2024-09-13T21:24:42.030 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T21:24:42.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T21:24:42.160 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904198 branch: squid description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904198' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3819 sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 sleep_before_teardown: 0 subset: 43/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 targets: smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGq/nnC54JVr6gwAhm1aUkroffNS1Cu4HvMemeZ/PFr7sAL4TZqt1b9Ui3iV2OsxInrB1B07NYCF0V4VtXKfKIg= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfE2UMbW1ujK3ShwpdGKltlbDmFVtbp12BApyyXjDrSA4q2HaPTE49QQvQx6qyQGUcdnXhFGV29tdAXFQHCqEo= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_21:08:03 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-13T21:24:42.160 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa; will attempt to use it 2024-09-13T21:24:42.161 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks 2024-09-13T21:24:42.161 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T21:24:42.163 INFO:teuthology.task.internal:Checking packages... 2024-09-13T21:24:42.185 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ecab7be58963a5bd03910cd73eef66405d7fdd50' 2024-09-13T21:24:42.185 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:24:42.185 INFO:teuthology.packaging:ref: None 2024-09-13T21:24:42.185 INFO:teuthology.packaging:tag: None 2024-09-13T21:24:42.185 INFO:teuthology.packaging:branch: squid 2024-09-13T21:24:42.185 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:24:42.185 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-13T21:24:42.403 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-324.gecab7be5 2024-09-13T21:24:42.405 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T21:24:42.415 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T21:24:42.415 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T21:24:42.432 INFO:teuthology.task.internal:Saving configuration 2024-09-13T21:24:42.452 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T21:24:42.458 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T21:24:42.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 21:19:31.980947', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGq/nnC54JVr6gwAhm1aUkroffNS1Cu4HvMemeZ/PFr7sAL4TZqt1b9Ui3iV2OsxInrB1B07NYCF0V4VtXKfKIg='} 2024-09-13T21:24:42.521 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 21:19:31.982177', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfE2UMbW1ujK3ShwpdGKltlbDmFVtbp12BApyyXjDrSA4q2HaPTE49QQvQx6qyQGUcdnXhFGV29tdAXFQHCqEo='} 2024-09-13T21:24:42.521 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T21:24:42.532 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-13T21:24:42.532 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-13T21:24:42.532 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T21:24:42.600 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff278247ac0>, signals=[15]) 2024-09-13T21:24:42.601 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T21:24:42.607 INFO:teuthology.task.internal:Opening connections... 2024-09-13T21:24:42.607 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:24:42.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:24:42.692 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-09-13T21:24:42.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:24:42.779 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T21:24:42.785 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-09-13T21:24:42.804 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-09-13T21:24:42.804 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-09-13T21:24:42.862 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-09-13T21:24:42.862 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-09-13T21:24:42.862 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-09-13T21:24:42.862 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-09-13T21:24:42.862 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-09-13T21:24:42.862 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-09-13T21:24:42.862 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T21:24:42.863 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-09-13T21:24:42.863 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-09-13T21:24:42.863 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T21:24:42.863 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-09-13T21:24:42.863 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T21:24:42.864 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T21:24:42.864 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T21:24:42.865 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-09-13T21:24:42.889 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-09-13T21:24:42.908 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-09-13T21:24:42.908 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-09-13T21:24:42.970 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-09-13T21:24:42.970 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2024-09-13T21:24:42.970 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-09-13T21:24:42.970 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-09-13T21:24:42.971 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2024-09-13T21:24:42.971 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2024-09-13T21:24:42.971 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T21:24:42.971 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-09-13T21:24:42.971 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2024-09-13T21:24:42.972 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T21:24:42.972 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-09-13T21:24:42.972 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T21:24:42.972 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T21:24:42.972 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T21:24:42.973 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-09-13T21:24:43.005 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T21:24:43.014 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T21:24:43.021 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T21:24:43.021 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-09-13T21:24:43.024 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-09-13T21:24:43.041 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T21:24:43.047 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T21:24:43.047 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-09-13T21:24:43.082 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-09-13T21:24:43.188 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T21:24:43.255 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T21:24:43.269 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T21:24:43.269 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T21:24:43.270 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T21:24:43.270 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T21:24:43.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:24:43.288 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-13T21:24:43.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:24:43.289 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-09-13T21:24:43.346 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-503.el9.x86_64 2024-09-13T21:24:43.346 INFO:teuthology.task.kernel:Running kernel on smithi119: 5.14.0-503.el9.x86_64 2024-09-13T21:24:43.346 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum install -y kernel 2024-09-13T21:24:43.347 INFO:teuthology.orchestra.run.smithi155.stdout:5.14.0-503.el9.x86_64 2024-09-13T21:24:43.348 INFO:teuthology.task.kernel:Running kernel on smithi155: 5.14.0-503.el9.x86_64 2024-09-13T21:24:43.348 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum install -y kernel 2024-09-13T21:24:45.535 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-13T21:24:47.311 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-13T21:24:49.198 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.2 MB 00:03 2024-09-13T21:24:51.190 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-13T21:24:52.337 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.5 MB 00:01 2024-09-13T21:24:53.832 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-13T21:24:55.025 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-13T21:24:55.474 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-13T21:24:56.975 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-13T21:24:57.896 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-13T21:25:00.513 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-09-13T21:25:02.545 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T21:25:02.545 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T21:25:02.632 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:25:02.642 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:25:02.642 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-09-13T21:25:02.642 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:25:02.642 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:25:02.643 INFO:teuthology.orchestra.run.smithi119.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T21:25:02.643 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-13T21:25:02.643 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T21:25:02.643 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T21:25:02.643 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T21:25:02.643 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:25:02.643 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:25:02.643 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:25:02.643 INFO:teuthology.orchestra.run.smithi119.stdout:Install 4 Packages 2024-09-13T21:25:02.643 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:25:02.644 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 79 M 2024-09-13T21:25:02.644 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 126 M 2024-09-13T21:25:02.644 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:25:02.773 INFO:teuthology.orchestra.run.smithi119.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 267 kB/s | 23 kB 00:00 2024-09-13T21:25:03.351 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T21:25:05.374 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T21:25:05.374 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T21:25:05.458 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:25:05.466 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout:Install 4 Packages 2024-09-13T21:25:05.467 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:25:05.468 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 79 M 2024-09-13T21:25:05.468 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 126 M 2024-09-13T21:25:05.468 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:25:05.836 INFO:teuthology.orchestra.run.smithi155.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 255 kB/s | 23 kB 00:00 2024-09-13T21:25:06.219 INFO:teuthology.orchestra.run.smithi155.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-13T21:25:06.595 INFO:teuthology.orchestra.run.smithi155.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 38 MB/s | 29 MB 00:00 2024-09-13T21:25:06.748 INFO:teuthology.orchestra.run.smithi119.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-13T21:25:06.895 INFO:teuthology.orchestra.run.smithi155.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-13T21:25:06.895 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:25:06.896 INFO:teuthology.orchestra.run.smithi155.stdout:Total 55 MB/s | 79 MB 00:01 2024-09-13T21:25:07.577 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:25:07.946 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:25:07.946 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:25:08.920 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:25:08.920 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:25:10.247 INFO:teuthology.orchestra.run.smithi119.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.8 MB/s | 29 MB 00:07 2024-09-13T21:25:11.399 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:25:11.981 INFO:teuthology.orchestra.run.smithi119.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.7 MB/s | 35 MB 00:09 2024-09-13T21:25:11.981 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:25:11.982 INFO:teuthology.orchestra.run.smithi119.stdout:Total 8.4 MB/s | 79 MB 00:09 2024-09-13T21:25:12.144 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:25:12.244 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:25:12.664 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:25:13.016 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:25:13.016 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:25:13.955 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:25:13.955 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:25:15.066 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:25:15.197 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:25:16.392 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:25:17.066 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:25:17.151 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:25:19.959 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:25:20.006 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:25:20.047 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:25:20.103 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:25:24.931 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:25:24.952 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:25:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:25:29.920 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:26:03.185 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:26:03.224 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:26:03.583 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:26:03.583 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:26:03.583 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:26:03.583 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:26:04.407 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:26:04.407 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:26:04.407 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:26:04.407 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T21:26:04.407 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T21:26:04.407 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T21:26:04.407 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T21:26:04.407 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:26:04.407 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:26:04.770 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:26:04.852 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:26:04.853 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:26:04.853 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T21:26:04.853 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T21:26:04.853 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T21:26:04.853 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-13T21:26:04.853 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T21:26:04.854 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:26:04.912 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:26:04.912 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:26:04.912 DEBUG:teuthology.orchestra.run.smithi155:> sudo rpm -qi grub2-tools 2024-09-13T21:26:04.945 INFO:teuthology.orchestra.run.smithi155.stdout:Name : grub2-tools 2024-09-13T21:26:04.945 INFO:teuthology.orchestra.run.smithi155.stdout:Epoch : 1 2024-09-13T21:26:04.945 INFO:teuthology.orchestra.run.smithi155.stdout:Version : 2.06 2024-09-13T21:26:04.945 INFO:teuthology.orchestra.run.smithi155.stdout:Release : 82.el9 2024-09-13T21:26:04.945 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: x86_64 2024-09-13T21:26:04.945 INFO:teuthology.orchestra.run.smithi155.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T21:26:04.945 INFO:teuthology.orchestra.run.smithi155.stdout:Group : Unspecified 2024-09-13T21:26:04.945 INFO:teuthology.orchestra.run.smithi155.stdout:Size : 8274670 2024-09-13T21:26:04.945 INFO:teuthology.orchestra.run.smithi155.stdout:License : GPLv3+ 2024-09-13T21:26:04.945 INFO:teuthology.orchestra.run.smithi155.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:Packager : builder@centos.org 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:Vendor : CentOS 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:Summary : Support tools for GRUB. 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:Description : 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:hardware devices. 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:26:04.946 INFO:teuthology.orchestra.run.smithi155.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T21:26:04.947 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T21:26:04.947 INFO:teuthology.task.kernel:Updating grub on smithi155 to boot 5.14.0-505.el9.x86_64 2024-09-13T21:26:04.948 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T21:26:05.628 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2024-09-13T21:26:06.953 INFO:teuthology.orchestra.run.smithi155.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T21:26:06.985 INFO:teuthology.orchestra.run.smithi155.stderr:done 2024-09-13T21:26:06.988 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-09-13T21:26:07.003 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.7gG3UyJ5VJ 2024-09-13T21:26:07.004 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7gG3UyJ5VJ 2024-09-13T21:26:07.071 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.7gG3UyJ5VJ 2024-09-13T21:26:07.218 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.7gG3UyJ5VJ is 6KB 2024-09-13T21:26:07.267 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.7gG3UyJ5VJ 2024-09-13T21:26:07.282 DEBUG:teuthology.orchestra.run.smithi155:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T21:26:07.344 INFO:teuthology.orchestra.run.smithi155.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T21:26:07.344 INFO:teuthology.orchestra.run.smithi155.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T21:26:07.344 INFO:teuthology.orchestra.run.smithi155.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T21:26:07.345 INFO:teuthology.orchestra.run.smithi155.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T21:26:07.346 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T21:26:07.489 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2024-09-13T21:26:08.385 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:26:08.421 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:26:08.785 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:26:08.785 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T21:26:08.785 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T21:26:08.785 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T21:26:09.665 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T21:26:09.666 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:26:09.666 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:26:09.666 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T21:26:09.666 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T21:26:09.666 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T21:26:09.666 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T21:26:09.666 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:26:09.666 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:26:10.029 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:26:10.121 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:26:10.121 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:26:10.121 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T21:26:10.122 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T21:26:10.122 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T21:26:10.122 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-13T21:26:10.122 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T21:26:10.122 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T21:26:10.180 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T21:26:10.180 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T21:26:10.180 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -qi grub2-tools 2024-09-13T21:26:10.214 INFO:teuthology.orchestra.run.smithi119.stdout:Name : grub2-tools 2024-09-13T21:26:10.214 INFO:teuthology.orchestra.run.smithi119.stdout:Epoch : 1 2024-09-13T21:26:10.214 INFO:teuthology.orchestra.run.smithi119.stdout:Version : 2.06 2024-09-13T21:26:10.214 INFO:teuthology.orchestra.run.smithi119.stdout:Release : 82.el9 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: x86_64 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Group : Unspecified 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Size : 8274670 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:License : GPLv3+ 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Packager : builder@centos.org 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Vendor : CentOS 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Summary : Support tools for GRUB. 2024-09-13T21:26:10.215 INFO:teuthology.orchestra.run.smithi119.stdout:Description : 2024-09-13T21:26:10.216 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:26:10.216 INFO:teuthology.orchestra.run.smithi119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T21:26:10.216 INFO:teuthology.orchestra.run.smithi119.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T21:26:10.216 INFO:teuthology.orchestra.run.smithi119.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T21:26:10.216 INFO:teuthology.orchestra.run.smithi119.stdout:hardware devices. 2024-09-13T21:26:10.216 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:26:10.216 INFO:teuthology.orchestra.run.smithi119.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T21:26:10.217 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T21:26:10.217 INFO:teuthology.task.kernel:Updating grub on smithi119 to boot 5.14.0-505.el9.x86_64 2024-09-13T21:26:10.217 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T21:26:10.798 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2024-09-13T21:26:12.163 INFO:teuthology.orchestra.run.smithi119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T21:26:12.192 INFO:teuthology.orchestra.run.smithi119.stderr:done 2024-09-13T21:26:12.194 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-13T21:26:12.210 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.0QLVk98zk2 2024-09-13T21:26:12.211 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0QLVk98zk2 2024-09-13T21:26:12.286 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.0QLVk98zk2 2024-09-13T21:26:12.423 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.0QLVk98zk2 is 6KB 2024-09-13T21:26:12.471 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.0QLVk98zk2 2024-09-13T21:26:12.486 DEBUG:teuthology.orchestra.run.smithi119:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T21:26:12.549 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T21:26:12.549 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T21:26:12.550 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T21:26:12.550 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T21:26:12.551 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T21:26:12.696 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2024-09-13T21:26:37.499 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-13T21:26:37.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-13T21:26:37.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:26:42.701 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-13T21:26:42.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-13T21:26:42.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:27:12.193 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-09-13T21:27:21.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-13T21:27:21.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:27:42.733 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T21:27:51.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-13T21:27:51.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:27:52.066 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-13T21:27:52.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-13T21:27:52.454 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T21:27:52.454 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-13T21:27:52.468 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-505.el9.x86_64 2024-09-13T21:27:52.468 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T21:27:52.469 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T21:27:52.469 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T21:27:53.470 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-13T21:27:53.470 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T21:27:53.590 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2024-09-13T21:27:53.618 DEBUG:teuthology.parallel:result is None 2024-09-13T21:28:21.215 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T21:28:33.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-13T21:28:33.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:28:33.626 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-09-13T21:28:33.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-13T21:28:33.987 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T21:28:33.987 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-09-13T21:28:34.003 INFO:teuthology.orchestra.run.smithi155.stdout:5.14.0-505.el9.x86_64 2024-09-13T21:28:34.003 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T21:28:34.003 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T21:28:34.003 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T21:28:35.004 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-13T21:28:35.004 DEBUG:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T21:28:35.074 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2024-09-13T21:28:35.096 DEBUG:teuthology.parallel:result is None 2024-09-13T21:28:35.097 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T21:28:35.104 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T21:28:35.104 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T21:28:35.107 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T21:28:35.125 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T21:28:35.131 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T21:28:35.141 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T21:28:35.142 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T21:28:35.168 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T21:28:35.202 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T21:28:35.209 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T21:28:35.210 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T21:28:35.236 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T21:28:35.268 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:28:35.275 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:28:35.278 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:28:35.287 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T21:28:35.289 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T21:28:35.296 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T21:28:35.297 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T21:28:35.331 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T21:28:35.358 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T21:28:35.367 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T21:28:35.368 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T21:28:35.401 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T21:28:35.420 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:28:35.504 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:28:35.557 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:28:35.653 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:28:35.681 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:28:35.681 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T21:28:35.747 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:28:35.801 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T21:28:35.842 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:28:35.934 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T21:28:35.967 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:28:35.967 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T21:28:36.032 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-09-13T21:28:36.034 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-09-13T21:28:36.075 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T21:28:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T21:28:36.614 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T21:28:36.621 INFO:teuthology.task.internal:Starting timer... 2024-09-13T21:28:36.622 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T21:28:36.692 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T21:28:36.702 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-13T21:28:36.702 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2024-09-13T21:28:36.749 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2024-09-13T21:28:36.750 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2024-09-13T21:28:36.793 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2024-09-13T21:28:36.795 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T21:28:36.795 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2024-09-13T21:28:36.815 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2024-09-13T21:28:36.815 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2024-09-13T21:28:36.931 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2024-09-13T21:28:36.931 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi119.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive'} 2024-09-13T21:28:36.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T21:28:36.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:28:36.959 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T21:28:36.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:28:36.985 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T21:28:36.985 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2024-09-13T21:28:37.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2024-09-13T21:28:37.095 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T21:28:37.106 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T21:28:37.120 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T21:28:37.121 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi119.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T21:32:24.720 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2024-09-13T21:32:24.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-13T21:32:24.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:32:24.809 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-13T21:32:24.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-13T21:32:24.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-13T21:32:24.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:32:25.010 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-09-13T21:32:25.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-13T21:32:25.099 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T21:32:25.112 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T21:32:25.113 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T21:32:25.113 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T21:32:25.116 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T21:32:25.116 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T21:32:25.143 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T21:32:25.159 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T21:32:25.173 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T21:32:25.183 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2024-09-13T21:32:25.189 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T21:32:25.194 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2024-09-13T21:32:25.210 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T21:32:25.215 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2024-09-13T21:32:25.222 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T21:32:25.227 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2024-09-13T21:32:25.242 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T21:32:25.257 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T21:32:25.277 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-13T21:32:25.280 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T21:32:25.280 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-13T21:32:25.280 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:32:25.280 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:32:25.280 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:32:25.280 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:32:25.314 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-09-13T21:32:25.317 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T21:32:25.317 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-09-13T21:32:25.317 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:32:25.318 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:32:25.318 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:32:25.318 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T21:32:25.319 INFO:teuthology.run_tasks:Running task install... 2024-09-13T21:32:25.326 DEBUG:teuthology.task.install:project ceph 2024-09-13T21:32:25.326 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}} 2024-09-13T21:32:25.327 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T21:32:25.327 INFO:teuthology.task.install:Using flavor: default 2024-09-13T21:32:25.332 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T21:32:25.333 INFO:teuthology.task.install:extra packages: [] 2024-09-13T21:32:25.333 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': None, 'wait_for_package': False} 2024-09-13T21:32:25.333 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:32:25.333 INFO:teuthology.packaging:ref: None 2024-09-13T21:32:25.334 INFO:teuthology.packaging:tag: None 2024-09-13T21:32:25.334 INFO:teuthology.packaging:branch: quincy 2024-09-13T21:32:25.334 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:32:25.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T21:32:25.336 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': None, 'wait_for_package': False} 2024-09-13T21:32:25.336 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:32:25.336 INFO:teuthology.packaging:ref: None 2024-09-13T21:32:25.336 INFO:teuthology.packaging:tag: None 2024-09-13T21:32:25.336 INFO:teuthology.packaging:branch: quincy 2024-09-13T21:32:25.336 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:32:25.336 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T21:32:25.547 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/ 2024-09-13T21:32:25.548 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1629.geb16b97b 2024-09-13T21:32:25.584 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/ 2024-09-13T21:32:25.585 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1629.geb16b97b 2024-09-13T21:32:25.688 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T21:32:25.688 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:32:25.688 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T21:32:25.703 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T21:32:25.703 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:32:25.703 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T21:32:25.714 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T21:32:25.714 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:32:25.714 INFO:teuthology.packaging:ref: None 2024-09-13T21:32:25.714 INFO:teuthology.packaging:tag: None 2024-09-13T21:32:25.715 INFO:teuthology.packaging:branch: quincy 2024-09-13T21:32:25.715 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:32:25.715 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T21:32:25.729 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T21:32:25.730 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:32:25.730 INFO:teuthology.packaging:ref: None 2024-09-13T21:32:25.730 INFO:teuthology.packaging:tag: None 2024-09-13T21:32:25.730 INFO:teuthology.packaging:branch: quincy 2024-09-13T21:32:25.730 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:32:25.730 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T21:32:25.781 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T21:32:25.796 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T21:32:25.857 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T21:32:25.873 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T21:32:25.921 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2024-09-13T21:32:25.923 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2024-09-13T21:32:25.937 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2024-09-13T21:32:25.939 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2024-09-13T21:32:26.149 INFO:teuthology.orchestra.run.smithi119.stdout:45 files removed 2024-09-13T21:32:26.168 INFO:teuthology.orchestra.run.smithi155.stdout:45 files removed 2024-09-13T21:32:26.175 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw 2024-09-13T21:32:26.196 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw 2024-09-13T21:32:26.735 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 280 kB/s | 77 kB 00:00 2024-09-13T21:32:26.749 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 292 kB/s | 77 kB 00:00 2024-09-13T21:32:27.002 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T21:32:27.034 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-13T21:32:27.261 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 8.0 kB/s | 1.8 kB 00:00 2024-09-13T21:32:27.383 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 5.7 kB/s | 1.8 kB 00:00 2024-09-13T21:32:27.814 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-13T21:32:28.117 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-13T21:32:30.996 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 20 MB 00:02 2024-09-13T21:32:32.402 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 20 MB 00:03 2024-09-13T21:32:36.886 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-13T21:32:36.913 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-13T21:32:38.337 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 19 kB 00:00 2024-09-13T21:32:38.464 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 19 kB 00:00 2024-09-13T21:32:39.533 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-13T21:32:39.651 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-13T21:32:44.930 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-13T21:32:44.990 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-13T21:32:47.348 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:32:47.358 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:32:47.358 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-13T21:32:47.358 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:32:47.358 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:32:47.358 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 14 M 2024-09-13T21:32:47.358 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2024-09-13T21:32:47.358 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.1 M 2024-09-13T21:32:47.358 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T21:32:47.359 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-13T21:32:47.359 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 5.0 M 2024-09-13T21:32:47.359 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 23 M 2024-09-13T21:32:47.359 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T21:32:47.359 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T21:32:47.359 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 636 k 2024-09-13T21:32:47.359 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T21:32:47.359 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T21:32:47.359 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T21:32:47.359 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 458 k 2024-09-13T21:32:47.360 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T21:32:47.360 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 4.9 M 2024-09-13T21:32:47.360 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T21:32:47.360 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T21:32:47.360 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 45 k 2024-09-13T21:32:47.360 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 120 k 2024-09-13T21:32:47.360 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 157 k 2024-09-13T21:32:47.360 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T21:32:47.360 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 320 k 2024-09-13T21:32:47.361 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 296 k 2024-09-13T21:32:47.361 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 99 k 2024-09-13T21:32:47.361 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T21:32:47.361 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:32:47.361 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:32:47.361 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:32:47.361 INFO:teuthology.orchestra.run.smithi119.stdout:Install 22 Packages 2024-09-13T21:32:47.361 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 2 Packages 2024-09-13T21:32:47.361 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:32:47.362 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 58 M 2024-09-13T21:32:47.362 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:32:47.382 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:32:47.396 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:32:47.396 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-13T21:32:47.396 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:32:47.396 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:32:47.396 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 14 M 2024-09-13T21:32:47.396 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2024-09-13T21:32:47.396 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.1 M 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 5.0 M 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 23 M 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 636 k 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 458 k 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T21:32:47.397 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 4.9 M 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 45 k 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 120 k 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 157 k 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 320 k 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 296 k 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 99 k 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:32:47.398 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:32:47.399 INFO:teuthology.orchestra.run.smithi155.stdout:Install 22 Packages 2024-09-13T21:32:47.399 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 2 Packages 2024-09-13T21:32:47.399 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:32:47.399 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 58 M 2024-09-13T21:32:47.399 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:32:47.924 INFO:teuthology.orchestra.run.smithi119.stdout:(1/24): ceph-base-17.2.7-1629.geb16b97b.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-13T21:32:47.983 INFO:teuthology.orchestra.run.smithi119.stdout:(2/24): ceph-selinux-17.2.7-1629.geb16b97b.el9. 431 kB/s | 25 kB 00:00 2024-09-13T21:32:48.091 INFO:teuthology.orchestra.run.smithi119.stdout:(3/24): libcephfs2-17.2.7-1629.geb16b97b.el9.x8 5.8 MB/s | 636 kB 00:00 2024-09-13T21:32:48.209 INFO:teuthology.orchestra.run.smithi119.stdout:(4/24): libradosstriper1-17.2.7-1629.geb16b97b. 3.8 MB/s | 458 kB 00:00 2024-09-13T21:32:48.492 INFO:teuthology.orchestra.run.smithi119.stdout:(5/24): librgw2-17.2.7-1629.geb16b97b.el9.x86_6 17 MB/s | 4.9 MB 00:00 2024-09-13T21:32:48.709 INFO:teuthology.orchestra.run.smithi119.stdout:(6/24): ceph-common-17.2.7-1629.geb16b97b.el9.x 18 MB/s | 23 MB 00:01 2024-09-13T21:32:48.735 INFO:teuthology.orchestra.run.smithi119.stdout:(7/24): python3-ceph-argparse-17.2.7-1629.geb16 187 kB/s | 45 kB 00:00 2024-09-13T21:32:48.759 INFO:teuthology.orchestra.run.smithi119.stdout:(8/24): python3-ceph-common-17.2.7-1629.geb16b9 2.4 MB/s | 120 kB 00:00 2024-09-13T21:32:48.785 INFO:teuthology.orchestra.run.smithi119.stdout:(9/24): python3-cephfs-17.2.7-1629.geb16b97b.el 3.1 MB/s | 157 kB 00:00 2024-09-13T21:32:48.810 INFO:teuthology.orchestra.run.smithi119.stdout:(10/24): python3-rados-17.2.7-1629.geb16b97b.el 6.2 MB/s | 320 kB 00:00 2024-09-13T21:32:48.835 INFO:teuthology.orchestra.run.smithi119.stdout:(11/24): python3-rbd-17.2.7-1629.geb16b97b.el9. 5.8 MB/s | 296 kB 00:00 2024-09-13T21:32:48.860 INFO:teuthology.orchestra.run.smithi119.stdout:(12/24): python3-rgw-17.2.7-1629.geb16b97b.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T21:32:48.949 INFO:teuthology.orchestra.run.smithi155.stdout:(1/24): ceph-base-17.2.7-1629.geb16b97b.el9.x86 4.1 MB/s | 5.0 MB 00:01 2024-09-13T21:32:48.990 INFO:teuthology.orchestra.run.smithi155.stdout:(2/24): ceph-selinux-17.2.7-1629.geb16b97b.el9. 610 kB/s | 25 kB 00:00 2024-09-13T21:32:49.011 INFO:teuthology.orchestra.run.smithi119.stdout:(13/24): ceph-radosgw-17.2.7-1629.geb16b97b.el9 9.2 MB/s | 14 MB 00:01 2024-09-13T21:32:49.066 INFO:teuthology.orchestra.run.smithi155.stdout:(3/24): libcephfs2-17.2.7-1629.geb16b97b.el9.x8 8.3 MB/s | 636 kB 00:00 2024-09-13T21:32:49.077 INFO:teuthology.orchestra.run.smithi119.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 661 kB/s | 160 kB 00:00 2024-09-13T21:32:49.103 INFO:teuthology.orchestra.run.smithi119.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 187 kB/s | 45 kB 00:00 2024-09-13T21:32:49.141 INFO:teuthology.orchestra.run.smithi155.stdout:(4/24): libradosstriper1-17.2.7-1629.geb16b97b. 6.0 MB/s | 458 kB 00:00 2024-09-13T21:32:49.145 INFO:teuthology.orchestra.run.smithi119.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-13T21:32:49.179 INFO:teuthology.orchestra.run.smithi119.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 561 kB/s | 42 kB 00:00 2024-09-13T21:32:49.221 INFO:teuthology.orchestra.run.smithi119.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-13T21:32:49.246 INFO:teuthology.orchestra.run.smithi119.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 728 kB/s | 49 kB 00:00 2024-09-13T21:32:49.288 INFO:teuthology.orchestra.run.smithi119.stdout:(20/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-13T21:32:49.321 INFO:teuthology.orchestra.run.smithi119.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 683 kB/s | 67 kB 00:00 2024-09-13T21:32:49.363 INFO:teuthology.orchestra.run.smithi119.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-13T21:32:49.458 INFO:teuthology.orchestra.run.smithi155.stdout:(5/24): ceph-radosgw-17.2.7-1629.geb16b97b.el9. 8.4 MB/s | 14 MB 00:01 2024-09-13T21:32:49.472 INFO:teuthology.orchestra.run.smithi119.stdout:(23/24): librados2-17.2.7-1629.geb16b97b.el9.x8 17 MB/s | 3.1 MB 00:00 2024-09-13T21:32:49.525 INFO:teuthology.orchestra.run.smithi155.stdout:(6/24): python3-ceph-argparse-17.2.7-1629.geb16 679 kB/s | 45 kB 00:00 2024-09-13T21:32:49.539 INFO:teuthology.orchestra.run.smithi119.stdout:(24/24): librbd1-17.2.7-1629.geb16b97b.el9.x86_ 14 MB/s | 2.9 MB 00:00 2024-09-13T21:32:49.544 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:32:49.544 INFO:teuthology.orchestra.run.smithi119.stdout:Total 27 MB/s | 58 MB 00:02 2024-09-13T21:32:49.609 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:32:49.617 INFO:teuthology.orchestra.run.smithi155.stdout:(7/24): librgw2-17.2.7-1629.geb16b97b.el9.x86_6 10 MB/s | 4.9 MB 00:00 2024-09-13T21:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:32:49.642 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:32:49.643 INFO:teuthology.orchestra.run.smithi155.stdout:(8/24): python3-ceph-common-17.2.7-1629.geb16b9 1.0 MB/s | 120 kB 00:00 2024-09-13T21:32:49.667 INFO:teuthology.orchestra.run.smithi155.stdout:(9/24): python3-cephfs-17.2.7-1629.geb16b97b.el 3.1 MB/s | 157 kB 00:00 2024-09-13T21:32:49.701 INFO:teuthology.orchestra.run.smithi155.stdout:(10/24): python3-rados-17.2.7-1629.geb16b97b.el 5.3 MB/s | 320 kB 00:00 2024-09-13T21:32:49.726 INFO:teuthology.orchestra.run.smithi155.stdout:(11/24): python3-rbd-17.2.7-1629.geb16b97b.el9. 4.9 MB/s | 296 kB 00:00 2024-09-13T21:32:49.797 INFO:teuthology.orchestra.run.smithi155.stdout:(12/24): python3-rgw-17.2.7-1629.geb16b97b.el9. 1.0 MB/s | 99 kB 00:00 2024-09-13T21:32:50.185 INFO:teuthology.orchestra.run.smithi155.stdout:(13/24): ceph-common-17.2.7-1629.geb16b97b.el9. 9.2 MB/s | 23 MB 00:02 2024-09-13T21:32:50.211 INFO:teuthology.orchestra.run.smithi155.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 110 kB/s | 45 kB 00:00 2024-09-13T21:32:50.297 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:32:50.297 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:32:50.386 INFO:teuthology.orchestra.run.smithi155.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 243 kB/s | 160 kB 00:00 2024-09-13T21:32:50.503 INFO:teuthology.orchestra.run.smithi155.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 362 kB/s | 42 kB 00:00 2024-09-13T21:32:50.553 INFO:teuthology.orchestra.run.smithi155.stdout:(17/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.0 MB/s | 308 kB 00:00 2024-09-13T21:32:50.578 INFO:teuthology.orchestra.run.smithi155.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T21:32:50.604 INFO:teuthology.orchestra.run.smithi155.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T21:32:50.662 INFO:teuthology.orchestra.run.smithi155.stdout:(20/24): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-13T21:32:50.688 INFO:teuthology.orchestra.run.smithi155.stdout:(21/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 613 kB/s | 292 kB 00:00 2024-09-13T21:32:50.871 INFO:teuthology.orchestra.run.smithi155.stdout:(22/24): librbd1-17.2.7-1629.geb16b97b.el9.x86_ 16 MB/s | 2.9 MB 00:00 2024-09-13T21:32:50.905 INFO:teuthology.orchestra.run.smithi155.stdout:(23/24): librdkafka-1.6.1-102.el9.x86_64.rpm 921 kB/s | 662 kB 00:00 2024-09-13T21:32:50.955 INFO:teuthology.orchestra.run.smithi155.stdout:(24/24): librados2-17.2.7-1629.geb16b97b.el9.x8 11 MB/s | 3.1 MB 00:00 2024-09-13T21:32:50.958 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:32:50.959 INFO:teuthology.orchestra.run.smithi155.stdout:Total 16 MB/s | 58 MB 00:03 2024-09-13T21:32:51.020 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:32:51.054 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:32:51.054 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:32:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:32:51.727 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:32:51.727 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:32:52.030 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-13T21:32:52.091 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T21:32:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T21:32:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 3/26 2024-09-13T21:32:52.300 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T21:32:52.389 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T21:32:52.441 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-13T21:32:52.472 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-13T21:32:52.908 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-13T21:32:52.937 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/26 2024-09-13T21:32:52.962 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:32:52.999 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/26 2024-09-13T21:32:53.027 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-13T21:32:53.071 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9. 10/26 2024-09-13T21:32:53.107 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 11/26 2024-09-13T21:32:53.169 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 12/26 2024-09-13T21:32:53.197 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 13/26 2024-09-13T21:32:53.255 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 13/26 2024-09-13T21:32:53.298 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-13T21:32:53.331 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-13T21:32:53.336 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-13T21:32:53.364 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-13T21:32:53.399 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T21:32:53.491 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T21:32:53.586 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 3/26 2024-09-13T21:32:53.609 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T21:32:53.656 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-13T21:32:53.698 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T21:32:53.701 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 18/26 2024-09-13T21:32:53.743 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-13T21:32:53.781 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-13T21:32:53.790 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 18/26 2024-09-13T21:32:53.865 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 19/26 2024-09-13T21:32:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x8 20/26 2024-09-13T21:32:54.216 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-13T21:32:54.246 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/26 2024-09-13T21:32:54.300 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/26 2024-09-13T21:32:54.329 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-13T21:32:54.372 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9. 10/26 2024-09-13T21:32:54.408 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 11/26 2024-09-13T21:32:54.471 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 12/26 2024-09-13T21:32:54.499 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 13/26 2024-09-13T21:32:54.564 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 13/26 2024-09-13T21:32:54.614 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-13T21:32:54.649 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-13T21:32:54.690 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-13T21:32:54.992 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-13T21:32:55.145 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 18/26 2024-09-13T21:32:55.234 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 18/26 2024-09-13T21:32:55.307 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 19/26 2024-09-13T21:32:55.339 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x8 20/26 2024-09-13T21:32:56.368 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T21:32:56.400 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T21:32:56.920 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T21:32:56.953 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 22/26 2024-09-13T21:32:57.051 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 22/26 2024-09-13T21:32:57.051 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T21:32:57.052 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T21:32:57.052 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:32:57.088 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T21:32:57.722 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T21:32:57.761 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T21:32:58.284 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T21:32:58.323 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 22/26 2024-09-13T21:32:58.424 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 22/26 2024-09-13T21:32:58.424 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T21:32:58.424 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T21:32:58.424 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:32:58.466 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T21:33:06.922 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T21:33:06.922 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2024-09-13T21:33:06.922 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2024-09-13T21:33:06.922 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2024-09-13T21:33:06.922 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2024-09-13T21:33:06.922 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2024-09-13T21:33:06.922 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /root 2024-09-13T21:33:06.922 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2024-09-13T21:33:06.923 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:08.077 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T21:33:08.077 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2024-09-13T21:33:08.078 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2024-09-13T21:33:08.078 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2024-09-13T21:33:08.078 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2024-09-13T21:33:08.078 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2024-09-13T21:33:08.078 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /root 2024-09-13T21:33:08.078 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2024-09-13T21:33:08.078 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:08.254 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 24/26 2024-09-13T21:33:08.333 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 24/26 2024-09-13T21:33:08.333 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:08.333 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T21:33:08.333 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:33:08.333 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:33:08.333 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:08.335 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T21:33:08.424 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T21:33:08.424 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T21:33:09.414 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 24/26 2024-09-13T21:33:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 24/26 2024-09-13T21:33:09.492 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:09.492 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T21:33:09.492 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:33:09.492 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T21:33:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T21:33:09.584 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T21:33:09.584 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T21:33:09.649 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T21:33:09.649 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 1/26 2024-09-13T21:33:09.649 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T21:33:09.652 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 3/26 2024-09-13T21:33:09.652 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T21:33:09.652 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 5/26 2024-09-13T21:33:09.653 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 6/26 2024-09-13T21:33:09.653 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 7/26 2024-09-13T21:33:09.653 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9. 8/26 2024-09-13T21:33:09.653 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x8 9/26 2024-09-13T21:33:09.653 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 10/26 2024-09-13T21:33:09.653 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 11/26 2024-09-13T21:33:09.654 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 12/26 2024-09-13T21:33:09.654 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 13/26 2024-09-13T21:33:09.654 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-13T21:33:09.654 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-13T21:33:09.654 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-13T21:33:09.655 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-13T21:33:09.655 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-13T21:33:09.655 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-13T21:33:09.655 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-13T21:33:09.655 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-13T21:33:09.655 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-13T21:33:09.656 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T21:33:09.656 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-13T21:33:09.656 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 25/26 2024-09-13T21:33:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T21:33:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:10.579 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2024-09-13T21:33:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.579 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.579 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T21:33:10.580 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:10.581 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:33:10.872 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T21:33:10.872 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 1/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 3/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 5/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 6/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 7/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9. 8/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x8 9/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 10/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 11/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 12/26 2024-09-13T21:33:10.873 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 13/26 2024-09-13T21:33:10.874 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-13T21:33:10.874 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-13T21:33:10.874 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-13T21:33:10.874 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-13T21:33:10.874 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-13T21:33:10.874 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-13T21:33:10.874 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-13T21:33:10.874 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-13T21:33:10.874 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-13T21:33:10.874 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T21:33:10.875 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-13T21:33:10.875 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 25/26 2024-09-13T21:33:10.925 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-test 2024-09-13T21:33:11.499 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:27 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:11.633 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 48 M 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 163 k 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:33:11.634 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:11.635 INFO:teuthology.orchestra.run.smithi119.stdout:Install 4 Packages 2024-09-13T21:33:11.635 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:11.635 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 48 M 2024-09-13T21:33:11.635 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 193 M 2024-09-13T21:33:11.635 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:33:11.823 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T21:33:11.823 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:11.823 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2024-09-13T21:33:11.823 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.823 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.823 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:33:11.824 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.824 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.824 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.824 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.824 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T21:33:11.824 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.824 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T21:33:11.824 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T21:33:11.824 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T21:33:11.824 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.824 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T21:33:11.825 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:11.826 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:33:11.945 INFO:teuthology.orchestra.run.smithi119.stdout:(1/4): libcephsqlite-17.2.7-1629.geb16b97b.el9. 785 kB/s | 163 kB 00:00 2024-09-13T21:33:12.201 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-test 2024-09-13T21:33:12.287 INFO:teuthology.orchestra.run.smithi119.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 554 kB/s | 304 kB 00:00 2024-09-13T21:33:12.303 INFO:teuthology.orchestra.run.smithi119.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 178 kB/s | 64 kB 00:00 2024-09-13T21:33:12.775 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:28 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:12.914 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:33:12.915 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:12.915 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-13T21:33:12.915 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:12.915 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:33:12.915 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 48 M 2024-09-13T21:33:12.915 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-13T21:33:12.915 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 163 k 2024-09-13T21:33:12.915 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T21:33:12.915 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T21:33:12.916 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:12.916 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:33:12.916 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:12.916 INFO:teuthology.orchestra.run.smithi155.stdout:Install 4 Packages 2024-09-13T21:33:12.916 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:12.916 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 48 M 2024-09-13T21:33:12.916 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 193 M 2024-09-13T21:33:12.917 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:33:13.237 INFO:teuthology.orchestra.run.smithi119.stdout:(4/4): ceph-test-17.2.7-1629.geb16b97b.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-13T21:33:13.239 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:13.240 INFO:teuthology.orchestra.run.smithi119.stdout:Total 30 MB/s | 48 MB 00:01 2024-09-13T21:33:13.240 INFO:teuthology.orchestra.run.smithi155.stdout:(1/4): libcephsqlite-17.2.7-1629.geb16b97b.el9. 729 kB/s | 163 kB 00:00 2024-09-13T21:33:13.268 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:33:13.287 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:33:13.287 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:33:13.290 INFO:teuthology.orchestra.run.smithi155.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.1 MB/s | 304 kB 00:00 2024-09-13T21:33:13.407 INFO:teuthology.orchestra.run.smithi155.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 381 kB/s | 64 kB 00:00 2024-09-13T21:33:13.654 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:33:13.655 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:33:14.214 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:33:14.281 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T21:33:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T21:33:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 3/4 2024-09-13T21:33:14.574 INFO:teuthology.orchestra.run.smithi155.stdout:(4/4): ceph-test-17.2.7-1629.geb16b97b.el9.x86_ 31 MB/s | 48 MB 00:01 2024-09-13T21:33:14.576 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:14.577 INFO:teuthology.orchestra.run.smithi155.stdout:Total 29 MB/s | 48 MB 00:01 2024-09-13T21:33:14.604 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:33:14.623 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:33:14.624 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:33:14.990 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:33:14.990 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:33:15.519 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:33:15.610 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T21:33:15.667 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T21:33:15.693 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 3/4 2024-09-13T21:33:18.772 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 3/4 2024-09-13T21:33:18.855 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 4/4 2024-09-13T21:33:20.123 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 3/4 2024-09-13T21:33:20.199 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 4/4 2024-09-13T21:33:21.024 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 4/4 2024-09-13T21:33:21.024 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 1/4 2024-09-13T21:33:21.024 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 2/4 2024-09-13T21:33:21.024 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T21:33:21.341 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T21:33:21.341 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:21.341 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:33:21.341 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:21.342 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:21.342 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T21:33:21.342 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T21:33:21.342 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:21.342 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:33:21.639 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph 2024-09-13T21:33:22.206 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:38 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:22.351 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:33:22.353 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:22.353 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-13T21:33:22.354 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:22.354 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:33:22.354 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 6.5 k 2024-09-13T21:33:22.354 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-13T21:33:22.354 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.1 M 2024-09-13T21:33:22.354 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 1.4 M 2024-09-13T21:33:22.354 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 240 k 2024-09-13T21:33:22.354 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.9 M 2024-09-13T21:33:22.354 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 15 M 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T21:33:22.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T21:33:22.356 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T21:33:22.357 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T21:33:22.357 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T21:33:22.357 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T21:33:22.357 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T21:33:22.357 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:22.357 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:33:22.357 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:22.357 INFO:teuthology.orchestra.run.smithi119.stdout:Install 34 Packages 2024-09-13T21:33:22.357 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:22.358 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 27 M 2024-09-13T21:33:22.358 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 96 M 2024-09-13T21:33:22.358 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:33:22.455 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 4/4 2024-09-13T21:33:22.456 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 1/4 2024-09-13T21:33:22.456 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 2/4 2024-09-13T21:33:22.456 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T21:33:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T21:33:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:22.779 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:33:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T21:33:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T21:33:22.779 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:22.780 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:33:22.837 INFO:teuthology.orchestra.run.smithi119.stdout:(1/34): ceph-17.2.7-1629.geb16b97b.el9.x86_64.r 44 kB/s | 6.5 kB 00:00 2024-09-13T21:33:22.987 INFO:teuthology.orchestra.run.smithi119.stdout:(2/34): ceph-mgr-17.2.7-1629.geb16b97b.el9.x86_ 4.7 MB/s | 1.4 MB 00:00 2024-09-13T21:33:23.038 INFO:teuthology.orchestra.run.smithi119.stdout:(3/34): ceph-mds-17.2.7-1629.geb16b97b.el9.x86_ 6.0 MB/s | 2.1 MB 00:00 2024-09-13T21:33:23.050 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph 2024-09-13T21:33:23.105 INFO:teuthology.orchestra.run.smithi119.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1629.geb16 3.5 MB/s | 240 kB 00:00 2024-09-13T21:33:23.230 INFO:teuthology.orchestra.run.smithi119.stdout:(5/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-13T21:33:23.314 INFO:teuthology.orchestra.run.smithi119.stdout:(6/34): python3-cryptography-36.0.1-4.el9.x86_6 15 MB/s | 1.2 MB 00:00 2024-09-13T21:33:23.472 INFO:teuthology.orchestra.run.smithi119.stdout:(7/34): ceph-osd-17.2.7-1629.geb16b97b.el9.x86_ 32 MB/s | 15 MB 00:00 2024-09-13T21:33:23.497 INFO:teuthology.orchestra.run.smithi119.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 580 kB/s | 106 kB 00:00 2024-09-13T21:33:23.539 INFO:teuthology.orchestra.run.smithi119.stdout:(9/34): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-13T21:33:23.590 INFO:teuthology.orchestra.run.smithi119.stdout:(10/34): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-13T21:33:23.615 INFO:teuthology.orchestra.run.smithi119.stdout:(11/34): python3-pycparser-2.20-6.el9.noarch.rp 951 kB/s | 135 kB 00:00 2024-09-13T21:33:23.616 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:39 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:23.673 INFO:teuthology.orchestra.run.smithi119.stdout:(12/34): ceph-mon-17.2.7-1629.geb16b97b.el9.x86 4.7 MB/s | 3.9 MB 00:00 2024-09-13T21:33:23.758 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:33:23.760 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:23.760 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-13T21:33:23.760 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:23.760 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:33:23.760 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 6.5 k 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.1 M 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 1.4 M 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 240 k 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.9 M 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 15 M 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T21:33:23.761 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T21:33:23.762 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T21:33:23.765 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:33:23.766 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:23.767 INFO:teuthology.orchestra.run.smithi155.stdout:Install 34 Packages 2024-09-13T21:33:23.767 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:23.767 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 27 M 2024-09-13T21:33:23.767 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 96 M 2024-09-13T21:33:23.767 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:33:24.174 INFO:teuthology.orchestra.run.smithi119.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 62 kB/s | 35 kB 00:00 2024-09-13T21:33:24.299 INFO:teuthology.orchestra.run.smithi119.stdout:(14/34): python3-packaging-20.9-5.el9.noarch.rp 123 kB/s | 77 kB 00:00 2024-09-13T21:33:24.382 INFO:teuthology.orchestra.run.smithi119.stdout:(15/34): python3-mako-1.1.4-6.el9.noarch.rpm 217 kB/s | 172 kB 00:00 2024-09-13T21:33:24.451 INFO:teuthology.orchestra.run.smithi155.stdout:(1/34): ceph-17.2.7-1629.geb16b97b.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-13T21:33:24.455 INFO:teuthology.orchestra.run.smithi119.stdout:(16/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 600 kB/s | 43 kB 00:00 2024-09-13T21:33:24.492 INFO:teuthology.orchestra.run.smithi119.stdout:(17/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.0 MB/s | 172 kB 00:00 2024-09-13T21:33:24.525 INFO:teuthology.orchestra.run.smithi119.stdout:(18/34): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-13T21:33:24.550 INFO:teuthology.orchestra.run.smithi119.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 427 kB/s | 11 kB 00:00 2024-09-13T21:33:24.584 INFO:teuthology.orchestra.run.smithi119.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 705 kB/s | 18 kB 00:00 2024-09-13T21:33:24.609 INFO:teuthology.orchestra.run.smithi119.stdout:(21/34): python3-jaraco-collections-3.0.0-8.el9 934 kB/s | 23 kB 00:00 2024-09-13T21:33:24.626 INFO:teuthology.orchestra.run.smithi155.stdout:(2/34): ceph-mgr-17.2.7-1629.geb16b97b.el9.x86_ 4.8 MB/s | 1.4 MB 00:00 2024-09-13T21:33:24.634 INFO:teuthology.orchestra.run.smithi119.stdout:(22/34): python3-jaraco-functools-3.5.0-2.el9.n 781 kB/s | 19 kB 00:00 2024-09-13T21:33:24.668 INFO:teuthology.orchestra.run.smithi119.stdout:(23/34): python3-jaraco-text-3.2.0-6.el9.noarch 599 kB/s | 20 kB 00:00 2024-09-13T21:33:24.693 INFO:teuthology.orchestra.run.smithi119.stdout:(24/34): python3-logutils-0.3.5-21.el9.noarch.r 1.8 MB/s | 46 kB 00:00 2024-09-13T21:33:24.701 INFO:teuthology.orchestra.run.smithi155.stdout:(3/34): ceph-mds-17.2.7-1629.geb16b97b.el9.x86_ 5.6 MB/s | 2.1 MB 00:00 2024-09-13T21:33:24.719 INFO:teuthology.orchestra.run.smithi119.stdout:(25/34): python3-more-itertools-8.12.0-2.el9.no 3.1 MB/s | 79 kB 00:00 2024-09-13T21:33:24.744 INFO:teuthology.orchestra.run.smithi119.stdout:(26/34): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-13T21:33:24.769 INFO:teuthology.orchestra.run.smithi119.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 655 kB/s | 16 kB 00:00 2024-09-13T21:33:24.794 INFO:teuthology.orchestra.run.smithi155.stdout:(4/34): ceph-mon-17.2.7-1629.geb16b97b.el9.x86_ 11 MB/s | 3.9 MB 00:00 2024-09-13T21:33:24.794 INFO:teuthology.orchestra.run.smithi119.stdout:(28/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-13T21:33:24.819 INFO:teuthology.orchestra.run.smithi155.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1629.geb16 2.0 MB/s | 240 kB 00:00 2024-09-13T21:33:24.820 INFO:teuthology.orchestra.run.smithi119.stdout:(29/34): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-13T21:33:24.845 INFO:teuthology.orchestra.run.smithi119.stdout:(30/34): python3-webob-1.8.8-2.el9.noarch.rpm 9.0 MB/s | 230 kB 00:00 2024-09-13T21:33:24.879 INFO:teuthology.orchestra.run.smithi119.stdout:(31/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 13 MB/s | 427 kB 00:00 2024-09-13T21:33:24.904 INFO:teuthology.orchestra.run.smithi119.stdout:(32/34): python3-pytz-2021.1-5.el9.noarch.rpm 70 kB/s | 51 kB 00:00 2024-09-13T21:33:24.929 INFO:teuthology.orchestra.run.smithi119.stdout:(33/34): python3-toml-0.10.2-6.el9.noarch.rpm 66 kB/s | 42 kB 00:00 2024-09-13T21:33:24.955 INFO:teuthology.orchestra.run.smithi119.stdout:(34/34): python3-zc-lockfile-2.0-10.el9.noarch. 265 kB/s | 20 kB 00:00 2024-09-13T21:33:24.959 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:24.959 INFO:teuthology.orchestra.run.smithi119.stdout:Total 10 MB/s | 27 MB 00:02 2024-09-13T21:33:25.093 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:33:25.130 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:33:25.130 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:33:25.136 INFO:teuthology.orchestra.run.smithi155.stdout:(6/34): ceph-osd-17.2.7-1629.geb16b97b.el9.x86_ 30 MB/s | 15 MB 00:00 2024-09-13T21:33:25.528 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:33:25.528 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:33:25.761 INFO:teuthology.orchestra.run.smithi155.stdout:(7/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 262 kB/s | 253 kB 00:00 2024-09-13T21:33:25.869 INFO:teuthology.orchestra.run.smithi155.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 148 kB/s | 106 kB 00:00 2024-09-13T21:33:25.945 INFO:teuthology.orchestra.run.smithi155.stdout:(9/34): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-09-13T21:33:26.449 INFO:teuthology.orchestra.run.smithi155.stdout:(10/34): python3-pycparser-2.20-6.el9.noarch.rp 197 kB/s | 135 kB 00:00 2024-09-13T21:33:26.566 INFO:teuthology.orchestra.run.smithi155.stdout:(11/34): python3-requests-2.25.1-8.el9.noarch.r 179 kB/s | 125 kB 00:00 2024-09-13T21:33:26.616 INFO:teuthology.orchestra.run.smithi155.stdout:(12/34): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-13T21:33:26.666 INFO:teuthology.orchestra.run.smithi155.stdout:(13/34): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-13T21:33:26.700 INFO:teuthology.orchestra.run.smithi155.stdout:(14/34): python3-markupsafe-1.1.1-12.el9.x86_64 260 kB/s | 35 kB 00:00 2024-09-13T21:33:26.725 INFO:teuthology.orchestra.run.smithi155.stdout:(15/34): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-13T21:33:26.750 INFO:teuthology.orchestra.run.smithi155.stdout:(16/34): python3-urllib3-1.26.5-6.el9.noarch.rp 267 kB/s | 215 kB 00:00 2024-09-13T21:33:26.781 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:33:26.784 INFO:teuthology.orchestra.run.smithi155.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 497 kB/s | 42 kB 00:00 2024-09-13T21:33:26.818 INFO:teuthology.orchestra.run.smithi155.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 471 kB/s | 43 kB 00:00 2024-09-13T21:33:26.846 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-13T21:33:26.851 INFO:teuthology.orchestra.run.smithi155.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 446 kB/s | 11 kB 00:00 2024-09-13T21:33:26.873 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-13T21:33:26.876 INFO:teuthology.orchestra.run.smithi155.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 762 kB/s | 18 kB 00:00 2024-09-13T21:33:26.902 INFO:teuthology.orchestra.run.smithi155.stdout:(21/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-13T21:33:26.906 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-13T21:33:26.927 INFO:teuthology.orchestra.run.smithi155.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-13T21:33:26.953 INFO:teuthology.orchestra.run.smithi155.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-13T21:33:26.977 INFO:teuthology.orchestra.run.smithi155.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-09-13T21:33:26.997 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-13T21:33:27.003 INFO:teuthology.orchestra.run.smithi155.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-13T21:33:27.028 INFO:teuthology.orchestra.run.smithi155.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T21:33:27.054 INFO:teuthology.orchestra.run.smithi155.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 659 kB/s | 16 kB 00:00 2024-09-13T21:33:27.075 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-13T21:33:27.087 INFO:teuthology.orchestra.run.smithi155.stdout:(28/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-13T21:33:27.112 INFO:teuthology.orchestra.run.smithi155.stdout:(29/34): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-13T21:33:27.125 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-13T21:33:27.146 INFO:teuthology.orchestra.run.smithi155.stdout:(30/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 976 kB/s | 90 kB 00:00 2024-09-13T21:33:27.160 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-13T21:33:27.171 INFO:teuthology.orchestra.run.smithi155.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-13T21:33:27.190 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-13T21:33:27.197 INFO:teuthology.orchestra.run.smithi155.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-09-13T21:33:27.222 INFO:teuthology.orchestra.run.smithi155.stdout:(33/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-13T21:33:27.224 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-13T21:33:27.247 INFO:teuthology.orchestra.run.smithi155.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-13T21:33:27.253 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:27.253 INFO:teuthology.orchestra.run.smithi155.stdout:Total 7.8 MB/s | 27 MB 00:03 2024-09-13T21:33:27.258 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-13T21:33:27.290 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-13T21:33:27.325 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-13T21:33:27.359 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-13T21:33:27.388 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:33:27.402 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-13T21:33:27.426 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:33:27.426 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:33:27.453 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T21:33:27.532 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-13T21:33:27.688 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-13T21:33:27.767 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-13T21:33:27.821 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-13T21:33:27.843 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:33:27.843 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:33:27.859 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-13T21:33:27.907 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-13T21:33:27.963 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-13T21:33:28.149 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-13T21:33:28.196 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-13T21:33:28.273 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-13T21:33:28.371 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-13T21:33:28.412 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-13T21:33:28.529 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-13T21:33:28.680 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9. 29/34 2024-09-13T21:33:28.705 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 30/34 2024-09-13T21:33:28.732 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 30/34 2024-09-13T21:33:28.732 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:28.732 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T21:33:28.733 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:33:28.733 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:33:28.733 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:29.092 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:33:29.184 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-13T21:33:29.216 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-13T21:33:29.257 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-13T21:33:29.357 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-13T21:33:29.428 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-13T21:33:29.469 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-13T21:33:29.503 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-13T21:33:29.534 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-13T21:33:29.568 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-13T21:33:29.601 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-13T21:33:29.642 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-13T21:33:29.681 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-13T21:33:29.712 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-13T21:33:29.760 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-13T21:33:29.802 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T21:33:29.881 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-13T21:33:30.028 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-13T21:33:30.031 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 31/34 2024-09-13T21:33:30.059 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 31/34 2024-09-13T21:33:30.059 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:30.059 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T21:33:30.059 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:33:30.059 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:33:30.059 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:30.112 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-13T21:33:30.174 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-13T21:33:30.221 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-13T21:33:30.278 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-13T21:33:30.333 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-13T21:33:30.440 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 32/34 2024-09-13T21:33:30.464 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 32/34 2024-09-13T21:33:30.464 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:30.465 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T21:33:30.465 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:33:30.465 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:33:30.465 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:30.519 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-13T21:33:30.575 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-13T21:33:30.654 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-13T21:33:30.666 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 33/34 2024-09-13T21:33:30.689 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 33/34 2024-09-13T21:33:30.690 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:30.690 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T21:33:30.690 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:33:30.690 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:33:30.690 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:30.743 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-13T21:33:30.755 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 34/34 2024-09-13T21:33:30.783 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-13T21:33:30.906 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-13T21:33:31.063 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9. 29/34 2024-09-13T21:33:31.094 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 30/34 2024-09-13T21:33:31.120 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 30/34 2024-09-13T21:33:31.121 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:31.121 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T21:33:31.121 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:33:31.121 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T21:33:31.121 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:32.487 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 31/34 2024-09-13T21:33:32.498 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 34/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 1/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 2/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 3/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 4/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 5/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9. 6/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-13T21:33:32.499 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-13T21:33:32.500 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-13T21:33:32.500 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-13T21:33:32.500 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T21:33:32.500 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-13T21:33:32.500 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-13T21:33:32.500 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-13T21:33:32.500 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-13T21:33:32.500 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-13T21:33:32.500 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-13T21:33:32.500 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-13T21:33:32.501 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-13T21:33:32.501 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-13T21:33:32.501 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-13T21:33:32.502 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-13T21:33:32.502 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-13T21:33:32.502 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-13T21:33:32.502 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-13T21:33:32.502 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-13T21:33:32.502 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-13T21:33:32.502 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-13T21:33:32.502 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-13T21:33:32.517 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 31/34 2024-09-13T21:33:32.517 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:32.518 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T21:33:32.518 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:33:32.518 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T21:33:32.518 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:32.896 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 32/34 2024-09-13T21:33:32.921 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 32/34 2024-09-13T21:33:32.921 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:32.921 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T21:33:32.921 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:33:32.921 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T21:33:32.921 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:33.131 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 33/34 2024-09-13T21:33:33.154 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 33/34 2024-09-13T21:33:33.154 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:33.154 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T21:33:33.155 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:33:33.155 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T21:33:33.155 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:33.219 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 34/34 2024-09-13T21:33:33.494 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-13T21:33:33.494 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:33.494 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:33:33.494 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:33.494 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T21:33:33.495 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T21:33:33.496 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T21:33:33.496 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T21:33:33.496 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T21:33:33.496 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T21:33:33.496 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T21:33:33.496 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T21:33:33.496 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T21:33:33.496 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T21:33:33.496 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T21:33:33.496 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T21:33:33.496 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T21:33:33.497 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T21:33:33.497 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T21:33:33.497 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T21:33:33.497 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T21:33:33.497 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T21:33:33.497 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T21:33:33.497 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T21:33:33.497 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T21:33:33.497 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:33.497 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:33:33.906 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-base 2024-09-13T21:33:34.478 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:34.568 INFO:teuthology.orchestra.run.smithi119.stdout:Package ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:33:34.609 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:33:34.610 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-09-13T21:33:34.611 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:33:34.683 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install cephadm 2024-09-13T21:33:34.819 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 34/34 2024-09-13T21:33:34.819 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 1/34 2024-09-13T21:33:34.819 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 2/34 2024-09-13T21:33:34.819 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 3/34 2024-09-13T21:33:34.819 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 4/34 2024-09-13T21:33:34.819 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 5/34 2024-09-13T21:33:34.819 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9. 6/34 2024-09-13T21:33:34.819 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-13T21:33:34.819 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-13T21:33:34.820 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-13T21:33:34.821 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-13T21:33:35.245 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:35.376 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:33:35.376 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:35.376 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-13T21:33:35.376 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:35.376 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:33:35.376 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 83 k 2024-09-13T21:33:35.376 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:35.376 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:33:35.376 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:35.376 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-09-13T21:33:35.377 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:35.377 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 83 k 2024-09-13T21:33:35.377 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 375 k 2024-09-13T21:33:35.377 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:33:35.575 INFO:teuthology.orchestra.run.smithi119.stdout:cephadm-17.2.7-1629.geb16b97b.el9.noarch.rpm 418 kB/s | 83 kB 00:00 2024-09-13T21:33:35.576 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:35.576 INFO:teuthology.orchestra.run.smithi119.stdout:Total 415 kB/s | 83 kB 00:00 2024-09-13T21:33:35.576 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:33:35.581 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:33:35.581 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:33:35.583 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:33:35.583 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:33:35.651 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:33:35.868 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-13T21:33:35.868 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:35.868 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:33:35.868 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:35.868 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:35.868 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:35.868 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:33:35.869 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:35.869 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:35.869 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T21:33:35.869 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T21:33:35.869 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T21:33:35.869 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T21:33:35.869 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T21:33:35.869 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T21:33:35.869 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T21:33:35.869 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T21:33:35.870 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T21:33:35.871 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T21:33:35.871 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T21:33:35.871 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T21:33:35.871 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T21:33:35.871 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T21:33:35.871 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T21:33:35.871 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T21:33:35.871 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:35.871 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:33:36.041 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T21:33:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T21:33:36.248 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-base 2024-09-13T21:33:36.513 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T21:33:36.772 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T21:33:36.772 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:36.772 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:33:36.772 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:33:36.773 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:36.773 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:33:36.818 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:36.909 INFO:teuthology.orchestra.run.smithi155.stdout:Package ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:33:36.951 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:33:36.952 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-09-13T21:33:36.952 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:33:36.988 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T21:33:37.026 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install cephadm 2024-09-13T21:33:37.565 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:37.589 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:37.700 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:33:37.701 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:37.701 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2024-09-13T21:33:37.701 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:37.701 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:33:37.701 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 137 k 2024-09-13T21:33:37.701 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:37.701 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:33:37.701 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:37.701 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-09-13T21:33:37.701 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:37.702 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 137 k 2024-09-13T21:33:37.702 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 379 k 2024-09-13T21:33:37.702 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:33:37.720 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:33:37.721 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:37.721 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-13T21:33:37.721 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:37.721 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:33:37.721 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 83 k 2024-09-13T21:33:37.721 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:37.721 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:33:37.721 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:37.721 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-09-13T21:33:37.721 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:37.722 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 83 k 2024-09-13T21:33:37.722 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 375 k 2024-09-13T21:33:37.722 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:33:37.906 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-immutable-object-cache-17.2.7-1629.geb16b9 674 kB/s | 137 kB 00:00 2024-09-13T21:33:37.906 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:37.907 INFO:teuthology.orchestra.run.smithi119.stdout:Total 668 kB/s | 137 kB 00:00 2024-09-13T21:33:37.907 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:33:37.914 INFO:teuthology.orchestra.run.smithi155.stdout:cephadm-17.2.7-1629.geb16b97b.el9.noarch.rpm 432 kB/s | 83 kB 00:00 2024-09-13T21:33:37.914 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:33:37.915 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:33:37.915 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:37.915 INFO:teuthology.orchestra.run.smithi155.stdout:Total 428 kB/s | 83 kB 00:00 2024-09-13T21:33:37.915 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:33:37.920 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:33:37.920 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:33:37.922 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:33:37.922 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:33:37.971 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:33:37.971 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:33:37.999 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:33:38.124 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:33:38.182 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T21:33:38.207 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T21:33:38.207 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:38.207 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T21:33:38.207 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:38.474 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T21:33:38.569 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T21:33:38.920 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T21:33:39.162 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T21:33:39.163 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:39.163 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:33:39.163 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:33:39.163 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:39.163 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:33:39.163 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T21:33:39.163 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:33:39.163 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:39.164 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:33:39.376 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr 2024-09-13T21:33:39.436 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T21:33:39.944 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:55 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:40.006 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:40.037 INFO:teuthology.orchestra.run.smithi119.stdout:Package ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:33:40.079 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:33:40.080 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-09-13T21:33:40.081 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:33:40.139 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:33:40.140 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:40.140 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2024-09-13T21:33:40.140 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:40.140 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:33:40.140 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 137 k 2024-09-13T21:33:40.140 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:40.140 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:33:40.140 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:40.141 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-09-13T21:33:40.141 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:40.141 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 137 k 2024-09-13T21:33:40.141 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 379 k 2024-09-13T21:33:40.141 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:33:40.148 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T21:33:40.348 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-immutable-object-cache-17.2.7-1629.geb16b9 666 kB/s | 137 kB 00:00 2024-09-13T21:33:40.349 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:40.349 INFO:teuthology.orchestra.run.smithi155.stdout:Total 660 kB/s | 137 kB 00:00 2024-09-13T21:33:40.349 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:33:40.356 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:33:40.357 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:33:40.414 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:33:40.414 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:33:40.573 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:33:40.649 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T21:33:40.673 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T21:33:40.673 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:33:40.674 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T21:33:40.674 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:40.710 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:40.845 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:33:40.846 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:40.846 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-13T21:33:40.846 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:40.846 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:33:40.846 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 3.4 M 2024-09-13T21:33:40.846 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-13T21:33:40.846 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 24 k 2024-09-13T21:33:40.846 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 15 k 2024-09-13T21:33:40.846 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T21:33:40.846 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T21:33:40.846 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T21:33:40.847 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2024-09-13T21:33:40.847 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T21:33:40.847 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:40.847 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:33:40.847 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:40.847 INFO:teuthology.orchestra.run.smithi119.stdout:Install 7 Packages 2024-09-13T21:33:40.847 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:40.848 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 3.7 M 2024-09-13T21:33:40.848 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 80 M 2024-09-13T21:33:40.848 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:33:41.209 INFO:teuthology.orchestra.run.smithi119.stdout:(1/7): ceph-prometheus-alerts-17.2.7-1629.geb16 88 kB/s | 15 kB 00:00 2024-09-13T21:33:41.226 INFO:teuthology.orchestra.run.smithi119.stdout:(2/7): ceph-grafana-dashboards-17.2.7-1629.geb1 133 kB/s | 24 kB 00:00 2024-09-13T21:33:41.260 INFO:teuthology.orchestra.run.smithi119.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 180 kB/s | 9.0 kB 00:00 2024-09-13T21:33:41.285 INFO:teuthology.orchestra.run.smithi119.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-13T21:33:41.310 INFO:teuthology.orchestra.run.smithi119.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 487 kB/s | 41 kB 00:00 2024-09-13T21:33:41.343 INFO:teuthology.orchestra.run.smithi119.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-13T21:33:41.444 INFO:teuthology.orchestra.run.smithi119.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1629.geb16b97b 8.4 MB/s | 3.4 MB 00:00 2024-09-13T21:33:41.448 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:41.448 INFO:teuthology.orchestra.run.smithi119.stdout:Total 6.1 MB/s | 3.7 MB 00:00 2024-09-13T21:33:41.448 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:33:41.456 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:33:41.456 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:33:41.539 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:33:41.539 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:33:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T21:33:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:41.659 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:33:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:33:41.659 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:41.659 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:33:41.847 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:33:41.876 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr 2024-09-13T21:33:41.912 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T21:33:41.946 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T21:33:41.993 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T21:33:42.033 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T21:33:42.070 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.n 5/7 2024-09-13T21:33:42.467 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:58 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:42.560 INFO:teuthology.orchestra.run.smithi155.stdout:Package ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:33:42.603 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:33:42.603 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-09-13T21:33:42.603 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:33:42.688 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T21:33:43.069 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9. 6/7 2024-09-13T21:33:43.107 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 7/7 2024-09-13T21:33:43.263 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:59 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:43.396 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:33:43.397 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:43.397 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-13T21:33:43.397 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:43.397 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:33:43.397 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 3.4 M 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 24 k 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 15 k 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout:Installing weak dependencies: 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout:Install 7 Packages 2024-09-13T21:33:43.398 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:43.399 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 3.7 M 2024-09-13T21:33:43.399 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 80 M 2024-09-13T21:33:43.399 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:33:43.586 INFO:teuthology.orchestra.run.smithi155.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1629.geb1 153 kB/s | 24 kB 00:00 2024-09-13T21:33:43.611 INFO:teuthology.orchestra.run.smithi155.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1629.geb16 79 kB/s | 15 kB 00:00 2024-09-13T21:33:43.656 INFO:teuthology.orchestra.run.smithi155.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 136 kB/s | 9.0 kB 00:00 2024-09-13T21:33:43.679 INFO:teuthology.orchestra.run.smithi155.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-13T21:33:43.704 INFO:teuthology.orchestra.run.smithi155.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-13T21:33:43.729 INFO:teuthology.orchestra.run.smithi155.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-13T21:33:43.846 INFO:teuthology.orchestra.run.smithi155.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1629.geb16b97b 8.0 MB/s | 3.4 MB 00:00 2024-09-13T21:33:43.850 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:43.850 INFO:teuthology.orchestra.run.smithi155.stdout:Total 8.1 MB/s | 3.7 MB 00:00 2024-09-13T21:33:43.850 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:33:43.860 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:33:43.860 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:33:43.940 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:33:43.940 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:33:44.175 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 7/7 2024-09-13T21:33:44.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9. 1/7 2024-09-13T21:33:44.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 2/7 2024-09-13T21:33:44.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.n 3/7 2024-09-13T21:33:44.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T21:33:44.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T21:33:44.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T21:33:44.244 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:33:44.314 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T21:33:44.348 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T21:33:44.403 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T21:33:44.443 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T21:33:44.462 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T21:33:44.462 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:44.462 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:33:44.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:33:44.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:33:44.462 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:33:44.463 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T21:33:44.463 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T21:33:44.463 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T21:33:44.463 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T21:33:44.463 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:44.463 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:33:44.481 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.n 5/7 2024-09-13T21:33:44.681 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T21:33:45.244 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:01 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:45.376 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:33:45.377 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-13T21:33:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-13T21:33:45.377 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-13T21:33:45.377 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:33:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 7.4 M 2024-09-13T21:33:45.377 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-13T21:33:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T21:33:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T21:33:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T21:33:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout:Install 12 Packages 2024-09-13T21:33:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:45.379 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 38 M 2024-09-13T21:33:45.379 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 212 M 2024-09-13T21:33:45.379 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:33:45.480 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9. 6/7 2024-09-13T21:33:45.518 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 7/7 2024-09-13T21:33:45.977 INFO:teuthology.orchestra.run.smithi119.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-16 16 MB/s | 7.4 MB 00:00 2024-09-13T21:33:46.269 INFO:teuthology.orchestra.run.smithi119.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 112 kB/s | 33 kB 00:00 2024-09-13T21:33:46.402 INFO:teuthology.orchestra.run.smithi119.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 216 kB/s | 191 kB 00:00 2024-09-13T21:33:46.610 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 7/7 2024-09-13T21:33:46.610 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9. 1/7 2024-09-13T21:33:46.610 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 2/7 2024-09-13T21:33:46.610 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.n 3/7 2024-09-13T21:33:46.610 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T21:33:46.610 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T21:33:46.610 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T21:33:46.686 INFO:teuthology.orchestra.run.smithi119.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 64 kB/s | 18 kB 00:00 2024-09-13T21:33:46.884 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T21:33:46.885 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:46.885 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:33:46.885 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:33:46.885 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:33:46.885 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:33:46.885 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T21:33:46.885 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T21:33:46.885 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T21:33:46.885 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T21:33:46.885 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:46.885 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:33:46.886 INFO:teuthology.orchestra.run.smithi119.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 192 kB/s | 38 kB 00:00 2024-09-13T21:33:47.036 INFO:teuthology.orchestra.run.smithi119.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.9 MB/s | 3.0 MB 00:00 2024-09-13T21:33:47.093 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T21:33:47.153 INFO:teuthology.orchestra.run.smithi119.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-13T21:33:47.212 INFO:teuthology.orchestra.run.smithi119.stdout:(8/12): libgfortran-11.5.0-2.el9.x86_64.rpm 473 kB/s | 801 kB 00:01 2024-09-13T21:33:47.421 INFO:teuthology.orchestra.run.smithi119.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-09-13T21:33:47.621 INFO:teuthology.orchestra.run.smithi119.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 6.7 MB/s | 4.9 MB 00:00 2024-09-13T21:33:47.651 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:03 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:47.771 INFO:teuthology.orchestra.run.smithi119.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 448 kB/s | 250 kB 00:00 2024-09-13T21:33:47.785 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:33:47.786 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-09-13T21:33:47.786 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-13T21:33:47.786 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-09-13T21:33:47.786 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:33:47.786 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 7.4 M 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T21:33:47.787 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:47.788 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:33:47.788 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-09-13T21:33:47.788 INFO:teuthology.orchestra.run.smithi155.stdout:Install 12 Packages 2024-09-13T21:33:47.788 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:33:47.788 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 38 M 2024-09-13T21:33:47.788 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 212 M 2024-09-13T21:33:47.789 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:33:48.063 INFO:teuthology.orchestra.run.smithi119.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-13T21:33:48.064 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:48.064 INFO:teuthology.orchestra.run.smithi119.stdout:Total 14 MB/s | 38 MB 00:02 2024-09-13T21:33:48.396 INFO:teuthology.orchestra.run.smithi155.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-16 17 MB/s | 7.4 MB 00:00 2024-09-13T21:33:48.416 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:33:48.443 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:33:48.443 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:33:48.513 INFO:teuthology.orchestra.run.smithi155.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 348 kB/s | 191 kB 00:00 2024-09-13T21:33:48.539 INFO:teuthology.orchestra.run.smithi155.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 33 kB 00:00 2024-09-13T21:33:48.589 INFO:teuthology.orchestra.run.smithi155.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-13T21:33:48.639 INFO:teuthology.orchestra.run.smithi155.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-13T21:33:48.698 INFO:teuthology.orchestra.run.smithi155.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-13T21:33:48.907 INFO:teuthology.orchestra.run.smithi155.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-13T21:33:48.935 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:33:48.935 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:33:49.568 INFO:teuthology.orchestra.run.smithi155.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.8 MB/s | 3.0 MB 00:01 2024-09-13T21:33:49.684 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:33:49.716 INFO:teuthology.orchestra.run.smithi155.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-13T21:33:49.760 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T21:33:49.803 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:33:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:33:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T21:33:50.121 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T21:33:50.177 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T21:33:50.261 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T21:33:50.549 INFO:teuthology.orchestra.run.smithi155.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.6 MB/s | 4.9 MB 00:01 2024-09-13T21:33:50.940 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T21:33:50.983 INFO:teuthology.orchestra.run.smithi155.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.5 MB/s | 5.1 MB 00:02 2024-09-13T21:33:51.065 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T21:33:52.324 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:33:53.364 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T21:33:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 12/12 2024-09-13T21:33:55.616 INFO:teuthology.orchestra.run.smithi155.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.8 MB/s | 16 MB 00:05 2024-09-13T21:33:55.617 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:55.617 INFO:teuthology.orchestra.run.smithi155.stdout:Total 4.9 MB/s | 38 MB 00:07 2024-09-13T21:33:55.970 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 12/12 2024-09-13T21:33:55.970 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 1/12 2024-09-13T21:33:55.970 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:33:55.970 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:33:55.971 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T21:33:55.971 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T21:33:55.971 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T21:33:55.971 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T21:33:55.971 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T21:33:55.971 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T21:33:55.971 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:33:55.971 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T21:33:55.977 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:33:56.003 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:33:56.003 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:33:56.354 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T21:33:56.354 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T21:33:56.355 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T21:33:56.356 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:56.356 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:33:56.513 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:33:56.513 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:33:56.789 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-rook 2024-09-13T21:33:57.266 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:33:57.346 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T21:33:57.379 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:13 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:33:57.398 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:33:57.495 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:33:57.518 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 47 k 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T21:33:57.520 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T21:33:57.521 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T21:33:57.521 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T21:33:57.521 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T21:33:57.521 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T21:33:57.521 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T21:33:57.521 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T21:33:57.521 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:57.521 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:33:57.521 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:33:57.521 INFO:teuthology.orchestra.run.smithi119.stdout:Install 13 Packages 2024-09-13T21:33:57.521 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:33:57.522 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 2.2 M 2024-09-13T21:33:57.522 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 26 M 2024-09-13T21:33:57.522 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:33:57.531 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T21:33:57.716 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T21:33:57.747 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T21:33:57.824 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T21:33:58.117 INFO:teuthology.orchestra.run.smithi119.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 223 kB/s | 26 kB 00:00 2024-09-13T21:33:58.134 INFO:teuthology.orchestra.run.smithi119.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 145 kB/s | 19 kB 00:00 2024-09-13T21:33:58.160 INFO:teuthology.orchestra.run.smithi119.stdout:(3/13): ceph-mgr-rook-17.2.7-1629.geb16b97b.el9 302 kB/s | 47 kB 00:00 2024-09-13T21:33:58.218 INFO:teuthology.orchestra.run.smithi119.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-13T21:33:58.260 INFO:teuthology.orchestra.run.smithi119.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-13T21:33:58.277 INFO:teuthology.orchestra.run.smithi119.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 916 kB/s | 54 kB 00:00 2024-09-13T21:33:58.311 INFO:teuthology.orchestra.run.smithi119.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.8 MB/s | 279 kB 00:00 2024-09-13T21:33:58.336 INFO:teuthology.orchestra.run.smithi119.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 426 kB/s | 32 kB 00:00 2024-09-13T21:33:58.370 INFO:teuthology.orchestra.run.smithi119.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 164 kB/s | 14 kB 00:00 2024-09-13T21:33:58.387 INFO:teuthology.orchestra.run.smithi119.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 4.0 MB/s | 59 kB 00:00 2024-09-13T21:33:58.412 INFO:teuthology.orchestra.run.smithi119.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-13T21:33:58.437 INFO:teuthology.orchestra.run.smithi119.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.8 MB/s | 220 kB 00:00 2024-09-13T21:33:58.471 INFO:teuthology.orchestra.run.smithi119.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-09-13T21:33:58.474 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:33:58.475 INFO:teuthology.orchestra.run.smithi119.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-13T21:33:58.483 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T21:33:58.537 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:33:58.552 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:33:58.552 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:33:58.594 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T21:33:58.638 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:33:58.639 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:33:59.148 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:33:59.317 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T21:33:59.372 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T21:33:59.427 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T21:33:59.464 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T21:33:59.506 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T21:33:59.607 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T21:33:59.719 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T21:33:59.765 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T21:33:59.833 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:34:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T21:34:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T21:34:00.572 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T21:34:00.617 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T21:34:00.641 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 13/13 2024-09-13T21:34:00.864 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T21:34:00.898 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 12/12 2024-09-13T21:34:01.403 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 13/13 2024-09-13T21:34:01.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 1/13 2024-09-13T21:34:01.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T21:34:01.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T21:34:01.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T21:34:01.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T21:34:01.403 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T21:34:01.404 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T21:34:01.404 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T21:34:01.404 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T21:34:01.404 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T21:34:01.404 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T21:34:01.404 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T21:34:01.736 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T21:34:01.736 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:01.736 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:34:01.736 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:34:01.736 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T21:34:01.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T21:34:01.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T21:34:01.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T21:34:01.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T21:34:01.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T21:34:01.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T21:34:01.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T21:34:01.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T21:34:01.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T21:34:01.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T21:34:01.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T21:34:01.738 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:01.738 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:01.986 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T21:34:02.552 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:18 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:02.686 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:02.686 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:02.686 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-13T21:34:02.686 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:02.686 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 124 k 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout:Install 6 Packages 2024-09-13T21:34:02.687 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:02.688 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 7.0 M 2024-09-13T21:34:02.688 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 33 M 2024-09-13T21:34:02.688 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:34:02.989 INFO:teuthology.orchestra.run.smithi119.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1629.geb16b97b.e 618 kB/s | 124 kB 00:00 2024-09-13T21:34:03.031 INFO:teuthology.orchestra.run.smithi119.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-13T21:34:03.081 INFO:teuthology.orchestra.run.smithi119.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.8 MB/s | 548 kB 00:00 2024-09-13T21:34:03.106 INFO:teuthology.orchestra.run.smithi119.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 842 kB/s | 58 kB 00:00 2024-09-13T21:34:03.132 INFO:teuthology.orchestra.run.smithi119.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-13T21:34:03.512 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 12/12 2024-09-13T21:34:03.513 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 1/12 2024-09-13T21:34:03.513 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T21:34:03.513 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T21:34:03.513 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T21:34:03.513 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T21:34:03.513 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T21:34:03.513 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T21:34:03.513 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T21:34:03.513 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T21:34:03.513 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T21:34:03.514 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T21:34:03.994 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T21:34:03.994 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:03.994 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:34:03.994 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:03.995 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:04.392 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-rook 2024-09-13T21:34:04.971 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:20 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:05.090 INFO:teuthology.orchestra.run.smithi119.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.6 MB/s | 6.0 MB 00:02 2024-09-13T21:34:05.092 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:05.093 INFO:teuthology.orchestra.run.smithi119.stdout:Total 2.9 MB/s | 7.0 MB 00:02 2024-09-13T21:34:05.103 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:05.104 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-13T21:34:05.105 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:05.105 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:34:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 47 k 2024-09-13T21:34:05.105 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-13T21:34:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T21:34:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T21:34:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T21:34:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T21:34:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T21:34:05.105 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T21:34:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T21:34:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T21:34:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T21:34:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T21:34:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T21:34:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T21:34:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:05.106 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:34:05.106 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:05.106 INFO:teuthology.orchestra.run.smithi155.stdout:Install 13 Packages 2024-09-13T21:34:05.106 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:05.107 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 2.2 M 2024-09-13T21:34:05.107 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 26 M 2024-09-13T21:34:05.107 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:34:05.165 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:34:05.180 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:34:05.180 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:34:05.276 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:34:05.276 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:34:05.577 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:34:05.658 INFO:teuthology.orchestra.run.smithi155.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 161 kB/s | 19 kB 00:00 2024-09-13T21:34:05.683 INFO:teuthology.orchestra.run.smithi155.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 177 kB/s | 26 kB 00:00 2024-09-13T21:34:05.708 INFO:teuthology.orchestra.run.smithi155.stdout:(3/13): ceph-mgr-rook-17.2.7-1629.geb16b97b.el9 279 kB/s | 47 kB 00:00 2024-09-13T21:34:05.755 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T21:34:05.783 INFO:teuthology.orchestra.run.smithi155.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-09-13T21:34:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T21:34:05.809 INFO:teuthology.orchestra.run.smithi155.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-13T21:34:05.851 INFO:teuthology.orchestra.run.smithi155.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 774 kB/s | 32 kB 00:00 2024-09-13T21:34:05.876 INFO:teuthology.orchestra.run.smithi155.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 580 kB/s | 54 kB 00:00 2024-09-13T21:34:05.901 INFO:teuthology.orchestra.run.smithi155.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 281 kB/s | 14 kB 00:00 2024-09-13T21:34:05.935 INFO:teuthology.orchestra.run.smithi155.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-13T21:34:05.977 INFO:teuthology.orchestra.run.smithi155.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.1 MB/s | 220 kB 00:00 2024-09-13T21:34:06.002 INFO:teuthology.orchestra.run.smithi155.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 909 kB/s | 59 kB 00:00 2024-09-13T21:34:06.027 INFO:teuthology.orchestra.run.smithi155.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-13T21:34:06.069 INFO:teuthology.orchestra.run.smithi155.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.4 MB/s | 1.0 MB 00:00 2024-09-13T21:34:06.073 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:06.073 INFO:teuthology.orchestra.run.smithi155.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-13T21:34:06.145 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:34:06.161 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:34:06.161 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:34:06.253 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:34:06.255 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:34:06.334 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T21:34:06.419 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T21:34:06.482 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T21:34:06.520 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 6/6 2024-09-13T21:34:06.757 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:34:06.941 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T21:34:07.004 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T21:34:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T21:34:07.097 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T21:34:07.139 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T21:34:07.241 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T21:34:07.281 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 6/6 2024-09-13T21:34:07.281 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/6 2024-09-13T21:34:07.281 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T21:34:07.281 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T21:34:07.281 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T21:34:07.281 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T21:34:07.342 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T21:34:07.391 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T21:34:07.559 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T21:34:07.559 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:07.559 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:34:07.559 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:34:07.559 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T21:34:07.559 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T21:34:07.560 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T21:34:07.560 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T21:34:07.560 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T21:34:07.560 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:07.560 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:07.794 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-fuse 2024-09-13T21:34:08.130 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T21:34:08.179 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T21:34:08.213 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T21:34:08.259 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T21:34:08.284 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 13/13 2024-09-13T21:34:08.368 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:08.508 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:08.509 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:08.509 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-13T21:34:08.509 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:08.509 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:34:08.509 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 813 k 2024-09-13T21:34:08.509 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-13T21:34:08.509 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T21:34:08.509 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:08.509 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:34:08.510 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:08.510 INFO:teuthology.orchestra.run.smithi119.stdout:Install 2 Packages 2024-09-13T21:34:08.510 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:08.510 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 893 k 2024-09-13T21:34:08.510 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 2.6 M 2024-09-13T21:34:08.510 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:34:08.666 INFO:teuthology.orchestra.run.smithi119.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 728 kB/s | 80 kB 00:00 2024-09-13T21:34:08.824 INFO:teuthology.orchestra.run.smithi119.stdout:(2/2): ceph-fuse-17.2.7-1629.geb16b97b.el9.x86_ 3.0 MB/s | 813 kB 00:00 2024-09-13T21:34:08.825 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:08.825 INFO:teuthology.orchestra.run.smithi119.stdout:Total 2.8 MB/s | 893 kB 00:00 2024-09-13T21:34:08.836 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:34:08.856 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:34:08.857 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:34:08.934 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:34:08.935 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:34:09.070 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 13/13 2024-09-13T21:34:09.070 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 1/13 2024-09-13T21:34:09.070 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T21:34:09.070 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T21:34:09.070 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T21:34:09.070 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T21:34:09.070 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T21:34:09.070 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T21:34:09.070 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T21:34:09.070 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T21:34:09.070 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T21:34:09.071 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T21:34:09.071 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T21:34:09.126 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:34:09.262 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T21:34:09.332 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2/2 2024-09-13T21:34:09.414 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T21:34:09.414 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:09.414 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:34:09.414 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:34:09.414 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T21:34:09.414 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:09.415 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:09.681 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T21:34:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2/2 2024-09-13T21:34:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/2 2024-09-13T21:34:10.248 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T21:34:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:10.258 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:34:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T21:34:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:10.258 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:10.381 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:10.382 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:10.382 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-13T21:34:10.382 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:10.382 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:34:10.382 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 124 k 2024-09-13T21:34:10.382 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-13T21:34:10.382 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T21:34:10.382 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T21:34:10.383 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T21:34:10.383 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T21:34:10.383 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T21:34:10.383 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:10.383 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:34:10.383 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:10.383 INFO:teuthology.orchestra.run.smithi155.stdout:Install 6 Packages 2024-09-13T21:34:10.383 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:10.384 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 7.0 M 2024-09-13T21:34:10.384 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 33 M 2024-09-13T21:34:10.384 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:34:10.520 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install librados-devel 2024-09-13T21:34:10.890 INFO:teuthology.orchestra.run.smithi155.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-13T21:34:10.915 INFO:teuthology.orchestra.run.smithi155.stdout:(2/6): ceph-mgr-cephadm-17.2.7-1629.geb16b97b.e 492 kB/s | 124 kB 00:00 2024-09-13T21:34:10.974 INFO:teuthology.orchestra.run.smithi155.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-13T21:34:11.007 INFO:teuthology.orchestra.run.smithi155.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 625 kB/s | 58 kB 00:00 2024-09-13T21:34:11.032 INFO:teuthology.orchestra.run.smithi155.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-13T21:34:11.100 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:11.237 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:11.237 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:11.237 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2024-09-13T21:34:11.238 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:11.238 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:34:11.238 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 126 k 2024-09-13T21:34:11.238 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:11.238 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:34:11.238 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:11.238 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-09-13T21:34:11.238 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:11.239 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 126 k 2024-09-13T21:34:11.239 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 448 k 2024-09-13T21:34:11.239 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:34:11.429 INFO:teuthology.orchestra.run.smithi119.stdout:librados-devel-17.2.7-1629.geb16b97b.el9.x86_64 665 kB/s | 126 kB 00:00 2024-09-13T21:34:11.429 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:11.429 INFO:teuthology.orchestra.run.smithi119.stdout:Total 661 kB/s | 126 kB 00:00 2024-09-13T21:34:11.429 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:34:11.435 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:34:11.435 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:34:11.497 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:34:11.498 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:34:11.642 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:34:11.750 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:12.144 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:12.409 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:12.409 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:12.409 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:34:12.409 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:34:12.409 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:12.409 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:12.664 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install libcephfs2 2024-09-13T21:34:12.983 INFO:teuthology.orchestra.run.smithi155.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.6 MB/s | 6.0 MB 00:02 2024-09-13T21:34:12.985 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:12.986 INFO:teuthology.orchestra.run.smithi155.stdout:Total 2.7 MB/s | 7.0 MB 00:02 2024-09-13T21:34:13.056 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:34:13.067 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:34:13.067 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:34:13.165 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:34:13.165 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:34:13.245 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:13.337 INFO:teuthology.orchestra.run.smithi119.stdout:Package libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:13.382 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:13.383 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-09-13T21:34:13.383 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:13.450 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install libcephfs-devel 2024-09-13T21:34:13.465 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:34:13.638 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T21:34:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T21:34:14.012 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:14.145 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:14.145 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2024-09-13T21:34:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:34:14.146 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T21:34:14.146 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:34:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-09-13T21:34:14.146 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 25 k 2024-09-13T21:34:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 110 k 2024-09-13T21:34:14.146 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:34:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T21:34:14.281 INFO:teuthology.orchestra.run.smithi119.stdout:libcephfs-devel-17.2.7-1629.geb16b97b.el9.x86_6 185 kB/s | 25 kB 00:00 2024-09-13T21:34:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:Total 183 kB/s | 25 kB 00:00 2024-09-13T21:34:14.282 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:34:14.285 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:34:14.286 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:34:14.287 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:34:14.287 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:34:14.295 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T21:34:14.351 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T21:34:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:34:14.388 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 6/6 2024-09-13T21:34:14.470 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:14.828 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:15.066 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:15.066 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:15.067 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:34:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:34:15.067 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:15.067 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:15.118 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 6/6 2024-09-13T21:34:15.118 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/6 2024-09-13T21:34:15.118 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T21:34:15.118 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T21:34:15.118 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T21:34:15.118 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T21:34:15.239 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install librados2 2024-09-13T21:34:15.395 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T21:34:15.395 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:15.395 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:34:15.395 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T21:34:15.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T21:34:15.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T21:34:15.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T21:34:15.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T21:34:15.395 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T21:34:15.396 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:15.396 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:15.638 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-fuse 2024-09-13T21:34:15.804 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:15.905 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:15.947 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:15.948 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-09-13T21:34:15.948 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:16.016 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install librbd1 2024-09-13T21:34:16.214 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:16.348 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:16.349 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:16.349 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-13T21:34:16.349 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:16.349 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:34:16.349 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 813 k 2024-09-13T21:34:16.349 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-13T21:34:16.349 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T21:34:16.350 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:16.350 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:34:16.350 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:16.350 INFO:teuthology.orchestra.run.smithi155.stdout:Install 2 Packages 2024-09-13T21:34:16.350 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:16.350 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 893 k 2024-09-13T21:34:16.351 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 2.6 M 2024-09-13T21:34:16.351 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:34:16.571 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:16.593 INFO:teuthology.orchestra.run.smithi155.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 557 kB/s | 80 kB 00:00 2024-09-13T21:34:16.662 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:16.704 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:16.705 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-09-13T21:34:16.705 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:16.735 INFO:teuthology.orchestra.run.smithi155.stdout:(2/2): ceph-fuse-17.2.7-1629.geb16b97b.el9.x86_ 2.8 MB/s | 813 kB 00:00 2024-09-13T21:34:16.736 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:16.736 INFO:teuthology.orchestra.run.smithi155.stdout:Total 2.3 MB/s | 893 kB 00:00 2024-09-13T21:34:16.747 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:34:16.769 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:34:16.769 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:34:16.770 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-rados 2024-09-13T21:34:16.850 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:34:16.851 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:34:17.050 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:34:17.199 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T21:34:17.276 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2/2 2024-09-13T21:34:17.334 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:17.424 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:17.466 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:17.467 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-09-13T21:34:17.467 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:17.538 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-rgw 2024-09-13T21:34:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2/2 2024-09-13T21:34:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/2 2024-09-13T21:34:18.100 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T21:34:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:18.172 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:34:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T21:34:18.172 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:18.172 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:18.191 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:18.234 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:18.235 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-09-13T21:34:18.235 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:18.315 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-cephfs 2024-09-13T21:34:18.437 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librados-devel 2024-09-13T21:34:18.874 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:18.965 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:19.008 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:19.009 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-09-13T21:34:19.009 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:19.020 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:19.089 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-rbd 2024-09-13T21:34:19.159 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:19.159 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:19.159 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2024-09-13T21:34:19.160 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:19.160 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:34:19.160 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 126 k 2024-09-13T21:34:19.160 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:19.160 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:34:19.160 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:19.160 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-09-13T21:34:19.161 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:19.161 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 126 k 2024-09-13T21:34:19.161 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 448 k 2024-09-13T21:34:19.161 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:34:19.358 INFO:teuthology.orchestra.run.smithi155.stdout:librados-devel-17.2.7-1629.geb16b97b.el9.x86_64 636 kB/s | 126 kB 00:00 2024-09-13T21:34:19.359 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:19.359 INFO:teuthology.orchestra.run.smithi155.stdout:Total 632 kB/s | 126 kB 00:00 2024-09-13T21:34:19.359 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:34:19.365 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:34:19.365 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:34:19.428 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:34:19.428 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:34:19.583 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:34:19.647 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:19.688 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:19.736 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:19.778 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:19.779 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-09-13T21:34:19.780 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:19.845 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install rbd-fuse 2024-09-13T21:34:20.124 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:20.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:20.378 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:20.378 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:34:20.378 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:34:20.378 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:20.378 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:20.408 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:20.541 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:20.542 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:20.542 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-09-13T21:34:20.542 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:20.542 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:34:20.542 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 82 k 2024-09-13T21:34:20.542 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:20.542 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:34:20.542 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:20.542 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-09-13T21:34:20.543 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:20.543 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 82 k 2024-09-13T21:34:20.543 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 222 k 2024-09-13T21:34:20.543 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:34:20.643 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install libcephfs2 2024-09-13T21:34:20.743 INFO:teuthology.orchestra.run.smithi119.stdout:rbd-fuse-17.2.7-1629.geb16b97b.el9.x86_64.rpm 409 kB/s | 82 kB 00:00 2024-09-13T21:34:20.743 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:20.743 INFO:teuthology.orchestra.run.smithi119.stdout:Total 406 kB/s | 82 kB 00:00 2024-09-13T21:34:20.743 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:34:20.750 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:34:20.750 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:34:20.812 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:34:20.813 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:34:20.966 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:34:21.064 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:21.223 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:21.315 INFO:teuthology.orchestra.run.smithi155.stdout:Package libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:21.360 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:21.361 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-09-13T21:34:21.361 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:21.422 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:21.425 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install libcephfs-devel 2024-09-13T21:34:21.649 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:21.649 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:21.649 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:34:21.649 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:34:21.649 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:21.650 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:21.886 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install rbd-mirror 2024-09-13T21:34:21.997 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:22.130 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:22.131 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2024-09-13T21:34:22.131 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:22.131 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:34:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T21:34:22.131 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:22.131 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:34:22.131 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:22.131 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-09-13T21:34:22.132 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:22.132 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 25 k 2024-09-13T21:34:22.132 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 110 k 2024-09-13T21:34:22.132 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:34:22.296 INFO:teuthology.orchestra.run.smithi155.stdout:libcephfs-devel-17.2.7-1629.geb16b97b.el9.x86_6 152 kB/s | 25 kB 00:00 2024-09-13T21:34:22.296 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:22.297 INFO:teuthology.orchestra.run.smithi155.stdout:Total 151 kB/s | 25 kB 00:00 2024-09-13T21:34:22.297 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:34:22.300 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:34:22.300 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:34:22.301 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:34:22.302 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:34:22.385 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:34:22.462 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:22.518 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:22.600 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:22.630 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2024-09-13T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-09-13T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 2.9 M 2024-09-13T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 12 M 2024-09-13T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:34:22.876 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:22.921 INFO:teuthology.orchestra.run.smithi119.stdout:rbd-mirror-17.2.7-1629.geb16b97b.el9.x86_64.rpm 9.2 MB/s | 2.9 MB 00:00 2024-09-13T21:34:22.921 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:22.922 INFO:teuthology.orchestra.run.smithi119.stdout:Total 9.2 MB/s | 2.9 MB 00:00 2024-09-13T21:34:22.922 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:34:22.930 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:34:22.931 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:34:23.010 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:34:23.011 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:34:23.111 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:23.112 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:23.112 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:34:23.112 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:34:23.112 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:23.112 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:23.313 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librados2 2024-09-13T21:34:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:34:23.479 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:23.505 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:23.505 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:34:23.505 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T21:34:23.505 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:34:23.505 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:34:23.505 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:23.883 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:39 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:23.972 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:24.015 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:24.016 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-09-13T21:34:24.016 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:24.092 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librbd1 2024-09-13T21:34:24.582 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:24.582 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:24.582 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:34:24.582 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:34:24.582 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:24.582 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:24.664 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:24.753 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:24.796 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:24.797 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-09-13T21:34:24.797 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:24.868 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rados 2024-09-13T21:34:24.881 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install rbd-nbd 2024-09-13T21:34:25.432 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:25.460 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:25.521 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:25.563 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:25.564 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-09-13T21:34:25.565 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:25.593 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 165 k 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 165 k 2024-09-13T21:34:25.594 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 477 k 2024-09-13T21:34:25.595 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-13T21:34:25.635 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rgw 2024-09-13T21:34:25.799 INFO:teuthology.orchestra.run.smithi119.stdout:rbd-nbd-17.2.7-1629.geb16b97b.el9.x86_64.rpm 810 kB/s | 165 kB 00:00 2024-09-13T21:34:25.800 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:25.800 INFO:teuthology.orchestra.run.smithi119.stdout:Total 802 kB/s | 165 kB 00:00 2024-09-13T21:34:25.800 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-13T21:34:25.807 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-13T21:34:25.807 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-13T21:34:25.871 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-13T21:34:25.871 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-13T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-13T21:34:26.121 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:26.198 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:42 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:26.290 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:26.331 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:26.333 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-09-13T21:34:26.333 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:26.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-cephfs 2024-09-13T21:34:26.545 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:26.798 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:26.798 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:26.798 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-13T21:34:26.799 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:34:26.799 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:34:26.799 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-13T21:34:26.964 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:42 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:27.056 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:27.064 DEBUG:teuthology.parallel:result is None 2024-09-13T21:34:27.098 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:27.099 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-09-13T21:34:27.099 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:27.168 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rbd 2024-09-13T21:34:27.733 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:27.823 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T21:34:27.866 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:27.866 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-09-13T21:34:27.867 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:27.946 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-fuse 2024-09-13T21:34:28.510 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:44 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:28.643 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:28.643 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:28.643 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2024-09-13T21:34:28.643 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:28.644 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:34:28.644 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 82 k 2024-09-13T21:34:28.644 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:28.644 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:34:28.644 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:28.644 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-09-13T21:34:28.644 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:28.644 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 82 k 2024-09-13T21:34:28.644 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 222 k 2024-09-13T21:34:28.644 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:34:28.841 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-fuse-17.2.7-1629.geb16b97b.el9.x86_64.rpm 416 kB/s | 82 kB 00:00 2024-09-13T21:34:28.842 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:28.842 INFO:teuthology.orchestra.run.smithi155.stdout:Total 413 kB/s | 82 kB 00:00 2024-09-13T21:34:28.842 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:34:28.848 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:34:28.849 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:34:28.911 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:34:28.911 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:34:29.056 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:34:29.172 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:29.558 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:29.811 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:29.811 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:29.811 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:34:29.811 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:34:29.811 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:29.812 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:30.050 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-mirror 2024-09-13T21:34:30.629 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:46 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:30.765 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:30.766 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2024-09-13T21:34:30.766 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:30.766 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:34:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T21:34:30.766 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:30.766 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:34:30.766 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:30.766 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-09-13T21:34:30.767 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:30.767 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 2.9 M 2024-09-13T21:34:30.767 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 12 M 2024-09-13T21:34:30.767 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:34:31.112 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-mirror-17.2.7-1629.geb16b97b.el9.x86_64.rpm 8.5 MB/s | 2.9 MB 00:00 2024-09-13T21:34:31.113 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:31.113 INFO:teuthology.orchestra.run.smithi155.stdout:Total 8.5 MB/s | 2.9 MB 00:00 2024-09-13T21:34:31.114 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:34:31.123 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:34:31.123 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:34:31.206 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:34:31.206 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:34:31.640 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:34:31.705 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:31.732 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:31.732 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T21:34:31.732 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T21:34:31.732 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:34:31.732 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T21:34:31.733 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:32.879 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:32.879 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:32.879 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:34:32.880 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:34:32.880 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:32.880 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:33.184 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-nbd 2024-09-13T21:34:33.772 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:49 ago on Fri 13 Sep 2024 09:32:44 PM UTC. 2024-09-13T21:34:33.906 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-13T21:34:33.907 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:33.907 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2024-09-13T21:34:33.907 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:33.907 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-13T21:34:33.907 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 165 k 2024-09-13T21:34:33.907 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:33.907 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-13T21:34:33.907 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-09-13T21:34:33.908 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2024-09-13T21:34:33.908 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:33.908 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 165 k 2024-09-13T21:34:33.908 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 477 k 2024-09-13T21:34:33.908 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-13T21:34:34.117 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-nbd-17.2.7-1629.geb16b97b.el9.x86_64.rpm 792 kB/s | 165 kB 00:00 2024-09-13T21:34:34.117 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:34:34.117 INFO:teuthology.orchestra.run.smithi155.stdout:Total 786 kB/s | 165 kB 00:00 2024-09-13T21:34:34.117 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-13T21:34:34.125 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-13T21:34:34.125 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-13T21:34:34.188 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-13T21:34:34.188 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-13T21:34:34.343 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-13T21:34:34.447 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:34.841 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:35.110 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T21:34:35.110 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:35.111 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-13T21:34:35.111 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T21:34:35.111 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:34:35.111 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-13T21:34:35.394 DEBUG:teuthology.parallel:result is None 2024-09-13T21:34:35.394 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:34:35.395 INFO:teuthology.packaging:ref: None 2024-09-13T21:34:35.395 INFO:teuthology.packaging:tag: None 2024-09-13T21:34:35.395 INFO:teuthology.packaging:branch: quincy 2024-09-13T21:34:35.395 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:34:35.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T21:34:35.632 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T21:34:35.658 INFO:teuthology.orchestra.run.smithi119.stdout:17.2.7-1629.geb16b97b.el9 2024-09-13T21:34:35.659 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1629.geb16b97b.el9 2024-09-13T21:34:35.659 INFO:teuthology.task.install:The correct ceph version 17.2.7-1629.geb16b97b is installed. 2024-09-13T21:34:35.661 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:34:35.662 INFO:teuthology.packaging:ref: None 2024-09-13T21:34:35.662 INFO:teuthology.packaging:tag: None 2024-09-13T21:34:35.662 INFO:teuthology.packaging:branch: quincy 2024-09-13T21:34:35.662 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:34:35.662 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T21:34:35.894 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T21:34:35.917 INFO:teuthology.orchestra.run.smithi155.stdout:17.2.7-1629.geb16b97b.el9 2024-09-13T21:34:35.917 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1629.geb16b97b.el9 2024-09-13T21:34:35.917 INFO:teuthology.task.install:The correct ceph version 17.2.7-1629.geb16b97b is installed. 2024-09-13T21:34:35.919 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T21:34:35.919 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:34:35.919 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T21:34:35.951 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:34:35.951 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T21:34:35.984 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T21:34:35.984 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:34:35.984 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T21:34:36.019 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T21:34:36.087 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:34:36.087 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T21:34:36.112 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T21:34:36.177 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T21:34:36.177 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:34:36.177 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T21:34:36.204 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T21:34:36.271 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:34:36.271 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T21:34:36.298 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T21:34:36.362 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T21:34:36.363 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:34:36.363 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T21:34:36.389 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T21:34:36.455 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:34:36.456 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T21:34:36.480 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T21:34:36.548 INFO:teuthology.run_tasks:Running task print... 2024-09-13T21:34:36.558 INFO:teuthology.task.print:**** done install task... 2024-09-13T21:34:36.558 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T21:34:36.658 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T21:34:36.659 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-13T21:34:36.659 INFO:tasks.cephadm:Cluster fsid is f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:34:36.659 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T21:34:36.659 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-13T21:34:36.660 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi119': '172.21.15.119', 'mon.smithi155': '172.21.15.155'} 2024-09-13T21:34:36.660 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T21:34:36.660 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname $(hostname -s) 2024-09-13T21:34:36.685 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname $(hostname -s) 2024-09-13T21:34:36.711 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-13T21:34:36.711 DEBUG:teuthology.orchestra.run.smithi119:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T21:34:36.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 13 21:34 /home/ubuntu/cephtest/cephadm 2024-09-13T21:34:36.896 DEBUG:teuthology.orchestra.run.smithi155:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T21:34:37.022 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 13 21:34 /home/ubuntu/cephtest/cephadm 2024-09-13T21:34:37.023 DEBUG:teuthology.orchestra.run.smithi119:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T21:34:37.039 DEBUG:teuthology.orchestra.run.smithi155:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T21:34:37.065 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-13T21:34:37.065 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-13T21:34:37.082 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-13T21:34:38.620 INFO:teuthology.orchestra.run.smithi119.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T21:34:38.700 INFO:teuthology.orchestra.run.smithi155.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T21:35:19.634 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:35:19.634 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)", 2024-09-13T21:35:19.634 INFO:teuthology.orchestra.run.smithi119.stdout: "image_id": "ab51d1bebd1200e205d11a014c20a7f2cf49d932afcbeabdc1c9fc887c00f446", 2024-09-13T21:35:19.634 INFO:teuthology.orchestra.run.smithi119.stdout: "repo_digests": [ 2024-09-13T21:35:19.634 INFO:teuthology.orchestra.run.smithi119.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6" 2024-09-13T21:35:19.634 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-13T21:35:19.634 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:35:20.045 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-13T21:35:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)", 2024-09-13T21:35:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: "image_id": "ab51d1bebd1200e205d11a014c20a7f2cf49d932afcbeabdc1c9fc887c00f446", 2024-09-13T21:35:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: "repo_digests": [ 2024-09-13T21:35:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6" 2024-09-13T21:35:20.045 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-09-13T21:35:20.045 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-13T21:35:20.066 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph 2024-09-13T21:35:20.099 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph 2024-09-13T21:35:20.126 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /etc/ceph 2024-09-13T21:35:20.168 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /etc/ceph 2024-09-13T21:35:20.194 INFO:tasks.cephadm:Writing seed config... 2024-09-13T21:35:20.196 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-13T21:35:20.196 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-13T21:35:20.196 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T21:35:20.197 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T21:35:20.197 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T21:35:20.197 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T21:35:20.197 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T21:35:20.197 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T21:35:20.197 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T21:35:20.197 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T21:35:20.197 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T21:35:20.198 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T21:35:20.199 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T21:35:20.200 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T21:35:20.200 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T21:35:20.200 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-13T21:35:20.200 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T21:35:20.200 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T21:35:20.201 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:35:20.201 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T21:35:20.226 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f9722044-7217-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T21:35:20.227 DEBUG:teuthology.orchestra.run.smithi119:mon.smithi119> sudo journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi119.service 2024-09-13T21:35:20.269 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T21:35:20.269 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid f9722044-7217-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.119 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:35:20.478 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-13T21:35:20.478 INFO:teuthology.orchestra.run.smithi119.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'f9722044-7217-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.119', '--skip-admin-label'] 2024-09-13T21:35:20.501 INFO:teuthology.orchestra.run.smithi119.stdout:/bin/podman: stdout 5.2.2 2024-09-13T21:35:20.501 INFO:teuthology.orchestra.run.smithi119.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T21:35:20.502 INFO:teuthology.orchestra.run.smithi119.stdout:Verifying podman|docker is present... 2024-09-13T21:35:20.523 INFO:teuthology.orchestra.run.smithi119.stdout:/bin/podman: stdout 5.2.2 2024-09-13T21:35:20.523 INFO:teuthology.orchestra.run.smithi119.stdout:Verifying lvm2 is present... 2024-09-13T21:35:20.524 INFO:teuthology.orchestra.run.smithi119.stdout:Verifying time synchronization is in place... 2024-09-13T21:35:20.531 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T21:35:20.532 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T21:35:20.538 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T21:35:20.538 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout inactive 2024-09-13T21:35:20.545 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout enabled 2024-09-13T21:35:20.552 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout active 2024-09-13T21:35:20.552 INFO:teuthology.orchestra.run.smithi119.stdout:Unit chronyd.service is enabled and running 2024-09-13T21:35:20.552 INFO:teuthology.orchestra.run.smithi119.stdout:Repeating the final host check... 2024-09-13T21:35:20.575 INFO:teuthology.orchestra.run.smithi119.stdout:/bin/podman: stdout 5.2.2 2024-09-13T21:35:20.575 INFO:teuthology.orchestra.run.smithi119.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T21:35:20.575 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl is present 2024-09-13T21:35:20.575 INFO:teuthology.orchestra.run.smithi119.stdout:lvcreate is present 2024-09-13T21:35:20.581 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T21:35:20.582 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T21:35:20.588 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T21:35:20.588 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout inactive 2024-09-13T21:35:20.595 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout enabled 2024-09-13T21:35:20.602 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout active 2024-09-13T21:35:20.602 INFO:teuthology.orchestra.run.smithi119.stdout:Unit chronyd.service is enabled and running 2024-09-13T21:35:20.602 INFO:teuthology.orchestra.run.smithi119.stdout:Host looks OK 2024-09-13T21:35:20.602 INFO:teuthology.orchestra.run.smithi119.stdout:Cluster fsid: f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:35:20.602 INFO:teuthology.orchestra.run.smithi119.stdout:Acquiring lock 140691135594848 on /run/cephadm/f9722044-7217-11ef-bceb-c7b262605968.lock 2024-09-13T21:35:20.602 INFO:teuthology.orchestra.run.smithi119.stdout:Lock 140691135594848 acquired on /run/cephadm/f9722044-7217-11ef-bceb-c7b262605968.lock 2024-09-13T21:35:20.603 INFO:teuthology.orchestra.run.smithi119.stdout:Verifying IP 172.21.15.119 port 3300 ... 2024-09-13T21:35:20.603 INFO:teuthology.orchestra.run.smithi119.stdout:Verifying IP 172.21.15.119 port 6789 ... 2024-09-13T21:35:20.603 INFO:teuthology.orchestra.run.smithi119.stdout:Base mon IP(s) is [172.21.15.119:3300, 172.21.15.119:6789], mon addrv is [v2:172.21.15.119:3300,v1:172.21.15.119:6789] 2024-09-13T21:35:20.607 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.119 metric 100 2024-09-13T21:35:20.607 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.119 metric 100 2024-09-13T21:35:20.609 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T21:35:20.609 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-13T21:35:20.609 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-13T21:35:20.612 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T21:35:20.612 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T21:35:20.612 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T21:35:20.612 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-13T21:35:20.612 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link noprefixroute 2024-09-13T21:35:20.612 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T21:35:20.613 INFO:teuthology.orchestra.run.smithi119.stdout:Mon IP `172.21.15.119` is in CIDR network `172.21.0.0/20` 2024-09-13T21:35:20.613 INFO:teuthology.orchestra.run.smithi119.stdout:Mon IP `172.21.15.119` is in CIDR network `172.21.0.0/20` 2024-09-13T21:35:20.613 INFO:teuthology.orchestra.run.smithi119.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T21:35:20.613 INFO:teuthology.orchestra.run.smithi119.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T21:35:20.614 INFO:teuthology.orchestra.run.smithi119.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T21:35:21.542 INFO:teuthology.orchestra.run.smithi119.stdout:/bin/podman: stdout ab51d1bebd1200e205d11a014c20a7f2cf49d932afcbeabdc1c9fc887c00f446 2024-09-13T21:35:21.543 INFO:teuthology.orchestra.run.smithi119.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T21:35:21.543 INFO:teuthology.orchestra.run.smithi119.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T21:35:21.543 INFO:teuthology.orchestra.run.smithi119.stdout:/bin/podman: stderr Copying blob sha256:9b559dbc30e0607f8b5bc9e421c2d3b7f5b89b8ae7a0518eaf6d2b64276fd6bc 2024-09-13T21:35:21.543 INFO:teuthology.orchestra.run.smithi119.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T21:35:21.543 INFO:teuthology.orchestra.run.smithi119.stdout:/bin/podman: stderr Copying config sha256:ab51d1bebd1200e205d11a014c20a7f2cf49d932afcbeabdc1c9fc887c00f446 2024-09-13T21:35:21.543 INFO:teuthology.orchestra.run.smithi119.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T21:35:22.438 INFO:teuthology.orchestra.run.smithi119.stdout:ceph: stdout ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable) 2024-09-13T21:35:22.438 INFO:teuthology.orchestra.run.smithi119.stdout:Ceph version: ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable) 2024-09-13T21:35:22.438 INFO:teuthology.orchestra.run.smithi119.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T21:35:24.315 INFO:teuthology.orchestra.run.smithi119.stdout:stat: stdout 167 167 2024-09-13T21:35:24.315 INFO:teuthology.orchestra.run.smithi119.stdout:Creating initial keys... 2024-09-13T21:35:33.608 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph-authtool: stdout AQAfsORm3SLDFRAAsJR5vTbaImjHWlCITq4kaQ== 2024-09-13T21:35:35.978 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph-authtool: stdout AQAnsORmG+x6FxAANg4wwaSs0AsemS2GaL3ikg== 2024-09-13T21:35:36.908 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph-authtool: stdout AQAosORmSS1MEhAAyNR7k9f0i2J8duczyFwCtw== 2024-09-13T21:35:36.909 INFO:teuthology.orchestra.run.smithi119.stdout:Creating initial monmap... 2024-09-13T21:35:37.807 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T21:35:37.807 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-13T21:35:37.807 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:35:37.807 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T21:35:37.808 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool for smithi119 [v2:172.21.15.119:3300,v1:172.21.15.119:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T21:35:37.808 INFO:teuthology.orchestra.run.smithi119.stdout:setting min_mon_release = octopus 2024-09-13T21:35:37.808 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/monmaptool: set fsid to f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:35:37.808 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T21:35:37.808 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:35:37.808 INFO:teuthology.orchestra.run.smithi119.stdout:Creating mon... 2024-09-13T21:35:38.731 INFO:teuthology.orchestra.run.smithi119.stdout:create mon.smithi119 on 2024-09-13T21:35:38.951 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T21:35:39.086 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T21:35:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f9722044-7217-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-f9722044-7217-11ef-bceb-c7b262605968.target. 2024-09-13T21:35:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f9722044-7217-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-f9722044-7217-11ef-bceb-c7b262605968.target. 2024-09-13T21:35:39.424 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi119 2024-09-13T21:35:39.424 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi119.service: Unit ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi119.service not loaded. 2024-09-13T21:35:39.598 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f9722044-7217-11ef-bceb-c7b262605968.target.wants/ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi119.service → /etc/systemd/system/ceph-f9722044-7217-11ef-bceb-c7b262605968@.service. 2024-09-13T21:35:40.146 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T21:35:40.146 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout disabled 2024-09-13T21:35:40.153 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T21:35:40.153 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout inactive 2024-09-13T21:35:40.153 INFO:teuthology.orchestra.run.smithi119.stdout:firewalld.service is not enabled 2024-09-13T21:35:40.153 INFO:teuthology.orchestra.run.smithi119.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T21:35:40.154 INFO:teuthology.orchestra.run.smithi119.stdout:Waiting for mon to start... 2024-09-13T21:35:40.154 INFO:teuthology.orchestra.run.smithi119.stdout:Waiting for mon... 2024-09-13T21:35:40.277 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:40 smithi119 systemd[1]: Started Ceph mon.smithi119 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:35:41.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:41 smithi119 ceph-mon[27285]: mon.smithi119 is new leader, mons smithi119 in quorum (ranks 0) 2024-09-13T21:35:41.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:41 smithi119 ceph-mon[27285]: monmap e1: 1 mons at {smithi119=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T21:35:41.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:41 smithi119 ceph-mon[27285]: fsmap 2024-09-13T21:35:41.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:41 smithi119 ceph-mon[27285]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T21:35:41.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:41 smithi119 ceph-mon[27285]: mgrmap e1: no daemons active 2024-09-13T21:35:42.328 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:42 smithi119 ceph-mon[27285]: from='client.? 172.21.15.119:0/3653834937' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T21:35:42.330 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T21:35:42.337 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout id: f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:35:42.337 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T21:35:42.337 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:42.337 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout services: 2024-09-13T21:35:42.337 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi119 (age 1.68455s) 2024-09-13T21:35:42.337 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T21:35:42.337 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T21:35:42.337 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout data: 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.684+0000 7ff08854f640 1 Processor -- start 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.684+0000 7ff08854f640 1 -- start start 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.684+0000 7ff08854f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.684+0000 7ff08854f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0801029c0 con 0x7ff080102070 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.685+0000 7ff0862eb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.685+0000 7ff0862eb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47076/0 (socket says 172.21.15.119:47076) 2024-09-13T21:35:42.338 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.685+0000 7ff0862eb640 1 -- 172.21.15.119:0/3953883643 learned_addr learned my addr 172.21.15.119:0/3953883643 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.685+0000 7ff0862eb640 1 -- 172.21.15.119:0/3953883643 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff080102b00 con 0x7ff080102070 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.687+0000 7ff0862eb640 1 --2- 172.21.15.119:0/3953883643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080102480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff070009840 tx=0x7ff0700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb9c6badc67e47f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.687+0000 7ff0852e9640 1 -- 172.21.15.119:0/3953883643 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff070032440 con 0x7ff080102070 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.687+0000 7ff0852e9640 1 -- 172.21.15.119:0/3953883643 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0700325a0 con 0x7ff080102070 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.687+0000 7ff0852e9640 1 -- 172.21.15.119:0/3953883643 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff070032890 con 0x7ff080102070 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.687+0000 7ff08854f640 1 -- 172.21.15.119:0/3953883643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 msgr2=0x7ff080102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.687+0000 7ff08854f640 1 --2- 172.21.15.119:0/3953883643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080102480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff070009840 tx=0x7ff0700091d0 comp rx=0 tx=0).stop 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.688+0000 7ff08854f640 1 -- 172.21.15.119:0/3953883643 shutdown_connections 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.688+0000 7ff08854f640 1 --2- 172.21.15.119:0/3953883643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080102480 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.688+0000 7ff08854f640 1 -- 172.21.15.119:0/3953883643 >> 172.21.15.119:0/3953883643 conn(0x7ff0800fd850 msgr2=0x7ff0800ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.688+0000 7ff08854f640 1 -- 172.21.15.119:0/3953883643 shutdown_connections 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.688+0000 7ff08854f640 1 -- 172.21.15.119:0/3953883643 wait complete. 2024-09-13T21:35:42.339 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.688+0000 7ff08854f640 1 Processor -- start 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.688+0000 7ff08854f640 1 -- start start 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.688+0000 7ff08854f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080110540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.688+0000 7ff08854f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff080110a80 con 0x7ff080102070 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff0862eb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080110540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff0862eb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080110540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47080/0 (socket says 172.21.15.119:47080) 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff0862eb640 1 -- 172.21.15.119:0/3653834937 learned_addr learned my addr 172.21.15.119:0/3653834937 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff0862eb640 1 -- 172.21.15.119:0/3653834937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070009450 con 0x7ff080102070 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff0862eb640 1 --2- 172.21.15.119:0/3653834937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080110540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff07002a790 tx=0x7ff070032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff076ffd640 1 -- 172.21.15.119:0/3653834937 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff070031be0 con 0x7ff080102070 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff076ffd640 1 -- 172.21.15.119:0/3653834937 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff070031d40 con 0x7ff080102070 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff08854f640 1 -- 172.21.15.119:0/3653834937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff080110c80 con 0x7ff080102070 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff076ffd640 1 -- 172.21.15.119:0/3653834937 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff07003b5a0 con 0x7ff080102070 2024-09-13T21:35:42.340 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff08854f640 1 -- 172.21.15.119:0/3653834937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff080111090 con 0x7ff080102070 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff076ffd640 1 -- 172.21.15.119:0/3653834937 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ff070039040 con 0x7ff080102070 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.689+0000 7ff076ffd640 1 -- 172.21.15.119:0/3653834937 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff070041030 con 0x7ff080102070 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.690+0000 7ff08854f640 1 -- 172.21.15.119:0/3653834937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08004b720 con 0x7ff080102070 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.692+0000 7ff076ffd640 1 -- 172.21.15.119:0/3653834937 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7ff07002ae60 con 0x7ff080102070 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.749+0000 7ff08854f640 1 -- 172.21.15.119:0/3653834937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ff08010a060 con 0x7ff080102070 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.749+0000 7ff076ffd640 1 -- 172.21.15.119:0/3653834937 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+324 (secure 0 0 0) 0x7ff070037070 con 0x7ff080102070 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.750+0000 7ff08854f640 1 -- 172.21.15.119:0/3653834937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 msgr2=0x7ff080110540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.750+0000 7ff08854f640 1 --2- 172.21.15.119:0/3653834937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080110540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff07002a790 tx=0x7ff070032000 comp rx=0 tx=0).stop 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.750+0000 7ff08854f640 1 -- 172.21.15.119:0/3653834937 shutdown_connections 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.750+0000 7ff08854f640 1 --2- 172.21.15.119:0/3653834937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff080102070 0x7ff080110540 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.750+0000 7ff08854f640 1 -- 172.21.15.119:0/3653834937 >> 172.21.15.119:0/3653834937 conn(0x7ff0800fd850 msgr2=0x7ff080107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.750+0000 7ff08854f640 1 -- 172.21.15.119:0/3653834937 shutdown_connections 2024-09-13T21:35:42.341 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:41.750+0000 7ff08854f640 1 -- 172.21.15.119:0/3653834937 wait complete. 2024-09-13T21:35:42.342 INFO:teuthology.orchestra.run.smithi119.stdout:mon is available 2024-09-13T21:35:42.342 INFO:teuthology.orchestra.run.smithi119.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T21:35:43.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:43 smithi119 ceph-mon[27285]: from='client.? 172.21.15.119:0/1382673672' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T21:35:43.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:43 smithi119 ceph-mon[27285]: from='client.? 172.21.15.119:0/1382673672' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T21:35:43.401 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:43.401 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout fsid = f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.119:3300,v1:172.21.15.119:6789] 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T21:35:43.402 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.734+0000 7fee42388640 1 Processor -- start 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.734+0000 7fee42388640 1 -- start start 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.734+0000 7fee42388640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.734+0000 7fee42388640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1029c0 con 0x7fee3c102070 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.734+0000 7fee3bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.734+0000 7fee3bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47082/0 (socket says 172.21.15.119:47082) 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.734+0000 7fee3bfff640 1 -- 172.21.15.119:0/2910071689 learned_addr learned my addr 172.21.15.119:0/2910071689 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:43.403 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.735+0000 7fee3bfff640 1 -- 172.21.15.119:0/2910071689 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c102b00 con 0x7fee3c102070 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.735+0000 7fee3bfff640 1 --2- 172.21.15.119:0/2910071689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c102480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009840 tx=0x7fee2c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823a083656fc52bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.735+0000 7fee3affd640 1 -- 172.21.15.119:0/2910071689 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee2c032440 con 0x7fee3c102070 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.735+0000 7fee3affd640 1 -- 172.21.15.119:0/2910071689 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c0325a0 con 0x7fee3c102070 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.735+0000 7fee3affd640 1 -- 172.21.15.119:0/2910071689 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee2c032890 con 0x7fee3c102070 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.736+0000 7fee42388640 1 -- 172.21.15.119:0/2910071689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 msgr2=0x7fee3c102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.736+0000 7fee42388640 1 --2- 172.21.15.119:0/2910071689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c102480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009840 tx=0x7fee2c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.736+0000 7fee42388640 1 -- 172.21.15.119:0/2910071689 shutdown_connections 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.736+0000 7fee42388640 1 --2- 172.21.15.119:0/2910071689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c102480 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.736+0000 7fee42388640 1 -- 172.21.15.119:0/2910071689 >> 172.21.15.119:0/2910071689 conn(0x7fee3c0fd850 msgr2=0x7fee3c0ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.736+0000 7fee42388640 1 -- 172.21.15.119:0/2910071689 shutdown_connections 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.736+0000 7fee42388640 1 -- 172.21.15.119:0/2910071689 wait complete. 2024-09-13T21:35:43.404 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.736+0000 7fee42388640 1 Processor -- start 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.737+0000 7fee42388640 1 -- start start 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.737+0000 7fee42388640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c110540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.737+0000 7fee42388640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c110a80 con 0x7fee3c102070 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.737+0000 7fee3bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c110540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.737+0000 7fee3bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c110540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47086/0 (socket says 172.21.15.119:47086) 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.737+0000 7fee3bfff640 1 -- 172.21.15.119:0/1382673672 learned_addr learned my addr 172.21.15.119:0/1382673672 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.737+0000 7fee3bfff640 1 -- 172.21.15.119:0/1382673672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c009450 con 0x7fee3c102070 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.737+0000 7fee3bfff640 1 --2- 172.21.15.119:0/1382673672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c110540 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fee2c02a790 tx=0x7fee2c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.738+0000 7fee38ff9640 1 -- 172.21.15.119:0/1382673672 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee2c031be0 con 0x7fee3c102070 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.738+0000 7fee38ff9640 1 -- 172.21.15.119:0/1382673672 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c031d40 con 0x7fee3c102070 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.738+0000 7fee42388640 1 -- 172.21.15.119:0/1382673672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c110c80 con 0x7fee3c102070 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.738+0000 7fee38ff9640 1 -- 172.21.15.119:0/1382673672 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee2c03b5a0 con 0x7fee3c102070 2024-09-13T21:35:43.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.738+0000 7fee42388640 1 -- 172.21.15.119:0/1382673672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c111090 con 0x7fee3c102070 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.738+0000 7fee38ff9640 1 -- 172.21.15.119:0/1382673672 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fee2c039040 con 0x7fee3c102070 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.738+0000 7fee38ff9640 1 -- 172.21.15.119:0/1382673672 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fee2c041030 con 0x7fee3c102070 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.739+0000 7fee42388640 1 -- 172.21.15.119:0/1382673672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c04b720 con 0x7fee3c102070 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.741+0000 7fee38ff9640 1 -- 172.21.15.119:0/1382673672 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fee2c02ae60 con 0x7fee3c102070 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.795+0000 7fee42388640 1 -- 172.21.15.119:0/1382673672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fee3c109d00 con 0x7fee3c102070 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.798+0000 7fee38ff9640 1 -- 172.21.15.119:0/1382673672 <== mon.0 v2:172.21.15.119:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fee2c046cd0 con 0x7fee3c102070 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.798+0000 7fee38ff9640 1 -- 172.21.15.119:0/1382673672 <== mon.0 v2:172.21.15.119:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+467 (secure 0 0 0) 0x7fee2c037070 con 0x7fee3c102070 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.799+0000 7fee42388640 1 -- 172.21.15.119:0/1382673672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 msgr2=0x7fee3c110540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.799+0000 7fee42388640 1 --2- 172.21.15.119:0/1382673672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c110540 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fee2c02a790 tx=0x7fee2c032000 comp rx=0 tx=0).stop 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.799+0000 7fee42388640 1 -- 172.21.15.119:0/1382673672 shutdown_connections 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.799+0000 7fee42388640 1 --2- 172.21.15.119:0/1382673672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee3c102070 0x7fee3c110540 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.799+0000 7fee42388640 1 -- 172.21.15.119:0/1382673672 >> 172.21.15.119:0/1382673672 conn(0x7fee3c0fd850 msgr2=0x7fee3c107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:43.406 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.799+0000 7fee42388640 1 -- 172.21.15.119:0/1382673672 shutdown_connections 2024-09-13T21:35:43.407 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:42.799+0000 7fee42388640 1 -- 172.21.15.119:0/1382673672 wait complete. 2024-09-13T21:35:43.407 INFO:teuthology.orchestra.run.smithi119.stdout:Generating new minimal ceph.conf... 2024-09-13T21:35:44.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:44 smithi119 ceph-mon[27285]: from='client.? 172.21.15.119:0/1671057675' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:35:44.423 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.799+0000 7f18abe86640 1 Processor -- start 2024-09-13T21:35:44.423 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.799+0000 7f18abe86640 1 -- start start 2024-09-13T21:35:44.423 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.799+0000 7f18abe86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4104c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:44.423 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.799+0000 7f18abe86640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a4076f60 con 0x7f18a4076b50 2024-09-13T21:35:44.423 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.799+0000 7f18a9c22640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4104c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:44.423 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.799+0000 7f18a9c22640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4104c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47090/0 (socket says 172.21.15.119:47090) 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.799+0000 7f18a9c22640 1 -- 172.21.15.119:0/2438805582 learned_addr learned my addr 172.21.15.119:0/2438805582 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.800+0000 7f18a9c22640 1 -- 172.21.15.119:0/2438805582 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a41051a0 con 0x7f18a4076b50 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.800+0000 7f18a9c22640 1 --2- 172.21.15.119:0/2438805582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4104c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009840 tx=0x7f18a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e6e4b8a7ccd68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.800+0000 7f18a8c20640 1 -- 172.21.15.119:0/2438805582 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18a0032440 con 0x7f18a4076b50 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.800+0000 7f18a8c20640 1 -- 172.21.15.119:0/2438805582 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f18a0032a00 con 0x7f18a4076b50 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.800+0000 7f18a8c20640 1 -- 172.21.15.119:0/2438805582 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18a00319e0 con 0x7f18a4076b50 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.801+0000 7f18abe86640 1 -- 172.21.15.119:0/2438805582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 msgr2=0x7f18a4104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.801+0000 7f18abe86640 1 --2- 172.21.15.119:0/2438805582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4104c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009840 tx=0x7f18a00091d0 comp rx=0 tx=0).stop 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.801+0000 7f18abe86640 1 -- 172.21.15.119:0/2438805582 shutdown_connections 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.801+0000 7f18abe86640 1 --2- 172.21.15.119:0/2438805582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4104c60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.801+0000 7f18abe86640 1 -- 172.21.15.119:0/2438805582 >> 172.21.15.119:0/2438805582 conn(0x7f18a40fc710 msgr2=0x7f18a40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.801+0000 7f18abe86640 1 -- 172.21.15.119:0/2438805582 shutdown_connections 2024-09-13T21:35:44.424 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.801+0000 7f18abe86640 1 -- 172.21.15.119:0/2438805582 wait complete. 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.802+0000 7f18abe86640 1 Processor -- start 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.802+0000 7f18abe86640 1 -- start start 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.802+0000 7f18abe86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4110de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.802+0000 7f18abe86640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a4111320 con 0x7f18a4076b50 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.802+0000 7f18a9c22640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4110de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.802+0000 7f18a9c22640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4110de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47096/0 (socket says 172.21.15.119:47096) 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.802+0000 7f18a9c22640 1 -- 172.21.15.119:0/1671057675 learned_addr learned my addr 172.21.15.119:0/1671057675 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.802+0000 7f18a9c22640 1 -- 172.21.15.119:0/1671057675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a0009450 con 0x7f18a4076b50 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.802+0000 7f18a9c22640 1 --2- 172.21.15.119:0/1671057675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4110de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f18a0006f00 tx=0x7f18a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.802+0000 7f189a7fc640 1 -- 172.21.15.119:0/1671057675 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18a0031e30 con 0x7f18a4076b50 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.803+0000 7f189a7fc640 1 -- 172.21.15.119:0/1671057675 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f18a003d8b0 con 0x7f18a4076b50 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.803+0000 7f18abe86640 1 -- 172.21.15.119:0/1671057675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a4111520 con 0x7f18a4076b50 2024-09-13T21:35:44.425 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.803+0000 7f189a7fc640 1 -- 172.21.15.119:0/1671057675 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18a003b8f0 con 0x7f18a4076b50 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.803+0000 7f18abe86640 1 -- 172.21.15.119:0/1671057675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a4111f70 con 0x7f18a4076b50 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.803+0000 7f189a7fc640 1 -- 172.21.15.119:0/1671057675 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f18a0039070 con 0x7f18a4076b50 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.803+0000 7f189a7fc640 1 -- 172.21.15.119:0/1671057675 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f18a00466d0 con 0x7f18a4076b50 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.804+0000 7f18abe86640 1 -- 172.21.15.119:0/1671057675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a4100390 con 0x7f18a4076b50 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.806+0000 7f189a7fc640 1 -- 172.21.15.119:0/1671057675 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f18a00657a0 con 0x7f18a4076b50 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.861+0000 7f18abe86640 1 -- 172.21.15.119:0/1671057675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f18a4105f50 con 0x7f18a4076b50 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.861+0000 7f189a7fc640 1 -- 172.21.15.119:0/1671057675 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f18a0054020 con 0x7f18a4076b50 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.862+0000 7f18abe86640 1 -- 172.21.15.119:0/1671057675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 msgr2=0x7f18a4110de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.862+0000 7f18abe86640 1 --2- 172.21.15.119:0/1671057675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4110de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f18a0006f00 tx=0x7f18a0008040 comp rx=0 tx=0).stop 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.862+0000 7f18abe86640 1 -- 172.21.15.119:0/1671057675 shutdown_connections 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.862+0000 7f18abe86640 1 --2- 172.21.15.119:0/1671057675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18a4076b50 0x7f18a4110de0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.862+0000 7f18abe86640 1 -- 172.21.15.119:0/1671057675 >> 172.21.15.119:0/1671057675 conn(0x7f18a40fc710 msgr2=0x7f18a40fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.862+0000 7f18abe86640 1 -- 172.21.15.119:0/1671057675 shutdown_connections 2024-09-13T21:35:44.426 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:43.862+0000 7f18abe86640 1 -- 172.21.15.119:0/1671057675 wait complete. 2024-09-13T21:35:44.427 INFO:teuthology.orchestra.run.smithi119.stdout:Restarting the monitor... 2024-09-13T21:35:44.696 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:44 smithi119 systemd[1]: Stopping Ceph mon.smithi119 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:35:45.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:44 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119[27281]: 2024-09-13T21:35:44.692+0000 7f168976b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi119 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:35:45.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:44 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119[27281]: 2024-09-13T21:35:44.692+0000 7f168976b640 -1 mon.smithi119@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T21:35:45.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:44 smithi119 podman[27528]: 2024-09-13 21:35:44.867839221 +0000 UTC m=+0.281509919 container died 73ca1c4b8a42d2ec7c641aad9e8e3fc71febc7766f86958b0a97ab078e69d260 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=quincy-eb16b97, ceph=True) 2024-09-13T21:35:45.529 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:45 smithi119 podman[27528]: 2024-09-13 21:35:45.235284764 +0000 UTC m=+0.648955461 container cleanup 73ca1c4b8a42d2ec7c641aad9e8e3fc71febc7766f86958b0a97ab078e69d260 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=quincy-eb16b97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T21:35:45.529 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:45 smithi119 bash[27528]: ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119 2024-09-13T21:35:45.830 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:45 smithi119 podman[27540]: 2024-09-13 21:35:45.528213671 +0000 UTC m=+0.652975426 container remove 73ca1c4b8a42d2ec7c641aad9e8e3fc71febc7766f86958b0a97ab078e69d260 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, CEPH_POINT_RELEASE=, RELEASE=quincy-eb16b97, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T21:35:45.830 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:45 smithi119 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi119.service: Deactivated successfully. 2024-09-13T21:35:45.830 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:45 smithi119 systemd[1]: Stopped Ceph mon.smithi119 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:35:45.830 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:45 smithi119 systemd[1]: Starting Ceph mon.smithi119 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:35:46.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:45 smithi119 podman[27635]: 2024-09-13 21:35:45.829081968 +0000 UTC m=+0.092180105 container create f49a62e4f3c30ef7eea1df23c2761db1daf21670d4f5d316030b337502247373 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-eb16b97, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-13T21:35:46.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:45 smithi119 podman[27635]: 2024-09-13 21:35:45.752423234 +0000 UTC m=+0.015521378 image pull ab51d1bebd1200e205d11a014c20a7f2cf49d932afcbeabdc1c9fc887c00f446 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-13T21:35:46.663 INFO:teuthology.orchestra.run.smithi119.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T21:35:46.787 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 podman[27635]: 2024-09-13 21:35:46.574184503 +0000 UTC m=+0.837282648 container init f49a62e4f3c30ef7eea1df23c2761db1daf21670d4f5d316030b337502247373 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-eb16b97) 2024-09-13T21:35:46.787 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 podman[27635]: 2024-09-13 21:35:46.57741985 +0000 UTC m=+0.840517990 container start f49a62e4f3c30ef7eea1df23c2761db1daf21670d4f5d316030b337502247373 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, RELEASE=quincy-eb16b97, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T21:35:46.787 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T21:35:46.787 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable), process ceph-mon, pid 2 2024-09-13T21:35:46.787 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: pidfile_write: ignore empty --pid-file 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: load: jerasure load: lrc 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: RocksDB version: 6.15.5 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Compile date Sep 13 2024 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: DB SUMMARY 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: DB Session ID: S6VF3QBAVWAQHP0215Y2 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: CURRENT file: CURRENT 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi119/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi119/store.db: 000010.log size: 98450 ; 2024-09-13T21:35:46.788 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.error_if_exists: 0 2024-09-13T21:35:46.789 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.create_if_missing: 0 2024-09-13T21:35:46.789 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.paranoid_checks: 1 2024-09-13T21:35:46.789 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T21:35:46.789 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.env: 0x56514aa09440 2024-09-13T21:35:46.789 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.fs: Posix File System 2024-09-13T21:35:46.789 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.info_log: 0x56514c10f0c0 2024-09-13T21:35:46.789 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T21:35:46.789 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.statistics: (nil) 2024-09-13T21:35:46.789 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.use_fsync: 0 2024-09-13T21:35:46.789 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_log_file_size: 0 2024-09-13T21:35:46.791 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T21:35:46.791 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T21:35:46.791 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T21:35:46.791 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T21:35:46.791 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.allow_fallocate: 1 2024-09-13T21:35:46.791 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T21:35:46.791 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T21:35:46.791 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.use_direct_reads: 0 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.db_log_dir: 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi119/store.db 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T21:35:46.792 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.write_buffer_manager: 0x56514c1cc810 2024-09-13T21:35:46.793 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T21:35:46.793 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-13T21:35:46.793 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T21:35:46.793 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T21:35:46.793 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T21:35:46.793 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T21:35:46.793 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T21:35:46.793 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T21:35:46.793 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T21:35:46.793 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.unordered_write: 0 2024-09-13T21:35:46.793 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.row_cache: None 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.wal_filter: None 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.preserve_deletes: 0 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.two_write_queues: 0 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.atomic_flush: 0 2024-09-13T21:35:46.794 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.log_readahead_size: 0 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_background_jobs: 2 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_background_compactions: -1 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_subcompactions: 1 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T21:35:46.795 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_open_files: -1 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_background_flushes: -1 2024-09-13T21:35:46.796 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Compression algorithms supported: 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: kZSTD supported: 0 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: kXpressCompression supported: 0 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: kBZip2Compression supported: 0 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: kLZ4Compression supported: 1 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: kZlibCompression supported: 1 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: kSnappyCompression supported: 1 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi119/store.db/MANIFEST-000009 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T21:35:46.797 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.merge_operator: 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_filter: None 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56514c0b5a38) 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: cache_index_and_filter_blocks: 1 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: pin_top_level_index_and_filter: 1 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_type: 0 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: data_block_index_type: 0 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_shortening: 1 2024-09-13T21:35:46.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: hash_index_allow_collision: 1 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: checksum: 1 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: no_block_cache: 0 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache: 0x56514c0eb1f0 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_name: BinnedLRUCache 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_options: 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: capacity : 536870912 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: num_shard_bits : 4 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: strict_capacity_limit : 0 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: high_pri_pool_ratio: 0.000 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_compressed: (nil) 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: persistent_cache: (nil) 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_size: 4096 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_size_deviation: 10 2024-09-13T21:35:46.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_restart_interval: 16 2024-09-13T21:35:46.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_block_restart_interval: 1 2024-09-13T21:35:46.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: metadata_block_size: 4096 2024-09-13T21:35:46.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: partition_filters: 0 2024-09-13T21:35:46.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: use_delta_encoding: 1 2024-09-13T21:35:46.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-13T21:35:46.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: whole_key_filtering: 1 2024-09-13T21:35:46.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: verify_compression: 0 2024-09-13T21:35:46.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: read_amp_bytes_per_bit: 0 2024-09-13T21:35:46.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: format_version: 4 2024-09-13T21:35:46.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: enable_index_compression: 1 2024-09-13T21:35:46.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_align: 0 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compression: NoCompression 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.num_levels: 7 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T21:35:46.801 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T21:35:46.802 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T21:35:46.803 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.arena_block_size: 4194304 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T21:35:46.804 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.inplace_update_support: 0 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.bloom_locality: 0 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.max_successive_merges: 0 2024-09-13T21:35:46.805 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.ttl: 2592000 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.enable_blob_files: false 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.min_blob_size: 0 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T21:35:46.806 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi119/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263346601829, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263346602818, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93527, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91607, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13594, "raw_average_key_size": 49, "raw_value_size": 84163, "raw_average_value_size": 306, "num_data_blocks": 11, "num_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726263346, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "99aa5b0a-b55a-4a01-a665-bf5ed5e49057", "db_session_id": "S6VF3QBAVWAQHP0215Y2"}} 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726263346603166, "job": 1, "event": "recovery_finished"} 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi119/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x56514c11e700 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: DB pointer 0x56514c0ee000 2024-09-13T21:35:46.807 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** DB Stats ** 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T21:35:46.808 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: L0 2/0 93.16 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.5 0.00 0.00 1 0.001 0 0 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Sum 2/0 93.16 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.5 0.00 0.00 1 0.001 0 0 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.5 0.00 0.00 1 0.001 0 0 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 126.5 0.00 0.00 1 0.001 0 0 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T21:35:46.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative compaction: 0.00 GB write, 26.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval compaction: 0.00 GB write, 26.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: L0 2/0 93.16 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.5 0.00 0.00 1 0.001 0 0 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Sum 2/0 93.16 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.5 0.00 0.00 1 0.001 0 0 2024-09-13T21:35:46.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 126.5 0.00 0.00 1 0.001 0 0 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative compaction: 0.00 GB write, 26.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:35:46.811 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: starting mon.smithi119 rank 0 at public addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] at bind addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi119 fsid f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: mon.smithi119@-1(???) e1 preinit fsid f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: mon.smithi119@-1(???).mds e1 new map 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: mon.smithi119@-1(???).mds e1 print_map 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: e1 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: legacy client fscid: -1 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: No filesystems configured 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: mon.smithi119@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T21:35:46.812 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: mon.smithi119@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T21:35:46.813 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: mon.smithi119@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T21:35:46.813 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: mon.smithi119@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T21:35:46.813 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: mon.smithi119@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T21:35:46.813 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 bash[27635]: f49a62e4f3c30ef7eea1df23c2761db1daf21670d4f5d316030b337502247373 2024-09-13T21:35:46.813 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 systemd[1]: Started Ceph mon.smithi119 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:35:46.813 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: mon.smithi119 is new leader, mons smithi119 in quorum (ranks 0) 2024-09-13T21:35:46.813 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: monmap e1: 1 mons at {smithi119=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T21:35:46.813 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: fsmap 2024-09-13T21:35:46.813 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T21:35:46.813 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:46 smithi119 ceph-mon[27653]: mgrmap e1: no daemons active 2024-09-13T21:35:47.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.105+0000 7fd76e2bc640 1 Processor -- start 2024-09-13T21:35:47.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.105+0000 7fd76e2bc640 1 -- start start 2024-09-13T21:35:47.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.105+0000 7fd76e2bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd7681018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:47.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.105+0000 7fd76e2bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd768101e00 con 0x7fd7681014b0 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.105+0000 7fd767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd7681018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.105+0000 7fd767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd7681018c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55562/0 (socket says 172.21.15.119:55562) 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.105+0000 7fd767fff640 1 -- 172.21.15.119:0/1160649894 learned_addr learned my addr 172.21.15.119:0/1160649894 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.106+0000 7fd767fff640 1 -- 172.21.15.119:0/1160649894 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd768101f40 con 0x7fd7681014b0 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.108+0000 7fd767fff640 1 --2- 172.21.15.119:0/1160649894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd7681018c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd758009840 tx=0x7fd7580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e8909fef3d6b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.108+0000 7fd7677fe640 1 -- 172.21.15.119:0/1160649894 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd758032440 con 0x7fd7681014b0 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.108+0000 7fd7677fe640 1 -- 172.21.15.119:0/1160649894 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd758032a00 con 0x7fd7681014b0 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.108+0000 7fd7677fe640 1 -- 172.21.15.119:0/1160649894 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7580319e0 con 0x7fd7681014b0 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd76e2bc640 1 -- 172.21.15.119:0/1160649894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 msgr2=0x7fd7681018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd76e2bc640 1 --2- 172.21.15.119:0/1160649894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd7681018c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd758009840 tx=0x7fd7580091d0 comp rx=0 tx=0).stop 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd76e2bc640 1 -- 172.21.15.119:0/1160649894 shutdown_connections 2024-09-13T21:35:47.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd76e2bc640 1 --2- 172.21.15.119:0/1160649894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd7681018c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd76e2bc640 1 -- 172.21.15.119:0/1160649894 >> 172.21.15.119:0/1160649894 conn(0x7fd7680fbdc0 msgr2=0x7fd7680fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd76e2bc640 1 -- 172.21.15.119:0/1160649894 shutdown_connections 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd76e2bc640 1 -- 172.21.15.119:0/1160649894 wait complete. 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd76e2bc640 1 Processor -- start 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd76e2bc640 1 -- start start 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd76e2bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd76810eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd76e2bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76810f050 con 0x7fd7681014b0 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd76810eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd76810eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55568/0 (socket says 172.21.15.119:55568) 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.109+0000 7fd767fff640 1 -- 172.21.15.119:0/2911764155 learned_addr learned my addr 172.21.15.119:0/2911764155 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.110+0000 7fd767fff640 1 -- 172.21.15.119:0/2911764155 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758009450 con 0x7fd7681014b0 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.110+0000 7fd767fff640 1 --2- 172.21.15.119:0/2911764155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd76810eb10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd7580098a0 tx=0x7fd758008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:47.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.110+0000 7fd7657fa640 1 -- 172.21.15.119:0/2911764155 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd758032880 con 0x7fd7681014b0 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.110+0000 7fd7657fa640 1 -- 172.21.15.119:0/2911764155 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd75803d8b0 con 0x7fd7681014b0 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.110+0000 7fd76e2bc640 1 -- 172.21.15.119:0/2911764155 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76810f250 con 0x7fd7681014b0 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.110+0000 7fd7657fa640 1 -- 172.21.15.119:0/2911764155 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd75803b910 con 0x7fd7681014b0 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.110+0000 7fd76e2bc640 1 -- 172.21.15.119:0/2911764155 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76810f6c0 con 0x7fd7681014b0 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.110+0000 7fd7657fa640 1 -- 172.21.15.119:0/2911764155 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd758039070 con 0x7fd7681014b0 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.110+0000 7fd7657fa640 1 -- 172.21.15.119:0/2911764155 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd758046700 con 0x7fd7681014b0 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.111+0000 7fd76e2bc640 1 -- 172.21.15.119:0/2911764155 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76804b720 con 0x7fd7681014b0 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.113+0000 7fd7657fa640 1 -- 172.21.15.119:0/2911764155 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd7580657a0 con 0x7fd7681014b0 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.168+0000 7fd76e2bc640 1 -- 172.21.15.119:0/2911764155 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fd768110660 con 0x7fd7681014b0 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.170+0000 7fd7657fa640 1 -- 172.21.15.119:0/2911764155 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd758054020 con 0x7fd7681014b0 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.171+0000 7fd76e2bc640 1 -- 172.21.15.119:0/2911764155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 msgr2=0x7fd76810eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.171+0000 7fd76e2bc640 1 --2- 172.21.15.119:0/2911764155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd76810eb10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd7580098a0 tx=0x7fd758008040 comp rx=0 tx=0).stop 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.171+0000 7fd76e2bc640 1 -- 172.21.15.119:0/2911764155 shutdown_connections 2024-09-13T21:35:47.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.171+0000 7fd76e2bc640 1 --2- 172.21.15.119:0/2911764155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7681014b0 0x7fd76810eb10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:47.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.171+0000 7fd76e2bc640 1 -- 172.21.15.119:0/2911764155 >> 172.21.15.119:0/2911764155 conn(0x7fd7680fbdc0 msgr2=0x7fd7681054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:47.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.171+0000 7fd76e2bc640 1 -- 172.21.15.119:0/2911764155 shutdown_connections 2024-09-13T21:35:47.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:47.171+0000 7fd76e2bc640 1 -- 172.21.15.119:0/2911764155 wait complete. 2024-09-13T21:35:47.692 INFO:teuthology.orchestra.run.smithi119.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T21:35:47.692 INFO:teuthology.orchestra.run.smithi119.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:35:47.692 INFO:teuthology.orchestra.run.smithi119.stdout:Creating mgr... 2024-09-13T21:35:47.692 INFO:teuthology.orchestra.run.smithi119.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T21:35:47.692 INFO:teuthology.orchestra.run.smithi119.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T21:35:47.692 INFO:teuthology.orchestra.run.smithi119.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-13T21:35:47.860 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f9722044-7217-11ef-bceb-c7b262605968@mgr.smithi119.gwjxmq 2024-09-13T21:35:47.860 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f9722044-7217-11ef-bceb-c7b262605968@mgr.smithi119.gwjxmq.service: Unit ceph-f9722044-7217-11ef-bceb-c7b262605968@mgr.smithi119.gwjxmq.service not loaded. 2024-09-13T21:35:48.012 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f9722044-7217-11ef-bceb-c7b262605968.target.wants/ceph-f9722044-7217-11ef-bceb-c7b262605968@mgr.smithi119.gwjxmq.service → /etc/systemd/system/ceph-f9722044-7217-11ef-bceb-c7b262605968@.service. 2024-09-13T21:35:48.477 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:48 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2911764155' entity='client.admin' 2024-09-13T21:35:48.574 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T21:35:48.574 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout disabled 2024-09-13T21:35:48.582 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T21:35:48.583 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout inactive 2024-09-13T21:35:48.583 INFO:teuthology.orchestra.run.smithi119.stdout:firewalld.service is not enabled 2024-09-13T21:35:48.583 INFO:teuthology.orchestra.run.smithi119.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T21:35:48.591 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T21:35:48.592 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout disabled 2024-09-13T21:35:48.599 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T21:35:48.599 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout inactive 2024-09-13T21:35:48.600 INFO:teuthology.orchestra.run.smithi119.stdout:firewalld.service is not enabled 2024-09-13T21:35:48.600 INFO:teuthology.orchestra.run.smithi119.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-13T21:35:48.600 INFO:teuthology.orchestra.run.smithi119.stdout:Waiting for mgr to start... 2024-09-13T21:35:48.600 INFO:teuthology.orchestra.run.smithi119.stdout:Waiting for mgr... 2024-09-13T21:35:49.319 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:49 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/73101760' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T21:35:49.706 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:49.706 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:35:49.706 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "fsid": "f9722044-7217-11ef-bceb-c7b262605968", 2024-09-13T21:35:49.706 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T21:35:49.706 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T21:35:49.706 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T21:35:49.706 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T21:35:49.707 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:49.707 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T21:35:49.707 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T21:35:49.707 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 0 2024-09-13T21:35:49.707 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:35:49.707 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T21:35:49.707 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "smithi119" 2024-09-13T21:35:49.707 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:35:49.707 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-13T21:35:49.707 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T21:35:49.708 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:49.708 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-13T21:35:49.708 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T21:35:49.708 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:49.708 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T21:35:49.708 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:49.708 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T21:35:49.708 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T21:35:49.708 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T21:35:49.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T21:35:49.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:49.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:35:49.718 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T21:35:40.068149+0000", 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.046+0000 7fce8375e640 1 Processor -- start 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.046+0000 7fce8375e640 1 -- start start 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.047+0000 7fce8375e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c1012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.047+0000 7fce8375e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c1017e0 con 0x7fce7c100e90 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.047+0000 7fce814fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c1012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:49.719 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.047+0000 7fce814fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c1012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55598/0 (socket says 172.21.15.119:55598) 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.047+0000 7fce814fa640 1 -- 172.21.15.119:0/3237586750 learned_addr learned my addr 172.21.15.119:0/3237586750 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.047+0000 7fce814fa640 1 -- 172.21.15.119:0/3237586750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c101920 con 0x7fce7c100e90 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.048+0000 7fce814fa640 1 --2- 172.21.15.119:0/3237586750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c1012a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fce78009840 tx=0x7fce780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d673d2f7452c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.049+0000 7fce73fff640 1 -- 172.21.15.119:0/3237586750 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce78032440 con 0x7fce7c100e90 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.049+0000 7fce73fff640 1 -- 172.21.15.119:0/3237586750 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fce78032a00 con 0x7fce7c100e90 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.049+0000 7fce73fff640 1 -- 172.21.15.119:0/3237586750 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce78031a10 con 0x7fce7c100e90 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.049+0000 7fce8375e640 1 -- 172.21.15.119:0/3237586750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 msgr2=0x7fce7c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.049+0000 7fce8375e640 1 --2- 172.21.15.119:0/3237586750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c1012a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fce78009840 tx=0x7fce780091d0 comp rx=0 tx=0).stop 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.049+0000 7fce8375e640 1 -- 172.21.15.119:0/3237586750 shutdown_connections 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.049+0000 7fce8375e640 1 --2- 172.21.15.119:0/3237586750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c1012a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.049+0000 7fce8375e640 1 -- 172.21.15.119:0/3237586750 >> 172.21.15.119:0/3237586750 conn(0x7fce7c0fc6d0 msgr2=0x7fce7c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.049+0000 7fce8375e640 1 -- 172.21.15.119:0/3237586750 shutdown_connections 2024-09-13T21:35:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.049+0000 7fce8375e640 1 -- 172.21.15.119:0/3237586750 wait complete. 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.050+0000 7fce8375e640 1 Processor -- start 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.051+0000 7fce8375e640 1 -- start start 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.051+0000 7fce8375e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.051+0000 7fce8375e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c110180 con 0x7fce7c100e90 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.051+0000 7fce814fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.051+0000 7fce814fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c10fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55604/0 (socket says 172.21.15.119:55604) 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.051+0000 7fce814fa640 1 -- 172.21.15.119:0/73101760 learned_addr learned my addr 172.21.15.119:0/73101760 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.051+0000 7fce814fa640 1 -- 172.21.15.119:0/73101760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce78009450 con 0x7fce7c100e90 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.051+0000 7fce814fa640 1 --2- 172.21.15.119:0/73101760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c10fc40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fce780098a0 tx=0x7fce7802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.051+0000 7fce71ffb640 1 -- 172.21.15.119:0/73101760 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce780327b0 con 0x7fce7c100e90 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.051+0000 7fce71ffb640 1 -- 172.21.15.119:0/73101760 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fce7803b870 con 0x7fce7c100e90 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.052+0000 7fce8375e640 1 -- 172.21.15.119:0/73101760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c110380 con 0x7fce7c100e90 2024-09-13T21:35:49.721 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.052+0000 7fce71ffb640 1 -- 172.21.15.119:0/73101760 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce7803a550 con 0x7fce7c100e90 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.052+0000 7fce8375e640 1 -- 172.21.15.119:0/73101760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c110730 con 0x7fce7c100e90 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.052+0000 7fce71ffb640 1 -- 172.21.15.119:0/73101760 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fce78039040 con 0x7fce7c100e90 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.052+0000 7fce71ffb640 1 -- 172.21.15.119:0/73101760 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fce780447a0 con 0x7fce7c100e90 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.053+0000 7fce8375e640 1 -- 172.21.15.119:0/73101760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c04b720 con 0x7fce7c100e90 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.055+0000 7fce71ffb640 1 -- 172.21.15.119:0/73101760 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fce78049060 con 0x7fce7c100e90 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.114+0000 7fce8375e640 1 -- 172.21.15.119:0/73101760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fce7c110f10 con 0x7fce7c100e90 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.114+0000 7fce71ffb640 1 -- 172.21.15.119:0/73101760 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fce7803f070 con 0x7fce7c100e90 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.115+0000 7fce8375e640 1 -- 172.21.15.119:0/73101760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 msgr2=0x7fce7c10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.115+0000 7fce8375e640 1 --2- 172.21.15.119:0/73101760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c10fc40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fce780098a0 tx=0x7fce7802c040 comp rx=0 tx=0).stop 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.115+0000 7fce8375e640 1 -- 172.21.15.119:0/73101760 shutdown_connections 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.115+0000 7fce8375e640 1 --2- 172.21.15.119:0/73101760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c100e90 0x7fce7c10fc40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.115+0000 7fce8375e640 1 -- 172.21.15.119:0/73101760 >> 172.21.15.119:0/73101760 conn(0x7fce7c0fc6d0 msgr2=0x7fce7c0fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:49.722 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.115+0000 7fce8375e640 1 -- 172.21.15.119:0/73101760 shutdown_connections 2024-09-13T21:35:49.723 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:49.115+0000 7fce8375e640 1 -- 172.21.15.119:0/73101760 wait complete. 2024-09-13T21:35:49.723 INFO:teuthology.orchestra.run.smithi119.stdout:mgr not available, waiting (1/15)... 2024-09-13T21:35:52.533 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:52 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3055853170' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T21:35:52.755 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:52.755 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:35:52.755 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "fsid": "f9722044-7217-11ef-bceb-c7b262605968", 2024-09-13T21:35:52.755 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T21:35:52.755 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 0 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "smithi119" 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:52.756 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-13T21:35:52.757 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T21:35:52.757 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:52.757 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T21:35:52.757 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:52.757 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T21:35:52.757 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T21:35:52.757 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T21:35:52.764 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T21:35:52.764 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T21:35:52.764 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:52.765 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T21:35:52.766 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:52.766 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T21:35:52.766 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T21:35:52.766 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:52.766 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T21:35:52.766 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T21:35:52.766 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T21:35:52.766 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T21:35:52.766 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T21:35:52.766 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T21:35:40.068149+0000", 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.115+0000 7f20fbd0f640 1 Processor -- start 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.115+0000 7f20fbd0f640 1 -- start start 2024-09-13T21:35:52.767 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.115+0000 7f20fbd0f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.115+0000 7f20fbd0f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f41050c0 con 0x7f20f4076b70 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.115+0000 7f20f9aab640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.115+0000 7f20f9aab640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55618/0 (socket says 172.21.15.119:55618) 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.115+0000 7f20f9aab640 1 -- 172.21.15.119:0/3198140643 learned_addr learned my addr 172.21.15.119:0/3198140643 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.116+0000 7f20f9aab640 1 -- 172.21.15.119:0/3198140643 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f4105200 con 0x7f20f4076b70 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.116+0000 7f20f9aab640 1 --2- 172.21.15.119:0/3198140643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4104b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009840 tx=0x7f20f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f58be59d9742e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.117+0000 7f20f8aa9640 1 -- 172.21.15.119:0/3198140643 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20f0032440 con 0x7f20f4076b70 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.117+0000 7f20f8aa9640 1 -- 172.21.15.119:0/3198140643 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f20f0032a00 con 0x7f20f4076b70 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.117+0000 7f20f8aa9640 1 -- 172.21.15.119:0/3198140643 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20f0031a10 con 0x7f20f4076b70 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.117+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3198140643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 msgr2=0x7f20f4104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.117+0000 7f20fbd0f640 1 --2- 172.21.15.119:0/3198140643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4104b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009840 tx=0x7f20f00091d0 comp rx=0 tx=0).stop 2024-09-13T21:35:52.768 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.117+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3198140643 shutdown_connections 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.117+0000 7f20fbd0f640 1 --2- 172.21.15.119:0/3198140643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4104b80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.117+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3198140643 >> 172.21.15.119:0/3198140643 conn(0x7f20f40fc6d0 msgr2=0x7f20f40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.117+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3198140643 shutdown_connections 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.117+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3198140643 wait complete. 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.118+0000 7f20fbd0f640 1 Processor -- start 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.118+0000 7f20fbd0f640 1 -- start start 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.118+0000 7f20fbd0f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.118+0000 7f20fbd0f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f4111340 con 0x7f20f4076b70 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.118+0000 7f20f9aab640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.118+0000 7f20f9aab640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55620/0 (socket says 172.21.15.119:55620) 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.118+0000 7f20f9aab640 1 -- 172.21.15.119:0/3055853170 learned_addr learned my addr 172.21.15.119:0/3055853170 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.119+0000 7f20f9aab640 1 -- 172.21.15.119:0/3055853170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0009450 con 0x7f20f4076b70 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.119+0000 7f20f9aab640 1 --2- 172.21.15.119:0/3055853170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4110e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20f00098a0 tx=0x7f20f002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:52.769 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.119+0000 7f20ea7fc640 1 -- 172.21.15.119:0/3055853170 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20f00327b0 con 0x7f20f4076b70 2024-09-13T21:35:52.770 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.119+0000 7f20ea7fc640 1 -- 172.21.15.119:0/3055853170 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f20f003b870 con 0x7f20f4076b70 2024-09-13T21:35:52.770 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.119+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3055853170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f4111540 con 0x7f20f4076b70 2024-09-13T21:35:52.770 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.120+0000 7f20ea7fc640 1 -- 172.21.15.119:0/3055853170 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20f003a550 con 0x7f20f4076b70 2024-09-13T21:35:52.770 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.120+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3055853170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f4111f90 con 0x7f20f4076b70 2024-09-13T21:35:52.770 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.120+0000 7f20ea7fc640 1 -- 172.21.15.119:0/3055853170 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f20f0039040 con 0x7f20f4076b70 2024-09-13T21:35:52.770 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.120+0000 7f20ea7fc640 1 -- 172.21.15.119:0/3055853170 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f20f00449f0 con 0x7f20f4076b70 2024-09-13T21:35:52.770 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.120+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3055853170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f41002f0 con 0x7f20f4076b70 2024-09-13T21:35:52.770 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.122+0000 7f20ea7fc640 1 -- 172.21.15.119:0/3055853170 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f20f0049060 con 0x7f20f4076b70 2024-09-13T21:35:52.770 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.181+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3055853170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f20f404b720 con 0x7f20f4076b70 2024-09-13T21:35:52.770 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.182+0000 7f20ea7fc640 1 -- 172.21.15.119:0/3055853170 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f20f003f070 con 0x7f20f4076b70 2024-09-13T21:35:52.770 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.183+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3055853170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 msgr2=0x7f20f4110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:52.771 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.183+0000 7f20fbd0f640 1 --2- 172.21.15.119:0/3055853170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4110e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20f00098a0 tx=0x7f20f002c040 comp rx=0 tx=0).stop 2024-09-13T21:35:52.771 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.183+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3055853170 shutdown_connections 2024-09-13T21:35:52.771 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.183+0000 7f20fbd0f640 1 --2- 172.21.15.119:0/3055853170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20f4076b70 0x7f20f4110e00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:52.771 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.183+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3055853170 >> 172.21.15.119:0/3055853170 conn(0x7f20f40fc6d0 msgr2=0x7f20f40fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:52.771 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.183+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3055853170 shutdown_connections 2024-09-13T21:35:52.771 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:52.183+0000 7f20fbd0f640 1 -- 172.21.15.119:0/3055853170 wait complete. 2024-09-13T21:35:52.771 INFO:teuthology.orchestra.run.smithi119.stdout:mgr not available, waiting (2/15)... 2024-09-13T21:35:53.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: Activating manager daemon smithi119.gwjxmq 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: mgrmap e2: smithi119.gwjxmq(active, starting, since 0.00289012s) 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: from='mgr.14100 172.21.15.119:0/767092752' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: from='mgr.14100 172.21.15.119:0/767092752' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: from='mgr.14100 172.21.15.119:0/767092752' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: from='mgr.14100 172.21.15.119:0/767092752' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: from='mgr.14100 172.21.15.119:0/767092752' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi119.gwjxmq", "id": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: Manager daemon smithi119.gwjxmq is now available 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: from='mgr.14100 172.21.15.119:0/767092752' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: from='mgr.14100 172.21.15.119:0/767092752' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/trash_purge_schedule"}]: dispatch 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: from='mgr.14100 172.21.15.119:0/767092752' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: from='mgr.14100 172.21.15.119:0/767092752' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:35:53.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:53 smithi119 ceph-mon[27653]: from='mgr.14100 172.21.15.119:0/767092752' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:35:55.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:54 smithi119 ceph-mon[27653]: mgrmap e3: smithi119.gwjxmq(active, since 1.00707s) 2024-09-13T21:35:55.852 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:55.852 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:35:55.852 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "fsid": "f9722044-7217-11ef-bceb-c7b262605968", 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 0 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "smithi119" 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:35:55.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-13T21:35:55.854 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T21:35:55.854 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:55.854 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-13T21:35:55.854 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T21:35:55.854 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:55.854 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T21:35:55.854 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:55.854 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T21:35:55.854 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T21:35:55.854 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T21:35:55.862 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T21:35:55.862 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T21:35:55.862 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T21:35:55.862 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T21:35:55.863 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout ], 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T21:35:55.864 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T21:35:40.068149+0000", 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout }, 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.122+0000 7fb59c980640 1 Processor -- start 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.122+0000 7fb59c980640 1 -- start start 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.122+0000 7fb59c980640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.122+0000 7fb59c980640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb598078fc0 con 0x7fb598078b20 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.122+0000 7fb59659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.122+0000 7fb59659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36088/0 (socket says 172.21.15.119:36088) 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.122+0000 7fb59659c640 1 -- 172.21.15.119:0/966057481 learned_addr learned my addr 172.21.15.119:0/966057481 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.123+0000 7fb59659c640 1 -- 172.21.15.119:0/966057481 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598079100 con 0x7fb598078b20 2024-09-13T21:35:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.123+0000 7fb59659c640 1 --2- 172.21.15.119:0/966057481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598077230 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb588009840 tx=0x7fb5880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1e6bd287f99878 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.124+0000 7fb595d9b640 1 -- 172.21.15.119:0/966057481 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb588032440 con 0x7fb598078b20 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.124+0000 7fb595d9b640 1 -- 172.21.15.119:0/966057481 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fb588032a00 con 0x7fb598078b20 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.124+0000 7fb595d9b640 1 -- 172.21.15.119:0/966057481 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5880319e0 con 0x7fb598078b20 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.124+0000 7fb59c980640 1 -- 172.21.15.119:0/966057481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 msgr2=0x7fb598077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.124+0000 7fb59c980640 1 --2- 172.21.15.119:0/966057481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598077230 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb588009840 tx=0x7fb5880091d0 comp rx=0 tx=0).stop 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.124+0000 7fb59c980640 1 -- 172.21.15.119:0/966057481 shutdown_connections 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.124+0000 7fb59c980640 1 --2- 172.21.15.119:0/966057481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598077230 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.124+0000 7fb59c980640 1 -- 172.21.15.119:0/966057481 >> 172.21.15.119:0/966057481 conn(0x7fb5980fd850 msgr2=0x7fb5980ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.124+0000 7fb59c980640 1 -- 172.21.15.119:0/966057481 shutdown_connections 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.124+0000 7fb59c980640 1 -- 172.21.15.119:0/966057481 wait complete. 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.125+0000 7fb59c980640 1 Processor -- start 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.125+0000 7fb59c980640 1 -- start start 2024-09-13T21:35:55.866 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.125+0000 7fb59c980640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.125+0000 7fb59c980640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5981134c0 con 0x7fb598078b20 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.125+0000 7fb59659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.125+0000 7fb59659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36090/0 (socket says 172.21.15.119:36090) 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.125+0000 7fb59659c640 1 -- 172.21.15.119:0/4129849912 learned_addr learned my addr 172.21.15.119:0/4129849912 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.126+0000 7fb59659c640 1 -- 172.21.15.119:0/4129849912 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588009450 con 0x7fb598078b20 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.126+0000 7fb59659c640 1 --2- 172.21.15.119:0/4129849912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598112f80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb588006f00 tx=0x7fb588008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.126+0000 7fb58f7fe640 1 -- 172.21.15.119:0/4129849912 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb588032880 con 0x7fb598078b20 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.126+0000 7fb58f7fe640 1 -- 172.21.15.119:0/4129849912 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fb58803b8d0 con 0x7fb598078b20 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.126+0000 7fb59c980640 1 -- 172.21.15.119:0/4129849912 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5981136c0 con 0x7fb598078b20 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.126+0000 7fb58f7fe640 1 -- 172.21.15.119:0/4129849912 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb58803a8f0 con 0x7fb598078b20 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.126+0000 7fb59c980640 1 -- 172.21.15.119:0/4129849912 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb598113b30 con 0x7fb598078b20 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.127+0000 7fb58f7fe640 1 -- 172.21.15.119:0/4129849912 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fb58803b470 con 0x7fb598078b20 2024-09-13T21:35:55.867 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.127+0000 7fb59c980640 1 -- 172.21.15.119:0/4129849912 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59804b720 con 0x7fb598078b20 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.127+0000 7fb58f7fe640 1 --2- 172.21.15.119:0/4129849912 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fb584039490 0x7fb58403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.127+0000 7fb58f7fe640 1 -- 172.21.15.119:0/4129849912 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb58806c8f0 con 0x7fb598078b20 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.127+0000 7fb58dd9b640 1 --2- 172.21.15.119:0/4129849912 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fb584039490 0x7fb58403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.128+0000 7fb58dd9b640 1 --2- 172.21.15.119:0/4129849912 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fb584039490 0x7fb58403b940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb580006fd0 tx=0x7fb580006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.132+0000 7fb58f7fe640 1 -- 172.21.15.119:0/4129849912 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb58803ab60 con 0x7fb598078b20 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.348+0000 7fb59c980640 1 -- 172.21.15.119:0/4129849912 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb5981081c0 con 0x7fb598078b20 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.348+0000 7fb58f7fe640 1 -- 172.21.15.119:0/4129849912 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7fb588037020 con 0x7fb598078b20 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.350+0000 7fb59c980640 1 -- 172.21.15.119:0/4129849912 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fb584039490 msgr2=0x7fb58403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.350+0000 7fb59c980640 1 --2- 172.21.15.119:0/4129849912 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fb584039490 0x7fb58403b940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb580006fd0 tx=0x7fb580006db0 comp rx=0 tx=0).stop 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.350+0000 7fb59c980640 1 -- 172.21.15.119:0/4129849912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 msgr2=0x7fb598112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.350+0000 7fb59c980640 1 --2- 172.21.15.119:0/4129849912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598112f80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb588006f00 tx=0x7fb588008040 comp rx=0 tx=0).stop 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.350+0000 7fb59c980640 1 -- 172.21.15.119:0/4129849912 shutdown_connections 2024-09-13T21:35:55.868 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.350+0000 7fb59c980640 1 --2- 172.21.15.119:0/4129849912 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fb584039490 0x7fb58403b940 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:55.869 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.350+0000 7fb59c980640 1 --2- 172.21.15.119:0/4129849912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb598078b20 0x7fb598112f80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:55.869 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.350+0000 7fb59c980640 1 -- 172.21.15.119:0/4129849912 >> 172.21.15.119:0/4129849912 conn(0x7fb5980fd850 msgr2=0x7fb5980fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:55.869 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.350+0000 7fb59c980640 1 -- 172.21.15.119:0/4129849912 shutdown_connections 2024-09-13T21:35:55.869 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:55.351+0000 7fb59c980640 1 -- 172.21.15.119:0/4129849912 wait complete. 2024-09-13T21:35:55.869 INFO:teuthology.orchestra.run.smithi119.stdout:mgr is available 2024-09-13T21:35:56.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:55 smithi119 ceph-mon[27653]: mgrmap e4: smithi119.gwjxmq(active, since 2s) 2024-09-13T21:35:56.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:55 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/4129849912' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T21:35:56.947 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:56.947 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T21:35:56.947 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout fsid = f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:35:56.947 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-13T21:35:56.947 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T21:35:56.947 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T21:35:56.947 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T21:35:56.947 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T21:35:56.947 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.216+0000 7f39bffca640 1 Processor -- start 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.216+0000 7f39bffca640 1 -- start start 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.217+0000 7f39bffca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b81012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:56.948 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.217+0000 7f39bffca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b81017e0 con 0x7f39b8100e90 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.217+0000 7f39bdd66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b81012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.217+0000 7f39bdd66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b81012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36106/0 (socket says 172.21.15.119:36106) 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.217+0000 7f39bdd66640 1 -- 172.21.15.119:0/1813902478 learned_addr learned my addr 172.21.15.119:0/1813902478 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.217+0000 7f39bdd66640 1 -- 172.21.15.119:0/1813902478 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8101920 con 0x7f39b8100e90 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.218+0000 7f39bdd66640 1 --2- 172.21.15.119:0/1813902478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b81012a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009840 tx=0x7f39b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dada3adfef3915ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.218+0000 7f39bcd64640 1 -- 172.21.15.119:0/1813902478 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39b4032440 con 0x7f39b8100e90 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.218+0000 7f39bcd64640 1 -- 172.21.15.119:0/1813902478 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f39b4032a00 con 0x7f39b8100e90 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.218+0000 7f39bcd64640 1 -- 172.21.15.119:0/1813902478 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39b4031a10 con 0x7f39b8100e90 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.218+0000 7f39bffca640 1 -- 172.21.15.119:0/1813902478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 msgr2=0x7f39b81012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.218+0000 7f39bffca640 1 --2- 172.21.15.119:0/1813902478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b81012a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009840 tx=0x7f39b40091d0 comp rx=0 tx=0).stop 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.218+0000 7f39bffca640 1 -- 172.21.15.119:0/1813902478 shutdown_connections 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.218+0000 7f39bffca640 1 --2- 172.21.15.119:0/1813902478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b81012a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.218+0000 7f39bffca640 1 -- 172.21.15.119:0/1813902478 >> 172.21.15.119:0/1813902478 conn(0x7f39b80fc6d0 msgr2=0x7f39b80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.219+0000 7f39bffca640 1 -- 172.21.15.119:0/1813902478 shutdown_connections 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.219+0000 7f39bffca640 1 -- 172.21.15.119:0/1813902478 wait complete. 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.219+0000 7f39bffca640 1 Processor -- start 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.219+0000 7f39bffca640 1 -- start start 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.219+0000 7f39bffca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b810fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.219+0000 7f39bffca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8110180 con 0x7f39b8100e90 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.219+0000 7f39bdd66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b810fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.219+0000 7f39bdd66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b810fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36112/0 (socket says 172.21.15.119:36112) 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.219+0000 7f39bdd66640 1 -- 172.21.15.119:0/113265172 learned_addr learned my addr 172.21.15.119:0/113265172 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.220+0000 7f39bdd66640 1 -- 172.21.15.119:0/113265172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b4009450 con 0x7f39b8100e90 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.220+0000 7f39bdd66640 1 --2- 172.21.15.119:0/113265172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b810fc40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f39b40098a0 tx=0x7f39b402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.220+0000 7f39aa7fc640 1 -- 172.21.15.119:0/113265172 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39b40327b0 con 0x7f39b8100e90 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.220+0000 7f39aa7fc640 1 -- 172.21.15.119:0/113265172 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f39b403b870 con 0x7f39b8100e90 2024-09-13T21:35:56.950 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.220+0000 7f39aa7fc640 1 -- 172.21.15.119:0/113265172 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39b403a550 con 0x7f39b8100e90 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.220+0000 7f39bffca640 1 -- 172.21.15.119:0/113265172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b8110380 con 0x7f39b8100e90 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.220+0000 7f39bffca640 1 -- 172.21.15.119:0/113265172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b81107f0 con 0x7f39b8100e90 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.221+0000 7f39aa7fc640 1 -- 172.21.15.119:0/113265172 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f39b4039040 con 0x7f39b8100e90 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.221+0000 7f39bffca640 1 -- 172.21.15.119:0/113265172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b804b720 con 0x7f39b8100e90 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.221+0000 7f39aa7fc640 1 --2- 172.21.15.119:0/113265172 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7f39a4039450 0x7f39a403b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.221+0000 7f39aa7fc640 1 -- 172.21.15.119:0/113265172 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f39b406c700 con 0x7f39b8100e90 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.221+0000 7f39bd565640 1 --2- 172.21.15.119:0/113265172 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7f39a4039450 0x7f39a403b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.221+0000 7f39bd565640 1 --2- 172.21.15.119:0/113265172 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7f39a4039450 0x7f39a403b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f39ac006fd0 tx=0x7f39ac006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.225+0000 7f39aa7fc640 1 -- 172.21.15.119:0/113265172 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f39b404b300 con 0x7f39b8100e90 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.381+0000 7f39bffca640 1 -- 172.21.15.119:0/113265172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f39b8111150 con 0x7f39b8100e90 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.381+0000 7f39aa7fc640 1 -- 172.21.15.119:0/113265172 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7f39b403f030 con 0x7f39b8100e90 2024-09-13T21:35:56.951 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.383+0000 7f39bffca640 1 -- 172.21.15.119:0/113265172 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7f39a4039450 msgr2=0x7f39a403b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:56.952 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.383+0000 7f39bffca640 1 --2- 172.21.15.119:0/113265172 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7f39a4039450 0x7f39a403b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f39ac006fd0 tx=0x7f39ac006db0 comp rx=0 tx=0).stop 2024-09-13T21:35:56.952 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.383+0000 7f39bffca640 1 -- 172.21.15.119:0/113265172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 msgr2=0x7f39b810fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:56.952 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.383+0000 7f39bffca640 1 --2- 172.21.15.119:0/113265172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b810fc40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f39b40098a0 tx=0x7f39b402c040 comp rx=0 tx=0).stop 2024-09-13T21:35:56.952 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.383+0000 7f39bffca640 1 -- 172.21.15.119:0/113265172 shutdown_connections 2024-09-13T21:35:56.952 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.383+0000 7f39bffca640 1 --2- 172.21.15.119:0/113265172 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7f39a4039450 0x7f39a403b900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:56.952 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.383+0000 7f39bffca640 1 --2- 172.21.15.119:0/113265172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39b8100e90 0x7f39b810fc40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:56.952 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.383+0000 7f39bffca640 1 -- 172.21.15.119:0/113265172 >> 172.21.15.119:0/113265172 conn(0x7f39b80fc6d0 msgr2=0x7f39b80fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:56.952 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.383+0000 7f39bffca640 1 -- 172.21.15.119:0/113265172 shutdown_connections 2024-09-13T21:35:56.952 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:56.384+0000 7f39bffca640 1 -- 172.21.15.119:0/113265172 wait complete. 2024-09-13T21:35:56.952 INFO:teuthology.orchestra.run.smithi119.stdout:Enabling cephadm module... 2024-09-13T21:35:57.191 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:56 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/113265172' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T21:35:58.183 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:57 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3257094647' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T21:35:58.570 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.264+0000 7fe6afc50640 1 Processor -- start 2024-09-13T21:35:58.570 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.264+0000 7fe6afc50640 1 -- start start 2024-09-13T21:35:58.570 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.264+0000 7fe6afc50640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a81024a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:58.570 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.264+0000 7fe6afc50640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a81029e0 con 0x7fe6a8102090 2024-09-13T21:35:58.570 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.264+0000 7fe6ad9ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a81024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:58.570 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.264+0000 7fe6ad9ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a81024a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36120/0 (socket says 172.21.15.119:36120) 2024-09-13T21:35:58.570 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.264+0000 7fe6ad9ec640 1 -- 172.21.15.119:0/4228374838 learned_addr learned my addr 172.21.15.119:0/4228374838 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:58.570 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.265+0000 7fe6ad9ec640 1 -- 172.21.15.119:0/4228374838 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8102b20 con 0x7fe6a8102090 2024-09-13T21:35:58.570 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.265+0000 7fe6ad9ec640 1 --2- 172.21.15.119:0/4228374838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a81024a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009840 tx=0x7fe6a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57a63a176602eb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:58.570 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.265+0000 7fe6ac9ea640 1 -- 172.21.15.119:0/4228374838 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6a4032440 con 0x7fe6a8102090 2024-09-13T21:35:58.571 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.265+0000 7fe6ac9ea640 1 -- 172.21.15.119:0/4228374838 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fe6a4032a00 con 0x7fe6a8102090 2024-09-13T21:35:58.571 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.265+0000 7fe6ac9ea640 1 -- 172.21.15.119:0/4228374838 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6a4031a10 con 0x7fe6a8102090 2024-09-13T21:35:58.571 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.266+0000 7fe6afc50640 1 -- 172.21.15.119:0/4228374838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 msgr2=0x7fe6a81024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:58.571 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.266+0000 7fe6afc50640 1 --2- 172.21.15.119:0/4228374838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a81024a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009840 tx=0x7fe6a40091d0 comp rx=0 tx=0).stop 2024-09-13T21:35:58.571 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.266+0000 7fe6afc50640 1 -- 172.21.15.119:0/4228374838 shutdown_connections 2024-09-13T21:35:58.571 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.266+0000 7fe6afc50640 1 --2- 172.21.15.119:0/4228374838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a81024a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:58.571 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.266+0000 7fe6afc50640 1 -- 172.21.15.119:0/4228374838 >> 172.21.15.119:0/4228374838 conn(0x7fe6a80fd850 msgr2=0x7fe6a80ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:58.571 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.266+0000 7fe6afc50640 1 -- 172.21.15.119:0/4228374838 shutdown_connections 2024-09-13T21:35:58.571 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.266+0000 7fe6afc50640 1 -- 172.21.15.119:0/4228374838 wait complete. 2024-09-13T21:35:58.571 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe6afc50640 1 Processor -- start 2024-09-13T21:35:58.571 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe6afc50640 1 -- start start 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe6afc50640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a8110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe6afc50640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8111310 con 0x7fe6a8102090 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe6ad9ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a8110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe6ad9ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a8110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36132/0 (socket says 172.21.15.119:36132) 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe6ad9ec640 1 -- 172.21.15.119:0/3257094647 learned_addr learned my addr 172.21.15.119:0/3257094647 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe6ad9ec640 1 -- 172.21.15.119:0/3257094647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a4009450 con 0x7fe6a8102090 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe6ad9ec640 1 --2- 172.21.15.119:0/3257094647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a8110dd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4006a70 tx=0x7fe6a402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe69e7fc640 1 -- 172.21.15.119:0/3257094647 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6a4031d10 con 0x7fe6a8102090 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe69e7fc640 1 -- 172.21.15.119:0/3257094647 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fe6a4031e70 con 0x7fe6a8102090 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.267+0000 7fe69e7fc640 1 -- 172.21.15.119:0/3257094647 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6a403b6f0 con 0x7fe6a8102090 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.268+0000 7fe6afc50640 1 -- 172.21.15.119:0/3257094647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a8111510 con 0x7fe6a8102090 2024-09-13T21:35:58.572 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.268+0000 7fe6afc50640 1 -- 172.21.15.119:0/3257094647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a8111f60 con 0x7fe6a8102090 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.268+0000 7fe69e7fc640 1 -- 172.21.15.119:0/3257094647 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fe6a4039070 con 0x7fe6a8102090 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.269+0000 7fe69e7fc640 1 --2- 172.21.15.119:0/3257094647 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fe694039490 0x7fe69403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.269+0000 7fe69e7fc640 1 -- 172.21.15.119:0/3257094647 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe6a406ccd0 con 0x7fe6a8102090 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.269+0000 7fe6afc50640 1 -- 172.21.15.119:0/3257094647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a81014f0 con 0x7fe6a8102090 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.269+0000 7fe6ad1eb640 1 --2- 172.21.15.119:0/3257094647 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fe694039490 0x7fe69403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.269+0000 7fe6ad1eb640 1 --2- 172.21.15.119:0/3257094647 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fe694039490 0x7fe69403b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe698006fd0 tx=0x7fe698006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.273+0000 7fe69e7fc640 1 -- 172.21.15.119:0/3257094647 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe6a4037030 con 0x7fe6a8102090 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.468+0000 7fe6afc50640 1 -- 172.21.15.119:0/3257094647 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fe6a804b720 con 0x7fe6a8102090 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.935+0000 7fe69e7fc640 1 -- 172.21.15.119:0/3257094647 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fe6a404dd30 con 0x7fe6a8102090 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.937+0000 7fe69e7fc640 1 -- 172.21.15.119:0/3257094647 <== mon.0 v2:172.21.15.119:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fe6a406c210 con 0x7fe6a8102090 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.939+0000 7fe6afc50640 1 -- 172.21.15.119:0/3257094647 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fe694039490 msgr2=0x7fe69403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.939+0000 7fe6afc50640 1 --2- 172.21.15.119:0/3257094647 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fe694039490 0x7fe69403b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe698006fd0 tx=0x7fe698006db0 comp rx=0 tx=0).stop 2024-09-13T21:35:58.573 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.939+0000 7fe6afc50640 1 -- 172.21.15.119:0/3257094647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 msgr2=0x7fe6a8110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:58.574 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.939+0000 7fe6afc50640 1 --2- 172.21.15.119:0/3257094647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a8110dd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4006a70 tx=0x7fe6a402c040 comp rx=0 tx=0).stop 2024-09-13T21:35:58.574 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.939+0000 7fe6afc50640 1 -- 172.21.15.119:0/3257094647 shutdown_connections 2024-09-13T21:35:58.574 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.939+0000 7fe6afc50640 1 --2- 172.21.15.119:0/3257094647 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fe694039490 0x7fe69403b940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:58.574 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.939+0000 7fe6afc50640 1 --2- 172.21.15.119:0/3257094647 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6a8102090 0x7fe6a8110dd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:58.574 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.939+0000 7fe6afc50640 1 -- 172.21.15.119:0/3257094647 >> 172.21.15.119:0/3257094647 conn(0x7fe6a80fd850 msgr2=0x7fe6a80fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:58.574 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.939+0000 7fe6afc50640 1 -- 172.21.15.119:0/3257094647 shutdown_connections 2024-09-13T21:35:58.574 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:57.939+0000 7fe6afc50640 1 -- 172.21.15.119:0/3257094647 wait complete. 2024-09-13T21:35:59.015 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:58 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3257094647' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T21:35:59.015 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:58 smithi119 ceph-mon[27653]: mgrmap e5: smithi119.gwjxmq(active, since 5s) 2024-09-13T21:35:59.853 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:35:59.873 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T21:35:59.873 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T21:35:59.873 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "active_name": "smithi119.gwjxmq", 2024-09-13T21:35:59.873 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T21:35:59.873 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:35:59.873 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.013+0000 7fd4096e8640 1 Processor -- start 2024-09-13T21:35:59.873 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.013+0000 7fd4096e8640 1 -- start start 2024-09-13T21:35:59.873 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.013+0000 7fd4096e8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404102930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:59.873 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.013+0000 7fd4096e8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd404102e70 con 0x7fd404102520 2024-09-13T21:35:59.873 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.013+0000 7fd402ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404102930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:59.873 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.013+0000 7fd402ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404102930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36154/0 (socket says 172.21.15.119:36154) 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.013+0000 7fd402ffd640 1 -- 172.21.15.119:0/4204159584 learned_addr learned my addr 172.21.15.119:0/4204159584 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.013+0000 7fd402ffd640 1 -- 172.21.15.119:0/4204159584 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404102fb0 con 0x7fd404102520 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.014+0000 7fd402ffd640 1 --2- 172.21.15.119:0/4204159584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404102930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009840 tx=0x7fd3f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223cf1f915710365 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.014+0000 7fd401ffb640 1 -- 172.21.15.119:0/4204159584 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3f4032440 con 0x7fd404102520 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.014+0000 7fd401ffb640 1 -- 172.21.15.119:0/4204159584 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd3f4032a00 con 0x7fd404102520 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.014+0000 7fd401ffb640 1 -- 172.21.15.119:0/4204159584 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3f40319e0 con 0x7fd404102520 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.015+0000 7fd4096e8640 1 -- 172.21.15.119:0/4204159584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 msgr2=0x7fd404102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.015+0000 7fd4096e8640 1 --2- 172.21.15.119:0/4204159584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404102930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009840 tx=0x7fd3f40091d0 comp rx=0 tx=0).stop 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.015+0000 7fd4096e8640 1 -- 172.21.15.119:0/4204159584 shutdown_connections 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.015+0000 7fd4096e8640 1 --2- 172.21.15.119:0/4204159584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404102930 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.015+0000 7fd4096e8640 1 -- 172.21.15.119:0/4204159584 >> 172.21.15.119:0/4204159584 conn(0x7fd4040fbdd0 msgr2=0x7fd4040fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.015+0000 7fd4096e8640 1 -- 172.21.15.119:0/4204159584 shutdown_connections 2024-09-13T21:35:59.874 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.015+0000 7fd4096e8640 1 -- 172.21.15.119:0/4204159584 wait complete. 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.016+0000 7fd4096e8640 1 Processor -- start 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.016+0000 7fd4096e8640 1 -- start start 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.016+0000 7fd4096e8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404112f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.016+0000 7fd4096e8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd404113460 con 0x7fd404102520 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.016+0000 7fd402ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.016+0000 7fd402ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404112f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36164/0 (socket says 172.21.15.119:36164) 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.016+0000 7fd402ffd640 1 -- 172.21.15.119:0/1489445325 learned_addr learned my addr 172.21.15.119:0/1489445325 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.016+0000 7fd402ffd640 1 -- 172.21.15.119:0/1489445325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f4009450 con 0x7fd404102520 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.017+0000 7fd402ffd640 1 --2- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404112f20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4000c00 tx=0x7fd3f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.017+0000 7fd3eb7fe640 1 -- 172.21.15.119:0/1489445325 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3f403d450 con 0x7fd404102520 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.017+0000 7fd3eb7fe640 1 -- 172.21.15.119:0/1489445325 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd3f403da10 con 0x7fd404102520 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.017+0000 7fd3eb7fe640 1 -- 172.21.15.119:0/1489445325 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3f403b8e0 con 0x7fd404102520 2024-09-13T21:35:59.875 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.017+0000 7fd4096e8640 1 -- 172.21.15.119:0/1489445325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd404113660 con 0x7fd404102520 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.017+0000 7fd4096e8640 1 -- 172.21.15.119:0/1489445325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd404113ad0 con 0x7fd404102520 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.018+0000 7fd3eb7fe640 1 -- 172.21.15.119:0/1489445325 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fd3f4039070 con 0x7fd404102520 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.018+0000 7fd3eb7fe640 1 --2- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fd3ec039490 0x7fd3ec03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.018+0000 7fd4096e8640 1 -- 172.21.15.119:0/1489445325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40404b720 con 0x7fd404102520 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.018+0000 7fd3eb7fe640 1 -- 172.21.15.119:0/1489445325 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd3f406dd30 con 0x7fd404102520 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.018+0000 7fd4027fc640 1 -- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fd3ec039490 msgr2=0x7fd3ec03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/254943630 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.018+0000 7fd4027fc640 1 --2- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fd3ec039490 0x7fd3ec03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.022+0000 7fd3eb7fe640 1 -- 172.21.15.119:0/1489445325 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd3f4041070 con 0x7fd404102520 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.219+0000 7fd4027fc640 1 -- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fd3ec039490 msgr2=0x7fd3ec03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/254943630 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.219+0000 7fd4027fc640 1 --2- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fd3ec039490 0x7fd3ec03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.225+0000 7fd4096e8640 1 -- 172.21.15.119:0/1489445325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd404113ad0 con 0x7fd404102520 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.225+0000 7fd3eb7fe640 1 -- 172.21.15.119:0/1489445325 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fd3f4037030 con 0x7fd404102520 2024-09-13T21:35:59.876 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.227+0000 7fd4096e8640 1 -- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fd3ec039490 msgr2=0x7fd3ec03b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:35:59.877 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.227+0000 7fd4096e8640 1 --2- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fd3ec039490 0x7fd3ec03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:59.877 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.227+0000 7fd4096e8640 1 -- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 msgr2=0x7fd404112f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:35:59.877 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.227+0000 7fd4096e8640 1 --2- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404112f20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4000c00 tx=0x7fd3f4008040 comp rx=0 tx=0).stop 2024-09-13T21:35:59.877 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.227+0000 7fd4096e8640 1 -- 172.21.15.119:0/1489445325 shutdown_connections 2024-09-13T21:35:59.877 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.227+0000 7fd4096e8640 1 --2- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fd3ec039490 0x7fd3ec03b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:59.877 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.227+0000 7fd4096e8640 1 --2- 172.21.15.119:0/1489445325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd404102520 0x7fd404112f20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:35:59.877 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.227+0000 7fd4096e8640 1 -- 172.21.15.119:0/1489445325 >> 172.21.15.119:0/1489445325 conn(0x7fd4040fbdd0 msgr2=0x7fd4040fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:35:59.877 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.227+0000 7fd4096e8640 1 -- 172.21.15.119:0/1489445325 shutdown_connections 2024-09-13T21:35:59.877 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:35:59.227+0000 7fd4096e8640 1 -- 172.21.15.119:0/1489445325 wait complete. 2024-09-13T21:35:59.878 INFO:teuthology.orchestra.run.smithi119.stdout:Waiting for the mgr to restart... 2024-09-13T21:35:59.878 INFO:teuthology.orchestra.run.smithi119.stdout:Waiting for mgr epoch 5... 2024-09-13T21:36:00.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:35:59 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1489445325' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T21:36:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: Active manager daemon smithi119.gwjxmq restarted 2024-09-13T21:36:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: Activating manager daemon smithi119.gwjxmq 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: mgrmap e6: smithi119.gwjxmq(active, starting, since 0.00388029s) 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi119.gwjxmq", "id": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: Manager daemon smithi119.gwjxmq is now available 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:36:02.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:02 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/trash_purge_schedule"}]: dispatch 2024-09-13T21:36:03.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:03 smithi119 ceph-mon[27653]: Found migration_current of "None". Setting to last migration. 2024-09-13T21:36:03.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:03 smithi119 ceph-mon[27653]: mgrmap e7: smithi119.gwjxmq(active, since 1.00505s) 2024-09-13T21:36:03.878 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:36:03.878 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T21:36:03.878 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T21:36:03.878 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:36:03.878 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.246+0000 7fa40c89e640 1 Processor -- start 2024-09-13T21:36:03.878 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.246+0000 7fa40c89e640 1 -- start start 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.246+0000 7fa40c89e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa4081012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.246+0000 7fa40c89e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4081017e0 con 0x7fa408100e90 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.247+0000 7fa40659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa4081012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.247+0000 7fa40659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa4081012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36180/0 (socket says 172.21.15.119:36180) 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.247+0000 7fa40659c640 1 -- 172.21.15.119:0/2420378196 learned_addr learned my addr 172.21.15.119:0/2420378196 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.247+0000 7fa40659c640 1 -- 172.21.15.119:0/2420378196 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa408101920 con 0x7fa408100e90 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.248+0000 7fa40659c640 1 --2- 172.21.15.119:0/2420378196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa4081012a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009840 tx=0x7fa3f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd0f2c4bea4826d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.248+0000 7fa40559a640 1 -- 172.21.15.119:0/2420378196 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3f8032440 con 0x7fa408100e90 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.248+0000 7fa40559a640 1 -- 172.21.15.119:0/2420378196 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa3f8032a00 con 0x7fa408100e90 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.248+0000 7fa40559a640 1 -- 172.21.15.119:0/2420378196 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3f8031a10 con 0x7fa408100e90 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.248+0000 7fa40c89e640 1 -- 172.21.15.119:0/2420378196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 msgr2=0x7fa4081012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.248+0000 7fa40c89e640 1 --2- 172.21.15.119:0/2420378196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa4081012a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009840 tx=0x7fa3f80091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:03.879 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.248+0000 7fa40c89e640 1 -- 172.21.15.119:0/2420378196 shutdown_connections 2024-09-13T21:36:03.880 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.248+0000 7fa40c89e640 1 --2- 172.21.15.119:0/2420378196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa4081012a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:03.880 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.248+0000 7fa40c89e640 1 -- 172.21.15.119:0/2420378196 >> 172.21.15.119:0/2420378196 conn(0x7fa4080fc6d0 msgr2=0x7fa4080feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:03.880 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.248+0000 7fa40c89e640 1 -- 172.21.15.119:0/2420378196 shutdown_connections 2024-09-13T21:36:03.880 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.248+0000 7fa40c89e640 1 -- 172.21.15.119:0/2420378196 wait complete. 2024-09-13T21:36:03.880 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.249+0000 7fa40c89e640 1 Processor -- start 2024-09-13T21:36:03.880 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.249+0000 7fa40c89e640 1 -- start start 2024-09-13T21:36:03.880 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.249+0000 7fa40c89e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa408076b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:03.880 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.249+0000 7fa40c89e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa408113a60 con 0x7fa408100e90 2024-09-13T21:36:03.880 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.249+0000 7fa40659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa408076b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:03.880 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.249+0000 7fa40659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa408076b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36186/0 (socket says 172.21.15.119:36186) 2024-09-13T21:36:03.880 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.249+0000 7fa40659c640 1 -- 172.21.15.119:0/2338140153 learned_addr learned my addr 172.21.15.119:0/2338140153 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.249+0000 7fa40659c640 1 -- 172.21.15.119:0/2338140153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f8009450 con 0x7fa408100e90 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.250+0000 7fa40659c640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa408076b00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80098a0 tx=0x7fa3f802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.250+0000 7fa3f6ffd640 1 -- 172.21.15.119:0/2338140153 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3f80327b0 con 0x7fa408100e90 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.250+0000 7fa3f6ffd640 1 -- 172.21.15.119:0/2338140153 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa3f803b870 con 0x7fa408100e90 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.250+0000 7fa40c89e640 1 -- 172.21.15.119:0/2338140153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa408113ba0 con 0x7fa408100e90 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.250+0000 7fa3f6ffd640 1 -- 172.21.15.119:0/2338140153 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3f803a550 con 0x7fa408100e90 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.250+0000 7fa40c89e640 1 -- 172.21.15.119:0/2338140153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa408114010 con 0x7fa408100e90 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.251+0000 7fa3f6ffd640 1 -- 172.21.15.119:0/2338140153 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fa3f8039040 con 0x7fa408100e90 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.251+0000 7fa3f6ffd640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 0x7fa3f003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.251+0000 7fa40c89e640 1 -- 172.21.15.119:0/2338140153 --> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa40804b720 con 0x7fa3f00394e0 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.251+0000 7fa3f6ffd640 1 -- 172.21.15.119:0/2338140153 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa3f806c8b0 con 0x7fa408100e90 2024-09-13T21:36:03.881 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.251+0000 7fa405d9b640 1 -- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 msgr2=0x7fa3f003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/254943630 2024-09-13T21:36:03.882 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.251+0000 7fa405d9b640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 0x7fa3f003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:36:03.882 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.452+0000 7fa405d9b640 1 -- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 msgr2=0x7fa3f003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/254943630 2024-09-13T21:36:03.882 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.452+0000 7fa405d9b640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 0x7fa3f003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:36:03.882 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.853+0000 7fa405d9b640 1 -- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 msgr2=0x7fa3f003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/254943630 2024-09-13T21:36:03.882 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:00.853+0000 7fa405d9b640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 0x7fa3f003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T21:36:03.882 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:01.654+0000 7fa405d9b640 1 -- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 msgr2=0x7fa3f003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/254943630 2024-09-13T21:36:03.883 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:01.654+0000 7fa405d9b640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 0x7fa3f003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T21:36:03.883 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:02.292+0000 7fa3f6ffd640 1 -- 172.21.15.119:0/2338140153 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mgrmap(e 6) v1 ==== 45274+0+0 (secure 0 0 0) 0x7fa3f806ba60 con 0x7fa408100e90 2024-09-13T21:36:03.883 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:02.292+0000 7fa3f6ffd640 1 -- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 msgr2=0x7fa3f003b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:36:03.883 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:02.292+0000 7fa3f6ffd640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 0x7fa3f003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:03.883 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.292+0000 7fa3f6ffd640 1 -- 172.21.15.119:0/2338140153 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7fa3f803c8c0 con 0x7fa408100e90 2024-09-13T21:36:03.883 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.292+0000 7fa3f6ffd640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fa3f003cc40 0x7fa3f003f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:03.883 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.292+0000 7fa3f6ffd640 1 -- 172.21.15.119:0/2338140153 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa40804b720 con 0x7fa3f003cc40 2024-09-13T21:36:03.884 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.293+0000 7fa405d9b640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fa3f003cc40 0x7fa3f003f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:03.884 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.293+0000 7fa405d9b640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fa3f003cc40 0x7fa3f003f020 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc003940 tx=0x7fa3fc009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:03.884 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.294+0000 7fa3f6ffd640 1 -- 172.21.15.119:0/2338140153 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fa40804b720 con 0x7fa3f003cc40 2024-09-13T21:36:03.884 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa40c89e640 1 -- 172.21.15.119:0/2338140153 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fa408102b10 con 0x7fa3f003cc40 2024-09-13T21:36:03.884 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa3f6ffd640 1 -- 172.21.15.119:0/2338140153 <== mgr.14118 v2:172.21.15.119:6800/366226653 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa408102b10 con 0x7fa3f003cc40 2024-09-13T21:36:03.884 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa40c89e640 1 -- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fa3f003cc40 msgr2=0x7fa3f003f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa40c89e640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fa3f003cc40 0x7fa3f003f020 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc003940 tx=0x7fa3fc009350 comp rx=0 tx=0).stop 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa40c89e640 1 -- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 msgr2=0x7fa408076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa40c89e640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa408076b00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80098a0 tx=0x7fa3f802c040 comp rx=0 tx=0).stop 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa40c89e640 1 -- 172.21.15.119:0/2338140153 shutdown_connections 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa40c89e640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fa3f003cc40 0x7fa3f003f020 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa40c89e640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:6800/254943630,v1:172.21.15.119:6801/254943630] conn(0x7fa3f00394e0 0x7fa3f003b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa40c89e640 1 --2- 172.21.15.119:0/2338140153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa408100e90 0x7fa408076b00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa40c89e640 1 -- 172.21.15.119:0/2338140153 >> 172.21.15.119:0/2338140153 conn(0x7fa4080fc6d0 msgr2=0x7fa4080fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.299+0000 7fa40c89e640 1 -- 172.21.15.119:0/2338140153 shutdown_connections 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:03.300+0000 7fa40c89e640 1 -- 172.21.15.119:0/2338140153 wait complete. 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:mgr epoch 5 is available 2024-09-13T21:36:03.885 INFO:teuthology.orchestra.run.smithi119.stdout:Setting orchestrator backend to cephadm... 2024-09-13T21:36:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:04 smithi119 ceph-mon[27653]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T21:36:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:04 smithi119 ceph-mon[27653]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T21:36:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:04 smithi119 ceph-mon[27653]: [13/Sep/2024:21:36:03] ENGINE Bus STARTING 2024-09-13T21:36:04.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:04 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:04.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:04 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:05.041 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.304+0000 7fb77ed06640 1 Processor -- start 2024-09-13T21:36:05.041 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.304+0000 7fb77ed06640 1 -- start start 2024-09-13T21:36:05.041 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.304+0000 7fb77ed06640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb778104bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:05.041 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.304+0000 7fb77ed06640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb778076f40 con 0x7fb778076b30 2024-09-13T21:36:05.041 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.304+0000 7fb77caa2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb778104bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:05.041 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.304+0000 7fb77caa2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb778104bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53812/0 (socket says 172.21.15.119:53812) 2024-09-13T21:36:05.042 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.304+0000 7fb77caa2640 1 -- 172.21.15.119:0/3750528872 learned_addr learned my addr 172.21.15.119:0/3750528872 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:05.042 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.304+0000 7fb77caa2640 1 -- 172.21.15.119:0/3750528872 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778105110 con 0x7fb778076b30 2024-09-13T21:36:05.042 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.305+0000 7fb77caa2640 1 --2- 172.21.15.119:0/3750528872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb778104bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009840 tx=0x7fb76c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853d739c75eed4f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:05.042 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.305+0000 7fb7777fe640 1 -- 172.21.15.119:0/3750528872 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb76c032440 con 0x7fb778076b30 2024-09-13T21:36:05.042 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.305+0000 7fb7777fe640 1 -- 172.21.15.119:0/3750528872 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fb76c032a00 con 0x7fb778076b30 2024-09-13T21:36:05.042 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.305+0000 7fb7777fe640 1 -- 172.21.15.119:0/3750528872 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb76c031a10 con 0x7fb778076b30 2024-09-13T21:36:05.042 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.306+0000 7fb77ed06640 1 -- 172.21.15.119:0/3750528872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 msgr2=0x7fb778104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:05.042 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.306+0000 7fb77ed06640 1 --2- 172.21.15.119:0/3750528872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb778104bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009840 tx=0x7fb76c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.306+0000 7fb77ed06640 1 -- 172.21.15.119:0/3750528872 shutdown_connections 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.306+0000 7fb77ed06640 1 --2- 172.21.15.119:0/3750528872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb778104bd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.306+0000 7fb77ed06640 1 -- 172.21.15.119:0/3750528872 >> 172.21.15.119:0/3750528872 conn(0x7fb7780fc700 msgr2=0x7fb7780feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.306+0000 7fb77ed06640 1 -- 172.21.15.119:0/3750528872 shutdown_connections 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.306+0000 7fb77ed06640 1 -- 172.21.15.119:0/3750528872 wait complete. 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.307+0000 7fb77ed06640 1 Processor -- start 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.307+0000 7fb77ed06640 1 -- start start 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.307+0000 7fb77ed06640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb77810ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.307+0000 7fb77ed06640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77810f100 con 0x7fb778076b30 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.307+0000 7fb77caa2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb77810ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.307+0000 7fb77caa2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb77810ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53818/0 (socket says 172.21.15.119:53818) 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.307+0000 7fb77caa2640 1 -- 172.21.15.119:0/3569269585 learned_addr learned my addr 172.21.15.119:0/3569269585 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.307+0000 7fb77caa2640 1 -- 172.21.15.119:0/3569269585 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c009450 con 0x7fb778076b30 2024-09-13T21:36:05.043 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.308+0000 7fb77caa2640 1 --2- 172.21.15.119:0/3569269585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb77810ebc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb76c006a70 tx=0x7fb76c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.308+0000 7fb7757fa640 1 -- 172.21.15.119:0/3569269585 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb76c031c90 con 0x7fb778076b30 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.308+0000 7fb77ed06640 1 -- 172.21.15.119:0/3569269585 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77810f300 con 0x7fb778076b30 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.308+0000 7fb7757fa640 1 -- 172.21.15.119:0/3569269585 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fb76c031df0 con 0x7fb778076b30 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.308+0000 7fb7757fa640 1 -- 172.21.15.119:0/3569269585 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb76c03b5e0 con 0x7fb778076b30 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.308+0000 7fb77ed06640 1 -- 172.21.15.119:0/3569269585 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77810f770 con 0x7fb778076b30 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.309+0000 7fb7757fa640 1 -- 172.21.15.119:0/3569269585 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7fb76c039070 con 0x7fb778076b30 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.309+0000 7fb7757fa640 1 --2- 172.21.15.119:0/3569269585 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fb76803d780 0x7fb76803fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.309+0000 7fb77ed06640 1 -- 172.21.15.119:0/3569269585 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77804b720 con 0x7fb778076b30 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.309+0000 7fb7757fa640 1 -- 172.21.15.119:0/3569269585 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb76c06cef0 con 0x7fb778076b30 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.309+0000 7fb777fff640 1 --2- 172.21.15.119:0/3569269585 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fb76803d780 0x7fb76803fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.310+0000 7fb777fff640 1 --2- 172.21.15.119:0/3569269585 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fb76803d780 0x7fb76803fc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb764006fd0 tx=0x7fb764006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.314+0000 7fb7757fa640 1 -- 172.21.15.119:0/3569269585 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb76c041070 con 0x7fb778076b30 2024-09-13T21:36:05.044 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.479+0000 7fb77ed06640 1 -- 172.21.15.119:0/3569269585 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fb778110900 con 0x7fb76803d780 2024-09-13T21:36:05.045 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.490+0000 7fb7757fa640 1 -- 172.21.15.119:0/3569269585 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb778110900 con 0x7fb76803d780 2024-09-13T21:36:05.045 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.492+0000 7fb77ed06640 1 -- 172.21.15.119:0/3569269585 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fb76803d780 msgr2=0x7fb76803fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:05.045 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.492+0000 7fb77ed06640 1 --2- 172.21.15.119:0/3569269585 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fb76803d780 0x7fb76803fc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb764006fd0 tx=0x7fb764006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:05.045 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.492+0000 7fb77ed06640 1 -- 172.21.15.119:0/3569269585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 msgr2=0x7fb77810ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:05.045 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.492+0000 7fb77ed06640 1 --2- 172.21.15.119:0/3569269585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb77810ebc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb76c006a70 tx=0x7fb76c02c040 comp rx=0 tx=0).stop 2024-09-13T21:36:05.045 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.492+0000 7fb77ed06640 1 -- 172.21.15.119:0/3569269585 shutdown_connections 2024-09-13T21:36:05.045 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.492+0000 7fb77ed06640 1 --2- 172.21.15.119:0/3569269585 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fb76803d780 0x7fb76803fc30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:05.045 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.492+0000 7fb77ed06640 1 --2- 172.21.15.119:0/3569269585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb778076b30 0x7fb77810ebc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:05.045 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.492+0000 7fb77ed06640 1 -- 172.21.15.119:0/3569269585 >> 172.21.15.119:0/3569269585 conn(0x7fb7780fc700 msgr2=0x7fb778102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:05.046 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.492+0000 7fb77ed06640 1 -- 172.21.15.119:0/3569269585 shutdown_connections 2024-09-13T21:36:05.046 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:04.493+0000 7fb77ed06640 1 -- 172.21.15.119:0/3569269585 wait complete. 2024-09-13T21:36:05.627 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:05 smithi119 ceph-mon[27653]: [13/Sep/2024:21:36:04] ENGINE Serving on https://172.21.15.119:7150 2024-09-13T21:36:05.627 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:05 smithi119 ceph-mon[27653]: [13/Sep/2024:21:36:04] ENGINE Bus STARTED 2024-09-13T21:36:05.627 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:05 smithi119 ceph-mon[27653]: [13/Sep/2024:21:36:04] ENGINE Error in HTTPServer.serve 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Traceback (most recent call last): 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._run(expiration_interval) 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s = self.context.wrap_socket( 2024-09-13T21:36:05.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:36:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: return self.sslsocket_class._create( 2024-09-13T21:36:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:36:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self.do_handshake() 2024-09-13T21:36:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:36:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._sslobj.do_handshake() 2024-09-13T21:36:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:36:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:05 smithi119 ceph-mon[27653]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:05 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:05 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:05 smithi119 ceph-mon[27653]: mgrmap e8: smithi119.gwjxmq(active, since 2s) 2024-09-13T21:36:06.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T21:36:06.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.444+0000 7fd8bdd8c640 1 Processor -- start 2024-09-13T21:36:06.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.444+0000 7fd8bdd8c640 1 -- start start 2024-09-13T21:36:06.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.444+0000 7fd8bdd8c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.444+0000 7fd8bdd8c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b8079070 con 0x7fd8b8078c60 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.444+0000 7fd8b77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.444+0000 7fd8b77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53820/0 (socket says 172.21.15.119:53820) 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.444+0000 7fd8b77fe640 1 -- 172.21.15.119:0/1523825946 learned_addr learned my addr 172.21.15.119:0/1523825946 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.445+0000 7fd8b77fe640 1 -- 172.21.15.119:0/1523825946 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8077770 con 0x7fd8b8078c60 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.445+0000 7fd8b77fe640 1 --2- 172.21.15.119:0/1523825946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8077230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009840 tx=0x7fd8a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7a8d9425e268f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.445+0000 7fd8b6ffd640 1 -- 172.21.15.119:0/1523825946 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8a8032440 con 0x7fd8b8078c60 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.445+0000 7fd8b6ffd640 1 -- 172.21.15.119:0/1523825946 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd8a8032a00 con 0x7fd8b8078c60 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.445+0000 7fd8b6ffd640 1 -- 172.21.15.119:0/1523825946 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8a80319e0 con 0x7fd8b8078c60 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.446+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/1523825946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 msgr2=0x7fd8b8077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.446+0000 7fd8bdd8c640 1 --2- 172.21.15.119:0/1523825946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8077230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009840 tx=0x7fd8a80091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.446+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/1523825946 shutdown_connections 2024-09-13T21:36:06.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.446+0000 7fd8bdd8c640 1 --2- 172.21.15.119:0/1523825946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8077230 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.446+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/1523825946 >> 172.21.15.119:0/1523825946 conn(0x7fd8b80fd710 msgr2=0x7fd8b80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.446+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/1523825946 shutdown_connections 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.446+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/1523825946 wait complete. 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.447+0000 7fd8bdd8c640 1 Processor -- start 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.447+0000 7fd8bdd8c640 1 -- start start 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.447+0000 7fd8bdd8c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8112f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.447+0000 7fd8bdd8c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b8113460 con 0x7fd8b8078c60 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.447+0000 7fd8b77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.447+0000 7fd8b77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8112f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53832/0 (socket says 172.21.15.119:53832) 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.447+0000 7fd8b77fe640 1 -- 172.21.15.119:0/731063753 learned_addr learned my addr 172.21.15.119:0/731063753 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.447+0000 7fd8b77fe640 1 -- 172.21.15.119:0/731063753 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a8009450 con 0x7fd8b8078c60 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.447+0000 7fd8b77fe640 1 --2- 172.21.15.119:0/731063753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8112f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8006f00 tx=0x7fd8a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:06.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.447+0000 7fd8b4ff9640 1 -- 172.21.15.119:0/731063753 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8a8031e30 con 0x7fd8b8078c60 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.447+0000 7fd8b4ff9640 1 -- 172.21.15.119:0/731063753 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd8a803d8b0 con 0x7fd8b8078c60 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.448+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/731063753 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b8113660 con 0x7fd8b8078c60 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.448+0000 7fd8b4ff9640 1 -- 172.21.15.119:0/731063753 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8a803b8f0 con 0x7fd8b8078c60 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.448+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/731063753 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b8113ad0 con 0x7fd8b8078c60 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.448+0000 7fd8b4ff9640 1 -- 172.21.15.119:0/731063753 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fd8a8039070 con 0x7fd8b8078c60 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.449+0000 7fd8b4ff9640 1 --2- 172.21.15.119:0/731063753 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd8a40394e0 0x7fd8a403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.449+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/731063753 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b8113ad0 con 0x7fd8b8078c60 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.449+0000 7fd8b4ff9640 1 -- 172.21.15.119:0/731063753 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd8a806d0e0 con 0x7fd8b8078c60 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.449+0000 7fd8affff640 1 --2- 172.21.15.119:0/731063753 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd8a40394e0 0x7fd8a403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.449+0000 7fd8affff640 1 --2- 172.21.15.119:0/731063753 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd8a40394e0 0x7fd8a403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0006fd0 tx=0x7fd8a0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.453+0000 7fd8b4ff9640 1 -- 172.21.15.119:0/731063753 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd8b8113ad0 con 0x7fd8b8078c60 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.614+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/731063753 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8b8113ad0 con 0x7fd8a40394e0 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.614+0000 7fd8b4ff9640 1 -- 172.21.15.119:0/731063753 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fd8b8113ad0 con 0x7fd8a40394e0 2024-09-13T21:36:06.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.616+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/731063753 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd8a40394e0 msgr2=0x7fd8a403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:06.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.616+0000 7fd8bdd8c640 1 --2- 172.21.15.119:0/731063753 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd8a40394e0 0x7fd8a403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0006fd0 tx=0x7fd8a0006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:06.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.616+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/731063753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 msgr2=0x7fd8b8112f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:06.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.616+0000 7fd8bdd8c640 1 --2- 172.21.15.119:0/731063753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8112f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8006f00 tx=0x7fd8a8008040 comp rx=0 tx=0).stop 2024-09-13T21:36:06.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.616+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/731063753 shutdown_connections 2024-09-13T21:36:06.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.616+0000 7fd8bdd8c640 1 --2- 172.21.15.119:0/731063753 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd8a40394e0 0x7fd8a403b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:06.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.616+0000 7fd8bdd8c640 1 --2- 172.21.15.119:0/731063753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b8078c60 0x7fd8b8112f20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:06.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.616+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/731063753 >> 172.21.15.119:0/731063753 conn(0x7fd8b80fd710 msgr2=0x7fd8b80fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:06.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.616+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/731063753 shutdown_connections 2024-09-13T21:36:06.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:05.616+0000 7fd8bdd8c640 1 -- 172.21.15.119:0/731063753 wait complete. 2024-09-13T21:36:06.152 INFO:teuthology.orchestra.run.smithi119.stdout:Generating ssh key... 2024-09-13T21:36:06.527 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:06 smithi119 ceph-mon[27653]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:07.706 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:07 smithi119 ceph-mon[27653]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:07.706 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:07 smithi119 ceph-mon[27653]: Generating ssh key... 2024-09-13T21:36:07.707 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:07 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:07.707 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:07 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:07.713 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.541+0000 7f3023f79640 1 Processor -- start 2024-09-13T21:36:07.713 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.541+0000 7f3023f79640 1 -- start start 2024-09-13T21:36:07.713 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.541+0000 7f3023f79640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:07.713 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.541+0000 7f3023f79640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c1050c0 con 0x7f301c076b70 2024-09-13T21:36:07.713 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.542+0000 7f3021d15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:07.713 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.542+0000 7f3021d15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53840/0 (socket says 172.21.15.119:53840) 2024-09-13T21:36:07.714 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.542+0000 7f3021d15640 1 -- 172.21.15.119:0/4164291231 learned_addr learned my addr 172.21.15.119:0/4164291231 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:07.714 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.542+0000 7f3021d15640 1 -- 172.21.15.119:0/4164291231 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c105200 con 0x7f301c076b70 2024-09-13T21:36:07.714 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.543+0000 7f3021d15640 1 --2- 172.21.15.119:0/4164291231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c104b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3014009e50 tx=0x7f3014009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9e98e5ce1b95c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:07.714 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.543+0000 7f3020d13640 1 -- 172.21.15.119:0/4164291231 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3014031560 con 0x7f301c076b70 2024-09-13T21:36:07.714 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.543+0000 7f3020d13640 1 -- 172.21.15.119:0/4164291231 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f301402d050 con 0x7f301c076b70 2024-09-13T21:36:07.714 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.543+0000 7f3020d13640 1 -- 172.21.15.119:0/4164291231 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30140079b0 con 0x7f301c076b70 2024-09-13T21:36:07.714 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.543+0000 7f3023f79640 1 -- 172.21.15.119:0/4164291231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 msgr2=0x7f301c104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:07.714 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.543+0000 7f3023f79640 1 --2- 172.21.15.119:0/4164291231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c104b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3014009e50 tx=0x7f3014009840 comp rx=0 tx=0).stop 2024-09-13T21:36:07.714 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.543+0000 7f3023f79640 1 -- 172.21.15.119:0/4164291231 shutdown_connections 2024-09-13T21:36:07.714 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.543+0000 7f3023f79640 1 --2- 172.21.15.119:0/4164291231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c104b80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:07.714 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.543+0000 7f3023f79640 1 -- 172.21.15.119:0/4164291231 >> 172.21.15.119:0/4164291231 conn(0x7f301c0fc6d0 msgr2=0x7f301c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.543+0000 7f3023f79640 1 -- 172.21.15.119:0/4164291231 shutdown_connections 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.543+0000 7f3023f79640 1 -- 172.21.15.119:0/4164291231 wait complete. 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.544+0000 7f3023f79640 1 Processor -- start 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.544+0000 7f3023f79640 1 -- start start 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.544+0000 7f3023f79640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c1024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.544+0000 7f3023f79640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c1029f0 con 0x7f301c076b70 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.544+0000 7f3021d15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c1024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.544+0000 7f3021d15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c1024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53846/0 (socket says 172.21.15.119:53846) 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.544+0000 7f3021d15640 1 -- 172.21.15.119:0/100696740 learned_addr learned my addr 172.21.15.119:0/100696740 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.544+0000 7f3021d15640 1 -- 172.21.15.119:0/100696740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3014009ae0 con 0x7f301c076b70 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.545+0000 7f3021d15640 1 --2- 172.21.15.119:0/100696740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c1024b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3014007690 tx=0x7f3014009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.545+0000 7f30127fc640 1 -- 172.21.15.119:0/100696740 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3014031b70 con 0x7f301c076b70 2024-09-13T21:36:07.715 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.545+0000 7f30127fc640 1 -- 172.21.15.119:0/100696740 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3014031cd0 con 0x7f301c076b70 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.545+0000 7f30127fc640 1 -- 172.21.15.119:0/100696740 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30140445a0 con 0x7f301c076b70 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.545+0000 7f3023f79640 1 -- 172.21.15.119:0/100696740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301c100a80 con 0x7f301c076b70 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.545+0000 7f3023f79640 1 -- 172.21.15.119:0/100696740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301c100ef0 con 0x7f301c076b70 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.546+0000 7f30127fc640 1 -- 172.21.15.119:0/100696740 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f3014038040 con 0x7f301c076b70 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.546+0000 7f3023f79640 1 -- 172.21.15.119:0/100696740 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301c04b720 con 0x7f301c076b70 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.546+0000 7f30127fc640 1 --2- 172.21.15.119:0/100696740 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f30080394e0 0x7f300803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.546+0000 7f30127fc640 1 -- 172.21.15.119:0/100696740 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3014040030 con 0x7f301c076b70 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.546+0000 7f3021514640 1 --2- 172.21.15.119:0/100696740 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f30080394e0 0x7f300803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.546+0000 7f3021514640 1 --2- 172.21.15.119:0/100696740 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f30080394e0 0x7f300803b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f300c006fd0 tx=0x7f300c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.550+0000 7f30127fc640 1 -- 172.21.15.119:0/100696740 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f301404cae0 con 0x7f301c076b70 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:06.705+0000 7f3023f79640 1 -- 172.21.15.119:0/100696740 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f301c1016a0 con 0x7f30080394e0 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:07.152+0000 7f30127fc640 1 -- 172.21.15.119:0/100696740 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f301c1016a0 con 0x7f30080394e0 2024-09-13T21:36:07.716 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:07.153+0000 7f3023f79640 1 -- 172.21.15.119:0/100696740 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f30080394e0 msgr2=0x7f300803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:07.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:07.154+0000 7f3023f79640 1 --2- 172.21.15.119:0/100696740 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f30080394e0 0x7f300803b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f300c006fd0 tx=0x7f300c006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:07.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:07.154+0000 7f3023f79640 1 -- 172.21.15.119:0/100696740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 msgr2=0x7f301c1024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:07.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:07.154+0000 7f3023f79640 1 --2- 172.21.15.119:0/100696740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c1024b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3014007690 tx=0x7f3014009840 comp rx=0 tx=0).stop 2024-09-13T21:36:07.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:07.154+0000 7f3023f79640 1 -- 172.21.15.119:0/100696740 shutdown_connections 2024-09-13T21:36:07.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:07.154+0000 7f3023f79640 1 --2- 172.21.15.119:0/100696740 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f30080394e0 0x7f300803b990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:07.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:07.154+0000 7f3023f79640 1 --2- 172.21.15.119:0/100696740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c076b70 0x7f301c1024b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:07.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:07.154+0000 7f3023f79640 1 -- 172.21.15.119:0/100696740 >> 172.21.15.119:0/100696740 conn(0x7f301c0fc6d0 msgr2=0x7f301c0fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:07.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:07.154+0000 7f3023f79640 1 -- 172.21.15.119:0/100696740 shutdown_connections 2024-09-13T21:36:07.717 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:07.154+0000 7f3023f79640 1 -- 172.21.15.119:0/100696740 wait complete. 2024-09-13T21:36:08.812 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1ZsooAwl3Hiw+xi+WLoUSVXqvFWnsmJVfmDI3XMm9+xSYTWTGyWudVx1Mit2CWKGsDrwVUWgaMgS4cmvvOKW0L6AMOT2fQcxwpHQCY1l8Zxk2ohxxf+kRfsD/75DEm5c8FKPMjEyIgTyB6H1Pn+Bdx4pWLWiVOJsFaGY8sOwEDdpn6mtmoVr439VzS08c5hisuiEkHuUVBD/39MI9yId68ZHZAr0oYpa1VclwUtSCHTJ80YImK//9kVmip1Zr1vTWLawc5gEZAgafZWoQC7usdGz6Vv4SXy7p+Fe3PryWmoKtuHLfUWoLf6SIZo6WNUqprMt2iVvKqTiNjY6DiK2PA4MsjLQA9T7aq6w1ehrVz5I2tsBwnc2M302Wk/MaIqXpohyhwuwq3y5jWRTiqRqhXc0zIMddO/Pxw8ijOLPARyXoEe2JUhwhElTpLNqYiYddYyUB58Ey2EATlfO5HCbEQ3+2d4hnLIMSs9y+vrQ3XvDZEDbKNjpGtCKwYsVdTFs= ceph-f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:36:08.812 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.101+0000 7f72ec0fd640 1 Processor -- start 2024-09-13T21:36:08.812 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.102+0000 7f72ec0fd640 1 -- start start 2024-09-13T21:36:08.812 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.102+0000 7f72ec0fd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e41017c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:08.812 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.102+0000 7f72ec0fd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4101d00 con 0x7f72e41013b0 2024-09-13T21:36:08.812 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.102+0000 7f72e9e99640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e41017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:08.812 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.102+0000 7f72e9e99640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e41017c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53852/0 (socket says 172.21.15.119:53852) 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.102+0000 7f72e9e99640 1 -- 172.21.15.119:0/689667759 learned_addr learned my addr 172.21.15.119:0/689667759 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.102+0000 7f72e9e99640 1 -- 172.21.15.119:0/689667759 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4101e40 con 0x7f72e41013b0 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.103+0000 7f72e9e99640 1 --2- 172.21.15.119:0/689667759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e41017c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009840 tx=0x7f72d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef65a7f8b85a7f07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.103+0000 7f72e8e97640 1 -- 172.21.15.119:0/689667759 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72d8032440 con 0x7f72e41013b0 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.103+0000 7f72e8e97640 1 -- 172.21.15.119:0/689667759 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f72d8032a00 con 0x7f72e41013b0 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.103+0000 7f72e8e97640 1 -- 172.21.15.119:0/689667759 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72d80319e0 con 0x7f72e41013b0 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.104+0000 7f72ec0fd640 1 -- 172.21.15.119:0/689667759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 msgr2=0x7f72e41017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.104+0000 7f72ec0fd640 1 --2- 172.21.15.119:0/689667759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e41017c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009840 tx=0x7f72d80091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.104+0000 7f72ec0fd640 1 -- 172.21.15.119:0/689667759 shutdown_connections 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.104+0000 7f72ec0fd640 1 --2- 172.21.15.119:0/689667759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e41017c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.104+0000 7f72ec0fd640 1 -- 172.21.15.119:0/689667759 >> 172.21.15.119:0/689667759 conn(0x7f72e40fbdc0 msgr2=0x7f72e40fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.104+0000 7f72ec0fd640 1 -- 172.21.15.119:0/689667759 shutdown_connections 2024-09-13T21:36:08.813 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.104+0000 7f72ec0fd640 1 -- 172.21.15.119:0/689667759 wait complete. 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.104+0000 7f72ec0fd640 1 Processor -- start 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.104+0000 7f72ec0fd640 1 -- start start 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.104+0000 7f72ec0fd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e4100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.104+0000 7f72ec0fd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4113a80 con 0x7f72e41013b0 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.105+0000 7f72e9e99640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e4100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.105+0000 7f72e9e99640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e4100bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53864/0 (socket says 172.21.15.119:53864) 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.105+0000 7f72e9e99640 1 -- 172.21.15.119:0/1006514681 learned_addr learned my addr 172.21.15.119:0/1006514681 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.105+0000 7f72e9e99640 1 -- 172.21.15.119:0/1006514681 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8009450 con 0x7f72e41013b0 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.105+0000 7f72e9e99640 1 --2- 172.21.15.119:0/1006514681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e4100bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f72d8000c00 tx=0x7f72d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.105+0000 7f72d67fc640 1 -- 172.21.15.119:0/1006514681 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72d803d450 con 0x7f72e41013b0 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.105+0000 7f72d67fc640 1 -- 172.21.15.119:0/1006514681 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f72d803da10 con 0x7f72e41013b0 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.105+0000 7f72ec0fd640 1 -- 172.21.15.119:0/1006514681 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e4113bc0 con 0x7f72e41013b0 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.105+0000 7f72d67fc640 1 -- 172.21.15.119:0/1006514681 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72d803b8e0 con 0x7f72e41013b0 2024-09-13T21:36:08.814 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.105+0000 7f72ec0fd640 1 -- 172.21.15.119:0/1006514681 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e4113fd0 con 0x7f72e41013b0 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.106+0000 7f72d67fc640 1 -- 172.21.15.119:0/1006514681 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f72d8039070 con 0x7f72e41013b0 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.106+0000 7f72ec0fd640 1 -- 172.21.15.119:0/1006514681 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e404b720 con 0x7f72e41013b0 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.106+0000 7f72d67fc640 1 --2- 172.21.15.119:0/1006514681 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f72d00394e0 0x7f72d003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.106+0000 7f72d67fc640 1 -- 172.21.15.119:0/1006514681 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f72d806d3c0 con 0x7f72e41013b0 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.107+0000 7f72e9698640 1 --2- 172.21.15.119:0/1006514681 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f72d00394e0 0x7f72d003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.107+0000 7f72e9698640 1 --2- 172.21.15.119:0/1006514681 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f72d00394e0 0x7f72d003b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f72e0006fd0 tx=0x7f72e0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.111+0000 7f72d67fc640 1 -- 172.21.15.119:0/1006514681 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f72d803cb60 con 0x7f72e41013b0 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.265+0000 7f72ec0fd640 1 -- 172.21.15.119:0/1006514681 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f72e40fd0b0 con 0x7f72d00394e0 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.265+0000 7f72d67fc640 1 -- 172.21.15.119:0/1006514681 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f72e40fd0b0 con 0x7f72d00394e0 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.267+0000 7f72ec0fd640 1 -- 172.21.15.119:0/1006514681 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f72d00394e0 msgr2=0x7f72d003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.267+0000 7f72ec0fd640 1 --2- 172.21.15.119:0/1006514681 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f72d00394e0 0x7f72d003b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f72e0006fd0 tx=0x7f72e0006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.267+0000 7f72ec0fd640 1 -- 172.21.15.119:0/1006514681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 msgr2=0x7f72e4100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:08.815 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.267+0000 7f72ec0fd640 1 --2- 172.21.15.119:0/1006514681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e4100bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f72d8000c00 tx=0x7f72d8008040 comp rx=0 tx=0).stop 2024-09-13T21:36:08.816 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.267+0000 7f72ec0fd640 1 -- 172.21.15.119:0/1006514681 shutdown_connections 2024-09-13T21:36:08.816 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.267+0000 7f72ec0fd640 1 --2- 172.21.15.119:0/1006514681 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f72d00394e0 0x7f72d003b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:08.816 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.267+0000 7f72ec0fd640 1 --2- 172.21.15.119:0/1006514681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e41013b0 0x7f72e4100bb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:08.816 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.267+0000 7f72ec0fd640 1 -- 172.21.15.119:0/1006514681 >> 172.21.15.119:0/1006514681 conn(0x7f72e40fbdc0 msgr2=0x7f72e40fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:08.816 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.267+0000 7f72ec0fd640 1 -- 172.21.15.119:0/1006514681 shutdown_connections 2024-09-13T21:36:08.816 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:08.267+0000 7f72ec0fd640 1 -- 172.21.15.119:0/1006514681 wait complete. 2024-09-13T21:36:08.816 INFO:teuthology.orchestra.run.smithi119.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T21:36:08.816 INFO:teuthology.orchestra.run.smithi119.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T21:36:08.819 INFO:teuthology.orchestra.run.smithi119.stdout:Adding host smithi119... 2024-09-13T21:36:09.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:09 smithi119 ceph-mon[27653]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:10.187 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:10 smithi119 ceph-mon[27653]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi119", "addr": "172.21.15.119", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:11.124 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:11 smithi119 ceph-mon[27653]: Deploying cephadm binary to smithi119 2024-09-13T21:36:12.687 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout Added host 'smithi119' with addr '172.21.15.119' 2024-09-13T21:36:12.687 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.209+0000 7f0c09285640 1 Processor -- start 2024-09-13T21:36:12.687 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.209+0000 7f0c09285640 1 -- start start 2024-09-13T21:36:12.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.209+0000 7f0c09285640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:12.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.209+0000 7f0c09285640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c041029c0 con 0x7f0c04102070 2024-09-13T21:36:12.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.210+0000 7f0c02ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:12.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.210+0000 7f0c02ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53876/0 (socket says 172.21.15.119:53876) 2024-09-13T21:36:12.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.210+0000 7f0c02ffd640 1 -- 172.21.15.119:0/1619084924 learned_addr learned my addr 172.21.15.119:0/1619084924 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:12.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.210+0000 7f0c02ffd640 1 -- 172.21.15.119:0/1619084924 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c04102b00 con 0x7f0c04102070 2024-09-13T21:36:12.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.210+0000 7f0c02ffd640 1 --2- 172.21.15.119:0/1619084924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04102480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009840 tx=0x7f0bf40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2766724ed052811 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:12.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.211+0000 7f0c027fc640 1 -- 172.21.15.119:0/1619084924 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf4032440 con 0x7f0c04102070 2024-09-13T21:36:12.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.211+0000 7f0c027fc640 1 -- 172.21.15.119:0/1619084924 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0bf4032a00 con 0x7f0c04102070 2024-09-13T21:36:12.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.211+0000 7f0c027fc640 1 -- 172.21.15.119:0/1619084924 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf4031a10 con 0x7f0c04102070 2024-09-13T21:36:12.688 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.211+0000 7f0c09285640 1 -- 172.21.15.119:0/1619084924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 msgr2=0x7f0c04102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.211+0000 7f0c09285640 1 --2- 172.21.15.119:0/1619084924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04102480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009840 tx=0x7f0bf40091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.211+0000 7f0c09285640 1 -- 172.21.15.119:0/1619084924 shutdown_connections 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.211+0000 7f0c09285640 1 --2- 172.21.15.119:0/1619084924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04102480 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.211+0000 7f0c09285640 1 -- 172.21.15.119:0/1619084924 >> 172.21.15.119:0/1619084924 conn(0x7f0c040fd850 msgr2=0x7f0c040ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.211+0000 7f0c09285640 1 -- 172.21.15.119:0/1619084924 shutdown_connections 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.211+0000 7f0c09285640 1 -- 172.21.15.119:0/1619084924 wait complete. 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.212+0000 7f0c09285640 1 Processor -- start 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.212+0000 7f0c09285640 1 -- start start 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.212+0000 7f0c09285640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.212+0000 7f0c09285640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c04079140 con 0x7f0c04102070 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.212+0000 7f0c02ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.212+0000 7f0c02ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53890/0 (socket says 172.21.15.119:53890) 2024-09-13T21:36:12.689 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.212+0000 7f0c02ffd640 1 -- 172.21.15.119:0/3214504388 learned_addr learned my addr 172.21.15.119:0/3214504388 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.212+0000 7f0c02ffd640 1 -- 172.21.15.119:0/3214504388 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf4009450 con 0x7f0c04102070 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.213+0000 7f0c02ffd640 1 --2- 172.21.15.119:0/3214504388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04078c00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4006a70 tx=0x7f0bf402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.213+0000 7f0bfb7fe640 1 -- 172.21.15.119:0/3214504388 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf4031d10 con 0x7f0c04102070 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.213+0000 7f0bfb7fe640 1 -- 172.21.15.119:0/3214504388 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0bf4031e70 con 0x7f0c04102070 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.213+0000 7f0bfb7fe640 1 -- 172.21.15.119:0/3214504388 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf403b6f0 con 0x7f0c04102070 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.213+0000 7f0c09285640 1 -- 172.21.15.119:0/3214504388 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c040771d0 con 0x7f0c04102070 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.213+0000 7f0c09285640 1 -- 172.21.15.119:0/3214504388 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c04077640 con 0x7f0c04102070 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.213+0000 7f0bfb7fe640 1 -- 172.21.15.119:0/3214504388 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f0bf4039070 con 0x7f0c04102070 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.214+0000 7f0bfb7fe640 1 --2- 172.21.15.119:0/3214504388 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f0bf0039490 0x7f0bf003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.214+0000 7f0bfb7fe640 1 -- 172.21.15.119:0/3214504388 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0bf406ce10 con 0x7f0c04102070 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.214+0000 7f0bfbfff640 1 --2- 172.21.15.119:0/3214504388 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f0bf0039490 0x7f0bf003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.214+0000 7f0c09285640 1 -- 172.21.15.119:0/3214504388 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0404b720 con 0x7f0c04102070 2024-09-13T21:36:12.690 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.214+0000 7f0bfbfff640 1 --2- 172.21.15.119:0/3214504388 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f0bf0039490 0x7f0bf003b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0bec006fd0 tx=0x7f0bec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.218+0000 7f0bfb7fe640 1 -- 172.21.15.119:0/3214504388 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0bf4047b40 con 0x7f0c04102070 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:09.377+0000 7f0c09285640 1 -- 172.21.15.119:0/3214504388 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi119", "addr": "172.21.15.119", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c04077ab0 con 0x7f0bf0039490 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:12.081+0000 7f0bfb7fe640 1 -- 172.21.15.119:0/3214504388 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0c04077ab0 con 0x7f0bf0039490 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:12.084+0000 7f0c09285640 1 -- 172.21.15.119:0/3214504388 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f0bf0039490 msgr2=0x7f0bf003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:12.084+0000 7f0c09285640 1 --2- 172.21.15.119:0/3214504388 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f0bf0039490 0x7f0bf003b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0bec006fd0 tx=0x7f0bec006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:12.084+0000 7f0c09285640 1 -- 172.21.15.119:0/3214504388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 msgr2=0x7f0c04078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:12.084+0000 7f0c09285640 1 --2- 172.21.15.119:0/3214504388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04078c00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4006a70 tx=0x7f0bf402c040 comp rx=0 tx=0).stop 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:12.084+0000 7f0c09285640 1 -- 172.21.15.119:0/3214504388 shutdown_connections 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:12.084+0000 7f0c09285640 1 --2- 172.21.15.119:0/3214504388 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f0bf0039490 0x7f0bf003b940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:12.084+0000 7f0c09285640 1 --2- 172.21.15.119:0/3214504388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c04102070 0x7f0c04078c00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:12.084+0000 7f0c09285640 1 -- 172.21.15.119:0/3214504388 >> 172.21.15.119:0/3214504388 conn(0x7f0c040fd850 msgr2=0x7f0c040fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:12.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:12.084+0000 7f0c09285640 1 -- 172.21.15.119:0/3214504388 shutdown_connections 2024-09-13T21:36:12.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:12.084+0000 7f0c09285640 1 -- 172.21.15.119:0/3214504388 wait complete. 2024-09-13T21:36:12.692 INFO:teuthology.orchestra.run.smithi119.stdout:Deploying mon service with default placement... 2024-09-13T21:36:13.251 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:13 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:13.251 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:13 smithi119 ceph-mon[27653]: Added host smithi119 2024-09-13T21:36:13.252 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:13 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:13.896 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.168+0000 7f87a4371640 1 Processor -- start 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.168+0000 7f87a4371640 1 -- start start 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.169+0000 7f87a4371640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c101300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.169+0000 7f87a4371640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c101840 con 0x7f879c100ef0 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.169+0000 7f87a210d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c101300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.169+0000 7f87a210d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c101300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53902/0 (socket says 172.21.15.119:53902) 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.169+0000 7f87a210d640 1 -- 172.21.15.119:0/1891893046 learned_addr learned my addr 172.21.15.119:0/1891893046 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.169+0000 7f87a210d640 1 -- 172.21.15.119:0/1891893046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c101980 con 0x7f879c100ef0 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.170+0000 7f87a210d640 1 --2- 172.21.15.119:0/1891893046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c101300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8798009840 tx=0x7f87980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba7439cb5f66498 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.170+0000 7f87a110b640 1 -- 172.21.15.119:0/1891893046 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8798032440 con 0x7f879c100ef0 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.170+0000 7f87a110b640 1 -- 172.21.15.119:0/1891893046 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8798032a00 con 0x7f879c100ef0 2024-09-13T21:36:13.897 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.170+0000 7f87a110b640 1 -- 172.21.15.119:0/1891893046 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87980319e0 con 0x7f879c100ef0 2024-09-13T21:36:13.898 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.170+0000 7f87a4371640 1 -- 172.21.15.119:0/1891893046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 msgr2=0x7f879c101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:13.898 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.170+0000 7f87a4371640 1 --2- 172.21.15.119:0/1891893046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c101300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8798009840 tx=0x7f87980091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:13.898 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a4371640 1 -- 172.21.15.119:0/1891893046 shutdown_connections 2024-09-13T21:36:13.898 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a4371640 1 --2- 172.21.15.119:0/1891893046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c101300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:13.898 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a4371640 1 -- 172.21.15.119:0/1891893046 >> 172.21.15.119:0/1891893046 conn(0x7f879c0fc710 msgr2=0x7f879c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:13.898 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a4371640 1 -- 172.21.15.119:0/1891893046 shutdown_connections 2024-09-13T21:36:13.898 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a4371640 1 -- 172.21.15.119:0/1891893046 wait complete. 2024-09-13T21:36:13.898 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a4371640 1 Processor -- start 2024-09-13T21:36:13.898 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a4371640 1 -- start start 2024-09-13T21:36:13.898 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a4371640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:13.898 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a4371640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c113510 con 0x7f879c100ef0 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a210d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a210d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c112fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53912/0 (socket says 172.21.15.119:53912) 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.171+0000 7f87a210d640 1 -- 172.21.15.119:0/2153707729 learned_addr learned my addr 172.21.15.119:0/2153707729 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.172+0000 7f87a210d640 1 -- 172.21.15.119:0/2153707729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8798009450 con 0x7f879c100ef0 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.172+0000 7f87a210d640 1 --2- 172.21.15.119:0/2153707729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c112fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f87980098a0 tx=0x7f8798008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.172+0000 7f8792ffd640 1 -- 172.21.15.119:0/2153707729 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8798032880 con 0x7f879c100ef0 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.172+0000 7f8792ffd640 1 -- 172.21.15.119:0/2153707729 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f879803d8b0 con 0x7f879c100ef0 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.172+0000 7f87a4371640 1 -- 172.21.15.119:0/2153707729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c113710 con 0x7f879c100ef0 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.172+0000 7f8792ffd640 1 -- 172.21.15.119:0/2153707729 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f879803b8e0 con 0x7f879c100ef0 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.172+0000 7f87a4371640 1 -- 172.21.15.119:0/2153707729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c113b80 con 0x7f879c100ef0 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.173+0000 7f8792ffd640 1 -- 172.21.15.119:0/2153707729 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f8798039070 con 0x7f879c100ef0 2024-09-13T21:36:13.899 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.173+0000 7f87a4371640 1 -- 172.21.15.119:0/2153707729 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c04b720 con 0x7f879c100ef0 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.173+0000 7f8792ffd640 1 --2- 172.21.15.119:0/2153707729 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f87880394e0 0x7f878803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.173+0000 7f8792ffd640 1 -- 172.21.15.119:0/2153707729 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f879806d090 con 0x7f879c100ef0 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.173+0000 7f87a190c640 1 --2- 172.21.15.119:0/2153707729 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f87880394e0 0x7f878803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.173+0000 7f87a190c640 1 --2- 172.21.15.119:0/2153707729 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f87880394e0 0x7f878803b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f878c006fd0 tx=0x7f878c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.178+0000 7f8792ffd640 1 -- 172.21.15.119:0/2153707729 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f879804eda0 con 0x7f879c100ef0 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.347+0000 7f87a4371640 1 -- 172.21.15.119:0/2153707729 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f879c113b80 con 0x7f87880394e0 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.352+0000 7f8792ffd640 1 -- 172.21.15.119:0/2153707729 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f879c113b80 con 0x7f87880394e0 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.354+0000 7f87a4371640 1 -- 172.21.15.119:0/2153707729 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f87880394e0 msgr2=0x7f878803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.354+0000 7f87a4371640 1 --2- 172.21.15.119:0/2153707729 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f87880394e0 0x7f878803b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f878c006fd0 tx=0x7f878c006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.354+0000 7f87a4371640 1 -- 172.21.15.119:0/2153707729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 msgr2=0x7f879c112fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.354+0000 7f87a4371640 1 --2- 172.21.15.119:0/2153707729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c112fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f87980098a0 tx=0x7f8798008040 comp rx=0 tx=0).stop 2024-09-13T21:36:13.900 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.354+0000 7f87a4371640 1 -- 172.21.15.119:0/2153707729 shutdown_connections 2024-09-13T21:36:13.901 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.354+0000 7f87a4371640 1 --2- 172.21.15.119:0/2153707729 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f87880394e0 0x7f878803b990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:13.901 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.354+0000 7f87a4371640 1 --2- 172.21.15.119:0/2153707729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f879c100ef0 0x7f879c112fd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:13.901 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.354+0000 7f87a4371640 1 -- 172.21.15.119:0/2153707729 >> 172.21.15.119:0/2153707729 conn(0x7f879c0fc710 msgr2=0x7f879c0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:13.901 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.354+0000 7f87a4371640 1 -- 172.21.15.119:0/2153707729 shutdown_connections 2024-09-13T21:36:13.901 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:13.354+0000 7f87a4371640 1 -- 172.21.15.119:0/2153707729 wait complete. 2024-09-13T21:36:13.901 INFO:teuthology.orchestra.run.smithi119.stdout:Deploying mgr service with default placement... 2024-09-13T21:36:14.452 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:14 smithi119 ceph-mon[27653]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:14.452 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:14 smithi119 ceph-mon[27653]: Saving service mon spec with placement count:5 2024-09-13T21:36:14.452 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:14 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:15 smithi119 ceph-mon[27653]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:15 smithi119 ceph-mon[27653]: Saving service mgr spec with placement count:2 2024-09-13T21:36:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:15 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.335+0000 7f4d889b8640 1 Processor -- start 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.335+0000 7f4d889b8640 1 -- start start 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.335+0000 7f4d889b8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d841012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.335+0000 7f4d889b8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d841017e0 con 0x7f4d84100e90 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.336+0000 7f4d8259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d841012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.336+0000 7f4d8259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d841012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36706/0 (socket says 172.21.15.119:36706) 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.336+0000 7f4d8259c640 1 -- 172.21.15.119:0/1726920290 learned_addr learned my addr 172.21.15.119:0/1726920290 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.336+0000 7f4d8259c640 1 -- 172.21.15.119:0/1726920290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d84101920 con 0x7f4d84100e90 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.337+0000 7f4d8259c640 1 --2- 172.21.15.119:0/1726920290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d841012a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400d0d0 tx=0x7f4d7400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a943a8ce8e1121 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.337+0000 7f4d8159a640 1 -- 172.21.15.119:0/1726920290 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d7400b440 con 0x7f4d84100e90 2024-09-13T21:36:15.953 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.337+0000 7f4d8159a640 1 -- 172.21.15.119:0/1726920290 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4d74009a70 con 0x7f4d84100e90 2024-09-13T21:36:15.954 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.337+0000 7f4d8159a640 1 -- 172.21.15.119:0/1726920290 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d74031af0 con 0x7f4d84100e90 2024-09-13T21:36:15.954 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.337+0000 7f4d889b8640 1 -- 172.21.15.119:0/1726920290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 msgr2=0x7f4d841012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:15.954 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.337+0000 7f4d889b8640 1 --2- 172.21.15.119:0/1726920290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d841012a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400d0d0 tx=0x7f4d7400ba50 comp rx=0 tx=0).stop 2024-09-13T21:36:15.954 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d889b8640 1 -- 172.21.15.119:0/1726920290 shutdown_connections 2024-09-13T21:36:15.954 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d889b8640 1 --2- 172.21.15.119:0/1726920290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d841012a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:15.954 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d889b8640 1 -- 172.21.15.119:0/1726920290 >> 172.21.15.119:0/1726920290 conn(0x7f4d840fc6d0 msgr2=0x7f4d840feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:15.954 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d889b8640 1 -- 172.21.15.119:0/1726920290 shutdown_connections 2024-09-13T21:36:15.954 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d889b8640 1 -- 172.21.15.119:0/1726920290 wait complete. 2024-09-13T21:36:15.954 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d889b8640 1 Processor -- start 2024-09-13T21:36:15.954 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d889b8640 1 -- start start 2024-09-13T21:36:15.954 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d889b8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d84112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d889b8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d841134c0 con 0x7f4d84100e90 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d8259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d84112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d8259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d84112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36716/0 (socket says 172.21.15.119:36716) 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.338+0000 7f4d8259c640 1 -- 172.21.15.119:0/4002424737 learned_addr learned my addr 172.21.15.119:0/4002424737 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.339+0000 7f4d8259c640 1 -- 172.21.15.119:0/4002424737 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7400bcf0 con 0x7f4d84100e90 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.339+0000 7f4d8259c640 1 --2- 172.21.15.119:0/4002424737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d84112f80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400b5e0 tx=0x7f4d7400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.339+0000 7f4d72ffd640 1 -- 172.21.15.119:0/4002424737 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d7403a420 con 0x7f4d84100e90 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.339+0000 7f4d72ffd640 1 -- 172.21.15.119:0/4002424737 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4d7403a9e0 con 0x7f4d84100e90 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.339+0000 7f4d889b8640 1 -- 172.21.15.119:0/4002424737 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d841136c0 con 0x7f4d84100e90 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.339+0000 7f4d72ffd640 1 -- 172.21.15.119:0/4002424737 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d740448f0 con 0x7f4d84100e90 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.339+0000 7f4d889b8640 1 -- 172.21.15.119:0/4002424737 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d84114250 con 0x7f4d84100e90 2024-09-13T21:36:15.955 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.340+0000 7f4d72ffd640 1 -- 172.21.15.119:0/4002424737 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f4d74044b60 con 0x7f4d84100e90 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.340+0000 7f4d889b8640 1 -- 172.21.15.119:0/4002424737 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d841002f0 con 0x7f4d84100e90 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.340+0000 7f4d72ffd640 1 --2- 172.21.15.119:0/4002424737 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f4d6c039490 0x7f4d6c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.340+0000 7f4d72ffd640 1 -- 172.21.15.119:0/4002424737 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4d7406df30 con 0x7f4d84100e90 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.340+0000 7f4d81d9b640 1 --2- 172.21.15.119:0/4002424737 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f4d6c039490 0x7f4d6c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.341+0000 7f4d81d9b640 1 --2- 172.21.15.119:0/4002424737 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f4d6c039490 0x7f4d6c03b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d78006fd0 tx=0x7f4d78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.345+0000 7f4d72ffd640 1 -- 172.21.15.119:0/4002424737 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4d7404c570 con 0x7f4d84100e90 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.512+0000 7f4d889b8640 1 -- 172.21.15.119:0/4002424737 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d84114640 con 0x7f4d6c039490 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.516+0000 7f4d72ffd640 1 -- 172.21.15.119:0/4002424737 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4d84114640 con 0x7f4d6c039490 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.518+0000 7f4d889b8640 1 -- 172.21.15.119:0/4002424737 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f4d6c039490 msgr2=0x7f4d6c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.518+0000 7f4d889b8640 1 --2- 172.21.15.119:0/4002424737 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f4d6c039490 0x7f4d6c03b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d78006fd0 tx=0x7f4d78006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.518+0000 7f4d889b8640 1 -- 172.21.15.119:0/4002424737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 msgr2=0x7f4d84112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:15.956 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.518+0000 7f4d889b8640 1 --2- 172.21.15.119:0/4002424737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d84112f80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400b5e0 tx=0x7f4d7400ba50 comp rx=0 tx=0).stop 2024-09-13T21:36:15.957 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.518+0000 7f4d889b8640 1 -- 172.21.15.119:0/4002424737 shutdown_connections 2024-09-13T21:36:15.957 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.518+0000 7f4d889b8640 1 --2- 172.21.15.119:0/4002424737 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f4d6c039490 0x7f4d6c03b940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:15.957 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.518+0000 7f4d889b8640 1 --2- 172.21.15.119:0/4002424737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d84100e90 0x7f4d84112f80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:15.957 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.518+0000 7f4d889b8640 1 -- 172.21.15.119:0/4002424737 >> 172.21.15.119:0/4002424737 conn(0x7f4d840fc6d0 msgr2=0x7f4d841053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:15.957 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.518+0000 7f4d889b8640 1 -- 172.21.15.119:0/4002424737 shutdown_connections 2024-09-13T21:36:15.957 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:14.518+0000 7f4d889b8640 1 -- 172.21.15.119:0/4002424737 wait complete. 2024-09-13T21:36:15.957 INFO:teuthology.orchestra.run.smithi119.stdout:Deploying crash service with default placement... 2024-09-13T21:36:16.783 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:16 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:16.783 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:16 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:17.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:17 smithi119 ceph-mon[27653]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:17.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:17 smithi119 ceph-mon[27653]: Saving service crash spec with placement * 2024-09-13T21:36:17.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:17 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:17.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:17 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:17.886 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.386+0000 7f9b0ec59640 1 Processor -- start 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.386+0000 7f9b0ec59640 1 -- start start 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.386+0000 7f9b0ec59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b081023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.386+0000 7f9b0ec59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b081028e0 con 0x7f9b08101f90 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.386+0000 7f9b0c9f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b081023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.387+0000 7f9b0c9f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b081023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36728/0 (socket says 172.21.15.119:36728) 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.387+0000 7f9b0c9f5640 1 -- 172.21.15.119:0/4172971964 learned_addr learned my addr 172.21.15.119:0/4172971964 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.387+0000 7f9b0c9f5640 1 -- 172.21.15.119:0/4172971964 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08102a20 con 0x7f9b08101f90 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.387+0000 7f9b0c9f5640 1 --2- 172.21.15.119:0/4172971964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b081023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009840 tx=0x7f9af80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e446719209ba78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.387+0000 7f9b077fe640 1 -- 172.21.15.119:0/4172971964 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af8032440 con 0x7f9b08101f90 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.388+0000 7f9b077fe640 1 -- 172.21.15.119:0/4172971964 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9af8032a40 con 0x7f9b08101f90 2024-09-13T21:36:17.887 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.388+0000 7f9b077fe640 1 -- 172.21.15.119:0/4172971964 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af8031a70 con 0x7f9b08101f90 2024-09-13T21:36:17.888 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.388+0000 7f9b0ec59640 1 -- 172.21.15.119:0/4172971964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 msgr2=0x7f9b081023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:17.888 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.388+0000 7f9b0ec59640 1 --2- 172.21.15.119:0/4172971964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b081023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009840 tx=0x7f9af80091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:17.888 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.388+0000 7f9b0ec59640 1 -- 172.21.15.119:0/4172971964 shutdown_connections 2024-09-13T21:36:17.888 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.388+0000 7f9b0ec59640 1 --2- 172.21.15.119:0/4172971964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b081023a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:17.888 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.388+0000 7f9b0ec59640 1 -- 172.21.15.119:0/4172971964 >> 172.21.15.119:0/4172971964 conn(0x7f9b080fd710 msgr2=0x7f9b080ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:17.888 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.388+0000 7f9b0ec59640 1 -- 172.21.15.119:0/4172971964 shutdown_connections 2024-09-13T21:36:17.888 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.388+0000 7f9b0ec59640 1 -- 172.21.15.119:0/4172971964 wait complete. 2024-09-13T21:36:17.888 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.389+0000 7f9b0ec59640 1 Processor -- start 2024-09-13T21:36:17.888 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.389+0000 7f9b0ec59640 1 -- start start 2024-09-13T21:36:17.888 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.389+0000 7f9b0ec59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b08110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:17.888 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.389+0000 7f9b0ec59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08111260 con 0x7f9b08101f90 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.389+0000 7f9b0c9f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b08110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.389+0000 7f9b0c9f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b08110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36738/0 (socket says 172.21.15.119:36738) 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.389+0000 7f9b0c9f5640 1 -- 172.21.15.119:0/2291806392 learned_addr learned my addr 172.21.15.119:0/2291806392 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.389+0000 7f9b0c9f5640 1 -- 172.21.15.119:0/2291806392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8009450 con 0x7f9b08101f90 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.389+0000 7f9b0c9f5640 1 --2- 172.21.15.119:0/2291806392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b08110d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009810 tx=0x7f9af80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.390+0000 7f9b057fa640 1 -- 172.21.15.119:0/2291806392 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af803c400 con 0x7f9b08101f90 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.390+0000 7f9b057fa640 1 -- 172.21.15.119:0/2291806392 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9af803ca00 con 0x7f9b08101f90 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.390+0000 7f9b0ec59640 1 -- 172.21.15.119:0/2291806392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b08111460 con 0x7f9b08101f90 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.390+0000 7f9b057fa640 1 -- 172.21.15.119:0/2291806392 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af803a870 con 0x7f9b08101f90 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.390+0000 7f9b0ec59640 1 -- 172.21.15.119:0/2291806392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b081118d0 con 0x7f9b08101f90 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.391+0000 7f9b057fa640 1 -- 172.21.15.119:0/2291806392 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f9af803ab30 con 0x7f9b08101f90 2024-09-13T21:36:17.889 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.391+0000 7f9b0ec59640 1 -- 172.21.15.119:0/2291806392 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0804b720 con 0x7f9b08101f90 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.391+0000 7f9b057fa640 1 --2- 172.21.15.119:0/2291806392 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f9af0039490 0x7f9af003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.391+0000 7f9b057fa640 1 -- 172.21.15.119:0/2291806392 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9af806cdd0 con 0x7f9b08101f90 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.391+0000 7f9b07fff640 1 --2- 172.21.15.119:0/2291806392 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f9af0039490 0x7f9af003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.391+0000 7f9b07fff640 1 --2- 172.21.15.119:0/2291806392 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f9af0039490 0x7f9af003b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9afc006fd0 tx=0x7f9afc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.395+0000 7f9b057fa640 1 -- 172.21.15.119:0/2291806392 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9af803cb70 con 0x7f9b08101f90 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.583+0000 7f9b0ec59640 1 -- 172.21.15.119:0/2291806392 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b081118d0 con 0x7f9af0039490 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.591+0000 7f9b057fa640 1 -- 172.21.15.119:0/2291806392 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f9b081118d0 con 0x7f9af0039490 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.593+0000 7f9b0ec59640 1 -- 172.21.15.119:0/2291806392 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f9af0039490 msgr2=0x7f9af003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.593+0000 7f9b0ec59640 1 --2- 172.21.15.119:0/2291806392 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f9af0039490 0x7f9af003b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9afc006fd0 tx=0x7f9afc006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.593+0000 7f9b0ec59640 1 -- 172.21.15.119:0/2291806392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 msgr2=0x7f9b08110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.593+0000 7f9b0ec59640 1 --2- 172.21.15.119:0/2291806392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b08110d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009810 tx=0x7f9af80091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.593+0000 7f9b0ec59640 1 -- 172.21.15.119:0/2291806392 shutdown_connections 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.593+0000 7f9b0ec59640 1 --2- 172.21.15.119:0/2291806392 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f9af0039490 0x7f9af003b940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:17.890 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.593+0000 7f9b0ec59640 1 --2- 172.21.15.119:0/2291806392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b08101f90 0x7f9b08110d20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:17.891 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.593+0000 7f9b0ec59640 1 -- 172.21.15.119:0/2291806392 >> 172.21.15.119:0/2291806392 conn(0x7f9b080fd710 msgr2=0x7f9b080fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:17.891 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.593+0000 7f9b0ec59640 1 -- 172.21.15.119:0/2291806392 shutdown_connections 2024-09-13T21:36:17.891 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:16.593+0000 7f9b0ec59640 1 -- 172.21.15.119:0/2291806392 wait complete. 2024-09-13T21:36:17.891 INFO:teuthology.orchestra.run.smithi119.stdout:Deploying prometheus service with default placement... 2024-09-13T21:36:19.111 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-13T21:36:19.111 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.322+0000 7f1c1ac14640 1 Processor -- start 2024-09-13T21:36:19.111 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.322+0000 7f1c1ac14640 1 -- start start 2024-09-13T21:36:19.111 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.322+0000 7f1c1ac14640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:19.111 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.322+0000 7f1c1ac14640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c141050c0 con 0x7f1c14076b70 2024-09-13T21:36:19.111 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.322+0000 7f1c189b0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.322+0000 7f1c189b0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36754/0 (socket says 172.21.15.119:36754) 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.322+0000 7f1c189b0640 1 -- 172.21.15.119:0/829333199 learned_addr learned my addr 172.21.15.119:0/829333199 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.323+0000 7f1c189b0640 1 -- 172.21.15.119:0/829333199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14105200 con 0x7f1c14076b70 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.323+0000 7f1c189b0640 1 --2- 172.21.15.119:0/829333199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14104b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009840 tx=0x7f1c0c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2222443769c68c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.324+0000 7f1c137fe640 1 -- 172.21.15.119:0/829333199 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c0c032440 con 0x7f1c14076b70 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.324+0000 7f1c137fe640 1 -- 172.21.15.119:0/829333199 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c0c032a40 con 0x7f1c14076b70 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.324+0000 7f1c137fe640 1 -- 172.21.15.119:0/829333199 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c0c031aa0 con 0x7f1c14076b70 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.324+0000 7f1c1ac14640 1 -- 172.21.15.119:0/829333199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 msgr2=0x7f1c14104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.324+0000 7f1c1ac14640 1 --2- 172.21.15.119:0/829333199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14104b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009840 tx=0x7f1c0c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.324+0000 7f1c1ac14640 1 -- 172.21.15.119:0/829333199 shutdown_connections 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.324+0000 7f1c1ac14640 1 --2- 172.21.15.119:0/829333199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14104b80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:19.112 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.324+0000 7f1c1ac14640 1 -- 172.21.15.119:0/829333199 >> 172.21.15.119:0/829333199 conn(0x7f1c140fc6d0 msgr2=0x7f1c140feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.324+0000 7f1c1ac14640 1 -- 172.21.15.119:0/829333199 shutdown_connections 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.324+0000 7f1c1ac14640 1 -- 172.21.15.119:0/829333199 wait complete. 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.325+0000 7f1c1ac14640 1 Processor -- start 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.325+0000 7f1c1ac14640 1 -- start start 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.325+0000 7f1c1ac14640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.325+0000 7f1c1ac14640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c14111370 con 0x7f1c14076b70 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.325+0000 7f1c189b0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.325+0000 7f1c189b0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36758/0 (socket says 172.21.15.119:36758) 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.325+0000 7f1c189b0640 1 -- 172.21.15.119:0/1702223419 learned_addr learned my addr 172.21.15.119:0/1702223419 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.326+0000 7f1c189b0640 1 -- 172.21.15.119:0/1702223419 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c009450 con 0x7f1c14076b70 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.326+0000 7f1c189b0640 1 --2- 172.21.15.119:0/1702223419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14110e30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009810 tx=0x7f1c0c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.326+0000 7f1c117fa640 1 -- 172.21.15.119:0/1702223419 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c0c0327b0 con 0x7f1c14076b70 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.326+0000 7f1c1ac14640 1 -- 172.21.15.119:0/1702223419 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c14111570 con 0x7f1c14076b70 2024-09-13T21:36:19.113 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.326+0000 7f1c117fa640 1 -- 172.21.15.119:0/1702223419 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c0c03b8d0 con 0x7f1c14076b70 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.326+0000 7f1c117fa640 1 -- 172.21.15.119:0/1702223419 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c0c03a6f0 con 0x7f1c14076b70 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.326+0000 7f1c1ac14640 1 -- 172.21.15.119:0/1702223419 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c14111fc0 con 0x7f1c14076b70 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.327+0000 7f1c1ac14640 1 -- 172.21.15.119:0/1702223419 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c141002f0 con 0x7f1c14076b70 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.327+0000 7f1c117fa640 1 -- 172.21.15.119:0/1702223419 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f1c0c039040 con 0x7f1c14076b70 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.327+0000 7f1c117fa640 1 --2- 172.21.15.119:0/1702223419 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f1c00039490 0x7f1c0003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.327+0000 7f1c117fa640 1 -- 172.21.15.119:0/1702223419 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1c0c06cb40 con 0x7f1c14076b70 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.327+0000 7f1c13fff640 1 --2- 172.21.15.119:0/1702223419 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f1c00039490 0x7f1c0003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.328+0000 7f1c13fff640 1 --2- 172.21.15.119:0/1702223419 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f1c00039490 0x7f1c0003b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400ad90 tx=0x7f1c04009410 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.332+0000 7f1c117fa640 1 -- 172.21.15.119:0/1702223419 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1c0c04bae0 con 0x7f1c14076b70 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.509+0000 7f1c1ac14640 1 -- 172.21.15.119:0/1702223419 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c140fdaf0 con 0x7f1c00039490 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.515+0000 7f1c117fa640 1 -- 172.21.15.119:0/1702223419 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f1c140fdaf0 con 0x7f1c00039490 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.517+0000 7f1c1ac14640 1 -- 172.21.15.119:0/1702223419 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f1c00039490 msgr2=0x7f1c0003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:19.114 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.517+0000 7f1c1ac14640 1 --2- 172.21.15.119:0/1702223419 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f1c00039490 0x7f1c0003b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400ad90 tx=0x7f1c04009410 comp rx=0 tx=0).stop 2024-09-13T21:36:19.115 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.517+0000 7f1c1ac14640 1 -- 172.21.15.119:0/1702223419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 msgr2=0x7f1c14110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:19.115 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.517+0000 7f1c1ac14640 1 --2- 172.21.15.119:0/1702223419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14110e30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009810 tx=0x7f1c0c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:19.115 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.517+0000 7f1c1ac14640 1 -- 172.21.15.119:0/1702223419 shutdown_connections 2024-09-13T21:36:19.115 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.517+0000 7f1c1ac14640 1 --2- 172.21.15.119:0/1702223419 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f1c00039490 0x7f1c0003b940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:19.115 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.517+0000 7f1c1ac14640 1 --2- 172.21.15.119:0/1702223419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c14076b70 0x7f1c14110e30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:19.115 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.517+0000 7f1c1ac14640 1 -- 172.21.15.119:0/1702223419 >> 172.21.15.119:0/1702223419 conn(0x7f1c140fc6d0 msgr2=0x7f1c140fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:19.115 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.517+0000 7f1c1ac14640 1 -- 172.21.15.119:0/1702223419 shutdown_connections 2024-09-13T21:36:19.115 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:18.517+0000 7f1c1ac14640 1 -- 172.21.15.119:0/1702223419 wait complete. 2024-09-13T21:36:19.115 INFO:teuthology.orchestra.run.smithi119.stdout:Deploying grafana service with default placement... 2024-09-13T21:36:19.701 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:19 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:19.701 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:19 smithi119 ceph-mon[27653]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:19.701 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:19 smithi119 ceph-mon[27653]: Saving service prometheus spec with placement count:1 2024-09-13T21:36:19.701 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:19 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:20.774 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:20 smithi119 ceph-mon[27653]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:20.775 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:20 smithi119 ceph-mon[27653]: Saving service grafana spec with placement count:1 2024-09-13T21:36:20.775 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:20 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:21.009 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-13T21:36:21.009 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.514+0000 7ff806703640 1 Processor -- start 2024-09-13T21:36:21.009 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.514+0000 7ff806703640 1 -- start start 2024-09-13T21:36:21.009 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.515+0000 7ff806703640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:21.009 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.515+0000 7ff806703640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff800076f40 con 0x7ff800076b30 2024-09-13T21:36:21.009 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.515+0000 7ff7fffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:21.009 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.515+0000 7ff7fffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36766/0 (socket says 172.21.15.119:36766) 2024-09-13T21:36:21.009 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.515+0000 7ff7fffff640 1 -- 172.21.15.119:0/1581983240 learned_addr learned my addr 172.21.15.119:0/1581983240 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.515+0000 7ff7fffff640 1 -- 172.21.15.119:0/1581983240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800105100 con 0x7ff800076b30 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.516+0000 7ff7fffff640 1 --2- 172.21.15.119:0/1581983240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800104bc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009840 tx=0x7ff7f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d3c16dad327f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.516+0000 7ff7ff7fe640 1 -- 172.21.15.119:0/1581983240 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7f0032440 con 0x7ff800076b30 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.516+0000 7ff7ff7fe640 1 -- 172.21.15.119:0/1581983240 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7f0032a40 con 0x7ff800076b30 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.516+0000 7ff7ff7fe640 1 -- 172.21.15.119:0/1581983240 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7f0031aa0 con 0x7ff800076b30 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff806703640 1 -- 172.21.15.119:0/1581983240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 msgr2=0x7ff800104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff806703640 1 --2- 172.21.15.119:0/1581983240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800104bc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009840 tx=0x7ff7f00091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff806703640 1 -- 172.21.15.119:0/1581983240 shutdown_connections 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff806703640 1 --2- 172.21.15.119:0/1581983240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800104bc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff806703640 1 -- 172.21.15.119:0/1581983240 >> 172.21.15.119:0/1581983240 conn(0x7ff8000fc6d0 msgr2=0x7ff8000feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff806703640 1 -- 172.21.15.119:0/1581983240 shutdown_connections 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff806703640 1 -- 172.21.15.119:0/1581983240 wait complete. 2024-09-13T21:36:21.010 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff806703640 1 Processor -- start 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff806703640 1 -- start start 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff806703640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff806703640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff800111360 con 0x7ff800076b30 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff7fffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff7fffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36768/0 (socket says 172.21.15.119:36768) 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.517+0000 7ff7fffff640 1 -- 172.21.15.119:0/2553074745 learned_addr learned my addr 172.21.15.119:0/2553074745 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.518+0000 7ff7fffff640 1 -- 172.21.15.119:0/2553074745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0009450 con 0x7ff800076b30 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.518+0000 7ff7fffff640 1 --2- 172.21.15.119:0/2553074745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800110e20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009810 tx=0x7ff7f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.518+0000 7ff7fd7fa640 1 -- 172.21.15.119:0/2553074745 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7f00327b0 con 0x7ff800076b30 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.518+0000 7ff806703640 1 -- 172.21.15.119:0/2553074745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff800111560 con 0x7ff800076b30 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.518+0000 7ff7fd7fa640 1 -- 172.21.15.119:0/2553074745 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7f003b8d0 con 0x7ff800076b30 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.518+0000 7ff7fd7fa640 1 -- 172.21.15.119:0/2553074745 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7f003a6f0 con 0x7ff800076b30 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.518+0000 7ff806703640 1 -- 172.21.15.119:0/2553074745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff800111fb0 con 0x7ff800076b30 2024-09-13T21:36:21.011 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.519+0000 7ff7fd7fa640 1 -- 172.21.15.119:0/2553074745 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ff7f0039040 con 0x7ff800076b30 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.519+0000 7ff806703640 1 -- 172.21.15.119:0/2553074745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8001002f0 con 0x7ff800076b30 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.519+0000 7ff7fd7fa640 1 --2- 172.21.15.119:0/2553074745 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff7ec039490 0x7ff7ec03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.519+0000 7ff7fd7fa640 1 -- 172.21.15.119:0/2553074745 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff7f006cbb0 con 0x7ff800076b30 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.519+0000 7ff7f7fff640 1 --2- 172.21.15.119:0/2553074745 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff7ec039490 0x7ff7ec03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.520+0000 7ff7f7fff640 1 --2- 172.21.15.119:0/2553074745 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff7ec039490 0x7ff7ec03b940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8006fd0 tx=0x7ff7e8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.524+0000 7ff7fd7fa640 1 -- 172.21.15.119:0/2553074745 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff7f003a850 con 0x7ff800076b30 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.699+0000 7ff806703640 1 -- 172.21.15.119:0/2553074745 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8000fdb30 con 0x7ff7ec039490 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.704+0000 7ff7fd7fa640 1 -- 172.21.15.119:0/2553074745 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7ff8000fdb30 con 0x7ff7ec039490 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.706+0000 7ff806703640 1 -- 172.21.15.119:0/2553074745 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff7ec039490 msgr2=0x7ff7ec03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.706+0000 7ff806703640 1 --2- 172.21.15.119:0/2553074745 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff7ec039490 0x7ff7ec03b940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8006fd0 tx=0x7ff7e8006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.706+0000 7ff806703640 1 -- 172.21.15.119:0/2553074745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 msgr2=0x7ff800110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.706+0000 7ff806703640 1 --2- 172.21.15.119:0/2553074745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800110e20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009810 tx=0x7ff7f00091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:21.012 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.706+0000 7ff806703640 1 -- 172.21.15.119:0/2553074745 shutdown_connections 2024-09-13T21:36:21.013 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.706+0000 7ff806703640 1 --2- 172.21.15.119:0/2553074745 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff7ec039490 0x7ff7ec03b940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:21.013 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.706+0000 7ff806703640 1 --2- 172.21.15.119:0/2553074745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff800076b30 0x7ff800110e20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:21.013 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.706+0000 7ff806703640 1 -- 172.21.15.119:0/2553074745 >> 172.21.15.119:0/2553074745 conn(0x7ff8000fc6d0 msgr2=0x7ff8000fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:21.013 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.706+0000 7ff806703640 1 -- 172.21.15.119:0/2553074745 shutdown_connections 2024-09-13T21:36:21.013 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:19.706+0000 7ff806703640 1 -- 172.21.15.119:0/2553074745 wait complete. 2024-09-13T21:36:21.013 INFO:teuthology.orchestra.run.smithi119.stdout:Deploying node-exporter service with default placement... 2024-09-13T21:36:22.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-13T21:36:22.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.430+0000 7fd22aa5e640 1 Processor -- start 2024-09-13T21:36:22.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.430+0000 7fd22aa5e640 1 -- start start 2024-09-13T21:36:22.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.430+0000 7fd22aa5e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224102410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:22.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.430+0000 7fd22aa5e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd224102950 con 0x7fd224102000 2024-09-13T21:36:22.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.431+0000 7fd223fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:22.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.431+0000 7fd223fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36782/0 (socket says 172.21.15.119:36782) 2024-09-13T21:36:22.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.431+0000 7fd223fff640 1 -- 172.21.15.119:0/1891338511 learned_addr learned my addr 172.21.15.119:0/1891338511 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:22.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.431+0000 7fd223fff640 1 -- 172.21.15.119:0/1891338511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd224102a90 con 0x7fd224102000 2024-09-13T21:36:22.148 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.432+0000 7fd223fff640 1 --2- 172.21.15.119:0/1891338511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224102410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd214009840 tx=0x7fd2140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0612c58b6040cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.432+0000 7fd222ffd640 1 -- 172.21.15.119:0/1891338511 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd214032440 con 0x7fd224102000 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.432+0000 7fd222ffd640 1 -- 172.21.15.119:0/1891338511 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd214032a40 con 0x7fd224102000 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.432+0000 7fd222ffd640 1 -- 172.21.15.119:0/1891338511 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd214031a70 con 0x7fd224102000 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.433+0000 7fd22aa5e640 1 -- 172.21.15.119:0/1891338511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 msgr2=0x7fd224102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.433+0000 7fd22aa5e640 1 --2- 172.21.15.119:0/1891338511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224102410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd214009840 tx=0x7fd2140091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.433+0000 7fd22aa5e640 1 -- 172.21.15.119:0/1891338511 shutdown_connections 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.433+0000 7fd22aa5e640 1 --2- 172.21.15.119:0/1891338511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224102410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.433+0000 7fd22aa5e640 1 -- 172.21.15.119:0/1891338511 >> 172.21.15.119:0/1891338511 conn(0x7fd2240fd7c0 msgr2=0x7fd2240ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.433+0000 7fd22aa5e640 1 -- 172.21.15.119:0/1891338511 shutdown_connections 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.433+0000 7fd22aa5e640 1 -- 172.21.15.119:0/1891338511 wait complete. 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.433+0000 7fd22aa5e640 1 Processor -- start 2024-09-13T21:36:22.149 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd22aa5e640 1 -- start start 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd22aa5e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224110de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd22aa5e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd224111320 con 0x7fd224102000 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd223fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224110de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd223fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224110de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36796/0 (socket says 172.21.15.119:36796) 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd223fff640 1 -- 172.21.15.119:0/870922493 learned_addr learned my addr 172.21.15.119:0/870922493 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd223fff640 1 -- 172.21.15.119:0/870922493 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214009450 con 0x7fd224102000 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd223fff640 1 --2- 172.21.15.119:0/870922493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224110de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd214009810 tx=0x7fd2140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd220ff9640 1 -- 172.21.15.119:0/870922493 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd21403c400 con 0x7fd224102000 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd220ff9640 1 -- 172.21.15.119:0/870922493 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd21403ca00 con 0x7fd224102000 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd22aa5e640 1 -- 172.21.15.119:0/870922493 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd224111520 con 0x7fd224102000 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd220ff9640 1 -- 172.21.15.119:0/870922493 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd21403a870 con 0x7fd224102000 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.434+0000 7fd22aa5e640 1 -- 172.21.15.119:0/870922493 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd224111f70 con 0x7fd224102000 2024-09-13T21:36:22.150 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.435+0000 7fd220ff9640 1 -- 172.21.15.119:0/870922493 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fd21403aae0 con 0x7fd224102000 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.435+0000 7fd22aa5e640 1 -- 172.21.15.119:0/870922493 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd224101460 con 0x7fd224102000 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.435+0000 7fd220ff9640 1 --2- 172.21.15.119:0/870922493 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd20c0394e0 0x7fd20c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.436+0000 7fd220ff9640 1 -- 172.21.15.119:0/870922493 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd21406ced0 con 0x7fd224102000 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.436+0000 7fd2237fe640 1 --2- 172.21.15.119:0/870922493 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd20c0394e0 0x7fd20c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.436+0000 7fd2237fe640 1 --2- 172.21.15.119:0/870922493 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd20c0394e0 0x7fd20c03b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd218006fd0 tx=0x7fd218006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.440+0000 7fd220ff9640 1 -- 172.21.15.119:0/870922493 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd214030570 con 0x7fd224102000 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.604+0000 7fd22aa5e640 1 -- 172.21.15.119:0/870922493 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2240fec20 con 0x7fd20c0394e0 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.608+0000 7fd220ff9640 1 -- 172.21.15.119:0/870922493 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fd2240fec20 con 0x7fd20c0394e0 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.610+0000 7fd22aa5e640 1 -- 172.21.15.119:0/870922493 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd20c0394e0 msgr2=0x7fd20c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.610+0000 7fd22aa5e640 1 --2- 172.21.15.119:0/870922493 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd20c0394e0 0x7fd20c03b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd218006fd0 tx=0x7fd218006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.610+0000 7fd22aa5e640 1 -- 172.21.15.119:0/870922493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 msgr2=0x7fd224110de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.610+0000 7fd22aa5e640 1 --2- 172.21.15.119:0/870922493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224110de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd214009810 tx=0x7fd2140091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:22.151 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.611+0000 7fd22aa5e640 1 -- 172.21.15.119:0/870922493 shutdown_connections 2024-09-13T21:36:22.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.611+0000 7fd22aa5e640 1 --2- 172.21.15.119:0/870922493 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fd20c0394e0 0x7fd20c03b990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:22.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.611+0000 7fd22aa5e640 1 --2- 172.21.15.119:0/870922493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd224102000 0x7fd224110de0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:22.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.611+0000 7fd22aa5e640 1 -- 172.21.15.119:0/870922493 >> 172.21.15.119:0/870922493 conn(0x7fd2240fd7c0 msgr2=0x7fd2240fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:22.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.611+0000 7fd22aa5e640 1 -- 172.21.15.119:0/870922493 shutdown_connections 2024-09-13T21:36:22.152 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:21.611+0000 7fd22aa5e640 1 -- 172.21.15.119:0/870922493 wait complete. 2024-09-13T21:36:22.152 INFO:teuthology.orchestra.run.smithi119.stdout:Deploying alertmanager service with default placement... 2024-09-13T21:36:22.696 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:22 smithi119 ceph-mon[27653]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:22.697 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:22 smithi119 ceph-mon[27653]: Saving service node-exporter spec with placement * 2024-09-13T21:36:22.697 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:22 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:23.324 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-13T21:36:23.324 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.516+0000 7f3dcf878640 1 Processor -- start 2024-09-13T21:36:23.324 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.517+0000 7f3dcf878640 1 -- start start 2024-09-13T21:36:23.324 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.517+0000 7f3dcf878640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8107060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:23.324 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.517+0000 7f3dcf878640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc8076f20 con 0x7f3dc8076b10 2024-09-13T21:36:23.324 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.517+0000 7f3dcd614640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.517+0000 7f3dcd614640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8107060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36800/0 (socket says 172.21.15.119:36800) 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.517+0000 7f3dcd614640 1 -- 172.21.15.119:0/777277935 learned_addr learned my addr 172.21.15.119:0/777277935 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.517+0000 7f3dcd614640 1 -- 172.21.15.119:0/777277935 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8102a50 con 0x7f3dc8076b10 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.518+0000 7f3dcd614640 1 --2- 172.21.15.119:0/777277935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8107060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009840 tx=0x7f3dc40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4e0fe060b346bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.518+0000 7f3dbffff640 1 -- 172.21.15.119:0/777277935 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3dc4032440 con 0x7f3dc8076b10 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.518+0000 7f3dbffff640 1 -- 172.21.15.119:0/777277935 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3dc4032a40 con 0x7f3dc8076b10 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.518+0000 7f3dbffff640 1 -- 172.21.15.119:0/777277935 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3dc4031a70 con 0x7f3dc8076b10 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.519+0000 7f3dcf878640 1 -- 172.21.15.119:0/777277935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 msgr2=0x7f3dc8107060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.519+0000 7f3dcf878640 1 --2- 172.21.15.119:0/777277935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8107060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009840 tx=0x7f3dc40091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.519+0000 7f3dcf878640 1 -- 172.21.15.119:0/777277935 shutdown_connections 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.519+0000 7f3dcf878640 1 --2- 172.21.15.119:0/777277935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8107060 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.519+0000 7f3dcf878640 1 -- 172.21.15.119:0/777277935 >> 172.21.15.119:0/777277935 conn(0x7f3dc80fc710 msgr2=0x7f3dc80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:23.325 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.519+0000 7f3dcf878640 1 -- 172.21.15.119:0/777277935 shutdown_connections 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.519+0000 7f3dcf878640 1 -- 172.21.15.119:0/777277935 wait complete. 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.519+0000 7f3dcf878640 1 Processor -- start 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.519+0000 7f3dcf878640 1 -- start start 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dcf878640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dcf878640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc8113470 con 0x7f3dc8076b10 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dcd614640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dcd614640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8112f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36808/0 (socket says 172.21.15.119:36808) 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dcd614640 1 -- 172.21.15.119:0/1477245213 learned_addr learned my addr 172.21.15.119:0/1477245213 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dcd614640 1 -- 172.21.15.119:0/1477245213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4009450 con 0x7f3dc8076b10 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dcd614640 1 --2- 172.21.15.119:0/1477245213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8112f30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4031750 tx=0x7f3dc40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dbdffb640 1 -- 172.21.15.119:0/1477245213 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3dc403c400 con 0x7f3dc8076b10 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dbdffb640 1 -- 172.21.15.119:0/1477245213 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3dc403ca00 con 0x7f3dc8076b10 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dcf878640 1 -- 172.21.15.119:0/1477245213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc8113670 con 0x7f3dc8076b10 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dbdffb640 1 -- 172.21.15.119:0/1477245213 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3dc403a880 con 0x7f3dc8076b10 2024-09-13T21:36:23.326 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.520+0000 7f3dcf878640 1 -- 172.21.15.119:0/1477245213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc8114200 con 0x7f3dc8076b10 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.521+0000 7f3dbdffb640 1 -- 172.21.15.119:0/1477245213 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f3dc403aaf0 con 0x7f3dc8076b10 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.521+0000 7f3dcf878640 1 -- 172.21.15.119:0/1477245213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc8100350 con 0x7f3dc8076b10 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.521+0000 7f3dbdffb640 1 --2- 172.21.15.119:0/1477245213 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f3db4039490 0x7f3db403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.521+0000 7f3dbdffb640 1 -- 172.21.15.119:0/1477245213 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3dc406cef0 con 0x7f3dc8076b10 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.521+0000 7f3dcce13640 1 --2- 172.21.15.119:0/1477245213 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f3db4039490 0x7f3db403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.522+0000 7f3dcce13640 1 --2- 172.21.15.119:0/1477245213 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f3db4039490 0x7f3db403b940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3db8006fd0 tx=0x7f3db8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.526+0000 7f3dbdffb640 1 -- 172.21.15.119:0/1477245213 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3dc4039ca0 con 0x7f3dc8076b10 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.689+0000 7f3dcf878640 1 -- 172.21.15.119:0/1477245213 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dc80fda40 con 0x7f3db4039490 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.694+0000 7f3dbdffb640 1 -- 172.21.15.119:0/1477245213 <== mgr.14118 v2:172.21.15.119:6800/366226653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f3dc80fda40 con 0x7f3db4039490 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.696+0000 7f3dcf878640 1 -- 172.21.15.119:0/1477245213 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f3db4039490 msgr2=0x7f3db403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.696+0000 7f3dcf878640 1 --2- 172.21.15.119:0/1477245213 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f3db4039490 0x7f3db403b940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3db8006fd0 tx=0x7f3db8006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:23.327 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.696+0000 7f3dcf878640 1 -- 172.21.15.119:0/1477245213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 msgr2=0x7f3dc8112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:23.328 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.696+0000 7f3dcf878640 1 --2- 172.21.15.119:0/1477245213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8112f30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4031750 tx=0x7f3dc40091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:23.328 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.696+0000 7f3dcf878640 1 -- 172.21.15.119:0/1477245213 shutdown_connections 2024-09-13T21:36:23.328 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.696+0000 7f3dcf878640 1 --2- 172.21.15.119:0/1477245213 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f3db4039490 0x7f3db403b940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:23.328 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.696+0000 7f3dcf878640 1 --2- 172.21.15.119:0/1477245213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dc8076b10 0x7f3dc8112f30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:23.328 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.696+0000 7f3dcf878640 1 -- 172.21.15.119:0/1477245213 >> 172.21.15.119:0/1477245213 conn(0x7f3dc80fc710 msgr2=0x7f3dc80fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:23.328 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.696+0000 7f3dcf878640 1 -- 172.21.15.119:0/1477245213 shutdown_connections 2024-09-13T21:36:23.328 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:22.696+0000 7f3dcf878640 1 -- 172.21.15.119:0/1477245213 wait complete. 2024-09-13T21:36:23.891 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:23 smithi119 ceph-mon[27653]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:36:23.891 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:23 smithi119 ceph-mon[27653]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:23.892 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:23 smithi119 ceph-mon[27653]: Saving service alertmanager spec with placement count:1 2024-09-13T21:36:23.892 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:23 smithi119 ceph-mon[27653]: from='mgr.14118 172.21.15.119:0/2762455538' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:24.405 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.721+0000 7feaa4d95640 1 Processor -- start 2024-09-13T21:36:24.410 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.721+0000 7feaa4d95640 1 -- start start 2024-09-13T21:36:24.410 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.722+0000 7feaa4d95640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:24.410 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.722+0000 7feaa4d95640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa01017e0 con 0x7feaa0100e90 2024-09-13T21:36:24.410 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.722+0000 7fea9e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.722+0000 7fea9e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36814/0 (socket says 172.21.15.119:36814) 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.722+0000 7fea9e59c640 1 -- 172.21.15.119:0/2376522308 learned_addr learned my addr 172.21.15.119:0/2376522308 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.722+0000 7fea9e59c640 1 -- 172.21.15.119:0/2376522308 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0101920 con 0x7feaa0100e90 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.723+0000 7fea9e59c640 1 --2- 172.21.15.119:0/2376522308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01012a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea90009e50 tx=0x7fea90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9a3a06c447c2a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.723+0000 7fea9d59a640 1 -- 172.21.15.119:0/2376522308 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea90031560 con 0x7feaa0100e90 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.723+0000 7fea9d59a640 1 -- 172.21.15.119:0/2376522308 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea9002d050 con 0x7feaa0100e90 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.723+0000 7fea9d59a640 1 -- 172.21.15.119:0/2376522308 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea90007a60 con 0x7feaa0100e90 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.723+0000 7feaa4d95640 1 -- 172.21.15.119:0/2376522308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 msgr2=0x7feaa01012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.723+0000 7feaa4d95640 1 --2- 172.21.15.119:0/2376522308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01012a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea90009e50 tx=0x7fea90009840 comp rx=0 tx=0).stop 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.724+0000 7feaa4d95640 1 -- 172.21.15.119:0/2376522308 shutdown_connections 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.724+0000 7feaa4d95640 1 --2- 172.21.15.119:0/2376522308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01012a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.724+0000 7feaa4d95640 1 -- 172.21.15.119:0/2376522308 >> 172.21.15.119:0/2376522308 conn(0x7feaa00fc6d0 msgr2=0x7feaa00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:24.411 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.724+0000 7feaa4d95640 1 -- 172.21.15.119:0/2376522308 shutdown_connections 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.724+0000 7feaa4d95640 1 -- 172.21.15.119:0/2376522308 wait complete. 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.724+0000 7feaa4d95640 1 Processor -- start 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.724+0000 7feaa4d95640 1 -- start start 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.724+0000 7feaa4d95640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.724+0000 7feaa4d95640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0107630 con 0x7feaa0100e90 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.725+0000 7fea9e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.725+0000 7fea9e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36826/0 (socket says 172.21.15.119:36826) 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.725+0000 7fea9e59c640 1 -- 172.21.15.119:0/3470371956 learned_addr learned my addr 172.21.15.119:0/3470371956 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.725+0000 7fea9e59c640 1 -- 172.21.15.119:0/3470371956 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90009ae0 con 0x7feaa0100e90 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.725+0000 7fea9e59c640 1 --2- 172.21.15.119:0/3470371956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01070f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fea9002ac70 tx=0x7fea90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.725+0000 7fea8effd640 1 -- 172.21.15.119:0/3470371956 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea90031bc0 con 0x7feaa0100e90 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.725+0000 7fea8effd640 1 -- 172.21.15.119:0/3470371956 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea90031d20 con 0x7feaa0100e90 2024-09-13T21:36:24.412 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.725+0000 7feaa4d95640 1 -- 172.21.15.119:0/3470371956 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa01056c0 con 0x7feaa0100e90 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.725+0000 7fea8effd640 1 -- 172.21.15.119:0/3470371956 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea90045570 con 0x7feaa0100e90 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.725+0000 7feaa4d95640 1 -- 172.21.15.119:0/3470371956 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa0105b30 con 0x7feaa0100e90 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.726+0000 7fea8effd640 1 -- 172.21.15.119:0/3470371956 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fea90038050 con 0x7feaa0100e90 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.726+0000 7fea8effd640 1 --2- 172.21.15.119:0/3470371956 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fea88039490 0x7fea8803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.726+0000 7fea8effd640 1 -- 172.21.15.119:0/3470371956 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fea9006cce0 con 0x7feaa0100e90 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.726+0000 7fea9dd9b640 1 --2- 172.21.15.119:0/3470371956 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fea88039490 0x7fea8803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.726+0000 7feaa4d95640 1 -- 172.21.15.119:0/3470371956 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa004b720 con 0x7feaa0100e90 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.727+0000 7fea9dd9b640 1 --2- 172.21.15.119:0/3470371956 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fea88039490 0x7fea8803b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea94006fd0 tx=0x7fea94006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.731+0000 7fea8effd640 1 -- 172.21.15.119:0/3470371956 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fea90041020 con 0x7feaa0100e90 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.884+0000 7feaa4d95640 1 -- 172.21.15.119:0/3470371956 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7feaa0105fb0 con 0x7feaa0100e90 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.888+0000 7fea8effd640 1 -- 172.21.15.119:0/3470371956 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fea90036070 con 0x7feaa0100e90 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.890+0000 7feaa4d95640 1 -- 172.21.15.119:0/3470371956 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fea88039490 msgr2=0x7fea8803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:24.413 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.890+0000 7feaa4d95640 1 --2- 172.21.15.119:0/3470371956 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fea88039490 0x7fea8803b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea94006fd0 tx=0x7fea94006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:24.414 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.890+0000 7feaa4d95640 1 -- 172.21.15.119:0/3470371956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 msgr2=0x7feaa01070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:24.414 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.890+0000 7feaa4d95640 1 --2- 172.21.15.119:0/3470371956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01070f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fea9002ac70 tx=0x7fea90009840 comp rx=0 tx=0).stop 2024-09-13T21:36:24.414 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.891+0000 7feaa4d95640 1 -- 172.21.15.119:0/3470371956 shutdown_connections 2024-09-13T21:36:24.414 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.891+0000 7feaa4d95640 1 --2- 172.21.15.119:0/3470371956 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fea88039490 0x7fea8803b940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:24.414 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.891+0000 7feaa4d95640 1 --2- 172.21.15.119:0/3470371956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaa0100e90 0x7feaa01070f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:24.414 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.891+0000 7feaa4d95640 1 -- 172.21.15.119:0/3470371956 >> 172.21.15.119:0/3470371956 conn(0x7feaa00fc6d0 msgr2=0x7feaa00fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:24.414 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.891+0000 7feaa4d95640 1 -- 172.21.15.119:0/3470371956 shutdown_connections 2024-09-13T21:36:24.414 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:23.891+0000 7feaa4d95640 1 -- 172.21.15.119:0/3470371956 wait complete. 2024-09-13T21:36:25.000 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:24 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3470371956' entity='client.admin' 2024-09-13T21:36:25.550 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.831+0000 7fe29df54640 1 Processor -- start 2024-09-13T21:36:25.550 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.831+0000 7fe29df54640 1 -- start start 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.831+0000 7fe29df54640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.831+0000 7fe29df54640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2981029c0 con 0x7fe298102070 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.831+0000 7fe2977fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.831+0000 7fe2977fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40012/0 (socket says 172.21.15.119:40012) 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.831+0000 7fe2977fe640 1 -- 172.21.15.119:0/352449146 learned_addr learned my addr 172.21.15.119:0/352449146 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.831+0000 7fe2977fe640 1 -- 172.21.15.119:0/352449146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe298102b00 con 0x7fe298102070 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.832+0000 7fe2977fe640 1 --2- 172.21.15.119:0/352449146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298102480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe288009840 tx=0x7fe2880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03a0a86a42da6ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.832+0000 7fe2967fc640 1 -- 172.21.15.119:0/352449146 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe288032440 con 0x7fe298102070 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.832+0000 7fe2967fc640 1 -- 172.21.15.119:0/352449146 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe288032a40 con 0x7fe298102070 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.832+0000 7fe2967fc640 1 -- 172.21.15.119:0/352449146 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe288031aa0 con 0x7fe298102070 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.833+0000 7fe29df54640 1 -- 172.21.15.119:0/352449146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 msgr2=0x7fe298102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:25.551 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.833+0000 7fe29df54640 1 --2- 172.21.15.119:0/352449146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298102480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe288009840 tx=0x7fe2880091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.833+0000 7fe29df54640 1 -- 172.21.15.119:0/352449146 shutdown_connections 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.833+0000 7fe29df54640 1 --2- 172.21.15.119:0/352449146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298102480 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.833+0000 7fe29df54640 1 -- 172.21.15.119:0/352449146 >> 172.21.15.119:0/352449146 conn(0x7fe2980fd850 msgr2=0x7fe2980ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.833+0000 7fe29df54640 1 -- 172.21.15.119:0/352449146 shutdown_connections 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.833+0000 7fe29df54640 1 -- 172.21.15.119:0/352449146 wait complete. 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.833+0000 7fe29df54640 1 Processor -- start 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.833+0000 7fe29df54640 1 -- start start 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe29df54640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe29df54640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe298111340 con 0x7fe298102070 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe2977fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe2977fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40028/0 (socket says 172.21.15.119:40028) 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe2977fe640 1 -- 172.21.15.119:0/1546717394 learned_addr learned my addr 172.21.15.119:0/1546717394 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:25.552 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe2977fe640 1 -- 172.21.15.119:0/1546717394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe288009450 con 0x7fe298102070 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe2977fe640 1 --2- 172.21.15.119:0/1546717394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298110e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe288009810 tx=0x7fe2880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe27ffff640 1 -- 172.21.15.119:0/1546717394 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2880327b0 con 0x7fe298102070 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe29df54640 1 -- 172.21.15.119:0/1546717394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe298111540 con 0x7fe298102070 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe27ffff640 1 -- 172.21.15.119:0/1546717394 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe28803b8d0 con 0x7fe298102070 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe27ffff640 1 -- 172.21.15.119:0/1546717394 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe28803a6f0 con 0x7fe298102070 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.834+0000 7fe29df54640 1 -- 172.21.15.119:0/1546717394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe298111f90 con 0x7fe298102070 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.835+0000 7fe27ffff640 1 -- 172.21.15.119:0/1546717394 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fe288039040 con 0x7fe298102070 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.835+0000 7fe27ffff640 1 --2- 172.21.15.119:0/1546717394 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fe280039490 0x7fe28003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.835+0000 7fe27ffff640 1 -- 172.21.15.119:0/1546717394 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe28806ce60 con 0x7fe298102070 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.835+0000 7fe29df54640 1 -- 172.21.15.119:0/1546717394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2981014d0 con 0x7fe298102070 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.835+0000 7fe296ffd640 1 --2- 172.21.15.119:0/1546717394 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fe280039490 0x7fe28003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:25.553 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.836+0000 7fe296ffd640 1 --2- 172.21.15.119:0/1546717394 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fe280039490 0x7fe28003b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe28c006fd0 tx=0x7fe28c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:25.554 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.840+0000 7fe27ffff640 1 -- 172.21.15.119:0/1546717394 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe288037070 con 0x7fe298102070 2024-09-13T21:36:25.554 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:24.997+0000 7fe29df54640 1 -- 172.21.15.119:0/1546717394 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fe29804b720 con 0x7fe298102070 2024-09-13T21:36:25.554 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.000+0000 7fe27ffff640 1 -- 172.21.15.119:0/1546717394 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fe288037020 con 0x7fe298102070 2024-09-13T21:36:25.554 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.003+0000 7fe29df54640 1 -- 172.21.15.119:0/1546717394 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fe280039490 msgr2=0x7fe28003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:25.554 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.003+0000 7fe29df54640 1 --2- 172.21.15.119:0/1546717394 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fe280039490 0x7fe28003b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe28c006fd0 tx=0x7fe28c006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:25.554 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.003+0000 7fe29df54640 1 -- 172.21.15.119:0/1546717394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 msgr2=0x7fe298110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:25.554 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.003+0000 7fe29df54640 1 --2- 172.21.15.119:0/1546717394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298110e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe288009810 tx=0x7fe2880091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:25.554 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.003+0000 7fe29df54640 1 -- 172.21.15.119:0/1546717394 shutdown_connections 2024-09-13T21:36:25.554 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.003+0000 7fe29df54640 1 --2- 172.21.15.119:0/1546717394 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7fe280039490 0x7fe28003b940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:25.554 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.003+0000 7fe29df54640 1 --2- 172.21.15.119:0/1546717394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe298102070 0x7fe298110e00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:25.554 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.003+0000 7fe29df54640 1 -- 172.21.15.119:0/1546717394 >> 172.21.15.119:0/1546717394 conn(0x7fe2980fd850 msgr2=0x7fe2980fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:25.555 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.003+0000 7fe29df54640 1 -- 172.21.15.119:0/1546717394 shutdown_connections 2024-09-13T21:36:25.555 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.003+0000 7fe29df54640 1 -- 172.21.15.119:0/1546717394 wait complete. 2024-09-13T21:36:25.555 INFO:teuthology.orchestra.run.smithi119.stdout:Enabling the dashboard module... 2024-09-13T21:36:26.177 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:25 smithi119 ceph-mon[27653]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:36:26.177 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:25 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1546717394' entity='client.admin' 2024-09-13T21:36:27.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:26 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/982647271' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T21:36:27.474 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.970+0000 7f28c449b640 1 Processor -- start 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.970+0000 7f28c449b640 1 -- start start 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.970+0000 7f28c449b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc101900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.970+0000 7f28c449b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc101e40 con 0x7f28bc1014f0 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.970+0000 7f28c2237640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc101900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.970+0000 7f28c2237640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc101900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40036/0 (socket says 172.21.15.119:40036) 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.970+0000 7f28c2237640 1 -- 172.21.15.119:0/1021212258 learned_addr learned my addr 172.21.15.119:0/1021212258 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.970+0000 7f28c2237640 1 -- 172.21.15.119:0/1021212258 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc101f80 con 0x7f28bc1014f0 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.971+0000 7f28c2237640 1 --2- 172.21.15.119:0/1021212258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc101900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009840 tx=0x7f28b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a4ec92c4bf6cad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.971+0000 7f28c1235640 1 -- 172.21.15.119:0/1021212258 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28b0032440 con 0x7f28bc1014f0 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.971+0000 7f28c1235640 1 -- 172.21.15.119:0/1021212258 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f28b0032a40 con 0x7f28bc1014f0 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.971+0000 7f28c1235640 1 -- 172.21.15.119:0/1021212258 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28b0031a70 con 0x7f28bc1014f0 2024-09-13T21:36:27.475 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.972+0000 7f28c449b640 1 -- 172.21.15.119:0/1021212258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 msgr2=0x7f28bc101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.972+0000 7f28c449b640 1 --2- 172.21.15.119:0/1021212258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc101900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009840 tx=0x7f28b00091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.972+0000 7f28c449b640 1 -- 172.21.15.119:0/1021212258 shutdown_connections 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.972+0000 7f28c449b640 1 --2- 172.21.15.119:0/1021212258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc101900 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.972+0000 7f28c449b640 1 -- 172.21.15.119:0/1021212258 >> 172.21.15.119:0/1021212258 conn(0x7f28bc0fbdc0 msgr2=0x7f28bc0fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.972+0000 7f28c449b640 1 -- 172.21.15.119:0/1021212258 shutdown_connections 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.972+0000 7f28c449b640 1 -- 172.21.15.119:0/1021212258 wait complete. 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.972+0000 7f28c449b640 1 Processor -- start 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.972+0000 7f28c449b640 1 -- start start 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.972+0000 7f28c449b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc110ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.972+0000 7f28c449b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc111530 con 0x7f28bc1014f0 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.973+0000 7f28c2237640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc110ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.973+0000 7f28c2237640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc110ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40048/0 (socket says 172.21.15.119:40048) 2024-09-13T21:36:27.476 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.973+0000 7f28c2237640 1 -- 172.21.15.119:0/982647271 learned_addr learned my addr 172.21.15.119:0/982647271 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.973+0000 7f28c2237640 1 -- 172.21.15.119:0/982647271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0009450 con 0x7f28bc1014f0 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.973+0000 7f28c2237640 1 --2- 172.21.15.119:0/982647271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc110ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28b0031750 tx=0x7f28b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.973+0000 7f28aeffd640 1 -- 172.21.15.119:0/982647271 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28b003c400 con 0x7f28bc1014f0 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.973+0000 7f28aeffd640 1 -- 172.21.15.119:0/982647271 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f28b003ca00 con 0x7f28bc1014f0 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.973+0000 7f28aeffd640 1 -- 172.21.15.119:0/982647271 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28b003a880 con 0x7f28bc1014f0 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.973+0000 7f28c449b640 1 -- 172.21.15.119:0/982647271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc111730 con 0x7f28bc1014f0 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.973+0000 7f28c449b640 1 -- 172.21.15.119:0/982647271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc111b40 con 0x7f28bc1014f0 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.974+0000 7f28aeffd640 1 -- 172.21.15.119:0/982647271 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f28b003aaf0 con 0x7f28bc1014f0 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.974+0000 7f28aeffd640 1 --2- 172.21.15.119:0/982647271 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f28a8039490 0x7f28a803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.974+0000 7f28aeffd640 1 -- 172.21.15.119:0/982647271 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f28b006d040 con 0x7f28bc1014f0 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.974+0000 7f28c449b640 1 -- 172.21.15.119:0/982647271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc04b720 con 0x7f28bc1014f0 2024-09-13T21:36:27.477 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.974+0000 7f28c1a36640 1 --2- 172.21.15.119:0/982647271 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f28a8039490 0x7f28a803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.975+0000 7f28c1a36640 1 --2- 172.21.15.119:0/982647271 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f28a8039490 0x7f28a803b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f28b8006fd0 tx=0x7f28b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:25.979+0000 7f28aeffd640 1 -- 172.21.15.119:0/982647271 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f28b0037030 con 0x7f28bc1014f0 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.175+0000 7f28c449b640 1 -- 172.21.15.119:0/982647271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f28bc10aba0 con 0x7f28bc1014f0 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.896+0000 7f28aeffd640 1 -- 172.21.15.119:0/982647271 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f28b003ccc0 con 0x7f28bc1014f0 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.897+0000 7f28aeffd640 1 -- 172.21.15.119:0/982647271 <== mon.0 v2:172.21.15.119:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f28b002bc40 con 0x7f28bc1014f0 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.899+0000 7f28c449b640 1 -- 172.21.15.119:0/982647271 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f28a8039490 msgr2=0x7f28a803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.899+0000 7f28c449b640 1 --2- 172.21.15.119:0/982647271 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f28a8039490 0x7f28a803b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f28b8006fd0 tx=0x7f28b8006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.899+0000 7f28c449b640 1 -- 172.21.15.119:0/982647271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 msgr2=0x7f28bc110ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.899+0000 7f28c449b640 1 --2- 172.21.15.119:0/982647271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc110ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28b0031750 tx=0x7f28b00091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.899+0000 7f28c449b640 1 -- 172.21.15.119:0/982647271 shutdown_connections 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.899+0000 7f28c449b640 1 --2- 172.21.15.119:0/982647271 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f28a8039490 0x7f28a803b940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.899+0000 7f28c449b640 1 --2- 172.21.15.119:0/982647271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28bc1014f0 0x7f28bc110ff0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:27.478 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.899+0000 7f28c449b640 1 -- 172.21.15.119:0/982647271 >> 172.21.15.119:0/982647271 conn(0x7f28bc0fbdc0 msgr2=0x7f28bc0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:27.479 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.899+0000 7f28c449b640 1 -- 172.21.15.119:0/982647271 shutdown_connections 2024-09-13T21:36:27.479 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:26.899+0000 7f28c449b640 1 -- 172.21.15.119:0/982647271 wait complete. 2024-09-13T21:36:28.127 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:27 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/982647271' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T21:36:28.128 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:27 smithi119 ceph-mon[27653]: mgrmap e9: smithi119.gwjxmq(active, since 24s) 2024-09-13T21:36:28.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:36:28.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T21:36:28.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T21:36:28.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "active_name": "smithi119.gwjxmq", 2024-09-13T21:36:28.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T21:36:28.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:36:28.691 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.919+0000 7ff5c2aa6640 1 Processor -- start 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.919+0000 7ff5c2aa6640 1 -- start start 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.919+0000 7ff5c2aa6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.919+0000 7ff5c2aa6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc1050c0 con 0x7ff5bc076b70 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.919+0000 7ff5c0842640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.919+0000 7ff5c0842640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40080/0 (socket says 172.21.15.119:40080) 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.919+0000 7ff5c0842640 1 -- 172.21.15.119:0/3435942210 learned_addr learned my addr 172.21.15.119:0/3435942210 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.920+0000 7ff5c0842640 1 -- 172.21.15.119:0/3435942210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc105200 con 0x7ff5bc076b70 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.920+0000 7ff5c0842640 1 --2- 172.21.15.119:0/3435942210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc104b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009840 tx=0x7ff5b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f8d03ea27ef463 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.920+0000 7ff5bb7fe640 1 -- 172.21.15.119:0/3435942210 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5b0032440 con 0x7ff5bc076b70 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.920+0000 7ff5bb7fe640 1 -- 172.21.15.119:0/3435942210 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff5b0032a40 con 0x7ff5bc076b70 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.920+0000 7ff5bb7fe640 1 -- 172.21.15.119:0/3435942210 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5b0031aa0 con 0x7ff5bc076b70 2024-09-13T21:36:28.692 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.921+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/3435942210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 msgr2=0x7ff5bc104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:28.693 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.921+0000 7ff5c2aa6640 1 --2- 172.21.15.119:0/3435942210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc104b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009840 tx=0x7ff5b00091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:28.693 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.921+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/3435942210 shutdown_connections 2024-09-13T21:36:28.693 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.921+0000 7ff5c2aa6640 1 --2- 172.21.15.119:0/3435942210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc104b80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:28.693 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.921+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/3435942210 >> 172.21.15.119:0/3435942210 conn(0x7ff5bc0fc6d0 msgr2=0x7ff5bc0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:28.693 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.921+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/3435942210 shutdown_connections 2024-09-13T21:36:28.693 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.921+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/3435942210 wait complete. 2024-09-13T21:36:28.693 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.922+0000 7ff5c2aa6640 1 Processor -- start 2024-09-13T21:36:28.693 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.922+0000 7ff5c2aa6640 1 -- start start 2024-09-13T21:36:28.693 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.922+0000 7ff5c2aa6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc1024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:28.693 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.922+0000 7ff5c2aa6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc1029f0 con 0x7ff5bc076b70 2024-09-13T21:36:28.693 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.922+0000 7ff5c0842640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc1024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.922+0000 7ff5c0842640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc1024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40090/0 (socket says 172.21.15.119:40090) 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.922+0000 7ff5c0842640 1 -- 172.21.15.119:0/2832329025 learned_addr learned my addr 172.21.15.119:0/2832329025 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.923+0000 7ff5c0842640 1 -- 172.21.15.119:0/2832329025 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0009450 con 0x7ff5bc076b70 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.923+0000 7ff5c0842640 1 --2- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc1024b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0006a70 tx=0x7ff5b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.923+0000 7ff5b97fa640 1 -- 172.21.15.119:0/2832329025 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5b0031d20 con 0x7ff5bc076b70 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.923+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/2832329025 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc100a80 con 0x7ff5bc076b70 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.923+0000 7ff5b97fa640 1 -- 172.21.15.119:0/2832329025 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff5b0031e80 con 0x7ff5bc076b70 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.923+0000 7ff5b97fa640 1 -- 172.21.15.119:0/2832329025 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5b003a750 con 0x7ff5bc076b70 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.923+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/2832329025 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc100ef0 con 0x7ff5bc076b70 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.924+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/2832329025 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc04b720 con 0x7ff5bc076b70 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.924+0000 7ff5b97fa640 1 -- 172.21.15.119:0/2832329025 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7ff5b0039040 con 0x7ff5bc076b70 2024-09-13T21:36:28.694 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.924+0000 7ff5b97fa640 1 --2- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff5ac0394e0 0x7ff5ac03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.925+0000 7ff5b97fa640 1 -- 172.21.15.119:0/2832329025 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff5b006cb50 con 0x7ff5bc076b70 2024-09-13T21:36:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.925+0000 7ff5bbfff640 1 -- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff5ac0394e0 msgr2=0x7ff5ac03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/366226653 2024-09-13T21:36:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.925+0000 7ff5bbfff640 1 --2- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff5ac0394e0 0x7ff5ac03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:36:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:27.933+0000 7ff5b97fa640 1 -- 172.21.15.119:0/2832329025 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff5b003a8b0 con 0x7ff5bc076b70 2024-09-13T21:36:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.126+0000 7ff5bbfff640 1 -- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff5ac0394e0 msgr2=0x7ff5ac03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/366226653 2024-09-13T21:36:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.126+0000 7ff5bbfff640 1 --2- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff5ac0394e0 0x7ff5ac03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:36:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.137+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/2832329025 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff5bc101500 con 0x7ff5bc076b70 2024-09-13T21:36:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.137+0000 7ff5b97fa640 1 -- 172.21.15.119:0/2832329025 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7ff5b003f070 con 0x7ff5bc076b70 2024-09-13T21:36:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.140+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff5ac0394e0 msgr2=0x7ff5ac03b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:36:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.140+0000 7ff5c2aa6640 1 --2- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff5ac0394e0 0x7ff5ac03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.140+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 msgr2=0x7ff5bc1024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:28.696 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.140+0000 7ff5c2aa6640 1 --2- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc1024b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0006a70 tx=0x7ff5b00091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:28.696 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.140+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/2832329025 shutdown_connections 2024-09-13T21:36:28.696 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.140+0000 7ff5c2aa6640 1 --2- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7ff5ac0394e0 0x7ff5ac03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:28.696 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.140+0000 7ff5c2aa6640 1 --2- 172.21.15.119:0/2832329025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5bc076b70 0x7ff5bc1024b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:28.696 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.140+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/2832329025 >> 172.21.15.119:0/2832329025 conn(0x7ff5bc0fc6d0 msgr2=0x7ff5bc0fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:28.696 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.140+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/2832329025 shutdown_connections 2024-09-13T21:36:28.696 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:28.140+0000 7ff5c2aa6640 1 -- 172.21.15.119:0/2832329025 wait complete. 2024-09-13T21:36:28.696 INFO:teuthology.orchestra.run.smithi119.stdout:Waiting for the mgr to restart... 2024-09-13T21:36:28.696 INFO:teuthology.orchestra.run.smithi119.stdout:Waiting for mgr epoch 9... 2024-09-13T21:36:28.932 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:28 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2832329025' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T21:36:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: Active manager daemon smithi119.gwjxmq restarted 2024-09-13T21:36:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: Activating manager daemon smithi119.gwjxmq 2024-09-13T21:36:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T21:36:31.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: mgrmap e10: smithi119.gwjxmq(active, starting, since 0.00319695s) 2024-09-13T21:36:31.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:36:31.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi119.gwjxmq", "id": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:36:31.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:36:31.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:36:31.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:36:31.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: Manager daemon smithi119.gwjxmq is now available 2024-09-13T21:36:31.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:36:31.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:36:31.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:31 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/trash_purge_schedule"}]: dispatch 2024-09-13T21:36:32.918 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout { 2024-09-13T21:36:32.918 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T21:36:32.918 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T21:36:32.918 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout } 2024-09-13T21:36:32.918 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.092+0000 7f01481d2640 1 Processor -- start 2024-09-13T21:36:32.918 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.092+0000 7f01481d2640 1 -- start start 2024-09-13T21:36:32.918 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.092+0000 7f01481d2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140104c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:32.918 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.092+0000 7f01481d2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140105150 con 0x7f0140076b90 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.092+0000 7f0145f6e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140104c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.092+0000 7f0145f6e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140104c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40100/0 (socket says 172.21.15.119:40100) 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.092+0000 7f0145f6e640 1 -- 172.21.15.119:0/2690400440 learned_addr learned my addr 172.21.15.119:0/2690400440 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.093+0000 7f0145f6e640 1 -- 172.21.15.119:0/2690400440 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140105290 con 0x7f0140076b90 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.093+0000 7f0145f6e640 1 --2- 172.21.15.119:0/2690400440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140104c10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f013c009840 tx=0x7f013c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3740f40238105d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.093+0000 7f0144f6c640 1 -- 172.21.15.119:0/2690400440 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f013c032440 con 0x7f0140076b90 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.093+0000 7f0144f6c640 1 -- 172.21.15.119:0/2690400440 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f013c032a40 con 0x7f0140076b90 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.093+0000 7f0144f6c640 1 -- 172.21.15.119:0/2690400440 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f013c031a70 con 0x7f0140076b90 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.094+0000 7f01481d2640 1 -- 172.21.15.119:0/2690400440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 msgr2=0x7f0140104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.094+0000 7f01481d2640 1 --2- 172.21.15.119:0/2690400440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140104c10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f013c009840 tx=0x7f013c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.094+0000 7f01481d2640 1 -- 172.21.15.119:0/2690400440 shutdown_connections 2024-09-13T21:36:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.094+0000 7f01481d2640 1 --2- 172.21.15.119:0/2690400440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140104c10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.094+0000 7f01481d2640 1 -- 172.21.15.119:0/2690400440 >> 172.21.15.119:0/2690400440 conn(0x7f01400fc6e0 msgr2=0x7f01400feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.094+0000 7f01481d2640 1 -- 172.21.15.119:0/2690400440 shutdown_connections 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.094+0000 7f01481d2640 1 -- 172.21.15.119:0/2690400440 wait complete. 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.095+0000 7f01481d2640 1 Processor -- start 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.095+0000 7f01481d2640 1 -- start start 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.095+0000 7f01481d2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.095+0000 7f01481d2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140111390 con 0x7f0140076b90 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.095+0000 7f0145f6e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.095+0000 7f0145f6e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40116/0 (socket says 172.21.15.119:40116) 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.095+0000 7f0145f6e640 1 -- 172.21.15.119:0/2743276950 learned_addr learned my addr 172.21.15.119:0/2743276950 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.095+0000 7f0145f6e640 1 -- 172.21.15.119:0/2743276950 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c009450 con 0x7f0140076b90 2024-09-13T21:36:32.920 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.096+0000 7f0145f6e640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140110e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f013c031750 tx=0x7f013c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.096+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f013c03c400 con 0x7f0140076b90 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.096+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f013c03ca00 con 0x7f0140076b90 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.096+0000 7f01481d2640 1 -- 172.21.15.119:0/2743276950 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140111590 con 0x7f0140076b90 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.096+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f013c03a880 con 0x7f0140076b90 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.096+0000 7f01481d2640 1 -- 172.21.15.119:0/2743276950 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0140111fe0 con 0x7f0140076b90 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.097+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f013c03a9e0 con 0x7f0140076b90 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.097+0000 7f01367fc640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 0x7f012c03b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.097+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 --> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f012c03c0f0 con 0x7f012c039530 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.097+0000 7f014576d640 1 -- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 msgr2=0x7f012c03b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/366226653 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.097+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f013c06cff0 con 0x7f0140076b90 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.097+0000 7f014576d640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 0x7f012c03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:36:32.921 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.298+0000 7f014576d640 1 -- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 msgr2=0x7f012c03b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/366226653 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.298+0000 7f014576d640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 0x7f012c03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.699+0000 7f014576d640 1 -- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 msgr2=0x7f012c03b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/366226653 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:29.699+0000 7f014576d640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 0x7f012c03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:30.500+0000 7f014576d640 1 -- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 msgr2=0x7f012c03b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/366226653 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:30.500+0000 7f014576d640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 0x7f012c03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:31.343+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f013c03c740 con 0x7f0140076b90 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:31.343+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 msgr2=0x7f012c03b9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:31.343+0000 7f01367fc640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 0x7f012c03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.344+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f013c039310 con 0x7f0140076b90 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.344+0000 7f01367fc640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f012c03cfd0 0x7f012c03f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.344+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 --> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f012c03c0f0 con 0x7f012c03cfd0 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.345+0000 7f014576d640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f012c03cfd0 0x7f012c03f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:32.922 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.345+0000 7f014576d640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f012c03cfd0 0x7f012c03f3b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0130003940 tx=0x7f0130009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.346+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 <== mgr.14160 v2:172.21.15.119:6800/1188851329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f012c03c0f0 con 0x7f012c03cfd0 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.351+0000 7f01481d2640 1 -- 172.21.15.119:0/2743276950 --> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0140100380 con 0x7f012c03cfd0 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.351+0000 7f01367fc640 1 -- 172.21.15.119:0/2743276950 <== mgr.14160 v2:172.21.15.119:6800/1188851329 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f0140100380 con 0x7f012c03cfd0 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.351+0000 7f01481d2640 1 -- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f012c03cfd0 msgr2=0x7f012c03f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.351+0000 7f01481d2640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f012c03cfd0 0x7f012c03f3b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0130003940 tx=0x7f0130009350 comp rx=0 tx=0).stop 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.351+0000 7f01481d2640 1 -- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 msgr2=0x7f0140110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.351+0000 7f01481d2640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140110e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f013c031750 tx=0x7f013c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.352+0000 7f01481d2640 1 -- 172.21.15.119:0/2743276950 shutdown_connections 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.352+0000 7f01481d2640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f012c03cfd0 0x7f012c03f3b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.352+0000 7f01481d2640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:6800/366226653,v1:172.21.15.119:6801/366226653] conn(0x7f012c039530 0x7f012c03b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.352+0000 7f01481d2640 1 --2- 172.21.15.119:0/2743276950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0140076b90 0x7f0140110e50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.352+0000 7f01481d2640 1 -- 172.21.15.119:0/2743276950 >> 172.21.15.119:0/2743276950 conn(0x7f01400fc6e0 msgr2=0x7f01400fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:32.923 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.352+0000 7f01481d2640 1 -- 172.21.15.119:0/2743276950 shutdown_connections 2024-09-13T21:36:32.924 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:32.352+0000 7f01481d2640 1 -- 172.21.15.119:0/2743276950 wait complete. 2024-09-13T21:36:32.924 INFO:teuthology.orchestra.run.smithi119.stdout:mgr epoch 9 is available 2024-09-13T21:36:32.924 INFO:teuthology.orchestra.run.smithi119.stdout:Generating a dashboard self-signed certificate... 2024-09-13T21:36:33.620 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:33 smithi119 ceph-mon[27653]: mgrmap e11: smithi119.gwjxmq(active, since 1.00589s) 2024-09-13T21:36:33.621 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:33 smithi119 ceph-mon[27653]: [13/Sep/2024:21:36:32] ENGINE Bus STARTING 2024-09-13T21:36:33.621 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:33 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:33.621 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:33 smithi119 ceph-mon[27653]: [13/Sep/2024:21:36:32] ENGINE Serving on https://172.21.15.119:7150 2024-09-13T21:36:33.621 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:33 smithi119 ceph-mon[27653]: [13/Sep/2024:21:36:32] ENGINE Bus STARTED 2024-09-13T21:36:33.621 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:33 smithi119 ceph-mon[27653]: [13/Sep/2024:21:36:32] ENGINE Error in HTTPServer.serve 2024-09-13T21:36:33.621 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Traceback (most recent call last): 2024-09-13T21:36:33.621 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:36:33.621 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:36:33.621 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:36:33.621 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._run(expiration_interval) 2024-09-13T21:36:33.621 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s = self.context.wrap_socket( 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: return self.sslsocket_class._create( 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self.do_handshake() 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._sslobj.do_handshake() 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:36:33.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:33 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:34.215 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T21:36:34.215 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.435+0000 7fadd59cb640 1 Processor -- start 2024-09-13T21:36:34.215 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.435+0000 7fadd59cb640 1 -- start start 2024-09-13T21:36:34.215 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.435+0000 7fadd59cb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd01012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:34.215 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.435+0000 7fadd59cb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd01017e0 con 0x7fadd0100e90 2024-09-13T21:36:34.215 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.435+0000 7fadceffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd01012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:34.215 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.435+0000 7fadceffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd01012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40208/0 (socket says 172.21.15.119:40208) 2024-09-13T21:36:34.215 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.435+0000 7fadceffd640 1 -- 172.21.15.119:0/924242346 learned_addr learned my addr 172.21.15.119:0/924242346 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:34.215 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.436+0000 7fadceffd640 1 -- 172.21.15.119:0/924242346 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0101920 con 0x7fadd0100e90 2024-09-13T21:36:34.216 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.436+0000 7fadceffd640 1 --2- 172.21.15.119:0/924242346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd01012a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fadc800baf0 tx=0x7fadc800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c872eee6c2d85e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:34.216 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.436+0000 7fadcdffb640 1 -- 172.21.15.119:0/924242346 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadc8031790 con 0x7fadd0100e90 2024-09-13T21:36:34.216 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.437+0000 7fadcdffb640 1 -- 172.21.15.119:0/924242346 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fadc8031d90 con 0x7fadd0100e90 2024-09-13T21:36:34.216 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.437+0000 7fadcdffb640 1 -- 172.21.15.119:0/924242346 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadc8039e60 con 0x7fadd0100e90 2024-09-13T21:36:34.216 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.437+0000 7fadd59cb640 1 -- 172.21.15.119:0/924242346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 msgr2=0x7fadd01012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:34.216 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.437+0000 7fadd59cb640 1 --2- 172.21.15.119:0/924242346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd01012a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fadc800baf0 tx=0x7fadc800b460 comp rx=0 tx=0).stop 2024-09-13T21:36:34.216 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.437+0000 7fadd59cb640 1 -- 172.21.15.119:0/924242346 shutdown_connections 2024-09-13T21:36:34.216 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.437+0000 7fadd59cb640 1 --2- 172.21.15.119:0/924242346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd01012a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:34.216 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.437+0000 7fadd59cb640 1 -- 172.21.15.119:0/924242346 >> 172.21.15.119:0/924242346 conn(0x7fadd00fc6d0 msgr2=0x7fadd00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.437+0000 7fadd59cb640 1 -- 172.21.15.119:0/924242346 shutdown_connections 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.437+0000 7fadd59cb640 1 -- 172.21.15.119:0/924242346 wait complete. 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.438+0000 7fadd59cb640 1 Processor -- start 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.438+0000 7fadd59cb640 1 -- start start 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.438+0000 7fadd59cb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd010ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.438+0000 7fadd59cb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd010f0f0 con 0x7fadd0100e90 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.438+0000 7fadceffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd010ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.438+0000 7fadceffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd010ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40210/0 (socket says 172.21.15.119:40210) 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.438+0000 7fadceffd640 1 -- 172.21.15.119:0/170875614 learned_addr learned my addr 172.21.15.119:0/170875614 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.438+0000 7fadceffd640 1 -- 172.21.15.119:0/170875614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc800b700 con 0x7fadd0100e90 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.438+0000 7fadceffd640 1 --2- 172.21.15.119:0/170875614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd010ebb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fadc8003080 tx=0x7fadc803c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.439+0000 7fadb77fe640 1 -- 172.21.15.119:0/170875614 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadc803a660 con 0x7fadd0100e90 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.439+0000 7fadb77fe640 1 -- 172.21.15.119:0/170875614 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fadc803ac60 con 0x7fadd0100e90 2024-09-13T21:36:34.217 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.439+0000 7fadd59cb640 1 -- 172.21.15.119:0/170875614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd010f2f0 con 0x7fadd0100e90 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.439+0000 7fadb77fe640 1 -- 172.21.15.119:0/170875614 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadc8044ac0 con 0x7fadd0100e90 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.439+0000 7fadd59cb640 1 -- 172.21.15.119:0/170875614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd010f760 con 0x7fadd0100e90 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.439+0000 7fadb77fe640 1 -- 172.21.15.119:0/170875614 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7fadc8044d30 con 0x7fadd0100e90 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.439+0000 7fadb77fe640 1 --2- 172.21.15.119:0/170875614 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fadb8039420 0x7fadb803b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.440+0000 7fadb77fe640 1 -- 172.21.15.119:0/170875614 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fadc80700d0 con 0x7fadd0100e90 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.440+0000 7fadce7fc640 1 --2- 172.21.15.119:0/170875614 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fadb8039420 0x7fadb803b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.440+0000 7fadd59cb640 1 -- 172.21.15.119:0/170875614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd01002f0 con 0x7fadd0100e90 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.440+0000 7fadce7fc640 1 --2- 172.21.15.119:0/170875614 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fadb8039420 0x7fadb803b8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadc400ad90 tx=0x7fadc4009410 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.444+0000 7fadb77fe640 1 -- 172.21.15.119:0/170875614 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fadc804b530 con 0x7fadd0100e90 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.618+0000 7fadd59cb640 1 -- 172.21.15.119:0/170875614 --> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fadd010ff90 con 0x7fadb8039420 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.689+0000 7fadb77fe640 1 -- 172.21.15.119:0/170875614 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fadc8038360 con 0x7fadd0100e90 2024-09-13T21:36:34.218 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.710+0000 7fadb77fe640 1 -- 172.21.15.119:0/170875614 <== mgr.14160 v2:172.21.15.119:6800/1188851329 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fadd010ff90 con 0x7fadb8039420 2024-09-13T21:36:34.219 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.713+0000 7fadd59cb640 1 -- 172.21.15.119:0/170875614 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fadb8039420 msgr2=0x7fadb803b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:34.219 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.713+0000 7fadd59cb640 1 --2- 172.21.15.119:0/170875614 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fadb8039420 0x7fadb803b8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadc400ad90 tx=0x7fadc4009410 comp rx=0 tx=0).stop 2024-09-13T21:36:34.219 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.713+0000 7fadd59cb640 1 -- 172.21.15.119:0/170875614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 msgr2=0x7fadd010ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:34.219 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.713+0000 7fadd59cb640 1 --2- 172.21.15.119:0/170875614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd010ebb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fadc8003080 tx=0x7fadc803c040 comp rx=0 tx=0).stop 2024-09-13T21:36:34.219 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.713+0000 7fadd59cb640 1 -- 172.21.15.119:0/170875614 shutdown_connections 2024-09-13T21:36:34.219 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.713+0000 7fadd59cb640 1 --2- 172.21.15.119:0/170875614 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fadb8039420 0x7fadb803b8d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:34.219 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.713+0000 7fadd59cb640 1 --2- 172.21.15.119:0/170875614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd0100e90 0x7fadd010ebb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:34.219 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.713+0000 7fadd59cb640 1 -- 172.21.15.119:0/170875614 >> 172.21.15.119:0/170875614 conn(0x7fadd00fc6d0 msgr2=0x7fadd0105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:34.219 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.713+0000 7fadd59cb640 1 -- 172.21.15.119:0/170875614 shutdown_connections 2024-09-13T21:36:34.219 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:33.713+0000 7fadd59cb640 1 -- 172.21.15.119:0/170875614 wait complete. 2024-09-13T21:36:34.219 INFO:teuthology.orchestra.run.smithi119.stdout:Creating initial admin user... 2024-09-13T21:36:34.695 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:34 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:34.695 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:34 smithi119 ceph-mon[27653]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:34.695 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:34 smithi119 ceph-mon[27653]: mgrmap e12: smithi119.gwjxmq(active, since 2s) 2024-09-13T21:36:34.695 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:34 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:34.695 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:34 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:35.634 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$dmCAUY8rjQT9Qc1Ofw4.E.U19OjJZVM/VtLPRbNqh9i78/JE2NLAe", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726263395, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T21:36:35.634 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.611+0000 7fd1e0c21640 1 Processor -- start 2024-09-13T21:36:35.634 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.611+0000 7fd1e0c21640 1 -- start start 2024-09-13T21:36:35.634 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.611+0000 7fd1e0c21640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc1070e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.611+0000 7fd1e0c21640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc102ad0 con 0x7fd1dc076a90 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.611+0000 7fd1da59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc1070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.611+0000 7fd1da59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc1070e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38380/0 (socket says 172.21.15.119:38380) 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.611+0000 7fd1da59c640 1 -- 172.21.15.119:0/3611834502 learned_addr learned my addr 172.21.15.119:0/3611834502 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.611+0000 7fd1da59c640 1 -- 172.21.15.119:0/3611834502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc076ea0 con 0x7fd1dc076a90 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.612+0000 7fd1da59c640 1 --2- 172.21.15.119:0/3611834502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc1070e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009840 tx=0x7fd1cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363bd64dcbf6977a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.612+0000 7fd1d9d9b640 1 -- 172.21.15.119:0/3611834502 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1cc032440 con 0x7fd1dc076a90 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.612+0000 7fd1d9d9b640 1 -- 172.21.15.119:0/3611834502 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd1cc032a40 con 0x7fd1dc076a90 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.612+0000 7fd1d9d9b640 1 -- 172.21.15.119:0/3611834502 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1cc031aa0 con 0x7fd1dc076a90 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.613+0000 7fd1e0c21640 1 -- 172.21.15.119:0/3611834502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 msgr2=0x7fd1dc1070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.613+0000 7fd1e0c21640 1 --2- 172.21.15.119:0/3611834502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc1070e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009840 tx=0x7fd1cc0091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:35.635 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.613+0000 7fd1e0c21640 1 -- 172.21.15.119:0/3611834502 shutdown_connections 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.613+0000 7fd1e0c21640 1 --2- 172.21.15.119:0/3611834502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc1070e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.613+0000 7fd1e0c21640 1 -- 172.21.15.119:0/3611834502 >> 172.21.15.119:0/3611834502 conn(0x7fd1dc0fc790 msgr2=0x7fd1dc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.613+0000 7fd1e0c21640 1 -- 172.21.15.119:0/3611834502 shutdown_connections 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.613+0000 7fd1e0c21640 1 -- 172.21.15.119:0/3611834502 wait complete. 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.613+0000 7fd1e0c21640 1 Processor -- start 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.613+0000 7fd1e0c21640 1 -- start start 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1e0c21640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1e0c21640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc113500 con 0x7fd1dc076a90 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1da59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1da59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc112fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38388/0 (socket says 172.21.15.119:38388) 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1da59c640 1 -- 172.21.15.119:0/713032043 learned_addr learned my addr 172.21.15.119:0/713032043 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1da59c640 1 -- 172.21.15.119:0/713032043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc009450 con 0x7fd1dc076a90 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1da59c640 1 --2- 172.21.15.119:0/713032043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc112fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc031780 tx=0x7fd1cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:35.636 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1d2ffd640 1 -- 172.21.15.119:0/713032043 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1cc0327b0 con 0x7fd1dc076a90 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1e0c21640 1 -- 172.21.15.119:0/713032043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc113700 con 0x7fd1dc076a90 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1d2ffd640 1 -- 172.21.15.119:0/713032043 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd1cc03b8d0 con 0x7fd1dc076a90 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1d2ffd640 1 -- 172.21.15.119:0/713032043 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1cc03a790 con 0x7fd1dc076a90 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.614+0000 7fd1e0c21640 1 -- 172.21.15.119:0/713032043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc113b70 con 0x7fd1dc076a90 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.615+0000 7fd1d2ffd640 1 -- 172.21.15.119:0/713032043 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fd1cc039040 con 0x7fd1dc076a90 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.615+0000 7fd1e0c21640 1 -- 172.21.15.119:0/713032043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc04b720 con 0x7fd1dc076a90 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.615+0000 7fd1d2ffd640 1 --2- 172.21.15.119:0/713032043 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fd1c80394e0 0x7fd1c803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.616+0000 7fd1d2ffd640 1 -- 172.21.15.119:0/713032043 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd1cc06ca70 con 0x7fd1dc076a90 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.616+0000 7fd1d3fff640 1 --2- 172.21.15.119:0/713032043 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fd1c80394e0 0x7fd1c803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.616+0000 7fd1d3fff640 1 --2- 172.21.15.119:0/713032043 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fd1c80394e0 0x7fd1c803b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4006fd0 tx=0x7fd1c4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.620+0000 7fd1d2ffd640 1 -- 172.21.15.119:0/713032043 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd1cc03a8f0 con 0x7fd1dc076a90 2024-09-13T21:36:35.637 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:34.791+0000 7fd1e0c21640 1 -- 172.21.15.119:0/713032043 --> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd1dc05eb60 con 0x7fd1c80394e0 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.017+0000 7fd1d2ffd640 1 -- 172.21.15.119:0/713032043 <== mgr.14160 v2:172.21.15.119:6800/1188851329 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fd1dc05eb60 con 0x7fd1c80394e0 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.019+0000 7fd1e0c21640 1 -- 172.21.15.119:0/713032043 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fd1c80394e0 msgr2=0x7fd1c803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.019+0000 7fd1e0c21640 1 --2- 172.21.15.119:0/713032043 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fd1c80394e0 0x7fd1c803b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4006fd0 tx=0x7fd1c4006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.019+0000 7fd1e0c21640 1 -- 172.21.15.119:0/713032043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 msgr2=0x7fd1dc112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.019+0000 7fd1e0c21640 1 --2- 172.21.15.119:0/713032043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc112fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc031780 tx=0x7fd1cc0091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.019+0000 7fd1e0c21640 1 -- 172.21.15.119:0/713032043 shutdown_connections 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.019+0000 7fd1e0c21640 1 --2- 172.21.15.119:0/713032043 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fd1c80394e0 0x7fd1c803b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.019+0000 7fd1e0c21640 1 --2- 172.21.15.119:0/713032043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1dc076a90 0x7fd1dc112fc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.019+0000 7fd1e0c21640 1 -- 172.21.15.119:0/713032043 >> 172.21.15.119:0/713032043 conn(0x7fd1dc0fc790 msgr2=0x7fd1dc0fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.019+0000 7fd1e0c21640 1 -- 172.21.15.119:0/713032043 shutdown_connections 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.019+0000 7fd1e0c21640 1 -- 172.21.15.119:0/713032043 wait complete. 2024-09-13T21:36:35.638 INFO:teuthology.orchestra.run.smithi119.stdout:Fetching dashboard port number... 2024-09-13T21:36:35.753 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:35 smithi119 ceph-mon[27653]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:35.753 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:35 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:36.810 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:36 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1808971777' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T21:36:37.068 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T21:36:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.995+0000 7f20a1996640 1 Processor -- start 2024-09-13T21:36:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.995+0000 7f20a1996640 1 -- start start 2024-09-13T21:36:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.996+0000 7f20a1996640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c104c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.996+0000 7f20a1996640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c076f60 con 0x7f209c076b50 2024-09-13T21:36:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.996+0000 7f209affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c104c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.996+0000 7f209affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c104c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38400/0 (socket says 172.21.15.119:38400) 2024-09-13T21:36:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.996+0000 7f209affd640 1 -- 172.21.15.119:0/1413188957 learned_addr learned my addr 172.21.15.119:0/1413188957 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.996+0000 7f209affd640 1 -- 172.21.15.119:0/1413188957 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c1051a0 con 0x7f209c076b50 2024-09-13T21:36:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.997+0000 7f209affd640 1 --2- 172.21.15.119:0/1413188957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c104c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f208c009840 tx=0x7f208c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91344c93bc777b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.997+0000 7f209a7fc640 1 -- 172.21.15.119:0/1413188957 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f208c032440 con 0x7f209c076b50 2024-09-13T21:36:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.997+0000 7f209a7fc640 1 -- 172.21.15.119:0/1413188957 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f208c032a40 con 0x7f209c076b50 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.997+0000 7f209a7fc640 1 -- 172.21.15.119:0/1413188957 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f208c031a70 con 0x7f209c076b50 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.998+0000 7f20a1996640 1 -- 172.21.15.119:0/1413188957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 msgr2=0x7f209c104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.998+0000 7f20a1996640 1 --2- 172.21.15.119:0/1413188957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c104c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f208c009840 tx=0x7f208c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.998+0000 7f20a1996640 1 -- 172.21.15.119:0/1413188957 shutdown_connections 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.998+0000 7f20a1996640 1 --2- 172.21.15.119:0/1413188957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c104c60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.998+0000 7f20a1996640 1 -- 172.21.15.119:0/1413188957 >> 172.21.15.119:0/1413188957 conn(0x7f209c0fc710 msgr2=0x7f209c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.998+0000 7f20a1996640 1 -- 172.21.15.119:0/1413188957 shutdown_connections 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.998+0000 7f20a1996640 1 -- 172.21.15.119:0/1413188957 wait complete. 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.998+0000 7f20a1996640 1 Processor -- start 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.998+0000 7f20a1996640 1 -- start start 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.998+0000 7f20a1996640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.998+0000 7f20a1996640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c111380 con 0x7f209c076b50 2024-09-13T21:36:37.070 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.999+0000 7f209affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.999+0000 7f209affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38406/0 (socket says 172.21.15.119:38406) 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.999+0000 7f209affd640 1 -- 172.21.15.119:0/1808971777 learned_addr learned my addr 172.21.15.119:0/1808971777 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.999+0000 7f209affd640 1 -- 172.21.15.119:0/1808971777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c009450 con 0x7f209c076b50 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.999+0000 7f209affd640 1 --2- 172.21.15.119:0/1808971777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c110e40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f208c009420 tx=0x7f208c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.999+0000 7f20937fe640 1 -- 172.21.15.119:0/1808971777 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f208c03c400 con 0x7f209c076b50 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.999+0000 7f20937fe640 1 -- 172.21.15.119:0/1808971777 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f208c03ca00 con 0x7f209c076b50 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.999+0000 7f20937fe640 1 -- 172.21.15.119:0/1808971777 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f208c03a920 con 0x7f209c076b50 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.999+0000 7f20a1996640 1 -- 172.21.15.119:0/1808971777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209c111580 con 0x7f209c076b50 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:35.999+0000 7f20a1996640 1 -- 172.21.15.119:0/1808971777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209c111fd0 con 0x7f209c076b50 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.000+0000 7f20937fe640 1 -- 172.21.15.119:0/1808971777 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f208c03cb70 con 0x7f209c076b50 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.000+0000 7f20a1996640 1 -- 172.21.15.119:0/1808971777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209c100390 con 0x7f209c076b50 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.000+0000 7f20937fe640 1 --2- 172.21.15.119:0/1808971777 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2088039530 0x7f208803b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:37.071 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.000+0000 7f20937fe640 1 -- 172.21.15.119:0/1808971777 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f208c06cf00 con 0x7f209c076b50 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.000+0000 7f2093fff640 1 --2- 172.21.15.119:0/1808971777 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2088039530 0x7f208803b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.001+0000 7f2093fff640 1 --2- 172.21.15.119:0/1808971777 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2088039530 0x7f208803b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2084006fd0 tx=0x7f2084006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.005+0000 7f20937fe640 1 -- 172.21.15.119:0/1808971777 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f208c03ce20 con 0x7f209c076b50 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.160+0000 7f20a1996640 1 -- 172.21.15.119:0/1808971777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f209c04b720 con 0x7f209c076b50 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.160+0000 7f20937fe640 1 -- 172.21.15.119:0/1808971777 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f208c03ce20 con 0x7f209c076b50 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.162+0000 7f20a1996640 1 -- 172.21.15.119:0/1808971777 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2088039530 msgr2=0x7f208803b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.162+0000 7f20a1996640 1 --2- 172.21.15.119:0/1808971777 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2088039530 0x7f208803b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2084006fd0 tx=0x7f2084006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.162+0000 7f20a1996640 1 -- 172.21.15.119:0/1808971777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 msgr2=0x7f209c110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.162+0000 7f20a1996640 1 --2- 172.21.15.119:0/1808971777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c110e40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f208c009420 tx=0x7f208c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.163+0000 7f20a1996640 1 -- 172.21.15.119:0/1808971777 shutdown_connections 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.163+0000 7f20a1996640 1 --2- 172.21.15.119:0/1808971777 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2088039530 0x7f208803b9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.163+0000 7f20a1996640 1 --2- 172.21.15.119:0/1808971777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f209c076b50 0x7f209c110e40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:37.073 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.163+0000 7f20a1996640 1 -- 172.21.15.119:0/1808971777 >> 172.21.15.119:0/1808971777 conn(0x7f209c0fc710 msgr2=0x7f209c0fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:37.073 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.163+0000 7f20a1996640 1 -- 172.21.15.119:0/1808971777 shutdown_connections 2024-09-13T21:36:37.073 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:36.163+0000 7f20a1996640 1 -- 172.21.15.119:0/1808971777 wait complete. 2024-09-13T21:36:37.076 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T21:36:37.076 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout disabled 2024-09-13T21:36:37.083 INFO:teuthology.orchestra.run.smithi119.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T21:36:37.083 INFO:teuthology.orchestra.run.smithi119.stdout:systemctl: stdout inactive 2024-09-13T21:36:37.083 INFO:teuthology.orchestra.run.smithi119.stdout:firewalld.service is not enabled 2024-09-13T21:36:37.083 INFO:teuthology.orchestra.run.smithi119.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T21:36:37.085 INFO:teuthology.orchestra.run.smithi119.stdout:Ceph Dashboard is now available at: 2024-09-13T21:36:37.085 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:36:37.085 INFO:teuthology.orchestra.run.smithi119.stdout: URL: https://smithi119.front.sepia.ceph.com:8443/ 2024-09-13T21:36:37.085 INFO:teuthology.orchestra.run.smithi119.stdout: User: admin 2024-09-13T21:36:37.085 INFO:teuthology.orchestra.run.smithi119.stdout: Password: ly0f1nbilg 2024-09-13T21:36:37.085 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:36:37.085 INFO:teuthology.orchestra.run.smithi119.stdout:Saving cluster configuration to /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config directory 2024-09-13T21:36:37.086 INFO:teuthology.orchestra.run.smithi119.stdout:Enabling autotune for osd_memory_target 2024-09-13T21:36:38.183 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.505+0000 7f6dafacb640 1 Processor -- start 2024-09-13T21:36:38.183 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.506+0000 7f6dafacb640 1 -- start start 2024-09-13T21:36:38.184 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.506+0000 7f6dafacb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8104c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:38.184 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.506+0000 7f6dafacb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da8076ee0 con 0x7f6da8076ad0 2024-09-13T21:36:38.184 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.506+0000 7f6dad867640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8104c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:38.184 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.506+0000 7f6dad867640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8104c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38418/0 (socket says 172.21.15.119:38418) 2024-09-13T21:36:38.184 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.506+0000 7f6dad867640 1 -- 172.21.15.119:0/133550229 learned_addr learned my addr 172.21.15.119:0/133550229 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:38.184 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.506+0000 7f6dad867640 1 -- 172.21.15.119:0/133550229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8105160 con 0x7f6da8076ad0 2024-09-13T21:36:38.184 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.507+0000 7f6dad867640 1 --2- 172.21.15.119:0/133550229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8104c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009840 tx=0x7f6da40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1944bcee7a8d0403 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:38.184 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.507+0000 7f6dac865640 1 -- 172.21.15.119:0/133550229 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6da4032440 con 0x7f6da8076ad0 2024-09-13T21:36:38.184 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.507+0000 7f6dac865640 1 -- 172.21.15.119:0/133550229 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6da4032a40 con 0x7f6da8076ad0 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.507+0000 7f6dac865640 1 -- 172.21.15.119:0/133550229 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6da4031aa0 con 0x7f6da8076ad0 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.508+0000 7f6dafacb640 1 -- 172.21.15.119:0/133550229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 msgr2=0x7f6da8104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.508+0000 7f6dafacb640 1 --2- 172.21.15.119:0/133550229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8104c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009840 tx=0x7f6da40091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.508+0000 7f6dafacb640 1 -- 172.21.15.119:0/133550229 shutdown_connections 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.508+0000 7f6dafacb640 1 --2- 172.21.15.119:0/133550229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8104c20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.508+0000 7f6dafacb640 1 -- 172.21.15.119:0/133550229 >> 172.21.15.119:0/133550229 conn(0x7f6da80fc6d0 msgr2=0x7f6da80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.508+0000 7f6dafacb640 1 -- 172.21.15.119:0/133550229 shutdown_connections 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.508+0000 7f6dafacb640 1 -- 172.21.15.119:0/133550229 wait complete. 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.508+0000 7f6dafacb640 1 Processor -- start 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.508+0000 7f6dafacb640 1 -- start start 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6dafacb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6dafacb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da8111380 con 0x7f6da8076ad0 2024-09-13T21:36:38.185 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6dad867640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6dad867640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38422/0 (socket says 172.21.15.119:38422) 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6dad867640 1 -- 172.21.15.119:0/2646602226 learned_addr learned my addr 172.21.15.119:0/2646602226 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6dad867640 1 -- 172.21.15.119:0/2646602226 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4009450 con 0x7f6da8076ad0 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6dad867640 1 --2- 172.21.15.119:0/2646602226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8110e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6da4006a70 tx=0x7f6da40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6d9e7fc640 1 -- 172.21.15.119:0/2646602226 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6da4031d20 con 0x7f6da8076ad0 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6d9e7fc640 1 -- 172.21.15.119:0/2646602226 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6da4031e80 con 0x7f6da8076ad0 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6dafacb640 1 -- 172.21.15.119:0/2646602226 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da8111580 con 0x7f6da8076ad0 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6d9e7fc640 1 -- 172.21.15.119:0/2646602226 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6da403a750 con 0x7f6da8076ad0 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.509+0000 7f6dafacb640 1 -- 172.21.15.119:0/2646602226 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da8111fd0 con 0x7f6da8076ad0 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.510+0000 7f6d9e7fc640 1 -- 172.21.15.119:0/2646602226 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f6da4039040 con 0x7f6da8076ad0 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.510+0000 7f6dafacb640 1 -- 172.21.15.119:0/2646602226 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da81002f0 con 0x7f6da8076ad0 2024-09-13T21:36:38.186 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.510+0000 7f6d9e7fc640 1 --2- 172.21.15.119:0/2646602226 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f6d94039580 0x7f6d9403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.510+0000 7f6d9e7fc640 1 -- 172.21.15.119:0/2646602226 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6da406cdf0 con 0x7f6da8076ad0 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.510+0000 7f6dad066640 1 --2- 172.21.15.119:0/2646602226 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f6d94039580 0x7f6d9403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.511+0000 7f6dad066640 1 --2- 172.21.15.119:0/2646602226 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f6d94039580 0x7f6d9403ba30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6d98006fd0 tx=0x7f6d98006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.515+0000 7f6d9e7fc640 1 -- 172.21.15.119:0/2646602226 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6da404c350 con 0x7f6da8076ad0 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.671+0000 7f6dafacb640 1 -- 172.21.15.119:0/2646602226 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f6da804b720 con 0x7f6da8076ad0 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.671+0000 7f6d9e7fc640 1 -- 172.21.15.119:0/2646602226 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f6da403f030 con 0x7f6da8076ad0 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.673+0000 7f6dafacb640 1 -- 172.21.15.119:0/2646602226 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f6d94039580 msgr2=0x7f6d9403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.673+0000 7f6dafacb640 1 --2- 172.21.15.119:0/2646602226 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f6d94039580 0x7f6d9403ba30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6d98006fd0 tx=0x7f6d98006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.673+0000 7f6dafacb640 1 -- 172.21.15.119:0/2646602226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 msgr2=0x7f6da8110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.673+0000 7f6dafacb640 1 --2- 172.21.15.119:0/2646602226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8110e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6da4006a70 tx=0x7f6da40091d0 comp rx=0 tx=0).stop 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.673+0000 7f6dafacb640 1 -- 172.21.15.119:0/2646602226 shutdown_connections 2024-09-13T21:36:38.187 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.673+0000 7f6dafacb640 1 --2- 172.21.15.119:0/2646602226 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f6d94039580 0x7f6d9403ba30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:38.188 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.673+0000 7f6dafacb640 1 --2- 172.21.15.119:0/2646602226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6da8076ad0 0x7f6da8110e40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:38.188 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.673+0000 7f6dafacb640 1 -- 172.21.15.119:0/2646602226 >> 172.21.15.119:0/2646602226 conn(0x7f6da80fc6d0 msgr2=0x7f6da80fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:38.188 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.673+0000 7f6dafacb640 1 -- 172.21.15.119:0/2646602226 shutdown_connections 2024-09-13T21:36:38.188 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:37.673+0000 7f6dafacb640 1 -- 172.21.15.119:0/2646602226 wait complete. 2024-09-13T21:36:38.546 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:38 smithi119 ceph-mon[27653]: mgrmap e13: smithi119.gwjxmq(active, since 6s) 2024-09-13T21:36:39.331 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.544+0000 7f3c318c6640 1 Processor -- start 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.544+0000 7f3c318c6640 1 -- start start 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.545+0000 7f3c318c6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c1013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.545+0000 7f3c318c6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1018e0 con 0x7f3c2c100f90 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.545+0000 7f3c2affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c1013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.545+0000 7f3c2affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c1013a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38432/0 (socket says 172.21.15.119:38432) 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.545+0000 7f3c2affd640 1 -- 172.21.15.119:0/2525253290 learned_addr learned my addr 172.21.15.119:0/2525253290 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.545+0000 7f3c2affd640 1 -- 172.21.15.119:0/2525253290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c101a20 con 0x7f3c2c100f90 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.546+0000 7f3c2affd640 1 --2- 172.21.15.119:0/2525253290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c1013a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00baf0 tx=0x7f3c1c00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5804b48459bd5caf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.546+0000 7f3c29ffb640 1 -- 172.21.15.119:0/2525253290 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c1c031790 con 0x7f3c2c100f90 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.546+0000 7f3c29ffb640 1 -- 172.21.15.119:0/2525253290 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c1c031d90 con 0x7f3c2c100f90 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.546+0000 7f3c29ffb640 1 -- 172.21.15.119:0/2525253290 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c1c039e60 con 0x7f3c2c100f90 2024-09-13T21:36:39.332 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.547+0000 7f3c318c6640 1 -- 172.21.15.119:0/2525253290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 msgr2=0x7f3c2c1013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.547+0000 7f3c318c6640 1 --2- 172.21.15.119:0/2525253290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c1013a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00baf0 tx=0x7f3c1c00b460 comp rx=0 tx=0).stop 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.547+0000 7f3c318c6640 1 -- 172.21.15.119:0/2525253290 shutdown_connections 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.547+0000 7f3c318c6640 1 --2- 172.21.15.119:0/2525253290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c1013a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.547+0000 7f3c318c6640 1 -- 172.21.15.119:0/2525253290 >> 172.21.15.119:0/2525253290 conn(0x7f3c2c0fc790 msgr2=0x7f3c2c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.547+0000 7f3c318c6640 1 -- 172.21.15.119:0/2525253290 shutdown_connections 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.547+0000 7f3c318c6640 1 -- 172.21.15.119:0/2525253290 wait complete. 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.547+0000 7f3c318c6640 1 Processor -- start 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.547+0000 7f3c318c6640 1 -- start start 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.547+0000 7f3c318c6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c10ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.547+0000 7f3c318c6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c10f120 con 0x7f3c2c100f90 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.548+0000 7f3c2affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c10ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.548+0000 7f3c2affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c10ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38436/0 (socket says 172.21.15.119:38436) 2024-09-13T21:36:39.333 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.548+0000 7f3c2affd640 1 -- 172.21.15.119:0/1176180481 learned_addr learned my addr 172.21.15.119:0/1176180481 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.548+0000 7f3c2affd640 1 -- 172.21.15.119:0/1176180481 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c00b700 con 0x7f3c2c100f90 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.548+0000 7f3c2affd640 1 --2- 172.21.15.119:0/1176180481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c10ebe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c003080 tx=0x7f3c1c03c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.548+0000 7f3c237fe640 1 -- 172.21.15.119:0/1176180481 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c1c03a660 con 0x7f3c2c100f90 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.548+0000 7f3c237fe640 1 -- 172.21.15.119:0/1176180481 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c1c03ac60 con 0x7f3c2c100f90 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.548+0000 7f3c318c6640 1 -- 172.21.15.119:0/1176180481 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c10f320 con 0x7f3c2c100f90 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.548+0000 7f3c237fe640 1 -- 172.21.15.119:0/1176180481 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c1c044ac0 con 0x7f3c2c100f90 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.548+0000 7f3c318c6640 1 -- 172.21.15.119:0/1176180481 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c10f790 con 0x7f3c2c100f90 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.549+0000 7f3c237fe640 1 -- 172.21.15.119:0/1176180481 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f3c1c044d30 con 0x7f3c2c100f90 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.549+0000 7f3c237fe640 1 --2- 172.21.15.119:0/1176180481 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f3c180395d0 0x7f3c1803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.549+0000 7f3c237fe640 1 -- 172.21.15.119:0/1176180481 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3c1c0703e0 con 0x7f3c2c100f90 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.549+0000 7f3c2a7fc640 1 --2- 172.21.15.119:0/1176180481 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f3c180395d0 0x7f3c1803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.549+0000 7f3c318c6640 1 -- 172.21.15.119:0/1176180481 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2c1003f0 con 0x7f3c2c100f90 2024-09-13T21:36:39.334 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.550+0000 7f3c2a7fc640 1 --2- 172.21.15.119:0/1176180481 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f3c180395d0 0x7f3c1803ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c14006fd0 tx=0x7f3c14006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.554+0000 7f3c237fe640 1 -- 172.21.15.119:0/1176180481 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3c1c035070 con 0x7f3c2c100f90 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.794+0000 7f3c318c6640 1 -- 172.21.15.119:0/1176180481 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f3c2c102c80 con 0x7f3c2c100f90 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.796+0000 7f3c237fe640 1 -- 172.21.15.119:0/1176180481 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f3c1c04b300 con 0x7f3c2c100f90 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.798+0000 7f3c318c6640 1 -- 172.21.15.119:0/1176180481 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f3c180395d0 msgr2=0x7f3c1803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.798+0000 7f3c318c6640 1 --2- 172.21.15.119:0/1176180481 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f3c180395d0 0x7f3c1803ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c14006fd0 tx=0x7f3c14006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.798+0000 7f3c318c6640 1 -- 172.21.15.119:0/1176180481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 msgr2=0x7f3c2c10ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.798+0000 7f3c318c6640 1 --2- 172.21.15.119:0/1176180481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c10ebe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c003080 tx=0x7f3c1c03c040 comp rx=0 tx=0).stop 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.798+0000 7f3c318c6640 1 -- 172.21.15.119:0/1176180481 shutdown_connections 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.798+0000 7f3c318c6640 1 --2- 172.21.15.119:0/1176180481 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f3c180395d0 0x7f3c1803ba80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.798+0000 7f3c318c6640 1 --2- 172.21.15.119:0/1176180481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c2c100f90 0x7f3c2c10ebe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:39.335 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.798+0000 7f3c318c6640 1 -- 172.21.15.119:0/1176180481 >> 172.21.15.119:0/1176180481 conn(0x7f3c2c0fc790 msgr2=0x7f3c2c105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.799+0000 7f3c318c6640 1 -- 172.21.15.119:0/1176180481 shutdown_connections 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/bin/ceph: stderr 2024-09-13T21:36:38.799+0000 7f3c318c6640 1 -- 172.21.15.119:0/1176180481 wait complete. 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:36:39.336 INFO:teuthology.orchestra.run.smithi119.stdout: ceph telemetry on 2024-09-13T21:36:39.337 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:36:39.337 INFO:teuthology.orchestra.run.smithi119.stdout:For more information see: 2024-09-13T21:36:39.337 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:36:39.337 INFO:teuthology.orchestra.run.smithi119.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-13T21:36:39.337 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:36:39.337 INFO:teuthology.orchestra.run.smithi119.stdout:Bootstrap complete. 2024-09-13T21:36:39.365 INFO:tasks.cephadm:Fetching config... 2024-09-13T21:36:39.366 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:36:39.366 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T21:36:39.381 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T21:36:39.382 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:36:39.382 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T21:36:39.438 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T21:36:39.438 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:36:39.438 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/keyring of=/dev/stdout 2024-09-13T21:36:39.504 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T21:36:39.504 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:36:39.504 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T21:36:39.559 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T21:36:39.559 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1ZsooAwl3Hiw+xi+WLoUSVXqvFWnsmJVfmDI3XMm9+xSYTWTGyWudVx1Mit2CWKGsDrwVUWgaMgS4cmvvOKW0L6AMOT2fQcxwpHQCY1l8Zxk2ohxxf+kRfsD/75DEm5c8FKPMjEyIgTyB6H1Pn+Bdx4pWLWiVOJsFaGY8sOwEDdpn6mtmoVr439VzS08c5hisuiEkHuUVBD/39MI9yId68ZHZAr0oYpa1VclwUtSCHTJ80YImK//9kVmip1Zr1vTWLawc5gEZAgafZWoQC7usdGz6Vv4SXy7p+Fe3PryWmoKtuHLfUWoLf6SIZo6WNUqprMt2iVvKqTiNjY6DiK2PA4MsjLQA9T7aq6w1ehrVz5I2tsBwnc2M302Wk/MaIqXpohyhwuwq3y5jWRTiqRqhXc0zIMddO/Pxw8ijOLPARyXoEe2JUhwhElTpLNqYiYddYyUB58Ey2EATlfO5HCbEQ3+2d4hnLIMSs9y+vrQ3XvDZEDbKNjpGtCKwYsVdTFs= ceph-f9722044-7217-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T21:36:39.648 INFO:teuthology.orchestra.run.smithi119.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1ZsooAwl3Hiw+xi+WLoUSVXqvFWnsmJVfmDI3XMm9+xSYTWTGyWudVx1Mit2CWKGsDrwVUWgaMgS4cmvvOKW0L6AMOT2fQcxwpHQCY1l8Zxk2ohxxf+kRfsD/75DEm5c8FKPMjEyIgTyB6H1Pn+Bdx4pWLWiVOJsFaGY8sOwEDdpn6mtmoVr439VzS08c5hisuiEkHuUVBD/39MI9yId68ZHZAr0oYpa1VclwUtSCHTJ80YImK//9kVmip1Zr1vTWLawc5gEZAgafZWoQC7usdGz6Vv4SXy7p+Fe3PryWmoKtuHLfUWoLf6SIZo6WNUqprMt2iVvKqTiNjY6DiK2PA4MsjLQA9T7aq6w1ehrVz5I2tsBwnc2M302Wk/MaIqXpohyhwuwq3y5jWRTiqRqhXc0zIMddO/Pxw8ijOLPARyXoEe2JUhwhElTpLNqYiYddYyUB58Ey2EATlfO5HCbEQ3+2d4hnLIMSs9y+vrQ3XvDZEDbKNjpGtCKwYsVdTFs= ceph-f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:36:39.659 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1ZsooAwl3Hiw+xi+WLoUSVXqvFWnsmJVfmDI3XMm9+xSYTWTGyWudVx1Mit2CWKGsDrwVUWgaMgS4cmvvOKW0L6AMOT2fQcxwpHQCY1l8Zxk2ohxxf+kRfsD/75DEm5c8FKPMjEyIgTyB6H1Pn+Bdx4pWLWiVOJsFaGY8sOwEDdpn6mtmoVr439VzS08c5hisuiEkHuUVBD/39MI9yId68ZHZAr0oYpa1VclwUtSCHTJ80YImK//9kVmip1Zr1vTWLawc5gEZAgafZWoQC7usdGz6Vv4SXy7p+Fe3PryWmoKtuHLfUWoLf6SIZo6WNUqprMt2iVvKqTiNjY6DiK2PA4MsjLQA9T7aq6w1ehrVz5I2tsBwnc2M302Wk/MaIqXpohyhwuwq3y5jWRTiqRqhXc0zIMddO/Pxw8ijOLPARyXoEe2JUhwhElTpLNqYiYddYyUB58Ey2EATlfO5HCbEQ3+2d4hnLIMSs9y+vrQ3XvDZEDbKNjpGtCKwYsVdTFs= ceph-f9722044-7217-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T21:36:39.703 INFO:teuthology.orchestra.run.smithi155.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1ZsooAwl3Hiw+xi+WLoUSVXqvFWnsmJVfmDI3XMm9+xSYTWTGyWudVx1Mit2CWKGsDrwVUWgaMgS4cmvvOKW0L6AMOT2fQcxwpHQCY1l8Zxk2ohxxf+kRfsD/75DEm5c8FKPMjEyIgTyB6H1Pn+Bdx4pWLWiVOJsFaGY8sOwEDdpn6mtmoVr439VzS08c5hisuiEkHuUVBD/39MI9yId68ZHZAr0oYpa1VclwUtSCHTJ80YImK//9kVmip1Zr1vTWLawc5gEZAgafZWoQC7usdGz6Vv4SXy7p+Fe3PryWmoKtuHLfUWoLf6SIZo6WNUqprMt2iVvKqTiNjY6DiK2PA4MsjLQA9T7aq6w1ehrVz5I2tsBwnc2M302Wk/MaIqXpohyhwuwq3y5jWRTiqRqhXc0zIMddO/Pxw8ijOLPARyXoEe2JUhwhElTpLNqYiYddYyUB58Ey2EATlfO5HCbEQ3+2d4hnLIMSs9y+vrQ3XvDZEDbKNjpGtCKwYsVdTFs= ceph-f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:36:39.716 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T21:36:39.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:39 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1176180481' entity='client.admin' 2024-09-13T21:36:39.964 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:36:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.683+0000 7f8564e86640 1 -- 172.21.15.119:0/4279214848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85600fb2e0 msgr2=0x7f85600fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.683+0000 7f8564e86640 1 --2- 172.21.15.119:0/4279214848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85600fb2e0 0x7f85600fb6f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8550004850 tx=0x7f8550009da0 comp rx=0 tx=0).stop 2024-09-13T21:36:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.683+0000 7f8564e86640 1 -- 172.21.15.119:0/4279214848 shutdown_connections 2024-09-13T21:36:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.683+0000 7f8564e86640 1 --2- 172.21.15.119:0/4279214848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85600fb2e0 0x7f85600fb6f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.683+0000 7f8564e86640 1 -- 172.21.15.119:0/4279214848 >> 172.21.15.119:0/4279214848 conn(0x7f85600f6ac0 msgr2=0x7f85600f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.683+0000 7f8564e86640 1 -- 172.21.15.119:0/4279214848 shutdown_connections 2024-09-13T21:36:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.683+0000 7f8564e86640 1 -- 172.21.15.119:0/4279214848 wait complete. 2024-09-13T21:36:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.684+0000 7f8564e86640 1 Processor -- start 2024-09-13T21:36:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.684+0000 7f8564e86640 1 -- start start 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.684+0000 7f8564e86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85600fb2e0 0x7f85600f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.684+0000 7f8564e86640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85600f8f20 con 0x7f85600fb2e0 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.684+0000 7f855e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85600fb2e0 0x7f85600f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.684+0000 7f855e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85600fb2e0 0x7f85600f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38456/0 (socket says 172.21.15.119:38456) 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.684+0000 7f855e59c640 1 -- 172.21.15.119:0/1498931079 learned_addr learned my addr 172.21.15.119:0/1498931079 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.684+0000 7f855e59c640 1 -- 172.21.15.119:0/1498931079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550005040 con 0x7f85600fb2e0 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.684+0000 7f855e59c640 1 --2- 172.21.15.119:0/1498931079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85600fb2e0 0x7f85600f89e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f855002a6d0 tx=0x7f8550009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.685+0000 7f85577fe640 1 -- 172.21.15.119:0/1498931079 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8550033630 con 0x7f85600fb2e0 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.685+0000 7f8564e86640 1 -- 172.21.15.119:0/1498931079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85600f6fb0 con 0x7f85600fb2e0 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.685+0000 7f85577fe640 1 -- 172.21.15.119:0/1498931079 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8550033c30 con 0x7f85600fb2e0 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.685+0000 7f85577fe640 1 -- 172.21.15.119:0/1498931079 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f855003dc00 con 0x7f85600fb2e0 2024-09-13T21:36:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.685+0000 7f8564e86640 1 -- 172.21.15.119:0/1498931079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85600f7420 con 0x7f85600fb2e0 2024-09-13T21:36:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.685+0000 7f85577fe640 1 -- 172.21.15.119:0/1498931079 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f8550030020 con 0x7f85600fb2e0 2024-09-13T21:36:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.686+0000 7f8564e86640 1 -- 172.21.15.119:0/1498931079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856005ed70 con 0x7f85600fb2e0 2024-09-13T21:36:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.686+0000 7f85577fe640 1 --2- 172.21.15.119:0/1498931079 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f854c039580 0x7f854c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.686+0000 7f85577fe640 1 -- 172.21.15.119:0/1498931079 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f855006ca30 con 0x7f85600fb2e0 2024-09-13T21:36:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.686+0000 7f8555d9b640 1 --2- 172.21.15.119:0/1498931079 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f854c039580 0x7f854c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.686+0000 7f8555d9b640 1 --2- 172.21.15.119:0/1498931079 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f854c039580 0x7f854c03ba30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8548006fd0 tx=0x7f8548006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.690+0000 7f85577fe640 1 -- 172.21.15.119:0/1498931079 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8550047440 con 0x7f85600fb2e0 2024-09-13T21:36:41.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.851+0000 7f8564e86640 1 -- 172.21.15.119:0/1498931079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f8560100f30 con 0x7f85600fb2e0 2024-09-13T21:36:41.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.854+0000 7f85577fe640 1 -- 172.21.15.119:0/1498931079 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f855003b7e0 con 0x7f85600fb2e0 2024-09-13T21:36:41.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.856+0000 7f8564e86640 1 -- 172.21.15.119:0/1498931079 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f854c039580 msgr2=0x7f854c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:41.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.856+0000 7f8564e86640 1 --2- 172.21.15.119:0/1498931079 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f854c039580 0x7f854c03ba30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8548006fd0 tx=0x7f8548006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:41.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.856+0000 7f8564e86640 1 -- 172.21.15.119:0/1498931079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85600fb2e0 msgr2=0x7f85600f89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:41.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.856+0000 7f8564e86640 1 --2- 172.21.15.119:0/1498931079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85600fb2e0 0x7f85600f89e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f855002a6d0 tx=0x7f8550009da0 comp rx=0 tx=0).stop 2024-09-13T21:36:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.856+0000 7f8564e86640 1 -- 172.21.15.119:0/1498931079 shutdown_connections 2024-09-13T21:36:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.856+0000 7f8564e86640 1 --2- 172.21.15.119:0/1498931079 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f854c039580 0x7f854c03ba30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.856+0000 7f8564e86640 1 --2- 172.21.15.119:0/1498931079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85600fb2e0 0x7f85600f89e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.856+0000 7f8564e86640 1 -- 172.21.15.119:0/1498931079 >> 172.21.15.119:0/1498931079 conn(0x7f85600f6ac0 msgr2=0x7f8560064990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.856+0000 7f8564e86640 1 -- 172.21.15.119:0/1498931079 shutdown_connections 2024-09-13T21:36:41.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:41.856+0000 7f8564e86640 1 -- 172.21.15.119:0/1498931079 wait complete. 2024-09-13T21:36:42.653 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T21:36:42.653 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T21:36:42.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:42 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1498931079' entity='client.admin' 2024-09-13T21:36:42.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:42 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:42.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:42 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:42.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:42 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:36:42.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:42 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:42.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:42 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:36:42.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:42 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T21:36:42.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:42 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:36:43.097 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:36:44.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:43 smithi119 ceph-mon[27653]: Deploying daemon crash.smithi119 on smithi119 2024-09-13T21:36:45.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.259+0000 7fe831cec640 1 -- 172.21.15.119:0/4081427232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fc1b0 msgr2=0x7fe82c0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:45.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.259+0000 7fe831cec640 1 --2- 172.21.15.119:0/4081427232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fc1b0 0x7fe82c0fc5c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe81c004850 tx=0x7fe81c009da0 comp rx=0 tx=0).stop 2024-09-13T21:36:45.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.259+0000 7fe831cec640 1 -- 172.21.15.119:0/4081427232 shutdown_connections 2024-09-13T21:36:45.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.259+0000 7fe831cec640 1 --2- 172.21.15.119:0/4081427232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fc1b0 0x7fe82c0fc5c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:45.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.259+0000 7fe831cec640 1 -- 172.21.15.119:0/4081427232 >> 172.21.15.119:0/4081427232 conn(0x7fe82c0f7990 msgr2=0x7fe82c0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:45.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.260+0000 7fe831cec640 1 -- 172.21.15.119:0/4081427232 shutdown_connections 2024-09-13T21:36:45.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.260+0000 7fe831cec640 1 -- 172.21.15.119:0/4081427232 wait complete. 2024-09-13T21:36:45.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.260+0000 7fe831cec640 1 Processor -- start 2024-09-13T21:36:45.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.260+0000 7fe831cec640 1 -- start start 2024-09-13T21:36:45.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.260+0000 7fe831cec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fc1b0 0x7fe82c071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:45.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.260+0000 7fe831cec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0719d0 con 0x7fe82c0fc1b0 2024-09-13T21:36:45.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.260+0000 7fe82b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fc1b0 0x7fe82c071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:45.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.261+0000 7fe82b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fc1b0 0x7fe82c071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40680/0 (socket says 172.21.15.119:40680) 2024-09-13T21:36:45.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.261+0000 7fe82b7fe640 1 -- 172.21.15.119:0/1349739305 learned_addr learned my addr 172.21.15.119:0/1349739305 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:45.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.261+0000 7fe82b7fe640 1 -- 172.21.15.119:0/1349739305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c005040 con 0x7fe82c0fc1b0 2024-09-13T21:36:45.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.261+0000 7fe82b7fe640 1 --2- 172.21.15.119:0/1349739305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fc1b0 0x7fe82c071490 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe81c02a6d0 tx=0x7fe81c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:45.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.261+0000 7fe828ff9640 1 -- 172.21.15.119:0/1349739305 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe81c033630 con 0x7fe82c0fc1b0 2024-09-13T21:36:45.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.261+0000 7fe828ff9640 1 -- 172.21.15.119:0/1349739305 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe81c033c30 con 0x7fe82c0fc1b0 2024-09-13T21:36:45.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.261+0000 7fe831cec640 1 -- 172.21.15.119:0/1349739305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c06fa60 con 0x7fe82c0fc1b0 2024-09-13T21:36:45.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.261+0000 7fe828ff9640 1 -- 172.21.15.119:0/1349739305 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe81c03dc00 con 0x7fe82c0fc1b0 2024-09-13T21:36:45.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.261+0000 7fe831cec640 1 -- 172.21.15.119:0/1349739305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c06fed0 con 0x7fe82c0fc1b0 2024-09-13T21:36:45.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.262+0000 7fe828ff9640 1 -- 172.21.15.119:0/1349739305 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fe81c030020 con 0x7fe82c0fc1b0 2024-09-13T21:36:45.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.262+0000 7fe831cec640 1 -- 172.21.15.119:0/1349739305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c1025d0 con 0x7fe82c0fc1b0 2024-09-13T21:36:45.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.262+0000 7fe828ff9640 1 --2- 172.21.15.119:0/1349739305 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe818039580 0x7fe81803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:45.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.262+0000 7fe828ff9640 1 -- 172.21.15.119:0/1349739305 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe81c06cb30 con 0x7fe82c0fc1b0 2024-09-13T21:36:45.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.262+0000 7fe822ffd640 1 --2- 172.21.15.119:0/1349739305 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe818039580 0x7fe81803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:45.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.263+0000 7fe822ffd640 1 --2- 172.21.15.119:0/1349739305 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe818039580 0x7fe81803ba30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe814006fd0 tx=0x7fe814006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:45.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.267+0000 7fe828ff9640 1 -- 172.21.15.119:0/1349739305 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe81c047440 con 0x7fe82c0fc1b0 2024-09-13T21:36:45.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.432+0000 7fe831cec640 1 -- 172.21.15.119:0/1349739305 --> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fe82c070110 con 0x7fe818039580 2024-09-13T21:36:45.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.435+0000 7fe828ff9640 1 -- 172.21.15.119:0/1349739305 <== mgr.14160 v2:172.21.15.119:6800/1188851329 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe82c070110 con 0x7fe818039580 2024-09-13T21:36:45.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.437+0000 7fe831cec640 1 -- 172.21.15.119:0/1349739305 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe818039580 msgr2=0x7fe81803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:45.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.437+0000 7fe831cec640 1 --2- 172.21.15.119:0/1349739305 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe818039580 0x7fe81803ba30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe814006fd0 tx=0x7fe814006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:45.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.437+0000 7fe831cec640 1 -- 172.21.15.119:0/1349739305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fc1b0 msgr2=0x7fe82c071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:45.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.437+0000 7fe831cec640 1 --2- 172.21.15.119:0/1349739305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fc1b0 0x7fe82c071490 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe81c02a6d0 tx=0x7fe81c009da0 comp rx=0 tx=0).stop 2024-09-13T21:36:45.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.437+0000 7fe831cec640 1 -- 172.21.15.119:0/1349739305 shutdown_connections 2024-09-13T21:36:45.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.437+0000 7fe831cec640 1 --2- 172.21.15.119:0/1349739305 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe818039580 0x7fe81803ba30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:45.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.437+0000 7fe831cec640 1 --2- 172.21.15.119:0/1349739305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fc1b0 0x7fe82c071490 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:45.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.437+0000 7fe831cec640 1 -- 172.21.15.119:0/1349739305 >> 172.21.15.119:0/1349739305 conn(0x7fe82c0f7990 msgr2=0x7fe82c0f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:45.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.437+0000 7fe831cec640 1 -- 172.21.15.119:0/1349739305 shutdown_connections 2024-09-13T21:36:45.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:45.437+0000 7fe831cec640 1 -- 172.21.15.119:0/1349739305 wait complete. 2024-09-13T21:36:46.233 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi155 2024-09-13T21:36:46.233 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:36:46.233 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.conf 2024-09-13T21:36:46.253 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:36:46.253 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:36:46.311 INFO:tasks.cephadm:Adding host smithi155 to orchestrator... 2024-09-13T21:36:46.312 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph orch host add smithi155 2024-09-13T21:36:46.597 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:46 smithi119 ceph-mon[27653]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:46.597 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:46 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:46.675 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:36:48.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.085+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/3831214648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b740fc1b0 msgr2=0x7f1b740fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:48.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.085+0000 7f1b7c7e4640 1 --2- 172.21.15.119:0/3831214648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b740fc1b0 0x7f1b740fc5c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1b70004850 tx=0x7f1b70009da0 comp rx=0 tx=0).stop 2024-09-13T21:36:48.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.085+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/3831214648 shutdown_connections 2024-09-13T21:36:48.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.085+0000 7f1b7c7e4640 1 --2- 172.21.15.119:0/3831214648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b740fc1b0 0x7f1b740fc5c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:48.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.085+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/3831214648 >> 172.21.15.119:0/3831214648 conn(0x7f1b740f7990 msgr2=0x7f1b740f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:48.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.085+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/3831214648 shutdown_connections 2024-09-13T21:36:48.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.085+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/3831214648 wait complete. 2024-09-13T21:36:48.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.086+0000 7f1b7c7e4640 1 Processor -- start 2024-09-13T21:36:48.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.086+0000 7f1b7c7e4640 1 -- start start 2024-09-13T21:36:48.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.086+0000 7f1b7c7e4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b740fc1b0 0x7f1b74071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:48.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.086+0000 7f1b7c7e4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740719d0 con 0x7f1b740fc1b0 2024-09-13T21:36:48.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.086+0000 7f1b7a580640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b740fc1b0 0x7f1b74071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:48.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.086+0000 7f1b7a580640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b740fc1b0 0x7f1b74071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40696/0 (socket says 172.21.15.119:40696) 2024-09-13T21:36:48.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.086+0000 7f1b7a580640 1 -- 172.21.15.119:0/978239439 learned_addr learned my addr 172.21.15.119:0/978239439 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:48.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.086+0000 7f1b7a580640 1 -- 172.21.15.119:0/978239439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b70005040 con 0x7f1b740fc1b0 2024-09-13T21:36:48.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.086+0000 7f1b7a580640 1 --2- 172.21.15.119:0/978239439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b740fc1b0 0x7f1b74071490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b7002a6d0 tx=0x7f1b70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:48.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.086+0000 7f1b6affd640 1 -- 172.21.15.119:0/978239439 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b70033630 con 0x7f1b740fc1b0 2024-09-13T21:36:48.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.087+0000 7f1b6affd640 1 -- 172.21.15.119:0/978239439 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1b70033c30 con 0x7f1b740fc1b0 2024-09-13T21:36:48.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.087+0000 7f1b6affd640 1 -- 172.21.15.119:0/978239439 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b7003dc00 con 0x7f1b740fc1b0 2024-09-13T21:36:48.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.087+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/978239439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7406fa60 con 0x7f1b740fc1b0 2024-09-13T21:36:48.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.087+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/978239439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7406fed0 con 0x7f1b740fc1b0 2024-09-13T21:36:48.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.087+0000 7f1b6affd640 1 -- 172.21.15.119:0/978239439 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f1b70030020 con 0x7f1b740fc1b0 2024-09-13T21:36:48.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.088+0000 7f1b6affd640 1 --2- 172.21.15.119:0/978239439 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f1b600395d0 0x7f1b6003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:48.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.088+0000 7f1b6affd640 1 -- 172.21.15.119:0/978239439 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1b7006c9f0 con 0x7f1b740fc1b0 2024-09-13T21:36:48.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.088+0000 7f1b79d7f640 1 --2- 172.21.15.119:0/978239439 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f1b600395d0 0x7f1b6003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:48.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.088+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/978239439 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b741025d0 con 0x7f1b740fc1b0 2024-09-13T21:36:48.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.088+0000 7f1b79d7f640 1 --2- 172.21.15.119:0/978239439 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f1b600395d0 0x7f1b6003ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1b64006fd0 tx=0x7f1b64006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:48.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.093+0000 7f1b6affd640 1 -- 172.21.15.119:0/978239439 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1b7003bb10 con 0x7f1b740fc1b0 2024-09-13T21:36:48.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:48.266+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/978239439 --> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b74101fc0 con 0x7f1b600395d0 2024-09-13T21:36:49.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:49 smithi119 ceph-mon[27653]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:36:49.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:49 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:49.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:49 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:49.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:49 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:49.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:49 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:49.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:49 smithi119 ceph-mon[27653]: Deploying daemon node-exporter.smithi119 on smithi119 2024-09-13T21:36:50.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:50 smithi119 ceph-mon[27653]: Deploying cephadm binary to smithi155 2024-09-13T21:36:51.267 INFO:teuthology.orchestra.run.smithi119.stdout:Added host 'smithi155' with addr '172.21.15.155' 2024-09-13T21:36:51.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:51.263+0000 7f1b6affd640 1 -- 172.21.15.119:0/978239439 <== mgr.14160 v2:172.21.15.119:6800/1188851329 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1b74101fc0 con 0x7f1b600395d0 2024-09-13T21:36:51.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:51.266+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/978239439 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f1b600395d0 msgr2=0x7f1b6003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:51.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:51.266+0000 7f1b7c7e4640 1 --2- 172.21.15.119:0/978239439 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f1b600395d0 0x7f1b6003ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1b64006fd0 tx=0x7f1b64006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:51.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:51.266+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/978239439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b740fc1b0 msgr2=0x7f1b74071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:51.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:51.266+0000 7f1b7c7e4640 1 --2- 172.21.15.119:0/978239439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b740fc1b0 0x7f1b74071490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b7002a6d0 tx=0x7f1b70009da0 comp rx=0 tx=0).stop 2024-09-13T21:36:51.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:51.266+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/978239439 shutdown_connections 2024-09-13T21:36:51.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:51.266+0000 7f1b7c7e4640 1 --2- 172.21.15.119:0/978239439 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f1b600395d0 0x7f1b6003ba80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:51.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:51.266+0000 7f1b7c7e4640 1 --2- 172.21.15.119:0/978239439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b740fc1b0 0x7f1b74071490 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:51.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:51.266+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/978239439 >> 172.21.15.119:0/978239439 conn(0x7f1b740f7990 msgr2=0x7f1b740f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:51.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:51.266+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/978239439 shutdown_connections 2024-09-13T21:36:51.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:51.266+0000 7f1b7c7e4640 1 -- 172.21.15.119:0/978239439 wait complete. 2024-09-13T21:36:52.230 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T21:36:52.462 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:52 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:52.462 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:52 smithi119 ceph-mon[27653]: Added host smithi155 2024-09-13T21:36:52.462 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:52 smithi119 ceph-mon[27653]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:36:52.462 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:52 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:52.678 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:36:53.870 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:53 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:53.870 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:53 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:53.870 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:53 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:53.870 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:53 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:53.870 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:53 smithi119 ceph-mon[27653]: Deploying daemon alertmanager.smithi119 on smithi119 2024-09-13T21:36:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.150+0000 7f7615122640 1 -- 172.21.15.119:0/3917367891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76100fb0c0 msgr2=0x7f76100fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.150+0000 7f7615122640 1 --2- 172.21.15.119:0/3917367891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76100fb0c0 0x7f76100fb4d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7600004850 tx=0x7f7600009da0 comp rx=0 tx=0).stop 2024-09-13T21:36:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.150+0000 7f7615122640 1 -- 172.21.15.119:0/3917367891 shutdown_connections 2024-09-13T21:36:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.150+0000 7f7615122640 1 --2- 172.21.15.119:0/3917367891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76100fb0c0 0x7f76100fb4d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.150+0000 7f7615122640 1 -- 172.21.15.119:0/3917367891 >> 172.21.15.119:0/3917367891 conn(0x7f76100f6880 msgr2=0x7f76100f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.150+0000 7f7615122640 1 -- 172.21.15.119:0/3917367891 shutdown_connections 2024-09-13T21:36:54.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.150+0000 7f7615122640 1 -- 172.21.15.119:0/3917367891 wait complete. 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.151+0000 7f7615122640 1 Processor -- start 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.151+0000 7f7615122640 1 -- start start 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.151+0000 7f7615122640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76100fb0c0 0x7f761010b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.151+0000 7f7615122640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761010bb40 con 0x7f76100fb0c0 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.151+0000 7f760ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76100fb0c0 0x7f761010b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.151+0000 7f760ed9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76100fb0c0 0x7f761010b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42258/0 (socket says 172.21.15.119:42258) 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.151+0000 7f760ed9d640 1 -- 172.21.15.119:0/2509800306 learned_addr learned my addr 172.21.15.119:0/2509800306 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.151+0000 7f760ed9d640 1 -- 172.21.15.119:0/2509800306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600005040 con 0x7f76100fb0c0 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.152+0000 7f760ed9d640 1 --2- 172.21.15.119:0/2509800306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76100fb0c0 0x7f761010b600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f760002a6d0 tx=0x7f7600009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.152+0000 7f75f77fe640 1 -- 172.21.15.119:0/2509800306 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7600033630 con 0x7f76100fb0c0 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.152+0000 7f75f77fe640 1 -- 172.21.15.119:0/2509800306 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7600033c30 con 0x7f76100fb0c0 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.152+0000 7f75f77fe640 1 -- 172.21.15.119:0/2509800306 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f760003dc00 con 0x7f76100fb0c0 2024-09-13T21:36:54.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.152+0000 7f7615122640 1 -- 172.21.15.119:0/2509800306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761010bd40 con 0x7f76100fb0c0 2024-09-13T21:36:54.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.152+0000 7f7615122640 1 -- 172.21.15.119:0/2509800306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761010c1b0 con 0x7f76100fb0c0 2024-09-13T21:36:54.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.153+0000 7f75f77fe640 1 -- 172.21.15.119:0/2509800306 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f7600030020 con 0x7f76100fb0c0 2024-09-13T21:36:54.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.153+0000 7f7615122640 1 -- 172.21.15.119:0/2509800306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761005ed70 con 0x7f76100fb0c0 2024-09-13T21:36:54.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.153+0000 7f75f77fe640 1 --2- 172.21.15.119:0/2509800306 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f75f8039580 0x7f75f803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:54.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.153+0000 7f75f77fe640 1 -- 172.21.15.119:0/2509800306 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f760006c970 con 0x7f76100fb0c0 2024-09-13T21:36:54.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.153+0000 7f760e59c640 1 --2- 172.21.15.119:0/2509800306 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f75f8039580 0x7f75f803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:54.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.153+0000 7f760e59c640 1 --2- 172.21.15.119:0/2509800306 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f75f8039580 0x7f75f803ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7604006fd0 tx=0x7f7604006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:54.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.157+0000 7f75f77fe640 1 -- 172.21.15.119:0/2509800306 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7600045d20 con 0x7f76100fb0c0 2024-09-13T21:36:54.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.346+0000 7f7615122640 1 -- 172.21.15.119:0/2509800306 --> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f761010c1b0 con 0x7f75f8039580 2024-09-13T21:36:54.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.347+0000 7f75f77fe640 1 -- 172.21.15.119:0/2509800306 <== mgr.14160 v2:172.21.15.119:6800/1188851329 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f761010c1b0 con 0x7f75f8039580 2024-09-13T21:36:54.349 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:36:54.349 INFO:teuthology.orchestra.run.smithi119.stdout:[{"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}, {"addr": "172.21.15.155", "hostname": "smithi155", "labels": [], "status": ""}] 2024-09-13T21:36:54.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.349+0000 7f7615122640 1 -- 172.21.15.119:0/2509800306 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f75f8039580 msgr2=0x7f75f803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:54.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.349+0000 7f7615122640 1 --2- 172.21.15.119:0/2509800306 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f75f8039580 0x7f75f803ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7604006fd0 tx=0x7f7604006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:54.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.349+0000 7f7615122640 1 -- 172.21.15.119:0/2509800306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76100fb0c0 msgr2=0x7f761010b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:54.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.349+0000 7f7615122640 1 --2- 172.21.15.119:0/2509800306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76100fb0c0 0x7f761010b600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f760002a6d0 tx=0x7f7600009da0 comp rx=0 tx=0).stop 2024-09-13T21:36:54.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.349+0000 7f7615122640 1 -- 172.21.15.119:0/2509800306 shutdown_connections 2024-09-13T21:36:54.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.349+0000 7f7615122640 1 --2- 172.21.15.119:0/2509800306 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f75f8039580 0x7f75f803ba30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:54.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.349+0000 7f7615122640 1 --2- 172.21.15.119:0/2509800306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76100fb0c0 0x7f761010b600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:54.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.349+0000 7f7615122640 1 -- 172.21.15.119:0/2509800306 >> 172.21.15.119:0/2509800306 conn(0x7f76100f6880 msgr2=0x7f76100f7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:54.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.350+0000 7f7615122640 1 -- 172.21.15.119:0/2509800306 shutdown_connections 2024-09-13T21:36:54.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:54.350+0000 7f7615122640 1 -- 172.21.15.119:0/2509800306 wait complete. 2024-09-13T21:36:54.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:54 smithi119 ceph-mon[27653]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:36:55.018 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T21:36:55.019 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T21:36:55.258 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:36:55.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:55 smithi119 ceph-mon[27653]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T21:36:56.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:56 smithi119 ceph-mon[27653]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:36:56.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:56 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:36:57.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.403+0000 7fe4798a1640 1 -- 172.21.15.119:0/1322158669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4740fc1d0 msgr2=0x7fe4740fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:57.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.403+0000 7fe4798a1640 1 --2- 172.21.15.119:0/1322158669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4740fc1d0 0x7fe4740fc5e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe464009bd0 tx=0x7fe464004d10 comp rx=0 tx=0).stop 2024-09-13T21:36:57.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.404+0000 7fe4798a1640 1 -- 172.21.15.119:0/1322158669 shutdown_connections 2024-09-13T21:36:57.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.404+0000 7fe4798a1640 1 --2- 172.21.15.119:0/1322158669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4740fc1d0 0x7fe4740fc5e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:57.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.404+0000 7fe4798a1640 1 -- 172.21.15.119:0/1322158669 >> 172.21.15.119:0/1322158669 conn(0x7fe4740f79b0 msgr2=0x7fe4740f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:57.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.404+0000 7fe4798a1640 1 -- 172.21.15.119:0/1322158669 shutdown_connections 2024-09-13T21:36:57.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.404+0000 7fe4798a1640 1 -- 172.21.15.119:0/1322158669 wait complete. 2024-09-13T21:36:57.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.404+0000 7fe4798a1640 1 Processor -- start 2024-09-13T21:36:57.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.404+0000 7fe4798a1640 1 -- start start 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.404+0000 7fe4798a1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4740fc1d0 0x7fe47410c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.404+0000 7fe4798a1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47410cc50 con 0x7fe4740fc1d0 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.404+0000 7fe472ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4740fc1d0 0x7fe47410c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.405+0000 7fe472ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4740fc1d0 0x7fe47410c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:42280/0 (socket says 172.21.15.119:42280) 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.405+0000 7fe472ffd640 1 -- 172.21.15.119:0/1655801694 learned_addr learned my addr 172.21.15.119:0/1655801694 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.405+0000 7fe472ffd640 1 -- 172.21.15.119:0/1655801694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4640098b0 con 0x7fe4740fc1d0 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.405+0000 7fe472ffd640 1 --2- 172.21.15.119:0/1655801694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4740fc1d0 0x7fe47410c710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe464003400 tx=0x7fe464004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.405+0000 7fe46b7fe640 1 -- 172.21.15.119:0/1655801694 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe464032910 con 0x7fe4740fc1d0 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.405+0000 7fe46b7fe640 1 -- 172.21.15.119:0/1655801694 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe46403d420 con 0x7fe4740fc1d0 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.405+0000 7fe4798a1640 1 -- 172.21.15.119:0/1655801694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47410ce50 con 0x7fe4740fc1d0 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.405+0000 7fe46b7fe640 1 -- 172.21.15.119:0/1655801694 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe464031590 con 0x7fe4740fc1d0 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.405+0000 7fe4798a1640 1 -- 172.21.15.119:0/1655801694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47410d9e0 con 0x7fe4740fc1d0 2024-09-13T21:36:57.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.406+0000 7fe46b7fe640 1 -- 172.21.15.119:0/1655801694 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fe46402f030 con 0x7fe4740fc1d0 2024-09-13T21:36:57.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.406+0000 7fe4798a1640 1 -- 172.21.15.119:0/1655801694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4741025f0 con 0x7fe4740fc1d0 2024-09-13T21:36:57.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.406+0000 7fe46b7fe640 1 --2- 172.21.15.119:0/1655801694 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe4600395d0 0x7fe46003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:36:57.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.406+0000 7fe46b7fe640 1 -- 172.21.15.119:0/1655801694 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe46406d7c0 con 0x7fe4740fc1d0 2024-09-13T21:36:57.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.406+0000 7fe4727fc640 1 --2- 172.21.15.119:0/1655801694 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe4600395d0 0x7fe46003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:36:57.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.407+0000 7fe4727fc640 1 --2- 172.21.15.119:0/1655801694 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe4600395d0 0x7fe46003ba80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe45c006fd0 tx=0x7fe45c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:36:57.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.411+0000 7fe46b7fe640 1 -- 172.21.15.119:0/1655801694 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe464030b20 con 0x7fe4740fc1d0 2024-09-13T21:36:57.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.589+0000 7fe4798a1640 1 -- 172.21.15.119:0/1655801694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe47410e330 con 0x7fe4740fc1d0 2024-09-13T21:36:57.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.703+0000 7fe46b7fe640 1 -- 172.21.15.119:0/1655801694 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe464041030 con 0x7fe4740fc1d0 2024-09-13T21:36:57.706 INFO:teuthology.orchestra.run.smithi119.stderr:adjusted tunables profile to default 2024-09-13T21:36:57.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.706+0000 7fe4798a1640 1 -- 172.21.15.119:0/1655801694 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe4600395d0 msgr2=0x7fe46003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:57.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.706+0000 7fe4798a1640 1 --2- 172.21.15.119:0/1655801694 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe4600395d0 0x7fe46003ba80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe45c006fd0 tx=0x7fe45c006db0 comp rx=0 tx=0).stop 2024-09-13T21:36:57.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.706+0000 7fe4798a1640 1 -- 172.21.15.119:0/1655801694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4740fc1d0 msgr2=0x7fe47410c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:36:57.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.706+0000 7fe4798a1640 1 --2- 172.21.15.119:0/1655801694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4740fc1d0 0x7fe47410c710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe464003400 tx=0x7fe464004d10 comp rx=0 tx=0).stop 2024-09-13T21:36:57.708 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:57 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1655801694' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T21:36:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.706+0000 7fe4798a1640 1 -- 172.21.15.119:0/1655801694 shutdown_connections 2024-09-13T21:36:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.706+0000 7fe4798a1640 1 --2- 172.21.15.119:0/1655801694 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe4600395d0 0x7fe46003ba80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.706+0000 7fe4798a1640 1 --2- 172.21.15.119:0/1655801694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4740fc1d0 0x7fe47410c710 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:36:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.706+0000 7fe4798a1640 1 -- 172.21.15.119:0/1655801694 >> 172.21.15.119:0/1655801694 conn(0x7fe4740f79b0 msgr2=0x7fe4740f8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:36:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.706+0000 7fe4798a1640 1 -- 172.21.15.119:0/1655801694 shutdown_connections 2024-09-13T21:36:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:36:57.706+0000 7fe4798a1640 1 -- 172.21.15.119:0/1655801694 wait complete. 2024-09-13T21:36:58.946 INFO:tasks.cephadm:Adding mon.smithi119 on smithi119 2024-09-13T21:36:58.946 INFO:tasks.cephadm:Adding mon.smithi155 on smithi155 2024-09-13T21:36:58.946 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi119:172.21.15.119=smithi119;smithi155:172.21.15.155=smithi155' 2024-09-13T21:36:58.995 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:58 smithi119 ceph-mon[27653]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:36:58.995 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:58 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1655801694' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T21:36:58.995 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:36:58 smithi119 ceph-mon[27653]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T21:36:59.275 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:36:59.319 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.820+0000 7f475e040640 1 -- 172.21.15.155:0/252404997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47580fd810 msgr2=0x7f47580fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.820+0000 7f475e040640 1 --2- 172.21.15.155:0/252404997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47580fd810 0x7f47580fdc20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4748009bd0 tx=0x7f4748004d10 comp rx=0 tx=0).stop 2024-09-13T21:37:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.820+0000 7f475e040640 1 -- 172.21.15.155:0/252404997 shutdown_connections 2024-09-13T21:37:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.820+0000 7f475e040640 1 --2- 172.21.15.155:0/252404997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47580fd810 0x7f47580fdc20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.820+0000 7f475e040640 1 -- 172.21.15.155:0/252404997 >> 172.21.15.155:0/252404997 conn(0x7f47580f6010 msgr2=0x7f47580f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.820+0000 7f475e040640 1 -- 172.21.15.155:0/252404997 shutdown_connections 2024-09-13T21:37:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.820+0000 7f475e040640 1 -- 172.21.15.155:0/252404997 wait complete. 2024-09-13T21:37:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.821+0000 7f475e040640 1 Processor -- start 2024-09-13T21:37:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.821+0000 7f475e040640 1 -- start start 2024-09-13T21:37:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.821+0000 7f475e040640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47580fd810 0x7f475810c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.821+0000 7f475e040640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475810ccc0 con 0x7f47580fd810 2024-09-13T21:37:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.821+0000 7f47577fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47580fd810 0x7f475810c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.821+0000 7f47577fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47580fd810 0x7f475810c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:60064/0 (socket says 172.21.15.155:60064) 2024-09-13T21:37:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.821+0000 7f47577fe640 1 -- 172.21.15.155:0/2703579283 learned_addr learned my addr 172.21.15.155:0/2703579283 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.821+0000 7f47577fe640 1 -- 172.21.15.155:0/2703579283 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47480098b0 con 0x7f47580fd810 2024-09-13T21:37:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.822+0000 7f47577fe640 1 --2- 172.21.15.155:0/2703579283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47580fd810 0x7f475810c780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4748009ba0 tx=0x7f4748004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.822+0000 7f473ffff640 1 -- 172.21.15.155:0/2703579283 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4748032910 con 0x7f47580fd810 2024-09-13T21:37:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.822+0000 7f473ffff640 1 -- 172.21.15.155:0/2703579283 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f474803d420 con 0x7f47580fd810 2024-09-13T21:37:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.822+0000 7f475e040640 1 -- 172.21.15.155:0/2703579283 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475810cec0 con 0x7f47580fd810 2024-09-13T21:37:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.822+0000 7f473ffff640 1 -- 172.21.15.155:0/2703579283 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4748031590 con 0x7f47580fd810 2024-09-13T21:37:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.822+0000 7f475e040640 1 -- 172.21.15.155:0/2703579283 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475810da50 con 0x7f47580fd810 2024-09-13T21:37:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.823+0000 7f473ffff640 1 -- 172.21.15.155:0/2703579283 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f474802f030 con 0x7f47580fd810 2024-09-13T21:37:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.823+0000 7f475e040640 1 -- 172.21.15.155:0/2703579283 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47581025f0 con 0x7f47580fd810 2024-09-13T21:37:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.823+0000 7f473ffff640 1 --2- 172.21.15.155:0/2703579283 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f4740039580 0x7f474003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:00.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.823+0000 7f473ffff640 1 -- 172.21.15.155:0/2703579283 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f474806d7c0 con 0x7f47580fd810 2024-09-13T21:37:00.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.823+0000 7f4756ffd640 1 --2- 172.21.15.155:0/2703579283 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f4740039580 0x7f474003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:00.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.824+0000 7f4756ffd640 1 --2- 172.21.15.155:0/2703579283 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f4740039580 0x7f474003ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f474c006fd0 tx=0x7f474c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:00.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.828+0000 7f473ffff640 1 -- 172.21.15.155:0/2703579283 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4748032a70 con 0x7f47580fd810 2024-09-13T21:37:00.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:00 smithi119 ceph-mon[27653]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:00.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:00.992+0000 7f475e040640 1 -- 172.21.15.155:0/2703579283 --> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi119:172.21.15.119=smithi119;smithi155:172.21.15.155=smithi155", "target": ["mon-mgr", ""]}) v1 -- 0x7f475810dc90 con 0x7f4740039580 2024-09-13T21:37:01.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:01.001+0000 7f473ffff640 1 -- 172.21.15.155:0/2703579283 <== mgr.14160 v2:172.21.15.119:6800/1188851329 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f475810dc90 con 0x7f4740039580 2024-09-13T21:37:01.003 INFO:teuthology.orchestra.run.smithi155.stdout:Scheduled mon update... 2024-09-13T21:37:01.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:01.002+0000 7f475e040640 1 -- 172.21.15.155:0/2703579283 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f4740039580 msgr2=0x7f474003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:01.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:01.002+0000 7f475e040640 1 --2- 172.21.15.155:0/2703579283 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f4740039580 0x7f474003ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f474c006fd0 tx=0x7f474c006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:01.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:01.002+0000 7f475e040640 1 -- 172.21.15.155:0/2703579283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47580fd810 msgr2=0x7f475810c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:01.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:01.002+0000 7f475e040640 1 --2- 172.21.15.155:0/2703579283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47580fd810 0x7f475810c780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4748009ba0 tx=0x7f4748004d10 comp rx=0 tx=0).stop 2024-09-13T21:37:01.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:01.003+0000 7f475e040640 1 -- 172.21.15.155:0/2703579283 shutdown_connections 2024-09-13T21:37:01.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:01.003+0000 7f475e040640 1 --2- 172.21.15.155:0/2703579283 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f4740039580 0x7f474003ba30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:01.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:01.003+0000 7f475e040640 1 --2- 172.21.15.155:0/2703579283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47580fd810 0x7f475810c780 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:01.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:01.003+0000 7f475e040640 1 -- 172.21.15.155:0/2703579283 >> 172.21.15.155:0/2703579283 conn(0x7f47580f6010 msgr2=0x7f47580f68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:01.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:01.003+0000 7f475e040640 1 -- 172.21.15.155:0/2703579283 shutdown_connections 2024-09-13T21:37:01.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:01.003+0000 7f475e040640 1 -- 172.21.15.155:0/2703579283 wait complete. 2024-09-13T21:37:01.611 DEBUG:teuthology.orchestra.run.smithi155:mon.smithi155> sudo journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi155.service 2024-09-13T21:37:01.614 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:01.614 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:01.884 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:01.928 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:02.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:02 smithi119 ceph-mon[27653]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi119:172.21.15.119=smithi119;smithi155:172.21.15.155=smithi155", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:37:02.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:02 smithi119 ceph-mon[27653]: Saving service mon spec with placement smithi119:172.21.15.119=smithi119;smithi155:172.21.15.155=smithi155;count:2 2024-09-13T21:37:02.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:02 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:02.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:02 smithi119 ceph-mon[27653]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:03.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.275+0000 7f6814d64640 1 -- 172.21.15.155:0/3672764138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68100fb0b0 msgr2=0x7f68100fb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:03.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.275+0000 7f6814d64640 1 --2- 172.21.15.155:0/3672764138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68100fb0b0 0x7f68100fb4c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6808009bd0 tx=0x7f6808004d10 comp rx=0 tx=0).stop 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.275+0000 7f6814d64640 1 -- 172.21.15.155:0/3672764138 shutdown_connections 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.275+0000 7f6814d64640 1 --2- 172.21.15.155:0/3672764138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68100fb0b0 0x7f68100fb4c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.275+0000 7f6814d64640 1 -- 172.21.15.155:0/3672764138 >> 172.21.15.155:0/3672764138 conn(0x7f68100f6850 msgr2=0x7f68100f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.275+0000 7f6814d64640 1 -- 172.21.15.155:0/3672764138 shutdown_connections 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.275+0000 7f6814d64640 1 -- 172.21.15.155:0/3672764138 wait complete. 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.276+0000 7f6814d64640 1 Processor -- start 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.276+0000 7f6814d64640 1 -- start start 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.276+0000 7f6814d64640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68100fb0b0 0x7f68100660a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.276+0000 7f6814d64640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681010d230 con 0x7f68100fb0b0 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.276+0000 7f680e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68100fb0b0 0x7f68100660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.276+0000 7f680e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68100fb0b0 0x7f68100660a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:60082/0 (socket says 172.21.15.155:60082) 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.276+0000 7f680e59c640 1 -- 172.21.15.155:0/1134289989 learned_addr learned my addr 172.21.15.155:0/1134289989 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:03.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.276+0000 7f680e59c640 1 -- 172.21.15.155:0/1134289989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68080098b0 con 0x7f68100fb0b0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.277+0000 7f680e59c640 1 --2- 172.21.15.155:0/1134289989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68100fb0b0 0x7f68100660a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6808003400 tx=0x7f6808004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.277+0000 7f6806ffd640 1 -- 172.21.15.155:0/1134289989 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6808032910 con 0x7f68100fb0b0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.277+0000 7f6806ffd640 1 -- 172.21.15.155:0/1134289989 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f680803d420 con 0x7f68100fb0b0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.277+0000 7f6814d64640 1 -- 172.21.15.155:0/1134289989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6810111840 con 0x7f68100fb0b0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.277+0000 7f6806ffd640 1 -- 172.21.15.155:0/1134289989 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6808031590 con 0x7f68100fb0b0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.277+0000 7f6814d64640 1 -- 172.21.15.155:0/1134289989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6810111bf0 con 0x7f68100fb0b0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.278+0000 7f6814d64640 1 -- 172.21.15.155:0/1134289989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681005ed70 con 0x7f68100fb0b0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.278+0000 7f6806ffd640 1 -- 172.21.15.155:0/1134289989 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f680802f030 con 0x7f68100fb0b0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.278+0000 7f6806ffd640 1 --2- 172.21.15.155:0/1134289989 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f67fc039580 0x7f67fc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.278+0000 7f6806ffd640 1 -- 172.21.15.155:0/1134289989 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f680806d6f0 con 0x7f68100fb0b0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.278+0000 7f680dd9b640 1 --2- 172.21.15.155:0/1134289989 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f67fc039580 0x7f67fc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.279+0000 7f680dd9b640 1 --2- 172.21.15.155:0/1134289989 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f67fc039580 0x7f67fc03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f67f8006fd0 tx=0x7f67f8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:03.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.283+0000 7f6806ffd640 1 -- 172.21.15.155:0/1134289989 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f680804e530 con 0x7f68100fb0b0 2024-09-13T21:37:03.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.494+0000 7f6814d64640 1 -- 172.21.15.155:0/1134289989 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f681004b720 con 0x7f68100fb0b0 2024-09-13T21:37:03.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.495+0000 7f6806ffd640 1 -- 172.21.15.155:0/1134289989 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f680804e350 con 0x7f68100fb0b0 2024-09-13T21:37:03.497 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:03.497 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:03.497 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:03.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.497+0000 7f6814d64640 1 -- 172.21.15.155:0/1134289989 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f67fc039580 msgr2=0x7f67fc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:03.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.497+0000 7f6814d64640 1 --2- 172.21.15.155:0/1134289989 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f67fc039580 0x7f67fc03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f67f8006fd0 tx=0x7f67f8006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:03.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.497+0000 7f6814d64640 1 -- 172.21.15.155:0/1134289989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68100fb0b0 msgr2=0x7f68100660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:03.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.497+0000 7f6814d64640 1 --2- 172.21.15.155:0/1134289989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68100fb0b0 0x7f68100660a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6808003400 tx=0x7f6808004d10 comp rx=0 tx=0).stop 2024-09-13T21:37:03.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.497+0000 7f6814d64640 1 -- 172.21.15.155:0/1134289989 shutdown_connections 2024-09-13T21:37:03.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.497+0000 7f6814d64640 1 --2- 172.21.15.155:0/1134289989 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f67fc039580 0x7f67fc03ba30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:03.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.497+0000 7f6814d64640 1 --2- 172.21.15.155:0/1134289989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68100fb0b0 0x7f68100660a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:03.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.497+0000 7f6814d64640 1 -- 172.21.15.155:0/1134289989 >> 172.21.15.155:0/1134289989 conn(0x7f68100f6850 msgr2=0x7f68100f7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:03.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.497+0000 7f6814d64640 1 -- 172.21.15.155:0/1134289989 shutdown_connections 2024-09-13T21:37:03.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:03.497+0000 7f6814d64640 1 -- 172.21.15.155:0/1134289989 wait complete. 2024-09-13T21:37:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:03 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:03 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:03 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:03 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:03 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:03 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:03 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T21:37:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:03 smithi119 ceph-mon[27653]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T21:37:03.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:03 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:03.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:03 smithi119 ceph-mon[27653]: Deploying daemon grafana.smithi119 on smithi119 2024-09-13T21:37:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:04 smithi119 ceph-mon[27653]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:04 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/1134289989' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:05.090 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:05.090 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:05.332 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:05.377 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:06.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.770+0000 7f69c7c62640 1 -- 172.21.15.155:0/2210519938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0104a20 msgr2=0x7f69c0104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:06.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.770+0000 7f69c7c62640 1 --2- 172.21.15.155:0/2210519938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0104a20 0x7f69c0104e30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69bc004850 tx=0x7f69bc009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:06.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.770+0000 7f69c7c62640 1 -- 172.21.15.155:0/2210519938 shutdown_connections 2024-09-13T21:37:06.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.770+0000 7f69c7c62640 1 --2- 172.21.15.155:0/2210519938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0104a20 0x7f69c0104e30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:06.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.770+0000 7f69c7c62640 1 -- 172.21.15.155:0/2210519938 >> 172.21.15.155:0/2210519938 conn(0x7f69c006b3b0 msgr2=0x7f69c006d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:06.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.770+0000 7f69c7c62640 1 -- 172.21.15.155:0/2210519938 shutdown_connections 2024-09-13T21:37:06.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.770+0000 7f69c7c62640 1 -- 172.21.15.155:0/2210519938 wait complete. 2024-09-13T21:37:06.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.771+0000 7f69c7c62640 1 Processor -- start 2024-09-13T21:37:06.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.771+0000 7f69c7c62640 1 -- start start 2024-09-13T21:37:06.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.771+0000 7f69c7c62640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0104a20 0x7f69c0068180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:06.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.771+0000 7f69c7c62640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c00686c0 con 0x7f69c0104a20 2024-09-13T21:37:06.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.771+0000 7f69c59fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0104a20 0x7f69c0068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:06.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.771+0000 7f69c59fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0104a20 0x7f69c0068180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:60094/0 (socket says 172.21.15.155:60094) 2024-09-13T21:37:06.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.771+0000 7f69c59fe640 1 -- 172.21.15.155:0/3038649969 learned_addr learned my addr 172.21.15.155:0/3038649969 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:06.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.772+0000 7f69c59fe640 1 -- 172.21.15.155:0/3038649969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc005040 con 0x7f69c0104a20 2024-09-13T21:37:06.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.772+0000 7f69c59fe640 1 --2- 172.21.15.155:0/3038649969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0104a20 0x7f69c0068180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69bc02a6d0 tx=0x7f69bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.772+0000 7f69b67fc640 1 -- 172.21.15.155:0/3038649969 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69bc033630 con 0x7f69c0104a20 2024-09-13T21:37:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.772+0000 7f69b67fc640 1 -- 172.21.15.155:0/3038649969 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f69bc033c30 con 0x7f69c0104a20 2024-09-13T21:37:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.772+0000 7f69c7c62640 1 -- 172.21.15.155:0/3038649969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c0066750 con 0x7f69c0104a20 2024-09-13T21:37:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.772+0000 7f69b67fc640 1 -- 172.21.15.155:0/3038649969 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69bc03dc30 con 0x7f69c0104a20 2024-09-13T21:37:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.772+0000 7f69c7c62640 1 -- 172.21.15.155:0/3038649969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c0066bc0 con 0x7f69c0104a20 2024-09-13T21:37:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.773+0000 7f69c7c62640 1 -- 172.21.15.155:0/3038649969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c010ade0 con 0x7f69c0104a20 2024-09-13T21:37:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.773+0000 7f69b67fc640 1 -- 172.21.15.155:0/3038649969 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f69bc030020 con 0x7f69c0104a20 2024-09-13T21:37:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.773+0000 7f69b67fc640 1 --2- 172.21.15.155:0/3038649969 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f69ac039580 0x7f69ac03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.773+0000 7f69b67fc640 1 -- 172.21.15.155:0/3038649969 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f69bc06ca00 con 0x7f69c0104a20 2024-09-13T21:37:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.773+0000 7f69c51fd640 1 --2- 172.21.15.155:0/3038649969 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f69ac039580 0x7f69ac03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.774+0000 7f69c51fd640 1 --2- 172.21.15.155:0/3038649969 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f69ac039580 0x7f69ac03ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f69b0006fd0 tx=0x7f69b0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:06.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.782+0000 7f69b67fc640 1 -- 172.21.15.155:0/3038649969 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f69bc033da0 con 0x7f69c0104a20 2024-09-13T21:37:06.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:06 smithi119 ceph-mon[27653]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:06.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:06 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:06.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.994+0000 7f69c7c62640 1 -- 172.21.15.155:0/3038649969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f69c005ed70 con 0x7f69c0104a20 2024-09-13T21:37:06.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.995+0000 7f69b67fc640 1 -- 172.21.15.155:0/3038649969 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f69bc03ba00 con 0x7f69c0104a20 2024-09-13T21:37:06.999 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:07.000 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:07.001 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:07.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.997+0000 7f69c7c62640 1 -- 172.21.15.155:0/3038649969 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f69ac039580 msgr2=0x7f69ac03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:07.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.997+0000 7f69c7c62640 1 --2- 172.21.15.155:0/3038649969 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f69ac039580 0x7f69ac03ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f69b0006fd0 tx=0x7f69b0006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:07.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.997+0000 7f69c7c62640 1 -- 172.21.15.155:0/3038649969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0104a20 msgr2=0x7f69c0068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:07.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.997+0000 7f69c7c62640 1 --2- 172.21.15.155:0/3038649969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0104a20 0x7f69c0068180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69bc02a6d0 tx=0x7f69bc009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:07.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.997+0000 7f69c7c62640 1 -- 172.21.15.155:0/3038649969 shutdown_connections 2024-09-13T21:37:07.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.997+0000 7f69c7c62640 1 --2- 172.21.15.155:0/3038649969 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f69ac039580 0x7f69ac03ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:07.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.997+0000 7f69c7c62640 1 --2- 172.21.15.155:0/3038649969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69c0104a20 0x7f69c0068180 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:07.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.997+0000 7f69c7c62640 1 -- 172.21.15.155:0/3038649969 >> 172.21.15.155:0/3038649969 conn(0x7f69c006b3b0 msgr2=0x7f69c006bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:07.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.997+0000 7f69c7c62640 1 -- 172.21.15.155:0/3038649969 shutdown_connections 2024-09-13T21:37:07.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:06.997+0000 7f69c7c62640 1 -- 172.21.15.155:0/3038649969 wait complete. 2024-09-13T21:37:07.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:07 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/3038649969' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:08.568 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:08.569 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:08.810 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:08.855 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:08.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:08 smithi119 ceph-mon[27653]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:10.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.316+0000 7f2e66eaf640 1 -- 172.21.15.155:0/152956790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e600fb0b0 msgr2=0x7f2e600fb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:10.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.316+0000 7f2e66eaf640 1 --2- 172.21.15.155:0/152956790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e600fb0b0 0x7f2e600fb4c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004850 tx=0x7f2e54009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:10.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.316+0000 7f2e66eaf640 1 -- 172.21.15.155:0/152956790 shutdown_connections 2024-09-13T21:37:10.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.316+0000 7f2e66eaf640 1 --2- 172.21.15.155:0/152956790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e600fb0b0 0x7f2e600fb4c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.316+0000 7f2e66eaf640 1 -- 172.21.15.155:0/152956790 >> 172.21.15.155:0/152956790 conn(0x7f2e600f6850 msgr2=0x7f2e600f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.316+0000 7f2e66eaf640 1 -- 172.21.15.155:0/152956790 shutdown_connections 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.316+0000 7f2e66eaf640 1 -- 172.21.15.155:0/152956790 wait complete. 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.316+0000 7f2e66eaf640 1 Processor -- start 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.316+0000 7f2e66eaf640 1 -- start start 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.317+0000 7f2e66eaf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e600fb0b0 0x7f2e600660a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.317+0000 7f2e66eaf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6010f440 con 0x7f2e600fb0b0 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.317+0000 7f2e64c4b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e600fb0b0 0x7f2e600660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.317+0000 7f2e64c4b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e600fb0b0 0x7f2e600660a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:55958/0 (socket says 172.21.15.155:55958) 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.317+0000 7f2e64c4b640 1 -- 172.21.15.155:0/1647117490 learned_addr learned my addr 172.21.15.155:0/1647117490 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.317+0000 7f2e64c4b640 1 -- 172.21.15.155:0/1647117490 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54005040 con 0x7f2e600fb0b0 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.317+0000 7f2e64c4b640 1 --2- 172.21.15.155:0/1647117490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e600fb0b0 0x7f2e600660a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2e5402a6d0 tx=0x7f2e54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:10.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.318+0000 7f2e5d7fa640 1 -- 172.21.15.155:0/1647117490 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e54033630 con 0x7f2e600fb0b0 2024-09-13T21:37:10.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.318+0000 7f2e5d7fa640 1 -- 172.21.15.155:0/1647117490 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2e54033c30 con 0x7f2e600fb0b0 2024-09-13T21:37:10.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.318+0000 7f2e66eaf640 1 -- 172.21.15.155:0/1647117490 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6010f580 con 0x7f2e600fb0b0 2024-09-13T21:37:10.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.318+0000 7f2e5d7fa640 1 -- 172.21.15.155:0/1647117490 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e5403dc00 con 0x7f2e600fb0b0 2024-09-13T21:37:10.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.318+0000 7f2e66eaf640 1 -- 172.21.15.155:0/1647117490 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6010f990 con 0x7f2e600fb0b0 2024-09-13T21:37:10.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.318+0000 7f2e66eaf640 1 -- 172.21.15.155:0/1647117490 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6005ed70 con 0x7f2e600fb0b0 2024-09-13T21:37:10.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.319+0000 7f2e5d7fa640 1 -- 172.21.15.155:0/1647117490 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f2e54030020 con 0x7f2e600fb0b0 2024-09-13T21:37:10.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.319+0000 7f2e5d7fa640 1 --2- 172.21.15.155:0/1647117490 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2e50039580 0x7f2e5003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:10.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.319+0000 7f2e5d7fa640 1 -- 172.21.15.155:0/1647117490 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2e5406cae0 con 0x7f2e600fb0b0 2024-09-13T21:37:10.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.319+0000 7f2e5ffff640 1 --2- 172.21.15.155:0/1647117490 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2e50039580 0x7f2e5003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:10.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.319+0000 7f2e5ffff640 1 --2- 172.21.15.155:0/1647117490 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2e50039580 0x7f2e5003ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c006fd0 tx=0x7f2e4c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:10.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.323+0000 7f2e5d7fa640 1 -- 172.21.15.155:0/1647117490 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2e54045800 con 0x7f2e600fb0b0 2024-09-13T21:37:10.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.539+0000 7f2e66eaf640 1 -- 172.21.15.155:0/1647117490 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2e6004b720 con 0x7f2e600fb0b0 2024-09-13T21:37:10.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.540+0000 7f2e5d7fa640 1 -- 172.21.15.155:0/1647117490 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2e54045800 con 0x7f2e600fb0b0 2024-09-13T21:37:10.542 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:10.542 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:10.543 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:10.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.542+0000 7f2e66eaf640 1 -- 172.21.15.155:0/1647117490 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2e50039580 msgr2=0x7f2e5003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:10.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.542+0000 7f2e66eaf640 1 --2- 172.21.15.155:0/1647117490 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2e50039580 0x7f2e5003ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c006fd0 tx=0x7f2e4c006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:10.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.542+0000 7f2e66eaf640 1 -- 172.21.15.155:0/1647117490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e600fb0b0 msgr2=0x7f2e600660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:10.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.542+0000 7f2e66eaf640 1 --2- 172.21.15.155:0/1647117490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e600fb0b0 0x7f2e600660a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2e5402a6d0 tx=0x7f2e54009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:10.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.542+0000 7f2e66eaf640 1 -- 172.21.15.155:0/1647117490 shutdown_connections 2024-09-13T21:37:10.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.542+0000 7f2e66eaf640 1 --2- 172.21.15.155:0/1647117490 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f2e50039580 0x7f2e5003ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:10.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.542+0000 7f2e66eaf640 1 --2- 172.21.15.155:0/1647117490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e600fb0b0 0x7f2e600660a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:10.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.542+0000 7f2e66eaf640 1 -- 172.21.15.155:0/1647117490 >> 172.21.15.155:0/1647117490 conn(0x7f2e600f6850 msgr2=0x7f2e600f7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:10.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.542+0000 7f2e66eaf640 1 -- 172.21.15.155:0/1647117490 shutdown_connections 2024-09-13T21:37:10.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:10.542+0000 7f2e66eaf640 1 -- 172.21.15.155:0/1647117490 wait complete. 2024-09-13T21:37:10.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:10 smithi119 ceph-mon[27653]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:11.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:11 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/1647117490' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:12.120 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:12.121 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:12.367 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:12.411 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:12.726 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:12 smithi119 ceph-mon[27653]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:13.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.734+0000 7fa4e2645640 1 -- 172.21.15.155:0/3205357694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4dc0fc1b0 msgr2=0x7fa4dc0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:13.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.735+0000 7fa4e2645640 1 --2- 172.21.15.155:0/3205357694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4dc0fc1b0 0x7fa4dc0fc5c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc004850 tx=0x7fa4cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:13.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.735+0000 7fa4e2645640 1 -- 172.21.15.155:0/3205357694 shutdown_connections 2024-09-13T21:37:13.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.735+0000 7fa4e2645640 1 --2- 172.21.15.155:0/3205357694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4dc0fc1b0 0x7fa4dc0fc5c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:13.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.735+0000 7fa4e2645640 1 -- 172.21.15.155:0/3205357694 >> 172.21.15.155:0/3205357694 conn(0x7fa4dc0f7990 msgr2=0x7fa4dc0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:13.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.735+0000 7fa4e2645640 1 -- 172.21.15.155:0/3205357694 shutdown_connections 2024-09-13T21:37:13.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.735+0000 7fa4e2645640 1 -- 172.21.15.155:0/3205357694 wait complete. 2024-09-13T21:37:13.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.735+0000 7fa4e2645640 1 Processor -- start 2024-09-13T21:37:13.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.735+0000 7fa4e2645640 1 -- start start 2024-09-13T21:37:13.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.736+0000 7fa4e2645640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4dc0fc1b0 0x7fa4dc10c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:13.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.736+0000 7fa4e2645640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc10cc30 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.736+0000 7fa4dbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4dc0fc1b0 0x7fa4dc10c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:13.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.736+0000 7fa4dbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4dc0fc1b0 0x7fa4dc10c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:55972/0 (socket says 172.21.15.155:55972) 2024-09-13T21:37:13.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.736+0000 7fa4dbfff640 1 -- 172.21.15.155:0/3369714316 learned_addr learned my addr 172.21.15.155:0/3369714316 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:13.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.736+0000 7fa4dbfff640 1 -- 172.21.15.155:0/3369714316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc005040 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.736+0000 7fa4dbfff640 1 --2- 172.21.15.155:0/3369714316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4dc0fc1b0 0x7fa4dc10c6f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc02a6d0 tx=0x7fa4cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:13.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.736+0000 7fa4d8ff9640 1 -- 172.21.15.155:0/3369714316 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4cc033630 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.736+0000 7fa4d8ff9640 1 -- 172.21.15.155:0/3369714316 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa4cc033c30 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.736+0000 7fa4e2645640 1 -- 172.21.15.155:0/3369714316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc10ce30 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.736+0000 7fa4d8ff9640 1 -- 172.21.15.155:0/3369714316 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4cc03dc00 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.737+0000 7fa4e2645640 1 -- 172.21.15.155:0/3369714316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc10d2a0 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.737+0000 7fa4d8ff9640 1 -- 172.21.15.155:0/3369714316 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fa4cc030020 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.738+0000 7fa4d8ff9640 1 --2- 172.21.15.155:0/3369714316 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fa4c40395d0 0x7fa4c403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:13.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.738+0000 7fa4e2645640 1 -- 172.21.15.155:0/3369714316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc10d2a0 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.738+0000 7fa4d8ff9640 1 -- 172.21.15.155:0/3369714316 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa4cc06c950 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.738+0000 7fa4db7fe640 1 --2- 172.21.15.155:0/3369714316 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fa4c40395d0 0x7fa4c403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:13.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.738+0000 7fa4db7fe640 1 --2- 172.21.15.155:0/3369714316 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fa4c40395d0 0x7fa4c403ba80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006fd0 tx=0x7fa4d0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:13.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.746+0000 7fa4d8ff9640 1 -- 172.21.15.155:0/3369714316 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa4dc10d2a0 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.961+0000 7fa4e2645640 1 -- 172.21.15.155:0/3369714316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa4dc05ed70 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.961+0000 7fa4d8ff9640 1 -- 172.21.15.155:0/3369714316 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa4cc03b730 con 0x7fa4dc0fc1b0 2024-09-13T21:37:13.964 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:13.964 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:13.965 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:13.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.963+0000 7fa4e2645640 1 -- 172.21.15.155:0/3369714316 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fa4c40395d0 msgr2=0x7fa4c403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:13.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.963+0000 7fa4e2645640 1 --2- 172.21.15.155:0/3369714316 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fa4c40395d0 0x7fa4c403ba80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006fd0 tx=0x7fa4d0006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:13.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.963+0000 7fa4e2645640 1 -- 172.21.15.155:0/3369714316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4dc0fc1b0 msgr2=0x7fa4dc10c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:13.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.963+0000 7fa4e2645640 1 --2- 172.21.15.155:0/3369714316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4dc0fc1b0 0x7fa4dc10c6f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc02a6d0 tx=0x7fa4cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:13.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.963+0000 7fa4e2645640 1 -- 172.21.15.155:0/3369714316 shutdown_connections 2024-09-13T21:37:13.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.963+0000 7fa4e2645640 1 --2- 172.21.15.155:0/3369714316 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fa4c40395d0 0x7fa4c403ba80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:13.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.963+0000 7fa4e2645640 1 --2- 172.21.15.155:0/3369714316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4dc0fc1b0 0x7fa4dc10c6f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:13.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.963+0000 7fa4e2645640 1 -- 172.21.15.155:0/3369714316 >> 172.21.15.155:0/3369714316 conn(0x7fa4dc0f7990 msgr2=0x7fa4dc0f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:13.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.964+0000 7fa4e2645640 1 -- 172.21.15.155:0/3369714316 shutdown_connections 2024-09-13T21:37:13.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:13.964+0000 7fa4e2645640 1 -- 172.21.15.155:0/3369714316 wait complete. 2024-09-13T21:37:14.523 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:14 smithi119 ceph-mon[27653]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:14.523 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:14 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/3369714316' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:15.531 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:15.531 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:15.605 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:15 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:15.606 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:15 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:15.606 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:15 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:15.606 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:15 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:15.606 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:15 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:15.606 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:15 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:15.606 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:15 smithi119 ceph-mon[27653]: Deploying daemon prometheus.smithi119 on smithi119 2024-09-13T21:37:15.777 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:15.821 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:16.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:16 smithi119 ceph-mon[27653]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:16.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:16 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:17.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.204+0000 7f129317c640 1 -- 172.21.15.155:0/134108403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f128c0fa850 msgr2=0x7f128c0fac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.204+0000 7f129317c640 1 --2- 172.21.15.155:0/134108403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f128c0fa850 0x7f128c0fac60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1280004850 tx=0x7f1280009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.204+0000 7f129317c640 1 -- 172.21.15.155:0/134108403 shutdown_connections 2024-09-13T21:37:17.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.204+0000 7f129317c640 1 --2- 172.21.15.155:0/134108403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f128c0fa850 0x7f128c0fac60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.204+0000 7f129317c640 1 -- 172.21.15.155:0/134108403 >> 172.21.15.155:0/134108403 conn(0x7f128c0f6010 msgr2=0x7f128c0f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.204+0000 7f129317c640 1 -- 172.21.15.155:0/134108403 shutdown_connections 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.204+0000 7f129317c640 1 -- 172.21.15.155:0/134108403 wait complete. 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.205+0000 7f129317c640 1 Processor -- start 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.205+0000 7f129317c640 1 -- start start 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.205+0000 7f129317c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f128c0fa850 0x7f128c0f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.205+0000 7f129317c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c10d2f0 con 0x7f128c0fa850 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.205+0000 7f1290f18640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f128c0fa850 0x7f128c0f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.206+0000 7f1290f18640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f128c0fa850 0x7f128c0f6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:55998/0 (socket says 172.21.15.155:55998) 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.206+0000 7f1290f18640 1 -- 172.21.15.155:0/3321439339 learned_addr learned my addr 172.21.15.155:0/3321439339 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.206+0000 7f1290f18640 1 -- 172.21.15.155:0/3321439339 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1280005040 con 0x7f128c0fa850 2024-09-13T21:37:17.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.206+0000 7f1290f18640 1 --2- 172.21.15.155:0/3321439339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f128c0fa850 0x7f128c0f6f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1280009920 tx=0x7f1280009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.206+0000 7f12897fa640 1 -- 172.21.15.155:0/3321439339 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1280033630 con 0x7f128c0fa850 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.206+0000 7f12897fa640 1 -- 172.21.15.155:0/3321439339 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1280033c30 con 0x7f128c0fa850 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.206+0000 7f129317c640 1 -- 172.21.15.155:0/3321439339 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c111900 con 0x7f128c0fa850 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.206+0000 7f12897fa640 1 -- 172.21.15.155:0/3321439339 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f128003dbb0 con 0x7f128c0fa850 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.206+0000 7f129317c640 1 -- 172.21.15.155:0/3321439339 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c111c30 con 0x7f128c0fa850 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.207+0000 7f12897fa640 1 -- 172.21.15.155:0/3321439339 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f1280030020 con 0x7f128c0fa850 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.207+0000 7f129317c640 1 -- 172.21.15.155:0/3321439339 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c05ed70 con 0x7f128c0fa850 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.207+0000 7f12897fa640 1 --2- 172.21.15.155:0/3321439339 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f127c039580 0x7f127c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.207+0000 7f12897fa640 1 -- 172.21.15.155:0/3321439339 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f128006cc90 con 0x7f128c0fa850 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.207+0000 7f128bfff640 1 --2- 172.21.15.155:0/3321439339 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f127c039580 0x7f127c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.208+0000 7f128bfff640 1 --2- 172.21.15.155:0/3321439339 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f127c039580 0x7f127c03ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1278006fd0 tx=0x7f1278006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.212+0000 7f12897fa640 1 -- 172.21.15.155:0/3321439339 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1280047440 con 0x7f128c0fa850 2024-09-13T21:37:17.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.427+0000 7f129317c640 1 -- 172.21.15.155:0/3321439339 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f128c02aa40 con 0x7f128c0fa850 2024-09-13T21:37:17.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.428+0000 7f12897fa640 1 -- 172.21.15.155:0/3321439339 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f128003b7e0 con 0x7f128c0fa850 2024-09-13T21:37:17.430 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:17.430 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:17.430 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:17.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.430+0000 7f129317c640 1 -- 172.21.15.155:0/3321439339 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f127c039580 msgr2=0x7f127c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.430+0000 7f129317c640 1 --2- 172.21.15.155:0/3321439339 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f127c039580 0x7f127c03ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1278006fd0 tx=0x7f1278006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.430+0000 7f129317c640 1 -- 172.21.15.155:0/3321439339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f128c0fa850 msgr2=0x7f128c0f6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.430+0000 7f129317c640 1 --2- 172.21.15.155:0/3321439339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f128c0fa850 0x7f128c0f6f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1280009920 tx=0x7f1280009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.430+0000 7f129317c640 1 -- 172.21.15.155:0/3321439339 shutdown_connections 2024-09-13T21:37:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.430+0000 7f129317c640 1 --2- 172.21.15.155:0/3321439339 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f127c039580 0x7f127c03ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.430+0000 7f129317c640 1 --2- 172.21.15.155:0/3321439339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f128c0fa850 0x7f128c0f6f20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.430+0000 7f129317c640 1 -- 172.21.15.155:0/3321439339 >> 172.21.15.155:0/3321439339 conn(0x7f128c0f6010 msgr2=0x7f128c0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.430+0000 7f129317c640 1 -- 172.21.15.155:0/3321439339 shutdown_connections 2024-09-13T21:37:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:17.430+0000 7f129317c640 1 -- 172.21.15.155:0/3321439339 wait complete. 2024-09-13T21:37:17.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:17 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/3321439339' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:18.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:18 smithi119 ceph-mon[27653]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:19.060 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:19.060 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:19.305 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:19.366 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:20.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.732+0000 7f36db904640 1 -- 172.21.15.155:0/11592239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36d40fc1d0 msgr2=0x7f36d40fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:20.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.732+0000 7f36db904640 1 --2- 172.21.15.155:0/11592239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36d40fc1d0 0x7f36d40fc5e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f36d0004850 tx=0x7f36d0009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:20.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.732+0000 7f36db904640 1 -- 172.21.15.155:0/11592239 shutdown_connections 2024-09-13T21:37:20.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.732+0000 7f36db904640 1 --2- 172.21.15.155:0/11592239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36d40fc1d0 0x7f36d40fc5e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.732+0000 7f36db904640 1 -- 172.21.15.155:0/11592239 >> 172.21.15.155:0/11592239 conn(0x7f36d40f79b0 msgr2=0x7f36d40f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.732+0000 7f36db904640 1 -- 172.21.15.155:0/11592239 shutdown_connections 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.732+0000 7f36db904640 1 -- 172.21.15.155:0/11592239 wait complete. 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.733+0000 7f36db904640 1 Processor -- start 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.733+0000 7f36db904640 1 -- start start 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.733+0000 7f36db904640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36d40fc1d0 0x7f36d410c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.733+0000 7f36db904640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d410cc10 con 0x7f36d40fc1d0 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.733+0000 7f36d96a0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36d40fc1d0 0x7f36d410c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.733+0000 7f36d96a0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36d40fc1d0 0x7f36d410c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:38364/0 (socket says 172.21.15.155:38364) 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.733+0000 7f36d96a0640 1 -- 172.21.15.155:0/3568447048 learned_addr learned my addr 172.21.15.155:0/3568447048 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.733+0000 7f36d96a0640 1 -- 172.21.15.155:0/3568447048 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0005040 con 0x7f36d40fc1d0 2024-09-13T21:37:20.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.734+0000 7f36d96a0640 1 --2- 172.21.15.155:0/3568447048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36d40fc1d0 0x7f36d410c6d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36d002a6d0 tx=0x7f36d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.734+0000 7f36c9ffb640 1 -- 172.21.15.155:0/3568447048 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36d0033630 con 0x7f36d40fc1d0 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.734+0000 7f36db904640 1 -- 172.21.15.155:0/3568447048 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d410ce10 con 0x7f36d40fc1d0 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.734+0000 7f36db904640 1 -- 172.21.15.155:0/3568447048 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d410d280 con 0x7f36d40fc1d0 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.734+0000 7f36c9ffb640 1 -- 172.21.15.155:0/3568447048 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f36d0033c30 con 0x7f36d40fc1d0 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.734+0000 7f36c9ffb640 1 -- 172.21.15.155:0/3568447048 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36d003da10 con 0x7f36d40fc1d0 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.735+0000 7f36c9ffb640 1 -- 172.21.15.155:0/3568447048 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f36d0030020 con 0x7f36d40fc1d0 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.735+0000 7f36db904640 1 -- 172.21.15.155:0/3568447048 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b8005240 con 0x7f36d40fc1d0 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.735+0000 7f36c9ffb640 1 --2- 172.21.15.155:0/3568447048 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f36c0039580 0x7f36c003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.735+0000 7f36c9ffb640 1 -- 172.21.15.155:0/3568447048 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f36d006cb90 con 0x7f36d40fc1d0 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.735+0000 7f36d8e9f640 1 --2- 172.21.15.155:0/3568447048 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f36c0039580 0x7f36c003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.736+0000 7f36d8e9f640 1 --2- 172.21.15.155:0/3568447048 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f36c0039580 0x7f36c003ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f36c4006fd0 tx=0x7f36c4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:20.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.740+0000 7f36c9ffb640 1 -- 172.21.15.155:0/3568447048 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f36d00446f0 con 0x7f36d40fc1d0 2024-09-13T21:37:20.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:20 smithi119 ceph-mon[27653]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:20.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.953+0000 7f36db904640 1 -- 172.21.15.155:0/3568447048 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f36b80054f0 con 0x7f36d40fc1d0 2024-09-13T21:37:20.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.953+0000 7f36c9ffb640 1 -- 172.21.15.155:0/3568447048 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f36d003bcf0 con 0x7f36d40fc1d0 2024-09-13T21:37:20.956 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:20.956 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:20.956 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:20.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.955+0000 7f36db904640 1 -- 172.21.15.155:0/3568447048 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f36c0039580 msgr2=0x7f36c003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:20.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.955+0000 7f36db904640 1 --2- 172.21.15.155:0/3568447048 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f36c0039580 0x7f36c003ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f36c4006fd0 tx=0x7f36c4006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:20.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.955+0000 7f36db904640 1 -- 172.21.15.155:0/3568447048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36d40fc1d0 msgr2=0x7f36d410c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:20.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.955+0000 7f36db904640 1 --2- 172.21.15.155:0/3568447048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36d40fc1d0 0x7f36d410c6d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f36d002a6d0 tx=0x7f36d0009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:20.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.955+0000 7f36db904640 1 -- 172.21.15.155:0/3568447048 shutdown_connections 2024-09-13T21:37:20.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.955+0000 7f36db904640 1 --2- 172.21.15.155:0/3568447048 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7f36c0039580 0x7f36c003ba30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:20.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.955+0000 7f36db904640 1 --2- 172.21.15.155:0/3568447048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36d40fc1d0 0x7f36d410c6d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:20.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.955+0000 7f36db904640 1 -- 172.21.15.155:0/3568447048 >> 172.21.15.155:0/3568447048 conn(0x7f36d40f79b0 msgr2=0x7f36d40f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:20.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.955+0000 7f36db904640 1 -- 172.21.15.155:0/3568447048 shutdown_connections 2024-09-13T21:37:20.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:20.955+0000 7f36db904640 1 -- 172.21.15.155:0/3568447048 wait complete. 2024-09-13T21:37:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:21 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/3568447048' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:22.530 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:22.530 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:22.767 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:22.813 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:22.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:22 smithi119 ceph-mon[27653]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:24.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.296+0000 7fe35a9c1640 1 -- 172.21.15.155:0/2071098655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3540fb2e0 msgr2=0x7fe3540fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:24.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.296+0000 7fe35a9c1640 1 --2- 172.21.15.155:0/2071098655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3540fb2e0 0x7fe3540fb6f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe344004850 tx=0x7fe344009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:24.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.296+0000 7fe35a9c1640 1 -- 172.21.15.155:0/2071098655 shutdown_connections 2024-09-13T21:37:24.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.296+0000 7fe35a9c1640 1 --2- 172.21.15.155:0/2071098655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3540fb2e0 0x7fe3540fb6f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:24.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.296+0000 7fe35a9c1640 1 -- 172.21.15.155:0/2071098655 >> 172.21.15.155:0/2071098655 conn(0x7fe3540f6ac0 msgr2=0x7fe3540f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:24.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.296+0000 7fe35a9c1640 1 -- 172.21.15.155:0/2071098655 shutdown_connections 2024-09-13T21:37:24.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.296+0000 7fe35a9c1640 1 -- 172.21.15.155:0/2071098655 wait complete. 2024-09-13T21:37:24.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.297+0000 7fe35a9c1640 1 Processor -- start 2024-09-13T21:37:24.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.297+0000 7fe35a9c1640 1 -- start start 2024-09-13T21:37:24.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.297+0000 7fe35a9c1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3540fb2e0 0x7fe3540654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:24.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.297+0000 7fe35a9c1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35410f660 con 0x7fe3540fb2e0 2024-09-13T21:37:24.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.297+0000 7fe353fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3540fb2e0 0x7fe3540654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:24.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.297+0000 7fe353fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3540fb2e0 0x7fe3540654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:38392/0 (socket says 172.21.15.155:38392) 2024-09-13T21:37:24.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.297+0000 7fe353fff640 1 -- 172.21.15.155:0/4242016868 learned_addr learned my addr 172.21.15.155:0/4242016868 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:24.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.298+0000 7fe353fff640 1 -- 172.21.15.155:0/4242016868 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe344005040 con 0x7fe3540fb2e0 2024-09-13T21:37:24.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.298+0000 7fe353fff640 1 --2- 172.21.15.155:0/4242016868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3540fb2e0 0x7fe3540654d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe344009920 tx=0x7fe344009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:24.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.298+0000 7fe350ff9640 1 -- 172.21.15.155:0/4242016868 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe344033630 con 0x7fe3540fb2e0 2024-09-13T21:37:24.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.298+0000 7fe35a9c1640 1 -- 172.21.15.155:0/4242016868 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35410f7a0 con 0x7fe3540fb2e0 2024-09-13T21:37:24.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.298+0000 7fe350ff9640 1 -- 172.21.15.155:0/4242016868 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe344033c30 con 0x7fe3540fb2e0 2024-09-13T21:37:24.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.298+0000 7fe350ff9640 1 -- 172.21.15.155:0/4242016868 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe34403dc40 con 0x7fe3540fb2e0 2024-09-13T21:37:24.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.298+0000 7fe35a9c1640 1 -- 172.21.15.155:0/4242016868 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35410fbb0 con 0x7fe3540fb2e0 2024-09-13T21:37:24.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.299+0000 7fe350ff9640 1 -- 172.21.15.155:0/4242016868 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fe344030020 con 0x7fe3540fb2e0 2024-09-13T21:37:24.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.299+0000 7fe35a9c1640 1 -- 172.21.15.155:0/4242016868 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35405ed70 con 0x7fe3540fb2e0 2024-09-13T21:37:24.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.299+0000 7fe350ff9640 1 --2- 172.21.15.155:0/4242016868 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe33c039580 0x7fe33c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:24.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.299+0000 7fe350ff9640 1 -- 172.21.15.155:0/4242016868 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe34406cb70 con 0x7fe3540fb2e0 2024-09-13T21:37:24.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.299+0000 7fe3537fe640 1 --2- 172.21.15.155:0/4242016868 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe33c039580 0x7fe33c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:24.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.300+0000 7fe3537fe640 1 --2- 172.21.15.155:0/4242016868 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe33c039580 0x7fe33c03ba30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe348006fd0 tx=0x7fe348006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:24.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.304+0000 7fe350ff9640 1 -- 172.21.15.155:0/4242016868 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe34403b370 con 0x7fe3540fb2e0 2024-09-13T21:37:24.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.520+0000 7fe35a9c1640 1 -- 172.21.15.155:0/4242016868 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe35404b720 con 0x7fe3540fb2e0 2024-09-13T21:37:24.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.520+0000 7fe350ff9640 1 -- 172.21.15.155:0/4242016868 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fe34403b370 con 0x7fe3540fb2e0 2024-09-13T21:37:24.522 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:24.522 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:24.522 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:24.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.522+0000 7fe35a9c1640 1 -- 172.21.15.155:0/4242016868 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe33c039580 msgr2=0x7fe33c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:24.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.522+0000 7fe35a9c1640 1 --2- 172.21.15.155:0/4242016868 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe33c039580 0x7fe33c03ba30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe348006fd0 tx=0x7fe348006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:24.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.522+0000 7fe35a9c1640 1 -- 172.21.15.155:0/4242016868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3540fb2e0 msgr2=0x7fe3540654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:24.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.522+0000 7fe35a9c1640 1 --2- 172.21.15.155:0/4242016868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3540fb2e0 0x7fe3540654d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe344009920 tx=0x7fe344009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:24.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.523+0000 7fe35a9c1640 1 -- 172.21.15.155:0/4242016868 shutdown_connections 2024-09-13T21:37:24.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.523+0000 7fe35a9c1640 1 --2- 172.21.15.155:0/4242016868 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fe33c039580 0x7fe33c03ba30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:24.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.523+0000 7fe35a9c1640 1 --2- 172.21.15.155:0/4242016868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3540fb2e0 0x7fe3540654d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:24.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.523+0000 7fe35a9c1640 1 -- 172.21.15.155:0/4242016868 >> 172.21.15.155:0/4242016868 conn(0x7fe3540f6ac0 msgr2=0x7fe3540f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:24.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.523+0000 7fe35a9c1640 1 -- 172.21.15.155:0/4242016868 shutdown_connections 2024-09-13T21:37:24.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:24.523+0000 7fe35a9c1640 1 -- 172.21.15.155:0/4242016868 wait complete. 2024-09-13T21:37:24.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:24 smithi119 ceph-mon[27653]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:24.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:24 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:24.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:24 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:24.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:24 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:24.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:24 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T21:37:24.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:24 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/4242016868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:26.083 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:26.083 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:26.320 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:26.365 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:26.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:26 smithi119 ceph-mon[27653]: from='mgr.14160 172.21.15.119:0/3037840780' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T21:37:26.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:26 smithi119 ceph-mon[27653]: mgrmap e14: smithi119.gwjxmq(active, since 54s) 2024-09-13T21:37:27.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.905+0000 7fbdeb51e640 1 -- 172.21.15.155:0/344159452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde40fc1d0 msgr2=0x7fbde40fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.905+0000 7fbdeb51e640 1 --2- 172.21.15.155:0/344159452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde40fc1d0 0x7fbde40fc5e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbde0004850 tx=0x7fbde0009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.905+0000 7fbdeb51e640 1 -- 172.21.15.155:0/344159452 shutdown_connections 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.905+0000 7fbdeb51e640 1 --2- 172.21.15.155:0/344159452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde40fc1d0 0x7fbde40fc5e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.905+0000 7fbdeb51e640 1 -- 172.21.15.155:0/344159452 >> 172.21.15.155:0/344159452 conn(0x7fbde40f79b0 msgr2=0x7fbde40f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.906+0000 7fbdeb51e640 1 -- 172.21.15.155:0/344159452 shutdown_connections 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.906+0000 7fbdeb51e640 1 -- 172.21.15.155:0/344159452 wait complete. 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.906+0000 7fbdeb51e640 1 Processor -- start 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.906+0000 7fbdeb51e640 1 -- start start 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.906+0000 7fbdeb51e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde40fc1d0 0x7fbde4071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.906+0000 7fbdeb51e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40719d0 con 0x7fbde40fc1d0 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.906+0000 7fbde92ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde40fc1d0 0x7fbde4071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:27.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.906+0000 7fbde92ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde40fc1d0 0x7fbde4071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:38410/0 (socket says 172.21.15.155:38410) 2024-09-13T21:37:27.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.906+0000 7fbde92ba640 1 -- 172.21.15.155:0/1700929211 learned_addr learned my addr 172.21.15.155:0/1700929211 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:27.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.907+0000 7fbde92ba640 1 -- 172.21.15.155:0/1700929211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde0005040 con 0x7fbde40fc1d0 2024-09-13T21:37:27.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.907+0000 7fbde92ba640 1 --2- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde40fc1d0 0x7fbde4071490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbde002a6d0 tx=0x7fbde0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:27.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.907+0000 7fbdd9ffb640 1 -- 172.21.15.155:0/1700929211 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbde0033630 con 0x7fbde40fc1d0 2024-09-13T21:37:27.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.907+0000 7fbdeb51e640 1 -- 172.21.15.155:0/1700929211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde406fa60 con 0x7fbde40fc1d0 2024-09-13T21:37:27.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.907+0000 7fbdd9ffb640 1 -- 172.21.15.155:0/1700929211 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbde0033c30 con 0x7fbde40fc1d0 2024-09-13T21:37:27.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.907+0000 7fbdd9ffb640 1 -- 172.21.15.155:0/1700929211 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbde003dc00 con 0x7fbde40fc1d0 2024-09-13T21:37:27.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.907+0000 7fbdeb51e640 1 -- 172.21.15.155:0/1700929211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde406fed0 con 0x7fbde40fc1d0 2024-09-13T21:37:27.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.908+0000 7fbdd9ffb640 1 -- 172.21.15.155:0/1700929211 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 14) v1 ==== 45578+0+0 (secure 0 0 0) 0x7fbde0030020 con 0x7fbde40fc1d0 2024-09-13T21:37:27.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.908+0000 7fbdeb51e640 1 -- 172.21.15.155:0/1700929211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde41025f0 con 0x7fbde40fc1d0 2024-09-13T21:37:27.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.908+0000 7fbdd9ffb640 1 --2- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fbdd00395d0 0x7fbdd003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:27.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.908+0000 7fbdd9ffb640 1 -- 172.21.15.155:0/1700929211 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbde006cb20 con 0x7fbde40fc1d0 2024-09-13T21:37:27.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.908+0000 7fbde8ab9640 1 -- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fbdd00395d0 msgr2=0x7fbdd003ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/1188851329 2024-09-13T21:37:27.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.908+0000 7fbde8ab9640 1 --2- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fbdd00395d0 0x7fbdd003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:37:27.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:27.913+0000 7fbdd9ffb640 1 -- 172.21.15.155:0/1700929211 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbde0045800 con 0x7fbde40fc1d0 2024-09-13T21:37:28.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.109+0000 7fbde8ab9640 1 -- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fbdd00395d0 msgr2=0x7fbdd003ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6800/1188851329 2024-09-13T21:37:28.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.109+0000 7fbde8ab9640 1 --2- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fbdd00395d0 0x7fbdd003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T21:37:28.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.127+0000 7fbdeb51e640 1 -- 172.21.15.155:0/1700929211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbde405ed70 con 0x7fbde40fc1d0 2024-09-13T21:37:28.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.127+0000 7fbdd9ffb640 1 -- 172.21.15.155:0/1700929211 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fbde0045800 con 0x7fbde40fc1d0 2024-09-13T21:37:28.129 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:28.129 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:28.129 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:28.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.129+0000 7fbdeb51e640 1 -- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fbdd00395d0 msgr2=0x7fbdd003ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:37:28.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.129+0000 7fbdeb51e640 1 --2- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fbdd00395d0 0x7fbdd003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:28.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.129+0000 7fbdeb51e640 1 -- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde40fc1d0 msgr2=0x7fbde4071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:28.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.129+0000 7fbdeb51e640 1 --2- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde40fc1d0 0x7fbde4071490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbde002a6d0 tx=0x7fbde0009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:28.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.129+0000 7fbdeb51e640 1 -- 172.21.15.155:0/1700929211 shutdown_connections 2024-09-13T21:37:28.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.129+0000 7fbdeb51e640 1 --2- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:6800/1188851329,v1:172.21.15.119:6801/1188851329] conn(0x7fbdd00395d0 0x7fbdd003ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:28.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.129+0000 7fbdeb51e640 1 --2- 172.21.15.155:0/1700929211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbde40fc1d0 0x7fbde4071490 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:28.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.129+0000 7fbdeb51e640 1 -- 172.21.15.155:0/1700929211 >> 172.21.15.155:0/1700929211 conn(0x7fbde40f79b0 msgr2=0x7fbde40f8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:28.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.129+0000 7fbdeb51e640 1 -- 172.21.15.155:0/1700929211 shutdown_connections 2024-09-13T21:37:28.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:28.129+0000 7fbdeb51e640 1 -- 172.21.15.155:0/1700929211 wait complete. 2024-09-13T21:37:28.465 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:28 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/1700929211' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:29.692 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:29.693 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:29.929 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:29.947 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: Active manager daemon smithi119.gwjxmq restarted 2024-09-13T21:37:29.947 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: Activating manager daemon smithi119.gwjxmq 2024-09-13T21:37:29.947 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T21:37:29.947 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: mgrmap e15: smithi119.gwjxmq(active, starting, since 0.00649161s) 2024-09-13T21:37:29.947 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:37:29.947 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi119.gwjxmq", "id": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:37:29.947 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:37:29.947 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:37:29.947 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:37:29.947 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: Manager daemon smithi119.gwjxmq is now available 2024-09-13T21:37:29.948 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:37:29.948 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:29.948 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:37:29.948 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:37:29.975 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:30.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/trash_purge_schedule"}]: dispatch 2024-09-13T21:37:30.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:30 smithi119 ceph-mon[27653]: mgrmap e16: smithi119.gwjxmq(active, since 1.00841s) 2024-09-13T21:37:31.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.512+0000 7f4673b0d640 1 -- 172.21.15.155:0/2562517575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f466c065650 msgr2=0x7f466c0feff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.512+0000 7f4673b0d640 1 --2- 172.21.15.155:0/2562517575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f466c065650 0x7f466c0feff0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4668004850 tx=0x7f4668009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.512+0000 7f4673b0d640 1 -- 172.21.15.155:0/2562517575 shutdown_connections 2024-09-13T21:37:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.512+0000 7f4673b0d640 1 --2- 172.21.15.155:0/2562517575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f466c065650 0x7f466c0feff0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.512+0000 7f4673b0d640 1 -- 172.21.15.155:0/2562517575 >> 172.21.15.155:0/2562517575 conn(0x7f466c0f6ac0 msgr2=0x7f466c0f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.512+0000 7f4673b0d640 1 -- 172.21.15.155:0/2562517575 shutdown_connections 2024-09-13T21:37:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.512+0000 7f4673b0d640 1 -- 172.21.15.155:0/2562517575 wait complete. 2024-09-13T21:37:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.513+0000 7f4673b0d640 1 Processor -- start 2024-09-13T21:37:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.513+0000 7f4673b0d640 1 -- start start 2024-09-13T21:37:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.513+0000 7f4673b0d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f466c065650 0x7f466c10c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.513+0000 7f4673b0d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c10ce80 con 0x7f466c065650 2024-09-13T21:37:31.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.513+0000 7f46718a9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f466c065650 0x7f466c10c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.513+0000 7f46718a9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f466c065650 0x7f466c10c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:51930/0 (socket says 172.21.15.155:51930) 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.513+0000 7f46718a9640 1 -- 172.21.15.155:0/713516488 learned_addr learned my addr 172.21.15.155:0/713516488 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.513+0000 7f46718a9640 1 -- 172.21.15.155:0/713516488 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4668005040 con 0x7f466c065650 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.514+0000 7f46718a9640 1 --2- 172.21.15.155:0/713516488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f466c065650 0x7f466c10c940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f466802a6d0 tx=0x7f4668009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.514+0000 7f46627fc640 1 -- 172.21.15.155:0/713516488 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4668033630 con 0x7f466c065650 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.514+0000 7f46627fc640 1 -- 172.21.15.155:0/713516488 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4668033c30 con 0x7f466c065650 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.514+0000 7f46627fc640 1 -- 172.21.15.155:0/713516488 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f466803dc30 con 0x7f466c065650 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.514+0000 7f4673b0d640 1 -- 172.21.15.155:0/713516488 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c10d080 con 0x7f466c065650 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.514+0000 7f4673b0d640 1 -- 172.21.15.155:0/713516488 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c10d4f0 con 0x7f466c065650 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.515+0000 7f46627fc640 1 -- 172.21.15.155:0/713516488 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 16) v1 ==== 45428+0+0 (secure 0 0 0) 0x7f4668030020 con 0x7f466c065650 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.515+0000 7f4673b0d640 1 -- 172.21.15.155:0/713516488 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466c05ed70 con 0x7f466c065650 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.515+0000 7f46627fc640 1 --2- 172.21.15.155:0/713516488 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4658039420 0x7f465803b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:31.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.515+0000 7f46627fc640 1 -- 172.21.15.155:0/713516488 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f466806c6a0 con 0x7f466c065650 2024-09-13T21:37:31.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.515+0000 7f46710a8640 1 --2- 172.21.15.155:0/713516488 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4658039420 0x7f465803b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:31.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.516+0000 7f46710a8640 1 --2- 172.21.15.155:0/713516488 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4658039420 0x7f465803b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f465c006fd0 tx=0x7f465c006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:31.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.520+0000 7f46627fc640 1 -- 172.21.15.155:0/713516488 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4668045800 con 0x7f466c065650 2024-09-13T21:37:31.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.747+0000 7f4673b0d640 1 -- 172.21.15.155:0/713516488 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f466c04b720 con 0x7f466c065650 2024-09-13T21:37:31.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.747+0000 7f46627fc640 1 -- 172.21.15.155:0/713516488 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4668045800 con 0x7f466c065650 2024-09-13T21:37:31.749 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:31.749 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:31.749 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:31.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.749+0000 7f4673b0d640 1 -- 172.21.15.155:0/713516488 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4658039420 msgr2=0x7f465803b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:31.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.749+0000 7f4673b0d640 1 --2- 172.21.15.155:0/713516488 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4658039420 0x7f465803b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f465c006fd0 tx=0x7f465c006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.749+0000 7f4673b0d640 1 -- 172.21.15.155:0/713516488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f466c065650 msgr2=0x7f466c10c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:31.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.749+0000 7f4673b0d640 1 --2- 172.21.15.155:0/713516488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f466c065650 0x7f466c10c940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f466802a6d0 tx=0x7f4668009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.749+0000 7f4673b0d640 1 -- 172.21.15.155:0/713516488 shutdown_connections 2024-09-13T21:37:31.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.749+0000 7f4673b0d640 1 --2- 172.21.15.155:0/713516488 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4658039420 0x7f465803b8d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.749+0000 7f4673b0d640 1 --2- 172.21.15.155:0/713516488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f466c065650 0x7f466c10c940 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:31.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.749+0000 7f4673b0d640 1 -- 172.21.15.155:0/713516488 >> 172.21.15.155:0/713516488 conn(0x7f466c0f6ac0 msgr2=0x7f466c0f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:31.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.749+0000 7f4673b0d640 1 -- 172.21.15.155:0/713516488 shutdown_connections 2024-09-13T21:37:31.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:31.749+0000 7f4673b0d640 1 -- 172.21.15.155:0/713516488 wait complete. 2024-09-13T21:37:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:31 smithi119 ceph-mon[27653]: [13/Sep/2024:21:37:30] ENGINE Bus STARTING 2024-09-13T21:37:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:31 smithi119 ceph-mon[27653]: [13/Sep/2024:21:37:30] ENGINE Serving on https://172.21.15.119:7150 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:31 smithi119 ceph-mon[27653]: [13/Sep/2024:21:37:30] ENGINE Bus STARTED 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:31 smithi119 ceph-mon[27653]: [13/Sep/2024:21:37:30] ENGINE Error in HTTPServer.serve 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Traceback (most recent call last): 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._run(expiration_interval) 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s = self.context.wrap_socket( 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:37:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: return self.sslsocket_class._create( 2024-09-13T21:37:32.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:37:32.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self.do_handshake() 2024-09-13T21:37:32.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:37:32.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._sslobj.do_handshake() 2024-09-13T21:37:32.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:37:32.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:32.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:32.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:33.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:32 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/713516488' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:33.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:32 smithi119 ceph-mon[27653]: mgrmap e17: smithi119.gwjxmq(active, since 2s) 2024-09-13T21:37:33.387 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:33.388 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:33.818 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:33.869 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T21:37:35.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:35 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:35.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:35 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:35.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:35 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:35.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:35 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:35.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:35 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:37:36.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.231+0000 7faf5c53f640 1 -- 172.21.15.155:0/1154929958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf541010e0 msgr2=0x7faf541014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:36.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.231+0000 7faf5c53f640 1 --2- 172.21.15.155:0/1154929958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf541010e0 0x7faf541014b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faf50004850 tx=0x7faf50009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.231+0000 7faf5c53f640 1 -- 172.21.15.155:0/1154929958 shutdown_connections 2024-09-13T21:37:36.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.231+0000 7faf5c53f640 1 --2- 172.21.15.155:0/1154929958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf541010e0 0x7faf541014b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.231+0000 7faf5c53f640 1 -- 172.21.15.155:0/1154929958 >> 172.21.15.155:0/1154929958 conn(0x7faf540710b0 msgr2=0x7faf540714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:36.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.231+0000 7faf5c53f640 1 -- 172.21.15.155:0/1154929958 shutdown_connections 2024-09-13T21:37:36.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.231+0000 7faf5c53f640 1 -- 172.21.15.155:0/1154929958 wait complete. 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.231+0000 7faf5c53f640 1 Processor -- start 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.232+0000 7faf5c53f640 1 -- start start 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.232+0000 7faf5c53f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf541010e0 0x7faf5410d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.232+0000 7faf5c53f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5410dcf0 con 0x7faf541010e0 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.232+0000 7faf5a2db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf541010e0 0x7faf5410d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.232+0000 7faf5a2db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf541010e0 0x7faf5410d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:51944/0 (socket says 172.21.15.155:51944) 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.232+0000 7faf5a2db640 1 -- 172.21.15.155:0/2282083968 learned_addr learned my addr 172.21.15.155:0/2282083968 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.232+0000 7faf5a2db640 1 -- 172.21.15.155:0/2282083968 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50005040 con 0x7faf541010e0 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.232+0000 7faf5a2db640 1 --2- 172.21.15.155:0/2282083968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf541010e0 0x7faf5410d7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf5002a6d0 tx=0x7faf50009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.232+0000 7faf4affd640 1 -- 172.21.15.155:0/2282083968 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf5002cf10 con 0x7faf541010e0 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.233+0000 7faf4affd640 1 -- 172.21.15.155:0/2282083968 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faf50033ad0 con 0x7faf541010e0 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.233+0000 7faf5c53f640 1 -- 172.21.15.155:0/2282083968 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5410def0 con 0x7faf541010e0 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.233+0000 7faf4affd640 1 -- 172.21.15.155:0/2282083968 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf5003ebb0 con 0x7faf541010e0 2024-09-13T21:37:36.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.233+0000 7faf5c53f640 1 -- 172.21.15.155:0/2282083968 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5410e340 con 0x7faf541010e0 2024-09-13T21:37:36.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.233+0000 7faf4affd640 1 -- 172.21.15.155:0/2282083968 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7faf50030020 con 0x7faf541010e0 2024-09-13T21:37:36.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.234+0000 7faf5c53f640 1 -- 172.21.15.155:0/2282083968 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf540fc850 con 0x7faf541010e0 2024-09-13T21:37:36.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.234+0000 7faf4affd640 1 --2- 172.21.15.155:0/2282083968 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7faf40039670 0x7faf4003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:36.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.234+0000 7faf4affd640 1 -- 172.21.15.155:0/2282083968 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7faf5006d750 con 0x7faf541010e0 2024-09-13T21:37:36.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.234+0000 7faf59ada640 1 --2- 172.21.15.155:0/2282083968 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7faf40039670 0x7faf4003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:36.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.234+0000 7faf59ada640 1 --2- 172.21.15.155:0/2282083968 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7faf40039670 0x7faf4003bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faf44006fd0 tx=0x7faf44006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:36.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.238+0000 7faf4affd640 1 -- 172.21.15.155:0/2282083968 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faf500475d0 con 0x7faf541010e0 2024-09-13T21:37:36.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.485+0000 7faf5c53f640 1 -- 172.21.15.155:0/2282083968 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faf5405ed70 con 0x7faf541010e0 2024-09-13T21:37:36.486 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.485+0000 7faf4affd640 1 -- 172.21.15.155:0/2282083968 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7faf5003c330 con 0x7faf541010e0 2024-09-13T21:37:36.487 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:36.487 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:36.487 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:36.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.487+0000 7faf5c53f640 1 -- 172.21.15.155:0/2282083968 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7faf40039670 msgr2=0x7faf4003bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:36.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.487+0000 7faf5c53f640 1 --2- 172.21.15.155:0/2282083968 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7faf40039670 0x7faf4003bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faf44006fd0 tx=0x7faf44006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.487+0000 7faf5c53f640 1 -- 172.21.15.155:0/2282083968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf541010e0 msgr2=0x7faf5410d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:36.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.487+0000 7faf5c53f640 1 --2- 172.21.15.155:0/2282083968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf541010e0 0x7faf5410d7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf5002a6d0 tx=0x7faf50009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.488+0000 7faf5c53f640 1 -- 172.21.15.155:0/2282083968 shutdown_connections 2024-09-13T21:37:36.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.488+0000 7faf5c53f640 1 --2- 172.21.15.155:0/2282083968 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7faf40039670 0x7faf4003bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.488+0000 7faf5c53f640 1 --2- 172.21.15.155:0/2282083968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf541010e0 0x7faf5410d7b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:36.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.488+0000 7faf5c53f640 1 -- 172.21.15.155:0/2282083968 >> 172.21.15.155:0/2282083968 conn(0x7faf540710b0 msgr2=0x7faf54102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:36.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.488+0000 7faf5c53f640 1 -- 172.21.15.155:0/2282083968 shutdown_connections 2024-09-13T21:37:36.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:36.488+0000 7faf5c53f640 1 -- 172.21.15.155:0/2282083968 wait complete. 2024-09-13T21:37:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:37:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:37:36.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:37:36.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-13T21:37:36.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-13T21:37:36.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:36.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:36.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:36.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:36.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:36.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:37:36.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T21:37:36.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:37:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:37 smithi119 ceph-mon[27653]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:37:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:37 smithi119 ceph-mon[27653]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:37:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:37 smithi119 ceph-mon[27653]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:37:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:37 smithi119 ceph-mon[27653]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:37:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:37 smithi119 ceph-mon[27653]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:37:37.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:37 smithi119 ceph-mon[27653]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:37:37.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:37 smithi119 ceph-mon[27653]: Deploying daemon crash.smithi155 on smithi155 2024-09-13T21:37:37.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:37 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/2282083968' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:38.132 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:38.133 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:38.416 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:37:39.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.901+0000 7f82d8da7640 1 -- 172.21.15.155:0/2789406067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d41010e0 msgr2=0x7f82d41014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:39.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.901+0000 7f82d8da7640 1 --2- 172.21.15.155:0/2789406067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d41010e0 0x7f82d41014b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009bd0 tx=0x7f82cc004d10 comp rx=0 tx=0).stop 2024-09-13T21:37:39.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.902+0000 7f82d8da7640 1 -- 172.21.15.155:0/2789406067 shutdown_connections 2024-09-13T21:37:39.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.902+0000 7f82d8da7640 1 --2- 172.21.15.155:0/2789406067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d41010e0 0x7f82d41014b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:39.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.902+0000 7f82d8da7640 1 -- 172.21.15.155:0/2789406067 >> 172.21.15.155:0/2789406067 conn(0x7f82d40710b0 msgr2=0x7f82d40714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:39.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.902+0000 7f82d8da7640 1 -- 172.21.15.155:0/2789406067 shutdown_connections 2024-09-13T21:37:39.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.902+0000 7f82d8da7640 1 -- 172.21.15.155:0/2789406067 wait complete. 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.902+0000 7f82d8da7640 1 Processor -- start 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.902+0000 7f82d8da7640 1 -- start start 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.902+0000 7f82d8da7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d41010e0 0x7f82d410d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.902+0000 7f82d8da7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d410dcf0 con 0x7f82d41010e0 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.903+0000 7f82d259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d41010e0 0x7f82d410d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.903+0000 7f82d259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d41010e0 0x7f82d410d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:51966/0 (socket says 172.21.15.155:51966) 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.903+0000 7f82d259c640 1 -- 172.21.15.155:0/1453109632 learned_addr learned my addr 172.21.15.155:0/1453109632 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.903+0000 7f82d259c640 1 -- 172.21.15.155:0/1453109632 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc0098b0 con 0x7f82d41010e0 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.903+0000 7f82d259c640 1 --2- 172.21.15.155:0/1453109632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d41010e0 0x7f82d410d7b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009ba0 tx=0x7f82cc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.904+0000 7f82caffd640 1 -- 172.21.15.155:0/1453109632 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82cc0327a0 con 0x7f82d41010e0 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.904+0000 7f82d8da7640 1 -- 172.21.15.155:0/1453109632 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d410def0 con 0x7f82d41010e0 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.904+0000 7f82caffd640 1 -- 172.21.15.155:0/1453109632 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f82cc032da0 con 0x7f82d41010e0 2024-09-13T21:37:39.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.904+0000 7f82caffd640 1 -- 172.21.15.155:0/1453109632 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82cc03dd80 con 0x7f82d41010e0 2024-09-13T21:37:39.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.904+0000 7f82d8da7640 1 -- 172.21.15.155:0/1453109632 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d410e340 con 0x7f82d41010e0 2024-09-13T21:37:39.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.905+0000 7f82caffd640 1 -- 172.21.15.155:0/1453109632 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f82cc02f030 con 0x7f82d41010e0 2024-09-13T21:37:39.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.905+0000 7f82caffd640 1 --2- 172.21.15.155:0/1453109632 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f82c0039620 0x7f82c003bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:39.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.905+0000 7f82caffd640 1 -- 172.21.15.155:0/1453109632 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f82cc06d990 con 0x7f82d41010e0 2024-09-13T21:37:39.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.905+0000 7f82d8da7640 1 -- 172.21.15.155:0/1453109632 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d40fc850 con 0x7f82d41010e0 2024-09-13T21:37:39.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.905+0000 7f82d1d9b640 1 --2- 172.21.15.155:0/1453109632 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f82c0039620 0x7f82c003bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:39.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.906+0000 7f82d1d9b640 1 --2- 172.21.15.155:0/1453109632 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f82c0039620 0x7f82c003bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f82bc006fd0 tx=0x7f82bc006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:39.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:39.910+0000 7f82caffd640 1 -- 172.21.15.155:0/1453109632 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f82cc04e530 con 0x7f82d41010e0 2024-09-13T21:37:40.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.134+0000 7f82d8da7640 1 -- 172.21.15.155:0/1453109632 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f82d404b720 con 0x7f82d41010e0 2024-09-13T21:37:40.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.135+0000 7f82caffd640 1 -- 172.21.15.155:0/1453109632 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f82cc04e350 con 0x7f82d41010e0 2024-09-13T21:37:40.136 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:40.137 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:40.137 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:40.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.137+0000 7f82d8da7640 1 -- 172.21.15.155:0/1453109632 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f82c0039620 msgr2=0x7f82c003bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:40.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.137+0000 7f82d8da7640 1 --2- 172.21.15.155:0/1453109632 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f82c0039620 0x7f82c003bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f82bc006fd0 tx=0x7f82bc006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:40.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.137+0000 7f82d8da7640 1 -- 172.21.15.155:0/1453109632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d41010e0 msgr2=0x7f82d410d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:40.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.137+0000 7f82d8da7640 1 --2- 172.21.15.155:0/1453109632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d41010e0 0x7f82d410d7b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009ba0 tx=0x7f82cc004d10 comp rx=0 tx=0).stop 2024-09-13T21:37:40.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.137+0000 7f82d8da7640 1 -- 172.21.15.155:0/1453109632 shutdown_connections 2024-09-13T21:37:40.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.137+0000 7f82d8da7640 1 --2- 172.21.15.155:0/1453109632 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f82c0039620 0x7f82c003bad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:40.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.137+0000 7f82d8da7640 1 --2- 172.21.15.155:0/1453109632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82d41010e0 0x7f82d410d7b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:40.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.137+0000 7f82d8da7640 1 -- 172.21.15.155:0/1453109632 >> 172.21.15.155:0/1453109632 conn(0x7f82d40710b0 msgr2=0x7f82d4102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:40.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.137+0000 7f82d8da7640 1 -- 172.21.15.155:0/1453109632 shutdown_connections 2024-09-13T21:37:40.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:40.137+0000 7f82d8da7640 1 -- 172.21.15.155:0/1453109632 wait complete. 2024-09-13T21:37:40.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:40 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/1453109632' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:41.636 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:41.636 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:41.888 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:37:42.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:41 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:42.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:41 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:42.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:41 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:42.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:41 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:42.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:41 smithi119 ceph-mon[27653]: Deploying daemon node-exporter.smithi155 on smithi155 2024-09-13T21:37:44.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.268+0000 7fef03940640 1 -- 172.21.15.155:0/548447363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc101100 msgr2=0x7feefc1014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:44.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.268+0000 7fef03940640 1 --2- 172.21.15.155:0/548447363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc101100 0x7feefc1014d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feef8004850 tx=0x7feef8009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.268+0000 7fef03940640 1 -- 172.21.15.155:0/548447363 shutdown_connections 2024-09-13T21:37:44.344 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.268+0000 7fef03940640 1 --2- 172.21.15.155:0/548447363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc101100 0x7feefc1014d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.268+0000 7fef03940640 1 -- 172.21.15.155:0/548447363 >> 172.21.15.155:0/548447363 conn(0x7feefc0f6d10 msgr2=0x7feefc0f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:44.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.268+0000 7fef03940640 1 -- 172.21.15.155:0/548447363 shutdown_connections 2024-09-13T21:37:44.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.268+0000 7fef03940640 1 -- 172.21.15.155:0/548447363 wait complete. 2024-09-13T21:37:44.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.269+0000 7fef03940640 1 Processor -- start 2024-09-13T21:37:44.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.269+0000 7fef03940640 1 -- start start 2024-09-13T21:37:44.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.269+0000 7fef03940640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc101100 0x7feefc1149f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:44.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.269+0000 7fef03940640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc114f30 con 0x7feefc101100 2024-09-13T21:37:44.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.269+0000 7fef016dc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc101100 0x7feefc1149f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:44.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.269+0000 7fef016dc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc101100 0x7feefc1149f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:44292/0 (socket says 172.21.15.155:44292) 2024-09-13T21:37:44.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.269+0000 7fef016dc640 1 -- 172.21.15.155:0/828852837 learned_addr learned my addr 172.21.15.155:0/828852837 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:44.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.269+0000 7fef016dc640 1 -- 172.21.15.155:0/828852837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8005040 con 0x7feefc101100 2024-09-13T21:37:44.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.270+0000 7fef016dc640 1 --2- 172.21.15.155:0/828852837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc101100 0x7feefc1149f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feef802a6d0 tx=0x7feef8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:44.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.270+0000 7feef1ffb640 1 -- 172.21.15.155:0/828852837 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feef802cf10 con 0x7feefc101100 2024-09-13T21:37:44.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.270+0000 7fef03940640 1 -- 172.21.15.155:0/828852837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc115130 con 0x7feefc101100 2024-09-13T21:37:44.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.270+0000 7feef1ffb640 1 -- 172.21.15.155:0/828852837 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feef8033ad0 con 0x7feefc101100 2024-09-13T21:37:44.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.270+0000 7feef1ffb640 1 -- 172.21.15.155:0/828852837 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feef803ebb0 con 0x7feefc101100 2024-09-13T21:37:44.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.270+0000 7fef03940640 1 -- 172.21.15.155:0/828852837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc115600 con 0x7feefc101100 2024-09-13T21:37:44.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.271+0000 7fef03940640 1 -- 172.21.15.155:0/828852837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc0fc870 con 0x7feefc101100 2024-09-13T21:37:44.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.271+0000 7feef1ffb640 1 -- 172.21.15.155:0/828852837 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7feef8030020 con 0x7feefc101100 2024-09-13T21:37:44.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.271+0000 7feef1ffb640 1 --2- 172.21.15.155:0/828852837 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7feee8039670 0x7feee803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:44.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.271+0000 7feef1ffb640 1 -- 172.21.15.155:0/828852837 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7feef806c500 con 0x7feefc101100 2024-09-13T21:37:44.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.272+0000 7fef00edb640 1 --2- 172.21.15.155:0/828852837 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7feee8039670 0x7feee803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:44.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.272+0000 7fef00edb640 1 --2- 172.21.15.155:0/828852837 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7feee8039670 0x7feee803bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feeec006fd0 tx=0x7feeec006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:44.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.276+0000 7feef1ffb640 1 -- 172.21.15.155:0/828852837 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7feef803c930 con 0x7feefc101100 2024-09-13T21:37:44.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.492+0000 7fef03940640 1 -- 172.21.15.155:0/828852837 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feefc115600 con 0x7feefc101100 2024-09-13T21:37:44.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.492+0000 7feef1ffb640 1 -- 172.21.15.155:0/828852837 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7feefc115600 con 0x7feefc101100 2024-09-13T21:37:44.494 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:44.494 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:44.495 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:44.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.494+0000 7fef03940640 1 -- 172.21.15.155:0/828852837 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7feee8039670 msgr2=0x7feee803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:44.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.494+0000 7fef03940640 1 --2- 172.21.15.155:0/828852837 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7feee8039670 0x7feee803bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feeec006fd0 tx=0x7feeec006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.494+0000 7fef03940640 1 -- 172.21.15.155:0/828852837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc101100 msgr2=0x7feefc1149f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:44.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.494+0000 7fef03940640 1 --2- 172.21.15.155:0/828852837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc101100 0x7feefc1149f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feef802a6d0 tx=0x7feef8009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.494+0000 7fef03940640 1 -- 172.21.15.155:0/828852837 shutdown_connections 2024-09-13T21:37:44.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.494+0000 7fef03940640 1 --2- 172.21.15.155:0/828852837 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7feee8039670 0x7feee803bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.494+0000 7fef03940640 1 --2- 172.21.15.155:0/828852837 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc101100 0x7feefc1149f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:44.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.494+0000 7fef03940640 1 -- 172.21.15.155:0/828852837 >> 172.21.15.155:0/828852837 conn(0x7feefc0f6d10 msgr2=0x7feefc065360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:44.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.494+0000 7fef03940640 1 -- 172.21.15.155:0/828852837 shutdown_connections 2024-09-13T21:37:44.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:44.494+0000 7fef03940640 1 -- 172.21.15.155:0/828852837 wait complete. 2024-09-13T21:37:44.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:44 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/828852837' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:46.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:46.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:37:46.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:46.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.wuuxfd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:37:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.wuuxfd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T21:37:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:37:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:37:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:45 smithi119 ceph-mon[27653]: Deploying daemon mgr.smithi155.wuuxfd on smithi155 2024-09-13T21:37:46.551 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:46.552 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:46.828 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:37:49.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.089+0000 7f80b54c7640 1 -- 172.21.15.155:0/3033131411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80b01010d0 msgr2=0x7f80b01014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:49.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.089+0000 7f80b54c7640 1 --2- 172.21.15.155:0/3033131411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80b01010d0 0x7f80b01014a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f80a0004850 tx=0x7f80a0009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.089+0000 7f80b54c7640 1 -- 172.21.15.155:0/3033131411 shutdown_connections 2024-09-13T21:37:49.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.089+0000 7f80b54c7640 1 --2- 172.21.15.155:0/3033131411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80b01010d0 0x7f80b01014a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.089+0000 7f80b54c7640 1 -- 172.21.15.155:0/3033131411 >> 172.21.15.155:0/3033131411 conn(0x7f80b00f6ca0 msgr2=0x7f80b00f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:49.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.089+0000 7f80b54c7640 1 -- 172.21.15.155:0/3033131411 shutdown_connections 2024-09-13T21:37:49.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.089+0000 7f80b54c7640 1 -- 172.21.15.155:0/3033131411 wait complete. 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.090+0000 7f80b54c7640 1 Processor -- start 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.090+0000 7f80b54c7640 1 -- start start 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.090+0000 7f80b54c7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80b01010d0 0x7f80b010d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.090+0000 7f80b54c7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b010dcb0 con 0x7f80b01010d0 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.090+0000 7f80aeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80b01010d0 0x7f80b010d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.090+0000 7f80aeffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80b01010d0 0x7f80b010d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.155:44324/0 (socket says 172.21.15.155:44324) 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.090+0000 7f80aeffd640 1 -- 172.21.15.155:0/2246502963 learned_addr learned my addr 172.21.15.155:0/2246502963 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.090+0000 7f80aeffd640 1 -- 172.21.15.155:0/2246502963 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a0005040 con 0x7f80b01010d0 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.091+0000 7f80aeffd640 1 --2- 172.21.15.155:0/2246502963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80b01010d0 0x7f80b010d770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80a002a6d0 tx=0x7f80a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.091+0000 7f80977fe640 1 -- 172.21.15.155:0/2246502963 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80a002cf10 con 0x7f80b01010d0 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.091+0000 7f80b54c7640 1 -- 172.21.15.155:0/2246502963 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b010deb0 con 0x7f80b01010d0 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.091+0000 7f80977fe640 1 -- 172.21.15.155:0/2246502963 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f80a0033ad0 con 0x7f80b01010d0 2024-09-13T21:37:49.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.091+0000 7f80977fe640 1 -- 172.21.15.155:0/2246502963 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80a003ebb0 con 0x7f80b01010d0 2024-09-13T21:37:49.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.091+0000 7f80b54c7640 1 -- 172.21.15.155:0/2246502963 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b010e380 con 0x7f80b01010d0 2024-09-13T21:37:49.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.092+0000 7f80977fe640 1 -- 172.21.15.155:0/2246502963 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f80a0030020 con 0x7f80b01010d0 2024-09-13T21:37:49.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.092+0000 7f80b54c7640 1 -- 172.21.15.155:0/2246502963 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b010e5c0 con 0x7f80b01010d0 2024-09-13T21:37:49.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.092+0000 7f80977fe640 1 --2- 172.21.15.155:0/2246502963 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8098039670 0x7f809803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:49.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.092+0000 7f80977fe640 1 -- 172.21.15.155:0/2246502963 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f80a006c700 con 0x7f80b01010d0 2024-09-13T21:37:49.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.093+0000 7f80ae7fc640 1 --2- 172.21.15.155:0/2246502963 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8098039670 0x7f809803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:49.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.093+0000 7f80ae7fc640 1 --2- 172.21.15.155:0/2246502963 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8098039670 0x7f809803bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80a4006fd0 tx=0x7f80a4006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:49.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.097+0000 7f80977fe640 1 -- 172.21.15.155:0/2246502963 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f80a0043210 con 0x7f80b01010d0 2024-09-13T21:37:49.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.334+0000 7f80b54c7640 1 -- 172.21.15.155:0/2246502963 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f80b00fc840 con 0x7f80b01010d0 2024-09-13T21:37:49.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.334+0000 7f80977fe640 1 -- 172.21.15.155:0/2246502963 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f80a0043210 con 0x7f80b01010d0 2024-09-13T21:37:49.337 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:37:49.338 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":1,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:35:37.219093Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T21:37:49.338 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 1 2024-09-13T21:37:49.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.336+0000 7f80b54c7640 1 -- 172.21.15.155:0/2246502963 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8098039670 msgr2=0x7f809803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:49.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.336+0000 7f80b54c7640 1 --2- 172.21.15.155:0/2246502963 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8098039670 0x7f809803bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80a4006fd0 tx=0x7f80a4006db0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.336+0000 7f80b54c7640 1 -- 172.21.15.155:0/2246502963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80b01010d0 msgr2=0x7f80b010d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:49.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.336+0000 7f80b54c7640 1 --2- 172.21.15.155:0/2246502963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80b01010d0 0x7f80b010d770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80a002a6d0 tx=0x7f80a0009da0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.337+0000 7f80b54c7640 1 -- 172.21.15.155:0/2246502963 shutdown_connections 2024-09-13T21:37:49.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.337+0000 7f80b54c7640 1 --2- 172.21.15.155:0/2246502963 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8098039670 0x7f809803bb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.337+0000 7f80b54c7640 1 --2- 172.21.15.155:0/2246502963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80b01010d0 0x7f80b010d770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:49.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.337+0000 7f80b54c7640 1 -- 172.21.15.155:0/2246502963 >> 172.21.15.155:0/2246502963 conn(0x7f80b00f6ca0 msgr2=0x7f80b00f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:49.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.337+0000 7f80b54c7640 1 -- 172.21.15.155:0/2246502963 shutdown_connections 2024-09-13T21:37:49.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:49.337+0000 7f80b54c7640 1 -- 172.21.15.155:0/2246502963 wait complete. 2024-09-13T21:37:49.998 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:49 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:49.998 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:49 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:49.998 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:49 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:49.998 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:49 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:49.998 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:49 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:37:49.998 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:49 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:37:49.998 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:49 smithi119 ceph-mon[27653]: Deploying daemon mon.smithi155 on smithi155 2024-09-13T21:37:49.998 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:49 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/2246502963' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:37:49.998 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:49 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:50.985 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T21:37:50.985 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T21:37:51.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:50 smithi119 ceph-mon[27653]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:51.982 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi155/config 2024-09-13T21:37:53.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:52 smithi119 ceph-mon[27653]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:54.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:53 smithi119 ceph-mon[27653]: Standby manager daemon smithi155.wuuxfd started 2024-09-13T21:37:54.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:53 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/676071554' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/crt"}]: dispatch 2024-09-13T21:37:54.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:53 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/676071554' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:37:54.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:53 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/676071554' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/key"}]: dispatch 2024-09-13T21:37:54.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:53 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/676071554' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:37:59.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:37:58 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:59.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:59.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:37:59.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:37:59.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: mon.smithi119 calling monitor election 2024-09-13T21:37:59.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:37:59.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:59.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: mon.smithi155 calling monitor election 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: mon.smithi119 is new leader, mons smithi119,smithi155 in quorum (ranks 0,1) 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: monmap e2: 2 mons at {smithi119=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0],smithi155=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: fsmap 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: mgrmap e18: smithi119.gwjxmq(active, since 29s), standbys: smithi155.wuuxfd 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: overall HEALTH_OK 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:59.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:59.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:59.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:59.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:58 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:37:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.958+0000 7f8e135d1640 1 -- 172.21.15.155:0/3496568243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df8005be0 msgr2=0x7f8df8008060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:37:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.958+0000 7f8e135d1640 1 --2- 172.21.15.155:0/3496568243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df8005be0 0x7f8df8008060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0fc730 tx=0x7f8e08002040 comp rx=0 tx=0).stop 2024-09-13T21:37:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.958+0000 7f8e135d1640 1 -- 172.21.15.155:0/3496568243 shutdown_connections 2024-09-13T21:37:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.958+0000 7f8e135d1640 1 --2- 172.21.15.155:0/3496568243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df8005be0 0x7f8df8008060 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.958+0000 7f8e135d1640 1 -- 172.21.15.155:0/3496568243 >> 172.21.15.155:0/3496568243 conn(0x7f8e0c0f6e40 msgr2=0x7f8e0c0f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:37:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.959+0000 7f8e135d1640 1 -- 172.21.15.155:0/3496568243 shutdown_connections 2024-09-13T21:37:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.959+0000 7f8e135d1640 1 -- 172.21.15.155:0/3496568243 wait complete. 2024-09-13T21:37:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.959+0000 7f8e135d1640 1 Processor -- start 2024-09-13T21:37:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.959+0000 7f8e135d1640 1 -- start start 2024-09-13T21:37:59.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.959+0000 7f8e135d1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df8005be0 0x7f8e0c112a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.959+0000 7f8e135d1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e0c112f60 0x7f8e0c10c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.959+0000 7f8e135d1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c113520 con 0x7f8df8005be0 2024-09-13T21:37:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.959+0000 7f8e135d1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c113660 con 0x7f8e0c112f60 2024-09-13T21:37:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e10b6c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e0c112f60 0x7f8e0c10c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e10b6c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e0c112f60 0x7f8e0c10c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34550/0 (socket says 172.21.15.155:34550) 2024-09-13T21:37:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e10b6c640 1 -- 172.21.15.155:0/3735013267 learned_addr learned my addr 172.21.15.155:0/3735013267 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:37:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e10b6c640 1 -- 172.21.15.155:0/3735013267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e0c112f60 msgr2=0x7f8e0c10c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T21:37:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e10b6c640 1 -- 172.21.15.155:0/3735013267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e0c112f60 msgr2=0x7f8e0c10c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T21:37:59.964 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e10b6c640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e0c112f60 0x7f8e0c10c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-13T21:37:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e10b6c640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e0c112f60 0x7f8e0c10c9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T21:37:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e1136d640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df8005be0 0x7f8e0c112a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e1136d640 1 -- 172.21.15.155:0/3735013267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e0c112f60 msgr2=0x7f8e0c10c9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T21:37:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e1136d640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e0c112f60 0x7f8e0c10c9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:37:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e1136d640 1 -- 172.21.15.155:0/3735013267 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e08005040 con 0x7f8df8005be0 2024-09-13T21:37:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e1136d640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df8005be0 0x7f8e0c112a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0fb1d0 tx=0x7f8e0802d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e01ffb640 1 -- 172.21.15.155:0/3735013267 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e0803f400 con 0x7f8df8005be0 2024-09-13T21:37:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e01ffb640 1 -- 172.21.15.155:0/3735013267 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8e0800f040 con 0x7f8df8005be0 2024-09-13T21:37:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e135d1640 1 -- 172.21.15.155:0/3735013267 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c10cfc0 con 0x7f8df8005be0 2024-09-13T21:37:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.960+0000 7f8e01ffb640 1 -- 172.21.15.155:0/3735013267 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e0803d6a0 con 0x7f8df8005be0 2024-09-13T21:37:59.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.961+0000 7f8e135d1640 1 -- 172.21.15.155:0/3735013267 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c10d4b0 con 0x7f8df8005be0 2024-09-13T21:37:59.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.962+0000 7f8e135d1640 1 -- 172.21.15.155:0/3735013267 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0c0fc9e0 con 0x7f8df8005be0 2024-09-13T21:37:59.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.962+0000 7f8e01ffb640 1 -- 172.21.15.155:0/3735013267 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f8e0803fb00 con 0x7f8df8005be0 2024-09-13T21:37:59.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.963+0000 7f8e01ffb640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8df006ee20 0x7f8df00712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:37:59.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.963+0000 7f8e01ffb640 1 -- 172.21.15.155:0/3735013267 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f8e080ae6f0 con 0x7f8df8005be0 2024-09-13T21:37:59.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.963+0000 7f8e10b6c640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8df006ee20 0x7f8df00712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:37:59.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.963+0000 7f8e10b6c640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8df006ee20 0x7f8df00712d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc006fd0 tx=0x7f8dfc008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:37:59.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:37:59.966+0000 7f8e01ffb640 1 -- 172.21.15.155:0/3735013267 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8e0807c950 con 0x7f8df8005be0 2024-09-13T21:38:00.045 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:37:59 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:00.045 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:37:59 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:00.046 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:37:59 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:00.046 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:37:59 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:38:00.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:59 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:00.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:59 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:00.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:59 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:00.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:37:59 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:38:00.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.193+0000 7f8e135d1640 1 -- 172.21.15.155:0/3735013267 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8e0c04b720 con 0x7f8df8005be0 2024-09-13T21:38:00.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.194+0000 7f8e01ffb640 1 -- 172.21.15.155:0/3735013267 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7f8e08043410 con 0x7f8df8005be0 2024-09-13T21:38:00.196 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:38:00.197 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":2,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","modified":"2024-09-13T21:37:53.720836Z","created":"2024-09-13T21:35:37.219093Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi155","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T21:38:00.197 INFO:teuthology.orchestra.run.smithi155.stderr:dumped monmap epoch 2 2024-09-13T21:38:00.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.196+0000 7f8e135d1640 1 -- 172.21.15.155:0/3735013267 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8df006ee20 msgr2=0x7f8df00712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:00.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.196+0000 7f8e135d1640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8df006ee20 0x7f8df00712d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc006fd0 tx=0x7f8dfc008040 comp rx=0 tx=0).stop 2024-09-13T21:38:00.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.196+0000 7f8e135d1640 1 -- 172.21.15.155:0/3735013267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df8005be0 msgr2=0x7f8e0c112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:00.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.196+0000 7f8e135d1640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df8005be0 0x7f8e0c112a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0fb1d0 tx=0x7f8e0802d040 comp rx=0 tx=0).stop 2024-09-13T21:38:00.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.196+0000 7f8e135d1640 1 -- 172.21.15.155:0/3735013267 shutdown_connections 2024-09-13T21:38:00.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.196+0000 7f8e135d1640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8df006ee20 0x7f8df00712d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:00.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.196+0000 7f8e135d1640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e0c112f60 0x7f8e0c10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:00.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.196+0000 7f8e135d1640 1 --2- 172.21.15.155:0/3735013267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df8005be0 0x7f8e0c112a20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:00.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.196+0000 7f8e135d1640 1 -- 172.21.15.155:0/3735013267 >> 172.21.15.155:0/3735013267 conn(0x7f8e0c0f6e40 msgr2=0x7f8e0c100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:00.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.196+0000 7f8e135d1640 1 -- 172.21.15.155:0/3735013267 shutdown_connections 2024-09-13T21:38:00.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:38:00.196+0000 7f8e135d1640 1 -- 172.21.15.155:0/3735013267 wait complete. 2024-09-13T21:38:01.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:00 smithi155 ceph-mon[34732]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:01.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:00 smithi155 ceph-mon[34732]: from='client.? 172.21.15.155:0/3735013267' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:38:01.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:00 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:01.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:00 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:01.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:00 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:01.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:00 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:01.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:00 smithi119 ceph-mon[27653]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:01.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:00 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/3735013267' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T21:38:01.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:00 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:01.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:00 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:01.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:00 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:01.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:00 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:01.209 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T21:38:01.209 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T21:38:01.470 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:38:02.461 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-13T21:38:02.461 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-13T21:38:02.461 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:38:02.461 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:38:02.461 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:02.461 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:02.461 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:02.461 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:02.462 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:02.462 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: Reconfiguring mon.smithi119 (unknown last config time)... 2024-09-13T21:38:02.462 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:38:02.462 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:38:02.462 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:02.462 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:02 smithi119 ceph-mon[27653]: Reconfiguring daemon mon.smithi119 on smithi119 2024-09-13T21:38:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-13T21:38:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-13T21:38:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:38:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:38:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:02.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:02.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:02.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:02.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:02.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: Reconfiguring mon.smithi119 (unknown last config time)... 2024-09-13T21:38:02.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:38:02.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:38:02.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:02.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:02 smithi155 ceph-mon[34732]: Reconfiguring daemon mon.smithi119 on smithi119 2024-09-13T21:38:03.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:03 smithi119 ceph-mon[27653]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:03 smithi155 ceph-mon[34732]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:03.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.870+0000 7f07d4250640 1 -- 172.21.15.119:0/1079758418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc0fcf80 msgr2=0x7f07cc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:03.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.870+0000 7f07d4250640 1 --2- 172.21.15.119:0/1079758418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc0fcf80 0x7f07cc0fd3d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07c80048d0 tx=0x7f07c8009da0 comp rx=0 tx=0).stop 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.870+0000 7f07d4250640 1 -- 172.21.15.119:0/1079758418 shutdown_connections 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.870+0000 7f07d4250640 1 --2- 172.21.15.119:0/1079758418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc0fcf80 0x7f07cc0fd3d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.870+0000 7f07d4250640 1 --2- 172.21.15.119:0/1079758418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07cc0fb810 0x7f07cc0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.870+0000 7f07d4250640 1 -- 172.21.15.119:0/1079758418 >> 172.21.15.119:0/1079758418 conn(0x7f07cc0723b0 msgr2=0x7f07cc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.870+0000 7f07d4250640 1 -- 172.21.15.119:0/1079758418 shutdown_connections 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.870+0000 7f07d4250640 1 -- 172.21.15.119:0/1079758418 wait complete. 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d4250640 1 Processor -- start 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d4250640 1 -- start start 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d4250640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc0fb810 0x7f07cc112140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d4250640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07cc0fcf80 0x7f07cc112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d4250640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc112d10 con 0x7f07cc0fb810 2024-09-13T21:38:03.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d4250640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc10c100 con 0x7f07cc0fcf80 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d1fec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc0fb810 0x7f07cc112140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d1fec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc0fb810 0x7f07cc112140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:54444/0 (socket says 172.21.15.119:54444) 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d1fec640 1 -- 172.21.15.119:0/3848414045 learned_addr learned my addr 172.21.15.119:0/3848414045 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d17eb640 1 --2- 172.21.15.119:0/3848414045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07cc0fcf80 0x7f07cc112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d1fec640 1 -- 172.21.15.119:0/3848414045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07cc0fcf80 msgr2=0x7f07cc112680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d1fec640 1 --2- 172.21.15.119:0/3848414045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07cc0fcf80 0x7f07cc112680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.871+0000 7f07d1fec640 1 -- 172.21.15.119:0/3848414045 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c8005040 con 0x7f07cc0fb810 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.872+0000 7f07d1fec640 1 --2- 172.21.15.119:0/3848414045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc0fb810 0x7f07cc112140 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00b790 tx=0x7f07bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.872+0000 7f07c27fc640 1 -- 172.21.15.119:0/3848414045 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07bc00c700 con 0x7f07cc0fb810 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.872+0000 7f07c27fc640 1 -- 172.21.15.119:0/3848414045 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f07bc00cd00 con 0x7f07cc0fb810 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.872+0000 7f07d4250640 1 -- 172.21.15.119:0/3848414045 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07cc10c3e0 con 0x7f07cc0fb810 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.872+0000 7f07c27fc640 1 -- 172.21.15.119:0/3848414045 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07bc015e70 con 0x7f07cc0fb810 2024-09-13T21:38:03.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.872+0000 7f07d4250640 1 -- 172.21.15.119:0/3848414045 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07cc10c900 con 0x7f07cc0fb810 2024-09-13T21:38:03.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.873+0000 7f07d4250640 1 -- 172.21.15.119:0/3848414045 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07cc0fcbc0 con 0x7f07cc0fb810 2024-09-13T21:38:03.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.873+0000 7f07c27fc640 1 -- 172.21.15.119:0/3848414045 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f07bc012070 con 0x7f07cc0fb810 2024-09-13T21:38:03.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.874+0000 7f07c27fc640 1 --2- 172.21.15.119:0/3848414045 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f07b806ecc0 0x7f07b8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:03.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.874+0000 7f07d17eb640 1 --2- 172.21.15.119:0/3848414045 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f07b806ecc0 0x7f07b8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:03.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.874+0000 7f07c27fc640 1 -- 172.21.15.119:0/3848414045 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f07bc08cb50 con 0x7f07cc0fb810 2024-09-13T21:38:03.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.874+0000 7f07d17eb640 1 --2- 172.21.15.119:0/3848414045 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f07b806ecc0 0x7f07b8071170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f07cc10da40 tx=0x7f07c8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:03.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:03.878+0000 7f07c27fc640 1 -- 172.21.15.119:0/3848414045 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f07bc05add0 con 0x7f07cc0fb810 2024-09-13T21:38:04.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.043+0000 7f07d4250640 1 -- 172.21.15.119:0/3848414045 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f07cc04b7b0 con 0x7f07cc0fb810 2024-09-13T21:38:04.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.043+0000 7f07c27fc640 1 -- 172.21.15.119:0/3848414045 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f07bc08c300 con 0x7f07cc0fb810 2024-09-13T21:38:04.045 INFO:teuthology.orchestra.run.smithi119.stdout:# minimal ceph.conf for f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:38:04.045 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2024-09-13T21:38:04.046 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:38:04.046 INFO:teuthology.orchestra.run.smithi119.stdout: mon_host = [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] 2024-09-13T21:38:04.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.046+0000 7f07d4250640 1 -- 172.21.15.119:0/3848414045 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f07b806ecc0 msgr2=0x7f07b8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:04.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.046+0000 7f07d4250640 1 --2- 172.21.15.119:0/3848414045 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f07b806ecc0 0x7f07b8071170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f07cc10da40 tx=0x7f07c8035040 comp rx=0 tx=0).stop 2024-09-13T21:38:04.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.046+0000 7f07d4250640 1 -- 172.21.15.119:0/3848414045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc0fb810 msgr2=0x7f07cc112140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:04.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.046+0000 7f07d4250640 1 --2- 172.21.15.119:0/3848414045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc0fb810 0x7f07cc112140 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00b790 tx=0x7f07bc0091d0 comp rx=0 tx=0).stop 2024-09-13T21:38:04.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.046+0000 7f07d4250640 1 -- 172.21.15.119:0/3848414045 shutdown_connections 2024-09-13T21:38:04.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.046+0000 7f07d4250640 1 --2- 172.21.15.119:0/3848414045 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f07b806ecc0 0x7f07b8071170 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:04.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.046+0000 7f07d4250640 1 --2- 172.21.15.119:0/3848414045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07cc0fcf80 0x7f07cc112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:04.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.046+0000 7f07d4250640 1 --2- 172.21.15.119:0/3848414045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc0fb810 0x7f07cc112140 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:04.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.046+0000 7f07d4250640 1 -- 172.21.15.119:0/3848414045 >> 172.21.15.119:0/3848414045 conn(0x7f07cc0723b0 msgr2=0x7f07cc0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:04.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.046+0000 7f07d4250640 1 -- 172.21.15.119:0/3848414045 shutdown_connections 2024-09-13T21:38:04.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:04.046+0000 7f07d4250640 1 -- 172.21.15.119:0/3848414045 wait complete. 2024-09-13T21:38:04.616 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:04 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:04.616 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:04 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:04.616 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:04 smithi119 ceph-mon[27653]: Reconfiguring mgr.smithi119.gwjxmq (unknown last config time)... 2024-09-13T21:38:04.616 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:04 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.gwjxmq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:38:04.616 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:04 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:38:04.616 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:04 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:04.616 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:04 smithi119 ceph-mon[27653]: Reconfiguring daemon mgr.smithi119.gwjxmq on smithi119 2024-09-13T21:38:04.616 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:04 smithi119 ceph-mon[27653]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:04.617 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:04 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3848414045' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:04.768 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T21:38:04.768 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:38:04.768 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T21:38:04.795 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:38:04.795 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:38:04.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:04 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:04.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:04 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:04.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:04 smithi155 ceph-mon[34732]: Reconfiguring mgr.smithi119.gwjxmq (unknown last config time)... 2024-09-13T21:38:04.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:04 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.gwjxmq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:38:04.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:04 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:38:04.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:04 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:04.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:04 smithi155 ceph-mon[34732]: Reconfiguring daemon mgr.smithi119.gwjxmq on smithi119 2024-09-13T21:38:04.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:04 smithi155 ceph-mon[34732]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:04.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:04 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3848414045' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:04.860 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:38:04.861 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T21:38:04.893 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:38:04.893 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:38:04.963 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T21:38:04.963 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:38:04.963 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T21:38:04.979 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T21:38:04.979 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-09-13T21:38:05.035 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T21:38:05.035 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:38:05.035 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-13T21:38:05.035 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:38:05.035 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:38:05.035 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-13 21:37:23.686468907 +0000 2024-09-13T21:38:05.035 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-13 21:32:04.098011087 +0000 2024-09-13T21:38:05.035 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-13 21:32:04.098011087 +0000 2024-09-13T21:38:05.035 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-13 21:32:04.098011087 +0000 2024-09-13T21:38:05.035 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T21:38:05.099 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-13T21:38:05.099 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-13T21:38:05.099 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000211065 s, 2.4 MB/s 2024-09-13T21:38:05.100 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T21:38:05.156 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-09-13T21:38:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T21:38:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:38:05.212 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T21:38:05.212 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:38:05.212 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:38:05.212 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-13 21:37:23.686468907 +0000 2024-09-13T21:38:05.212 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-13 21:32:04.431002920 +0000 2024-09-13T21:38:05.212 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-13 21:32:04.431002920 +0000 2024-09-13T21:38:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-13 21:32:04.431002920 +0000 2024-09-13T21:38:05.212 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T21:38:05.274 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-13T21:38:05.275 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-13T21:38:05.275 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000193132 s, 2.7 MB/s 2024-09-13T21:38:05.276 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T21:38:05.333 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-09-13T21:38:05.389 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T21:38:05.389 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:38:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T21:38:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:38:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:38:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-13 21:37:23.687468883 +0000 2024-09-13T21:38:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-13 21:32:04.747995147 +0000 2024-09-13T21:38:05.389 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-13 21:32:04.747995147 +0000 2024-09-13T21:38:05.389 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-13 21:32:04.747995147 +0000 2024-09-13T21:38:05.390 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T21:38:05.453 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-13T21:38:05.453 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-13T21:38:05.453 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000209427 s, 2.4 MB/s 2024-09-13T21:38:05.454 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T21:38:05.510 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-09-13T21:38:05.567 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T21:38:05.567 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:38:05.567 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-13T21:38:05.567 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:38:05.568 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:38:05.568 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-13 21:37:23.687468883 +0000 2024-09-13T21:38:05.568 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-13 21:32:05.075987103 +0000 2024-09-13T21:38:05.568 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-13 21:32:05.075987103 +0000 2024-09-13T21:38:05.568 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-13 21:32:05.075987103 +0000 2024-09-13T21:38:05.568 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T21:38:05.630 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-13T21:38:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-13T21:38:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000235977 s, 2.2 MB/s 2024-09-13T21:38:05.632 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T21:38:05.689 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:38:05.689 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T21:38:05.709 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T21:38:05.709 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-09-13T21:38:05.768 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T21:38:05.768 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:38:05.769 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-13T21:38:05.769 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:38:05.769 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:38:05.769 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-13 21:37:52.161896495 +0000 2024-09-13T21:38:05.769 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-13 21:32:04.122082119 +0000 2024-09-13T21:38:05.769 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-13 21:32:04.122082119 +0000 2024-09-13T21:38:05.770 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-13 21:32:04.122082119 +0000 2024-09-13T21:38:05.770 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T21:38:05.836 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-13T21:38:05.836 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-13T21:38:05.836 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000214868 s, 2.4 MB/s 2024-09-13T21:38:05.837 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T21:38:05.895 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-09-13T21:38:05.955 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T21:38:05.956 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:38:05.956 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T21:38:05.956 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:38:05.956 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:38:05.956 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-13 21:37:52.161896495 +0000 2024-09-13T21:38:05.956 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-13 21:32:04.456075429 +0000 2024-09-13T21:38:05.956 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-13 21:32:04.456075429 +0000 2024-09-13T21:38:05.956 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-13 21:32:04.456075429 +0000 2024-09-13T21:38:05.956 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T21:38:06.021 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-13T21:38:06.021 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-13T21:38:06.021 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000233105 s, 2.2 MB/s 2024-09-13T21:38:06.023 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T21:38:06.081 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-09-13T21:38:06.137 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T21:38:06.138 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:38:06.138 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T21:38:06.138 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:38:06.138 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:38:06.138 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-13 21:37:52.161896495 +0000 2024-09-13T21:38:06.138 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-13 21:32:04.770069140 +0000 2024-09-13T21:38:06.138 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-13 21:32:04.770069140 +0000 2024-09-13T21:38:06.138 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-13 21:32:04.770069140 +0000 2024-09-13T21:38:06.138 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T21:38:06.202 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-13T21:38:06.202 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-13T21:38:06.203 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000329673 s, 1.6 MB/s 2024-09-13T21:38:06.204 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T21:38:06.261 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-09-13T21:38:06.316 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T21:38:06.316 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T21:38:06.316 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-13T21:38:06.316 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:38:06.317 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T21:38:06.317 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-13 21:37:52.162896475 +0000 2024-09-13T21:38:06.317 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-13 21:32:05.142061689 +0000 2024-09-13T21:38:06.317 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-13 21:32:05.142061689 +0000 2024-09-13T21:38:06.317 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-13 21:32:05.142061689 +0000 2024-09-13T21:38:06.317 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T21:38:06.380 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-13T21:38:06.380 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-13T21:38:06.380 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000176309 s, 2.9 MB/s 2024-09-13T21:38:06.381 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T21:38:06.438 INFO:tasks.cephadm:Deploying osd.0 on smithi119 with /dev/vg_nvme/lv_4... 2024-09-13T21:38:06.439 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T21:38:06.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:06 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:06.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:06 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:06.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:06 smithi119 ceph-mon[27653]: Reconfiguring crash.smithi119 (monmap changed)... 2024-09-13T21:38:06.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:06 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:38:06.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:06 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:06.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:06 smithi119 ceph-mon[27653]: Reconfiguring daemon crash.smithi119 on smithi119 2024-09-13T21:38:06.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:06 smithi119 ceph-mon[27653]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:06.917 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:38:07.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:06 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:07.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:06 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:07.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:06 smithi155 ceph-mon[34732]: Reconfiguring crash.smithi119 (monmap changed)... 2024-09-13T21:38:07.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:06 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:38:07.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:06 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:07.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:06 smithi155 ceph-mon[34732]: Reconfiguring daemon crash.smithi119 on smithi119 2024-09-13T21:38:07.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:06 smithi155 ceph-mon[34732]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:08.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:08.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:08.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:07 smithi119 ceph-mon[27653]: Reconfiguring alertmanager.smithi119 (dependencies changed)... 2024-09-13T21:38:08.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:07 smithi119 ceph-mon[27653]: Reconfiguring daemon alertmanager.smithi119 on smithi119 2024-09-13T21:38:08.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:08.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:08.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:07 smithi155 ceph-mon[34732]: Reconfiguring alertmanager.smithi119 (dependencies changed)... 2024-09-13T21:38:08.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:07 smithi155 ceph-mon[34732]: Reconfiguring daemon alertmanager.smithi119 on smithi119 2024-09-13T21:38:09.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:08 smithi119 ceph-mon[27653]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:09.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:08 smithi155 ceph-mon[34732]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:10.999 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:10 smithi119 ceph-mon[27653]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:11.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:10 smithi155 ceph-mon[34732]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:13.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:13 smithi119 ceph-mon[27653]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:13.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:13 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:13.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:13 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:13.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:13 smithi119 ceph-mon[27653]: Reconfiguring grafana.smithi119 (dependencies changed)... 2024-09-13T21:38:13.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:13 smithi119 ceph-mon[27653]: Reconfiguring daemon grafana.smithi119 on smithi119 2024-09-13T21:38:13.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:13 smithi155 ceph-mon[34732]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:13.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:13 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:13.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:13 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:13.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:13 smithi155 ceph-mon[34732]: Reconfiguring grafana.smithi119 (dependencies changed)... 2024-09-13T21:38:13.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:13 smithi155 ceph-mon[34732]: Reconfiguring daemon grafana.smithi119 on smithi119 2024-09-13T21:38:13.399 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:38:13.420 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi119:vg_nvme/lv_4 2024-09-13T21:38:14.522 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:38:15.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:15 smithi155 ceph-mon[34732]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:15.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:15.373 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:15 smithi119 ceph-mon[27653]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:15.373 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.526+0000 7f2e17c5e640 1 -- 172.21.15.119:0/1523223914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e100fd820 msgr2=0x7f2e100fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.526+0000 7f2e17c5e640 1 --2- 172.21.15.119:0/1523223914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e100fd820 0x7f2e100fdc90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2e000048d0 tx=0x7f2e00009da0 comp rx=0 tx=0).stop 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.526+0000 7f2e17c5e640 1 -- 172.21.15.119:0/1523223914 shutdown_connections 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.526+0000 7f2e17c5e640 1 --2- 172.21.15.119:0/1523223914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e100fd820 0x7f2e100fdc90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.526+0000 7f2e17c5e640 1 --2- 172.21.15.119:0/1523223914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e100fc550 0x7f2e100fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.526+0000 7f2e17c5e640 1 -- 172.21.15.119:0/1523223914 >> 172.21.15.119:0/1523223914 conn(0x7f2e100f7d30 msgr2=0x7f2e100fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.526+0000 7f2e17c5e640 1 -- 172.21.15.119:0/1523223914 shutdown_connections 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.526+0000 7f2e17c5e640 1 -- 172.21.15.119:0/1523223914 wait complete. 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e17c5e640 1 Processor -- start 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e17c5e640 1 -- start start 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e17c5e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e100fc550 0x7f2e1010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:16.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e17c5e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e100fd820 0x7f2e1010d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e17c5e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1010dc40 con 0x7f2e100fd820 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e17c5e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1010e460 con 0x7f2e100fc550 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e151f9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e100fd820 0x7f2e1010d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e151f9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e100fd820 0x7f2e1010d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45720/0 (socket says 172.21.15.119:45720) 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e151f9640 1 -- 172.21.15.119:0/3296651484 learned_addr learned my addr 172.21.15.119:0/3296651484 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e159fa640 1 --2- 172.21.15.119:0/3296651484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e100fc550 0x7f2e1010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e151f9640 1 -- 172.21.15.119:0/3296651484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e100fc550 msgr2=0x7f2e1010d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e151f9640 1 --2- 172.21.15.119:0/3296651484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e100fc550 0x7f2e1010d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.527+0000 7f2e151f9640 1 -- 172.21.15.119:0/3296651484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00005040 con 0x7f2e100fd820 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.528+0000 7f2e151f9640 1 --2- 172.21.15.119:0/3296651484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e100fd820 0x7f2e1010d5f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2e00003080 tx=0x7f2e00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.528+0000 7f2e067fc640 1 -- 172.21.15.119:0/3296651484 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e00038070 con 0x7f2e100fd820 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.528+0000 7f2e067fc640 1 -- 172.21.15.119:0/3296651484 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2e00009800 con 0x7f2e100fd820 2024-09-13T21:38:16.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.528+0000 7f2e17c5e640 1 -- 172.21.15.119:0/3296651484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1010e690 con 0x7f2e100fd820 2024-09-13T21:38:16.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.528+0000 7f2e067fc640 1 -- 172.21.15.119:0/3296651484 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e00033660 con 0x7f2e100fd820 2024-09-13T21:38:16.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.528+0000 7f2e17c5e640 1 -- 172.21.15.119:0/3296651484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1010ebd0 con 0x7f2e100fd820 2024-09-13T21:38:16.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.529+0000 7f2e17c5e640 1 -- 172.21.15.119:0/3296651484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e100fb9b0 con 0x7f2e100fd820 2024-09-13T21:38:16.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.529+0000 7f2e067fc640 1 -- 172.21.15.119:0/3296651484 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f2e00030020 con 0x7f2e100fd820 2024-09-13T21:38:16.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.530+0000 7f2e067fc640 1 --2- 172.21.15.119:0/3296651484 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2dfc06ecc0 0x7f2dfc071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:16.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.530+0000 7f2e067fc640 1 -- 172.21.15.119:0/3296651484 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2e000ad210 con 0x7f2e100fd820 2024-09-13T21:38:16.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.530+0000 7f2e159fa640 1 --2- 172.21.15.119:0/3296651484 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2dfc06ecc0 0x7f2dfc071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:16.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.530+0000 7f2e159fa640 1 --2- 172.21.15.119:0/3296651484 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2dfc06ecc0 0x7f2dfc071170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0041d0 tx=0x7f2e0c009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:16.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.534+0000 7f2e067fc640 1 -- 172.21.15.119:0/3296651484 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2e0007b410 con 0x7f2e100fd820 2024-09-13T21:38:16.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:16.704+0000 7f2e17c5e640 1 -- 172.21.15.119:0/3296651484 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e1010ee90 con 0x7f2dfc06ecc0 2024-09-13T21:38:17.328 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:17 smithi119 ceph-mon[27653]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:17.328 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:38:17.328 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:38:17.328 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:17.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:17 smithi155 ceph-mon[34732]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:17.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:38:17.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:38:17.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:18.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:18 smithi155 ceph-mon[34732]: from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:38:18.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:18 smithi119 ceph-mon[27653]: from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:38:19.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:19 smithi119 ceph-mon[27653]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:19.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:19 smithi155 ceph-mon[34732]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:20.699 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:20 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:20.700 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:20 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:20.700 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:20 smithi119 ceph-mon[27653]: Reconfiguring prometheus.smithi119 (dependencies changed)... 2024-09-13T21:38:20.700 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:20 smithi119 ceph-mon[27653]: Reconfiguring daemon prometheus.smithi119 on smithi119 2024-09-13T21:38:20.700 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:20 smithi119 ceph-mon[27653]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:20.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:20 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:20.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:20 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:20.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:20 smithi155 ceph-mon[34732]: Reconfiguring prometheus.smithi119 (dependencies changed)... 2024-09-13T21:38:20.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:20 smithi155 ceph-mon[34732]: Reconfiguring daemon prometheus.smithi119 on smithi119 2024-09-13T21:38:20.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:20 smithi155 ceph-mon[34732]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:21 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2657797814' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e8b172e-d14d-4fe7-9e19-a623844ddaba"}]: dispatch 2024-09-13T21:38:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:21 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2657797814' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e8b172e-d14d-4fe7-9e19-a623844ddaba"}]': finished 2024-09-13T21:38:21.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:21 smithi155 ceph-mon[34732]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T21:38:21.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:21 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:38:21.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:21 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1334777029' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:38:21.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:21 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2657797814' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e8b172e-d14d-4fe7-9e19-a623844ddaba"}]: dispatch 2024-09-13T21:38:21.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:21 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2657797814' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e8b172e-d14d-4fe7-9e19-a623844ddaba"}]': finished 2024-09-13T21:38:21.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:21 smithi119 ceph-mon[27653]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T21:38:21.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:21 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:38:21.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:21 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1334777029' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:38:22.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:22 smithi155 ceph-mon[34732]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:22.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:22 smithi119 ceph-mon[27653]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:24.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:24 smithi119 ceph-mon[27653]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:25.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:24 smithi155 ceph-mon[34732]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:27.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:26 smithi155 ceph-mon[34732]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:27.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:26 smithi119 ceph-mon[27653]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:28.809 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:28 smithi119 ceph-mon[27653]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:29.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:28 smithi155 ceph-mon[34732]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:29.932 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:30.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:29 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:31.136 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:31 smithi119 ceph-mon[27653]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:31.136 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:31.136 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:31.136 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:31 smithi119 ceph-mon[27653]: Reconfiguring crash.smithi155 (monmap changed)... 2024-09-13T21:38:31.136 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:38:31.136 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:31.136 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:31 smithi119 ceph-mon[27653]: Reconfiguring daemon crash.smithi155 on smithi155 2024-09-13T21:38:31.295 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:31 smithi155 ceph-mon[34732]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:31.295 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:31 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:31.295 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:31 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:31.295 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:31 smithi155 ceph-mon[34732]: Reconfiguring crash.smithi155 (monmap changed)... 2024-09-13T21:38:31.295 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:31 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:38:31.296 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:31 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:31.296 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:31 smithi155 ceph-mon[34732]: Reconfiguring daemon crash.smithi155 on smithi155 2024-09-13T21:38:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:32 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:38:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:32 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:32 smithi119 ceph-mon[27653]: Deploying daemon osd.0 on smithi119 2024-09-13T21:38:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:32 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:32 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:32 smithi119 ceph-mon[27653]: Reconfiguring mgr.smithi155.wuuxfd (monmap changed)... 2024-09-13T21:38:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:32 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.wuuxfd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:38:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:32 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:38:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:32 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:32.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:32 smithi119 ceph-mon[27653]: Reconfiguring daemon mgr.smithi155.wuuxfd on smithi155 2024-09-13T21:38:32.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:32 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:38:32.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:32 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:32.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:32 smithi155 ceph-mon[34732]: Deploying daemon osd.0 on smithi119 2024-09-13T21:38:32.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:32 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:32.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:32 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:32.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:32 smithi155 ceph-mon[34732]: Reconfiguring mgr.smithi155.wuuxfd (monmap changed)... 2024-09-13T21:38:32.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:32 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.wuuxfd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:38:32.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:32 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:38:32.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:32 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:32.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:32 smithi155 ceph-mon[34732]: Reconfiguring daemon mgr.smithi155.wuuxfd on smithi155 2024-09-13T21:38:33.613 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:33 smithi119 ceph-mon[27653]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:33.613 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:33.613 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:33.613 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:38:33.613 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:38:33.614 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:33.614 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:33 smithi155 ceph-mon[34732]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:33.615 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:33.615 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:33.615 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:38:33.615 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:38:33.615 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:34.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: Reconfiguring mon.smithi155 (monmap changed)... 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: Reconfiguring daemon mon.smithi155 on smithi155 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi119.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi119.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi119.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:34.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:34.641 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: Reconfiguring mon.smithi155 (monmap changed)... 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: Reconfiguring daemon mon.smithi155 on smithi155 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi119.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi119.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi119.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T21:38:34.642 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:34.643 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:35.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:35 smithi155 ceph-mon[34732]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:35.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:35 smithi155 ceph-mon[34732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:38:35.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:35 smithi155 ceph-mon[34732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi119.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T21:38:35.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:35 smithi155 ceph-mon[34732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:38:35.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:35 smithi155 ceph-mon[34732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi119.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T21:38:35.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:35 smithi155 ceph-mon[34732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:38:35.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:35 smithi155 ceph-mon[34732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi119.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T21:38:35.593 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:35 smithi119 ceph-mon[27653]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:35.593 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:35 smithi119 ceph-mon[27653]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:38:35.593 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:35 smithi119 ceph-mon[27653]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi119.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T21:38:35.593 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:35 smithi119 ceph-mon[27653]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:38:35.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:35 smithi119 ceph-mon[27653]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi119.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T21:38:35.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:35 smithi119 ceph-mon[27653]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:38:35.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:35 smithi119 ceph-mon[27653]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi119.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T21:38:36.770 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:36 smithi119 ceph-mon[27653]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:36.770 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:36.770 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:36.770 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:36.770 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:37.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:36 smithi155 ceph-mon[34732]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:37.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:36 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:37.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:36 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:37.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:36 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:37.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:36 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:38.954 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:38 smithi119 ceph-mon[27653]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:38 smithi155 ceph-mon[34732]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:40.550 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:40 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:40.551 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:40 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:40.551 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:40 smithi119 ceph-mon[27653]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:40.551 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:40 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:40.551 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:40 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:40.551 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:40 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:40.551 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:40 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:40.688 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:40 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:40.689 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:40 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:40.689 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:40 smithi155 ceph-mon[34732]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:40.689 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:40 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:40.689 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:40 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:40.689 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:40 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:40.689 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:40 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:41.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:41 smithi119 ceph-mon[27653]: from='osd.0 [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T21:38:41.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.679+0000 7f2e067fc640 1 -- 172.21.15.119:0/3296651484 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2e1010ee90 con 0x7f2dfc06ecc0 2024-09-13T21:38:41.681 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 0 on host 'smithi119' 2024-09-13T21:38:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.681+0000 7f2e17c5e640 1 -- 172.21.15.119:0/3296651484 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2dfc06ecc0 msgr2=0x7f2dfc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.681+0000 7f2e17c5e640 1 --2- 172.21.15.119:0/3296651484 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2dfc06ecc0 0x7f2dfc071170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0041d0 tx=0x7f2e0c009040 comp rx=0 tx=0).stop 2024-09-13T21:38:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.681+0000 7f2e17c5e640 1 -- 172.21.15.119:0/3296651484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e100fd820 msgr2=0x7f2e1010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.681+0000 7f2e17c5e640 1 --2- 172.21.15.119:0/3296651484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e100fd820 0x7f2e1010d5f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2e00003080 tx=0x7f2e00009da0 comp rx=0 tx=0).stop 2024-09-13T21:38:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.681+0000 7f2e17c5e640 1 -- 172.21.15.119:0/3296651484 shutdown_connections 2024-09-13T21:38:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.681+0000 7f2e17c5e640 1 --2- 172.21.15.119:0/3296651484 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2dfc06ecc0 0x7f2dfc071170 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.681+0000 7f2e17c5e640 1 --2- 172.21.15.119:0/3296651484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e100fd820 0x7f2e1010d5f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.681+0000 7f2e17c5e640 1 --2- 172.21.15.119:0/3296651484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e100fc550 0x7f2e1010d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.681+0000 7f2e17c5e640 1 -- 172.21.15.119:0/3296651484 >> 172.21.15.119:0/3296651484 conn(0x7f2e100f7d30 msgr2=0x7f2e100f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.681+0000 7f2e17c5e640 1 -- 172.21.15.119:0/3296651484 shutdown_connections 2024-09-13T21:38:41.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:41.681+0000 7f2e17c5e640 1 -- 172.21.15.119:0/3296651484 wait complete. 2024-09-13T21:38:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:41 smithi155 ceph-mon[34732]: from='osd.0 [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T21:38:42.275 DEBUG:teuthology.orchestra.run.smithi119:osd.0> sudo journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T21:38:42.277 INFO:tasks.cephadm:Deploying osd.1 on smithi119 with /dev/vg_nvme/lv_3... 2024-09-13T21:38:42.278 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T21:38:42.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:42 smithi155 ceph-mon[34732]: from='osd.0 [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T21:38:42.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:42 smithi155 ceph-mon[34732]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T21:38:42.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:42 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:38:42.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:42 smithi155 ceph-mon[34732]: from='osd.0 [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:38:42.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:42 smithi155 ceph-mon[34732]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:42.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:42 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:42.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:42 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:42.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:42 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:42.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:42 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:42 smithi119 ceph-mon[27653]: from='osd.0 [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T21:38:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:42 smithi119 ceph-mon[27653]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T21:38:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:42 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:38:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:42 smithi119 ceph-mon[27653]: from='osd.0 [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:38:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:42 smithi119 ceph-mon[27653]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T21:38:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:42 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:42 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:42 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:42 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:42.631 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:38:42 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0[45726]: 2024-09-13T21:38:42.445+0000 7fb0e2bf7640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T21:38:42.631 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:38:42 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0[45726]: 2024-09-13T21:38:42.449+0000 7fb0dea30640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:38:42.708 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:38:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:43 smithi155 ceph-mon[34732]: from='osd.0 [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-13T21:38:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:43 smithi155 ceph-mon[34732]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T21:38:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:38:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:38:43.760 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:43 smithi119 ceph-mon[27653]: from='osd.0 [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-13T21:38:43.760 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:43 smithi119 ceph-mon[27653]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T21:38:43.760 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:38:43.760 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:38:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:44 smithi119 ceph-mon[27653]: purged_snaps scrub starts 2024-09-13T21:38:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:44 smithi119 ceph-mon[27653]: purged_snaps scrub ok 2024-09-13T21:38:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:44 smithi119 ceph-mon[27653]: osd.0 [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104] boot 2024-09-13T21:38:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:44 smithi119 ceph-mon[27653]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T21:38:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:44 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:38:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:44 smithi119 ceph-mon[27653]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:44.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:44 smithi155 ceph-mon[34732]: purged_snaps scrub starts 2024-09-13T21:38:44.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:44 smithi155 ceph-mon[34732]: purged_snaps scrub ok 2024-09-13T21:38:44.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:44 smithi155 ceph-mon[34732]: osd.0 [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104] boot 2024-09-13T21:38:44.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:44 smithi155 ceph-mon[34732]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T21:38:44.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:44 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:38:44.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:44 smithi155 ceph-mon[34732]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:45 smithi119 ceph-mon[27653]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T21:38:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:45.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:45 smithi155 ceph-mon[34732]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T21:38:45.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:38:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:38:46.021 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi119:vg_nvme/lv_3 2024-09-13T21:38:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:46 smithi119 ceph-mon[27653]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:46.679 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:38:46.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:46 smithi155 ceph-mon[34732]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:48.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.710+0000 7f735036c640 1 -- 172.21.15.119:0/3308195066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73480fe760 msgr2=0x7f73480feb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:48.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.710+0000 7f735036c640 1 --2- 172.21.15.119:0/3308195066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73480fe760 0x7f73480feb70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f73440048d0 tx=0x7f7344009da0 comp rx=0 tx=0).stop 2024-09-13T21:38:48.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.710+0000 7f735036c640 1 -- 172.21.15.119:0/3308195066 shutdown_connections 2024-09-13T21:38:48.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.710+0000 7f735036c640 1 --2- 172.21.15.119:0/3308195066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73480ffa30 0x7f73480ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:48.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.710+0000 7f735036c640 1 --2- 172.21.15.119:0/3308195066 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73480fe760 0x7f73480feb70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:48.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.710+0000 7f735036c640 1 -- 172.21.15.119:0/3308195066 >> 172.21.15.119:0/3308195066 conn(0x7f73480fa060 msgr2=0x7f73480fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:38:48.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.710+0000 7f735036c640 1 -- 172.21.15.119:0/3308195066 shutdown_connections 2024-09-13T21:38:48.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.710+0000 7f735036c640 1 -- 172.21.15.119:0/3308195066 wait complete. 2024-09-13T21:38:48.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.710+0000 7f735036c640 1 Processor -- start 2024-09-13T21:38:48.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.710+0000 7f735036c640 1 -- start start 2024-09-13T21:38:48.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f735036c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73480fe760 0x7f734810f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:48.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f735036c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73480ffa30 0x7f734810f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:48.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f735036c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7348110670 con 0x7f73480fe760 2024-09-13T21:38:48.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f735036c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73481107e0 con 0x7f73480ffa30 2024-09-13T21:38:48.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f734e108640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73480fe760 0x7f734810f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:48.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f734e108640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73480fe760 0x7f734810f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51922/0 (socket says 172.21.15.119:51922) 2024-09-13T21:38:48.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f734e108640 1 -- 172.21.15.119:0/1517257171 learned_addr learned my addr 172.21.15.119:0/1517257171 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:38:48.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f734e108640 1 -- 172.21.15.119:0/1517257171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73480ffa30 msgr2=0x7f734810f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:38:48.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f734d907640 1 --2- 172.21.15.119:0/1517257171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73480ffa30 0x7f734810f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:48.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f734e108640 1 --2- 172.21.15.119:0/1517257171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73480ffa30 0x7f734810f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:38:48.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f734e108640 1 -- 172.21.15.119:0/1517257171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7344005040 con 0x7f73480fe760 2024-09-13T21:38:48.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f734e108640 1 --2- 172.21.15.119:0/1517257171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73480fe760 0x7f734810f2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7344003080 tx=0x7f7344009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:48.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f733effd640 1 -- 172.21.15.119:0/1517257171 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7344038070 con 0x7f73480fe760 2024-09-13T21:38:48.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f733effd640 1 -- 172.21.15.119:0/1517257171 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7344009800 con 0x7f73480fe760 2024-09-13T21:38:48.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f733effd640 1 -- 172.21.15.119:0/1517257171 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7344033660 con 0x7f73480fe760 2024-09-13T21:38:48.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.711+0000 7f735036c640 1 -- 172.21.15.119:0/1517257171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7348110a60 con 0x7f73480fe760 2024-09-13T21:38:48.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.712+0000 7f735036c640 1 -- 172.21.15.119:0/1517257171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7348110f20 con 0x7f73480fe760 2024-09-13T21:38:48.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.713+0000 7f735036c640 1 -- 172.21.15.119:0/1517257171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73481079f0 con 0x7f73480fe760 2024-09-13T21:38:48.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.713+0000 7f733effd640 1 -- 172.21.15.119:0/1517257171 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f7344030020 con 0x7f73480fe760 2024-09-13T21:38:48.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.713+0000 7f733effd640 1 --2- 172.21.15.119:0/1517257171 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f733406ecc0 0x7f7334071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:38:48.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.714+0000 7f733effd640 1 -- 172.21.15.119:0/1517257171 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f73440ad470 con 0x7f73480fe760 2024-09-13T21:38:48.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.714+0000 7f734d907640 1 --2- 172.21.15.119:0/1517257171 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f733406ecc0 0x7f7334071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:38:48.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.714+0000 7f734d907640 1 --2- 172.21.15.119:0/1517257171 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f733406ecc0 0x7f7334071170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f734810f070 tx=0x7f7338008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:38:48.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.718+0000 7f733effd640 1 -- 172.21.15.119:0/1517257171 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f734407b410 con 0x7f73480fe760 2024-09-13T21:38:48.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:48 smithi119 ceph-mon[27653]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:48.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:48 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:48.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:48 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:48.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:38:48.900+0000 7f735036c640 1 -- 172.21.15.119:0/1517257171 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7348111140 con 0x7f733406ecc0 2024-09-13T21:38:49.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:48 smithi155 ceph-mon[34732]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:49.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:48 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:49.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:48 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:50.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:49 smithi155 ceph-mon[34732]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:38:50.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:49 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:38:50.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:49 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:38:50.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:49 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:50.112 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:49 smithi119 ceph-mon[27653]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:38:50.112 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:49 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:38:50.112 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:49 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:38:50.112 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:49 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:50.984 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:50 smithi119 ceph-mon[27653]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:51.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:50 smithi155 ceph-mon[34732]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:53.522 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:53.523 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: Detected new or changed devices on smithi119 2024-09-13T21:38:53.523 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:53.523 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:53.523 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:38:53.523 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: Adjusting osd_memory_target on smithi119 to 12864M 2024-09-13T21:38:53.523 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:53.523 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:53.523 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:53.523 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:53.523 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:53.524 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/871009889' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20f7ea98-15de-439f-94c4-9b9cf453b74d"}]: dispatch 2024-09-13T21:38:53.524 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/871009889' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20f7ea98-15de-439f-94c4-9b9cf453b74d"}]': finished 2024-09-13T21:38:53.524 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T21:38:53.524 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:38:53.575 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:53.575 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: Detected new or changed devices on smithi119 2024-09-13T21:38:53.575 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:53.575 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:53.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:38:53.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: Adjusting osd_memory_target on smithi119 to 12864M 2024-09-13T21:38:53.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:53.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:53.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:53.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:53.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:38:53.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/871009889' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20f7ea98-15de-439f-94c4-9b9cf453b74d"}]: dispatch 2024-09-13T21:38:53.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/871009889' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20f7ea98-15de-439f-94c4-9b9cf453b74d"}]': finished 2024-09-13T21:38:53.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T21:38:53.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:38:54.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:54 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1561459337' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:38:54.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:54 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:54.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:54 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:54.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:54 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1561459337' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:38:54.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:54 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:54.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:54 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:55 smithi155 ceph-mon[34732]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:55 smithi119 ceph-mon[27653]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:57.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:57 smithi119 ceph-mon[27653]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:57.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:57 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:57.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:57 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:57.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:57 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:57.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:57 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:57.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:57 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:57 smithi155 ceph-mon[34732]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:57 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:57 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:57 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:38:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:57 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:38:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:57 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:38:59.502 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:38:59 smithi119 ceph-mon[27653]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:38:59.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:38:59 smithi155 ceph-mon[34732]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:00 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:00 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:01 smithi155 ceph-mon[34732]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:01 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:39:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:01 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:01 smithi119 ceph-mon[27653]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:01 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:39:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:01 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:02.338 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:02 smithi119 ceph-mon[27653]: Deploying daemon osd.1 on smithi119 2024-09-13T21:39:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:02 smithi155 ceph-mon[34732]: Deploying daemon osd.1 on smithi119 2024-09-13T21:39:03.578 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:03 smithi119 ceph-mon[27653]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:03 smithi155 ceph-mon[34732]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:05.443 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:05 smithi119 ceph-mon[27653]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:05.443 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:05 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:05.443 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:05 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:05.443 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:05 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:05 smithi155 ceph-mon[34732]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:05 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:05 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:05 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:07.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:07 smithi119 ceph-mon[27653]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:07 smithi155 ceph-mon[34732]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:08.284 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 1 on host 'smithi119' 2024-09-13T21:39:08.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.281+0000 7f733effd640 1 -- 172.21.15.119:0/1517257171 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7348111140 con 0x7f733406ecc0 2024-09-13T21:39:08.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.284+0000 7f735036c640 1 -- 172.21.15.119:0/1517257171 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f733406ecc0 msgr2=0x7f7334071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:08.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.284+0000 7f735036c640 1 --2- 172.21.15.119:0/1517257171 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f733406ecc0 0x7f7334071170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f734810f070 tx=0x7f7338008040 comp rx=0 tx=0).stop 2024-09-13T21:39:08.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.284+0000 7f735036c640 1 -- 172.21.15.119:0/1517257171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73480fe760 msgr2=0x7f734810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:08.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.284+0000 7f735036c640 1 --2- 172.21.15.119:0/1517257171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73480fe760 0x7f734810f2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7344003080 tx=0x7f7344009da0 comp rx=0 tx=0).stop 2024-09-13T21:39:08.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.284+0000 7f735036c640 1 -- 172.21.15.119:0/1517257171 shutdown_connections 2024-09-13T21:39:08.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.284+0000 7f735036c640 1 --2- 172.21.15.119:0/1517257171 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f733406ecc0 0x7f7334071170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:08.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.284+0000 7f735036c640 1 --2- 172.21.15.119:0/1517257171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73480ffa30 0x7f734810f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:08.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.284+0000 7f735036c640 1 --2- 172.21.15.119:0/1517257171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73480fe760 0x7f734810f2c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:08.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.284+0000 7f735036c640 1 -- 172.21.15.119:0/1517257171 >> 172.21.15.119:0/1517257171 conn(0x7f73480fa060 msgr2=0x7f73480fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:08.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.284+0000 7f735036c640 1 -- 172.21.15.119:0/1517257171 shutdown_connections 2024-09-13T21:39:08.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:08.284+0000 7f735036c640 1 -- 172.21.15.119:0/1517257171 wait complete. 2024-09-13T21:39:08.882 DEBUG:teuthology.orchestra.run.smithi119:osd.1> sudo journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T21:39:08.885 INFO:tasks.cephadm:Deploying osd.2 on smithi119 with /dev/vg_nvme/lv_2... 2024-09-13T21:39:08.885 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T21:39:09.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:09 smithi119 ceph-mon[27653]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:09.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:09 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:09.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:09 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:09.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:09 smithi119 ceph-mon[27653]: from='osd.1 [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T21:39:09.380 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:39:09 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[53646]: 2024-09-13T21:39:09.108+0000 7f56504d0440 -1 osd.1 0 log_to_monitors true 2024-09-13T21:39:09.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:09 smithi155 ceph-mon[34732]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:09.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:09 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:09.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:09 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:09.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:09 smithi155 ceph-mon[34732]: from='osd.1 [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T21:39:10.333 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:39:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:10 smithi155 ceph-mon[34732]: from='osd.1 [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T21:39:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:10 smithi155 ceph-mon[34732]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T21:39:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:10 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:39:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:10 smithi155 ceph-mon[34732]: from='osd.1 [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:39:10.630 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:39:10 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[53646]: 2024-09-13T21:39:10.320+0000 7f564bc42640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T21:39:10.630 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:39:10 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[53646]: 2024-09-13T21:39:10.324+0000 7f5646a79640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:39:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:10 smithi119 ceph-mon[27653]: from='osd.1 [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T21:39:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:10 smithi119 ceph-mon[27653]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T21:39:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:10 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:39:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:10 smithi119 ceph-mon[27653]: from='osd.1 [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:39:11.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:11 smithi119 ceph-mon[27653]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:11.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:11 smithi119 ceph-mon[27653]: from='osd.1 [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-13T21:39:11.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:11 smithi119 ceph-mon[27653]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T21:39:11.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:39:11.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:39:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:11 smithi155 ceph-mon[34732]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T21:39:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:11 smithi155 ceph-mon[34732]: from='osd.1 [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-13T21:39:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:11 smithi155 ceph-mon[34732]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T21:39:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:39:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:39:12.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:12 smithi119 ceph-mon[27653]: purged_snaps scrub starts 2024-09-13T21:39:12.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:12 smithi119 ceph-mon[27653]: purged_snaps scrub ok 2024-09-13T21:39:12.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:12 smithi119 ceph-mon[27653]: osd.1 [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795] boot 2024-09-13T21:39:12.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:12 smithi119 ceph-mon[27653]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T21:39:12.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:12 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:39:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:12 smithi155 ceph-mon[34732]: purged_snaps scrub starts 2024-09-13T21:39:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:12 smithi155 ceph-mon[34732]: purged_snaps scrub ok 2024-09-13T21:39:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:12 smithi155 ceph-mon[34732]: osd.1 [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795] boot 2024-09-13T21:39:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:12 smithi155 ceph-mon[34732]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T21:39:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:12 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:39:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:13 smithi155 ceph-mon[34732]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:13 smithi155 ceph-mon[34732]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T21:39:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:13 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:13 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:13 smithi119 ceph-mon[27653]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:13 smithi119 ceph-mon[27653]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T21:39:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:13 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:13 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:14.151 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:39:14.172 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi119:vg_nvme/lv_2 2024-09-13T21:39:15.434 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:39:15.557 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:15 smithi119 ceph-mon[27653]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:15.557 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:15.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:15 smithi155 ceph-mon[34732]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:15.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:17.610 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:17 smithi119 ceph-mon[27653]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:17.610 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:17.610 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:17.610 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:39:17.610 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:39:17.610 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:17.610 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:17.610 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:39:17.610 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:17.610 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.686+0000 7fa15cc1e640 1 -- 172.21.15.119:0/2857049587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa158065be0 msgr2=0x7fa1580ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.686+0000 7fa15cc1e640 1 --2- 172.21.15.119:0/2857049587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa158065be0 0x7fa1580ff1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa148009c50 tx=0x7fa148004d10 comp rx=0 tx=0).stop 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 -- 172.21.15.119:0/2857049587 shutdown_connections 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 --2- 172.21.15.119:0/2857049587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1580ff6e0 0x7fa158101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 --2- 172.21.15.119:0/2857049587 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa158065be0 0x7fa1580ff1a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 -- 172.21.15.119:0/2857049587 >> 172.21.15.119:0/2857049587 conn(0x7fa1580f6c10 msgr2=0x7fa1580f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 -- 172.21.15.119:0/2857049587 shutdown_connections 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 -- 172.21.15.119:0/2857049587 wait complete. 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 Processor -- start 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 -- start start 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa158065be0 0x7fa15810d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1580ff6e0 0x7fa15810d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15810e500 con 0x7fa1580ff6e0 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa15cc1e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15810e670 con 0x7fa158065be0 2024-09-13T21:39:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa155d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1580ff6e0 0x7fa15810d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa155d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1580ff6e0 0x7fa15810d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60380/0 (socket says 172.21.15.119:60380) 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.687+0000 7fa155d9b640 1 -- 172.21.15.119:0/3629033328 learned_addr learned my addr 172.21.15.119:0/3629033328 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.688+0000 7fa15659c640 1 --2- 172.21.15.119:0/3629033328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa158065be0 0x7fa15810d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.688+0000 7fa155d9b640 1 -- 172.21.15.119:0/3629033328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa158065be0 msgr2=0x7fa15810d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.688+0000 7fa155d9b640 1 --2- 172.21.15.119:0/3629033328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa158065be0 0x7fa15810d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.688+0000 7fa155d9b640 1 -- 172.21.15.119:0/3629033328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480098b0 con 0x7fa1580ff6e0 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.688+0000 7fa155d9b640 1 --2- 172.21.15.119:0/3629033328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1580ff6e0 0x7fa15810d6e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa14000b790 tx=0x7fa1400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.688+0000 7fa14effd640 1 -- 172.21.15.119:0/3629033328 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa14000c700 con 0x7fa1580ff6e0 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.688+0000 7fa15cc1e640 1 -- 172.21.15.119:0/3629033328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15810e950 con 0x7fa1580ff6e0 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.688+0000 7fa14effd640 1 -- 172.21.15.119:0/3629033328 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa14000cd00 con 0x7fa1580ff6e0 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.688+0000 7fa14effd640 1 -- 172.21.15.119:0/3629033328 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa140015e70 con 0x7fa1580ff6e0 2024-09-13T21:39:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.688+0000 7fa15cc1e640 1 -- 172.21.15.119:0/3629033328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15810ee70 con 0x7fa1580ff6e0 2024-09-13T21:39:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.689+0000 7fa15cc1e640 1 -- 172.21.15.119:0/3629033328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1580fa890 con 0x7fa1580ff6e0 2024-09-13T21:39:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.690+0000 7fa14effd640 1 -- 172.21.15.119:0/3629033328 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7fa140012070 con 0x7fa1580ff6e0 2024-09-13T21:39:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.690+0000 7fa14effd640 1 --2- 172.21.15.119:0/3629033328 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa14406ecc0 0x7fa144071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.690+0000 7fa14effd640 1 -- 172.21.15.119:0/3629033328 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7fa14008d430 con 0x7fa1580ff6e0 2024-09-13T21:39:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.690+0000 7fa15659c640 1 --2- 172.21.15.119:0/3629033328 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa14406ecc0 0x7fa144071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.691+0000 7fa15659c640 1 --2- 172.21.15.119:0/3629033328 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa14406ecc0 0x7fa144071170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa14802a940 tx=0x7fa148004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.696+0000 7fa14effd640 1 -- 172.21.15.119:0/3629033328 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa14005b2a0 con 0x7fa1580ff6e0 2024-09-13T21:39:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:17 smithi155 ceph-mon[34732]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:39:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:39:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:39:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:17.872+0000 7fa15cc1e640 1 -- 172.21.15.119:0/3629033328 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa15810f0f0 con 0x7fa14406ecc0 2024-09-13T21:39:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:18 smithi119 ceph-mon[27653]: Detected new or changed devices on smithi119 2024-09-13T21:39:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:18 smithi119 ceph-mon[27653]: Adjusting osd_memory_target on smithi119 to 6432M 2024-09-13T21:39:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:18 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:39:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:18 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:39:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:18 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:18 smithi155 ceph-mon[34732]: Detected new or changed devices on smithi119 2024-09-13T21:39:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:18 smithi155 ceph-mon[34732]: Adjusting osd_memory_target on smithi119 to 6432M 2024-09-13T21:39:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:18 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:39:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:18 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:39:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:18 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:19.504 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:19 smithi119 ceph-mon[27653]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:19.504 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:19 smithi119 ceph-mon[27653]: from='client.14276 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:19 smithi155 ceph-mon[34732]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:19 smithi155 ceph-mon[34732]: from='client.14276 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:21 smithi119 ceph-mon[27653]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:21 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3526764818' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a363ab32-96ac-4960-8a67-01dbf5ee5016"}]: dispatch 2024-09-13T21:39:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:21 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3526764818' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a363ab32-96ac-4960-8a67-01dbf5ee5016"}]': finished 2024-09-13T21:39:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:21 smithi119 ceph-mon[27653]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T21:39:21.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:21 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:21 smithi155 ceph-mon[34732]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:21 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3526764818' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a363ab32-96ac-4960-8a67-01dbf5ee5016"}]: dispatch 2024-09-13T21:39:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:21 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3526764818' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a363ab32-96ac-4960-8a67-01dbf5ee5016"}]': finished 2024-09-13T21:39:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:21 smithi155 ceph-mon[34732]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T21:39:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:21 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:22.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:22 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2675308816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:39:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:22 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2675308816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:39:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:23 smithi155 ceph-mon[34732]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:23 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:23 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:23 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:23 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:39:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:23 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:23 smithi119 ceph-mon[27653]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:23 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:23 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:23 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:23 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:39:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:23 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:25.616 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:25 smithi119 ceph-mon[27653]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:25 smithi155 ceph-mon[34732]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:27.556 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:27 smithi119 ceph-mon[27653]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:27 smithi155 ceph-mon[34732]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:29.565 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:29 smithi119 ceph-mon[27653]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:29.565 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:39:29.565 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:29.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:29 smithi155 ceph-mon[34732]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:29.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:29 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:39:29.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:29 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:30 smithi119 ceph-mon[27653]: Deploying daemon osd.2 on smithi119 2024-09-13T21:39:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:30 smithi155 ceph-mon[34732]: Deploying daemon osd.2 on smithi119 2024-09-13T21:39:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:31.609 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:31 smithi119 ceph-mon[27653]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:31.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:31 smithi155 ceph-mon[34732]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:33 smithi155 ceph-mon[34732]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:33.706 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:33 smithi119 ceph-mon[27653]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:33.706 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:33.706 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:33.707 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:35.504 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:35 smithi119 ceph-mon[27653]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:35.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:35 smithi155 ceph-mon[34732]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:36.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.688+0000 7fa14effd640 1 -- 172.21.15.119:0/3629033328 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa15810f0f0 con 0x7fa14406ecc0 2024-09-13T21:39:36.690 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 2 on host 'smithi119' 2024-09-13T21:39:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.690+0000 7fa15cc1e640 1 -- 172.21.15.119:0/3629033328 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa14406ecc0 msgr2=0x7fa144071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.690+0000 7fa15cc1e640 1 --2- 172.21.15.119:0/3629033328 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa14406ecc0 0x7fa144071170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa14802a940 tx=0x7fa148004d10 comp rx=0 tx=0).stop 2024-09-13T21:39:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.690+0000 7fa15cc1e640 1 -- 172.21.15.119:0/3629033328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1580ff6e0 msgr2=0x7fa15810d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.690+0000 7fa15cc1e640 1 --2- 172.21.15.119:0/3629033328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1580ff6e0 0x7fa15810d6e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa14000b790 tx=0x7fa1400091d0 comp rx=0 tx=0).stop 2024-09-13T21:39:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.690+0000 7fa15cc1e640 1 -- 172.21.15.119:0/3629033328 shutdown_connections 2024-09-13T21:39:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.690+0000 7fa15cc1e640 1 --2- 172.21.15.119:0/3629033328 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa14406ecc0 0x7fa144071170 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:36.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.690+0000 7fa15cc1e640 1 --2- 172.21.15.119:0/3629033328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1580ff6e0 0x7fa15810d6e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.690+0000 7fa15cc1e640 1 --2- 172.21.15.119:0/3629033328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa158065be0 0x7fa15810d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.690+0000 7fa15cc1e640 1 -- 172.21.15.119:0/3629033328 >> 172.21.15.119:0/3629033328 conn(0x7fa1580f6c10 msgr2=0x7fa1580f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.690+0000 7fa15cc1e640 1 -- 172.21.15.119:0/3629033328 shutdown_connections 2024-09-13T21:39:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:39:36.690+0000 7fa15cc1e640 1 -- 172.21.15.119:0/3629033328 wait complete. 2024-09-13T21:39:37.326 DEBUG:teuthology.orchestra.run.smithi119:osd.2> sudo journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T21:39:37.328 INFO:tasks.cephadm:Deploying osd.3 on smithi155 with /dev/vg_nvme/lv_4... 2024-09-13T21:39:37.329 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T21:39:37.580 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:37 smithi119 ceph-mon[27653]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:37.580 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:37 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:37.580 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:37 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:37.580 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:37 smithi119 ceph-mon[27653]: from='osd.2 [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T21:39:37.584 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi155/config 2024-09-13T21:39:37.706 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:37 smithi155 ceph-mon[34732]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:37.706 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:37 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:37.706 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:37 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:37.706 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:37 smithi155 ceph-mon[34732]: from='osd.2 [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T21:39:38.812 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:38 smithi155 ceph-mon[34732]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:38.813 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:38 smithi155 ceph-mon[34732]: from='osd.2 [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T21:39:38.813 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:38 smithi155 ceph-mon[34732]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T21:39:38.813 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:38 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:38.813 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:38 smithi155 ceph-mon[34732]: from='osd.2 [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:39:38.977 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:38 smithi119 ceph-mon[27653]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:38.977 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:38 smithi119 ceph-mon[27653]: from='osd.2 [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T21:39:38.977 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:38 smithi119 ceph-mon[27653]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T21:39:38.978 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:38 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:38.978 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:38 smithi119 ceph-mon[27653]: from='osd.2 [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:39:38.978 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:39:38 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2[61050]: 2024-09-13T21:39:38.697+0000 7f7756d50640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T21:39:38.978 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:39:38 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2[61050]: 2024-09-13T21:39:38.704+0000 7f7751b87640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:39:39.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:39 smithi155 ceph-mon[34732]: from='osd.2 [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-13T21:39:39.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:39 smithi155 ceph-mon[34732]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T21:39:39.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:39 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:39.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:39 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:39.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:39 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:39.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:39 smithi119 ceph-mon[27653]: from='osd.2 [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-13T21:39:39.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:39 smithi119 ceph-mon[27653]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T21:39:39.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:39 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:39.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:39 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:39.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:39 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:39.888 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:39:39.909 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_4 2024-09-13T21:39:40.154 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi155/config 2024-09-13T21:39:41.019 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:40 smithi119 ceph-mon[27653]: purged_snaps scrub starts 2024-09-13T21:39:41.019 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:40 smithi119 ceph-mon[27653]: purged_snaps scrub ok 2024-09-13T21:39:41.019 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:40 smithi119 ceph-mon[27653]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:41.019 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:40 smithi119 ceph-mon[27653]: osd.2 [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891] boot 2024-09-13T21:39:41.019 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:40 smithi119 ceph-mon[27653]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T21:39:41.019 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:40 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:41.019 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:40 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-13T21:39:41.019 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:40 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:41.019 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:40 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:41.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:40 smithi155 ceph-mon[34732]: purged_snaps scrub starts 2024-09-13T21:39:41.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:40 smithi155 ceph-mon[34732]: purged_snaps scrub ok 2024-09-13T21:39:41.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:40 smithi155 ceph-mon[34732]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T21:39:41.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:40 smithi155 ceph-mon[34732]: osd.2 [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891] boot 2024-09-13T21:39:41.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:40 smithi155 ceph-mon[34732]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T21:39:41.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:40 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:39:41.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:40 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-13T21:39:41.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:40 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:41.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:40 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.609+0000 7f77c8ed7640 1 -- 172.21.15.155:0/96182807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77c40fc520 msgr2=0x7f77c40fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.609+0000 7f77c8ed7640 1 --2- 172.21.15.155:0/96182807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77c40fc520 0x7f77c40fc930 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f77b40048d0 tx=0x7f77b4009da0 comp rx=0 tx=0).stop 2024-09-13T21:39:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.609+0000 7f77c8ed7640 1 -- 172.21.15.155:0/96182807 shutdown_connections 2024-09-13T21:39:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.609+0000 7f77c8ed7640 1 --2- 172.21.15.155:0/96182807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77c40fd7f0 0x7f77c40fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.609+0000 7f77c8ed7640 1 --2- 172.21.15.155:0/96182807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77c40fc520 0x7f77c40fc930 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.609+0000 7f77c8ed7640 1 -- 172.21.15.155:0/96182807 >> 172.21.15.155:0/96182807 conn(0x7f77c40f7ce0 msgr2=0x7f77c40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.609+0000 7f77c8ed7640 1 -- 172.21.15.155:0/96182807 shutdown_connections 2024-09-13T21:39:41.616 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.609+0000 7f77c8ed7640 1 -- 172.21.15.155:0/96182807 wait complete. 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c8ed7640 1 Processor -- start 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c8ed7640 1 -- start start 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c8ed7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77c40fc520 0x7f77c410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c8ed7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77c40fd7f0 0x7f77c410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c8ed7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c410dc10 con 0x7f77c40fd7f0 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c8ed7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c410e430 con 0x7f77c40fc520 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77c40fc520 0x7f77c410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77c40fc520 0x7f77c410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44150/0 (socket says 172.21.15.155:44150) 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c259c640 1 -- 172.21.15.155:0/203648221 learned_addr learned my addr 172.21.15.155:0/203648221 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c1d9b640 1 --2- 172.21.15.155:0/203648221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77c40fd7f0 0x7f77c410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c259c640 1 -- 172.21.15.155:0/203648221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77c40fd7f0 msgr2=0x7f77c410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:41.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c259c640 1 --2- 172.21.15.155:0/203648221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77c40fd7f0 0x7f77c410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c259c640 1 -- 172.21.15.155:0/203648221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b4005040 con 0x7f77c40fc520 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.610+0000 7f77c259c640 1 --2- 172.21.15.155:0/203648221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77c40fc520 0x7f77c410d080 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f77b40043d0 tx=0x7f77b4009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.611+0000 7f77baffd640 1 -- 172.21.15.155:0/203648221 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77b4038070 con 0x7f77c40fc520 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.611+0000 7f77baffd640 1 -- 172.21.15.155:0/203648221 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f77b402ae90 con 0x7f77c40fc520 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.611+0000 7f77c8ed7640 1 -- 172.21.15.155:0/203648221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c410e660 con 0x7f77c40fc520 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.611+0000 7f77baffd640 1 -- 172.21.15.155:0/203648221 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77b403e670 con 0x7f77c40fc520 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.611+0000 7f77c8ed7640 1 -- 172.21.15.155:0/203648221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c410ec00 con 0x7f77c40fc520 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.612+0000 7f77c8ed7640 1 -- 172.21.15.155:0/203648221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c40fb980 con 0x7f77c40fc520 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.612+0000 7f77baffd640 1 -- 172.21.15.155:0/203648221 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f77b4030020 con 0x7f77c40fc520 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.613+0000 7f77baffd640 1 --2- 172.21.15.155:0/203648221 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77b006ecc0 0x7f77b0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.613+0000 7f77baffd640 1 -- 172.21.15.155:0/203648221 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f77b40ad880 con 0x7f77c40fc520 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.613+0000 7f77c1d9b640 1 --2- 172.21.15.155:0/203648221 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77b006ecc0 0x7f77b0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:39:41.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.614+0000 7f77c1d9b640 1 --2- 172.21.15.155:0/203648221 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77b006ecc0 0x7f77b0071170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f77c410ce30 tx=0x7f77ac00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:39:41.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.617+0000 7f77baffd640 1 -- 172.21.15.155:0/203648221 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f77b407b470 con 0x7f77c40fc520 2024-09-13T21:39:41.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:41.781+0000 7f77c8ed7640 1 -- 172.21.15.155:0/203648221 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f77c410ef30 con 0x7f77b006ecc0 2024-09-13T21:39:42.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:41 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-13T21:39:42.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:41 smithi155 ceph-mon[34732]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T21:39:42.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:41 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T21:39:42.083 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:41 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-13T21:39:42.083 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:41 smithi119 ceph-mon[27653]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T21:39:42.083 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:41 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T21:39:42.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:42 smithi155 ceph-mon[34732]: pgmap v74: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:42.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:42 smithi155 ceph-mon[34732]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T21:39:42.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:42 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T21:39:42.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:42 smithi155 ceph-mon[34732]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T21:39:42.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:42 smithi155 ceph-mon[34732]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:42.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:42 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:39:42.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:42 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:39:42.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:42 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:43.081 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:42 smithi119 ceph-mon[27653]: pgmap v74: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:43.081 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:42 smithi119 ceph-mon[27653]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T21:39:43.081 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:42 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T21:39:43.082 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:42 smithi119 ceph-mon[27653]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T21:39:43.082 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:42 smithi119 ceph-mon[27653]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:39:43.082 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:42 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:39:43.082 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:42 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:39:43.082 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:42 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:43.082 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:39:42 smithi119 sudo[64127]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T21:39:43.082 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:39:42 smithi119 sudo[64127]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:39:43.082 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:39:42 smithi119 sudo[64127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T21:39:43.082 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:39:42 smithi119 sudo[64127]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:39:43.352 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65228]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T21:39:43.352 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65228]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:39:43.352 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T21:39:43.352 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65228]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:39:43.620 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65234]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T21:39:43.620 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65234]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:39:43.620 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T21:39:43.620 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65234]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:39:43.880 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65269]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T21:39:43.880 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65269]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:39:43.880 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T21:39:43.880 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65269]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:39:43.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65272]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T21:39:43.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65272]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:39:43.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T21:39:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:39:44.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:39:44.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:39:44.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:44.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:44.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:39:44.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:44.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:44.376 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:39:43 smithi119 sudo[65272]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:39:44.377 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65307]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T21:39:44.377 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65307]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:39:44.377 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T21:39:44.377 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65307]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:39:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65310]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T21:39:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65310]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:39:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T21:39:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65310]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:39:44.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:44.643+0000 7f77baffd640 1 -- 172.21.15.155:0/203648221 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f77b402c3a0 con 0x7f77c40fc520 2024-09-13T21:39:45.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65313]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T21:39:45.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65313]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:39:45.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T21:39:45.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:44 smithi119 sudo[65313]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:39:45.138 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:44 smithi155 sudo[38127]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T21:39:45.138 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:44 smithi155 sudo[38127]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:39:45.139 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:44 smithi155 sudo[38127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T21:39:45.139 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:44 smithi155 sudo[38127]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:39:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 sudo[38130]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T21:39:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 sudo[38130]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T21:39:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 sudo[38130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 sudo[38130]: pam_unix(sudo:session): session closed for user root 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: Detected new or changed devices on smithi119 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: Adjusting osd_memory_target on smithi119 to 4288M 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='client.? 172.21.15.155:0/3841393658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c466e0be-66c9-49ba-ab51-7ba539606287"}]: dispatch 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c466e0be-66c9-49ba-ab51-7ba539606287"}]: dispatch 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c466e0be-66c9-49ba-ab51-7ba539606287"}]': finished 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:39:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T21:39:45.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='client.? 172.21.15.155:0/4040266489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:39:45.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T21:39:45.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T21:39:45.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: Cluster is now healthy 2024-09-13T21:39:45.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:39:45.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:39:45.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: mgrmap e19: smithi119.gwjxmq(active, since 2m), standbys: smithi155.wuuxfd 2024-09-13T21:39:45.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:39:45.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:39:45.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: Detected new or changed devices on smithi119 2024-09-13T21:39:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: Adjusting osd_memory_target on smithi119 to 4288M 2024-09-13T21:39:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:39:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/3841393658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c466e0be-66c9-49ba-ab51-7ba539606287"}]: dispatch 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c466e0be-66c9-49ba-ab51-7ba539606287"}]: dispatch 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c466e0be-66c9-49ba-ab51-7ba539606287"}]': finished 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/4040266489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: Cluster is now healthy 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:39:45.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: mgrmap e19: smithi119.gwjxmq(active, since 2m), standbys: smithi155.wuuxfd 2024-09-13T21:39:45.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:39:45.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:39:45.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:39:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:46 smithi155 ceph-mon[34732]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T21:39:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:46 smithi155 ceph-mon[34732]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T21:39:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:46 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:46 smithi119 ceph-mon[27653]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T21:39:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:46 smithi119 ceph-mon[27653]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T21:39:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:46 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:47 smithi155 ceph-mon[34732]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:47.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:47 smithi119 ceph-mon[27653]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:49.452 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:49 smithi119 ceph-mon[27653]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:49.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:49 smithi155 ceph-mon[34732]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:51.324 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:51 smithi155 ceph-mon[34732]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:51.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:51 smithi119 ceph-mon[27653]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:52.293 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:52 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:39:52.293 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:52 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:52.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:52 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:39:52.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:52 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:39:53.575 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:53 smithi155 ceph-mon[34732]: Deploying daemon osd.3 on smithi155 2024-09-13T21:39:53.575 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:53 smithi155 ceph-mon[34732]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:53.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:53 smithi119 ceph-mon[27653]: Deploying daemon osd.3 on smithi155 2024-09-13T21:39:53.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:53 smithi119 ceph-mon[27653]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:55.252 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:55 smithi155 ceph-mon[34732]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:55 smithi119 ceph-mon[27653]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:57 smithi155 ceph-mon[34732]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:57 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:57 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:57 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:57 smithi119 ceph-mon[27653]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:57 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:39:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:57 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:57 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:39:59.231 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 3 on host 'smithi155' 2024-09-13T21:39:59.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.229+0000 7f77baffd640 1 -- 172.21.15.155:0/203648221 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f77c410ef30 con 0x7f77b006ecc0 2024-09-13T21:39:59.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.231+0000 7f77c8ed7640 1 -- 172.21.15.155:0/203648221 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77b006ecc0 msgr2=0x7f77b0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:59.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.231+0000 7f77c8ed7640 1 --2- 172.21.15.155:0/203648221 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77b006ecc0 0x7f77b0071170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f77c410ce30 tx=0x7f77ac00b040 comp rx=0 tx=0).stop 2024-09-13T21:39:59.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.231+0000 7f77c8ed7640 1 -- 172.21.15.155:0/203648221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77c40fc520 msgr2=0x7f77c410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:39:59.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.231+0000 7f77c8ed7640 1 --2- 172.21.15.155:0/203648221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77c40fc520 0x7f77c410d080 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f77b40043d0 tx=0x7f77b4009da0 comp rx=0 tx=0).stop 2024-09-13T21:39:59.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.231+0000 7f77c8ed7640 1 -- 172.21.15.155:0/203648221 shutdown_connections 2024-09-13T21:39:59.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.231+0000 7f77c8ed7640 1 --2- 172.21.15.155:0/203648221 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77b006ecc0 0x7f77b0071170 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:59.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.231+0000 7f77c8ed7640 1 --2- 172.21.15.155:0/203648221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77c40fd7f0 0x7f77c410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:59.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.231+0000 7f77c8ed7640 1 --2- 172.21.15.155:0/203648221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77c40fc520 0x7f77c410d080 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:39:59.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.231+0000 7f77c8ed7640 1 -- 172.21.15.155:0/203648221 >> 172.21.15.155:0/203648221 conn(0x7f77c40f7ce0 msgr2=0x7f77c40f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:39:59.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.231+0000 7f77c8ed7640 1 -- 172.21.15.155:0/203648221 shutdown_connections 2024-09-13T21:39:59.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:39:59.231+0000 7f77c8ed7640 1 -- 172.21.15.155:0/203648221 wait complete. 2024-09-13T21:39:59.552 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:39:59 smithi155 ceph-mon[34732]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:39:59.564 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:39:59 smithi119 ceph-mon[27653]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:40:00.196 DEBUG:teuthology.orchestra.run.smithi155:osd.3> sudo journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T21:40:00.198 INFO:tasks.cephadm:Deploying osd.4 on smithi155 with /dev/vg_nvme/lv_3... 2024-09-13T21:40:00.199 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T21:40:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:00 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:00 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:00 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:00 smithi155 ceph-mon[34732]: overall HEALTH_OK 2024-09-13T21:40:00.584 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:40:00 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[40092]: 2024-09-13T21:40:00.330+0000 7f47eab38440 -1 osd.3 0 log_to_monitors true 2024-09-13T21:40:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:00 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:00 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:00 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:00 smithi119 ceph-mon[27653]: overall HEALTH_OK 2024-09-13T21:40:01.219 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi155/config 2024-09-13T21:40:01.482 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:01 smithi155 ceph-mon[34732]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:40:01.482 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:01 smithi155 ceph-mon[34732]: from='osd.3 [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:40:01.482 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:01 smithi155 ceph-mon[34732]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:40:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:01 smithi119 ceph-mon[27653]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:40:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:01 smithi119 ceph-mon[27653]: from='osd.3 [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:40:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:01 smithi119 ceph-mon[27653]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:40:02.333 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:40:02 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[40092]: 2024-09-13T21:40:02.243+0000 7f47e62aa640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T21:40:02.333 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:40:02 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[40092]: 2024-09-13T21:40:02.249+0000 7f47e10e1640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:40:02.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:02 smithi155 ceph-mon[34732]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T21:40:02.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:02 smithi155 ceph-mon[34732]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T21:40:02.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:02 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:02.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:02 smithi155 ceph-mon[34732]: from='osd.3 [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:02.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:02 smithi155 ceph-mon[34732]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:02.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:02 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:02.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:02 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:02 smithi119 ceph-mon[27653]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T21:40:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:02 smithi119 ceph-mon[27653]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T21:40:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:02 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:02 smithi119 ceph-mon[27653]: from='osd.3 [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:02 smithi119 ceph-mon[27653]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:02 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:02 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:03.533 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:03 smithi155 ceph-mon[34732]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:40:03.533 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:03 smithi155 ceph-mon[34732]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-13T21:40:03.533 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:03 smithi155 ceph-mon[34732]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T21:40:03.533 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:03 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:03.533 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:03 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:03.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:03 smithi119 ceph-mon[27653]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:40:03.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:03 smithi119 ceph-mon[27653]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-13T21:40:03.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:03 smithi119 ceph-mon[27653]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T21:40:03.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:03 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:03.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:03 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:04.536 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:04 smithi155 ceph-mon[34732]: purged_snaps scrub starts 2024-09-13T21:40:04.536 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:04 smithi155 ceph-mon[34732]: purged_snaps scrub ok 2024-09-13T21:40:04.536 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:04 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:04.536 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:04 smithi155 ceph-mon[34732]: osd.3 [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865] boot 2024-09-13T21:40:04.536 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:04 smithi155 ceph-mon[34732]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T21:40:04.536 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:04 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:04.541 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:40:04.564 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_3 2024-09-13T21:40:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:04 smithi119 ceph-mon[27653]: purged_snaps scrub starts 2024-09-13T21:40:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:04 smithi119 ceph-mon[27653]: purged_snaps scrub ok 2024-09-13T21:40:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:04 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:04 smithi119 ceph-mon[27653]: osd.3 [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865] boot 2024-09-13T21:40:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:04 smithi119 ceph-mon[27653]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T21:40:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:04 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:40:05.103 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi155/config 2024-09-13T21:40:05.519 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:05 smithi155 ceph-mon[34732]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:40:05.519 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:05 smithi155 ceph-mon[34732]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T21:40:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:05 smithi119 ceph-mon[27653]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T21:40:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:05 smithi119 ceph-mon[27653]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T21:40:06.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:06 smithi155 ceph-mon[34732]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T21:40:06.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:06 smithi119 ceph-mon[27653]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T21:40:07.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.348+0000 7fd6e21a0640 1 -- 172.21.15.155:0/2976167429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0fb470 msgr2=0x7fd6dc0fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:07.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.348+0000 7fd6e21a0640 1 --2- 172.21.15.155:0/2976167429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0fb470 0x7fd6dc0fb880 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0048d0 tx=0x7fd6cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:40:07.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.348+0000 7fd6e21a0640 1 -- 172.21.15.155:0/2976167429 shutdown_connections 2024-09-13T21:40:07.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.348+0000 7fd6e21a0640 1 --2- 172.21.15.155:0/2976167429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0fc740 0x7fd6dc0fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:07.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.348+0000 7fd6e21a0640 1 --2- 172.21.15.155:0/2976167429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0fb470 0x7fd6dc0fb880 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:07.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.348+0000 7fd6e21a0640 1 -- 172.21.15.155:0/2976167429 >> 172.21.15.155:0/2976167429 conn(0x7fd6dc0f6c10 msgr2=0x7fd6dc0f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:07.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.348+0000 7fd6e21a0640 1 -- 172.21.15.155:0/2976167429 shutdown_connections 2024-09-13T21:40:07.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.348+0000 7fd6e21a0640 1 -- 172.21.15.155:0/2976167429 wait complete. 2024-09-13T21:40:07.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6e21a0640 1 Processor -- start 2024-09-13T21:40:07.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6e21a0640 1 -- start start 2024-09-13T21:40:07.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6e21a0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0fb470 0x7fd6dc0ff540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:07.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6e21a0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0fc740 0x7fd6dc0fda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:07.354 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6e21a0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0fdfc0 con 0x7fd6dc0fb470 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6e21a0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0fe100 con 0x7fd6dc0fc740 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6daffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0fc740 0x7fd6dc0fda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6daffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0fc740 0x7fd6dc0fda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37018/0 (socket says 172.21.15.155:37018) 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6daffd640 1 -- 172.21.15.155:0/3783498634 learned_addr learned my addr 172.21.15.155:0/3783498634 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6db7fe640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0fb470 0x7fd6dc0ff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6daffd640 1 -- 172.21.15.155:0/3783498634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0fb470 msgr2=0x7fd6dc0ff540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6daffd640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0fb470 0x7fd6dc0ff540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6daffd640 1 -- 172.21.15.155:0/3783498634 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc005040 con 0x7fd6dc0fc740 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.349+0000 7fd6db7fe640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0fb470 0x7fd6dc0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.350+0000 7fd6daffd640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0fc740 0x7fd6dc0fda80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000eb70 tx=0x7fd6d000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.350+0000 7fd6c3fff640 1 -- 172.21.15.155:0/3783498634 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6d0007c30 con 0x7fd6dc0fc740 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.350+0000 7fd6c3fff640 1 -- 172.21.15.155:0/3783498634 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd6d000f040 con 0x7fd6dc0fc740 2024-09-13T21:40:07.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.350+0000 7fd6e21a0640 1 -- 172.21.15.155:0/3783498634 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc0fe380 con 0x7fd6dc0fc740 2024-09-13T21:40:07.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.350+0000 7fd6c3fff640 1 -- 172.21.15.155:0/3783498634 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6d00094e0 con 0x7fd6dc0fc740 2024-09-13T21:40:07.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.350+0000 7fd6e21a0640 1 -- 172.21.15.155:0/3783498634 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc115120 con 0x7fd6dc0fc740 2024-09-13T21:40:07.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.351+0000 7fd6e21a0640 1 -- 172.21.15.155:0/3783498634 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc0fa8d0 con 0x7fd6dc0fc740 2024-09-13T21:40:07.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.351+0000 7fd6c3fff640 1 -- 172.21.15.155:0/3783498634 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd6d0009640 con 0x7fd6dc0fc740 2024-09-13T21:40:07.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.352+0000 7fd6c3fff640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd6c406ed60 0x7fd6c4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:07.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.352+0000 7fd6c3fff640 1 -- 172.21.15.155:0/3783498634 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fd6d008d810 con 0x7fd6dc0fc740 2024-09-13T21:40:07.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.352+0000 7fd6db7fe640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd6c406ed60 0x7fd6c4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:07.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.353+0000 7fd6db7fe640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd6c406ed60 0x7fd6c4071210 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00b020 tx=0x7fd6cc009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:07.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.356+0000 7fd6c3fff640 1 -- 172.21.15.155:0/3783498634 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd6d005b110 con 0x7fd6dc0fc740 2024-09-13T21:40:07.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:07.518+0000 7fd6e21a0640 1 -- 172.21.15.155:0/3783498634 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6dc103fd0 con 0x7fd6c406ed60 2024-09-13T21:40:07.519 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:07.519 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:07.519 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:07.519 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:07.520 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:07.520 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:07.520 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:07.520 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:07.520 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:07.520 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:07.520 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:07.520 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:07.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:07.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:07.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:08.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:08 smithi155 ceph-mon[34732]: Detected new or changed devices on smithi155 2024-09-13T21:40:08.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:08 smithi155 ceph-mon[34732]: Adjusting osd_memory_target on smithi155 to 15936M 2024-09-13T21:40:08.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:08 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:40:08.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:08 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:40:08.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:08 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:08.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:08 smithi119 ceph-mon[27653]: Detected new or changed devices on smithi155 2024-09-13T21:40:08.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:08 smithi119 ceph-mon[27653]: Adjusting osd_memory_target on smithi155 to 15936M 2024-09-13T21:40:08.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:08 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:40:08.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:08 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:40:08.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:08 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:09.566 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:09 smithi119 ceph-mon[27653]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:09.566 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:09 smithi119 ceph-mon[27653]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-13T21:40:09.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:09 smithi155 ceph-mon[34732]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:09.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:09 smithi155 ceph-mon[34732]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-13T21:40:10.437 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:10 smithi155 ceph-mon[34732]: from='client.? 172.21.15.155:0/1974862258' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "409c56f1-9e14-455a-a229-81f504ade49a"}]: dispatch 2024-09-13T21:40:10.437 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:10 smithi155 ceph-mon[34732]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "409c56f1-9e14-455a-a229-81f504ade49a"}]: dispatch 2024-09-13T21:40:10.437 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:10 smithi155 ceph-mon[34732]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "409c56f1-9e14-455a-a229-81f504ade49a"}]': finished 2024-09-13T21:40:10.437 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:10 smithi155 ceph-mon[34732]: osdmap e29: 5 total, 4 up, 5 in 2024-09-13T21:40:10.437 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:10 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:10 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/1974862258' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "409c56f1-9e14-455a-a229-81f504ade49a"}]: dispatch 2024-09-13T21:40:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:10 smithi119 ceph-mon[27653]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "409c56f1-9e14-455a-a229-81f504ade49a"}]: dispatch 2024-09-13T21:40:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:10 smithi119 ceph-mon[27653]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "409c56f1-9e14-455a-a229-81f504ade49a"}]': finished 2024-09-13T21:40:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:10 smithi119 ceph-mon[27653]: osdmap e29: 5 total, 4 up, 5 in 2024-09-13T21:40:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:10 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:11 smithi155 ceph-mon[34732]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-13T21:40:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:11 smithi155 ceph-mon[34732]: from='client.? 172.21.15.155:0/3781862654' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:40:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:11 smithi119 ceph-mon[27653]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-13T21:40:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:11 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/3781862654' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:40:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:13 smithi155 ceph-mon[34732]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-13T21:40:13.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:13 smithi119 ceph-mon[27653]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-13T21:40:15.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:15 smithi155 ceph-mon[34732]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-13T21:40:15.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:15 smithi119 ceph-mon[27653]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-13T21:40:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:17.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:17 smithi155 ceph-mon[34732]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T21:40:17.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:40:17.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:17.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:17 smithi119 ceph-mon[27653]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T21:40:17.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:40:17.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:18.547 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:18 smithi155 ceph-mon[34732]: Deploying daemon osd.4 on smithi155 2024-09-13T21:40:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:18 smithi119 ceph-mon[27653]: Deploying daemon osd.4 on smithi155 2024-09-13T21:40:19.516 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:19 smithi155 ceph-mon[34732]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:19.553 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:19 smithi119 ceph-mon[27653]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:21 smithi155 ceph-mon[34732]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:21 smithi119 ceph-mon[27653]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:22.422 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:22 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:22.422 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:22 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:22.422 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:22 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:22 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:22 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:22 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:23 smithi155 ceph-mon[34732]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:23.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:23 smithi119 ceph-mon[27653]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:25 smithi155 ceph-mon[34732]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:25.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:25 smithi119 ceph-mon[27653]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:25.940 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 4 on host 'smithi155' 2024-09-13T21:40:25.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.937+0000 7fd6c3fff640 1 -- 172.21.15.155:0/3783498634 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd6dc103fd0 con 0x7fd6c406ed60 2024-09-13T21:40:25.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.940+0000 7fd6e21a0640 1 -- 172.21.15.155:0/3783498634 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd6c406ed60 msgr2=0x7fd6c4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:25.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.940+0000 7fd6e21a0640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd6c406ed60 0x7fd6c4071210 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00b020 tx=0x7fd6cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:40:25.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.940+0000 7fd6e21a0640 1 -- 172.21.15.155:0/3783498634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0fc740 msgr2=0x7fd6dc0fda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:25.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.940+0000 7fd6e21a0640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0fc740 0x7fd6dc0fda80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000eb70 tx=0x7fd6d000b040 comp rx=0 tx=0).stop 2024-09-13T21:40:25.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.940+0000 7fd6e21a0640 1 -- 172.21.15.155:0/3783498634 shutdown_connections 2024-09-13T21:40:25.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.940+0000 7fd6e21a0640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd6c406ed60 0x7fd6c4071210 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:25.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.940+0000 7fd6e21a0640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0fc740 0x7fd6dc0fda80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:25.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.940+0000 7fd6e21a0640 1 --2- 172.21.15.155:0/3783498634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0fb470 0x7fd6dc0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:25.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.940+0000 7fd6e21a0640 1 -- 172.21.15.155:0/3783498634 >> 172.21.15.155:0/3783498634 conn(0x7fd6dc0f6c10 msgr2=0x7fd6dc066080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:25.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.940+0000 7fd6e21a0640 1 -- 172.21.15.155:0/3783498634 shutdown_connections 2024-09-13T21:40:25.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:25.940+0000 7fd6e21a0640 1 -- 172.21.15.155:0/3783498634 wait complete. 2024-09-13T21:40:26.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:26 smithi155 ceph-mon[34732]: from='osd.4 [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:40:26.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:26 smithi155 ceph-mon[34732]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:40:26.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:26 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:26.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:26 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:26.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:26 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:26.616 DEBUG:teuthology.orchestra.run.smithi155:osd.4> sudo journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T21:40:26.618 INFO:tasks.cephadm:Deploying osd.5 on smithi155 with /dev/vg_nvme/lv_2... 2024-09-13T21:40:26.618 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T21:40:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:26 smithi119 ceph-mon[27653]: from='osd.4 [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:40:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:26 smithi119 ceph-mon[27653]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:40:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:26 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:26 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:26 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:27.347 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi155/config 2024-09-13T21:40:27.570 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:27 smithi155 ceph-mon[34732]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:27.570 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:27 smithi155 ceph-mon[34732]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T21:40:27.570 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:27 smithi155 ceph-mon[34732]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T21:40:27.570 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:27 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:27.570 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:27 smithi155 ceph-mon[34732]: from='osd.4 [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:27.571 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:27 smithi155 ceph-mon[34732]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:27.571 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:40:27 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[46867]: 2024-09-13T21:40:27.320+0000 7f21e7165640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T21:40:27.571 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:40:27 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[46867]: 2024-09-13T21:40:27.327+0000 7f21e179b640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:40:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:27 smithi119 ceph-mon[27653]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:27 smithi119 ceph-mon[27653]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T21:40:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:27 smithi119 ceph-mon[27653]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T21:40:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:27 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:27 smithi119 ceph-mon[27653]: from='osd.4 [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:27 smithi119 ceph-mon[27653]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:28.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:28 smithi155 ceph-mon[34732]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-13T21:40:28.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:28 smithi155 ceph-mon[34732]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T21:40:28.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:28 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:28.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:28 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:28.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:28 smithi119 ceph-mon[27653]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-13T21:40:28.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:28 smithi119 ceph-mon[27653]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T21:40:28.633 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:28 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:28.633 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:28 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:29 smithi155 ceph-mon[34732]: purged_snaps scrub starts 2024-09-13T21:40:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:29 smithi155 ceph-mon[34732]: purged_snaps scrub ok 2024-09-13T21:40:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:29 smithi155 ceph-mon[34732]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:29.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:29 smithi155 ceph-mon[34732]: osd.4 [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809] boot 2024-09-13T21:40:29.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:29 smithi155 ceph-mon[34732]: osdmap e32: 5 total, 5 up, 5 in 2024-09-13T21:40:29.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:29 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:29.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:29 smithi119 ceph-mon[27653]: purged_snaps scrub starts 2024-09-13T21:40:29.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:29 smithi119 ceph-mon[27653]: purged_snaps scrub ok 2024-09-13T21:40:29.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:29 smithi119 ceph-mon[27653]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T21:40:29.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:29 smithi119 ceph-mon[27653]: osd.4 [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809] boot 2024-09-13T21:40:29.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:29 smithi119 ceph-mon[27653]: osdmap e32: 5 total, 5 up, 5 in 2024-09-13T21:40:29.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:40:30.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:30 smithi155 ceph-mon[34732]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T21:40:30.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:30.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:30.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:30.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:30.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:30.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:30.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:30.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:30.471 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:30 smithi119 ceph-mon[27653]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T21:40:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:30.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:31.305 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-13T21:40:31.326 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_2 2024-09-13T21:40:31.570 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi155/config 2024-09-13T21:40:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:31 smithi155 ceph-mon[34732]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:31 smithi155 ceph-mon[34732]: Detected new or changed devices on smithi155 2024-09-13T21:40:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:31 smithi155 ceph-mon[34732]: Adjusting osd_memory_target on smithi155 to 7968M 2024-09-13T21:40:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:31 smithi119 ceph-mon[27653]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:31 smithi119 ceph-mon[27653]: Detected new or changed devices on smithi155 2024-09-13T21:40:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:31 smithi119 ceph-mon[27653]: Adjusting osd_memory_target on smithi155 to 7968M 2024-09-13T21:40:33.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.161+0000 7f14e04e8640 1 -- 172.21.15.155:0/1988436204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d80fb450 msgr2=0x7f14d80fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:33.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.161+0000 7f14e04e8640 1 --2- 172.21.15.155:0/1988436204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d80fb450 0x7f14d80fb860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f14c80048d0 tx=0x7f14c8009da0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.161+0000 7f14e04e8640 1 -- 172.21.15.155:0/1988436204 shutdown_connections 2024-09-13T21:40:33.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.161+0000 7f14e04e8640 1 --2- 172.21.15.155:0/1988436204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d80fc720 0x7f14d80fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.161+0000 7f14e04e8640 1 --2- 172.21.15.155:0/1988436204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d80fb450 0x7f14d80fb860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.161+0000 7f14e04e8640 1 -- 172.21.15.155:0/1988436204 >> 172.21.15.155:0/1988436204 conn(0x7f14d80f6c10 msgr2=0x7f14d80f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:33.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.161+0000 7f14e04e8640 1 -- 172.21.15.155:0/1988436204 shutdown_connections 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.161+0000 7f14e04e8640 1 -- 172.21.15.155:0/1988436204 wait complete. 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14e04e8640 1 Processor -- start 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14e04e8640 1 -- start start 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14e04e8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d80fb450 0x7f14d810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14e04e8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d80fc720 0x7f14d8112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14e04e8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8066770 con 0x7f14d80fb450 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14e04e8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80668e0 con 0x7f14d80fc720 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14dda83640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d80fc720 0x7f14d8112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14dda83640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d80fc720 0x7f14d8112310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44106/0 (socket says 172.21.15.155:44106) 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14dda83640 1 -- 172.21.15.155:0/19787576 learned_addr learned my addr 172.21.15.155:0/19787576 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14de284640 1 --2- 172.21.15.155:0/19787576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d80fb450 0x7f14d810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:33.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14dda83640 1 -- 172.21.15.155:0/19787576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d80fb450 msgr2=0x7f14d810fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14dda83640 1 --2- 172.21.15.155:0/19787576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d80fb450 0x7f14d810fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14dda83640 1 -- 172.21.15.155:0/19787576 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8005040 con 0x7f14d80fc720 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.162+0000 7f14dda83640 1 --2- 172.21.15.155:0/19787576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d80fc720 0x7f14d8112310 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f14d400c790 tx=0x7f14d40043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.163+0000 7f14ceffd640 1 -- 172.21.15.155:0/19787576 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14d400a820 con 0x7f14d80fc720 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.163+0000 7f14ceffd640 1 -- 172.21.15.155:0/19787576 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f14d400ae20 con 0x7f14d80fc720 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.163+0000 7f14e04e8640 1 -- 172.21.15.155:0/19787576 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d81128b0 con 0x7f14d80fc720 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.163+0000 7f14ceffd640 1 -- 172.21.15.155:0/19787576 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14d40113a0 con 0x7f14d80fc720 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.163+0000 7f14e04e8640 1 -- 172.21.15.155:0/19787576 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d8112e50 con 0x7f14d80fc720 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.164+0000 7f14e04e8640 1 -- 172.21.15.155:0/19787576 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d80fa8b0 con 0x7f14d80fc720 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.164+0000 7f14ceffd640 1 -- 172.21.15.155:0/19787576 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f14d4012400 con 0x7f14d80fc720 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.165+0000 7f14ceffd640 1 --2- 172.21.15.155:0/19787576 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f14c406ed60 0x7f14c4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:33.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.165+0000 7f14ceffd640 1 -- 172.21.15.155:0/19787576 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f14d408dd20 con 0x7f14d80fc720 2024-09-13T21:40:33.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.165+0000 7f14de284640 1 --2- 172.21.15.155:0/19787576 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f14c406ed60 0x7f14c4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:33.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.166+0000 7f14de284640 1 --2- 172.21.15.155:0/19787576 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f14c406ed60 0x7f14c4071210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14c8007ac0 tx=0x7f14c8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:33.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.170+0000 7f14ceffd640 1 -- 172.21.15.155:0/19787576 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f14d405b450 con 0x7f14d80fc720 2024-09-13T21:40:33.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:33.333+0000 7f14e04e8640 1 -- 172.21.15.155:0/19787576 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f14d8100b30 con 0x7f14c406ed60 2024-09-13T21:40:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:33 smithi155 ceph-mon[34732]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:33.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:33 smithi119 ceph-mon[27653]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:34.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:34 smithi119 ceph-mon[27653]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:34.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:40:34.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:40:34.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:34 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:34.697 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:34 smithi155 ceph-mon[34732]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:40:34.697 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T21:40:34.697 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T21:40:34.697 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:34 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:35.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:35 smithi119 ceph-mon[27653]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:35.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:35 smithi155 ceph-mon[34732]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:36.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:36 smithi155 ceph-mon[34732]: from='client.? 172.21.15.155:0/1791276025' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3943357b-59a1-45d5-9d34-804b3a2bb64c"}]: dispatch 2024-09-13T21:40:36.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:36 smithi155 ceph-mon[34732]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3943357b-59a1-45d5-9d34-804b3a2bb64c"}]: dispatch 2024-09-13T21:40:36.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:36 smithi155 ceph-mon[34732]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3943357b-59a1-45d5-9d34-804b3a2bb64c"}]': finished 2024-09-13T21:40:36.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:36 smithi155 ceph-mon[34732]: osdmap e34: 6 total, 5 up, 6 in 2024-09-13T21:40:36.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:36 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:36.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:36 smithi155 ceph-mon[34732]: from='client.? 172.21.15.155:0/3862225509' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:40:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:36 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/1791276025' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3943357b-59a1-45d5-9d34-804b3a2bb64c"}]: dispatch 2024-09-13T21:40:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:36 smithi119 ceph-mon[27653]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3943357b-59a1-45d5-9d34-804b3a2bb64c"}]: dispatch 2024-09-13T21:40:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:36 smithi119 ceph-mon[27653]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3943357b-59a1-45d5-9d34-804b3a2bb64c"}]': finished 2024-09-13T21:40:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:36 smithi119 ceph-mon[27653]: osdmap e34: 6 total, 5 up, 6 in 2024-09-13T21:40:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:36 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:36 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/3862225509' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T21:40:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:37 smithi119 ceph-mon[27653]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:37 smithi155 ceph-mon[34732]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:39.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:39 smithi119 ceph-mon[27653]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:39.729 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:39 smithi155 ceph-mon[34732]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:41.411 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:41 smithi155 ceph-mon[34732]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:41.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:41 smithi119 ceph-mon[27653]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:43.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:43 smithi119 ceph-mon[27653]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:43.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:40:43.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:43 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:43 smithi155 ceph-mon[34732]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:40:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:43 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:44.613 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:44 smithi155 ceph-mon[34732]: Deploying daemon osd.5 on smithi155 2024-09-13T21:40:44.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:44 smithi119 ceph-mon[27653]: Deploying daemon osd.5 on smithi155 2024-09-13T21:40:45.753 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:45 smithi155 ceph-mon[34732]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:45.753 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:45.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:45 smithi119 ceph-mon[27653]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:45.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:40:47.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:47 smithi155 ceph-mon[34732]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:47.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:47 smithi119 ceph-mon[27653]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:48.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:48 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:48.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:48 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:48.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:48 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:48.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:48 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:48.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:48 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:48.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:48 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:49.781 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:49 smithi119 ceph-mon[27653]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:49.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:49 smithi155 ceph-mon[34732]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:51.774 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:51 smithi155 ceph-mon[34732]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:51.775 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:51 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:51.775 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:51 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:51.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.806+0000 7f14ceffd640 1 -- 172.21.15.155:0/19787576 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f14d8100b30 con 0x7f14c406ed60 2024-09-13T21:40:51.807 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 5 on host 'smithi155' 2024-09-13T21:40:51.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.808+0000 7f14e04e8640 1 -- 172.21.15.155:0/19787576 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f14c406ed60 msgr2=0x7f14c4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:51.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.808+0000 7f14e04e8640 1 --2- 172.21.15.155:0/19787576 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f14c406ed60 0x7f14c4071210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14c8007ac0 tx=0x7f14c8035040 comp rx=0 tx=0).stop 2024-09-13T21:40:51.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.808+0000 7f14e04e8640 1 -- 172.21.15.155:0/19787576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d80fc720 msgr2=0x7f14d8112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:51.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.808+0000 7f14e04e8640 1 --2- 172.21.15.155:0/19787576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d80fc720 0x7f14d8112310 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f14d400c790 tx=0x7f14d40043c0 comp rx=0 tx=0).stop 2024-09-13T21:40:51.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.808+0000 7f14e04e8640 1 -- 172.21.15.155:0/19787576 shutdown_connections 2024-09-13T21:40:51.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.808+0000 7f14e04e8640 1 --2- 172.21.15.155:0/19787576 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f14c406ed60 0x7f14c4071210 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:51.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.808+0000 7f14e04e8640 1 --2- 172.21.15.155:0/19787576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d80fc720 0x7f14d8112310 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:51.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.808+0000 7f14e04e8640 1 --2- 172.21.15.155:0/19787576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d80fb450 0x7f14d810fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:51.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.808+0000 7f14e04e8640 1 -- 172.21.15.155:0/19787576 >> 172.21.15.155:0/19787576 conn(0x7f14d80f6c10 msgr2=0x7f14d80f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:51.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.808+0000 7f14e04e8640 1 -- 172.21.15.155:0/19787576 shutdown_connections 2024-09-13T21:40:51.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:40:51.808+0000 7f14e04e8640 1 -- 172.21.15.155:0/19787576 wait complete. 2024-09-13T21:40:51.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:51 smithi119 ceph-mon[27653]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:51.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:51 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:51.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:51 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:52.445 DEBUG:teuthology.orchestra.run.smithi155:osd.5> sudo journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T21:40:52.447 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-13T21:40:52.448 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T21:40:52.705 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:40:52.826 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:52 smithi119 ceph-mon[27653]: from='osd.5 [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:40:52.827 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:52 smithi119 ceph-mon[27653]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:40:52.827 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:52 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:52.827 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:52 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:52.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:52 smithi155 ceph-mon[34732]: from='osd.5 [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:40:52.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:52 smithi155 ceph-mon[34732]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:40:52.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:52 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:52.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:52 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:53 smithi155 ceph-mon[34732]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:53 smithi155 ceph-mon[34732]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T21:40:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:53 smithi155 ceph-mon[34732]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T21:40:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:53.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:53 smithi155 ceph-mon[34732]: from='osd.5 [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:53.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:53 smithi155 ceph-mon[34732]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:53.584 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:40:53 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[53534]: 2024-09-13T21:40:53.439+0000 7f4fe9f0b640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T21:40:53.584 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:40:53 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[53534]: 2024-09-13T21:40:53.448+0000 7f4fe251b640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:40:53.816 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:53 smithi119 ceph-mon[27653]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:53.816 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:53 smithi119 ceph-mon[27653]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T21:40:53.816 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:53 smithi119 ceph-mon[27653]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T21:40:53.816 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:53.816 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:53 smithi119 ceph-mon[27653]: from='osd.5 [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:53.816 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:53 smithi119 ceph-mon[27653]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:40:54.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.303+0000 7fbf6b67d640 1 -- 172.21.15.119:0/2021327925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf640fb430 msgr2=0x7fbf640fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.303+0000 7fbf6b67d640 1 --2- 172.21.15.119:0/2021327925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf640fb430 0x7fbf640fb840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbf600048d0 tx=0x7fbf60009da0 comp rx=0 tx=0).stop 2024-09-13T21:40:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.303+0000 7fbf6b67d640 1 -- 172.21.15.119:0/2021327925 shutdown_connections 2024-09-13T21:40:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.303+0000 7fbf6b67d640 1 --2- 172.21.15.119:0/2021327925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640fc700 0x7fbf640fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.303+0000 7fbf6b67d640 1 --2- 172.21.15.119:0/2021327925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf640fb430 0x7fbf640fb840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.303+0000 7fbf6b67d640 1 -- 172.21.15.119:0/2021327925 >> 172.21.15.119:0/2021327925 conn(0x7fbf640f6c10 msgr2=0x7fbf640f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.303+0000 7fbf6b67d640 1 -- 172.21.15.119:0/2021327925 shutdown_connections 2024-09-13T21:40:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.303+0000 7fbf6b67d640 1 -- 172.21.15.119:0/2021327925 wait complete. 2024-09-13T21:40:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.303+0000 7fbf6b67d640 1 Processor -- start 2024-09-13T21:40:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.303+0000 7fbf6b67d640 1 -- start start 2024-09-13T21:40:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.303+0000 7fbf6b67d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf640fb430 0x7fbf6410fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf6b67d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640fc700 0x7fbf641122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf6b67d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf64065cc0 con 0x7fbf640fb430 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf6b67d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf64065e30 con 0x7fbf640fc700 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf69419640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf640fb430 0x7fbf6410fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf69419640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf640fb430 0x7fbf6410fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58146/0 (socket says 172.21.15.119:58146) 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf69419640 1 -- 172.21.15.119:0/1545725273 learned_addr learned my addr 172.21.15.119:0/1545725273 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf69419640 1 -- 172.21.15.119:0/1545725273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640fc700 msgr2=0x7fbf641122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf68c18640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640fc700 0x7fbf641122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf69419640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640fc700 0x7fbf641122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf69419640 1 -- 172.21.15.119:0/1545725273 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf60005040 con 0x7fbf640fb430 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf68c18640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640fc700 0x7fbf641122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf69419640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf640fb430 0x7fbf6410fd60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbf60003080 tx=0x7fbf60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:54.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf59ffb640 1 -- 172.21.15.119:0/1545725273 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf60038070 con 0x7fbf640fb430 2024-09-13T21:40:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf6b67d640 1 -- 172.21.15.119:0/1545725273 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf64112850 con 0x7fbf640fb430 2024-09-13T21:40:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf59ffb640 1 -- 172.21.15.119:0/1545725273 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbf6002abd0 con 0x7fbf640fb430 2024-09-13T21:40:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf59ffb640 1 -- 172.21.15.119:0/1545725273 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf6003e670 con 0x7fbf640fb430 2024-09-13T21:40:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.304+0000 7fbf6b67d640 1 -- 172.21.15.119:0/1545725273 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf64112dc0 con 0x7fbf640fb430 2024-09-13T21:40:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.305+0000 7fbf6b67d640 1 -- 172.21.15.119:0/1545725273 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf640fa890 con 0x7fbf640fb430 2024-09-13T21:40:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.306+0000 7fbf59ffb640 1 -- 172.21.15.119:0/1545725273 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fbf60030020 con 0x7fbf640fb430 2024-09-13T21:40:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.306+0000 7fbf59ffb640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbf5006ed60 0x7fbf50071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.306+0000 7fbf59ffb640 1 -- 172.21.15.119:0/1545725273 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4354+0+0 (secure 0 0 0) 0x7fbf600ae140 con 0x7fbf640fb430 2024-09-13T21:40:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.306+0000 7fbf68c18640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbf5006ed60 0x7fbf50071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.307+0000 7fbf68c18640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbf5006ed60 0x7fbf50071210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf540041d0 tx=0x7fbf54009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.311+0000 7fbf59ffb640 1 -- 172.21.15.119:0/1545725273 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbf6007b6b0 con 0x7fbf640fb430 2024-09-13T21:40:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.474+0000 7fbf6b67d640 1 -- 172.21.15.119:0/1545725273 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fbf6404b720 con 0x7fbf640fb430 2024-09-13T21:40:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.474+0000 7fbf59ffb640 1 -- 172.21.15.119:0/1545725273 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7fbf6007b050 con 0x7fbf640fb430 2024-09-13T21:40:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:40:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.476+0000 7fbf6b67d640 1 -- 172.21.15.119:0/1545725273 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbf5006ed60 msgr2=0x7fbf50071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.476+0000 7fbf6b67d640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbf5006ed60 0x7fbf50071210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf540041d0 tx=0x7fbf54009040 comp rx=0 tx=0).stop 2024-09-13T21:40:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.476+0000 7fbf6b67d640 1 -- 172.21.15.119:0/1545725273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf640fb430 msgr2=0x7fbf6410fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.476+0000 7fbf6b67d640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf640fb430 0x7fbf6410fd60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbf60003080 tx=0x7fbf60009da0 comp rx=0 tx=0).stop 2024-09-13T21:40:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.476+0000 7fbf6b67d640 1 -- 172.21.15.119:0/1545725273 shutdown_connections 2024-09-13T21:40:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.476+0000 7fbf6b67d640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbf5006ed60 0x7fbf50071210 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.476+0000 7fbf6b67d640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640fc700 0x7fbf641122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.476+0000 7fbf6b67d640 1 --2- 172.21.15.119:0/1545725273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf640fb430 0x7fbf6410fd60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.476+0000 7fbf6b67d640 1 -- 172.21.15.119:0/1545725273 >> 172.21.15.119:0/1545725273 conn(0x7fbf640f6c10 msgr2=0x7fbf640f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.476+0000 7fbf6b67d640 1 -- 172.21.15.119:0/1545725273 shutdown_connections 2024-09-13T21:40:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:54.476+0000 7fbf6b67d640 1 -- 172.21.15.119:0/1545725273 wait complete. 2024-09-13T21:40:54.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:54 smithi155 ceph-mon[34732]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-13T21:40:54.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:54 smithi155 ceph-mon[34732]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T21:40:54.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:54 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:54.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:54 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:54.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:54 smithi155 ceph-mon[34732]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:54.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:54 smithi119 ceph-mon[27653]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-13T21:40:54.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:54 smithi119 ceph-mon[27653]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T21:40:54.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:54 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:54.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:54 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:54.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:54 smithi119 ceph-mon[27653]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T21:40:55.143 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":37,"num_osds":6,"num_up_osds":6,"osd_up_since":1726263654,"num_in_osds":6,"osd_in_since":1726263635,"num_remapped_pgs":0} 2024-09-13T21:40:55.144 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T21:40:55.401 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:40:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:55 smithi155 ceph-mon[34732]: purged_snaps scrub starts 2024-09-13T21:40:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:55 smithi155 ceph-mon[34732]: purged_snaps scrub ok 2024-09-13T21:40:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:55 smithi155 ceph-mon[34732]: osd.5 [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381] boot 2024-09-13T21:40:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:55 smithi155 ceph-mon[34732]: osdmap e37: 6 total, 6 up, 6 in 2024-09-13T21:40:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:55 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:55 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1545725273' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T21:40:55.740 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:55 smithi119 ceph-mon[27653]: purged_snaps scrub starts 2024-09-13T21:40:55.740 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:55 smithi119 ceph-mon[27653]: purged_snaps scrub ok 2024-09-13T21:40:55.740 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:55 smithi119 ceph-mon[27653]: osd.5 [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381] boot 2024-09-13T21:40:55.740 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:55 smithi119 ceph-mon[27653]: osdmap e37: 6 total, 6 up, 6 in 2024-09-13T21:40:55.741 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:55 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:40:55.741 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:55 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1545725273' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T21:40:56.571 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T21:40:56.571 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: Detected new or changed devices on smithi155 2024-09-13T21:40:56.571 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:56.571 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:56.571 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:56.571 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:56.571 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:56.571 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: Adjusting osd_memory_target on smithi155 to 5312M 2024-09-13T21:40:56.571 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:56.571 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:56.571 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:56.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:40:56.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:56.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:56.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:56.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:56.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:56 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:56.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: Detected new or changed devices on smithi155 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: Adjusting osd_memory_target on smithi155 to 5312M 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:40:56.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:40:56.835 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:40:56.835 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:56 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:40:57.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.078+0000 7fe8345b4640 1 -- 172.21.15.119:0/1795804380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fbd90 msgr2=0x7fe82c0fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:57.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.078+0000 7fe8345b4640 1 --2- 172.21.15.119:0/1795804380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fbd90 0x7fe82c0fc200 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe8280048d0 tx=0x7fe828009da0 comp rx=0 tx=0).stop 2024-09-13T21:40:57.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.078+0000 7fe8345b4640 1 -- 172.21.15.119:0/1795804380 shutdown_connections 2024-09-13T21:40:57.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.078+0000 7fe8345b4640 1 --2- 172.21.15.119:0/1795804380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fbd90 0x7fe82c0fc200 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:57.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.078+0000 7fe8345b4640 1 --2- 172.21.15.119:0/1795804380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe82c1014f0 0x7fe82c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:57.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.078+0000 7fe8345b4640 1 -- 172.21.15.119:0/1795804380 >> 172.21.15.119:0/1795804380 conn(0x7fe82c070ce0 msgr2=0x7fe82c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:57.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.078+0000 7fe8345b4640 1 -- 172.21.15.119:0/1795804380 shutdown_connections 2024-09-13T21:40:57.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.078+0000 7fe8345b4640 1 -- 172.21.15.119:0/1795804380 wait complete. 2024-09-13T21:40:57.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.078+0000 7fe8345b4640 1 Processor -- start 2024-09-13T21:40:57.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe8345b4640 1 -- start start 2024-09-13T21:40:57.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe8345b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fbd90 0x7fe82c113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:57.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe8345b4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe82c1014f0 0x7fe82c113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe8345b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c113e00 con 0x7fe82c0fbd90 2024-09-13T21:40:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe8345b4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c10d1b0 con 0x7fe82c1014f0 2024-09-13T21:40:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe832350640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fbd90 0x7fe82c113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe832350640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fbd90 0x7fe82c113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58166/0 (socket says 172.21.15.119:58166) 2024-09-13T21:40:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe832350640 1 -- 172.21.15.119:0/748836113 learned_addr learned my addr 172.21.15.119:0/748836113 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:40:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe831b4f640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe82c1014f0 0x7fe82c113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe832350640 1 -- 172.21.15.119:0/748836113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe82c1014f0 msgr2=0x7fe82c113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe832350640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe82c1014f0 0x7fe82c113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe832350640 1 -- 172.21.15.119:0/748836113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828005040 con 0x7fe82c0fbd90 2024-09-13T21:40:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe831b4f640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe82c1014f0 0x7fe82c113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:40:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe832350640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fbd90 0x7fe82c113230 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe82000b790 tx=0x7fe8200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.079+0000 7fe81effd640 1 -- 172.21.15.119:0/748836113 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe82000c700 con 0x7fe82c0fbd90 2024-09-13T21:40:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.080+0000 7fe8345b4640 1 -- 172.21.15.119:0/748836113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c10d490 con 0x7fe82c0fbd90 2024-09-13T21:40:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.080+0000 7fe81effd640 1 -- 172.21.15.119:0/748836113 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe82000cd00 con 0x7fe82c0fbd90 2024-09-13T21:40:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.080+0000 7fe81effd640 1 -- 172.21.15.119:0/748836113 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe820015e70 con 0x7fe82c0fbd90 2024-09-13T21:40:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.080+0000 7fe8345b4640 1 -- 172.21.15.119:0/748836113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c10d980 con 0x7fe82c0fbd90 2024-09-13T21:40:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.081+0000 7fe8345b4640 1 -- 172.21.15.119:0/748836113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c0fcda0 con 0x7fe82c0fbd90 2024-09-13T21:40:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.081+0000 7fe81effd640 1 -- 172.21.15.119:0/748836113 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe820012070 con 0x7fe82c0fbd90 2024-09-13T21:40:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.082+0000 7fe81effd640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe81806ed60 0x7fe818071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.082+0000 7fe831b4f640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe81806ed60 0x7fe818071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.082+0000 7fe81effd640 1 -- 172.21.15.119:0/748836113 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe82008d9c0 con 0x7fe82c0fbd90 2024-09-13T21:40:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.082+0000 7fe831b4f640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe81806ed60 0x7fe818071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe82c071ab0 tx=0x7fe828035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.086+0000 7fe81effd640 1 -- 172.21.15.119:0/748836113 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe82005ae20 con 0x7fe82c0fbd90 2024-09-13T21:40:57.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.244+0000 7fe8345b4640 1 -- 172.21.15.119:0/748836113 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe82c04b7b0 con 0x7fe82c0fbd90 2024-09-13T21:40:57.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.245+0000 7fe81effd640 1 -- 172.21.15.119:0/748836113 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11108 (secure 0 0 0) 0x7fe82005a7c0 con 0x7fe82c0fbd90 2024-09-13T21:40:57.246 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:40:57.247 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":38,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","created":"2024-09-13T21:35:40.067719+0000","modified":"2024-09-13T21:40:55.443085+0000","last_up_change":"2024-09-13T21:40:54.435322+0000","last_in_change":"2024-09-13T21:40:35.626027+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T21:39:39.960550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"3e8b172e-d14d-4fe7-9e19-a623844ddaba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6803","nonce":2110350104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6805","nonce":2110350104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6809","nonce":2110350104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6807","nonce":2110350104}]},"public_addr":"172.21.15.119:6803/2110350104","cluster_addr":"172.21.15.119:6805/2110350104","heartbeat_back_addr":"172.21.15.119:6809/2110350104","heartbeat_front_addr":"172.21.15.119:6807/2110350104","state":["exists","up"]},{"osd":1,"uuid":"20f7ea98-15de-439f-94c4-9b9cf453b74d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6811","nonce":1621715795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6813","nonce":1621715795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6817","nonce":1621715795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6815","nonce":1621715795}]},"public_addr":"172.21.15.119:6811/1621715795","cluster_addr":"172.21.15.119:6813/1621715795","heartbeat_back_addr":"172.21.15.119:6817/1621715795","heartbeat_front_addr":"172.21.15.119:6815/1621715795","state":["exists","up"]},{"osd":2,"uuid":"a363ab32-96ac-4960-8a67-01dbf5ee5016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6819","nonce":2710038891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6821","nonce":2710038891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6825","nonce":2710038891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6823","nonce":2710038891}]},"public_addr":"172.21.15.119:6819/2710038891","cluster_addr":"172.21.15.119:6821/2710038891","heartbeat_back_addr":"172.21.15.119:6825/2710038891","heartbeat_front_addr":"172.21.15.119:6823/2710038891","state":["exists","up"]},{"osd":3,"uuid":"c466e0be-66c9-49ba-ab51-7ba539606287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6801","nonce":1451588865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6803","nonce":1451588865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6807","nonce":1451588865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6805","nonce":1451588865}]},"public_addr":"172.21.15.155:6801/1451588865","cluster_addr":"172.21.15.155:6803/1451588865","heartbeat_back_addr":"172.21.15.155:6807/1451588865","heartbeat_front_addr":"172.21.15.155:6805/1451588865","state":["exists","up"]},{"osd":4,"uuid":"409c56f1-9e14-455a-a229-81f504ade49a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6809","nonce":70849809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6811","nonce":70849809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6815","nonce":70849809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6813","nonce":70849809}]},"public_addr":"172.21.15.155:6809/70849809","cluster_addr":"172.21.15.155:6811/70849809","heartbeat_back_addr":"172.21.15.155:6815/70849809","heartbeat_front_addr":"172.21.15.155:6813/70849809","state":["exists","up"]},{"osd":5,"uuid":"3943357b-59a1-45d5-9d34-804b3a2bb64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6817","nonce":929688381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6819","nonce":929688381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6823","nonce":929688381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6821","nonce":929688381}]},"public_addr":"172.21.15.155:6817/929688381","cluster_addr":"172.21.15.155:6819/929688381","heartbeat_back_addr":"172.21.15.155:6823/929688381","heartbeat_front_addr":"172.21.15.155:6821/929688381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:38:41.412003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:39:10.073235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:39:38.202262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:40:01.287717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:40:26.885567+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:40:52.549373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2630647001":"2024-09-14T21:37:29.647517+0000","172.21.15.119:6801/1188851329":"2024-09-14T21:37:29.647517+0000","172.21.15.119:0/4064361328":"2024-09-14T21:37:29.647517+0000","172.21.15.119:0/2537835370":"2024-09-14T21:36:02.290241+0000","172.21.15.119:6800/254943630":"2024-09-14T21:36:02.290241+0000","172.21.15.119:6801/254943630":"2024-09-14T21:36:02.290241+0000","172.21.15.119:0/4158458893":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/4214610807":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/1804460008":"2024-09-14T21:36:02.290241+0000","172.21.15.119:0/1724446307":"2024-09-14T21:36:02.290241+0000","172.21.15.119:6800/366226653":"2024-09-14T21:36:31.341760+0000","172.21.15.119:6801/366226653":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/1575352567":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/2573788183":"2024-09-14T21:37:29.647517+0000","172.21.15.119:6800/1188851329":"2024-09-14T21:37:29.647517+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T21:40:57.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.246+0000 7fe8345b4640 1 -- 172.21.15.119:0/748836113 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe81806ed60 msgr2=0x7fe818071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:57.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.246+0000 7fe8345b4640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe81806ed60 0x7fe818071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe82c071ab0 tx=0x7fe828035040 comp rx=0 tx=0).stop 2024-09-13T21:40:57.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.247+0000 7fe8345b4640 1 -- 172.21.15.119:0/748836113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fbd90 msgr2=0x7fe82c113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:57.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.247+0000 7fe8345b4640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fbd90 0x7fe82c113230 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe82000b790 tx=0x7fe8200091d0 comp rx=0 tx=0).stop 2024-09-13T21:40:57.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.247+0000 7fe8345b4640 1 -- 172.21.15.119:0/748836113 shutdown_connections 2024-09-13T21:40:57.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.247+0000 7fe8345b4640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe81806ed60 0x7fe818071210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:57.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.247+0000 7fe8345b4640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe82c1014f0 0x7fe82c113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:57.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.247+0000 7fe8345b4640 1 --2- 172.21.15.119:0/748836113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe82c0fbd90 0x7fe82c113230 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:57.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.247+0000 7fe8345b4640 1 -- 172.21.15.119:0/748836113 >> 172.21.15.119:0/748836113 conn(0x7fe82c070ce0 msgr2=0x7fe82c0f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:57.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.247+0000 7fe8345b4640 1 -- 172.21.15.119:0/748836113 shutdown_connections 2024-09-13T21:40:57.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:57.247+0000 7fe8345b4640 1 -- 172.21.15.119:0/748836113 wait complete. 2024-09-13T21:40:57.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:57 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/748836113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:40:57.908 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T21:39:39.960550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-13T21:40:57.908 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T21:40:58.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:57 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/748836113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:40:58.154 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:40:58.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:40:58 smithi119 ceph-mon[27653]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:40:59.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:40:58 smithi155 ceph-mon[34732]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:40:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.813+0000 7f8a77b56640 1 -- 172.21.15.119:0/2548417251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a70102540 msgr2=0x7f8a70102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.813+0000 7f8a77b56640 1 --2- 172.21.15.119:0/2548417251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a70102540 0x7f8a70102910 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8a600048d0 tx=0x7f8a60009da0 comp rx=0 tx=0).stop 2024-09-13T21:40:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.813+0000 7f8a77b56640 1 -- 172.21.15.119:0/2548417251 shutdown_connections 2024-09-13T21:40:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.813+0000 7f8a77b56640 1 --2- 172.21.15.119:0/2548417251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a70102ee0 0x7f8a700fc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.813+0000 7f8a77b56640 1 --2- 172.21.15.119:0/2548417251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a70102540 0x7f8a70102910 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.813+0000 7f8a77b56640 1 -- 172.21.15.119:0/2548417251 >> 172.21.15.119:0/2548417251 conn(0x7f8a700f8120 msgr2=0x7f8a700fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.813+0000 7f8a77b56640 1 -- 172.21.15.119:0/2548417251 shutdown_connections 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.813+0000 7f8a77b56640 1 -- 172.21.15.119:0/2548417251 wait complete. 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a77b56640 1 Processor -- start 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a77b56640 1 -- start start 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a77b56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a70102540 0x7f8a701131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a77b56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a70102ee0 0x7f8a70113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a77b56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a70113d20 con 0x7f8a70102540 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a77b56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7010d160 con 0x7f8a70102ee0 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a758f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a70102540 0x7f8a701131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a758f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a70102540 0x7f8a701131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58182/0 (socket says 172.21.15.119:58182) 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a758f2640 1 -- 172.21.15.119:0/3736618567 learned_addr learned my addr 172.21.15.119:0/3736618567 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a750f1640 1 --2- 172.21.15.119:0/3736618567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a70102ee0 0x7f8a70113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a758f2640 1 -- 172.21.15.119:0/3736618567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a70102ee0 msgr2=0x7f8a70113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a758f2640 1 --2- 172.21.15.119:0/3736618567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a70102ee0 0x7f8a70113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.814+0000 7f8a758f2640 1 -- 172.21.15.119:0/3736618567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a60005040 con 0x7f8a70102540 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.815+0000 7f8a758f2640 1 --2- 172.21.15.119:0/3736618567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a70102540 0x7f8a701131e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a60000c00 tx=0x7f8a60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.815+0000 7f8a667fc640 1 -- 172.21.15.119:0/3736618567 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a60038070 con 0x7f8a70102540 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.815+0000 7f8a77b56640 1 -- 172.21.15.119:0/3736618567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7010d3e0 con 0x7f8a70102540 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.815+0000 7f8a667fc640 1 -- 172.21.15.119:0/3736618567 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a6002ade0 con 0x7f8a70102540 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.815+0000 7f8a667fc640 1 -- 172.21.15.119:0/3736618567 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a6002c7e0 con 0x7f8a70102540 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.815+0000 7f8a77b56640 1 -- 172.21.15.119:0/3736618567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7010d920 con 0x7f8a70102540 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.816+0000 7f8a77b56640 1 -- 172.21.15.119:0/3736618567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a700fdcc0 con 0x7f8a70102540 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.816+0000 7f8a667fc640 1 -- 172.21.15.119:0/3736618567 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8a60030020 con 0x7f8a70102540 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.817+0000 7f8a667fc640 1 --2- 172.21.15.119:0/3736618567 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8a5c06ed60 0x7f8a5c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.817+0000 7f8a750f1640 1 --2- 172.21.15.119:0/3736618567 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8a5c06ed60 0x7f8a5c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:40:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.817+0000 7f8a667fc640 1 -- 172.21.15.119:0/3736618567 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8a600adad0 con 0x7f8a70102540 2024-09-13T21:40:59.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.817+0000 7f8a750f1640 1 --2- 172.21.15.119:0/3736618567 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8a5c06ed60 0x7f8a5c071210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a7010eaa0 tx=0x7f8a6c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:40:59.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.821+0000 7f8a667fc640 1 -- 172.21.15.119:0/3736618567 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8a6007afe0 con 0x7f8a70102540 2024-09-13T21:40:59.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.975+0000 7f8a77b56640 1 -- 172.21.15.119:0/3736618567 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a7004b720 con 0x7f8a70102540 2024-09-13T21:40:59.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.975+0000 7f8a667fc640 1 -- 172.21.15.119:0/3736618567 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a6007a980 con 0x7f8a70102540 2024-09-13T21:40:59.977 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-09-13T21:40:59.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.977+0000 7f8a77b56640 1 -- 172.21.15.119:0/3736618567 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8a5c06ed60 msgr2=0x7f8a5c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:59.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.977+0000 7f8a77b56640 1 --2- 172.21.15.119:0/3736618567 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8a5c06ed60 0x7f8a5c071210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a7010eaa0 tx=0x7f8a6c00b040 comp rx=0 tx=0).stop 2024-09-13T21:40:59.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.977+0000 7f8a77b56640 1 -- 172.21.15.119:0/3736618567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a70102540 msgr2=0x7f8a701131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:40:59.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.977+0000 7f8a77b56640 1 --2- 172.21.15.119:0/3736618567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a70102540 0x7f8a701131e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a60000c00 tx=0x7f8a60009da0 comp rx=0 tx=0).stop 2024-09-13T21:40:59.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.977+0000 7f8a77b56640 1 -- 172.21.15.119:0/3736618567 shutdown_connections 2024-09-13T21:40:59.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.977+0000 7f8a77b56640 1 --2- 172.21.15.119:0/3736618567 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f8a5c06ed60 0x7f8a5c071210 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:59.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.977+0000 7f8a77b56640 1 --2- 172.21.15.119:0/3736618567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a70102ee0 0x7f8a70113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:59.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.977+0000 7f8a77b56640 1 --2- 172.21.15.119:0/3736618567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a70102540 0x7f8a701131e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:40:59.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.977+0000 7f8a77b56640 1 -- 172.21.15.119:0/3736618567 >> 172.21.15.119:0/3736618567 conn(0x7f8a700f8120 msgr2=0x7f8a700f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:40:59.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.977+0000 7f8a77b56640 1 -- 172.21.15.119:0/3736618567 shutdown_connections 2024-09-13T21:40:59.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:40:59.977+0000 7f8a77b56640 1 -- 172.21.15.119:0/3736618567 wait complete. 2024-09-13T21:41:00.581 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T21:41:00.581 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T21:41:00.825 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:00.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:00 smithi119 ceph-mon[27653]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:00.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:00 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:00.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:00 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3736618567' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T21:41:01.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:00 smithi155 ceph-mon[34732]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:01.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:00 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:01.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:00 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3736618567' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T21:41:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.413+0000 7fea87669640 1 -- 172.21.15.119:0/2689140104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea800fdbc0 msgr2=0x7fea800fdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.413+0000 7fea87669640 1 --2- 172.21.15.119:0/2689140104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea800fdbc0 0x7fea800fdfd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0048d0 tx=0x7fea7c009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.413+0000 7fea87669640 1 -- 172.21.15.119:0/2689140104 shutdown_connections 2024-09-13T21:41:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.413+0000 7fea87669640 1 --2- 172.21.15.119:0/2689140104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea800fe510 0x7fea800fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.413+0000 7fea87669640 1 --2- 172.21.15.119:0/2689140104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea800fdbc0 0x7fea800fdfd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:02.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.413+0000 7fea87669640 1 -- 172.21.15.119:0/2689140104 >> 172.21.15.119:0/2689140104 conn(0x7fea800f63a0 msgr2=0x7fea800f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.413+0000 7fea87669640 1 -- 172.21.15.119:0/2689140104 shutdown_connections 2024-09-13T21:41:02.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.413+0000 7fea87669640 1 -- 172.21.15.119:0/2689140104 wait complete. 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.414+0000 7fea87669640 1 Processor -- start 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.414+0000 7fea87669640 1 -- start start 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.414+0000 7fea87669640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea800fdbc0 0x7fea8010d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.414+0000 7fea87669640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea800fe510 0x7fea8010d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.414+0000 7fea87669640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8010dca0 con 0x7fea800fdbc0 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.414+0000 7fea87669640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8010e470 con 0x7fea800fe510 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.414+0000 7fea85405640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea800fdbc0 0x7fea8010d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.414+0000 7fea85405640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea800fdbc0 0x7fea8010d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58208/0 (socket says 172.21.15.119:58208) 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.414+0000 7fea85405640 1 -- 172.21.15.119:0/283533676 learned_addr learned my addr 172.21.15.119:0/283533676 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.414+0000 7fea84c04640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea800fe510 0x7fea8010d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.415+0000 7fea85405640 1 -- 172.21.15.119:0/283533676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea800fe510 msgr2=0x7fea8010d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:02.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.415+0000 7fea85405640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea800fe510 0x7fea8010d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:02.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.415+0000 7fea85405640 1 -- 172.21.15.119:0/283533676 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c005040 con 0x7fea800fdbc0 2024-09-13T21:41:02.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.415+0000 7fea84c04640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea800fe510 0x7fea8010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:41:02.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.415+0000 7fea85405640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea800fdbc0 0x7fea8010d110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea7c003080 tx=0x7fea7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:02.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.415+0000 7fea75ffb640 1 -- 172.21.15.119:0/283533676 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea7c038070 con 0x7fea800fdbc0 2024-09-13T21:41:02.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.415+0000 7fea75ffb640 1 -- 172.21.15.119:0/283533676 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea7c02abd0 con 0x7fea800fdbc0 2024-09-13T21:41:02.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.415+0000 7fea87669640 1 -- 172.21.15.119:0/283533676 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8010e6a0 con 0x7fea800fdbc0 2024-09-13T21:41:02.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.415+0000 7fea75ffb640 1 -- 172.21.15.119:0/283533676 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea7c03e670 con 0x7fea800fdbc0 2024-09-13T21:41:02.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.415+0000 7fea87669640 1 -- 172.21.15.119:0/283533676 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8010ec40 con 0x7fea800fdbc0 2024-09-13T21:41:02.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.416+0000 7fea87669640 1 -- 172.21.15.119:0/283533676 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea800fa060 con 0x7fea800fdbc0 2024-09-13T21:41:02.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.417+0000 7fea75ffb640 1 -- 172.21.15.119:0/283533676 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fea7c030020 con 0x7fea800fdbc0 2024-09-13T21:41:02.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.417+0000 7fea75ffb640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea6c06ed60 0x7fea6c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:02.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.417+0000 7fea75ffb640 1 -- 172.21.15.119:0/283533676 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fea7c0ae250 con 0x7fea800fdbc0 2024-09-13T21:41:02.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.417+0000 7fea84c04640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea6c06ed60 0x7fea6c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:02.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.417+0000 7fea84c04640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea6c06ed60 0x7fea6c071210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fea8010cec0 tx=0x7fea70009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:02.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.421+0000 7fea75ffb640 1 -- 172.21.15.119:0/283533676 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fea7c07b6b0 con 0x7fea800fdbc0 2024-09-13T21:41:02.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.632+0000 7fea87669640 1 -- 172.21.15.119:0/283533676 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fea8004b720 con 0x7fea800fdbc0 2024-09-13T21:41:02.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.636+0000 7fea75ffb640 1 -- 172.21.15.119:0/283533676 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fea7c07b050 con 0x7fea800fdbc0 2024-09-13T21:41:02.637 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-09-13T21:41:02.638 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBuseRml1rIJRAApi30JvLZj+hpwEKpEIOpQQ== 2024-09-13T21:41:02.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.638+0000 7fea87669640 1 -- 172.21.15.119:0/283533676 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea6c06ed60 msgr2=0x7fea6c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:02.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.638+0000 7fea87669640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea6c06ed60 0x7fea6c071210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fea8010cec0 tx=0x7fea70009040 comp rx=0 tx=0).stop 2024-09-13T21:41:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.638+0000 7fea87669640 1 -- 172.21.15.119:0/283533676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea800fdbc0 msgr2=0x7fea8010d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.638+0000 7fea87669640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea800fdbc0 0x7fea8010d110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea7c003080 tx=0x7fea7c009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.638+0000 7fea87669640 1 -- 172.21.15.119:0/283533676 shutdown_connections 2024-09-13T21:41:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.638+0000 7fea87669640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea6c06ed60 0x7fea6c071210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.638+0000 7fea87669640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea800fe510 0x7fea8010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.638+0000 7fea87669640 1 --2- 172.21.15.119:0/283533676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea800fdbc0 0x7fea8010d110 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.638+0000 7fea87669640 1 -- 172.21.15.119:0/283533676 >> 172.21.15.119:0/283533676 conn(0x7fea800f63a0 msgr2=0x7fea800f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.638+0000 7fea87669640 1 -- 172.21.15.119:0/283533676 shutdown_connections 2024-09-13T21:41:02.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:02.638+0000 7fea87669640 1 -- 172.21.15.119:0/283533676 wait complete. 2024-09-13T21:41:02.938 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:02 smithi119 ceph-mon[27653]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:02.938 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:02 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/283533676' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:41:02.938 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:02 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/283533676' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T21:41:03.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:02 smithi155 ceph-mon[34732]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:03.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:02 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/283533676' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:41:03.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:02 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/283533676' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T21:41:03.355 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:41:03.355 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T21:41:03.355 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T21:41:03.393 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T21:41:03.649 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi155/config 2024-09-13T21:41:05.000 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:04 smithi155 ceph-mon[34732]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:04 smithi119 ceph-mon[27653]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:05.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.193+0000 7fcb76d36640 1 -- 172.21.15.155:0/3538295747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb700fb430 msgr2=0x7fcb700fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:05.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.193+0000 7fcb76d36640 1 --2- 172.21.15.155:0/3538295747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb700fb430 0x7fcb700fb840 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcb640048d0 tx=0x7fcb64009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.193+0000 7fcb76d36640 1 -- 172.21.15.155:0/3538295747 shutdown_connections 2024-09-13T21:41:05.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.193+0000 7fcb76d36640 1 --2- 172.21.15.155:0/3538295747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb700fc700 0x7fcb700fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.193+0000 7fcb76d36640 1 --2- 172.21.15.155:0/3538295747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb700fb430 0x7fcb700fb840 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.193+0000 7fcb76d36640 1 -- 172.21.15.155:0/3538295747 >> 172.21.15.155:0/3538295747 conn(0x7fcb700f6bf0 msgr2=0x7fcb700f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:05.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.193+0000 7fcb76d36640 1 -- 172.21.15.155:0/3538295747 shutdown_connections 2024-09-13T21:41:05.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.193+0000 7fcb76d36640 1 -- 172.21.15.155:0/3538295747 wait complete. 2024-09-13T21:41:05.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.193+0000 7fcb76d36640 1 Processor -- start 2024-09-13T21:41:05.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.193+0000 7fcb76d36640 1 -- start start 2024-09-13T21:41:05.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb76d36640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb700fb430 0x7fcb7010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb76d36640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb700fc700 0x7fcb7010d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb76d36640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7010e460 con 0x7fcb700fc700 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb76d36640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7010e5d0 con 0x7fcb700fb430 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb74ad2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb700fb430 0x7fcb7010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb74ad2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb700fb430 0x7fcb7010d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:40860/0 (socket says 172.21.15.155:40860) 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb74ad2640 1 -- 172.21.15.155:0/4103475071 learned_addr learned my addr 172.21.15.155:0/4103475071 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb6ffff640 1 --2- 172.21.15.155:0/4103475071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb700fc700 0x7fcb7010d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb74ad2640 1 -- 172.21.15.155:0/4103475071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb700fc700 msgr2=0x7fcb7010d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb74ad2640 1 --2- 172.21.15.155:0/4103475071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb700fc700 0x7fcb7010d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb74ad2640 1 -- 172.21.15.155:0/4103475071 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb64005040 con 0x7fcb700fb430 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.194+0000 7fcb74ad2640 1 --2- 172.21.15.155:0/4103475071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb700fb430 0x7fcb7010d0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb64003080 tx=0x7fcb64009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.195+0000 7fcb6d7fa640 1 -- 172.21.15.155:0/4103475071 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb64038070 con 0x7fcb700fb430 2024-09-13T21:41:05.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.195+0000 7fcb76d36640 1 -- 172.21.15.155:0/4103475071 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7010e850 con 0x7fcb700fb430 2024-09-13T21:41:05.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.195+0000 7fcb6d7fa640 1 -- 172.21.15.155:0/4103475071 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcb6402abd0 con 0x7fcb700fb430 2024-09-13T21:41:05.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.195+0000 7fcb6d7fa640 1 -- 172.21.15.155:0/4103475071 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb6403e670 con 0x7fcb700fb430 2024-09-13T21:41:05.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.195+0000 7fcb76d36640 1 -- 172.21.15.155:0/4103475071 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7010ed70 con 0x7fcb700fb430 2024-09-13T21:41:05.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.196+0000 7fcb76d36640 1 -- 172.21.15.155:0/4103475071 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb701046c0 con 0x7fcb700fb430 2024-09-13T21:41:05.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.196+0000 7fcb6d7fa640 1 -- 172.21.15.155:0/4103475071 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fcb64030020 con 0x7fcb700fb430 2024-09-13T21:41:05.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.197+0000 7fcb6d7fa640 1 --2- 172.21.15.155:0/4103475071 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fcb6006ed60 0x7fcb60071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:05.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.197+0000 7fcb6d7fa640 1 -- 172.21.15.155:0/4103475071 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcb640ae250 con 0x7fcb700fb430 2024-09-13T21:41:05.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.197+0000 7fcb6ffff640 1 --2- 172.21.15.155:0/4103475071 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fcb6006ed60 0x7fcb60071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:05.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.197+0000 7fcb6ffff640 1 --2- 172.21.15.155:0/4103475071 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fcb6006ed60 0x7fcb60071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c006fd0 tx=0x7fcb5c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:05.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.201+0000 7fcb6d7fa640 1 -- 172.21.15.155:0/4103475071 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcb6407b6b0 con 0x7fcb700fb430 2024-09-13T21:41:05.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.415+0000 7fcb76d36640 1 -- 172.21.15.155:0/4103475071 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fcb700fa890 con 0x7fcb700fb430 2024-09-13T21:41:05.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.421+0000 7fcb6d7fa640 1 -- 172.21.15.155:0/4103475071 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fcb6407b050 con 0x7fcb700fb430 2024-09-13T21:41:05.423 INFO:teuthology.orchestra.run.smithi155.stdout:[client.1] 2024-09-13T21:41:05.423 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBxseRmnRbkGBAAPld7GDGfA/EP9v+nrkdUjw== 2024-09-13T21:41:05.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.423+0000 7fcb76d36640 1 -- 172.21.15.155:0/4103475071 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fcb6006ed60 msgr2=0x7fcb60071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:05.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.423+0000 7fcb76d36640 1 --2- 172.21.15.155:0/4103475071 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fcb6006ed60 0x7fcb60071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c006fd0 tx=0x7fcb5c008040 comp rx=0 tx=0).stop 2024-09-13T21:41:05.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.423+0000 7fcb76d36640 1 -- 172.21.15.155:0/4103475071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb700fb430 msgr2=0x7fcb7010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:05.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.423+0000 7fcb76d36640 1 --2- 172.21.15.155:0/4103475071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb700fb430 0x7fcb7010d0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb64003080 tx=0x7fcb64009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.424+0000 7fcb76d36640 1 -- 172.21.15.155:0/4103475071 shutdown_connections 2024-09-13T21:41:05.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.424+0000 7fcb76d36640 1 --2- 172.21.15.155:0/4103475071 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fcb6006ed60 0x7fcb60071210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.424+0000 7fcb76d36640 1 --2- 172.21.15.155:0/4103475071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb700fc700 0x7fcb7010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.424+0000 7fcb76d36640 1 --2- 172.21.15.155:0/4103475071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb700fb430 0x7fcb7010d0b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:05.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.424+0000 7fcb76d36640 1 -- 172.21.15.155:0/4103475071 >> 172.21.15.155:0/4103475071 conn(0x7fcb700f6bf0 msgr2=0x7fcb70065690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:05.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.424+0000 7fcb76d36640 1 -- 172.21.15.155:0/4103475071 shutdown_connections 2024-09-13T21:41:05.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:41:05.424+0000 7fcb76d36640 1 -- 172.21.15.155:0/4103475071 wait complete. 2024-09-13T21:41:06.062 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:05 smithi155 ceph-mon[34732]: from='client.? 172.21.15.155:0/4103475071' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:41:06.062 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:05 smithi155 ceph-mon[34732]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:41:06.062 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:05 smithi155 ceph-mon[34732]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T21:41:06.086 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:41:06.086 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-13T21:41:06.086 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T21:41:06.123 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T21:41:06.123 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T21:41:06.123 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T21:41:06.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:05 smithi119 ceph-mon[27653]: from='client.? 172.21.15.155:0/4103475071' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:41:06.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:05 smithi119 ceph-mon[27653]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T21:41:06.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:05 smithi119 ceph-mon[27653]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T21:41:06.375 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:07.710 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:07 smithi119 ceph-mon[27653]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:07 smithi155 ceph-mon[34732]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:08.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.031+0000 7f49669ea640 1 -- 172.21.15.119:0/1598061721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4960102550 msgr2=0x7f4960102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:08.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.031+0000 7f49669ea640 1 --2- 172.21.15.119:0/1598061721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4960102550 0x7f4960102920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f49500048d0 tx=0x7f4950009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:08.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.031+0000 7f49669ea640 1 -- 172.21.15.119:0/1598061721 shutdown_connections 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.031+0000 7f49669ea640 1 --2- 172.21.15.119:0/1598061721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4960102ef0 0x7f49600fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.031+0000 7f49669ea640 1 --2- 172.21.15.119:0/1598061721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4960102550 0x7f4960102920 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.031+0000 7f49669ea640 1 -- 172.21.15.119:0/1598061721 >> 172.21.15.119:0/1598061721 conn(0x7f49600f80f0 msgr2=0x7f49600fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.031+0000 7f49669ea640 1 -- 172.21.15.119:0/1598061721 shutdown_connections 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.031+0000 7f49669ea640 1 -- 172.21.15.119:0/1598061721 wait complete. 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f49669ea640 1 Processor -- start 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f49669ea640 1 -- start start 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f49669ea640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4960102550 0x7f49601135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f49669ea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4960102ef0 0x7f4960113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f49669ea640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49601141d0 con 0x7f4960102ef0 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f49669ea640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496010d550 con 0x7f4960102550 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f4957fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4960102ef0 0x7f4960113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f4957fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4960102ef0 0x7f4960113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50138/0 (socket says 172.21.15.119:50138) 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f4957fff640 1 -- 172.21.15.119:0/2828103534 learned_addr learned my addr 172.21.15.119:0/2828103534 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f495ffff640 1 --2- 172.21.15.119:0/2828103534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4960102550 0x7f49601135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f4957fff640 1 -- 172.21.15.119:0/2828103534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4960102550 msgr2=0x7f49601135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f4957fff640 1 --2- 172.21.15.119:0/2828103534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4960102550 0x7f49601135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.032+0000 7f4957fff640 1 -- 172.21.15.119:0/2828103534 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950005040 con 0x7f4960102ef0 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.033+0000 7f4957fff640 1 --2- 172.21.15.119:0/2828103534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4960102ef0 0x7f4960113af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f494800b540 tx=0x7f49480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.033+0000 7f495d7fa640 1 -- 172.21.15.119:0/2828103534 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f494800f6f0 con 0x7f4960102ef0 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.033+0000 7f49669ea640 1 -- 172.21.15.119:0/2828103534 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496010d7e0 con 0x7f4960102ef0 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.033+0000 7f495d7fa640 1 -- 172.21.15.119:0/2828103534 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f494800fcf0 con 0x7f4960102ef0 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.033+0000 7f495d7fa640 1 -- 172.21.15.119:0/2828103534 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4948011e80 con 0x7f4960102ef0 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.033+0000 7f49669ea640 1 -- 172.21.15.119:0/2828103534 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496010dd00 con 0x7f4960102ef0 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.034+0000 7f49669ea640 1 -- 172.21.15.119:0/2828103534 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49600fdcd0 con 0x7f4960102ef0 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.034+0000 7f495d7fa640 1 -- 172.21.15.119:0/2828103534 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f49480116b0 con 0x7f4960102ef0 2024-09-13T21:41:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.035+0000 7f495d7fa640 1 --2- 172.21.15.119:0/2828103534 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f494c06ed60 0x7f494c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:08.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.035+0000 7f495d7fa640 1 -- 172.21.15.119:0/2828103534 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f494808dc50 con 0x7f4960102ef0 2024-09-13T21:41:08.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.035+0000 7f495ffff640 1 --2- 172.21.15.119:0/2828103534 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f494c06ed60 0x7f494c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:08.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.035+0000 7f495ffff640 1 --2- 172.21.15.119:0/2828103534 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f494c06ed60 0x7f494c071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f49500048a0 tx=0x7f4950035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:08.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.039+0000 7f495d7fa640 1 -- 172.21.15.119:0/2828103534 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f494805acb0 con 0x7f4960102ef0 2024-09-13T21:41:08.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.233+0000 7f49669ea640 1 -- 172.21.15.119:0/2828103534 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f49600fbd50 con 0x7f4960102ef0 2024-09-13T21:41:08.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.236+0000 7f495d7fa640 1 -- 172.21.15.119:0/2828103534 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176717 (secure 0 0 0) 0x7f494805aad0 con 0x7f4960102ef0 2024-09-13T21:41:08.241 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:41:08.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.238+0000 7f49669ea640 1 -- 172.21.15.119:0/2828103534 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f494c06ed60 msgr2=0x7f494c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:08.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.238+0000 7f49669ea640 1 --2- 172.21.15.119:0/2828103534 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f494c06ed60 0x7f494c071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f49500048a0 tx=0x7f4950035040 comp rx=0 tx=0).stop 2024-09-13T21:41:08.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.238+0000 7f49669ea640 1 -- 172.21.15.119:0/2828103534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4960102ef0 msgr2=0x7f4960113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:08.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.238+0000 7f49669ea640 1 --2- 172.21.15.119:0/2828103534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4960102ef0 0x7f4960113af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f494800b540 tx=0x7f49480091a0 comp rx=0 tx=0).stop 2024-09-13T21:41:08.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.238+0000 7f49669ea640 1 -- 172.21.15.119:0/2828103534 shutdown_connections 2024-09-13T21:41:08.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.238+0000 7f49669ea640 1 --2- 172.21.15.119:0/2828103534 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f494c06ed60 0x7f494c071210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:08.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.238+0000 7f49669ea640 1 --2- 172.21.15.119:0/2828103534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4960102ef0 0x7f4960113af0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:08.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.238+0000 7f49669ea640 1 --2- 172.21.15.119:0/2828103534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4960102550 0x7f49601135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:08.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.238+0000 7f49669ea640 1 -- 172.21.15.119:0/2828103534 >> 172.21.15.119:0/2828103534 conn(0x7f49600f80f0 msgr2=0x7f49600f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:08.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.238+0000 7f49669ea640 1 -- 172.21.15.119:0/2828103534 shutdown_connections 2024-09-13T21:41:08.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:08.238+0000 7f49669ea640 1 -- 172.21.15.119:0/2828103534 wait complete. 2024-09-13T21:41:08.560 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:08 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2828103534' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T21:41:08.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:08 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2828103534' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T21:41:08.955 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":19,"flags":0,"active_gid":14208,"active_name":"smithi119.gwjxmq","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":245070511},{"type":"v1","addr":"172.21.15.119:6801","nonce":245070511}]},"active_addr":"172.21.15.119:6801/245070511","active_change":"2024-09-13T21:37:29.647661+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14226,"name":"smithi155.wuuxfd","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.119:8443/","prometheus":"http://172.21.15.119:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":1116844341}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":789874977}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":1305587427}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":821090242}]}]} 2024-09-13T21:41:08.960 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T21:41:08.960 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T21:41:08.960 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T21:41:09.240 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:09.633 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:09 smithi119 ceph-mon[27653]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:09 smithi155 ceph-mon[34732]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:10.586 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:10 smithi119 ceph-mon[27653]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:10.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.779+0000 7f191d68b640 1 -- 172.21.15.119:0/3007671877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19180fe460 msgr2=0x7f19180fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:10.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.779+0000 7f191d68b640 1 --2- 172.21.15.119:0/3007671877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19180fe460 0x7f19180fe830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1908009c50 tx=0x7f1908004d10 comp rx=0 tx=0).stop 2024-09-13T21:41:10.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.779+0000 7f191d68b640 1 -- 172.21.15.119:0/3007671877 shutdown_connections 2024-09-13T21:41:10.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.779+0000 7f191d68b640 1 --2- 172.21.15.119:0/3007671877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1918064fc0 0x7f1918065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:10.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.779+0000 7f191d68b640 1 --2- 172.21.15.119:0/3007671877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19180fe460 0x7f19180fe830 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:10.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.779+0000 7f191d68b640 1 -- 172.21.15.119:0/3007671877 >> 172.21.15.119:0/3007671877 conn(0x7f19180723b0 msgr2=0x7f19180727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:10.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.779+0000 7f191d68b640 1 -- 172.21.15.119:0/3007671877 shutdown_connections 2024-09-13T21:41:10.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.779+0000 7f191d68b640 1 -- 172.21.15.119:0/3007671877 wait complete. 2024-09-13T21:41:10.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.779+0000 7f191d68b640 1 Processor -- start 2024-09-13T21:41:10.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.779+0000 7f191d68b640 1 -- start start 2024-09-13T21:41:10.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f191d68b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1918064fc0 0x7f19181131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:10.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f191d68b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19180fe460 0x7f19181136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:10.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f191d68b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918113cf0 con 0x7f19180fe460 2024-09-13T21:41:10.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f191d68b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191810d130 con 0x7f1918064fc0 2024-09-13T21:41:10.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f19167fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19180fe460 0x7f19181136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:10.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f19167fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19180fe460 0x7f19181136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50156/0 (socket says 172.21.15.119:50156) 2024-09-13T21:41:10.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f19167fc640 1 -- 172.21.15.119:0/3029475326 learned_addr learned my addr 172.21.15.119:0/3029475326 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f1916ffd640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1918064fc0 0x7f19181131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f19167fc640 1 -- 172.21.15.119:0/3029475326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1918064fc0 msgr2=0x7f19181131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f19167fc640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1918064fc0 0x7f19181131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f19167fc640 1 -- 172.21.15.119:0/3029475326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080098b0 con 0x7f19180fe460 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f1916ffd640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1918064fc0 0x7f19181131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f19167fc640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19180fe460 0x7f19181136f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f190c002a50 tx=0x7f190c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f18ff7fe640 1 -- 172.21.15.119:0/3029475326 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190c007c30 con 0x7f19180fe460 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f18ff7fe640 1 -- 172.21.15.119:0/3029475326 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f190c00f040 con 0x7f19180fe460 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f191d68b640 1 -- 172.21.15.119:0/3029475326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191810d410 con 0x7f19180fe460 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f18ff7fe640 1 -- 172.21.15.119:0/3029475326 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190c00da90 con 0x7f19180fe460 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.780+0000 7f191d68b640 1 -- 172.21.15.119:0/3029475326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191810d9b0 con 0x7f19180fe460 2024-09-13T21:41:10.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.782+0000 7f191d68b640 1 -- 172.21.15.119:0/3029475326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19180fdcf0 con 0x7f19180fe460 2024-09-13T21:41:10.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.782+0000 7f18ff7fe640 1 -- 172.21.15.119:0/3029475326 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f190c00dd00 con 0x7f19180fe460 2024-09-13T21:41:10.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.782+0000 7f18ff7fe640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f190006ed60 0x7f1900071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:10.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.782+0000 7f18ff7fe640 1 -- 172.21.15.119:0/3029475326 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f190c08d730 con 0x7f19180fe460 2024-09-13T21:41:10.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.782+0000 7f1916ffd640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f190006ed60 0x7f1900071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:10.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.783+0000 7f1916ffd640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f190006ed60 0x7f1900071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1908004a30 tx=0x7f1908004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:10.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.786+0000 7f18ff7fe640 1 -- 172.21.15.119:0/3029475326 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f190c04d2a0 con 0x7f19180fe460 2024-09-13T21:41:10.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:10 smithi155 ceph-mon[34732]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:10.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.942+0000 7f191d68b640 1 -- 172.21.15.119:0/3029475326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f191810e850 con 0x7f19180fe460 2024-09-13T21:41:10.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.943+0000 7f18ff7fe640 1 -- 172.21.15.119:0/3029475326 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11108 (secure 0 0 0) 0x7f190c05ac50 con 0x7f19180fe460 2024-09-13T21:41:10.945 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:41:10.945 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":38,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","created":"2024-09-13T21:35:40.067719+0000","modified":"2024-09-13T21:40:55.443085+0000","last_up_change":"2024-09-13T21:40:54.435322+0000","last_in_change":"2024-09-13T21:40:35.626027+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T21:39:39.960550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"3e8b172e-d14d-4fe7-9e19-a623844ddaba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6803","nonce":2110350104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6805","nonce":2110350104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6809","nonce":2110350104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6807","nonce":2110350104}]},"public_addr":"172.21.15.119:6803/2110350104","cluster_addr":"172.21.15.119:6805/2110350104","heartbeat_back_addr":"172.21.15.119:6809/2110350104","heartbeat_front_addr":"172.21.15.119:6807/2110350104","state":["exists","up"]},{"osd":1,"uuid":"20f7ea98-15de-439f-94c4-9b9cf453b74d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6811","nonce":1621715795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6813","nonce":1621715795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6817","nonce":1621715795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6815","nonce":1621715795}]},"public_addr":"172.21.15.119:6811/1621715795","cluster_addr":"172.21.15.119:6813/1621715795","heartbeat_back_addr":"172.21.15.119:6817/1621715795","heartbeat_front_addr":"172.21.15.119:6815/1621715795","state":["exists","up"]},{"osd":2,"uuid":"a363ab32-96ac-4960-8a67-01dbf5ee5016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6819","nonce":2710038891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6821","nonce":2710038891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6825","nonce":2710038891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6823","nonce":2710038891}]},"public_addr":"172.21.15.119:6819/2710038891","cluster_addr":"172.21.15.119:6821/2710038891","heartbeat_back_addr":"172.21.15.119:6825/2710038891","heartbeat_front_addr":"172.21.15.119:6823/2710038891","state":["exists","up"]},{"osd":3,"uuid":"c466e0be-66c9-49ba-ab51-7ba539606287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6801","nonce":1451588865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6803","nonce":1451588865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6807","nonce":1451588865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6805","nonce":1451588865}]},"public_addr":"172.21.15.155:6801/1451588865","cluster_addr":"172.21.15.155:6803/1451588865","heartbeat_back_addr":"172.21.15.155:6807/1451588865","heartbeat_front_addr":"172.21.15.155:6805/1451588865","state":["exists","up"]},{"osd":4,"uuid":"409c56f1-9e14-455a-a229-81f504ade49a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6809","nonce":70849809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6811","nonce":70849809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6815","nonce":70849809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6813","nonce":70849809}]},"public_addr":"172.21.15.155:6809/70849809","cluster_addr":"172.21.15.155:6811/70849809","heartbeat_back_addr":"172.21.15.155:6815/70849809","heartbeat_front_addr":"172.21.15.155:6813/70849809","state":["exists","up"]},{"osd":5,"uuid":"3943357b-59a1-45d5-9d34-804b3a2bb64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6817","nonce":929688381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6819","nonce":929688381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6823","nonce":929688381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6821","nonce":929688381}]},"public_addr":"172.21.15.155:6817/929688381","cluster_addr":"172.21.15.155:6819/929688381","heartbeat_back_addr":"172.21.15.155:6823/929688381","heartbeat_front_addr":"172.21.15.155:6821/929688381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:38:41.412003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:39:10.073235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:39:38.202262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:40:01.287717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:40:26.885567+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:40:52.549373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2630647001":"2024-09-14T21:37:29.647517+0000","172.21.15.119:6801/1188851329":"2024-09-14T21:37:29.647517+0000","172.21.15.119:0/4064361328":"2024-09-14T21:37:29.647517+0000","172.21.15.119:0/2537835370":"2024-09-14T21:36:02.290241+0000","172.21.15.119:6800/254943630":"2024-09-14T21:36:02.290241+0000","172.21.15.119:6801/254943630":"2024-09-14T21:36:02.290241+0000","172.21.15.119:0/4158458893":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/4214610807":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/1804460008":"2024-09-14T21:36:02.290241+0000","172.21.15.119:0/1724446307":"2024-09-14T21:36:02.290241+0000","172.21.15.119:6800/366226653":"2024-09-14T21:36:31.341760+0000","172.21.15.119:6801/366226653":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/1575352567":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/2573788183":"2024-09-14T21:37:29.647517+0000","172.21.15.119:6800/1188851329":"2024-09-14T21:37:29.647517+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T21:41:10.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.944+0000 7f191d68b640 1 -- 172.21.15.119:0/3029475326 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f190006ed60 msgr2=0x7f1900071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:10.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.945+0000 7f191d68b640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f190006ed60 0x7f1900071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1908004a30 tx=0x7f1908004d10 comp rx=0 tx=0).stop 2024-09-13T21:41:10.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.945+0000 7f191d68b640 1 -- 172.21.15.119:0/3029475326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19180fe460 msgr2=0x7f19181136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:10.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.945+0000 7f191d68b640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19180fe460 0x7f19181136f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f190c002a50 tx=0x7f190c004600 comp rx=0 tx=0).stop 2024-09-13T21:41:10.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.945+0000 7f191d68b640 1 -- 172.21.15.119:0/3029475326 shutdown_connections 2024-09-13T21:41:10.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.945+0000 7f191d68b640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f190006ed60 0x7f1900071210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:10.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.945+0000 7f191d68b640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19180fe460 0x7f19181136f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:10.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.945+0000 7f191d68b640 1 --2- 172.21.15.119:0/3029475326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1918064fc0 0x7f19181131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:10.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.945+0000 7f191d68b640 1 -- 172.21.15.119:0/3029475326 >> 172.21.15.119:0/3029475326 conn(0x7f19180723b0 msgr2=0x7f1918105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:10.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.945+0000 7f191d68b640 1 -- 172.21.15.119:0/3029475326 shutdown_connections 2024-09-13T21:41:10.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:10.945+0000 7f191d68b640 1 -- 172.21.15.119:0/3029475326 wait complete. 2024-09-13T21:41:11.570 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T21:41:11.570 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T21:41:11.734 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:11 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3029475326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:41:11.817 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:11.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:11 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3029475326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:41:12.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:12 smithi119 ceph-mon[27653]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:12.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:12 smithi155 ceph-mon[34732]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:13.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.413+0000 7f2d3910e640 1 -- 172.21.15.119:0/1644466415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d34102660 msgr2=0x7f2d34102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:13.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.413+0000 7f2d3910e640 1 --2- 172.21.15.119:0/1644466415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d34102660 0x7f2d34102a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2d280048d0 tx=0x7f2d28009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:13.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.413+0000 7f2d3910e640 1 -- 172.21.15.119:0/1644466415 shutdown_connections 2024-09-13T21:41:13.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.413+0000 7f2d3910e640 1 --2- 172.21.15.119:0/1644466415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d340fac80 0x7f2d340fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:13.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.413+0000 7f2d3910e640 1 --2- 172.21.15.119:0/1644466415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d34102660 0x7f2d34102a30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:13.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.413+0000 7f2d3910e640 1 -- 172.21.15.119:0/1644466415 >> 172.21.15.119:0/1644466415 conn(0x7f2d34070ce0 msgr2=0x7f2d340710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:13.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.413+0000 7f2d3910e640 1 -- 172.21.15.119:0/1644466415 shutdown_connections 2024-09-13T21:41:13.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.413+0000 7f2d3910e640 1 -- 172.21.15.119:0/1644466415 wait complete. 2024-09-13T21:41:13.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.414+0000 7f2d3910e640 1 Processor -- start 2024-09-13T21:41:13.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.414+0000 7f2d3910e640 1 -- start start 2024-09-13T21:41:13.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.414+0000 7f2d3910e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d340fac80 0x7f2d341131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:13.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.414+0000 7f2d3910e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d34102660 0x7f2d34113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:13.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.414+0000 7f2d3910e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34113d10 con 0x7f2d34102660 2024-09-13T21:41:13.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.414+0000 7f2d3910e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3410d150 con 0x7f2d340fac80 2024-09-13T21:41:13.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.414+0000 7f2d3259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d34102660 0x7f2d34113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:13.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.414+0000 7f2d3259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d34102660 0x7f2d34113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50174/0 (socket says 172.21.15.119:50174) 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.414+0000 7f2d3259c640 1 -- 172.21.15.119:0/2219054296 learned_addr learned my addr 172.21.15.119:0/2219054296 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.414+0000 7f2d32d9d640 1 --2- 172.21.15.119:0/2219054296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d340fac80 0x7f2d341131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.415+0000 7f2d3259c640 1 -- 172.21.15.119:0/2219054296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d340fac80 msgr2=0x7f2d341131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.415+0000 7f2d3259c640 1 --2- 172.21.15.119:0/2219054296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d340fac80 0x7f2d341131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.415+0000 7f2d3259c640 1 -- 172.21.15.119:0/2219054296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28005040 con 0x7f2d34102660 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.415+0000 7f2d3259c640 1 --2- 172.21.15.119:0/2219054296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d34102660 0x7f2d34113710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2d24002a50 tx=0x7f2d24004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.415+0000 7f2d1b7fe640 1 -- 172.21.15.119:0/2219054296 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d24007c30 con 0x7f2d34102660 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.415+0000 7f2d1b7fe640 1 -- 172.21.15.119:0/2219054296 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2d2400f040 con 0x7f2d34102660 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.415+0000 7f2d1b7fe640 1 -- 172.21.15.119:0/2219054296 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d2400dad0 con 0x7f2d34102660 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.415+0000 7f2d3910e640 1 -- 172.21.15.119:0/2219054296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3410d430 con 0x7f2d34102660 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.415+0000 7f2d3910e640 1 -- 172.21.15.119:0/2219054296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3410d9d0 con 0x7f2d34102660 2024-09-13T21:41:13.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.416+0000 7f2d3910e640 1 -- 172.21.15.119:0/2219054296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d340657d0 con 0x7f2d34102660 2024-09-13T21:41:13.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.417+0000 7f2d1b7fe640 1 -- 172.21.15.119:0/2219054296 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2d2400dc30 con 0x7f2d34102660 2024-09-13T21:41:13.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.417+0000 7f2d1b7fe640 1 --2- 172.21.15.119:0/2219054296 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d1c06ed60 0x7f2d1c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:13.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.417+0000 7f2d32d9d640 1 --2- 172.21.15.119:0/2219054296 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d1c06ed60 0x7f2d1c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:13.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.417+0000 7f2d1b7fe640 1 -- 172.21.15.119:0/2219054296 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2d2408dbc0 con 0x7f2d34102660 2024-09-13T21:41:13.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.418+0000 7f2d32d9d640 1 --2- 172.21.15.119:0/2219054296 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d1c06ed60 0x7f2d1c071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009ac0 tx=0x7f2d28035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:13.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.421+0000 7f2d1b7fe640 1 -- 172.21.15.119:0/2219054296 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2d2405b0a0 con 0x7f2d34102660 2024-09-13T21:41:13.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.578+0000 7f2d3910e640 1 -- 172.21.15.119:0/2219054296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d34074c00 con 0x7f2d34102660 2024-09-13T21:41:13.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.578+0000 7f2d1b7fe640 1 -- 172.21.15.119:0/2219054296 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11108 (secure 0 0 0) 0x7f2d2405aa40 con 0x7f2d34102660 2024-09-13T21:41:13.580 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:41:13.580 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":38,"fsid":"f9722044-7217-11ef-bceb-c7b262605968","created":"2024-09-13T21:35:40.067719+0000","modified":"2024-09-13T21:40:55.443085+0000","last_up_change":"2024-09-13T21:40:54.435322+0000","last_in_change":"2024-09-13T21:40:35.626027+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T21:39:39.960550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"3e8b172e-d14d-4fe7-9e19-a623844ddaba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6803","nonce":2110350104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6805","nonce":2110350104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6809","nonce":2110350104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2110350104},{"type":"v1","addr":"172.21.15.119:6807","nonce":2110350104}]},"public_addr":"172.21.15.119:6803/2110350104","cluster_addr":"172.21.15.119:6805/2110350104","heartbeat_back_addr":"172.21.15.119:6809/2110350104","heartbeat_front_addr":"172.21.15.119:6807/2110350104","state":["exists","up"]},{"osd":1,"uuid":"20f7ea98-15de-439f-94c4-9b9cf453b74d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6811","nonce":1621715795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6813","nonce":1621715795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6817","nonce":1621715795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1621715795},{"type":"v1","addr":"172.21.15.119:6815","nonce":1621715795}]},"public_addr":"172.21.15.119:6811/1621715795","cluster_addr":"172.21.15.119:6813/1621715795","heartbeat_back_addr":"172.21.15.119:6817/1621715795","heartbeat_front_addr":"172.21.15.119:6815/1621715795","state":["exists","up"]},{"osd":2,"uuid":"a363ab32-96ac-4960-8a67-01dbf5ee5016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6819","nonce":2710038891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6821","nonce":2710038891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6825","nonce":2710038891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2710038891},{"type":"v1","addr":"172.21.15.119:6823","nonce":2710038891}]},"public_addr":"172.21.15.119:6819/2710038891","cluster_addr":"172.21.15.119:6821/2710038891","heartbeat_back_addr":"172.21.15.119:6825/2710038891","heartbeat_front_addr":"172.21.15.119:6823/2710038891","state":["exists","up"]},{"osd":3,"uuid":"c466e0be-66c9-49ba-ab51-7ba539606287","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6801","nonce":1451588865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6803","nonce":1451588865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6807","nonce":1451588865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":1451588865},{"type":"v1","addr":"172.21.15.155:6805","nonce":1451588865}]},"public_addr":"172.21.15.155:6801/1451588865","cluster_addr":"172.21.15.155:6803/1451588865","heartbeat_back_addr":"172.21.15.155:6807/1451588865","heartbeat_front_addr":"172.21.15.155:6805/1451588865","state":["exists","up"]},{"osd":4,"uuid":"409c56f1-9e14-455a-a229-81f504ade49a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6809","nonce":70849809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6811","nonce":70849809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6815","nonce":70849809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":70849809},{"type":"v1","addr":"172.21.15.155:6813","nonce":70849809}]},"public_addr":"172.21.15.155:6809/70849809","cluster_addr":"172.21.15.155:6811/70849809","heartbeat_back_addr":"172.21.15.155:6815/70849809","heartbeat_front_addr":"172.21.15.155:6813/70849809","state":["exists","up"]},{"osd":5,"uuid":"3943357b-59a1-45d5-9d34-804b3a2bb64c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6817","nonce":929688381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6819","nonce":929688381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6823","nonce":929688381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":929688381},{"type":"v1","addr":"172.21.15.155:6821","nonce":929688381}]},"public_addr":"172.21.15.155:6817/929688381","cluster_addr":"172.21.15.155:6819/929688381","heartbeat_back_addr":"172.21.15.155:6823/929688381","heartbeat_front_addr":"172.21.15.155:6821/929688381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:38:41.412003+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:39:10.073235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:39:38.202262+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:40:01.287717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:40:26.885567+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T21:40:52.549373+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2630647001":"2024-09-14T21:37:29.647517+0000","172.21.15.119:6801/1188851329":"2024-09-14T21:37:29.647517+0000","172.21.15.119:0/4064361328":"2024-09-14T21:37:29.647517+0000","172.21.15.119:0/2537835370":"2024-09-14T21:36:02.290241+0000","172.21.15.119:6800/254943630":"2024-09-14T21:36:02.290241+0000","172.21.15.119:6801/254943630":"2024-09-14T21:36:02.290241+0000","172.21.15.119:0/4158458893":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/4214610807":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/1804460008":"2024-09-14T21:36:02.290241+0000","172.21.15.119:0/1724446307":"2024-09-14T21:36:02.290241+0000","172.21.15.119:6800/366226653":"2024-09-14T21:36:31.341760+0000","172.21.15.119:6801/366226653":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/1575352567":"2024-09-14T21:36:31.341760+0000","172.21.15.119:0/2573788183":"2024-09-14T21:37:29.647517+0000","172.21.15.119:6800/1188851329":"2024-09-14T21:37:29.647517+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T21:41:13.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.580+0000 7f2d3910e640 1 -- 172.21.15.119:0/2219054296 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d1c06ed60 msgr2=0x7f2d1c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:13.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.580+0000 7f2d3910e640 1 --2- 172.21.15.119:0/2219054296 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d1c06ed60 0x7f2d1c071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009ac0 tx=0x7f2d28035040 comp rx=0 tx=0).stop 2024-09-13T21:41:13.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.580+0000 7f2d3910e640 1 -- 172.21.15.119:0/2219054296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d34102660 msgr2=0x7f2d34113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:13.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.580+0000 7f2d3910e640 1 --2- 172.21.15.119:0/2219054296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d34102660 0x7f2d34113710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2d24002a50 tx=0x7f2d24004600 comp rx=0 tx=0).stop 2024-09-13T21:41:13.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.580+0000 7f2d3910e640 1 -- 172.21.15.119:0/2219054296 shutdown_connections 2024-09-13T21:41:13.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.580+0000 7f2d3910e640 1 --2- 172.21.15.119:0/2219054296 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d1c06ed60 0x7f2d1c071210 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:13.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.580+0000 7f2d3910e640 1 --2- 172.21.15.119:0/2219054296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d34102660 0x7f2d34113710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:13.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.580+0000 7f2d3910e640 1 --2- 172.21.15.119:0/2219054296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d340fac80 0x7f2d341131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:13.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.580+0000 7f2d3910e640 1 -- 172.21.15.119:0/2219054296 >> 172.21.15.119:0/2219054296 conn(0x7f2d34070ce0 msgr2=0x7f2d340fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:13.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.580+0000 7f2d3910e640 1 -- 172.21.15.119:0/2219054296 shutdown_connections 2024-09-13T21:41:13.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:13.580+0000 7f2d3910e640 1 -- 172.21.15.119:0/2219054296 wait complete. 2024-09-13T21:41:13.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:13 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2219054296' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:41:14.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:13 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2219054296' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T21:41:14.300 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T21:41:14.300 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T21:41:14.301 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T21:41:14.301 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T21:41:14.301 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T21:41:14.302 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T21:41:14.586 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:14.589 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:14.957 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:14 smithi119 ceph-mon[27653]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:15.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:14 smithi155 ceph-mon[34732]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:15.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:16.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:16.750 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:16 smithi119 ceph-mon[27653]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:17.022 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:17.022 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:17.022 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:17.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:16 smithi155 ceph-mon[34732]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:17.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.281+0000 7f3961a33640 1 -- 172.21.15.119:0/4105120190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f395c0fb810 msgr2=0x7f395c0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:17.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.281+0000 7f3961a33640 1 --2- 172.21.15.119:0/4105120190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f395c0fb810 0x7f395c0fbbe0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f394c009c50 tx=0x7f394c004d10 comp rx=0 tx=0).stop 2024-09-13T21:41:17.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.281+0000 7f3961a33640 1 -- 172.21.15.119:0/4105120190 shutdown_connections 2024-09-13T21:41:17.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.281+0000 7f3961a33640 1 --2- 172.21.15.119:0/4105120190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fcf80 0x7f395c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:17.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.281+0000 7f3961a33640 1 --2- 172.21.15.119:0/4105120190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f395c0fb810 0x7f395c0fbbe0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:17.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.281+0000 7f3961a33640 1 -- 172.21.15.119:0/4105120190 >> 172.21.15.119:0/4105120190 conn(0x7f395c0723b0 msgr2=0x7f395c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.281+0000 7f3961a33640 1 -- 172.21.15.119:0/4105120190 shutdown_connections 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.281+0000 7f3961a33640 1 -- 172.21.15.119:0/4105120190 wait complete. 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.282+0000 7f3961a33640 1 Processor -- start 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.282+0000 7f3961a33640 1 -- start start 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.282+0000 7f3961a33640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb810 0x7f395c10e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.282+0000 7f3961a33640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f395c0fcf80 0x7f395c10e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.282+0000 7f3961a33640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c10ede0 con 0x7f395c0fcf80 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.282+0000 7f3961a33640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c10ef50 con 0x7f395c0fb810 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.282+0000 7f395a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f395c0fcf80 0x7f395c10e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.282+0000 7f395a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f395c0fcf80 0x7f395c10e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35136/0 (socket says 172.21.15.119:35136) 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.282+0000 7f395a7fc640 1 -- 172.21.15.119:0/1652367218 learned_addr learned my addr 172.21.15.119:0/1652367218 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.283+0000 7f395affd640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb810 0x7f395c10e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:17.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.283+0000 7f395a7fc640 1 -- 172.21.15.119:0/1652367218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb810 msgr2=0x7f395c10e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:17.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.283+0000 7f395a7fc640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb810 0x7f395c10e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:17.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.283+0000 7f395a7fc640 1 -- 172.21.15.119:0/1652367218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c0098b0 con 0x7f395c0fcf80 2024-09-13T21:41:17.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.283+0000 7f395a7fc640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f395c0fcf80 0x7f395c10e700 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f394400b790 tx=0x7f39440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:17.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.283+0000 7f39537fe640 1 -- 172.21.15.119:0/1652367218 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f394400c700 con 0x7f395c0fcf80 2024-09-13T21:41:17.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.283+0000 7f39537fe640 1 -- 172.21.15.119:0/1652367218 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f394400cd00 con 0x7f395c0fcf80 2024-09-13T21:41:17.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.283+0000 7f3961a33640 1 -- 172.21.15.119:0/1652367218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395c117230 con 0x7f395c0fcf80 2024-09-13T21:41:17.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.283+0000 7f39537fe640 1 -- 172.21.15.119:0/1652367218 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3944015e70 con 0x7f395c0fcf80 2024-09-13T21:41:17.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.283+0000 7f3961a33640 1 -- 172.21.15.119:0/1652367218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395c117750 con 0x7f395c0fcf80 2024-09-13T21:41:17.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.284+0000 7f3961a33640 1 -- 172.21.15.119:0/1652367218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f395c0fae90 con 0x7f395c0fcf80 2024-09-13T21:41:17.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.284+0000 7f39537fe640 1 -- 172.21.15.119:0/1652367218 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3944012070 con 0x7f395c0fcf80 2024-09-13T21:41:17.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.285+0000 7f39537fe640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f394806ed50 0x7f3948071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:17.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.285+0000 7f395affd640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f394806ed50 0x7f3948071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:17.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.285+0000 7f39537fe640 1 -- 172.21.15.119:0/1652367218 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f394408d9d0 con 0x7f395c0fcf80 2024-09-13T21:41:17.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.285+0000 7f39537fe640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381] conn(0x7f3948074ad0 0x7f3948076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:17.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.285+0000 7f39537fe640 1 -- 172.21.15.119:0/1652367218 --> [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3948077590 con 0x7f3948074ad0 2024-09-13T21:41:17.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.285+0000 7f39537fe640 1 -- 172.21.15.119:0/1652367218 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3944092220 con 0x7f395c0fcf80 2024-09-13T21:41:17.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.285+0000 7f395affd640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f394806ed50 0x7f3948071200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f394c004a30 tx=0x7f394c004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:17.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.285+0000 7f395b7fe640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381] conn(0x7f3948074ad0 0x7f3948076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:17.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.286+0000 7f395b7fe640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381] conn(0x7f3948074ad0 0x7f3948076ee0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:17.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.286+0000 7f39537fe640 1 -- 172.21.15.119:0/1652367218 <== osd.5 v2:172.21.15.155:6816/929688381 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3948077590 con 0x7f3948074ad0 2024-09-13T21:41:17.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.298+0000 7f3961a33640 1 -- 172.21.15.119:0/1652367218 --> [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f395c0fcbc0 con 0x7f3948074ad0 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f39537fe640 1 -- 172.21.15.119:0/1652367218 <== osd.5 v2:172.21.15.155:6816/929688381 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f395c0fcbc0 con 0x7f3948074ad0 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 -- 172.21.15.119:0/1652367218 >> [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381] conn(0x7f3948074ad0 msgr2=0x7f3948076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381] conn(0x7f3948074ad0 0x7f3948076ee0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 -- 172.21.15.119:0/1652367218 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f394806ed50 msgr2=0x7f3948071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f394806ed50 0x7f3948071200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f394c004a30 tx=0x7f394c004d10 comp rx=0 tx=0).stop 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 -- 172.21.15.119:0/1652367218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f395c0fcf80 msgr2=0x7f395c10e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f395c0fcf80 0x7f395c10e700 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f394400b790 tx=0x7f39440091d0 comp rx=0 tx=0).stop 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 -- 172.21.15.119:0/1652367218 shutdown_connections 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.155:6816/929688381,v1:172.21.15.155:6817/929688381] conn(0x7f3948074ad0 0x7f3948076ee0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f394806ed50 0x7f3948071200 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f395c0fcf80 0x7f395c10e700 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 --2- 172.21.15.119:0/1652367218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0fb810 0x7f395c10e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 -- 172.21.15.119:0/1652367218 >> 172.21.15.119:0/1652367218 conn(0x7f395c0723b0 msgr2=0x7f395c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 -- 172.21.15.119:0/1652367218 shutdown_connections 2024-09-13T21:41:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:17.299+0000 7f3961a33640 1 -- 172.21.15.119:0/1652367218 wait complete. 2024-09-13T21:41:19.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:18 smithi155 ceph-mon[34732]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:19.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:18 smithi119 ceph-mon[27653]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:20.371 INFO:teuthology.orchestra.run.smithi119.stdout:158913789959 2024-09-13T21:41:20.371 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T21:41:20.381 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:21.076 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:20 smithi119 ceph-mon[27653]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:21.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:20 smithi155 ceph-mon[34732]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:21.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 -- 172.21.15.119:0/4250493830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f012c0fac80 msgr2=0x7f012c0fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:21.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 --2- 172.21.15.119:0/4250493830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f012c0fac80 0x7f012c0fb0d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f011c0048d0 tx=0x7f011c009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:21.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 -- 172.21.15.119:0/4250493830 shutdown_connections 2024-09-13T21:41:21.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 --2- 172.21.15.119:0/4250493830 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f012c0fac80 0x7f012c0fb0d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:21.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 --2- 172.21.15.119:0/4250493830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f012c100c70 0x7f012c101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:21.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 -- 172.21.15.119:0/4250493830 >> 172.21.15.119:0/4250493830 conn(0x7f012c070ce0 msgr2=0x7f012c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:21.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 -- 172.21.15.119:0/4250493830 shutdown_connections 2024-09-13T21:41:21.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 -- 172.21.15.119:0/4250493830 wait complete. 2024-09-13T21:41:21.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 Processor -- start 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 -- start start 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f012c0fac80 0x7f012c1131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f012c100c70 0x7f012c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c113d30 con 0x7f012c100c70 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.968+0000 7f01346a6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c10d170 con 0x7f012c0fac80 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f0131c41640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f012c100c70 0x7f012c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f0131c41640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f012c100c70 0x7f012c113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35156/0 (socket says 172.21.15.119:35156) 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f0131c41640 1 -- 172.21.15.119:0/3373849198 learned_addr learned my addr 172.21.15.119:0/3373849198 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f0132442640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f012c0fac80 0x7f012c1131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f0131c41640 1 -- 172.21.15.119:0/3373849198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f012c0fac80 msgr2=0x7f012c1131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f0131c41640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f012c0fac80 0x7f012c1131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f0131c41640 1 -- 172.21.15.119:0/3373849198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c005040 con 0x7f012c100c70 2024-09-13T21:41:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f0131c41640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f012c100c70 0x7f012c113730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f011c000c00 tx=0x7f011c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f0122ffd640 1 -- 172.21.15.119:0/3373849198 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f011c038070 con 0x7f012c100c70 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f0122ffd640 1 -- 172.21.15.119:0/3373849198 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f011c02ade0 con 0x7f012c100c70 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f01346a6640 1 -- 172.21.15.119:0/3373849198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012c10d3f0 con 0x7f012c100c70 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f0122ffd640 1 -- 172.21.15.119:0/3373849198 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f011c02c7e0 con 0x7f012c100c70 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.969+0000 7f01346a6640 1 -- 172.21.15.119:0/3373849198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c10d930 con 0x7f012c100c70 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.970+0000 7f01346a6640 1 -- 172.21.15.119:0/3373849198 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f012c10de10 con 0x7f012c100c70 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.971+0000 7f0122ffd640 1 -- 172.21.15.119:0/3373849198 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f011c030020 con 0x7f012c100c70 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.971+0000 7f0122ffd640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f011806ed60 0x7f0118071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.971+0000 7f0122ffd640 1 -- 172.21.15.119:0/3373849198 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f011c0adad0 con 0x7f012c100c70 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.971+0000 7f0132442640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f011806ed60 0x7f0118071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.971+0000 7f0122ffd640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104] conn(0x7f0118074ae0 0x7f0118076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.971+0000 7f0122ffd640 1 -- 172.21.15.119:0/3373849198 --> [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01180775a0 con 0x7f0118074ae0 2024-09-13T21:41:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.971+0000 7f0122ffd640 1 -- 172.21.15.119:0/3373849198 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f011c0b2220 con 0x7f012c100c70 2024-09-13T21:41:21.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.971+0000 7f0132c43640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104] conn(0x7f0118074ae0 0x7f0118076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:21.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.972+0000 7f0132442640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f011806ed60 0x7f0118071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:21.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.972+0000 7f0132c43640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104] conn(0x7f0118074ae0 0x7f0118076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:21.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.972+0000 7f0122ffd640 1 -- 172.21.15.119:0/3373849198 <== osd.0 v2:172.21.15.119:6802/2110350104 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f01180775a0 con 0x7f0118074ae0 2024-09-13T21:41:21.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.985+0000 7f01346a6640 1 -- 172.21.15.119:0/3373849198 --> [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f012c100180 con 0x7f0118074ae0 2024-09-13T21:41:21.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.985+0000 7f0122ffd640 1 -- 172.21.15.119:0/3373849198 <== osd.0 v2:172.21.15.119:6802/2110350104 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f012c100180 con 0x7f0118074ae0 2024-09-13T21:41:21.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 -- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104] conn(0x7f0118074ae0 msgr2=0x7f0118076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:21.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104] conn(0x7f0118074ae0 0x7f0118076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 -- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f011806ed60 msgr2=0x7f0118071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f011806ed60 0x7f0118071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128009040 comp rx=0 tx=0).stop 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 -- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f012c100c70 msgr2=0x7f012c113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f012c100c70 0x7f012c113730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f011c000c00 tx=0x7f011c009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 -- 172.21.15.119:0/3373849198 shutdown_connections 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6802/2110350104,v1:172.21.15.119:6803/2110350104] conn(0x7f0118074ae0 0x7f0118076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f011806ed60 0x7f0118071210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f012c100c70 0x7f012c113730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 --2- 172.21.15.119:0/3373849198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f012c0fac80 0x7f012c1131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 -- 172.21.15.119:0/3373849198 >> 172.21.15.119:0/3373849198 conn(0x7f012c070ce0 msgr2=0x7f012c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 -- 172.21.15.119:0/3373849198 shutdown_connections 2024-09-13T21:41:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:21.986+0000 7f01346a6640 1 -- 172.21.15.119:0/3373849198 wait complete. 2024-09-13T21:41:22.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.733+0000 7f2d7c951640 1 -- 172.21.15.119:0/146937879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d78102ed0 msgr2=0x7f2d780fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:22.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.733+0000 7f2d7c951640 1 --2- 172.21.15.119:0/146937879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d78102ed0 0x7f2d780fc590 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d600048d0 tx=0x7f2d60009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:22.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.733+0000 7f2d7c951640 1 -- 172.21.15.119:0/146937879 shutdown_connections 2024-09-13T21:41:22.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.733+0000 7f2d7c951640 1 --2- 172.21.15.119:0/146937879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d78102ed0 0x7f2d780fc590 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:22.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.733+0000 7f2d7c951640 1 --2- 172.21.15.119:0/146937879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d78102530 0x7f2d78102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:22.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.733+0000 7f2d7c951640 1 -- 172.21.15.119:0/146937879 >> 172.21.15.119:0/146937879 conn(0x7f2d780f80f0 msgr2=0x7f2d780fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:22.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.733+0000 7f2d7c951640 1 -- 172.21.15.119:0/146937879 shutdown_connections 2024-09-13T21:41:22.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.733+0000 7f2d7c951640 1 -- 172.21.15.119:0/146937879 wait complete. 2024-09-13T21:41:22.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.734+0000 7f2d7c951640 1 Processor -- start 2024-09-13T21:41:22.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.734+0000 7f2d7c951640 1 -- start start 2024-09-13T21:41:22.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.734+0000 7f2d7c951640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d78102530 0x7f2d781131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:22.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.734+0000 7f2d7c951640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d78102ed0 0x7f2d78113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:22.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.734+0000 7f2d7c951640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d78113d30 con 0x7f2d78102530 2024-09-13T21:41:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.734+0000 7f2d7c951640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7810d170 con 0x7f2d78102ed0 2024-09-13T21:41:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.734+0000 7f2d7659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d78102530 0x7f2d781131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.734+0000 7f2d7659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d78102530 0x7f2d781131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:35182/0 (socket says 172.21.15.119:35182) 2024-09-13T21:41:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.734+0000 7f2d7659c640 1 -- 172.21.15.119:0/1297084233 learned_addr learned my addr 172.21.15.119:0/1297084233 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.735+0000 7f2d6dd9b640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d78102ed0 0x7f2d78113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.735+0000 7f2d7659c640 1 -- 172.21.15.119:0/1297084233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d78102ed0 msgr2=0x7f2d78113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:22.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.735+0000 7f2d7659c640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d78102ed0 0x7f2d78113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:22.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.735+0000 7f2d7659c640 1 -- 172.21.15.119:0/1297084233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d60005040 con 0x7f2d78102530 2024-09-13T21:41:22.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.735+0000 7f2d7659c640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d78102530 0x7f2d781131f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2d68002a50 tx=0x7f2d68004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:22.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.735+0000 7f2d6f7fe640 1 -- 172.21.15.119:0/1297084233 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d68007c30 con 0x7f2d78102530 2024-09-13T21:41:22.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.735+0000 7f2d7c951640 1 -- 172.21.15.119:0/1297084233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7810d450 con 0x7f2d78102530 2024-09-13T21:41:22.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.735+0000 7f2d6f7fe640 1 -- 172.21.15.119:0/1297084233 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2d6800f040 con 0x7f2d78102530 2024-09-13T21:41:22.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.735+0000 7f2d6f7fe640 1 -- 172.21.15.119:0/1297084233 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d6800da90 con 0x7f2d78102530 2024-09-13T21:41:22.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.735+0000 7f2d7c951640 1 -- 172.21.15.119:0/1297084233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7810d9c0 con 0x7f2d78102530 2024-09-13T21:41:22.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.736+0000 7f2d7c951640 1 -- 172.21.15.119:0/1297084233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d7810de70 con 0x7f2d78102530 2024-09-13T21:41:22.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.736+0000 7f2d6f7fe640 1 -- 172.21.15.119:0/1297084233 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2d6800dd00 con 0x7f2d78102530 2024-09-13T21:41:22.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.737+0000 7f2d6f7fe640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d6406ed60 0x7f2d64071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:22.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.737+0000 7f2d6f7fe640 1 -- 172.21.15.119:0/1297084233 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2d6808d700 con 0x7f2d78102530 2024-09-13T21:41:22.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.737+0000 7f2d6dd9b640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d6406ed60 0x7f2d64071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:22.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.737+0000 7f2d6f7fe640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865] conn(0x7f2d64074ae0 0x7f2d64076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:22.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.737+0000 7f2d6f7fe640 1 -- 172.21.15.119:0/1297084233 --> [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d640775a0 con 0x7f2d64074ae0 2024-09-13T21:41:22.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.737+0000 7f2d6f7fe640 1 -- 172.21.15.119:0/1297084233 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d6808fd50 con 0x7f2d78102530 2024-09-13T21:41:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.737+0000 7f2d76d9d640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865] conn(0x7f2d64074ae0 0x7f2d64076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.737+0000 7f2d6dd9b640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d6406ed60 0x7f2d64071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d60000c00 tx=0x7f2d60035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.738+0000 7f2d76d9d640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865] conn(0x7f2d64074ae0 0x7f2d64076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.738+0000 7f2d6f7fe640 1 -- 172.21.15.119:0/1297084233 <== osd.3 v2:172.21.15.155:6800/1451588865 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2d640775a0 con 0x7f2d64074ae0 2024-09-13T21:41:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.751+0000 7f2d7c951640 1 -- 172.21.15.119:0/1297084233 --> [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d7810dfe0 con 0x7f2d64074ae0 2024-09-13T21:41:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.751+0000 7f2d6f7fe640 1 -- 172.21.15.119:0/1297084233 <== osd.3 v2:172.21.15.155:6800/1451588865 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2d7810dfe0 con 0x7f2d64074ae0 2024-09-13T21:41:22.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 -- 172.21.15.119:0/1297084233 >> [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865] conn(0x7f2d64074ae0 msgr2=0x7f2d64076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:22.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865] conn(0x7f2d64074ae0 0x7f2d64076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:22.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 -- 172.21.15.119:0/1297084233 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d6406ed60 msgr2=0x7f2d64071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d6406ed60 0x7f2d64071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d60000c00 tx=0x7f2d60035040 comp rx=0 tx=0).stop 2024-09-13T21:41:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 -- 172.21.15.119:0/1297084233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d78102530 msgr2=0x7f2d781131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d78102530 0x7f2d781131f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2d68002a50 tx=0x7f2d68004600 comp rx=0 tx=0).stop 2024-09-13T21:41:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 -- 172.21.15.119:0/1297084233 shutdown_connections 2024-09-13T21:41:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.155:6800/1451588865,v1:172.21.15.155:6801/1451588865] conn(0x7f2d64074ae0 0x7f2d64076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f2d6406ed60 0x7f2d64071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:22.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d78102ed0 0x7f2d78113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:22.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 --2- 172.21.15.119:0/1297084233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d78102530 0x7f2d781131f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:22.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 -- 172.21.15.119:0/1297084233 >> 172.21.15.119:0/1297084233 conn(0x7f2d780f80f0 msgr2=0x7f2d780f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:22.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 -- 172.21.15.119:0/1297084233 shutdown_connections 2024-09-13T21:41:22.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:22.752+0000 7f2d7c951640 1 -- 172.21.15.119:0/1297084233 wait complete. 2024-09-13T21:41:23.044 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:22 smithi155 ceph-mon[34732]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:23.068 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:22 smithi119 ceph-mon[27653]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:24.036 INFO:teuthology.orchestra.run.smithi119.stdout:38654705698 2024-09-13T21:41:24.037 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T21:41:24.897 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:24 smithi119 ceph-mon[27653]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:25.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:24 smithi155 ceph-mon[34732]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:25.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.089+0000 7f94d0185640 1 -- 172.21.15.119:0/2976160618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8064fc0 msgr2=0x7f94c8065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:25.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.089+0000 7f94d0185640 1 --2- 172.21.15.119:0/2976160618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8064fc0 0x7f94c8065430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0048d0 tx=0x7f94bc009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.089+0000 7f94d0185640 1 -- 172.21.15.119:0/2976160618 shutdown_connections 2024-09-13T21:41:25.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.089+0000 7f94d0185640 1 --2- 172.21.15.119:0/2976160618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c8064fc0 0x7f94c8065430 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.089+0000 7f94d0185640 1 --2- 172.21.15.119:0/2976160618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94c80fe460 0x7f94c80fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.089+0000 7f94d0185640 1 -- 172.21.15.119:0/2976160618 >> 172.21.15.119:0/2976160618 conn(0x7f94c80723b0 msgr2=0x7f94c80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:25.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.090+0000 7f94d0185640 1 -- 172.21.15.119:0/2976160618 shutdown_connections 2024-09-13T21:41:25.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.090+0000 7f94d0185640 1 -- 172.21.15.119:0/2976160618 wait complete. 2024-09-13T21:41:25.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.090+0000 7f94d0185640 1 Processor -- start 2024-09-13T21:41:25.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.090+0000 7f94d0185640 1 -- start start 2024-09-13T21:41:25.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.090+0000 7f94d0185640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94c8064fc0 0x7f94c8113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:25.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.090+0000 7f94d0185640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c80fe460 0x7f94c8113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:25.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.090+0000 7f94d0185640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8113e00 con 0x7f94c80fe460 2024-09-13T21:41:25.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.090+0000 7f94d0185640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c810d1b0 con 0x7f94c8064fc0 2024-09-13T21:41:25.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.090+0000 7f94cd720640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c80fe460 0x7f94c8113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.090+0000 7f94cd720640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c80fe460 0x7f94c8113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37436/0 (socket says 172.21.15.119:37436) 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.091+0000 7f94cd720640 1 -- 172.21.15.119:0/2758692660 learned_addr learned my addr 172.21.15.119:0/2758692660 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.091+0000 7f94cdf21640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94c8064fc0 0x7f94c8113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.091+0000 7f94cd720640 1 -- 172.21.15.119:0/2758692660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94c8064fc0 msgr2=0x7f94c8113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.091+0000 7f94cd720640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94c8064fc0 0x7f94c8113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.091+0000 7f94cd720640 1 -- 172.21.15.119:0/2758692660 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc005040 con 0x7f94c80fe460 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.091+0000 7f94cd720640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c80fe460 0x7f94c8113770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94bc003080 tx=0x7f94bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.091+0000 7f94c67fc640 1 -- 172.21.15.119:0/2758692660 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94bc038070 con 0x7f94c80fe460 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.091+0000 7f94c67fc640 1 -- 172.21.15.119:0/2758692660 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f94bc0097e0 con 0x7f94c80fe460 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.091+0000 7f94d0185640 1 -- 172.21.15.119:0/2758692660 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c810d430 con 0x7f94c80fe460 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.091+0000 7f94c67fc640 1 -- 172.21.15.119:0/2758692660 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94bc03d420 con 0x7f94c80fe460 2024-09-13T21:41:25.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.091+0000 7f94d0185640 1 -- 172.21.15.119:0/2758692660 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c810d8f0 con 0x7f94c80fe460 2024-09-13T21:41:25.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.092+0000 7f94d0185640 1 -- 172.21.15.119:0/2758692660 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94c810ddd0 con 0x7f94c80fe460 2024-09-13T21:41:25.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.093+0000 7f94c67fc640 1 -- 172.21.15.119:0/2758692660 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f94bc030020 con 0x7f94c80fe460 2024-09-13T21:41:25.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.093+0000 7f94c67fc640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94b006ed60 0x7f94b0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:25.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.093+0000 7f94cdf21640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94b006ed60 0x7f94b0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:25.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.093+0000 7f94c67fc640 1 -- 172.21.15.119:0/2758692660 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f94bc0ae6a0 con 0x7f94c80fe460 2024-09-13T21:41:25.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.093+0000 7f94c67fc640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809] conn(0x7f94b0074ae0 0x7f94b0076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:25.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.093+0000 7f94c67fc640 1 -- 172.21.15.119:0/2758692660 --> [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94b00775a0 con 0x7f94b0074ae0 2024-09-13T21:41:25.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.093+0000 7f94c67fc640 1 -- 172.21.15.119:0/2758692660 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94bc0aea80 con 0x7f94c80fe460 2024-09-13T21:41:25.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.094+0000 7f94cdf21640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94b006ed60 0x7f94b0071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f94b8007580 tx=0x7f94b8009780 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:25.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.094+0000 7f94ce722640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809] conn(0x7f94b0074ae0 0x7f94b0076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:25.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.094+0000 7f94ce722640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809] conn(0x7f94b0074ae0 0x7f94b0076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:25.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.095+0000 7f94c67fc640 1 -- 172.21.15.119:0/2758692660 <== osd.4 v2:172.21.15.155:6808/70849809 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f94b00775a0 con 0x7f94b0074ae0 2024-09-13T21:41:25.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.109+0000 7f94d0185640 1 -- 172.21.15.119:0/2758692660 --> [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f94c8106e30 con 0x7f94b0074ae0 2024-09-13T21:41:25.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.109+0000 7f94c67fc640 1 -- 172.21.15.119:0/2758692660 <== osd.4 v2:172.21.15.155:6808/70849809 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f94c8106e30 con 0x7f94b0074ae0 2024-09-13T21:41:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 -- 172.21.15.119:0/2758692660 >> [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809] conn(0x7f94b0074ae0 msgr2=0x7f94b0076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809] conn(0x7f94b0074ae0 0x7f94b0076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 -- 172.21.15.119:0/2758692660 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94b006ed60 msgr2=0x7f94b0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94b006ed60 0x7f94b0071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f94b8007580 tx=0x7f94b8009780 comp rx=0 tx=0).stop 2024-09-13T21:41:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 -- 172.21.15.119:0/2758692660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c80fe460 msgr2=0x7f94c8113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c80fe460 0x7f94c8113770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94bc003080 tx=0x7f94bc009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 -- 172.21.15.119:0/2758692660 shutdown_connections 2024-09-13T21:41:25.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.155:6808/70849809,v1:172.21.15.155:6809/70849809] conn(0x7f94b0074ae0 0x7f94b0076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94b006ed60 0x7f94b0071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94c80fe460 0x7f94c8113770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 --2- 172.21.15.119:0/2758692660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94c8064fc0 0x7f94c8113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 -- 172.21.15.119:0/2758692660 >> 172.21.15.119:0/2758692660 conn(0x7f94c80723b0 msgr2=0x7f94c8105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:25.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 -- 172.21.15.119:0/2758692660 shutdown_connections 2024-09-13T21:41:25.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.110+0000 7f94d0185640 1 -- 172.21.15.119:0/2758692660 wait complete. 2024-09-13T21:41:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.272+0000 7f1999f3f640 1 -- 172.21.15.119:0/3238593492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19941025b0 msgr2=0x7f1994102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.272+0000 7f1999f3f640 1 --2- 172.21.15.119:0/3238593492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19941025b0 0x7f1994102980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f19840048d0 tx=0x7f1984009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 -- 172.21.15.119:0/3238593492 shutdown_connections 2024-09-13T21:41:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 --2- 172.21.15.119:0/3238593492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19940fac80 0x7f19940fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 --2- 172.21.15.119:0/3238593492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19941025b0 0x7f1994102980 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 -- 172.21.15.119:0/3238593492 >> 172.21.15.119:0/3238593492 conn(0x7f1994070ce0 msgr2=0x7f19940710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 -- 172.21.15.119:0/3238593492 shutdown_connections 2024-09-13T21:41:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 -- 172.21.15.119:0/3238593492 wait complete. 2024-09-13T21:41:25.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 Processor -- start 2024-09-13T21:41:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 -- start start 2024-09-13T21:41:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19940fac80 0x7f19940fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19941025b0 0x7f19940fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19940fc8e0 con 0x7f19940fac80 2024-09-13T21:41:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.273+0000 7f1999f3f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19940fca50 con 0x7f19941025b0 2024-09-13T21:41:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f19937fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19940fac80 0x7f19940fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f19937fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19940fac80 0x7f19940fbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37458/0 (socket says 172.21.15.119:37458) 2024-09-13T21:41:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f19937fe640 1 -- 172.21.15.119:0/4237909846 learned_addr learned my addr 172.21.15.119:0/4237909846 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f198affd640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19941025b0 0x7f19940fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f19937fe640 1 -- 172.21.15.119:0/4237909846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19941025b0 msgr2=0x7f19940fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:25.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f19937fe640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19941025b0 0x7f19940fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f19937fe640 1 -- 172.21.15.119:0/4237909846 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1984005040 con 0x7f19940fac80 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f19937fe640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19940fac80 0x7f19940fbe60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1984000c00 tx=0x7f1984009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f1990ff9640 1 -- 172.21.15.119:0/4237909846 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1984038070 con 0x7f19940fac80 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f1990ff9640 1 -- 172.21.15.119:0/4237909846 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f198402ade0 con 0x7f19940fac80 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f1990ff9640 1 -- 172.21.15.119:0/4237909846 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198402c7e0 con 0x7f19940fac80 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f1999f3f640 1 -- 172.21.15.119:0/4237909846 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19940fcc80 con 0x7f19940fac80 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.274+0000 7f1999f3f640 1 -- 172.21.15.119:0/4237909846 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1994119840 con 0x7f19940fac80 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.275+0000 7f1999f3f640 1 -- 172.21.15.119:0/4237909846 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1994106d20 con 0x7f19940fac80 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.276+0000 7f1990ff9640 1 -- 172.21.15.119:0/4237909846 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1984030020 con 0x7f19940fac80 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.276+0000 7f1990ff9640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f198006ed60 0x7f1980071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.276+0000 7f198affd640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f198006ed60 0x7f1980071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.276+0000 7f1990ff9640 1 -- 172.21.15.119:0/4237909846 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f19840adad0 con 0x7f19940fac80 2024-09-13T21:41:25.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.276+0000 7f1990ff9640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891] conn(0x7f1980074ae0 0x7f1980076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:25.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.276+0000 7f1990ff9640 1 -- 172.21.15.119:0/4237909846 --> [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19800775a0 con 0x7f1980074ae0 2024-09-13T21:41:25.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.276+0000 7f1990ff9640 1 -- 172.21.15.119:0/4237909846 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19840b2220 con 0x7f19940fac80 2024-09-13T21:41:25.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.277+0000 7f1993fff640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891] conn(0x7f1980074ae0 0x7f1980076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:25.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.277+0000 7f198affd640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f198006ed60 0x7f1980071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19940fd7a0 tx=0x7f197c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:25.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.277+0000 7f1993fff640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891] conn(0x7f1980074ae0 0x7f1980076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:25.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.277+0000 7f1990ff9640 1 -- 172.21.15.119:0/4237909846 <== osd.2 v2:172.21.15.119:6818/2710038891 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f19800775a0 con 0x7f1980074ae0 2024-09-13T21:41:25.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 -- 172.21.15.119:0/4237909846 --> [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f19940657d0 con 0x7f1980074ae0 2024-09-13T21:41:25.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1990ff9640 1 -- 172.21.15.119:0/4237909846 <== osd.2 v2:172.21.15.119:6818/2710038891 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f19940657d0 con 0x7f1980074ae0 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 -- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891] conn(0x7f1980074ae0 msgr2=0x7f1980076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891] conn(0x7f1980074ae0 0x7f1980076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 -- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f198006ed60 msgr2=0x7f1980071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f198006ed60 0x7f1980071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19940fd7a0 tx=0x7f197c00b040 comp rx=0 tx=0).stop 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 -- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19940fac80 msgr2=0x7f19940fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19940fac80 0x7f19940fbe60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1984000c00 tx=0x7f1984009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 -- 172.21.15.119:0/4237909846 shutdown_connections 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6818/2710038891,v1:172.21.15.119:6819/2710038891] conn(0x7f1980074ae0 0x7f1980076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f198006ed60 0x7f1980071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19941025b0 0x7f19940fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 --2- 172.21.15.119:0/4237909846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19940fac80 0x7f19940fbe60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 -- 172.21.15.119:0/4237909846 >> 172.21.15.119:0/4237909846 conn(0x7f1994070ce0 msgr2=0x7f1994105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 -- 172.21.15.119:0/4237909846 shutdown_connections 2024-09-13T21:41:25.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:25.290+0000 7f1999f3f640 1 -- 172.21.15.119:0/4237909846 wait complete. 2024-09-13T21:41:26.212 INFO:teuthology.orchestra.run.smithi119.stdout:81604378648 2024-09-13T21:41:26.212 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T21:41:26.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.408+0000 7faccb044640 1 -- 172.21.15.119:0/4217794419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facc4065520 msgr2=0x7facc4065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:26.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.408+0000 7faccb044640 1 --2- 172.21.15.119:0/4217794419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facc4065520 0x7facc4065970 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7facb00048d0 tx=0x7facb0009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:26.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.408+0000 7faccb044640 1 -- 172.21.15.119:0/4217794419 shutdown_connections 2024-09-13T21:41:26.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.408+0000 7faccb044640 1 --2- 172.21.15.119:0/4217794419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facc4065520 0x7facc4065970 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:26.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.408+0000 7faccb044640 1 --2- 172.21.15.119:0/4217794419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facc4101540 0x7facc4064fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:26.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.408+0000 7faccb044640 1 -- 172.21.15.119:0/4217794419 >> 172.21.15.119:0/4217794419 conn(0x7facc40723b0 msgr2=0x7facc40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:26.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.408+0000 7faccb044640 1 -- 172.21.15.119:0/4217794419 shutdown_connections 2024-09-13T21:41:26.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.408+0000 7faccb044640 1 -- 172.21.15.119:0/4217794419 wait complete. 2024-09-13T21:41:26.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.408+0000 7faccb044640 1 Processor -- start 2024-09-13T21:41:26.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.408+0000 7faccb044640 1 -- start start 2024-09-13T21:41:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.409+0000 7faccb044640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facc4065520 0x7facc41198e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.409+0000 7faccb044640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facc4101540 0x7facc4119e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.409+0000 7faccb044640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc411a500 con 0x7facc4101540 2024-09-13T21:41:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.409+0000 7faccb044640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc4113880 con 0x7facc4065520 2024-09-13T21:41:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.409+0000 7facc3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facc4101540 0x7facc4119e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.409+0000 7facc3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facc4101540 0x7facc4119e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37470/0 (socket says 172.21.15.119:37470) 2024-09-13T21:41:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.409+0000 7facc3fff640 1 -- 172.21.15.119:0/1833359795 learned_addr learned my addr 172.21.15.119:0/1833359795 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.409+0000 7facc8de0640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facc4065520 0x7facc41198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.409+0000 7facc3fff640 1 -- 172.21.15.119:0/1833359795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facc4065520 msgr2=0x7facc41198e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.409+0000 7facc3fff640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facc4065520 0x7facc41198e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.409+0000 7facc3fff640 1 -- 172.21.15.119:0/1833359795 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb0005040 con 0x7facc4101540 2024-09-13T21:41:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.410+0000 7facc3fff640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facc4101540 0x7facc4119e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7facb0003080 tx=0x7facb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.410+0000 7facc17fa640 1 -- 172.21.15.119:0/1833359795 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb0038070 con 0x7facc4101540 2024-09-13T21:41:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.410+0000 7facc17fa640 1 -- 172.21.15.119:0/1833359795 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7facb00097e0 con 0x7facc4101540 2024-09-13T21:41:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.410+0000 7faccb044640 1 -- 172.21.15.119:0/1833359795 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc4113ab0 con 0x7facc4101540 2024-09-13T21:41:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.410+0000 7facc17fa640 1 -- 172.21.15.119:0/1833359795 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb003d420 con 0x7facc4101540 2024-09-13T21:41:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.410+0000 7faccb044640 1 -- 172.21.15.119:0/1833359795 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc4113f70 con 0x7facc4101540 2024-09-13T21:41:26.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.411+0000 7faccb044640 1 -- 172.21.15.119:0/1833359795 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facc4114490 con 0x7facc4101540 2024-09-13T21:41:26.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.411+0000 7facc17fa640 1 -- 172.21.15.119:0/1833359795 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7facb0030020 con 0x7facc4101540 2024-09-13T21:41:26.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.412+0000 7facc17fa640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7facb406ed60 0x7facb4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:26.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.412+0000 7facc17fa640 1 -- 172.21.15.119:0/1833359795 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7facb00ae3a0 con 0x7facc4101540 2024-09-13T21:41:26.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.412+0000 7facc8de0640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7facb406ed60 0x7facb4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:26.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.412+0000 7facc17fa640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795] conn(0x7facb4074ae0 0x7facb4076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:26.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.412+0000 7facc17fa640 1 -- 172.21.15.119:0/1833359795 --> [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facb40775a0 con 0x7facb4074ae0 2024-09-13T21:41:26.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.412+0000 7facc17fa640 1 -- 172.21.15.119:0/1833359795 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7facb00b0990 con 0x7facc4101540 2024-09-13T21:41:26.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.412+0000 7facc95e1640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795] conn(0x7facb4074ae0 0x7facb4076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:26.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.412+0000 7facc8de0640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7facb406ed60 0x7facb4071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7facb8006fd0 tx=0x7facb8008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:26.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.412+0000 7facc95e1640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795] conn(0x7facb4074ae0 0x7facb4076ef0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:26.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.413+0000 7facc17fa640 1 -- 172.21.15.119:0/1833359795 <== osd.1 v2:172.21.15.119:6810/1621715795 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7facb40775a0 con 0x7facb4074ae0 2024-09-13T21:41:26.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.426+0000 7faccb044640 1 -- 172.21.15.119:0/1833359795 --> [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7facc40fbae0 con 0x7facb4074ae0 2024-09-13T21:41:26.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.426+0000 7facc17fa640 1 -- 172.21.15.119:0/1833359795 <== osd.1 v2:172.21.15.119:6810/1621715795 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7facc40fbae0 con 0x7facb4074ae0 2024-09-13T21:41:26.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 -- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795] conn(0x7facb4074ae0 msgr2=0x7facb4076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:26.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795] conn(0x7facb4074ae0 0x7facb4076ef0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:26.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 -- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7facb406ed60 msgr2=0x7facb4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:26.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7facb406ed60 0x7facb4071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7facb8006fd0 tx=0x7facb8008040 comp rx=0 tx=0).stop 2024-09-13T21:41:26.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 -- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facc4101540 msgr2=0x7facc4119e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:26.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facc4101540 0x7facc4119e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7facb0003080 tx=0x7facb0009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:26.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 -- 172.21.15.119:0/1833359795 shutdown_connections 2024-09-13T21:41:26.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7facb406ed60 0x7facb4071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:26.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facc4101540 0x7facc4119e20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:26.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.119:6810/1621715795,v1:172.21.15.119:6811/1621715795] conn(0x7facb4074ae0 0x7facb4076ef0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:26.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 --2- 172.21.15.119:0/1833359795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facc4065520 0x7facc41198e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:26.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 -- 172.21.15.119:0/1833359795 >> 172.21.15.119:0/1833359795 conn(0x7facc40723b0 msgr2=0x7facc40fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:26.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 -- 172.21.15.119:0/1833359795 shutdown_connections 2024-09-13T21:41:26.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:26.427+0000 7faccb044640 1 -- 172.21.15.119:0/1833359795 wait complete. 2024-09-13T21:41:27.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:26 smithi155 ceph-mon[34732]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:27.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:26 smithi119 ceph-mon[27653]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:27.174 INFO:teuthology.orchestra.run.smithi119.stdout:60129542173 2024-09-13T21:41:27.175 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T21:41:27.554 INFO:teuthology.orchestra.run.smithi119.stdout:111669149715 2024-09-13T21:41:27.554 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T21:41:27.617 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:28.028 INFO:teuthology.orchestra.run.smithi119.stdout:137438953485 2024-09-13T21:41:28.029 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T21:41:28.086 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:28.097 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:29.071 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:28 smithi119 ceph-mon[27653]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:29.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:28 smithi155 ceph-mon[34732]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:30.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:29 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:30.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:29 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:31.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:30 smithi155 ceph-mon[34732]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:31.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:30 smithi119 ceph-mon[27653]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:31.182 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:31.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.378+0000 7fa189c3d640 1 -- 172.21.15.119:0/1957590993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184102550 msgr2=0x7fa184102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:31.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.378+0000 7fa189c3d640 1 --2- 172.21.15.119:0/1957590993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184102550 0x7fa184102920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa174009c50 tx=0x7fa174004d10 comp rx=0 tx=0).stop 2024-09-13T21:41:31.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.378+0000 7fa189c3d640 1 -- 172.21.15.119:0/1957590993 shutdown_connections 2024-09-13T21:41:31.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.378+0000 7fa189c3d640 1 --2- 172.21.15.119:0/1957590993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa184102ef0 0x7fa1840fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:31.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.378+0000 7fa189c3d640 1 --2- 172.21.15.119:0/1957590993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184102550 0x7fa184102920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:31.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.378+0000 7fa189c3d640 1 -- 172.21.15.119:0/1957590993 >> 172.21.15.119:0/1957590993 conn(0x7fa1840f80f0 msgr2=0x7fa1840fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:31.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.378+0000 7fa189c3d640 1 -- 172.21.15.119:0/1957590993 shutdown_connections 2024-09-13T21:41:31.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.378+0000 7fa189c3d640 1 -- 172.21.15.119:0/1957590993 wait complete. 2024-09-13T21:41:31.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.378+0000 7fa189c3d640 1 Processor -- start 2024-09-13T21:41:31.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa189c3d640 1 -- start start 2024-09-13T21:41:31.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa189c3d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184102550 0x7fa184113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:31.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa189c3d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa184102ef0 0x7fa184113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:31.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa189c3d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1841140d0 con 0x7fa184102550 2024-09-13T21:41:31.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa189c3d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18410d4e0 con 0x7fa184102ef0 2024-09-13T21:41:31.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184102550 0x7fa184113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:31.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184102550 0x7fa184113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37480/0 (socket says 172.21.15.119:37480) 2024-09-13T21:41:31.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa1837fe640 1 -- 172.21.15.119:0/1557020294 learned_addr learned my addr 172.21.15.119:0/1557020294 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:31.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa182ffd640 1 --2- 172.21.15.119:0/1557020294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa184102ef0 0x7fa184113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:31.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa1837fe640 1 -- 172.21.15.119:0/1557020294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa184102ef0 msgr2=0x7fa184113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:31.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa1837fe640 1 --2- 172.21.15.119:0/1557020294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa184102ef0 0x7fa184113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:31.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa1837fe640 1 -- 172.21.15.119:0/1557020294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1740098b0 con 0x7fa184102550 2024-09-13T21:41:31.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.379+0000 7fa1837fe640 1 --2- 172.21.15.119:0/1557020294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184102550 0x7fa184113540 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa174004750 tx=0x7fa174004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.380+0000 7fa17bfff640 1 -- 172.21.15.119:0/1557020294 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa174009610 con 0x7fa184102550 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.380+0000 7fa17bfff640 1 -- 172.21.15.119:0/1557020294 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa174032b10 con 0x7fa184102550 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.380+0000 7fa189c3d640 1 -- 172.21.15.119:0/1557020294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18410d760 con 0x7fa184102550 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.380+0000 7fa17bfff640 1 -- 172.21.15.119:0/1557020294 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa17403d990 con 0x7fa184102550 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.380+0000 7fa189c3d640 1 -- 172.21.15.119:0/1557020294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18410dd00 con 0x7fa184102550 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.381+0000 7fa189c3d640 1 -- 172.21.15.119:0/1557020294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1840fdcd0 con 0x7fa184102550 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.381+0000 7fa17bfff640 1 -- 172.21.15.119:0/1557020294 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa17402f030 con 0x7fa184102550 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.381+0000 7fa17bfff640 1 --2- 172.21.15.119:0/1557020294 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa17006ed60 0x7fa170071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.382+0000 7fa182ffd640 1 --2- 172.21.15.119:0/1557020294 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa17006ed60 0x7fa170071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.382+0000 7fa17bfff640 1 -- 172.21.15.119:0/1557020294 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa1740aefc0 con 0x7fa184102550 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.382+0000 7fa182ffd640 1 --2- 172.21.15.119:0/1557020294 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa17006ed60 0x7fa170071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa16c007fd0 tx=0x7fa16c009e90 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:31.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.386+0000 7fa17bfff640 1 -- 172.21.15.119:0/1557020294 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa17407c420 con 0x7fa184102550 2024-09-13T21:41:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.547+0000 7fa189c3d640 1 -- 172.21.15.119:0/1557020294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa18404b720 con 0x7fa184102550 2024-09-13T21:41:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.547+0000 7fa17bfff640 1 -- 172.21.15.119:0/1557020294 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1740480c0 con 0x7fa184102550 2024-09-13T21:41:31.549 INFO:teuthology.orchestra.run.smithi119.stdout:60129542173 2024-09-13T21:41:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.549+0000 7fa189c3d640 1 -- 172.21.15.119:0/1557020294 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa17006ed60 msgr2=0x7fa170071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.549+0000 7fa189c3d640 1 --2- 172.21.15.119:0/1557020294 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa17006ed60 0x7fa170071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa16c007fd0 tx=0x7fa16c009e90 comp rx=0 tx=0).stop 2024-09-13T21:41:31.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.549+0000 7fa189c3d640 1 -- 172.21.15.119:0/1557020294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184102550 msgr2=0x7fa184113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:31.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.549+0000 7fa189c3d640 1 --2- 172.21.15.119:0/1557020294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184102550 0x7fa184113540 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa174004750 tx=0x7fa174004d10 comp rx=0 tx=0).stop 2024-09-13T21:41:31.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.549+0000 7fa189c3d640 1 -- 172.21.15.119:0/1557020294 shutdown_connections 2024-09-13T21:41:31.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.549+0000 7fa189c3d640 1 --2- 172.21.15.119:0/1557020294 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa17006ed60 0x7fa170071210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:31.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.549+0000 7fa189c3d640 1 --2- 172.21.15.119:0/1557020294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa184102ef0 0x7fa184113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:31.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.549+0000 7fa189c3d640 1 --2- 172.21.15.119:0/1557020294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa184102550 0x7fa184113540 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:31.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.549+0000 7fa189c3d640 1 -- 172.21.15.119:0/1557020294 >> 172.21.15.119:0/1557020294 conn(0x7fa1840f80f0 msgr2=0x7fa1840f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:31.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.549+0000 7fa189c3d640 1 -- 172.21.15.119:0/1557020294 shutdown_connections 2024-09-13T21:41:31.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:31.549+0000 7fa189c3d640 1 -- 172.21.15.119:0/1557020294 wait complete. 2024-09-13T21:41:32.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:31 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1557020294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T21:41:32.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:31 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1557020294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T21:41:32.460 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542173 for osd.1 2024-09-13T21:41:32.460 DEBUG:teuthology.parallel:result is None 2024-09-13T21:41:32.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.713+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/1822147828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cd4102550 msgr2=0x7f7cd4102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:32.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.713+0000 7f7cd9fd7640 1 --2- 172.21.15.119:0/1822147828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cd4102550 0x7f7cd4102920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40048d0 tx=0x7f7cc4009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:32.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.713+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/1822147828 shutdown_connections 2024-09-13T21:41:32.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.713+0000 7f7cd9fd7640 1 --2- 172.21.15.119:0/1822147828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd4102ef0 0x7f7cd40fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:32.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.713+0000 7f7cd9fd7640 1 --2- 172.21.15.119:0/1822147828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cd4102550 0x7f7cd4102920 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:32.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.713+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/1822147828 >> 172.21.15.119:0/1822147828 conn(0x7f7cd40f80f0 msgr2=0x7f7cd40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:32.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.713+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/1822147828 shutdown_connections 2024-09-13T21:41:32.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.713+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/1822147828 wait complete. 2024-09-13T21:41:32.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.714+0000 7f7cd9fd7640 1 Processor -- start 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.714+0000 7f7cd9fd7640 1 -- start start 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.714+0000 7f7cd9fd7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd4102550 0x7f7cd41135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.714+0000 7f7cd9fd7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cd4102ef0 0x7f7cd4113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.714+0000 7f7cd9fd7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41141d0 con 0x7f7cd4102ef0 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.714+0000 7f7cd9fd7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd410d550 con 0x7f7cd4102550 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.714+0000 7f7cd2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cd4102ef0 0x7f7cd4113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.714+0000 7f7cd2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cd4102ef0 0x7f7cd4113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37500/0 (socket says 172.21.15.119:37500) 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.714+0000 7f7cd2ffd640 1 -- 172.21.15.119:0/588288786 learned_addr learned my addr 172.21.15.119:0/588288786 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.714+0000 7f7cd37fe640 1 --2- 172.21.15.119:0/588288786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd4102550 0x7f7cd41135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.715+0000 7f7cd2ffd640 1 -- 172.21.15.119:0/588288786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd4102550 msgr2=0x7f7cd41135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.715+0000 7f7cd2ffd640 1 --2- 172.21.15.119:0/588288786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd4102550 0x7f7cd41135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:32.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.715+0000 7f7cd2ffd640 1 -- 172.21.15.119:0/588288786 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4005040 con 0x7f7cd4102ef0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.715+0000 7f7cd2ffd640 1 --2- 172.21.15.119:0/588288786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cd4102ef0 0x7f7cd4113af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800b540 tx=0x7f7cc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.715+0000 7f7cbbfff640 1 -- 172.21.15.119:0/588288786 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cc800f6f0 con 0x7f7cd4102ef0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.715+0000 7f7cbbfff640 1 -- 172.21.15.119:0/588288786 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7cc800fcf0 con 0x7f7cd4102ef0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.715+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/588288786 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd410d7e0 con 0x7f7cd4102ef0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.715+0000 7f7cbbfff640 1 -- 172.21.15.119:0/588288786 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cc8011e80 con 0x7f7cd4102ef0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.715+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/588288786 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd410dd00 con 0x7f7cd4102ef0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.716+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/588288786 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd40fdcd0 con 0x7f7cd4102ef0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.717+0000 7f7cbbfff640 1 -- 172.21.15.119:0/588288786 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7cc80116b0 con 0x7f7cd4102ef0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.717+0000 7f7cbbfff640 1 --2- 172.21.15.119:0/588288786 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f7cbc06ed60 0x7f7cbc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.717+0000 7f7cbbfff640 1 -- 172.21.15.119:0/588288786 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7cc808dc50 con 0x7f7cd4102ef0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.717+0000 7f7cd37fe640 1 --2- 172.21.15.119:0/588288786 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f7cbc06ed60 0x7f7cbc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.718+0000 7f7cd37fe640 1 --2- 172.21.15.119:0/588288786 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f7cbc06ed60 0x7f7cbc071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40048a0 tx=0x7f7cc4035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:32.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.721+0000 7f7cbbfff640 1 -- 172.21.15.119:0/588288786 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7cc805acb0 con 0x7f7cd4102ef0 2024-09-13T21:41:32.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.883+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/588288786 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7cd40fbd50 con 0x7f7cd4102ef0 2024-09-13T21:41:32.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.883+0000 7f7cbbfff640 1 -- 172.21.15.119:0/588288786 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cc805aad0 con 0x7f7cd4102ef0 2024-09-13T21:41:32.885 INFO:teuthology.orchestra.run.smithi119.stdout:81604378650 2024-09-13T21:41:32.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.885+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/588288786 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f7cbc06ed60 msgr2=0x7f7cbc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:32.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.885+0000 7f7cd9fd7640 1 --2- 172.21.15.119:0/588288786 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f7cbc06ed60 0x7f7cbc071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40048a0 tx=0x7f7cc4035040 comp rx=0 tx=0).stop 2024-09-13T21:41:32.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.885+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/588288786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cd4102ef0 msgr2=0x7f7cd4113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:32.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.885+0000 7f7cd9fd7640 1 --2- 172.21.15.119:0/588288786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cd4102ef0 0x7f7cd4113af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800b540 tx=0x7f7cc80091a0 comp rx=0 tx=0).stop 2024-09-13T21:41:32.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.885+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/588288786 shutdown_connections 2024-09-13T21:41:32.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.885+0000 7f7cd9fd7640 1 --2- 172.21.15.119:0/588288786 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f7cbc06ed60 0x7f7cbc071210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:32.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.885+0000 7f7cd9fd7640 1 --2- 172.21.15.119:0/588288786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cd4102ef0 0x7f7cd4113af0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:32.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.885+0000 7f7cd9fd7640 1 --2- 172.21.15.119:0/588288786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cd4102550 0x7f7cd41135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:32.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.885+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/588288786 >> 172.21.15.119:0/588288786 conn(0x7f7cd40f80f0 msgr2=0x7f7cd40f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:32.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.885+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/588288786 shutdown_connections 2024-09-13T21:41:32.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:32.885+0000 7f7cd9fd7640 1 -- 172.21.15.119:0/588288786 wait complete. 2024-09-13T21:41:32.992 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:32 smithi119 ceph-mon[27653]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:33.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:32 smithi155 ceph-mon[34732]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:33.623 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-09-13T21:41:33.623 DEBUG:teuthology.parallel:result is None 2024-09-13T21:41:33.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:33 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/588288786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T21:41:33.925 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:33.926 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:34.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:33 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/588288786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T21:41:35.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:34 smithi155 ceph-mon[34732]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:35.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:34 smithi119 ceph-mon[27653]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.578+0000 7fb08695d640 1 -- 172.21.15.119:0/4251246087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0800fb480 msgr2=0x7fb0800fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.578+0000 7fb08695d640 1 --2- 172.21.15.119:0/4251246087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0800fb480 0x7fb0800fb8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb0680048d0 tx=0x7fb068009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.578+0000 7fb08695d640 1 -- 172.21.15.119:0/4251246087 shutdown_connections 2024-09-13T21:41:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.578+0000 7fb08695d640 1 --2- 172.21.15.119:0/4251246087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0800fb480 0x7fb0800fb8f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.578+0000 7fb08695d640 1 --2- 172.21.15.119:0/4251246087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0801014c0 0x7fb080101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.578+0000 7fb08695d640 1 -- 172.21.15.119:0/4251246087 >> 172.21.15.119:0/4251246087 conn(0x7fb0800f7000 msgr2=0x7fb0800f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.578+0000 7fb08695d640 1 -- 172.21.15.119:0/4251246087 shutdown_connections 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.578+0000 7fb08695d640 1 -- 172.21.15.119:0/4251246087 wait complete. 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb08695d640 1 Processor -- start 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb08695d640 1 -- start start 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb08695d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0800fb480 0x7fb0800f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb08695d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0801014c0 0x7fb0800f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb08695d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800f7fb0 con 0x7fb0801014c0 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb08695d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800f8120 con 0x7fb0800fb480 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb077fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0801014c0 0x7fb0800f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb077fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0801014c0 0x7fb0800f79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37326/0 (socket says 172.21.15.119:37326) 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb077fff640 1 -- 172.21.15.119:0/2739304310 learned_addr learned my addr 172.21.15.119:0/2739304310 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb07ffff640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0800fb480 0x7fb0800f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb077fff640 1 -- 172.21.15.119:0/2739304310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0800fb480 msgr2=0x7fb0800f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb077fff640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0800fb480 0x7fb0800f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb077fff640 1 -- 172.21.15.119:0/2739304310 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb068005040 con 0x7fb0801014c0 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb07ffff640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0800fb480 0x7fb0800f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.579+0000 7fb077fff640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0801014c0 0x7fb0800f79e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb068003080 tx=0x7fb068009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.580+0000 7fb07d7fa640 1 -- 172.21.15.119:0/2739304310 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb068038070 con 0x7fb0801014c0 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.580+0000 7fb08695d640 1 -- 172.21.15.119:0/2739304310 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb080119620 con 0x7fb0801014c0 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.580+0000 7fb07d7fa640 1 -- 172.21.15.119:0/2739304310 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb0680097e0 con 0x7fb0801014c0 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.580+0000 7fb07d7fa640 1 -- 172.21.15.119:0/2739304310 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb06803d420 con 0x7fb0801014c0 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.580+0000 7fb08695d640 1 -- 172.21.15.119:0/2739304310 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0801199a0 con 0x7fb0801014c0 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.581+0000 7fb08695d640 1 -- 172.21.15.119:0/2739304310 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0800fcbc0 con 0x7fb0801014c0 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.581+0000 7fb07d7fa640 1 -- 172.21.15.119:0/2739304310 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb068030020 con 0x7fb0801014c0 2024-09-13T21:41:36.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.582+0000 7fb07d7fa640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb06c06ed60 0x7fb06c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:36.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.582+0000 7fb07d7fa640 1 -- 172.21.15.119:0/2739304310 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb0680ae3a0 con 0x7fb0801014c0 2024-09-13T21:41:36.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.582+0000 7fb07ffff640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb06c06ed60 0x7fb06c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:36.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.582+0000 7fb07ffff640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb06c06ed60 0x7fb06c071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb070006fd0 tx=0x7fb070008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:36.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.586+0000 7fb07d7fa640 1 -- 172.21.15.119:0/2739304310 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb06807b800 con 0x7fb0801014c0 2024-09-13T21:41:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.747+0000 7fb08695d640 1 -- 172.21.15.119:0/2739304310 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb0800fac40 con 0x7fb0801014c0 2024-09-13T21:41:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.747+0000 7fb07d7fa640 1 -- 172.21.15.119:0/2739304310 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb06807b1a0 con 0x7fb0801014c0 2024-09-13T21:41:36.749 INFO:teuthology.orchestra.run.smithi119.stdout:158913789963 2024-09-13T21:41:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.749+0000 7fb08695d640 1 -- 172.21.15.119:0/2739304310 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb06c06ed60 msgr2=0x7fb06c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.749+0000 7fb08695d640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb06c06ed60 0x7fb06c071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb070006fd0 tx=0x7fb070008040 comp rx=0 tx=0).stop 2024-09-13T21:41:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.749+0000 7fb08695d640 1 -- 172.21.15.119:0/2739304310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0801014c0 msgr2=0x7fb0800f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.749+0000 7fb08695d640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0801014c0 0x7fb0800f79e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb068003080 tx=0x7fb068009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.749+0000 7fb08695d640 1 -- 172.21.15.119:0/2739304310 shutdown_connections 2024-09-13T21:41:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.749+0000 7fb08695d640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb06c06ed60 0x7fb06c071210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.749+0000 7fb08695d640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0801014c0 0x7fb0800f79e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.749+0000 7fb08695d640 1 --2- 172.21.15.119:0/2739304310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0800fb480 0x7fb0800f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.749+0000 7fb08695d640 1 -- 172.21.15.119:0/2739304310 >> 172.21.15.119:0/2739304310 conn(0x7fb0800f7000 msgr2=0x7fb080065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.749+0000 7fb08695d640 1 -- 172.21.15.119:0/2739304310 shutdown_connections 2024-09-13T21:41:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:36.749+0000 7fb08695d640 1 -- 172.21.15.119:0/2739304310 wait complete. 2024-09-13T21:41:37.064 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:36 smithi119 ceph-mon[27653]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:37.064 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:36 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2739304310' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T21:41:37.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:36 smithi155 ceph-mon[34732]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:37.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:36 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2739304310' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T21:41:38.046 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789959 got 158913789963 for osd.5 2024-09-13T21:41:38.047 DEBUG:teuthology.parallel:result is None 2024-09-13T21:41:38.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.251+0000 7fc0f745c640 1 -- 172.21.15.119:0/756906905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0f0102550 msgr2=0x7fc0f0102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.251+0000 7fc0f745c640 1 --2- 172.21.15.119:0/756906905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0f0102550 0x7fc0f0102920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0048d0 tx=0x7fc0ec009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.251+0000 7fc0f745c640 1 -- 172.21.15.119:0/756906905 shutdown_connections 2024-09-13T21:41:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.251+0000 7fc0f745c640 1 --2- 172.21.15.119:0/756906905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f0102ef0 0x7fc0f00fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.251+0000 7fc0f745c640 1 --2- 172.21.15.119:0/756906905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0f0102550 0x7fc0f0102920 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.251+0000 7fc0f745c640 1 -- 172.21.15.119:0/756906905 >> 172.21.15.119:0/756906905 conn(0x7fc0f00f80f0 msgr2=0x7fc0f00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.251+0000 7fc0f745c640 1 -- 172.21.15.119:0/756906905 shutdown_connections 2024-09-13T21:41:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.251+0000 7fc0f745c640 1 -- 172.21.15.119:0/756906905 wait complete. 2024-09-13T21:41:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.251+0000 7fc0f745c640 1 Processor -- start 2024-09-13T21:41:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.251+0000 7fc0f745c640 1 -- start start 2024-09-13T21:41:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f745c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f0102550 0x7fc0f0113580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f745c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0f0102ef0 0x7fc0f0113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f745c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01141a0 con 0x7fc0f0102ef0 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f745c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f010d520 con 0x7fc0f0102550 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f49f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0f0102ef0 0x7fc0f0113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f49f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0f0102ef0 0x7fc0f0113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37342/0 (socket says 172.21.15.119:37342) 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f49f7640 1 -- 172.21.15.119:0/4209368777 learned_addr learned my addr 172.21.15.119:0/4209368777 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f51f8640 1 --2- 172.21.15.119:0/4209368777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f0102550 0x7fc0f0113580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f49f7640 1 -- 172.21.15.119:0/4209368777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f0102550 msgr2=0x7fc0f0113580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f49f7640 1 --2- 172.21.15.119:0/4209368777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f0102550 0x7fc0f0113580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f49f7640 1 -- 172.21.15.119:0/4209368777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec005040 con 0x7fc0f0102ef0 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f49f7640 1 --2- 172.21.15.119:0/4209368777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0f0102ef0 0x7fc0f0113ac0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000b540 tx=0x7fc0e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0e5ffb640 1 -- 172.21.15.119:0/4209368777 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e000f6f0 con 0x7fc0f0102ef0 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0f745c640 1 -- 172.21.15.119:0/4209368777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f010d7b0 con 0x7fc0f0102ef0 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0e5ffb640 1 -- 172.21.15.119:0/4209368777 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc0e000fcf0 con 0x7fc0f0102ef0 2024-09-13T21:41:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.252+0000 7fc0e5ffb640 1 -- 172.21.15.119:0/4209368777 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e00103a0 con 0x7fc0f0102ef0 2024-09-13T21:41:38.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.253+0000 7fc0f745c640 1 -- 172.21.15.119:0/4209368777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f010dcd0 con 0x7fc0f0102ef0 2024-09-13T21:41:38.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.254+0000 7fc0f745c640 1 -- 172.21.15.119:0/4209368777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f00fdcd0 con 0x7fc0f0102ef0 2024-09-13T21:41:38.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.254+0000 7fc0e5ffb640 1 -- 172.21.15.119:0/4209368777 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc0e000f850 con 0x7fc0f0102ef0 2024-09-13T21:41:38.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.254+0000 7fc0e5ffb640 1 --2- 172.21.15.119:0/4209368777 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc0dc06ed60 0x7fc0dc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:38.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.254+0000 7fc0e5ffb640 1 -- 172.21.15.119:0/4209368777 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc0e008dd80 con 0x7fc0f0102ef0 2024-09-13T21:41:38.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.255+0000 7fc0f51f8640 1 --2- 172.21.15.119:0/4209368777 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc0dc06ed60 0x7fc0dc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:38.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.255+0000 7fc0f51f8640 1 --2- 172.21.15.119:0/4209368777 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc0dc06ed60 0x7fc0dc071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0043d0 tx=0x7fc0ec009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:38.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.259+0000 7fc0e5ffb640 1 -- 172.21.15.119:0/4209368777 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc0e005b260 con 0x7fc0f0102ef0 2024-09-13T21:41:38.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.421+0000 7fc0f745c640 1 -- 172.21.15.119:0/4209368777 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc0f00fbd50 con 0x7fc0f0102ef0 2024-09-13T21:41:38.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.421+0000 7fc0e5ffb640 1 -- 172.21.15.119:0/4209368777 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0e005ac00 con 0x7fc0f0102ef0 2024-09-13T21:41:38.423 INFO:teuthology.orchestra.run.smithi119.stdout:111669149718 2024-09-13T21:41:38.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.423+0000 7fc0f745c640 1 -- 172.21.15.119:0/4209368777 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc0dc06ed60 msgr2=0x7fc0dc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.423+0000 7fc0f745c640 1 --2- 172.21.15.119:0/4209368777 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc0dc06ed60 0x7fc0dc071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0043d0 tx=0x7fc0ec009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.423+0000 7fc0f745c640 1 -- 172.21.15.119:0/4209368777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0f0102ef0 msgr2=0x7fc0f0113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:38.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.423+0000 7fc0f745c640 1 --2- 172.21.15.119:0/4209368777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0f0102ef0 0x7fc0f0113ac0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000b540 tx=0x7fc0e00091a0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.423+0000 7fc0f745c640 1 -- 172.21.15.119:0/4209368777 shutdown_connections 2024-09-13T21:41:38.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.423+0000 7fc0f745c640 1 --2- 172.21.15.119:0/4209368777 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc0dc06ed60 0x7fc0dc071210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.423+0000 7fc0f745c640 1 --2- 172.21.15.119:0/4209368777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0f0102ef0 0x7fc0f0113ac0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.423+0000 7fc0f745c640 1 --2- 172.21.15.119:0/4209368777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f0102550 0x7fc0f0113580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:38.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.423+0000 7fc0f745c640 1 -- 172.21.15.119:0/4209368777 >> 172.21.15.119:0/4209368777 conn(0x7fc0f00f80f0 msgr2=0x7fc0f00f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:38.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.423+0000 7fc0f745c640 1 -- 172.21.15.119:0/4209368777 shutdown_connections 2024-09-13T21:41:38.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:38.423+0000 7fc0f745c640 1 -- 172.21.15.119:0/4209368777 wait complete. 2024-09-13T21:41:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:38 smithi155 ceph-mon[34732]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:38 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/4209368777' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T21:41:39.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:38 smithi119 ceph-mon[27653]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:39.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:38 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/4209368777' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T21:41:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.374+0000 7f6281230640 1 -- 172.21.15.119:0/2547727295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f627c100c20 msgr2=0x7f627c100ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.374+0000 7f6281230640 1 --2- 172.21.15.119:0/2547727295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f627c100c20 0x7f627c100ff0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f626c0048d0 tx=0x7f626c009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.374+0000 7f6281230640 1 -- 172.21.15.119:0/2547727295 shutdown_connections 2024-09-13T21:41:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.374+0000 7f6281230640 1 --2- 172.21.15.119:0/2547727295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c0fabf0 0x7f627c0fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.374+0000 7f6281230640 1 --2- 172.21.15.119:0/2547727295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f627c100c20 0x7f627c100ff0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.374+0000 7f6281230640 1 -- 172.21.15.119:0/2547727295 >> 172.21.15.119:0/2547727295 conn(0x7f627c070c10 msgr2=0x7f627c071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.374+0000 7f6281230640 1 -- 172.21.15.119:0/2547727295 shutdown_connections 2024-09-13T21:41:39.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.374+0000 7f6281230640 1 -- 172.21.15.119:0/2547727295 wait complete. 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.374+0000 7f6281230640 1 Processor -- start 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f6281230640 1 -- start start 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f6281230640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f627c0fabf0 0x7f627c113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f6281230640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c100c20 0x7f627c1136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f6281230640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c113ca0 con 0x7f627c0fabf0 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f6281230640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c10d0e0 con 0x7f627c100c20 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f627ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f627c0fabf0 0x7f627c113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f627ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f627c0fabf0 0x7f627c113160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37348/0 (socket says 172.21.15.119:37348) 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f627ad9d640 1 -- 172.21.15.119:0/198309005 learned_addr learned my addr 172.21.15.119:0/198309005 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f6273fff640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c100c20 0x7f627c1136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f627ad9d640 1 -- 172.21.15.119:0/198309005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c100c20 msgr2=0x7f627c1136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f627ad9d640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c100c20 0x7f627c1136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f627ad9d640 1 -- 172.21.15.119:0/198309005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c005040 con 0x7f627c0fabf0 2024-09-13T21:41:39.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f6273fff640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c100c20 0x7f627c1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:41:39.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f627ad9d640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f627c0fabf0 0x7f627c113160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f626c0043d0 tx=0x7f626c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:39.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.375+0000 7f62737fe640 1 -- 172.21.15.119:0/198309005 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626c038070 con 0x7f627c0fabf0 2024-09-13T21:41:39.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.376+0000 7f62737fe640 1 -- 172.21.15.119:0/198309005 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f626c032b20 con 0x7f627c0fabf0 2024-09-13T21:41:39.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.376+0000 7f6281230640 1 -- 172.21.15.119:0/198309005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c10d360 con 0x7f627c0fabf0 2024-09-13T21:41:39.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.376+0000 7f62737fe640 1 -- 172.21.15.119:0/198309005 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626c03d960 con 0x7f627c0fabf0 2024-09-13T21:41:39.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.376+0000 7f6281230640 1 -- 172.21.15.119:0/198309005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c10d8a0 con 0x7f627c0fabf0 2024-09-13T21:41:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.377+0000 7f6281230640 1 -- 172.21.15.119:0/198309005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c0fc2e0 con 0x7f627c0fabf0 2024-09-13T21:41:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.377+0000 7f62737fe640 1 -- 172.21.15.119:0/198309005 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f626c030020 con 0x7f627c0fabf0 2024-09-13T21:41:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.377+0000 7f62737fe640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f626806ed50 0x7f6268071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.377+0000 7f62737fe640 1 -- 172.21.15.119:0/198309005 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f626c0ae770 con 0x7f627c0fabf0 2024-09-13T21:41:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.377+0000 7f6273fff640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f626806ed50 0x7f6268071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:39.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.378+0000 7f6273fff640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f626806ed50 0x7f6268071200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6264007fd0 tx=0x7f6264009e90 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:39.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.381+0000 7f62737fe640 1 -- 172.21.15.119:0/198309005 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f626c07bbd0 con 0x7f627c0fabf0 2024-09-13T21:41:39.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.541+0000 7f6281230640 1 -- 172.21.15.119:0/198309005 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f627c05ed70 con 0x7f627c0fabf0 2024-09-13T21:41:39.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.541+0000 7f62737fe640 1 -- 172.21.15.119:0/198309005 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f626c07b570 con 0x7f627c0fabf0 2024-09-13T21:41:39.543 INFO:teuthology.orchestra.run.smithi119.stdout:38654705701 2024-09-13T21:41:39.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.543+0000 7f6281230640 1 -- 172.21.15.119:0/198309005 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f626806ed50 msgr2=0x7f6268071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:39.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.543+0000 7f6281230640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f626806ed50 0x7f6268071200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6264007fd0 tx=0x7f6264009e90 comp rx=0 tx=0).stop 2024-09-13T21:41:39.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.543+0000 7f6281230640 1 -- 172.21.15.119:0/198309005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f627c0fabf0 msgr2=0x7f627c113160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:39.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.543+0000 7f6281230640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f627c0fabf0 0x7f627c113160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f626c0043d0 tx=0x7f626c009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.543+0000 7f6281230640 1 -- 172.21.15.119:0/198309005 shutdown_connections 2024-09-13T21:41:39.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.543+0000 7f6281230640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f626806ed50 0x7f6268071200 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.543+0000 7f6281230640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c100c20 0x7f627c1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.543+0000 7f6281230640 1 --2- 172.21.15.119:0/198309005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f627c0fabf0 0x7f627c113160 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:39.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.543+0000 7f6281230640 1 -- 172.21.15.119:0/198309005 >> 172.21.15.119:0/198309005 conn(0x7f627c070c10 msgr2=0x7f627c0f8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:39.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.543+0000 7f6281230640 1 -- 172.21.15.119:0/198309005 shutdown_connections 2024-09-13T21:41:39.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:39.543+0000 7f6281230640 1 -- 172.21.15.119:0/198309005 wait complete. 2024-09-13T21:41:39.802 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149715 got 111669149718 for osd.3 2024-09-13T21:41:39.803 DEBUG:teuthology.parallel:result is None 2024-09-13T21:41:40.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:39 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/198309005' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T21:41:40.113 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:39 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/198309005' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T21:41:40.517 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705701 for osd.0 2024-09-13T21:41:40.518 DEBUG:teuthology.parallel:result is None 2024-09-13T21:41:40.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.937+0000 7f4378c22640 1 -- 172.21.15.119:0/226327693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4374102ef0 msgr2=0x7f43740fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:40.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.937+0000 7f4378c22640 1 --2- 172.21.15.119:0/226327693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4374102ef0 0x7f43740fc5b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43680048d0 tx=0x7f4368009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:40.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 -- 172.21.15.119:0/226327693 shutdown_connections 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 --2- 172.21.15.119:0/226327693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4374102ef0 0x7f43740fc5b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 --2- 172.21.15.119:0/226327693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4374102550 0x7f4374102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 -- 172.21.15.119:0/226327693 >> 172.21.15.119:0/226327693 conn(0x7f43740f80f0 msgr2=0x7f43740fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 -- 172.21.15.119:0/226327693 shutdown_connections 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 -- 172.21.15.119:0/226327693 wait complete. 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 Processor -- start 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 -- start start 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4374102550 0x7f43741135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4374102ef0 0x7f4374113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43741141d0 con 0x7f4374102550 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.938+0000 7f4378c22640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437410d550 con 0x7f4374102ef0 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f437259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4374102550 0x7f43741135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f437259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4374102550 0x7f43741135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37370/0 (socket says 172.21.15.119:37370) 2024-09-13T21:41:40.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f437259c640 1 -- 172.21.15.119:0/1364335542 learned_addr learned my addr 172.21.15.119:0/1364335542 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:40.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f4371d9b640 1 --2- 172.21.15.119:0/1364335542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4374102ef0 0x7f4374113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:40.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f437259c640 1 -- 172.21.15.119:0/1364335542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4374102ef0 msgr2=0x7f4374113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:40.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f437259c640 1 --2- 172.21.15.119:0/1364335542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4374102ef0 0x7f4374113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:40.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f437259c640 1 -- 172.21.15.119:0/1364335542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368005040 con 0x7f4374102550 2024-09-13T21:41:40.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f437259c640 1 --2- 172.21.15.119:0/1364335542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4374102550 0x7f43741135b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f436400b790 tx=0x7f43640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:40.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f4362ffd640 1 -- 172.21.15.119:0/1364335542 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f436400c700 con 0x7f4374102550 2024-09-13T21:41:40.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f4378c22640 1 -- 172.21.15.119:0/1364335542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437410d7e0 con 0x7f4374102550 2024-09-13T21:41:40.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f4362ffd640 1 -- 172.21.15.119:0/1364335542 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f436400cd00 con 0x7f4374102550 2024-09-13T21:41:40.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f4362ffd640 1 -- 172.21.15.119:0/1364335542 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4364015e80 con 0x7f4374102550 2024-09-13T21:41:40.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.939+0000 7f4378c22640 1 -- 172.21.15.119:0/1364335542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437410dcd0 con 0x7f4374102550 2024-09-13T21:41:40.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.940+0000 7f4378c22640 1 -- 172.21.15.119:0/1364335542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43740fdcd0 con 0x7f4374102550 2024-09-13T21:41:40.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.941+0000 7f4362ffd640 1 -- 172.21.15.119:0/1364335542 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4364012070 con 0x7f4374102550 2024-09-13T21:41:40.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.941+0000 7f4362ffd640 1 --2- 172.21.15.119:0/1364335542 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f435c06ed60 0x7f435c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:40.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.941+0000 7f4362ffd640 1 -- 172.21.15.119:0/1364335542 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f436408d6c0 con 0x7f4374102550 2024-09-13T21:41:40.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.941+0000 7f4371d9b640 1 --2- 172.21.15.119:0/1364335542 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f435c06ed60 0x7f435c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:40.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.942+0000 7f4371d9b640 1 --2- 172.21.15.119:0/1364335542 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f435c06ed60 0x7f435c071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f43680048a0 tx=0x7f4368035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:40.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:40.945+0000 7f4362ffd640 1 -- 172.21.15.119:0/1364335542 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f436405ab20 con 0x7f4374102550 2024-09-13T21:41:41.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:40 smithi155 ceph-mon[34732]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:41.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.104+0000 7f4378c22640 1 -- 172.21.15.119:0/1364335542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f437410ec20 con 0x7f4374102550 2024-09-13T21:41:41.106 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:40 smithi119 ceph-mon[27653]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:41.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.105+0000 7f4362ffd640 1 -- 172.21.15.119:0/1364335542 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f436405a4c0 con 0x7f4374102550 2024-09-13T21:41:41.107 INFO:teuthology.orchestra.run.smithi119.stdout:137438953488 2024-09-13T21:41:41.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.107+0000 7f4378c22640 1 -- 172.21.15.119:0/1364335542 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f435c06ed60 msgr2=0x7f435c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:41.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.107+0000 7f4378c22640 1 --2- 172.21.15.119:0/1364335542 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f435c06ed60 0x7f435c071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f43680048a0 tx=0x7f4368035040 comp rx=0 tx=0).stop 2024-09-13T21:41:41.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.107+0000 7f4378c22640 1 -- 172.21.15.119:0/1364335542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4374102550 msgr2=0x7f43741135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:41.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.107+0000 7f4378c22640 1 --2- 172.21.15.119:0/1364335542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4374102550 0x7f43741135b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f436400b790 tx=0x7f43640091d0 comp rx=0 tx=0).stop 2024-09-13T21:41:41.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.107+0000 7f4378c22640 1 -- 172.21.15.119:0/1364335542 shutdown_connections 2024-09-13T21:41:41.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.107+0000 7f4378c22640 1 --2- 172.21.15.119:0/1364335542 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f435c06ed60 0x7f435c071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:41.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.107+0000 7f4378c22640 1 --2- 172.21.15.119:0/1364335542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4374102ef0 0x7f4374113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:41.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.107+0000 7f4378c22640 1 --2- 172.21.15.119:0/1364335542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4374102550 0x7f43741135b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:41.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.107+0000 7f4378c22640 1 -- 172.21.15.119:0/1364335542 >> 172.21.15.119:0/1364335542 conn(0x7f43740f80f0 msgr2=0x7f43740f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:41.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.107+0000 7f4378c22640 1 -- 172.21.15.119:0/1364335542 shutdown_connections 2024-09-13T21:41:41.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:41.107+0000 7f4378c22640 1 -- 172.21.15.119:0/1364335542 wait complete. 2024-09-13T21:41:41.720 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953485 got 137438953488 for osd.4 2024-09-13T21:41:41.720 DEBUG:teuthology.parallel:result is None 2024-09-13T21:41:41.721 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T21:41:41.721 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T21:41:41.966 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:42.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:41 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1364335542' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T21:41:42.086 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:41 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1364335542' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T21:41:43.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:42 smithi155 ceph-mon[34732]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:43.091 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:42 smithi119 ceph-mon[27653]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:43.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.609+0000 7fb0d9e75640 1 -- 172.21.15.119:0/214724494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d41014e0 msgr2=0x7fb0d41018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:43.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.609+0000 7fb0d9e75640 1 --2- 172.21.15.119:0/214724494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d41014e0 0x7fb0d41018b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40048d0 tx=0x7fb0c4009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:43.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.609+0000 7fb0d9e75640 1 -- 172.21.15.119:0/214724494 shutdown_connections 2024-09-13T21:41:43.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.609+0000 7fb0d9e75640 1 --2- 172.21.15.119:0/214724494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0d40fb4a0 0x7fb0d40fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:43.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.609+0000 7fb0d9e75640 1 --2- 172.21.15.119:0/214724494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d41014e0 0x7fb0d41018b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:43.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.609+0000 7fb0d9e75640 1 -- 172.21.15.119:0/214724494 >> 172.21.15.119:0/214724494 conn(0x7fb0d40f7060 msgr2=0x7fb0d40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:43.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.609+0000 7fb0d9e75640 1 -- 172.21.15.119:0/214724494 shutdown_connections 2024-09-13T21:41:43.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.609+0000 7fb0d9e75640 1 -- 172.21.15.119:0/214724494 wait complete. 2024-09-13T21:41:43.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.609+0000 7fb0d9e75640 1 Processor -- start 2024-09-13T21:41:43.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.609+0000 7fb0d9e75640 1 -- start start 2024-09-13T21:41:43.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d9e75640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0d40fb4a0 0x7fb0d41131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:43.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d9e75640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d41014e0 0x7fb0d41136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d9e75640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4113ce0 con 0x7fb0d41014e0 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d9e75640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d410d120 con 0x7fb0d40fb4a0 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d41014e0 0x7fb0d41136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d41014e0 0x7fb0d41136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37386/0 (socket says 172.21.15.119:37386) 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d2ffd640 1 -- 172.21.15.119:0/1918907577 learned_addr learned my addr 172.21.15.119:0/1918907577 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d37fe640 1 --2- 172.21.15.119:0/1918907577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0d40fb4a0 0x7fb0d41131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d2ffd640 1 -- 172.21.15.119:0/1918907577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0d40fb4a0 msgr2=0x7fb0d41131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d2ffd640 1 --2- 172.21.15.119:0/1918907577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0d40fb4a0 0x7fb0d41131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d2ffd640 1 -- 172.21.15.119:0/1918907577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c4005040 con 0x7fb0d41014e0 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d2ffd640 1 --2- 172.21.15.119:0/1918907577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d41014e0 0x7fb0d41136e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8002a50 tx=0x7fb0c8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0bbfff640 1 -- 172.21.15.119:0/1918907577 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0c8007c30 con 0x7fb0d41014e0 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d9e75640 1 -- 172.21.15.119:0/1918907577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d410d400 con 0x7fb0d41014e0 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0bbfff640 1 -- 172.21.15.119:0/1918907577 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb0c800f040 con 0x7fb0d41014e0 2024-09-13T21:41:43.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0bbfff640 1 -- 172.21.15.119:0/1918907577 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0c800dad0 con 0x7fb0d41014e0 2024-09-13T21:41:43.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.610+0000 7fb0d9e75640 1 -- 172.21.15.119:0/1918907577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d410d9a0 con 0x7fb0d41014e0 2024-09-13T21:41:43.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.612+0000 7fb0d9e75640 1 -- 172.21.15.119:0/1918907577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d40fcbe0 con 0x7fb0d41014e0 2024-09-13T21:41:43.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.612+0000 7fb0bbfff640 1 -- 172.21.15.119:0/1918907577 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb0c800dc30 con 0x7fb0d41014e0 2024-09-13T21:41:43.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.612+0000 7fb0bbfff640 1 --2- 172.21.15.119:0/1918907577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb0bc06ed60 0x7fb0bc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:43.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.613+0000 7fb0d37fe640 1 --2- 172.21.15.119:0/1918907577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb0bc06ed60 0x7fb0bc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:43.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.613+0000 7fb0bbfff640 1 -- 172.21.15.119:0/1918907577 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb0c808dc90 con 0x7fb0d41014e0 2024-09-13T21:41:43.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.613+0000 7fb0d37fe640 1 --2- 172.21.15.119:0/1918907577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb0bc06ed60 0x7fb0bc071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009ac0 tx=0x7fb0c4035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:43.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.617+0000 7fb0bbfff640 1 -- 172.21.15.119:0/1918907577 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb0c805b0f0 con 0x7fb0d41014e0 2024-09-13T21:41:43.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.770+0000 7fb0d9e75640 1 -- 172.21.15.119:0/1918907577 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0d4108460 con 0x7fb0bc06ed60 2024-09-13T21:41:43.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.772+0000 7fb0bbfff640 1 -- 172.21.15.119:0/1918907577 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27945 (secure 0 0 0) 0x7fb0d4108460 con 0x7fb0bc06ed60 2024-09-13T21:41:43.774 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:41:43.775 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T21:41:43.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.774+0000 7fb0d9e75640 1 -- 172.21.15.119:0/1918907577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb0bc06ed60 msgr2=0x7fb0bc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:43.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.774+0000 7fb0d9e75640 1 --2- 172.21.15.119:0/1918907577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb0bc06ed60 0x7fb0bc071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009ac0 tx=0x7fb0c4035040 comp rx=0 tx=0).stop 2024-09-13T21:41:43.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.774+0000 7fb0d9e75640 1 -- 172.21.15.119:0/1918907577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d41014e0 msgr2=0x7fb0d41136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:43.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.774+0000 7fb0d9e75640 1 --2- 172.21.15.119:0/1918907577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d41014e0 0x7fb0d41136e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8002a50 tx=0x7fb0c8004600 comp rx=0 tx=0).stop 2024-09-13T21:41:43.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.774+0000 7fb0d9e75640 1 -- 172.21.15.119:0/1918907577 shutdown_connections 2024-09-13T21:41:43.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.774+0000 7fb0d9e75640 1 --2- 172.21.15.119:0/1918907577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb0bc06ed60 0x7fb0bc071210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:43.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.774+0000 7fb0d9e75640 1 --2- 172.21.15.119:0/1918907577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0d41014e0 0x7fb0d41136e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:43.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.774+0000 7fb0d9e75640 1 --2- 172.21.15.119:0/1918907577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0d40fb4a0 0x7fb0d41131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:43.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.774+0000 7fb0d9e75640 1 -- 172.21.15.119:0/1918907577 >> 172.21.15.119:0/1918907577 conn(0x7fb0d40f7060 msgr2=0x7fb0d4065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:43.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.774+0000 7fb0d9e75640 1 -- 172.21.15.119:0/1918907577 shutdown_connections 2024-09-13T21:41:43.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:43.774+0000 7fb0d9e75640 1 -- 172.21.15.119:0/1918907577 wait complete. 2024-09-13T21:41:44.464 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-13T21:41:43.713521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787932,"kb_used_data":3776,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682980,"statfs":{"total":575970213888,"available":574139371520,"internally_reserved":0,"allocated":3866624,"data_stored":2557439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001976"},"pg_stats":[{"pgid":"1.0","version":"23'72","reported_seq":130,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T21:40:54.630401+0000","last_change":"2024-09-13T21:40:28.320226+0000","last_active":"2024-09-13T21:40:54.630401+0000","last_peered":"2024-09-13T21:40:54.630401+0000","last_clean":"2024-09-13T21:40:54.630401+0000","last_became_active":"2024-09-13T21:40:28.319777+0000","last_became_peered":"2024-09-13T21:40:28.319777+0000","last_unstale":"2024-09-13T21:40:54.630401+0000","last_undegraded":"2024-09-13T21:40:54.630401+0000","last_fullsized":"2024-09-13T21:40:54.630401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T21:39:40.702432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T21:39:40.702432+0000","last_clean_scrub_stamp":"2024-09-13T21:39:40.702432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:29.516319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]}]},{"osd":4,"up_from":32,"seq":137438953489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Sep 13 21:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Sep 13 21:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Sep 13 21:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.377},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Sep 13 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Sep 13 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Sep 13 21:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.255},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.33700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297700,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447452,"statfs":{"total":95995035648,"available":95690190848,"internally_reserved":0,"allocated":344064,"data_stored":130505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:40:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Sep 13 21:40:42 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Sep 13 21:41:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Sep 13 21:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.7109999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.6640000000000001,"5min":3.6640000000000001,"15min":3.6640000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:41:16 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.32900000000000001,"15min":0.32400000000000001},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.495,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.23999999999999999}]},{"osd":2,"last update":"Fri Sep 13 21:40:41 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.27200000000000002}]},{"osd":3,"last update":"Fri Sep 13 21:41:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Sep 13 21:41:30 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.497},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 21:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.28999999999999998,"15min":0.28199999999999997},"min":{"1min":0.224,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.30399999999999999,"15min":0.29799999999999999},"min":{"1min":0.20999999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.27100000000000002}]},{"osd":2,"last update":"Fri Sep 13 21:40:45 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.312},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.28699999999999998}]},{"osd":3,"last update":"Fri Sep 13 21:41:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.2969999999999997,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":6.3929999999999998,"5min":6.3929999999999998,"15min":6.3929999999999998},"last":0.437}]},{"osd":4,"last update":"Fri Sep 13 21:41:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T21:41:44.465 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T21:41:44.717 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:45.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:44 smithi155 ceph-mon[34732]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:45.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:44 smithi155 ceph-mon[34732]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T21:41:45.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:44 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:45.123 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:44 smithi119 ceph-mon[27653]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:45.123 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:44 smithi119 ceph-mon[27653]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T21:41:45.124 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:44 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:41:46.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.373+0000 7fd699b0d640 1 -- 172.21.15.119:0/833541345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd694102620 msgr2=0x7fd6941029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:46.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.373+0000 7fd699b0d640 1 --2- 172.21.15.119:0/833541345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd694102620 0x7fd6941029f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd6840048d0 tx=0x7fd684009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:46.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.373+0000 7fd699b0d640 1 -- 172.21.15.119:0/833541345 shutdown_connections 2024-09-13T21:41:46.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.373+0000 7fd699b0d640 1 --2- 172.21.15.119:0/833541345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6940fac80 0x7fd6940fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:46.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.373+0000 7fd699b0d640 1 --2- 172.21.15.119:0/833541345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd694102620 0x7fd6941029f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.373+0000 7fd699b0d640 1 -- 172.21.15.119:0/833541345 >> 172.21.15.119:0/833541345 conn(0x7fd694070ce0 msgr2=0x7fd6940710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.373+0000 7fd699b0d640 1 -- 172.21.15.119:0/833541345 shutdown_connections 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.373+0000 7fd699b0d640 1 -- 172.21.15.119:0/833541345 wait complete. 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.373+0000 7fd699b0d640 1 Processor -- start 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.373+0000 7fd699b0d640 1 -- start start 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd699b0d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6940fac80 0x7fd6941131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd699b0d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd694102620 0x7fd694113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd699b0d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd694113dc0 con 0x7fd6940fac80 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd699b0d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69410d170 con 0x7fd694102620 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd6937fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6940fac80 0x7fd6941131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd6937fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6940fac80 0x7fd6941131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60614/0 (socket says 172.21.15.119:60614) 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd6937fe640 1 -- 172.21.15.119:0/564077023 learned_addr learned my addr 172.21.15.119:0/564077023 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:46.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd692ffd640 1 --2- 172.21.15.119:0/564077023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd694102620 0x7fd694113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:46.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd6937fe640 1 -- 172.21.15.119:0/564077023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd694102620 msgr2=0x7fd694113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:46.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd6937fe640 1 --2- 172.21.15.119:0/564077023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd694102620 0x7fd694113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:46.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd6937fe640 1 -- 172.21.15.119:0/564077023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd684005040 con 0x7fd6940fac80 2024-09-13T21:41:46.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd6937fe640 1 --2- 172.21.15.119:0/564077023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6940fac80 0x7fd6941131f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd684003080 tx=0x7fd684009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:46.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd67bfff640 1 -- 172.21.15.119:0/564077023 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd684038070 con 0x7fd6940fac80 2024-09-13T21:41:46.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd699b0d640 1 -- 172.21.15.119:0/564077023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69410d3f0 con 0x7fd6940fac80 2024-09-13T21:41:46.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd67bfff640 1 -- 172.21.15.119:0/564077023 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd6840097e0 con 0x7fd6940fac80 2024-09-13T21:41:46.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd67bfff640 1 -- 172.21.15.119:0/564077023 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd68403d420 con 0x7fd6940fac80 2024-09-13T21:41:46.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.374+0000 7fd699b0d640 1 -- 172.21.15.119:0/564077023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69410d8b0 con 0x7fd6940fac80 2024-09-13T21:41:46.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.375+0000 7fd699b0d640 1 -- 172.21.15.119:0/564077023 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6940657b0 con 0x7fd6940fac80 2024-09-13T21:41:46.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.376+0000 7fd67bfff640 1 -- 172.21.15.119:0/564077023 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd684030020 con 0x7fd6940fac80 2024-09-13T21:41:46.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.376+0000 7fd67bfff640 1 --2- 172.21.15.119:0/564077023 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd67c06ed60 0x7fd67c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:46.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.376+0000 7fd67bfff640 1 -- 172.21.15.119:0/564077023 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd6840ae470 con 0x7fd6940fac80 2024-09-13T21:41:46.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.376+0000 7fd692ffd640 1 --2- 172.21.15.119:0/564077023 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd67c06ed60 0x7fd67c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:46.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.377+0000 7fd692ffd640 1 --2- 172.21.15.119:0/564077023 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd67c06ed60 0x7fd67c071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd688006fd0 tx=0x7fd688008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:46.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.380+0000 7fd67bfff640 1 -- 172.21.15.119:0/564077023 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd68407b8d0 con 0x7fd6940fac80 2024-09-13T21:41:46.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.532+0000 7fd699b0d640 1 -- 172.21.15.119:0/564077023 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6941095f0 con 0x7fd67c06ed60 2024-09-13T21:41:46.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.533+0000 7fd67bfff640 1 -- 172.21.15.119:0/564077023 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27893 (secure 0 0 0) 0x7fd6941095f0 con 0x7fd67c06ed60 2024-09-13T21:41:46.535 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:41:46.535 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-13T21:41:46.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.535+0000 7fd699b0d640 1 -- 172.21.15.119:0/564077023 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd67c06ed60 msgr2=0x7fd67c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:46.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.535+0000 7fd699b0d640 1 --2- 172.21.15.119:0/564077023 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd67c06ed60 0x7fd67c071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd688006fd0 tx=0x7fd688008040 comp rx=0 tx=0).stop 2024-09-13T21:41:46.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.535+0000 7fd699b0d640 1 -- 172.21.15.119:0/564077023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6940fac80 msgr2=0x7fd6941131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:46.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.535+0000 7fd699b0d640 1 --2- 172.21.15.119:0/564077023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6940fac80 0x7fd6941131f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd684003080 tx=0x7fd684009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:46.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.535+0000 7fd699b0d640 1 -- 172.21.15.119:0/564077023 shutdown_connections 2024-09-13T21:41:46.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.535+0000 7fd699b0d640 1 --2- 172.21.15.119:0/564077023 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd67c06ed60 0x7fd67c071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:46.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.535+0000 7fd699b0d640 1 --2- 172.21.15.119:0/564077023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd694102620 0x7fd694113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:46.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.535+0000 7fd699b0d640 1 --2- 172.21.15.119:0/564077023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6940fac80 0x7fd6941131f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:46.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.535+0000 7fd699b0d640 1 -- 172.21.15.119:0/564077023 >> 172.21.15.119:0/564077023 conn(0x7fd694070ce0 msgr2=0x7fd694105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:46.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.535+0000 7fd699b0d640 1 -- 172.21.15.119:0/564077023 shutdown_connections 2024-09-13T21:41:46.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:46.535+0000 7fd699b0d640 1 -- 172.21.15.119:0/564077023 wait complete. 2024-09-13T21:41:47.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:46 smithi155 ceph-mon[34732]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:47.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:46 smithi119 ceph-mon[27653]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:47.312 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-13T21:41:45.713831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787932,"kb_used_data":3776,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682980,"statfs":{"total":575970213888,"available":574139371520,"internally_reserved":0,"allocated":3866624,"data_stored":2557439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001925"},"pg_stats":[{"pgid":"1.0","version":"23'72","reported_seq":130,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T21:40:54.630401+0000","last_change":"2024-09-13T21:40:28.320226+0000","last_active":"2024-09-13T21:40:54.630401+0000","last_peered":"2024-09-13T21:40:54.630401+0000","last_clean":"2024-09-13T21:40:54.630401+0000","last_became_active":"2024-09-13T21:40:28.319777+0000","last_became_peered":"2024-09-13T21:40:28.319777+0000","last_unstale":"2024-09-13T21:40:54.630401+0000","last_undegraded":"2024-09-13T21:40:54.630401+0000","last_fullsized":"2024-09-13T21:40:54.630401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T21:39:40.702432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T21:39:40.702432+0000","last_clean_scrub_stamp":"2024-09-13T21:39:40.702432+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:29.516319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]}]},{"osd":4,"up_from":32,"seq":137438953489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Sep 13 21:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Sep 13 21:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Sep 13 21:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.376}]},{"osd":1,"last update":"Fri Sep 13 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.443},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Sep 13 21:41:06 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri Sep 13 21:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297700,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447452,"statfs":{"total":95995035648,"available":95690190848,"internally_reserved":0,"allocated":344064,"data_stored":130505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:41:45 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.34599999999999997,"15min":0.33000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.36499999999999999,"15min":0.35099999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.5979999999999999,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":0.313}]},{"osd":1,"last update":"Fri Sep 13 21:41:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.38200000000000001,"15min":0.37},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.6139999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.379,"15min":0.36499999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":3.625,"5min":3.625,"15min":3.625},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Sep 13 21:41:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Sep 13 21:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.7109999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.6640000000000001,"5min":3.6640000000000001,"15min":3.6640000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 21:41:16 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.22800000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.32900000000000001,"15min":0.32400000000000001},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.495,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.23999999999999999}]},{"osd":2,"last update":"Fri Sep 13 21:40:41 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.27200000000000002}]},{"osd":3,"last update":"Fri Sep 13 21:41:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Sep 13 21:41:30 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.497},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 21:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.28999999999999998,"15min":0.28199999999999997},"min":{"1min":0.224,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.30399999999999999,"15min":0.29799999999999999},"min":{"1min":0.20999999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.27100000000000002}]},{"osd":2,"last update":"Fri Sep 13 21:40:45 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.312},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.28699999999999998}]},{"osd":3,"last update":"Fri Sep 13 21:41:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":6.2969999999999997,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":6.3929999999999998,"5min":6.3929999999999998,"15min":6.3929999999999998},"last":0.437}]},{"osd":4,"last update":"Fri Sep 13 21:41:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T21:41:47.313 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T21:41:47.313 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T21:41:47.313 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T21:41:47.313 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T21:41:47.556 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:48.015 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:47 smithi119 ceph-mon[27653]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T21:41:48.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:47 smithi155 ceph-mon[34732]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T21:41:49.008 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:48 smithi119 ceph-mon[27653]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:49.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:48 smithi155 ceph-mon[34732]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:49.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.230+0000 7fab4dcce640 1 -- 172.21.15.119:0/3486290752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab480fac80 msgr2=0x7fab480fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.230+0000 7fab4dcce640 1 --2- 172.21.15.119:0/3486290752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab480fac80 0x7fab480fb0d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0048d0 tx=0x7fab3c009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.231+0000 7fab4dcce640 1 -- 172.21.15.119:0/3486290752 shutdown_connections 2024-09-13T21:41:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.231+0000 7fab4dcce640 1 --2- 172.21.15.119:0/3486290752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab480fac80 0x7fab480fb0d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.231+0000 7fab4dcce640 1 --2- 172.21.15.119:0/3486290752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab48102640 0x7fab48102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.231+0000 7fab4dcce640 1 -- 172.21.15.119:0/3486290752 >> 172.21.15.119:0/3486290752 conn(0x7fab48070ce0 msgr2=0x7fab480710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.231+0000 7fab4dcce640 1 -- 172.21.15.119:0/3486290752 shutdown_connections 2024-09-13T21:41:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.231+0000 7fab4dcce640 1 -- 172.21.15.119:0/3486290752 wait complete. 2024-09-13T21:41:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.231+0000 7fab4dcce640 1 Processor -- start 2024-09-13T21:41:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.231+0000 7fab4dcce640 1 -- start start 2024-09-13T21:41:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab4dcce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480fac80 0x7fab481131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab4dcce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab48102640 0x7fab481136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab4dcce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48113cf0 con 0x7fab48102640 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab4dcce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4810d130 con 0x7fab480fac80 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab46ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab48102640 0x7fab481136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab46ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab48102640 0x7fab481136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60624/0 (socket says 172.21.15.119:60624) 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab46ffd640 1 -- 172.21.15.119:0/1901987839 learned_addr learned my addr 172.21.15.119:0/1901987839 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab477fe640 1 --2- 172.21.15.119:0/1901987839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480fac80 0x7fab481131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab46ffd640 1 -- 172.21.15.119:0/1901987839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480fac80 msgr2=0x7fab481131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab46ffd640 1 --2- 172.21.15.119:0/1901987839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480fac80 0x7fab481131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab46ffd640 1 -- 172.21.15.119:0/1901987839 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c005040 con 0x7fab48102640 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab46ffd640 1 --2- 172.21.15.119:0/1901987839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab48102640 0x7fab481136f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fab3c000c00 tx=0x7fab3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab2ffff640 1 -- 172.21.15.119:0/1901987839 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab3c038070 con 0x7fab48102640 2024-09-13T21:41:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab4dcce640 1 -- 172.21.15.119:0/1901987839 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4810d3b0 con 0x7fab48102640 2024-09-13T21:41:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab2ffff640 1 -- 172.21.15.119:0/1901987839 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fab3c02ade0 con 0x7fab48102640 2024-09-13T21:41:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.232+0000 7fab2ffff640 1 -- 172.21.15.119:0/1901987839 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab3c02c7e0 con 0x7fab48102640 2024-09-13T21:41:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.233+0000 7fab4dcce640 1 -- 172.21.15.119:0/1901987839 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4810d8f0 con 0x7fab48102640 2024-09-13T21:41:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.234+0000 7fab4dcce640 1 -- 172.21.15.119:0/1901987839 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab480657c0 con 0x7fab48102640 2024-09-13T21:41:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.234+0000 7fab2ffff640 1 -- 172.21.15.119:0/1901987839 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fab3c030020 con 0x7fab48102640 2024-09-13T21:41:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.234+0000 7fab2ffff640 1 --2- 172.21.15.119:0/1901987839 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fab3006ed60 0x7fab30071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.235+0000 7fab2ffff640 1 -- 172.21.15.119:0/1901987839 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fab3c0adad0 con 0x7fab48102640 2024-09-13T21:41:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.235+0000 7fab477fe640 1 --2- 172.21.15.119:0/1901987839 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fab3006ed60 0x7fab30071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.235+0000 7fab477fe640 1 --2- 172.21.15.119:0/1901987839 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fab3006ed60 0x7fab30071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab38004ed0 tx=0x7fab3800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:49.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.239+0000 7fab2ffff640 1 -- 172.21.15.119:0/1901987839 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fab3c07afe0 con 0x7fab48102640 2024-09-13T21:41:49.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.428+0000 7fab4dcce640 1 -- 172.21.15.119:0/1901987839 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fab48109590 con 0x7fab48102640 2024-09-13T21:41:49.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.428+0000 7fab2ffff640 1 -- 172.21.15.119:0/1901987839 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fab3c07a980 con 0x7fab48102640 2024-09-13T21:41:49.431 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:41:49.431 INFO:teuthology.orchestra.run.smithi119.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T21:41:49.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.430+0000 7fab4dcce640 1 -- 172.21.15.119:0/1901987839 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fab3006ed60 msgr2=0x7fab30071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:49.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.430+0000 7fab4dcce640 1 --2- 172.21.15.119:0/1901987839 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fab3006ed60 0x7fab30071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab38004ed0 tx=0x7fab3800b040 comp rx=0 tx=0).stop 2024-09-13T21:41:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.430+0000 7fab4dcce640 1 -- 172.21.15.119:0/1901987839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab48102640 msgr2=0x7fab481136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.430+0000 7fab4dcce640 1 --2- 172.21.15.119:0/1901987839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab48102640 0x7fab481136f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fab3c000c00 tx=0x7fab3c009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.430+0000 7fab4dcce640 1 -- 172.21.15.119:0/1901987839 shutdown_connections 2024-09-13T21:41:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.430+0000 7fab4dcce640 1 --2- 172.21.15.119:0/1901987839 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fab3006ed60 0x7fab30071210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.430+0000 7fab4dcce640 1 --2- 172.21.15.119:0/1901987839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab48102640 0x7fab481136f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.430+0000 7fab4dcce640 1 --2- 172.21.15.119:0/1901987839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480fac80 0x7fab481131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.430+0000 7fab4dcce640 1 -- 172.21.15.119:0/1901987839 >> 172.21.15.119:0/1901987839 conn(0x7fab48070ce0 msgr2=0x7fab48105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.431+0000 7fab4dcce640 1 -- 172.21.15.119:0/1901987839 shutdown_connections 2024-09-13T21:41:49.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:49.431+0000 7fab4dcce640 1 -- 172.21.15.119:0/1901987839 wait complete. 2024-09-13T21:41:50.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:49 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1901987839' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T21:41:50.105 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:49 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1901987839' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T21:41:50.130 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T21:41:50.131 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T21:41:50.131 INFO:teuthology.run_tasks:Running task print... 2024-09-13T21:41:50.140 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-13T21:41:50.140 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:41:50.154 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:41:50.154 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-13T21:41:50.414 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:51.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:50 smithi155 ceph-mon[34732]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:51.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:50 smithi119 ceph-mon[27653]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:52.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.130+0000 7f3c348c4640 1 -- 172.21.15.119:0/4226292113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c300fd820 msgr2=0x7f3c300fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:52.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.130+0000 7f3c348c4640 1 --2- 172.21.15.119:0/4226292113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c300fd820 0x7f3c300fdc90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3c240048d0 tx=0x7f3c24009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:52.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.130+0000 7f3c348c4640 1 -- 172.21.15.119:0/4226292113 shutdown_connections 2024-09-13T21:41:52.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.130+0000 7f3c348c4640 1 --2- 172.21.15.119:0/4226292113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c300fd820 0x7f3c300fdc90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:52.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.130+0000 7f3c348c4640 1 --2- 172.21.15.119:0/4226292113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c300fc550 0x7f3c300fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:52.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.130+0000 7f3c348c4640 1 -- 172.21.15.119:0/4226292113 >> 172.21.15.119:0/4226292113 conn(0x7f3c300f7d30 msgr2=0x7f3c300fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:52.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.130+0000 7f3c348c4640 1 -- 172.21.15.119:0/4226292113 shutdown_connections 2024-09-13T21:41:52.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.130+0000 7f3c348c4640 1 -- 172.21.15.119:0/4226292113 wait complete. 2024-09-13T21:41:52.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c348c4640 1 Processor -- start 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c348c4640 1 -- start start 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c348c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c300fc550 0x7f3c3010d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c348c4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c300fd820 0x7f3c3010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c348c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3010dc00 con 0x7f3c300fc550 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c348c4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3010e420 con 0x7f3c300fd820 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c2e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c300fc550 0x7f3c3010d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c2e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c300fc550 0x7f3c3010d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60648/0 (socket says 172.21.15.119:60648) 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c2e59c640 1 -- 172.21.15.119:0/33443865 learned_addr learned my addr 172.21.15.119:0/33443865 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c2dd9b640 1 --2- 172.21.15.119:0/33443865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c300fd820 0x7f3c3010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c2e59c640 1 -- 172.21.15.119:0/33443865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c300fd820 msgr2=0x7f3c3010d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c2e59c640 1 --2- 172.21.15.119:0/33443865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c300fd820 0x7f3c3010d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:52.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c2e59c640 1 -- 172.21.15.119:0/33443865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24005040 con 0x7f3c300fc550 2024-09-13T21:41:52.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.131+0000 7f3c2e59c640 1 --2- 172.21.15.119:0/33443865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c300fc550 0x7f3c3010d070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000c830 tx=0x7f3c20004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:52.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.132+0000 7f3c1effd640 1 -- 172.21.15.119:0/33443865 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2000a850 con 0x7f3c300fc550 2024-09-13T21:41:52.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.132+0000 7f3c1effd640 1 -- 172.21.15.119:0/33443865 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c2000ae50 con 0x7f3c300fc550 2024-09-13T21:41:52.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.132+0000 7f3c348c4640 1 -- 172.21.15.119:0/33443865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3010e6b0 con 0x7f3c300fc550 2024-09-13T21:41:52.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.132+0000 7f3c1effd640 1 -- 172.21.15.119:0/33443865 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c200113a0 con 0x7f3c300fc550 2024-09-13T21:41:52.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.132+0000 7f3c348c4640 1 -- 172.21.15.119:0/33443865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3010ec50 con 0x7f3c300fc550 2024-09-13T21:41:52.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.133+0000 7f3c348c4640 1 -- 172.21.15.119:0/33443865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c300fb9b0 con 0x7f3c300fc550 2024-09-13T21:41:52.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.133+0000 7f3c1effd640 1 -- 172.21.15.119:0/33443865 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3c2000a9b0 con 0x7f3c300fc550 2024-09-13T21:41:52.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.133+0000 7f3c1effd640 1 --2- 172.21.15.119:0/33443865 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c1806ed60 0x7f3c18071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:52.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.134+0000 7f3c2dd9b640 1 --2- 172.21.15.119:0/33443865 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c1806ed60 0x7f3c18071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:52.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.134+0000 7f3c1effd640 1 -- 172.21.15.119:0/33443865 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3c2008df60 con 0x7f3c300fc550 2024-09-13T21:41:52.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.134+0000 7f3c2dd9b640 1 --2- 172.21.15.119:0/33443865 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c1806ed60 0x7f3c18071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3c24007ac0 tx=0x7f3c24035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:52.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.138+0000 7f3c1effd640 1 -- 172.21.15.119:0/33443865 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3c2005b4e0 con 0x7f3c300fc550 2024-09-13T21:41:52.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.292+0000 7f3c348c4640 1 -- 172.21.15.119:0/33443865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f3c3004b720 con 0x7f3c300fc550 2024-09-13T21:41:52.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.299+0000 7f3c1effd640 1 -- 172.21.15.119:0/33443865 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f3c2005ae80 con 0x7f3c300fc550 2024-09-13T21:41:52.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.301+0000 7f3c348c4640 1 -- 172.21.15.119:0/33443865 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c1806ed60 msgr2=0x7f3c18071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:52.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.301+0000 7f3c348c4640 1 --2- 172.21.15.119:0/33443865 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c1806ed60 0x7f3c18071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3c24007ac0 tx=0x7f3c24035040 comp rx=0 tx=0).stop 2024-09-13T21:41:52.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.301+0000 7f3c348c4640 1 -- 172.21.15.119:0/33443865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c300fc550 msgr2=0x7f3c3010d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:52.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.301+0000 7f3c348c4640 1 --2- 172.21.15.119:0/33443865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c300fc550 0x7f3c3010d070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000c830 tx=0x7f3c20004430 comp rx=0 tx=0).stop 2024-09-13T21:41:52.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.301+0000 7f3c348c4640 1 -- 172.21.15.119:0/33443865 shutdown_connections 2024-09-13T21:41:52.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.301+0000 7f3c348c4640 1 --2- 172.21.15.119:0/33443865 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c1806ed60 0x7f3c18071210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:52.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.301+0000 7f3c348c4640 1 --2- 172.21.15.119:0/33443865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c300fd820 0x7f3c3010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:52.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.301+0000 7f3c348c4640 1 --2- 172.21.15.119:0/33443865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c300fc550 0x7f3c3010d070 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:52.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.301+0000 7f3c348c4640 1 -- 172.21.15.119:0/33443865 >> 172.21.15.119:0/33443865 conn(0x7f3c300f7d30 msgr2=0x7f3c300f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:52.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.301+0000 7f3c348c4640 1 -- 172.21.15.119:0/33443865 shutdown_connections 2024-09-13T21:41:52.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:52.301+0000 7f3c348c4640 1 -- 172.21.15.119:0/33443865 wait complete. 2024-09-13T21:41:52.956 INFO:teuthology.run_tasks:Running task print... 2024-09-13T21:41:52.965 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-13T21:41:52.965 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:41:52.988 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:41:52.988 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T21:41:53.229 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:53 smithi155 ceph-mon[34732]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:53 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/33443865' entity='client.admin' 2024-09-13T21:41:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:41:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:41:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:41:53.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:53 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:41:53.585 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:53 smithi119 ceph-mon[27653]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:53.585 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:53 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/33443865' entity='client.admin' 2024-09-13T21:41:53.585 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:41:53.585 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:41:53.585 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:41:53.585 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:53 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:41:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.918+0000 7f6bcee2f640 1 -- 172.21.15.119:0/850972039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc80fb430 msgr2=0x7f6bc80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.918+0000 7f6bcee2f640 1 --2- 172.21.15.119:0/850972039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc80fb430 0x7f6bc80fb840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0048d0 tx=0x7f6bbc009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.918+0000 7f6bcee2f640 1 -- 172.21.15.119:0/850972039 shutdown_connections 2024-09-13T21:41:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.918+0000 7f6bcee2f640 1 --2- 172.21.15.119:0/850972039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc80fc700 0x7f6bc80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.918+0000 7f6bcee2f640 1 --2- 172.21.15.119:0/850972039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc80fb430 0x7f6bc80fb840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.918+0000 7f6bcee2f640 1 -- 172.21.15.119:0/850972039 >> 172.21.15.119:0/850972039 conn(0x7f6bc80f6c10 msgr2=0x7f6bc80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:54.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.918+0000 7f6bcee2f640 1 -- 172.21.15.119:0/850972039 shutdown_connections 2024-09-13T21:41:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.918+0000 7f6bcee2f640 1 -- 172.21.15.119:0/850972039 wait complete. 2024-09-13T21:41:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.918+0000 7f6bcee2f640 1 Processor -- start 2024-09-13T21:41:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bcee2f640 1 -- start start 2024-09-13T21:41:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bcee2f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc80fb430 0x7f6bc81121c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bcee2f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc80fc700 0x7f6bc8114710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bcee2f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc810dc70 con 0x7f6bc80fc700 2024-09-13T21:41:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bcee2f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8065bd0 con 0x7f6bc80fb430 2024-09-13T21:41:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bc7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc80fc700 0x7f6bc8114710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bc7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc80fc700 0x7f6bc8114710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58452/0 (socket says 172.21.15.119:58452) 2024-09-13T21:41:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bc7fff640 1 -- 172.21.15.119:0/2721927480 learned_addr learned my addr 172.21.15.119:0/2721927480 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:54.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bccbcb640 1 --2- 172.21.15.119:0/2721927480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc80fb430 0x7f6bc81121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bc7fff640 1 -- 172.21.15.119:0/2721927480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc80fb430 msgr2=0x7f6bc81121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bc7fff640 1 --2- 172.21.15.119:0/2721927480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc80fb430 0x7f6bc81121c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.919+0000 7f6bc7fff640 1 -- 172.21.15.119:0/2721927480 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc005040 con 0x7f6bc80fc700 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.920+0000 7f6bc7fff640 1 --2- 172.21.15.119:0/2721927480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc80fc700 0x7f6bc8114710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4002a50 tx=0x7f6bb4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.920+0000 7f6bc57fa640 1 -- 172.21.15.119:0/2721927480 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb4007c30 con 0x7f6bc80fc700 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.920+0000 7f6bcee2f640 1 -- 172.21.15.119:0/2721927480 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc8065eb0 con 0x7f6bc80fc700 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.920+0000 7f6bc57fa640 1 -- 172.21.15.119:0/2721927480 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6bb400f040 con 0x7f6bc80fc700 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.920+0000 7f6bc57fa640 1 -- 172.21.15.119:0/2721927480 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb400da10 con 0x7f6bc80fc700 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.920+0000 7f6bcee2f640 1 -- 172.21.15.119:0/2721927480 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc8115010 con 0x7f6bc80fc700 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.921+0000 7f6bcee2f640 1 -- 172.21.15.119:0/2721927480 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc80fa890 con 0x7f6bc80fc700 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.921+0000 7f6bc57fa640 1 -- 172.21.15.119:0/2721927480 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f6bb400dc80 con 0x7f6bc80fc700 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.922+0000 7f6bc57fa640 1 --2- 172.21.15.119:0/2721927480 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6bb806ed60 0x7f6bb8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.922+0000 7f6bc57fa640 1 -- 172.21.15.119:0/2721927480 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6bb408d600 con 0x7f6bc80fc700 2024-09-13T21:41:54.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.922+0000 7f6bccbcb640 1 --2- 172.21.15.119:0/2721927480 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6bb806ed60 0x7f6bb8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:54.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.922+0000 7f6bccbcb640 1 --2- 172.21.15.119:0/2721927480 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6bb806ed60 0x7f6bb8071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc000c00 tx=0x7f6bbc035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:54.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:54.926+0000 7f6bc57fa640 1 -- 172.21.15.119:0/2721927480 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6bb404d2a0 con 0x7f6bc80fc700 2024-09-13T21:41:55.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.093+0000 7f6bcee2f640 1 -- 172.21.15.119:0/2721927480 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bc8100b60 con 0x7f6bb806ed60 2024-09-13T21:41:55.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.094+0000 7f6bc57fa640 1 -- 172.21.15.119:0/2721927480 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6bc8100b60 con 0x7f6bb806ed60 2024-09-13T21:41:55.096 INFO:teuthology.orchestra.run.smithi119.stdout:Backend: cephadm 2024-09-13T21:41:55.096 INFO:teuthology.orchestra.run.smithi119.stdout:Available: Yes 2024-09-13T21:41:55.096 INFO:teuthology.orchestra.run.smithi119.stdout:Paused: No 2024-09-13T21:41:55.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.097+0000 7f6bcee2f640 1 -- 172.21.15.119:0/2721927480 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6bb806ed60 msgr2=0x7f6bb8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.097+0000 7f6bcee2f640 1 --2- 172.21.15.119:0/2721927480 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6bb806ed60 0x7f6bb8071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc000c00 tx=0x7f6bbc035040 comp rx=0 tx=0).stop 2024-09-13T21:41:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.097+0000 7f6bcee2f640 1 -- 172.21.15.119:0/2721927480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc80fc700 msgr2=0x7f6bc8114710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.097+0000 7f6bcee2f640 1 --2- 172.21.15.119:0/2721927480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc80fc700 0x7f6bc8114710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4002a50 tx=0x7f6bb4004600 comp rx=0 tx=0).stop 2024-09-13T21:41:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.097+0000 7f6bcee2f640 1 -- 172.21.15.119:0/2721927480 shutdown_connections 2024-09-13T21:41:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.097+0000 7f6bcee2f640 1 --2- 172.21.15.119:0/2721927480 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6bb806ed60 0x7f6bb8071210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.097+0000 7f6bcee2f640 1 --2- 172.21.15.119:0/2721927480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc80fc700 0x7f6bc8114710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.097+0000 7f6bcee2f640 1 --2- 172.21.15.119:0/2721927480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc80fb430 0x7f6bc81121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.097+0000 7f6bcee2f640 1 -- 172.21.15.119:0/2721927480 >> 172.21.15.119:0/2721927480 conn(0x7f6bc80f6c10 msgr2=0x7f6bc80f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.097+0000 7f6bcee2f640 1 -- 172.21.15.119:0/2721927480 shutdown_connections 2024-09-13T21:41:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:55.097+0000 7f6bcee2f640 1 -- 172.21.15.119:0/2721927480 wait complete. 2024-09-13T21:41:55.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:55 smithi119 ceph-mon[27653]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:55 smithi155 ceph-mon[34732]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:55.823 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T21:41:56.068 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:56.517 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:56 smithi119 ceph-mon[27653]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:56 smithi155 ceph-mon[34732]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:57.370 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:57 smithi119 ceph-mon[27653]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.550+0000 7fee19ff1640 1 -- 172.21.15.119:0/798165153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee140fc720 msgr2=0x7fee140fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.550+0000 7fee19ff1640 1 --2- 172.21.15.119:0/798165153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee140fc720 0x7fee140fcb90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fee080048d0 tx=0x7fee08009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.550+0000 7fee19ff1640 1 -- 172.21.15.119:0/798165153 shutdown_connections 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.550+0000 7fee19ff1640 1 --2- 172.21.15.119:0/798165153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee140fc720 0x7fee140fcb90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.550+0000 7fee19ff1640 1 --2- 172.21.15.119:0/798165153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee140fb450 0x7fee140fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.550+0000 7fee19ff1640 1 -- 172.21.15.119:0/798165153 >> 172.21.15.119:0/798165153 conn(0x7fee140f6c10 msgr2=0x7fee140f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.550+0000 7fee19ff1640 1 -- 172.21.15.119:0/798165153 shutdown_connections 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.550+0000 7fee19ff1640 1 -- 172.21.15.119:0/798165153 wait complete. 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.551+0000 7fee19ff1640 1 Processor -- start 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.551+0000 7fee19ff1640 1 -- start start 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.551+0000 7fee19ff1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee140fb450 0x7fee140ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.551+0000 7fee19ff1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee140fc720 0x7fee140fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.551+0000 7fee19ff1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee140fdff0 con 0x7fee140fc720 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.551+0000 7fee19ff1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee140fe130 con 0x7fee140fb450 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.551+0000 7fee12ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee140fc720 0x7fee140fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:57.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.551+0000 7fee12ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee140fc720 0x7fee140fda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58456/0 (socket says 172.21.15.119:58456) 2024-09-13T21:41:57.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.551+0000 7fee12ffd640 1 -- 172.21.15.119:0/1759618855 learned_addr learned my addr 172.21.15.119:0/1759618855 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:41:57.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.551+0000 7fee137fe640 1 --2- 172.21.15.119:0/1759618855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee140fb450 0x7fee140ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:57.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.552+0000 7fee12ffd640 1 -- 172.21.15.119:0/1759618855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee140fb450 msgr2=0x7fee140ff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:57.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.552+0000 7fee12ffd640 1 --2- 172.21.15.119:0/1759618855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee140fb450 0x7fee140ff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:57.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.552+0000 7fee12ffd640 1 -- 172.21.15.119:0/1759618855 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee08005040 con 0x7fee140fc720 2024-09-13T21:41:57.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.552+0000 7fee12ffd640 1 --2- 172.21.15.119:0/1759618855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee140fc720 0x7fee140fda60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fee080043d0 tx=0x7fee08009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:57.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.552+0000 7fedfbfff640 1 -- 172.21.15.119:0/1759618855 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee08038070 con 0x7fee140fc720 2024-09-13T21:41:57.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.552+0000 7fee19ff1640 1 -- 172.21.15.119:0/1759618855 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee140fe3b0 con 0x7fee140fc720 2024-09-13T21:41:57.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.552+0000 7fedfbfff640 1 -- 172.21.15.119:0/1759618855 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fee0802ae90 con 0x7fee140fc720 2024-09-13T21:41:57.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.552+0000 7fedfbfff640 1 -- 172.21.15.119:0/1759618855 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee0803e670 con 0x7fee140fc720 2024-09-13T21:41:57.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.552+0000 7fee19ff1640 1 -- 172.21.15.119:0/1759618855 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee14115120 con 0x7fee140fc720 2024-09-13T21:41:57.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.553+0000 7fee19ff1640 1 -- 172.21.15.119:0/1759618855 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee140fa8b0 con 0x7fee140fc720 2024-09-13T21:41:57.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.553+0000 7fedfbfff640 1 -- 172.21.15.119:0/1759618855 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fee08030020 con 0x7fee140fc720 2024-09-13T21:41:57.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.554+0000 7fedfbfff640 1 --2- 172.21.15.119:0/1759618855 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fedfc06ed60 0x7fedfc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:41:57.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.554+0000 7fedfbfff640 1 -- 172.21.15.119:0/1759618855 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fee080ae070 con 0x7fee140fc720 2024-09-13T21:41:57.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.554+0000 7fee137fe640 1 --2- 172.21.15.119:0/1759618855 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fedfc06ed60 0x7fedfc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:41:57.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.554+0000 7fee137fe640 1 --2- 172.21.15.119:0/1759618855 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fedfc06ed60 0x7fedfc071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee140ff320 tx=0x7fee0400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:41:57.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.558+0000 7fedfbfff640 1 -- 172.21.15.119:0/1759618855 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fee0807b4e0 con 0x7fee140fc720 2024-09-13T21:41:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:57 smithi155 ceph-mon[34732]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:57.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.719+0000 7fee19ff1640 1 -- 172.21.15.119:0/1759618855 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fee14103f80 con 0x7fedfc06ed60 2024-09-13T21:41:57.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.727+0000 7fedfbfff640 1 -- 172.21.15.119:0/1759618855 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2790 (secure 0 0 0) 0x7fee14103f80 con 0x7fedfc06ed60 2024-09-13T21:41:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:41:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (3m) 2m ago 4m 24.5M - 0.25.0 c8568f914cd2 d48a0a37f6f5 2024-09-13T21:41:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (5m) 2m ago 5m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 c6a79bd22109 2024-09-13T21:41:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (4m) 66s ago 4m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 1bccd1b9bda0 2024-09-13T21:41:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (3m) 2m ago 4m 80.8M - 9.4.7 954c08fa6188 b9b173631489 2024-09-13T21:41:57.728 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:9283,8765,8443 running (6m) 2m ago 6m 437M - 17.2.7-1629-geb16b97b ab51d1bebd12 b7b1f8308caa 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283 running (4m) 66s ago 4m 402M - 17.2.7-1629-geb16b97b ab51d1bebd12 bdaf3e955341 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (6m) 2m ago 6m 40.4M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 f49a62e4f3c3 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (4m) 66s ago 4m 38.3M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 66c9116315ae 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (5m) 2m ago 5m 16.1M - 1.5.0 0da6a335fe13 d6e79b36f728 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (4m) 66s ago 4m 15.7M - 1.5.0 0da6a335fe13 513bc6bacbbd 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (3m) 2m ago 3m 35.1M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 6e0bbff1ac3f 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (2m) 2m ago 2m 35.9M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (2m) 2m ago 2m 11.6M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (2m) 66s ago 2m 39.0M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (96s) 66s ago 95s 36.3M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (70s) 66s ago 70s 14.1M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:41:57.729 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (3m) 2m ago 4m 38.0M - 2.43.0 a07b618ecd1d 5d5878bd99c5 2024-09-13T21:41:57.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.728+0000 7fee19ff1640 1 -- 172.21.15.119:0/1759618855 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fedfc06ed60 msgr2=0x7fedfc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:57.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.728+0000 7fee19ff1640 1 --2- 172.21.15.119:0/1759618855 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fedfc06ed60 0x7fedfc071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee140ff320 tx=0x7fee0400b040 comp rx=0 tx=0).stop 2024-09-13T21:41:57.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.728+0000 7fee19ff1640 1 -- 172.21.15.119:0/1759618855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee140fc720 msgr2=0x7fee140fda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:41:57.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.728+0000 7fee19ff1640 1 --2- 172.21.15.119:0/1759618855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee140fc720 0x7fee140fda60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fee080043d0 tx=0x7fee08009da0 comp rx=0 tx=0).stop 2024-09-13T21:41:57.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.728+0000 7fee19ff1640 1 -- 172.21.15.119:0/1759618855 shutdown_connections 2024-09-13T21:41:57.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.728+0000 7fee19ff1640 1 --2- 172.21.15.119:0/1759618855 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fedfc06ed60 0x7fedfc071210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:57.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.728+0000 7fee19ff1640 1 --2- 172.21.15.119:0/1759618855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee140fc720 0x7fee140fda60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:57.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.728+0000 7fee19ff1640 1 --2- 172.21.15.119:0/1759618855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee140fb450 0x7fee140ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:41:57.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.728+0000 7fee19ff1640 1 -- 172.21.15.119:0/1759618855 >> 172.21.15.119:0/1759618855 conn(0x7fee140f6c10 msgr2=0x7fee14066080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:41:57.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.729+0000 7fee19ff1640 1 -- 172.21.15.119:0/1759618855 shutdown_connections 2024-09-13T21:41:57.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:41:57.729+0000 7fee19ff1640 1 -- 172.21.15.119:0/1759618855 wait complete. 2024-09-13T21:41:58.466 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T21:41:58.711 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:41:59.427 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:59 smithi119 ceph-mon[27653]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:59.427 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:41:59 smithi119 ceph-mon[27653]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:41:59.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:59 smithi155 ceph-mon[34732]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:41:59.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:41:59 smithi155 ceph-mon[34732]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:00.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.333+0000 7f7809096640 1 -- 172.21.15.119:0/1054474371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7804065c40 msgr2=0x7f78040fcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:00.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.333+0000 7f7809096640 1 --2- 172.21.15.119:0/1054474371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7804065c40 0x7f78040fcf30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77f40048d0 tx=0x7f77f4009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:00.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.333+0000 7f7809096640 1 -- 172.21.15.119:0/1054474371 shutdown_connections 2024-09-13T21:42:00.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.333+0000 7f7809096640 1 --2- 172.21.15.119:0/1054474371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78040fd470 0x7f78040ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.333+0000 7f7809096640 1 --2- 172.21.15.119:0/1054474371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7804065c40 0x7f78040fcf30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.333+0000 7f7809096640 1 -- 172.21.15.119:0/1054474371 >> 172.21.15.119:0/1054474371 conn(0x7f78040f6c10 msgr2=0x7f78040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.333+0000 7f7809096640 1 -- 172.21.15.119:0/1054474371 shutdown_connections 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.333+0000 7f7809096640 1 -- 172.21.15.119:0/1054474371 wait complete. 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7809096640 1 Processor -- start 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7809096640 1 -- start start 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7809096640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7804065c40 0x7f7804113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7809096640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78040fd470 0x7f7804113cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7809096640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7804114aa0 con 0x7f7804065c40 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7809096640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7804114c10 con 0x7f78040fd470 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7802d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7804065c40 0x7f7804113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:00.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7802d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7804065c40 0x7f7804113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58478/0 (socket says 172.21.15.119:58478) 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7802d9d640 1 -- 172.21.15.119:0/2341304110 learned_addr learned my addr 172.21.15.119:0/2341304110 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f780259c640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78040fd470 0x7f7804113cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7802d9d640 1 -- 172.21.15.119:0/2341304110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78040fd470 msgr2=0x7f7804113cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7802d9d640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78040fd470 0x7f7804113cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7802d9d640 1 -- 172.21.15.119:0/2341304110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f4005040 con 0x7f7804065c40 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f780259c640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78040fd470 0x7f7804113cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f7802d9d640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7804065c40 0x7f7804113790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f77f40048a0 tx=0x7f77f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.334+0000 7f77fb7fe640 1 -- 172.21.15.119:0/2341304110 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77f4038070 con 0x7f7804065c40 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.335+0000 7f77fb7fe640 1 -- 172.21.15.119:0/2341304110 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f77f402abd0 con 0x7f7804065c40 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.335+0000 7f7809096640 1 -- 172.21.15.119:0/2341304110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7804114e90 con 0x7f7804065c40 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.335+0000 7f77fb7fe640 1 -- 172.21.15.119:0/2341304110 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77f4033640 con 0x7f7804065c40 2024-09-13T21:42:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.335+0000 7f7809096640 1 -- 172.21.15.119:0/2341304110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78041153b0 con 0x7f7804065c40 2024-09-13T21:42:00.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.336+0000 7f7809096640 1 -- 172.21.15.119:0/2341304110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780410bdc0 con 0x7f7804065c40 2024-09-13T21:42:00.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.336+0000 7f77fb7fe640 1 -- 172.21.15.119:0/2341304110 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f77f4030020 con 0x7f7804065c40 2024-09-13T21:42:00.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.336+0000 7f77fb7fe640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77f006ed60 0x7f77f0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:00.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.336+0000 7f77fb7fe640 1 -- 172.21.15.119:0/2341304110 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f77f40ae1b0 con 0x7f7804065c40 2024-09-13T21:42:00.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.337+0000 7f780259c640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77f006ed60 0x7f77f0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:00.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.337+0000 7f780259c640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77f006ed60 0x7f77f0071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7804113540 tx=0x7f77ec008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:00.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.340+0000 7f77fb7fe640 1 -- 172.21.15.119:0/2341304110 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f77f407b610 con 0x7f7804065c40 2024-09-13T21:42:00.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.500+0000 7f7809096640 1 -- 172.21.15.119:0/2341304110 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f78041155d0 con 0x7f77f006ed60 2024-09-13T21:42:00.502 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:00 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:00.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.506+0000 7f77fb7fe640 1 -- 172.21.15.119:0/2341304110 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7f78041155d0 con 0x7f77f006ed60 2024-09-13T21:42:00.508 INFO:teuthology.orchestra.run.smithi119.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T21:42:00.508 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-13T21:42:00.508 INFO:teuthology.orchestra.run.smithi119.stdout:crash 2/2 2m ago 5m * 2024-09-13T21:42:00.508 INFO:teuthology.orchestra.run.smithi119.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-13T21:42:00.508 INFO:teuthology.orchestra.run.smithi119.stdout:mgr 2/2 2m ago 5m count:2 2024-09-13T21:42:00.508 INFO:teuthology.orchestra.run.smithi119.stdout:mon 2/2 2m ago 4m smithi119:172.21.15.119=smithi119;smithi155:172.21.15.155=smithi155;count:2 2024-09-13T21:42:00.508 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-13T21:42:00.508 INFO:teuthology.orchestra.run.smithi119.stdout:osd 6 2m ago - 2024-09-13T21:42:00.508 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-13T21:42:00.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.508+0000 7f7809096640 1 -- 172.21.15.119:0/2341304110 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77f006ed60 msgr2=0x7f77f0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:00.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.508+0000 7f7809096640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77f006ed60 0x7f77f0071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7804113540 tx=0x7f77ec008040 comp rx=0 tx=0).stop 2024-09-13T21:42:00.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.508+0000 7f7809096640 1 -- 172.21.15.119:0/2341304110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7804065c40 msgr2=0x7f7804113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:00.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.508+0000 7f7809096640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7804065c40 0x7f7804113790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f77f40048a0 tx=0x7f77f4009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:00.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.508+0000 7f7809096640 1 -- 172.21.15.119:0/2341304110 shutdown_connections 2024-09-13T21:42:00.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.508+0000 7f7809096640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f77f006ed60 0x7f77f0071210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:00.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.508+0000 7f7809096640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78040fd470 0x7f7804113cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:00.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.508+0000 7f7809096640 1 --2- 172.21.15.119:0/2341304110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7804065c40 0x7f7804113790 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:00.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.508+0000 7f7809096640 1 -- 172.21.15.119:0/2341304110 >> 172.21.15.119:0/2341304110 conn(0x7f78040f6c10 msgr2=0x7f78040f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:00.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.508+0000 7f7809096640 1 -- 172.21.15.119:0/2341304110 shutdown_connections 2024-09-13T21:42:00.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:00.508+0000 7f7809096640 1 -- 172.21.15.119:0/2341304110 wait complete. 2024-09-13T21:42:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:00 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:01.291 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T21:42:01.538 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:01 smithi155 ceph-mon[34732]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:01 smithi119 ceph-mon[27653]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:02 smithi155 ceph-mon[34732]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:02.586 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:02 smithi119 ceph-mon[27653]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:02.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.873+0000 7fea79e2c640 1 -- 172.21.15.119:0/3719868056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea740ff680 msgr2=0x7fea74101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:02.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.873+0000 7fea79e2c640 1 --2- 172.21.15.119:0/3719868056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea740ff680 0x7fea74101a60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fea680048d0 tx=0x7fea68009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:02.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.873+0000 7fea79e2c640 1 -- 172.21.15.119:0/3719868056 shutdown_connections 2024-09-13T21:42:02.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.873+0000 7fea79e2c640 1 --2- 172.21.15.119:0/3719868056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea740ff680 0x7fea74101a60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:02.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.873+0000 7fea79e2c640 1 --2- 172.21.15.119:0/3719868056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea74065c40 0x7fea740ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:02.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.873+0000 7fea79e2c640 1 -- 172.21.15.119:0/3719868056 >> 172.21.15.119:0/3719868056 conn(0x7fea740f6c10 msgr2=0x7fea740f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:02.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.873+0000 7fea79e2c640 1 -- 172.21.15.119:0/3719868056 shutdown_connections 2024-09-13T21:42:02.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.873+0000 7fea79e2c640 1 -- 172.21.15.119:0/3719868056 wait complete. 2024-09-13T21:42:02.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.874+0000 7fea79e2c640 1 Processor -- start 2024-09-13T21:42:02.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.874+0000 7fea79e2c640 1 -- start start 2024-09-13T21:42:02.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.874+0000 7fea79e2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea74065c40 0x7fea7410d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.874+0000 7fea79e2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea740ff680 0x7fea7410d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.874+0000 7fea79e2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7410e480 con 0x7fea740ff680 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.874+0000 7fea79e2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7410e5f0 con 0x7fea74065c40 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.874+0000 7fea72ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea740ff680 0x7fea7410d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.874+0000 7fea72ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea740ff680 0x7fea7410d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58488/0 (socket says 172.21.15.119:58488) 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.874+0000 7fea72ffd640 1 -- 172.21.15.119:0/4052745642 learned_addr learned my addr 172.21.15.119:0/4052745642 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.874+0000 7fea737fe640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea74065c40 0x7fea7410d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.875+0000 7fea72ffd640 1 -- 172.21.15.119:0/4052745642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea74065c40 msgr2=0x7fea7410d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.875+0000 7fea72ffd640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea74065c40 0x7fea7410d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.875+0000 7fea72ffd640 1 -- 172.21.15.119:0/4052745642 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea68005040 con 0x7fea740ff680 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.875+0000 7fea737fe640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea74065c40 0x7fea7410d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:42:02.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.875+0000 7fea72ffd640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea740ff680 0x7fea7410d610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fea68003080 tx=0x7fea68009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:02.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.875+0000 7fea5bfff640 1 -- 172.21.15.119:0/4052745642 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea6803c070 con 0x7fea740ff680 2024-09-13T21:42:02.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.875+0000 7fea5bfff640 1 -- 172.21.15.119:0/4052745642 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea68037cd0 con 0x7fea740ff680 2024-09-13T21:42:02.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.875+0000 7fea5bfff640 1 -- 172.21.15.119:0/4052745642 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea6802c3f0 con 0x7fea740ff680 2024-09-13T21:42:02.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.875+0000 7fea79e2c640 1 -- 172.21.15.119:0/4052745642 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7410e870 con 0x7fea740ff680 2024-09-13T21:42:02.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.875+0000 7fea79e2c640 1 -- 172.21.15.119:0/4052745642 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7410ed90 con 0x7fea740ff680 2024-09-13T21:42:02.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.876+0000 7fea79e2c640 1 -- 172.21.15.119:0/4052745642 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea740fa890 con 0x7fea740ff680 2024-09-13T21:42:02.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.877+0000 7fea5bfff640 1 -- 172.21.15.119:0/4052745642 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fea68030020 con 0x7fea740ff680 2024-09-13T21:42:02.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.877+0000 7fea5bfff640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea5c06ed60 0x7fea5c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:02.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.877+0000 7fea5bfff640 1 -- 172.21.15.119:0/4052745642 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fea680b2660 con 0x7fea740ff680 2024-09-13T21:42:02.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.877+0000 7fea737fe640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea5c06ed60 0x7fea5c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:02.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.877+0000 7fea737fe640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea5c06ed60 0x7fea5c071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fea740659a0 tx=0x7fea64008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:02.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:02.881+0000 7fea5bfff640 1 -- 172.21.15.119:0/4052745642 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fea6807fac0 con 0x7fea740ff680 2024-09-13T21:42:03.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.040+0000 7fea79e2c640 1 -- 172.21.15.119:0/4052745642 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fea7410efb0 con 0x7fea5c06ed60 2024-09-13T21:42:03.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.042+0000 7fea5bfff640 1 -- 172.21.15.119:0/4052745642 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fea7410efb0 con 0x7fea5c06ed60 2024-09-13T21:42:03.043 INFO:teuthology.orchestra.run.smithi119.stdout:HOST ADDR LABELS STATUS 2024-09-13T21:42:03.043 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119 172.21.15.119 2024-09-13T21:42:03.043 INFO:teuthology.orchestra.run.smithi119.stdout:smithi155 172.21.15.155 2024-09-13T21:42:03.044 INFO:teuthology.orchestra.run.smithi119.stdout:2 hosts in cluster 2024-09-13T21:42:03.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.044+0000 7fea79e2c640 1 -- 172.21.15.119:0/4052745642 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea5c06ed60 msgr2=0x7fea5c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:03.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.044+0000 7fea79e2c640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea5c06ed60 0x7fea5c071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fea740659a0 tx=0x7fea64008040 comp rx=0 tx=0).stop 2024-09-13T21:42:03.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.044+0000 7fea79e2c640 1 -- 172.21.15.119:0/4052745642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea740ff680 msgr2=0x7fea7410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:03.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.044+0000 7fea79e2c640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea740ff680 0x7fea7410d610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fea68003080 tx=0x7fea68009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:03.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.044+0000 7fea79e2c640 1 -- 172.21.15.119:0/4052745642 shutdown_connections 2024-09-13T21:42:03.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.044+0000 7fea79e2c640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fea5c06ed60 0x7fea5c071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:03.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.044+0000 7fea79e2c640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea740ff680 0x7fea7410d610 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:03.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.044+0000 7fea79e2c640 1 --2- 172.21.15.119:0/4052745642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea74065c40 0x7fea7410d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:03.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.044+0000 7fea79e2c640 1 -- 172.21.15.119:0/4052745642 >> 172.21.15.119:0/4052745642 conn(0x7fea740f6c10 msgr2=0x7fea740f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:03.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.044+0000 7fea79e2c640 1 -- 172.21.15.119:0/4052745642 shutdown_connections 2024-09-13T21:42:03.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:03.044+0000 7fea79e2c640 1 -- 172.21.15.119:0/4052745642 wait complete. 2024-09-13T21:42:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:03 smithi155 ceph-mon[34732]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:03.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:03 smithi119 ceph-mon[27653]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:03.717 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T21:42:03.960 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:04.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:04 smithi155 ceph-mon[34732]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:04 smithi119 ceph-mon[27653]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:05.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.571+0000 7fefcb196640 1 -- 172.21.15.119:0/2802752485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc40fba50 msgr2=0x7fefc40fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:05.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.571+0000 7fefcb196640 1 --2- 172.21.15.119:0/2802752485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc40fba50 0x7fefc40fbe60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fefac0048d0 tx=0x7fefac009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:05.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.572+0000 7fefcb196640 1 -- 172.21.15.119:0/2802752485 shutdown_connections 2024-09-13T21:42:05.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.572+0000 7fefcb196640 1 --2- 172.21.15.119:0/2802752485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefc40fc3a0 0x7fefc40fc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:05.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.572+0000 7fefcb196640 1 --2- 172.21.15.119:0/2802752485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc40fba50 0x7fefc40fbe60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:05.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.572+0000 7fefcb196640 1 -- 172.21.15.119:0/2802752485 >> 172.21.15.119:0/2802752485 conn(0x7fefc40f63a0 msgr2=0x7fefc40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.572+0000 7fefcb196640 1 -- 172.21.15.119:0/2802752485 shutdown_connections 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.572+0000 7fefcb196640 1 -- 172.21.15.119:0/2802752485 wait complete. 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.572+0000 7fefcb196640 1 Processor -- start 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.572+0000 7fefcb196640 1 -- start start 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefcb196640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefc40fba50 0x7fefc410c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefcb196640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc40fc3a0 0x7fefc410c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefcb196640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc410d3d0 con 0x7fefc40fc3a0 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefcb196640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc410d540 con 0x7fefc40fba50 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefc3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc40fc3a0 0x7fefc410c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefc3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc40fc3a0 0x7fefc410c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51088/0 (socket says 172.21.15.119:51088) 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefc3fff640 1 -- 172.21.15.119:0/4139753834 learned_addr learned my addr 172.21.15.119:0/4139753834 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefc8f32640 1 --2- 172.21.15.119:0/4139753834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefc40fba50 0x7fefc410c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefc3fff640 1 -- 172.21.15.119:0/4139753834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefc40fba50 msgr2=0x7fefc410c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefc3fff640 1 --2- 172.21.15.119:0/4139753834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefc40fba50 0x7fefc410c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefc3fff640 1 -- 172.21.15.119:0/4139753834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac005040 con 0x7fefc40fc3a0 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefc3fff640 1 --2- 172.21.15.119:0/4139753834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc40fc3a0 0x7fefc410c560 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fefb400bd20 tx=0x7fefb400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefc17fa640 1 -- 172.21.15.119:0/4139753834 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefb400b4c0 con 0x7fefc40fc3a0 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefcb196640 1 -- 172.21.15.119:0/4139753834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc410d7c0 con 0x7fefc40fc3a0 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefc17fa640 1 -- 172.21.15.119:0/4139753834 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fefb400ee90 con 0x7fefc40fc3a0 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefc17fa640 1 -- 172.21.15.119:0/4139753834 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefb40176b0 con 0x7fefc40fc3a0 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.573+0000 7fefcb196640 1 -- 172.21.15.119:0/4139753834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc410dce0 con 0x7fefc40fc3a0 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.574+0000 7fefcb196640 1 -- 172.21.15.119:0/4139753834 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc40fa040 con 0x7fefc40fc3a0 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.575+0000 7fefc17fa640 1 -- 172.21.15.119:0/4139753834 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fefb4014070 con 0x7fefc40fc3a0 2024-09-13T21:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.575+0000 7fefc17fa640 1 --2- 172.21.15.119:0/4139753834 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fefb006ed60 0x7fefb0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:05.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.575+0000 7fefc17fa640 1 -- 172.21.15.119:0/4139753834 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fefb40900f0 con 0x7fefc40fc3a0 2024-09-13T21:42:05.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.575+0000 7fefc8f32640 1 --2- 172.21.15.119:0/4139753834 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fefb006ed60 0x7fefb0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:05.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.576+0000 7fefc8f32640 1 --2- 172.21.15.119:0/4139753834 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fefb006ed60 0x7fefb0071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fefac007ac0 tx=0x7fefac035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:05.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.579+0000 7fefc17fa640 1 -- 172.21.15.119:0/4139753834 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fefb405d550 con 0x7fefc40fc3a0 2024-09-13T21:42:05.581 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:05 smithi119 ceph-mon[27653]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:05 smithi155 ceph-mon[34732]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:05.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.746+0000 7fefcb196640 1 -- 172.21.15.119:0/4139753834 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fefc410df00 con 0x7fefb006ed60 2024-09-13T21:42:05.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.748+0000 7fefc17fa640 1 -- 172.21.15.119:0/4139753834 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fefc410df00 con 0x7fefb006ed60 2024-09-13T21:42:05.749 INFO:teuthology.orchestra.run.smithi119.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T21:42:05.749 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-13T21:42:05.749 INFO:teuthology.orchestra.run.smithi119.stdout:smithi155 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GW400BGN 372G No 70s ago Has a FileSystem, LVM detected 2024-09-13T21:42:05.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.749+0000 7fefcb196640 1 -- 172.21.15.119:0/4139753834 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fefb006ed60 msgr2=0x7fefb0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:05.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.749+0000 7fefcb196640 1 --2- 172.21.15.119:0/4139753834 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fefb006ed60 0x7fefb0071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fefac007ac0 tx=0x7fefac035040 comp rx=0 tx=0).stop 2024-09-13T21:42:05.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.749+0000 7fefcb196640 1 -- 172.21.15.119:0/4139753834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc40fc3a0 msgr2=0x7fefc410c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:05.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.749+0000 7fefcb196640 1 --2- 172.21.15.119:0/4139753834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc40fc3a0 0x7fefc410c560 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fefb400bd20 tx=0x7fefb400ba50 comp rx=0 tx=0).stop 2024-09-13T21:42:05.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.750+0000 7fefcb196640 1 -- 172.21.15.119:0/4139753834 shutdown_connections 2024-09-13T21:42:05.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.750+0000 7fefcb196640 1 --2- 172.21.15.119:0/4139753834 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fefb006ed60 0x7fefb0071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:05.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.750+0000 7fefcb196640 1 --2- 172.21.15.119:0/4139753834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc40fc3a0 0x7fefc410c560 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:05.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.750+0000 7fefcb196640 1 --2- 172.21.15.119:0/4139753834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefc40fba50 0x7fefc410c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:05.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.750+0000 7fefcb196640 1 -- 172.21.15.119:0/4139753834 >> 172.21.15.119:0/4139753834 conn(0x7fefc40f63a0 msgr2=0x7fefc40f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:05.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.750+0000 7fefcb196640 1 -- 172.21.15.119:0/4139753834 shutdown_connections 2024-09-13T21:42:05.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:05.750+0000 7fefcb196640 1 -- 172.21.15.119:0/4139753834 wait complete. 2024-09-13T21:42:06.409 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:42:06.418 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:42:06.418 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-13T21:42:06.662 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:07 smithi119 ceph-mon[27653]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:07 smithi119 ceph-mon[27653]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:07 smithi155 ceph-mon[34732]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:07 smithi155 ceph-mon[34732]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:08.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 -- 172.21.15.119:0/2298159501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb00fc550 msgr2=0x7efdb00fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:08.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 --2- 172.21.15.119:0/2298159501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb00fc550 0x7efdb00fc960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efda00048d0 tx=0x7efda0009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:08.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 -- 172.21.15.119:0/2298159501 shutdown_connections 2024-09-13T21:42:08.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 --2- 172.21.15.119:0/2298159501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb00fd820 0x7efdb00fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:08.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 --2- 172.21.15.119:0/2298159501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb00fc550 0x7efdb00fc960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:08.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 -- 172.21.15.119:0/2298159501 >> 172.21.15.119:0/2298159501 conn(0x7efdb00f7d30 msgr2=0x7efdb00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:08.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 -- 172.21.15.119:0/2298159501 shutdown_connections 2024-09-13T21:42:08.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 -- 172.21.15.119:0/2298159501 wait complete. 2024-09-13T21:42:08.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 Processor -- start 2024-09-13T21:42:08.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 -- start start 2024-09-13T21:42:08.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb00fc550 0x7efdb010d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb00fd820 0x7efdb010d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb010e4e0 con 0x7efdb00fc550 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdb67f6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb010e650 con 0x7efdb00fd820 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdaffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb00fc550 0x7efdb010d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdaffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb00fc550 0x7efdb010d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51108/0 (socket says 172.21.15.119:51108) 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.153+0000 7efdaffff640 1 -- 172.21.15.119:0/3645291526 learned_addr learned my addr 172.21.15.119:0/3645291526 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.154+0000 7efdaffff640 1 -- 172.21.15.119:0/3645291526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb00fd820 msgr2=0x7efdb010d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.154+0000 7efda7fff640 1 --2- 172.21.15.119:0/3645291526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb00fd820 0x7efdb010d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.154+0000 7efdaffff640 1 --2- 172.21.15.119:0/3645291526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb00fd820 0x7efdb010d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.154+0000 7efdaffff640 1 -- 172.21.15.119:0/3645291526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0005040 con 0x7efdb00fc550 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.154+0000 7efdaffff640 1 --2- 172.21.15.119:0/3645291526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb00fc550 0x7efdb010d130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efda0003080 tx=0x7efda0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.154+0000 7efdad7fa640 1 -- 172.21.15.119:0/3645291526 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda0038070 con 0x7efdb00fc550 2024-09-13T21:42:08.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.154+0000 7efdad7fa640 1 -- 172.21.15.119:0/3645291526 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efda002abd0 con 0x7efdb00fc550 2024-09-13T21:42:08.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.154+0000 7efdb67f6640 1 -- 172.21.15.119:0/3645291526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb010e8d0 con 0x7efdb00fc550 2024-09-13T21:42:08.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.154+0000 7efdad7fa640 1 -- 172.21.15.119:0/3645291526 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda003e670 con 0x7efdb00fc550 2024-09-13T21:42:08.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.154+0000 7efdb67f6640 1 -- 172.21.15.119:0/3645291526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb010edf0 con 0x7efdb00fc550 2024-09-13T21:42:08.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.155+0000 7efdb67f6640 1 -- 172.21.15.119:0/3645291526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb01057e0 con 0x7efdb00fc550 2024-09-13T21:42:08.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.155+0000 7efdad7fa640 1 -- 172.21.15.119:0/3645291526 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7efda0030020 con 0x7efdb00fc550 2024-09-13T21:42:08.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.156+0000 7efdad7fa640 1 --2- 172.21.15.119:0/3645291526 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efd9c06ed60 0x7efd9c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:08.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.156+0000 7efdad7fa640 1 -- 172.21.15.119:0/3645291526 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efda00ae250 con 0x7efdb00fc550 2024-09-13T21:42:08.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.157+0000 7efda7fff640 1 --2- 172.21.15.119:0/3645291526 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efd9c06ed60 0x7efd9c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:08.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.157+0000 7efda7fff640 1 --2- 172.21.15.119:0/3645291526 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efd9c06ed60 0x7efd9c071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efdb010cee0 tx=0x7efd98008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:08.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.160+0000 7efdad7fa640 1 -- 172.21.15.119:0/3645291526 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efda007b6b0 con 0x7efdb00fc550 2024-09-13T21:42:08.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:08.340+0000 7efdb67f6640 1 -- 172.21.15.119:0/3645291526 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7efdb010f010 con 0x7efd9c06ed60 2024-09-13T21:42:09.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:09 smithi119 ceph-mon[27653]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:09.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:09 smithi119 ceph-mon[27653]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:09.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:09 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T21:42:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:09 smithi155 ceph-mon[34732]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:09 smithi155 ceph-mon[34732]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:42:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:09 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T21:42:10.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.369+0000 7efdad7fa640 1 -- 172.21.15.119:0/3645291526 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7efdb010f010 con 0x7efd9c06ed60 2024-09-13T21:42:10.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.371+0000 7efdb67f6640 1 -- 172.21.15.119:0/3645291526 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efd9c06ed60 msgr2=0x7efd9c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.371+0000 7efdb67f6640 1 --2- 172.21.15.119:0/3645291526 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efd9c06ed60 0x7efd9c071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efdb010cee0 tx=0x7efd98008040 comp rx=0 tx=0).stop 2024-09-13T21:42:10.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.371+0000 7efdb67f6640 1 -- 172.21.15.119:0/3645291526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb00fc550 msgr2=0x7efdb010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:10.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.371+0000 7efdb67f6640 1 --2- 172.21.15.119:0/3645291526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb00fc550 0x7efdb010d130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efda0003080 tx=0x7efda0009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.372+0000 7efdb67f6640 1 -- 172.21.15.119:0/3645291526 shutdown_connections 2024-09-13T21:42:10.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.372+0000 7efdb67f6640 1 --2- 172.21.15.119:0/3645291526 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efd9c06ed60 0x7efd9c071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.372+0000 7efdb67f6640 1 --2- 172.21.15.119:0/3645291526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb00fd820 0x7efdb010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.372+0000 7efdb67f6640 1 --2- 172.21.15.119:0/3645291526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efdb00fc550 0x7efdb010d130 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:10.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.372+0000 7efdb67f6640 1 -- 172.21.15.119:0/3645291526 >> 172.21.15.119:0/3645291526 conn(0x7efdb00f7d30 msgr2=0x7efdb00f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:10.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.372+0000 7efdb67f6640 1 -- 172.21.15.119:0/3645291526 shutdown_connections 2024-09-13T21:42:10.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:10.372+0000 7efdb67f6640 1 -- 172.21.15.119:0/3645291526 wait complete. 2024-09-13T21:42:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:10 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T21:42:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:10 smithi119 ceph-mon[27653]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T21:42:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:10 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T21:42:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:10 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119[27649]: 2024-09-13T21:42:10.348+0000 7f92b19ad640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:42:10.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:10 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T21:42:10.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:10 smithi155 ceph-mon[34732]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T21:42:10.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:10 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T21:42:11.060 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T21:42:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: pgmap v167: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T21:42:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: fsmap cephfs:0 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: Saving service mds.cephfs spec with placement count:4 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:11.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:11.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.rpmijj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:42:11.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.rpmijj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:42:11.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:11.734 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: pgmap v167: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:11.734 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T21:42:11.734 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: fsmap cephfs:0 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: Saving service mds.cephfs spec with placement count:4 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:11.735 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:11.736 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.rpmijj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:42:11.736 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.rpmijj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:42:11.736 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:12.312 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:12.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:12 smithi119 ceph-mon[27653]: Deploying daemon mds.cephfs.smithi119.rpmijj on smithi119 2024-09-13T21:42:12.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:12 smithi119 ceph-mon[27653]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T21:42:12.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:12 smithi155 ceph-mon[34732]: Deploying daemon mds.cephfs.smithi119.rpmijj on smithi119 2024-09-13T21:42:12.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:12 smithi155 ceph-mon[34732]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T21:42:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:13 smithi155 ceph-mon[34732]: pgmap v171: 65 pgs: 17 creating+peering, 30 unknown, 18 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:13 smithi155 ceph-mon[34732]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T21:42:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:13 smithi155 ceph-mon[34732]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T21:42:13.626 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:13 smithi119 ceph-mon[27653]: pgmap v171: 65 pgs: 17 creating+peering, 30 unknown, 18 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:13.626 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:13 smithi119 ceph-mon[27653]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T21:42:13.626 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:13 smithi119 ceph-mon[27653]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T21:42:14.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.098+0000 7f72c15a0640 1 -- 172.21.15.119:0/2931468763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72bc0fc710 msgr2=0x7f72bc0fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:14.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.098+0000 7f72c15a0640 1 --2- 172.21.15.119:0/2931468763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72bc0fc710 0x7f72bc0fcb80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f72b00048d0 tx=0x7f72b0009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:14.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.098+0000 7f72c15a0640 1 -- 172.21.15.119:0/2931468763 shutdown_connections 2024-09-13T21:42:14.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.098+0000 7f72c15a0640 1 --2- 172.21.15.119:0/2931468763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72bc0fc710 0x7f72bc0fcb80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:14.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.098+0000 7f72c15a0640 1 --2- 172.21.15.119:0/2931468763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72bc0fb440 0x7f72bc0fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:14.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.098+0000 7f72c15a0640 1 -- 172.21.15.119:0/2931468763 >> 172.21.15.119:0/2931468763 conn(0x7f72bc0f6c20 msgr2=0x7f72bc0f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:14.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.098+0000 7f72c15a0640 1 -- 172.21.15.119:0/2931468763 shutdown_connections 2024-09-13T21:42:14.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.098+0000 7f72c15a0640 1 -- 172.21.15.119:0/2931468763 wait complete. 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.098+0000 7f72c15a0640 1 Processor -- start 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.098+0000 7f72c15a0640 1 -- start start 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72c15a0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72bc0fb440 0x7f72bc10fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72c15a0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72bc0fc710 0x7f72bc1123b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72c15a0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc066780 con 0x7f72bc0fc710 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72c15a0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0668f0 con 0x7f72bc0fb440 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72ba7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72bc0fc710 0x7f72bc1123b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72ba7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72bc0fc710 0x7f72bc1123b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59710/0 (socket says 172.21.15.119:59710) 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72ba7fc640 1 -- 172.21.15.119:0/223395498 learned_addr learned my addr 172.21.15.119:0/223395498 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72baffd640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72bc0fb440 0x7f72bc10fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72ba7fc640 1 -- 172.21.15.119:0/223395498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72bc0fb440 msgr2=0x7f72bc10fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72ba7fc640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72bc0fb440 0x7f72bc10fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72ba7fc640 1 -- 172.21.15.119:0/223395498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0005040 con 0x7f72bc0fc710 2024-09-13T21:42:14.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72baffd640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72bc0fb440 0x7f72bc10fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72ba7fc640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72bc0fc710 0x7f72bc1123b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f72b0000c00 tx=0x7f72b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72a37fe640 1 -- 172.21.15.119:0/223395498 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b0038070 con 0x7f72bc0fc710 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72a37fe640 1 -- 172.21.15.119:0/223395498 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f72b002ae90 con 0x7f72bc0fc710 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72c15a0640 1 -- 172.21.15.119:0/223395498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc1129b0 con 0x7f72bc0fc710 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72a37fe640 1 -- 172.21.15.119:0/223395498 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b003d420 con 0x7f72bc0fc710 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.099+0000 7f72c15a0640 1 -- 172.21.15.119:0/223395498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc112e20 con 0x7f72bc0fc710 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.100+0000 7f72c15a0640 1 -- 172.21.15.119:0/223395498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72bc0fa8a0 con 0x7f72bc0fc710 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.101+0000 7f72a37fe640 1 -- 172.21.15.119:0/223395498 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f72b0030020 con 0x7f72bc0fc710 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.101+0000 7f72a37fe640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f72a406ed60 0x7f72a4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.101+0000 7f72a37fe640 1 -- 172.21.15.119:0/223395498 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f72b00ae910 con 0x7f72bc0fc710 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.101+0000 7f72baffd640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f72a406ed60 0x7f72a4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.102+0000 7f72baffd640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f72a406ed60 0x7f72a4071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f72ac006fd0 tx=0x7f72ac008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:14.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.106+0000 7f72a37fe640 1 -- 172.21.15.119:0/223395498 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f72b007ba30 con 0x7f72bc0fc710 2024-09-13T21:42:14.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.301+0000 7f72c15a0640 1 -- 172.21.15.119:0/223395498 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f72bc04b720 con 0x7f72bc0fc710 2024-09-13T21:42:14.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.301+0000 7f72a37fe640 1 -- 172.21.15.119:0/223395498 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f72b007b3d0 con 0x7f72bc0fc710 2024-09-13T21:42:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:e2 2024-09-13T21:42:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:42:14.303 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 2 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:42:10.349319+0000 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:42:14.304 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 0 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 1 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:in 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:up {} 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:42:14.305 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:42:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:42:14.306 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 0 2024-09-13T21:42:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:42:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:42:14.306 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 2 2024-09-13T21:42:14.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.304+0000 7f72c15a0640 1 -- 172.21.15.119:0/223395498 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f72a406ed60 msgr2=0x7f72a4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:14.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.304+0000 7f72c15a0640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f72a406ed60 0x7f72a4071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f72ac006fd0 tx=0x7f72ac008040 comp rx=0 tx=0).stop 2024-09-13T21:42:14.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.304+0000 7f72c15a0640 1 -- 172.21.15.119:0/223395498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72bc0fc710 msgr2=0x7f72bc1123b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:14.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.304+0000 7f72c15a0640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72bc0fc710 0x7f72bc1123b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f72b0000c00 tx=0x7f72b0009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:14.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.304+0000 7f72c15a0640 1 -- 172.21.15.119:0/223395498 shutdown_connections 2024-09-13T21:42:14.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.304+0000 7f72c15a0640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f72a406ed60 0x7f72a4071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:14.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.304+0000 7f72c15a0640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72bc0fc710 0x7f72bc1123b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:14.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.304+0000 7f72c15a0640 1 --2- 172.21.15.119:0/223395498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72bc0fb440 0x7f72bc10fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:14.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.304+0000 7f72c15a0640 1 -- 172.21.15.119:0/223395498 >> 172.21.15.119:0/223395498 conn(0x7f72bc0f6c20 msgr2=0x7f72bc0f8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:14.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.304+0000 7f72c15a0640 1 -- 172.21.15.119:0/223395498 shutdown_connections 2024-09-13T21:42:14.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:14.304+0000 7f72c15a0640 1 -- 172.21.15.119:0/223395498 wait complete. 2024-09-13T21:42:14.601 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:14 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/223395498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:42:14.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:14 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/223395498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:42:15.128 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:42:15.140 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:42:15.140 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-13T21:42:15.394 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:15.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:15 smithi155 ceph-mon[34732]: pgmap v173: 65 pgs: 17 creating+peering, 15 unknown, 33 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:15.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:15.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:15.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:15.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:15.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:15.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.yblkxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:42:15.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.yblkxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:42:15.496 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:15.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:15 smithi119 ceph-mon[27653]: pgmap v173: 65 pgs: 17 creating+peering, 15 unknown, 33 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:42:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.yblkxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:42:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.yblkxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:42:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:16.471 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:16 smithi119 ceph-mon[27653]: Deploying daemon mds.cephfs.smithi155.yblkxo on smithi155 2024-09-13T21:42:16.471 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:16 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.119:6826/1366726298,v1:172.21.15.119:6827/1366726298] up:boot 2024-09-13T21:42:16.471 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:16 smithi119 ceph-mon[27653]: daemon mds.cephfs.smithi119.rpmijj assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T21:42:16.472 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:16 smithi119 ceph-mon[27653]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T21:42:16.472 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:16 smithi119 ceph-mon[27653]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T21:42:16.472 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:16 smithi119 ceph-mon[27653]: Cluster is now healthy 2024-09-13T21:42:16.472 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:16 smithi119 ceph-mon[27653]: fsmap cephfs:0 1 up:standby 2024-09-13T21:42:16.472 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:16 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:42:16.473 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:16 smithi119 ceph-mon[27653]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:creating} 2024-09-13T21:42:16.473 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:16 smithi119 ceph-mon[27653]: daemon mds.cephfs.smithi119.rpmijj is now active in filesystem cephfs as rank 0 2024-09-13T21:42:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:16 smithi155 ceph-mon[34732]: Deploying daemon mds.cephfs.smithi155.yblkxo on smithi155 2024-09-13T21:42:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:16 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.119:6826/1366726298,v1:172.21.15.119:6827/1366726298] up:boot 2024-09-13T21:42:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:16 smithi155 ceph-mon[34732]: daemon mds.cephfs.smithi119.rpmijj assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T21:42:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:16 smithi155 ceph-mon[34732]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T21:42:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:16 smithi155 ceph-mon[34732]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T21:42:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:16 smithi155 ceph-mon[34732]: Cluster is now healthy 2024-09-13T21:42:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:16 smithi155 ceph-mon[34732]: fsmap cephfs:0 1 up:standby 2024-09-13T21:42:16.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:16 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:42:16.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:16 smithi155 ceph-mon[34732]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:creating} 2024-09-13T21:42:16.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:16 smithi155 ceph-mon[34732]: daemon mds.cephfs.smithi119.rpmijj is now active in filesystem cephfs as rank 0 2024-09-13T21:42:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.933+0000 7f0d193f5640 1 -- 172.21.15.119:0/234483936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140fb430 msgr2=0x7f0d140fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.933+0000 7f0d193f5640 1 --2- 172.21.15.119:0/234483936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140fb430 0x7f0d140fb840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0d04009c50 tx=0x7f0d04004d10 comp rx=0 tx=0).stop 2024-09-13T21:42:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.933+0000 7f0d193f5640 1 -- 172.21.15.119:0/234483936 shutdown_connections 2024-09-13T21:42:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.933+0000 7f0d193f5640 1 --2- 172.21.15.119:0/234483936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d140fc700 0x7f0d140fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.933+0000 7f0d193f5640 1 --2- 172.21.15.119:0/234483936 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140fb430 0x7f0d140fb840 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.933+0000 7f0d193f5640 1 -- 172.21.15.119:0/234483936 >> 172.21.15.119:0/234483936 conn(0x7f0d140f6c10 msgr2=0x7f0d140f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d193f5640 1 -- 172.21.15.119:0/234483936 shutdown_connections 2024-09-13T21:42:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d193f5640 1 -- 172.21.15.119:0/234483936 wait complete. 2024-09-13T21:42:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d193f5640 1 Processor -- start 2024-09-13T21:42:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d193f5640 1 -- start start 2024-09-13T21:42:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d193f5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d140fb430 0x7f0d1410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d193f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140fc700 0x7f0d141122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d193f5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14065c60 con 0x7f0d140fc700 2024-09-13T21:42:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d193f5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14065dd0 con 0x7f0d140fb430 2024-09-13T21:42:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d127fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140fc700 0x7f0d141122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d127fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140fc700 0x7f0d141122f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59750/0 (socket says 172.21.15.119:59750) 2024-09-13T21:42:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d127fc640 1 -- 172.21.15.119:0/3124129861 learned_addr learned my addr 172.21.15.119:0/3124129861 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.934+0000 7f0d12ffd640 1 --2- 172.21.15.119:0/3124129861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d140fb430 0x7f0d1410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.935+0000 7f0d127fc640 1 -- 172.21.15.119:0/3124129861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d140fb430 msgr2=0x7f0d1410fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.935+0000 7f0d127fc640 1 --2- 172.21.15.119:0/3124129861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d140fb430 0x7f0d1410fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.935+0000 7f0d127fc640 1 -- 172.21.15.119:0/3124129861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d040098b0 con 0x7f0d140fc700 2024-09-13T21:42:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.935+0000 7f0d127fc640 1 --2- 172.21.15.119:0/3124129861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140fc700 0x7f0d141122f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc002a50 tx=0x7f0cfc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.935+0000 7f0d0b7fe640 1 -- 172.21.15.119:0/3124129861 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cfc007c30 con 0x7f0d140fc700 2024-09-13T21:42:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.935+0000 7f0d0b7fe640 1 -- 172.21.15.119:0/3124129861 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0cfc00f040 con 0x7f0d140fc700 2024-09-13T21:42:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.935+0000 7f0d193f5640 1 -- 172.21.15.119:0/3124129861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d14112890 con 0x7f0d140fc700 2024-09-13T21:42:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.935+0000 7f0d0b7fe640 1 -- 172.21.15.119:0/3124129861 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cfc00db50 con 0x7f0d140fc700 2024-09-13T21:42:16.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.935+0000 7f0d193f5640 1 -- 172.21.15.119:0/3124129861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d14112e00 con 0x7f0d140fc700 2024-09-13T21:42:16.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.936+0000 7f0d193f5640 1 -- 172.21.15.119:0/3124129861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d140fa890 con 0x7f0d140fc700 2024-09-13T21:42:16.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.937+0000 7f0d0b7fe640 1 -- 172.21.15.119:0/3124129861 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f0cfc00dcb0 con 0x7f0d140fc700 2024-09-13T21:42:16.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.937+0000 7f0d0b7fe640 1 --2- 172.21.15.119:0/3124129861 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f0d0006ed60 0x7f0d00071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:16.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.937+0000 7f0d0b7fe640 1 -- 172.21.15.119:0/3124129861 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0cfc08df60 con 0x7f0d140fc700 2024-09-13T21:42:16.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.937+0000 7f0d12ffd640 1 --2- 172.21.15.119:0/3124129861 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f0d0006ed60 0x7f0d00071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:16.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.938+0000 7f0d12ffd640 1 --2- 172.21.15.119:0/3124129861 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f0d0006ed60 0x7f0d00071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d04000f80 tx=0x7f0d04004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:16.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:16.941+0000 7f0d0b7fe640 1 -- 172.21.15.119:0/3124129861 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0cfc05b100 con 0x7f0d140fc700 2024-09-13T21:42:17.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.130+0000 7f0d193f5640 1 -- 172.21.15.119:0/3124129861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f0d14103e30 con 0x7f0d140fc700 2024-09-13T21:42:17.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.381+0000 7f0d0b7fe640 1 -- 172.21.15.119:0/3124129861 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0cfc05aaa0 con 0x7f0d140fc700 2024-09-13T21:42:17.383 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:17 smithi119 ceph-mon[27653]: pgmap v174: 65 pgs: 5 creating+peering, 60 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 2 op/s 2024-09-13T21:42:17.383 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:17 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.119:6826/1366726298,v1:172.21.15.119:6827/1366726298] up:active 2024-09-13T21:42:17.383 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:17 smithi119 ceph-mon[27653]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:active} 2024-09-13T21:42:17.383 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:17 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3124129861' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T21:42:17.384 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:17.384 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:17.384 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:17.384 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.yydzwt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:42:17.384 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.yydzwt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:42:17.384 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:17 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:17.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.383+0000 7f0d193f5640 1 -- 172.21.15.119:0/3124129861 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f0d0006ed60 msgr2=0x7f0d00071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:17.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.383+0000 7f0d193f5640 1 --2- 172.21.15.119:0/3124129861 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f0d0006ed60 0x7f0d00071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d04000f80 tx=0x7f0d04004d10 comp rx=0 tx=0).stop 2024-09-13T21:42:17.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.383+0000 7f0d193f5640 1 -- 172.21.15.119:0/3124129861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140fc700 msgr2=0x7f0d141122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.383+0000 7f0d193f5640 1 --2- 172.21.15.119:0/3124129861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140fc700 0x7f0d141122f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc002a50 tx=0x7f0cfc004600 comp rx=0 tx=0).stop 2024-09-13T21:42:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.384+0000 7f0d193f5640 1 -- 172.21.15.119:0/3124129861 shutdown_connections 2024-09-13T21:42:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.384+0000 7f0d193f5640 1 --2- 172.21.15.119:0/3124129861 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f0d0006ed60 0x7f0d00071210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.384+0000 7f0d193f5640 1 --2- 172.21.15.119:0/3124129861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140fc700 0x7f0d141122f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.384+0000 7f0d193f5640 1 --2- 172.21.15.119:0/3124129861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d140fb430 0x7f0d1410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.384+0000 7f0d193f5640 1 -- 172.21.15.119:0/3124129861 >> 172.21.15.119:0/3124129861 conn(0x7f0d140f6c10 msgr2=0x7f0d140f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.384+0000 7f0d193f5640 1 -- 172.21.15.119:0/3124129861 shutdown_connections 2024-09-13T21:42:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:17.384+0000 7f0d193f5640 1 -- 172.21.15.119:0/3124129861 wait complete. 2024-09-13T21:42:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:17 smithi155 ceph-mon[34732]: pgmap v174: 65 pgs: 5 creating+peering, 60 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 2 op/s 2024-09-13T21:42:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:17 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.119:6826/1366726298,v1:172.21.15.119:6827/1366726298] up:active 2024-09-13T21:42:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:17 smithi155 ceph-mon[34732]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:active} 2024-09-13T21:42:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:17 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3124129861' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T21:42:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.yydzwt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:42:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.yydzwt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:42:17.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:17 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:17.992 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:42:18.002 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:42:18.002 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-13T21:42:18.500 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:18 smithi155 ceph-mon[34732]: Deploying daemon mds.cephfs.smithi119.yydzwt on smithi119 2024-09-13T21:42:18.501 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:18 smithi155 ceph-mon[34732]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T21:42:18.501 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:18 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] up:boot 2024-09-13T21:42:18.501 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:18 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3124129861' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T21:42:18.501 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:18 smithi155 ceph-mon[34732]: daemon mds.cephfs.smithi155.yblkxo assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T21:42:18.501 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:18 smithi155 ceph-mon[34732]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T21:42:18.501 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:18 smithi155 ceph-mon[34732]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T21:42:18.501 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:18 smithi155 ceph-mon[34732]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:active} 1 up:standby 2024-09-13T21:42:18.501 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:18 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:42:18.501 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:18 smithi155 ceph-mon[34732]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:creating} 2024-09-13T21:42:18.501 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:18 smithi155 ceph-mon[34732]: daemon mds.cephfs.smithi155.yblkxo is now active in filesystem cephfs as rank 1 2024-09-13T21:42:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:18 smithi119 ceph-mon[27653]: Deploying daemon mds.cephfs.smithi119.yydzwt on smithi119 2024-09-13T21:42:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:18 smithi119 ceph-mon[27653]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T21:42:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:18 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] up:boot 2024-09-13T21:42:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:18 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3124129861' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T21:42:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:18 smithi119 ceph-mon[27653]: daemon mds.cephfs.smithi155.yblkxo assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T21:42:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:18 smithi119 ceph-mon[27653]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T21:42:18.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:18 smithi119 ceph-mon[27653]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T21:42:18.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:18 smithi119 ceph-mon[27653]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:active} 1 up:standby 2024-09-13T21:42:18.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:18 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:42:18.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:18 smithi119 ceph-mon[27653]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:creating} 2024-09-13T21:42:18.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:18 smithi119 ceph-mon[27653]: daemon mds.cephfs.smithi155.yblkxo is now active in filesystem cephfs as rank 1 2024-09-13T21:42:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:19.444 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:19 smithi119 ceph-mon[27653]: pgmap v175: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 278 B/s wr, 2 op/s 2024-09-13T21:42:19.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:19 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] up:active 2024-09-13T21:42:19.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:19 smithi119 ceph-mon[27653]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 2024-09-13T21:42:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:19 smithi155 ceph-mon[34732]: pgmap v175: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 278 B/s wr, 2 op/s 2024-09-13T21:42:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:19 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] up:active 2024-09-13T21:42:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:19 smithi155 ceph-mon[34732]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 2024-09-13T21:42:20.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.965+0000 7f1c6ba66640 1 -- 172.21.15.119:0/915163542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c640ff680 msgr2=0x7f1c64101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:20.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.965+0000 7f1c6ba66640 1 --2- 172.21.15.119:0/915163542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c640ff680 0x7f1c64101a60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1c580048d0 tx=0x7f1c58009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:20.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.965+0000 7f1c6ba66640 1 -- 172.21.15.119:0/915163542 shutdown_connections 2024-09-13T21:42:20.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.965+0000 7f1c6ba66640 1 --2- 172.21.15.119:0/915163542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c640ff680 0x7f1c64101a60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:20.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.965+0000 7f1c6ba66640 1 --2- 172.21.15.119:0/915163542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c64065c40 0x7f1c640ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:20.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.965+0000 7f1c6ba66640 1 -- 172.21.15.119:0/915163542 >> 172.21.15.119:0/915163542 conn(0x7f1c640f6c10 msgr2=0x7f1c640f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:20.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.965+0000 7f1c6ba66640 1 -- 172.21.15.119:0/915163542 shutdown_connections 2024-09-13T21:42:20.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.965+0000 7f1c6ba66640 1 -- 172.21.15.119:0/915163542 wait complete. 2024-09-13T21:42:20.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c6ba66640 1 Processor -- start 2024-09-13T21:42:20.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c6ba66640 1 -- start start 2024-09-13T21:42:20.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c6ba66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c64065c40 0x7f1c640fcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:20.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c6ba66640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c640ff680 0x7f1c640fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:20.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c6ba66640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640fb5d0 con 0x7f1c64065c40 2024-09-13T21:42:20.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c6ba66640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640fb710 con 0x7f1c640ff680 2024-09-13T21:42:20.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c69802640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c64065c40 0x7f1c640fcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:20.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c69802640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c64065c40 0x7f1c640fcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59774/0 (socket says 172.21.15.119:59774) 2024-09-13T21:42:20.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c69802640 1 -- 172.21.15.119:0/2558160030 learned_addr learned my addr 172.21.15.119:0/2558160030 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:20.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c69001640 1 --2- 172.21.15.119:0/2558160030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c640ff680 0x7f1c640fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:20.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c69802640 1 -- 172.21.15.119:0/2558160030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c640ff680 msgr2=0x7f1c640fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:20.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c69802640 1 --2- 172.21.15.119:0/2558160030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c640ff680 0x7f1c640fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:20.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c69802640 1 -- 172.21.15.119:0/2558160030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58005040 con 0x7f1c64065c40 2024-09-13T21:42:20.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.966+0000 7f1c69802640 1 --2- 172.21.15.119:0/2558160030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c64065c40 0x7f1c640fcb50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400db00 tx=0x7f1c54004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:20.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.967+0000 7f1c627fc640 1 -- 172.21.15.119:0/2558160030 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c5400b910 con 0x7f1c64065c40 2024-09-13T21:42:20.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.967+0000 7f1c627fc640 1 -- 172.21.15.119:0/2558160030 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c5400f040 con 0x7f1c64065c40 2024-09-13T21:42:20.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.967+0000 7f1c6ba66640 1 -- 172.21.15.119:0/2558160030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c640fb9f0 con 0x7f1c64065c40 2024-09-13T21:42:20.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.967+0000 7f1c627fc640 1 -- 172.21.15.119:0/2558160030 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c54012390 con 0x7f1c64065c40 2024-09-13T21:42:20.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.967+0000 7f1c6ba66640 1 -- 172.21.15.119:0/2558160030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c641150c0 con 0x7f1c64065c40 2024-09-13T21:42:20.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.968+0000 7f1c6ba66640 1 -- 172.21.15.119:0/2558160030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c640fa890 con 0x7f1c64065c40 2024-09-13T21:42:20.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.968+0000 7f1c627fc640 1 -- 172.21.15.119:0/2558160030 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1c54013430 con 0x7f1c64065c40 2024-09-13T21:42:20.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.968+0000 7f1c627fc640 1 --2- 172.21.15.119:0/2558160030 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1c4c06ed60 0x7f1c4c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:20.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.969+0000 7f1c627fc640 1 -- 172.21.15.119:0/2558160030 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1c5408e740 con 0x7f1c64065c40 2024-09-13T21:42:20.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.969+0000 7f1c69001640 1 --2- 172.21.15.119:0/2558160030 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1c4c06ed60 0x7f1c4c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:20.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.969+0000 7f1c69001640 1 --2- 172.21.15.119:0/2558160030 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1c4c06ed60 0x7f1c4c071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1c58007ac0 tx=0x7f1c58035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:20.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:20.973+0000 7f1c627fc640 1 -- 172.21.15.119:0/2558160030 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1c5405b860 con 0x7f1c64065c40 2024-09-13T21:42:21.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.177+0000 7f1c6ba66640 1 -- 172.21.15.119:0/2558160030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1c6404b720 con 0x7f1c64065c40 2024-09-13T21:42:21.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.433+0000 7f1c627fc640 1 -- 172.21.15.119:0/2558160030 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1c5408e020 con 0x7f1c64065c40 2024-09-13T21:42:21.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.436+0000 7f1c6ba66640 1 -- 172.21.15.119:0/2558160030 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1c4c06ed60 msgr2=0x7f1c4c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:21.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.436+0000 7f1c6ba66640 1 --2- 172.21.15.119:0/2558160030 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1c4c06ed60 0x7f1c4c071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1c58007ac0 tx=0x7f1c58035040 comp rx=0 tx=0).stop 2024-09-13T21:42:21.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.436+0000 7f1c6ba66640 1 -- 172.21.15.119:0/2558160030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c64065c40 msgr2=0x7f1c640fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:21.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.436+0000 7f1c6ba66640 1 --2- 172.21.15.119:0/2558160030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c64065c40 0x7f1c640fcb50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400db00 tx=0x7f1c54004e30 comp rx=0 tx=0).stop 2024-09-13T21:42:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.436+0000 7f1c6ba66640 1 -- 172.21.15.119:0/2558160030 shutdown_connections 2024-09-13T21:42:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.436+0000 7f1c6ba66640 1 --2- 172.21.15.119:0/2558160030 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1c4c06ed60 0x7f1c4c071210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.436+0000 7f1c6ba66640 1 --2- 172.21.15.119:0/2558160030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c640ff680 0x7f1c640fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.436+0000 7f1c6ba66640 1 --2- 172.21.15.119:0/2558160030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c64065c40 0x7f1c640fcb50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.436+0000 7f1c6ba66640 1 -- 172.21.15.119:0/2558160030 >> 172.21.15.119:0/2558160030 conn(0x7f1c640f6c10 msgr2=0x7f1c640f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.436+0000 7f1c6ba66640 1 -- 172.21.15.119:0/2558160030 shutdown_connections 2024-09-13T21:42:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:21.436+0000 7f1c6ba66640 1 -- 172.21.15.119:0/2558160030 wait complete. 2024-09-13T21:42:21.522 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:21 smithi119 ceph-mon[27653]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 7 op/s 2024-09-13T21:42:21.522 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:21 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2558160030' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-13T21:42:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:21 smithi155 ceph-mon[34732]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 7 op/s 2024-09-13T21:42:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:21 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2558160030' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-13T21:42:22.409 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:42:22.419 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:42:22.420 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-13T21:42:22.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:22 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2558160030' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-13T21:42:22.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:22 smithi119 ceph-mon[27653]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 2024-09-13T21:42:22.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:22 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:22.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:22 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:22.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:22 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:22.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:22 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.afmavb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:42:22.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:22 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.afmavb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:42:22.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:22 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:22.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:22 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2558160030' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-13T21:42:22.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:22 smithi155 ceph-mon[34732]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 2024-09-13T21:42:22.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:22 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:22.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:22 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:22.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:22 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:22.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:22 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.afmavb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:42:22.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:22 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.afmavb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T21:42:22.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:22 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:22.679 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:23.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:23 smithi155 ceph-mon[34732]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-13T21:42:23.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:23 smithi155 ceph-mon[34732]: Deploying daemon mds.cephfs.smithi155.afmavb on smithi155 2024-09-13T21:42:23.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:23 smithi155 ceph-mon[34732]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T21:42:23.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:23 smithi155 ceph-mon[34732]: Cluster is now healthy 2024-09-13T21:42:23.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:23 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:boot 2024-09-13T21:42:23.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:23 smithi155 ceph-mon[34732]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 1 up:standby 2024-09-13T21:42:23.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:23 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:42:23.818 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:23 smithi119 ceph-mon[27653]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-13T21:42:23.878 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:23 smithi119 ceph-mon[27653]: Deploying daemon mds.cephfs.smithi155.afmavb on smithi155 2024-09-13T21:42:23.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:23 smithi119 ceph-mon[27653]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T21:42:23.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:23 smithi119 ceph-mon[27653]: Cluster is now healthy 2024-09-13T21:42:23.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:23 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:boot 2024-09-13T21:42:23.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:23 smithi119 ceph-mon[27653]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 1 up:standby 2024-09-13T21:42:23.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:23 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:42:24.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.325+0000 7f17c134e640 1 -- 172.21.15.119:0/288841605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17bc0ff740 msgr2=0x7f17bc101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:24.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.325+0000 7f17c134e640 1 --2- 172.21.15.119:0/288841605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17bc0ff740 0x7f17bc101b20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f17a40048d0 tx=0x7f17a4009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:24.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.325+0000 7f17c134e640 1 -- 172.21.15.119:0/288841605 shutdown_connections 2024-09-13T21:42:24.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.325+0000 7f17c134e640 1 --2- 172.21.15.119:0/288841605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17bc0ff740 0x7f17bc101b20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:24.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.325+0000 7f17c134e640 1 --2- 172.21.15.119:0/288841605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17bc065b80 0x7f17bc0ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:24.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.325+0000 7f17c134e640 1 -- 172.21.15.119:0/288841605 >> 172.21.15.119:0/288841605 conn(0x7f17bc0f6c10 msgr2=0x7f17bc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:24.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.326+0000 7f17c134e640 1 -- 172.21.15.119:0/288841605 shutdown_connections 2024-09-13T21:42:24.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.326+0000 7f17c134e640 1 -- 172.21.15.119:0/288841605 wait complete. 2024-09-13T21:42:24.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.326+0000 7f17c134e640 1 Processor -- start 2024-09-13T21:42:24.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.326+0000 7f17c134e640 1 -- start start 2024-09-13T21:42:24.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.326+0000 7f17c134e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17bc065b80 0x7f17bc10d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.326+0000 7f17c134e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17bc0ff740 0x7f17bc10d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.326+0000 7f17c134e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc10dc60 con 0x7f17bc065b80 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.326+0000 7f17c134e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc10e3c0 con 0x7f17bc0ff740 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.326+0000 7f17baffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17bc065b80 0x7f17bc10d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.326+0000 7f17baffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17bc065b80 0x7f17bc10d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41590/0 (socket says 172.21.15.119:41590) 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.326+0000 7f17baffd640 1 -- 172.21.15.119:0/544924414 learned_addr learned my addr 172.21.15.119:0/544924414 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.327+0000 7f17ba7fc640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17bc0ff740 0x7f17bc10d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.327+0000 7f17baffd640 1 -- 172.21.15.119:0/544924414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17bc0ff740 msgr2=0x7f17bc10d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.327+0000 7f17baffd640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17bc0ff740 0x7f17bc10d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.327+0000 7f17baffd640 1 -- 172.21.15.119:0/544924414 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4005040 con 0x7f17bc065b80 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.327+0000 7f17ba7fc640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17bc0ff740 0x7f17bc10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:42:24.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.327+0000 7f17baffd640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17bc065b80 0x7f17bc10d0d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00db00 tx=0x7f17ac004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.327+0000 7f17b37fe640 1 -- 172.21.15.119:0/544924414 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17ac00b910 con 0x7f17bc065b80 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.327+0000 7f17c134e640 1 -- 172.21.15.119:0/544924414 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17bc10e650 con 0x7f17bc065b80 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.327+0000 7f17b37fe640 1 -- 172.21.15.119:0/544924414 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f17ac00f040 con 0x7f17bc065b80 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.327+0000 7f17b37fe640 1 -- 172.21.15.119:0/544924414 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17ac012390 con 0x7f17bc065b80 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.327+0000 7f17c134e640 1 -- 172.21.15.119:0/544924414 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17bc10ebf0 con 0x7f17bc065b80 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.328+0000 7f17c134e640 1 -- 172.21.15.119:0/544924414 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17bc0fa890 con 0x7f17bc065b80 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.329+0000 7f17b37fe640 1 -- 172.21.15.119:0/544924414 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f17ac013430 con 0x7f17bc065b80 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.329+0000 7f17b37fe640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f17a806ed60 0x7f17a8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.329+0000 7f17b37fe640 1 -- 172.21.15.119:0/544924414 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f17ac08e740 con 0x7f17bc065b80 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.329+0000 7f17ba7fc640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f17a806ed60 0x7f17a8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.330+0000 7f17ba7fc640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f17a806ed60 0x7f17a8071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17a400b020 tx=0x7f17a4009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:24.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.333+0000 7f17b37fe640 1 -- 172.21.15.119:0/544924414 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f17ac05b860 con 0x7f17bc065b80 2024-09-13T21:42:24.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:24.542+0000 7f17c134e640 1 -- 172.21.15.119:0/544924414 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f17bc04b720 con 0x7f17bc065b80 2024-09-13T21:42:25.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.447+0000 7f17b37fe640 1 -- 172.21.15.119:0/544924414 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f17ac08e020 con 0x7f17bc065b80 2024-09-13T21:42:25.449 INFO:teuthology.orchestra.run.smithi119.stderr:inline data disabled 2024-09-13T21:42:25.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.449+0000 7f17c134e640 1 -- 172.21.15.119:0/544924414 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f17a806ed60 msgr2=0x7f17a8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:25.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.449+0000 7f17c134e640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f17a806ed60 0x7f17a8071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17a400b020 tx=0x7f17a4009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:25.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.449+0000 7f17c134e640 1 -- 172.21.15.119:0/544924414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17bc065b80 msgr2=0x7f17bc10d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:25.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.449+0000 7f17c134e640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17bc065b80 0x7f17bc10d0d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00db00 tx=0x7f17ac004e30 comp rx=0 tx=0).stop 2024-09-13T21:42:25.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.449+0000 7f17c134e640 1 -- 172.21.15.119:0/544924414 shutdown_connections 2024-09-13T21:42:25.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.449+0000 7f17c134e640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f17a806ed60 0x7f17a8071210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:25.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.449+0000 7f17c134e640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17bc0ff740 0x7f17bc10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:25.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.449+0000 7f17c134e640 1 --2- 172.21.15.119:0/544924414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17bc065b80 0x7f17bc10d0d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:25.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.449+0000 7f17c134e640 1 -- 172.21.15.119:0/544924414 >> 172.21.15.119:0/544924414 conn(0x7f17bc0f6c10 msgr2=0x7f17bc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:25.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.449+0000 7f17c134e640 1 -- 172.21.15.119:0/544924414 shutdown_connections 2024-09-13T21:42:25.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:25.450+0000 7f17c134e640 1 -- 172.21.15.119:0/544924414 wait complete. 2024-09-13T21:42:25.702 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-09-13T21:42:25.702 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:25.702 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:25.702 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:25.703 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:25.703 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:25.703 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] up:boot 2024-09-13T21:42:25.703 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:25.703 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:42:25.703 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:25.703 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/544924414' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-13T21:42:25.703 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:25 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:25.845 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-09-13T21:42:25.845 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:25.845 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:25.845 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:25.845 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:25.845 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:25.845 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] up:boot 2024-09-13T21:42:25.846 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:25.846 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:42:25.846 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:25.846 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/544924414' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-13T21:42:25.846 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:25 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:26.143 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:42:26.152 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:42:26.152 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T21:42:26.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:26 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/544924414' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-13T21:42:26.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:26 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] up:active 2024-09-13T21:42:26.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:26 smithi155 ceph-mon[34732]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:26.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:26 smithi155 ceph-mon[34732]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-13T21:42:26.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:26 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/544924414' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-13T21:42:26.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:26 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] up:active 2024-09-13T21:42:26.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:26 smithi119 ceph-mon[27653]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:26.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:26 smithi119 ceph-mon[27653]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-13T21:42:26.897 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:27 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:standby 2024-09-13T21:42:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:27 smithi119 ceph-mon[27653]: Dropping low affinity active daemon mds.cephfs.smithi119.rpmijj in favor of higher affinity standby. 2024-09-13T21:42:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:27 smithi119 ceph-mon[27653]: Replacing daemon mds.cephfs.smithi119.rpmijj as rank 0 with standby daemon mds.cephfs.smithi119.yydzwt 2024-09-13T21:42:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:27 smithi119 ceph-mon[27653]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T21:42:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:27 smithi119 ceph-mon[27653]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:27 smithi119 ceph-mon[27653]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T21:42:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:27 smithi119 ceph-mon[27653]: fsmap cephfs:2/2 {0=cephfs.smithi119.yydzwt=up:replay,1=cephfs.smithi155.yblkxo=up:active} 1 up:standby 2024-09-13T21:42:27.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:27 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:27.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:27 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:27 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:standby 2024-09-13T21:42:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:27 smithi155 ceph-mon[34732]: Dropping low affinity active daemon mds.cephfs.smithi119.rpmijj in favor of higher affinity standby. 2024-09-13T21:42:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:27 smithi155 ceph-mon[34732]: Replacing daemon mds.cephfs.smithi119.rpmijj as rank 0 with standby daemon mds.cephfs.smithi119.yydzwt 2024-09-13T21:42:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:27 smithi155 ceph-mon[34732]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T21:42:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:27 smithi155 ceph-mon[34732]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:27 smithi155 ceph-mon[34732]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T21:42:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:27 smithi155 ceph-mon[34732]: fsmap cephfs:2/2 {0=cephfs.smithi119.yydzwt=up:replay,1=cephfs.smithi155.yblkxo=up:active} 1 up:standby 2024-09-13T21:42:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:27 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:27.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:27 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:28.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:28 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:resolve 2024-09-13T21:42:28.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:28 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] up:boot 2024-09-13T21:42:28.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:28 smithi119 ceph-mon[27653]: fsmap cephfs:2/2 {0=cephfs.smithi119.yydzwt=up:resolve,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:28.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:28 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:42:28.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:28 smithi119 ceph-mon[27653]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-13T21:42:28.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:28 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:resolve 2024-09-13T21:42:28.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:28 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] up:boot 2024-09-13T21:42:28.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:28 smithi155 ceph-mon[34732]: fsmap cephfs:2/2 {0=cephfs.smithi119.yydzwt=up:resolve,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:28.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:28 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:42:28.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:28 smithi155 ceph-mon[34732]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-13T21:42:29.564 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:29 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:reconnect 2024-09-13T21:42:29.564 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:29 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] up:standby 2024-09-13T21:42:29.564 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:29 smithi119 ceph-mon[27653]: fsmap cephfs:2/2 {0=cephfs.smithi119.yydzwt=up:reconnect,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:29.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:29 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:reconnect 2024-09-13T21:42:29.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:29 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] up:standby 2024-09-13T21:42:29.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:29 smithi155 ceph-mon[34732]: fsmap cephfs:2/2 {0=cephfs.smithi119.yydzwt=up:reconnect,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.377+0000 7fa60de4d640 1 -- 172.21.15.119:0/1056269360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6080fd820 msgr2=0x7fa6080fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.377+0000 7fa60de4d640 1 --2- 172.21.15.119:0/1056269360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6080fd820 0x7fa6080fdc90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0048d0 tx=0x7fa5fc009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.377+0000 7fa60de4d640 1 -- 172.21.15.119:0/1056269360 shutdown_connections 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.377+0000 7fa60de4d640 1 --2- 172.21.15.119:0/1056269360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6080fd820 0x7fa6080fdc90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.377+0000 7fa60de4d640 1 --2- 172.21.15.119:0/1056269360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6080fc550 0x7fa6080fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.377+0000 7fa60de4d640 1 -- 172.21.15.119:0/1056269360 >> 172.21.15.119:0/1056269360 conn(0x7fa6080f7d30 msgr2=0x7fa6080fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.377+0000 7fa60de4d640 1 -- 172.21.15.119:0/1056269360 shutdown_connections 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.377+0000 7fa60de4d640 1 -- 172.21.15.119:0/1056269360 wait complete. 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa60de4d640 1 Processor -- start 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa60de4d640 1 -- start start 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa60de4d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6080fc550 0x7fa60810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa60de4d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6080fd820 0x7fa60810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa60de4d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60810dc20 con 0x7fa6080fc550 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa60de4d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60810e440 con 0x7fa6080fd820 2024-09-13T21:42:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa6077fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6080fc550 0x7fa60810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa6077fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6080fc550 0x7fa60810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41638/0 (socket says 172.21.15.119:41638) 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa6077fe640 1 -- 172.21.15.119:0/1666196051 learned_addr learned my addr 172.21.15.119:0/1666196051 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa6077fe640 1 -- 172.21.15.119:0/1666196051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6080fd820 msgr2=0x7fa60810d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa6077fe640 1 --2- 172.21.15.119:0/1666196051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6080fd820 0x7fa60810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa6077fe640 1 -- 172.21.15.119:0/1666196051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc005040 con 0x7fa6080fc550 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.378+0000 7fa6077fe640 1 --2- 172.21.15.119:0/1666196051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6080fc550 0x7fa60810d090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800c810 tx=0x7fa5f80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.379+0000 7fa5effff640 1 -- 172.21.15.119:0/1666196051 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f800a820 con 0x7fa6080fc550 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.379+0000 7fa60de4d640 1 -- 172.21.15.119:0/1666196051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60810e6d0 con 0x7fa6080fc550 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.379+0000 7fa5effff640 1 -- 172.21.15.119:0/1666196051 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa5f800ae20 con 0x7fa6080fc550 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.379+0000 7fa5effff640 1 -- 172.21.15.119:0/1666196051 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f80115c0 con 0x7fa6080fc550 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.379+0000 7fa60de4d640 1 -- 172.21.15.119:0/1666196051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60810ec70 con 0x7fa6080fc550 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.380+0000 7fa60de4d640 1 -- 172.21.15.119:0/1666196051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6080fb9b0 con 0x7fa6080fc550 2024-09-13T21:42:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.380+0000 7fa5effff640 1 -- 172.21.15.119:0/1666196051 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa5f8012840 con 0x7fa6080fc550 2024-09-13T21:42:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.381+0000 7fa5effff640 1 --2- 172.21.15.119:0/1666196051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa5f006ed60 0x7fa5f0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.381+0000 7fa606ffd640 1 --2- 172.21.15.119:0/1666196051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa5f006ed60 0x7fa5f0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.381+0000 7fa5effff640 1 -- 172.21.15.119:0/1666196051 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa5f808e780 con 0x7fa6080fc550 2024-09-13T21:42:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.381+0000 7fa606ffd640 1 --2- 172.21.15.119:0/1666196051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa5f006ed60 0x7fa5f0071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc02a530 tx=0x7fa5fc009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.385+0000 7fa5effff640 1 -- 172.21.15.119:0/1666196051 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa5f805b850 con 0x7fa6080fc550 2024-09-13T21:42:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.620+0000 7fa60de4d640 1 -- 172.21.15.119:0/1666196051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa608104f60 con 0x7fa6080fc550 2024-09-13T21:42:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.620+0000 7fa5effff640 1 -- 172.21.15.119:0/1666196051 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1820 (secure 0 0 0) 0x7fa5f8016070 con 0x7fa6080fc550 2024-09-13T21:42:30.623 INFO:teuthology.orchestra.run.smithi119.stdout:e18 2024-09-13T21:42:30.623 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:42:30.623 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 18 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:42:30.479212+0000 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:42:30.624 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:42:30.625 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:42:30.626 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:42:30.626 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:42:30.626 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:42:30.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:42:30.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:42:30.626 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:42:30.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:42:30.626 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:42:30.626 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:42:30.627 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 18 2024-09-13T21:42:30.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.622+0000 7fa60de4d640 1 -- 172.21.15.119:0/1666196051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa5f006ed60 msgr2=0x7fa5f0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:30.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.622+0000 7fa60de4d640 1 --2- 172.21.15.119:0/1666196051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa5f006ed60 0x7fa5f0071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc02a530 tx=0x7fa5fc009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:30.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.622+0000 7fa60de4d640 1 -- 172.21.15.119:0/1666196051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6080fc550 msgr2=0x7fa60810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:30.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.622+0000 7fa60de4d640 1 --2- 172.21.15.119:0/1666196051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6080fc550 0x7fa60810d090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800c810 tx=0x7fa5f80043c0 comp rx=0 tx=0).stop 2024-09-13T21:42:30.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.622+0000 7fa60de4d640 1 -- 172.21.15.119:0/1666196051 shutdown_connections 2024-09-13T21:42:30.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.622+0000 7fa60de4d640 1 --2- 172.21.15.119:0/1666196051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fa5f006ed60 0x7fa5f0071210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:30.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.622+0000 7fa60de4d640 1 --2- 172.21.15.119:0/1666196051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6080fd820 0x7fa60810d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:30.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.622+0000 7fa60de4d640 1 --2- 172.21.15.119:0/1666196051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6080fc550 0x7fa60810d090 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:30.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.622+0000 7fa60de4d640 1 -- 172.21.15.119:0/1666196051 >> 172.21.15.119:0/1666196051 conn(0x7fa6080f7d30 msgr2=0x7fa6080f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:30.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.622+0000 7fa60de4d640 1 -- 172.21.15.119:0/1666196051 shutdown_connections 2024-09-13T21:42:30.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:30.622+0000 7fa60de4d640 1 -- 172.21.15.119:0/1666196051 wait complete. 2024-09-13T21:42:30.635 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:30 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:rejoin 2024-09-13T21:42:30.635 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:30 smithi119 ceph-mon[27653]: fsmap cephfs:2/2 {0=cephfs.smithi119.yydzwt=up:rejoin,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:30.635 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:30 smithi119 ceph-mon[27653]: daemon mds.cephfs.smithi119.yydzwt is now active in filesystem cephfs as rank 0 2024-09-13T21:42:30.635 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:30.635 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:30.635 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:30 smithi119 ceph-mon[27653]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1023 B/s wr, 3 op/s 2024-09-13T21:42:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:30 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:rejoin 2024-09-13T21:42:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:30 smithi155 ceph-mon[34732]: fsmap cephfs:2/2 {0=cephfs.smithi119.yydzwt=up:rejoin,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:30 smithi155 ceph-mon[34732]: daemon mds.cephfs.smithi119.yydzwt is now active in filesystem cephfs as rank 0 2024-09-13T21:42:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:30 smithi155 ceph-mon[34732]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1023 B/s wr, 3 op/s 2024-09-13T21:42:31.454 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-13T21:42:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:31 smithi155 ceph-mon[34732]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T21:42:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:31 smithi155 ceph-mon[34732]: Cluster is now healthy 2024-09-13T21:42:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:31 smithi155 ceph-mon[34732]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:active 2024-09-13T21:42:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:31 smithi155 ceph-mon[34732]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:31 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:31 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:31.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:31 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:31.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:31 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:31.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:31 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:31.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:31 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1666196051' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:42:31.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:31 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:31.756 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:31 smithi119 ceph-mon[27653]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T21:42:31.756 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:31 smithi119 ceph-mon[27653]: Cluster is now healthy 2024-09-13T21:42:31.756 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:31 smithi119 ceph-mon[27653]: mds.? [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] up:active 2024-09-13T21:42:31.756 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:31 smithi119 ceph-mon[27653]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:42:31.756 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:31.757 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:31.757 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:31.757 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:31.757 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:31.757 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:31 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1666196051' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:42:31.757 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:31 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:42:32.122 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:32.581 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:32 smithi119 ceph-mon[27653]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T21:42:32.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:32 smithi155 ceph-mon[34732]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T21:42:33.732 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:33.732 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:34.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:34.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:34.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.169+0000 7f146f969640 1 -- 172.21.15.119:0/3340044223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14680fd820 msgr2=0x7f14680fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:34.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.169+0000 7f146f969640 1 --2- 172.21.15.119:0/3340044223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14680fd820 0x7f14680fdc90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f14580048d0 tx=0x7f1458009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:34.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.169+0000 7f146f969640 1 -- 172.21.15.119:0/3340044223 shutdown_connections 2024-09-13T21:42:34.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.169+0000 7f146f969640 1 --2- 172.21.15.119:0/3340044223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14680fd820 0x7f14680fdc90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:34.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.169+0000 7f146f969640 1 --2- 172.21.15.119:0/3340044223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14680fc550 0x7f14680fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:34.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.169+0000 7f146f969640 1 -- 172.21.15.119:0/3340044223 >> 172.21.15.119:0/3340044223 conn(0x7f14680f7d30 msgr2=0x7f14680fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:34.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.169+0000 7f146f969640 1 -- 172.21.15.119:0/3340044223 shutdown_connections 2024-09-13T21:42:34.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.169+0000 7f146f969640 1 -- 172.21.15.119:0/3340044223 wait complete. 2024-09-13T21:42:34.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.170+0000 7f146f969640 1 Processor -- start 2024-09-13T21:42:34.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.170+0000 7f146f969640 1 -- start start 2024-09-13T21:42:34.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.170+0000 7f146f969640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14680fc550 0x7f146810d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:34.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.170+0000 7f146f969640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14680fd820 0x7f146810d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:34.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.170+0000 7f146f969640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146810e490 con 0x7f14680fc550 2024-09-13T21:42:34.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.170+0000 7f146f969640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146810e600 con 0x7f14680fd820 2024-09-13T21:42:34.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.170+0000 7f146d705640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14680fc550 0x7f146810d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:34.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.170+0000 7f146d705640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14680fc550 0x7f146810d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38302/0 (socket says 172.21.15.119:38302) 2024-09-13T21:42:34.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.170+0000 7f146d705640 1 -- 172.21.15.119:0/1702556432 learned_addr learned my addr 172.21.15.119:0/1702556432 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:34.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.171+0000 7f146cf04640 1 --2- 172.21.15.119:0/1702556432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14680fd820 0x7f146810d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:34.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.171+0000 7f146d705640 1 -- 172.21.15.119:0/1702556432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14680fd820 msgr2=0x7f146810d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:34.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.171+0000 7f146d705640 1 --2- 172.21.15.119:0/1702556432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14680fd820 0x7f146810d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:34.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.171+0000 7f146d705640 1 -- 172.21.15.119:0/1702556432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1458005040 con 0x7f14680fc550 2024-09-13T21:42:34.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.171+0000 7f146d705640 1 --2- 172.21.15.119:0/1702556432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14680fc550 0x7f146810d0e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f146400b790 tx=0x7f14640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:34.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.171+0000 7f145dffb640 1 -- 172.21.15.119:0/1702556432 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f146400c700 con 0x7f14680fc550 2024-09-13T21:42:34.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.171+0000 7f145dffb640 1 -- 172.21.15.119:0/1702556432 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f146400cd00 con 0x7f14680fc550 2024-09-13T21:42:34.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.171+0000 7f146f969640 1 -- 172.21.15.119:0/1702556432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146810e8e0 con 0x7f14680fc550 2024-09-13T21:42:34.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.171+0000 7f145dffb640 1 -- 172.21.15.119:0/1702556432 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1464015e80 con 0x7f14680fc550 2024-09-13T21:42:34.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.171+0000 7f146f969640 1 -- 172.21.15.119:0/1702556432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146810ee00 con 0x7f14680fc550 2024-09-13T21:42:34.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.173+0000 7f146f969640 1 -- 172.21.15.119:0/1702556432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14681057e0 con 0x7f14680fc550 2024-09-13T21:42:34.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.173+0000 7f145dffb640 1 -- 172.21.15.119:0/1702556432 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1464012070 con 0x7f14680fc550 2024-09-13T21:42:34.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.173+0000 7f145dffb640 1 --2- 172.21.15.119:0/1702556432 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f145406ed60 0x7f1454071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:34.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.173+0000 7f145dffb640 1 -- 172.21.15.119:0/1702556432 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f146408da30 con 0x7f14680fc550 2024-09-13T21:42:34.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.173+0000 7f146cf04640 1 --2- 172.21.15.119:0/1702556432 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f145406ed60 0x7f1454071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:34.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.174+0000 7f146cf04640 1 --2- 172.21.15.119:0/1702556432 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f145406ed60 0x7f1454071210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f146810ce90 tx=0x7f1458035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:34.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.178+0000 7f145dffb640 1 -- 172.21.15.119:0/1702556432 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f146405ab00 con 0x7f14680fc550 2024-09-13T21:42:34.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.376+0000 7f146f969640 1 -- 172.21.15.119:0/1702556432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14680fb9b0 con 0x7f14680fc550 2024-09-13T21:42:34.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.377+0000 7f145dffb640 1 -- 172.21.15.119:0/1702556432 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f146405a4a0 con 0x7f14680fc550 2024-09-13T21:42:34.380 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 18 2024-09-13T21:42:34.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.379+0000 7f146f969640 1 -- 172.21.15.119:0/1702556432 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f145406ed60 msgr2=0x7f1454071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.379+0000 7f146f969640 1 --2- 172.21.15.119:0/1702556432 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f145406ed60 0x7f1454071210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f146810ce90 tx=0x7f1458035040 comp rx=0 tx=0).stop 2024-09-13T21:42:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.379+0000 7f146f969640 1 -- 172.21.15.119:0/1702556432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14680fc550 msgr2=0x7f146810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.379+0000 7f146f969640 1 --2- 172.21.15.119:0/1702556432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14680fc550 0x7f146810d0e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f146400b790 tx=0x7f14640091d0 comp rx=0 tx=0).stop 2024-09-13T21:42:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.379+0000 7f146f969640 1 -- 172.21.15.119:0/1702556432 shutdown_connections 2024-09-13T21:42:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.380+0000 7f146f969640 1 --2- 172.21.15.119:0/1702556432 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f145406ed60 0x7f1454071210 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.380+0000 7f146f969640 1 --2- 172.21.15.119:0/1702556432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14680fd820 0x7f146810d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.380+0000 7f146f969640 1 --2- 172.21.15.119:0/1702556432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14680fc550 0x7f146810d0e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.380+0000 7f146f969640 1 -- 172.21.15.119:0/1702556432 >> 172.21.15.119:0/1702556432 conn(0x7f14680f7d30 msgr2=0x7f14680f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.380+0000 7f146f969640 1 -- 172.21.15.119:0/1702556432 shutdown_connections 2024-09-13T21:42:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:34.380+0000 7f146f969640 1 -- 172.21.15.119:0/1702556432 wait complete. 2024-09-13T21:42:34.391 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:42:35.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:34 smithi155 ceph-mon[34732]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:42:35.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:34 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1702556432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:42:35.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:34 smithi119 ceph-mon[27653]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:42:35.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:34 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1702556432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:42:36.085 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-13T21:42:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:37.043 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:36 smithi119 ceph-mon[27653]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:42:37.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:36 smithi155 ceph-mon[34732]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:42:38.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.375+0000 7ff2ca37e640 1 -- 172.21.15.119:0/1638122991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c40fc550 msgr2=0x7ff2c40fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:38.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.375+0000 7ff2ca37e640 1 --2- 172.21.15.119:0/1638122991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c40fc550 0x7ff2c40fc960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40048d0 tx=0x7ff2b4009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:38.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.375+0000 7ff2ca37e640 1 -- 172.21.15.119:0/1638122991 shutdown_connections 2024-09-13T21:42:38.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.375+0000 7ff2ca37e640 1 --2- 172.21.15.119:0/1638122991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2c40fd820 0x7ff2c40fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:38.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.375+0000 7ff2ca37e640 1 --2- 172.21.15.119:0/1638122991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c40fc550 0x7ff2c40fc960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:38.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.375+0000 7ff2ca37e640 1 -- 172.21.15.119:0/1638122991 >> 172.21.15.119:0/1638122991 conn(0x7ff2c40f7d30 msgr2=0x7ff2c40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:38.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.375+0000 7ff2ca37e640 1 -- 172.21.15.119:0/1638122991 shutdown_connections 2024-09-13T21:42:38.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.375+0000 7ff2ca37e640 1 -- 172.21.15.119:0/1638122991 wait complete. 2024-09-13T21:42:38.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.375+0000 7ff2ca37e640 1 Processor -- start 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2ca37e640 1 -- start start 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2ca37e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c40fc550 0x7ff2c4071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2ca37e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2c40fd820 0x7ff2c406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2ca37e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4070080 con 0x7ff2c40fc550 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2ca37e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40701c0 con 0x7ff2c40fd820 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2c3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c40fc550 0x7ff2c4071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2c3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c40fc550 0x7ff2c4071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38332/0 (socket says 172.21.15.119:38332) 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2c3fff640 1 -- 172.21.15.119:0/2454209930 learned_addr learned my addr 172.21.15.119:0/2454209930 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2c3fff640 1 -- 172.21.15.119:0/2454209930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2c40fd820 msgr2=0x7ff2c406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2c37fe640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2c40fd820 0x7ff2c406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2c3fff640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2c40fd820 0x7ff2c406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:38.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2c3fff640 1 -- 172.21.15.119:0/2454209930 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b4005040 con 0x7ff2c40fc550 2024-09-13T21:42:38.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2c37fe640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2c40fd820 0x7ff2c406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:42:38.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2c3fff640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c40fc550 0x7ff2c4071570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4003080 tx=0x7ff2b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:38.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.376+0000 7ff2c0ff9640 1 -- 172.21.15.119:0/2454209930 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2b4038070 con 0x7ff2c40fc550 2024-09-13T21:42:38.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.377+0000 7ff2ca37e640 1 -- 172.21.15.119:0/2454209930 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c4070440 con 0x7ff2c40fc550 2024-09-13T21:42:38.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.377+0000 7ff2c0ff9640 1 -- 172.21.15.119:0/2454209930 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff2b402abd0 con 0x7ff2c40fc550 2024-09-13T21:42:38.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.377+0000 7ff2c0ff9640 1 -- 172.21.15.119:0/2454209930 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2b403e670 con 0x7ff2c40fc550 2024-09-13T21:42:38.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.377+0000 7ff2ca37e640 1 -- 172.21.15.119:0/2454209930 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c4115180 con 0x7ff2c40fc550 2024-09-13T21:42:38.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.378+0000 7ff2ca37e640 1 -- 172.21.15.119:0/2454209930 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c40fb9b0 con 0x7ff2c40fc550 2024-09-13T21:42:38.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.378+0000 7ff2c0ff9640 1 -- 172.21.15.119:0/2454209930 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff2b4030020 con 0x7ff2c40fc550 2024-09-13T21:42:38.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.379+0000 7ff2c0ff9640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7ff2ac06ed60 0x7ff2ac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:38.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.379+0000 7ff2c0ff9640 1 -- 172.21.15.119:0/2454209930 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff2b40ae510 con 0x7ff2c40fc550 2024-09-13T21:42:38.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.379+0000 7ff2c37fe640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7ff2ac06ed60 0x7ff2ac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:38.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.379+0000 7ff2c37fe640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7ff2ac06ed60 0x7ff2ac071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8006fd0 tx=0x7ff2b8008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:38.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.383+0000 7ff2c0ff9640 1 -- 172.21.15.119:0/2454209930 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff2b407b660 con 0x7ff2c40fc550 2024-09-13T21:42:38.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.631+0000 7ff2ca37e640 1 -- 172.21.15.119:0/2454209930 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7ff2c404b720 con 0x7ff2c40fc550 2024-09-13T21:42:38.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.631+0000 7ff2c0ff9640 1 -- 172.21.15.119:0/2454209930 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v18) v1 ==== 78+0+100 (secure 0 0 0) 0x7ff2b407b000 con 0x7ff2c40fc550 2024-09-13T21:42:38.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.633+0000 7ff2ca37e640 1 -- 172.21.15.119:0/2454209930 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7ff2ac06ed60 msgr2=0x7ff2ac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:38.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.633+0000 7ff2ca37e640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7ff2ac06ed60 0x7ff2ac071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8006fd0 tx=0x7ff2b8008040 comp rx=0 tx=0).stop 2024-09-13T21:42:38.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.633+0000 7ff2ca37e640 1 -- 172.21.15.119:0/2454209930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c40fc550 msgr2=0x7ff2c4071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:38.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.633+0000 7ff2ca37e640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c40fc550 0x7ff2c4071570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4003080 tx=0x7ff2b4009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:38.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.633+0000 7ff2ca37e640 1 -- 172.21.15.119:0/2454209930 shutdown_connections 2024-09-13T21:42:38.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.633+0000 7ff2ca37e640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7ff2ac06ed60 0x7ff2ac071210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:38.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.633+0000 7ff2ca37e640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2c40fd820 0x7ff2c406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:38.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.633+0000 7ff2ca37e640 1 --2- 172.21.15.119:0/2454209930 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2c40fc550 0x7ff2c4071570 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:38.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.633+0000 7ff2ca37e640 1 -- 172.21.15.119:0/2454209930 >> 172.21.15.119:0/2454209930 conn(0x7ff2c40f7d30 msgr2=0x7ff2c40f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:38.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.634+0000 7ff2ca37e640 1 -- 172.21.15.119:0/2454209930 shutdown_connections 2024-09-13T21:42:38.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:38.634+0000 7ff2ca37e640 1 -- 172.21.15.119:0/2454209930 wait complete. 2024-09-13T21:42:38.643 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:42:38.994 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:38 smithi119 ceph-mon[27653]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:42:38.995 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:38 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:38.995 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:38 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:38.995 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:38 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:38.995 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:38 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:38.995 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:38 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:38.995 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:38 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2454209930' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T21:42:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:38 smithi155 ceph-mon[34732]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:42:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:38 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:38 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:38 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:42:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:38 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:42:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:38 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:38 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2454209930' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T21:42:39.282 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-13T21:42:39.295 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T21:42:39.538 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:40.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:40 smithi119 ceph-mon[27653]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:42:41.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:40 smithi155 ceph-mon[34732]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:42:41.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 -- 172.21.15.119:0/3175565833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8498102530 msgr2=0x7f8498102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:41.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 --2- 172.21.15.119:0/3175565833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8498102530 0x7f8498102900 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f84940048d0 tx=0x7f8494009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 -- 172.21.15.119:0/3175565833 shutdown_connections 2024-09-13T21:42:41.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 --2- 172.21.15.119:0/3175565833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8498102ed0 0x7f84980fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 --2- 172.21.15.119:0/3175565833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8498102530 0x7f8498102900 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 -- 172.21.15.119:0/3175565833 >> 172.21.15.119:0/3175565833 conn(0x7f84980f80f0 msgr2=0x7f84980fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:41.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 -- 172.21.15.119:0/3175565833 shutdown_connections 2024-09-13T21:42:41.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 -- 172.21.15.119:0/3175565833 wait complete. 2024-09-13T21:42:41.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 Processor -- start 2024-09-13T21:42:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 -- start start 2024-09-13T21:42:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8498102530 0x7f849806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8498102ed0 0x7f849806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498070490 con 0x7f8498102ed0 2024-09-13T21:42:41.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849fff7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498070600 con 0x7f8498102530 2024-09-13T21:42:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.092+0000 7f849d592640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8498102ed0 0x7f849806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.093+0000 7f849d592640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8498102ed0 0x7f849806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38344/0 (socket says 172.21.15.119:38344) 2024-09-13T21:42:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.093+0000 7f849d592640 1 -- 172.21.15.119:0/2279391212 learned_addr learned my addr 172.21.15.119:0/2279391212 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.093+0000 7f849d592640 1 -- 172.21.15.119:0/2279391212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8498102530 msgr2=0x7f849806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.093+0000 7f849d592640 1 --2- 172.21.15.119:0/2279391212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8498102530 0x7f849806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.093+0000 7f849d592640 1 -- 172.21.15.119:0/2279391212 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494005040 con 0x7f8498102ed0 2024-09-13T21:42:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.093+0000 7f849d592640 1 --2- 172.21.15.119:0/2279391212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8498102ed0 0x7f849806ff50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f848800c740 tx=0x7f84880043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.093+0000 7f848e7fc640 1 -- 172.21.15.119:0/2279391212 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8488012810 con 0x7f8498102ed0 2024-09-13T21:42:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.093+0000 7f848e7fc640 1 -- 172.21.15.119:0/2279391212 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8488012e10 con 0x7f8498102ed0 2024-09-13T21:42:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.093+0000 7f849fff7640 1 -- 172.21.15.119:0/2279391212 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8498070890 con 0x7f8498102ed0 2024-09-13T21:42:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.093+0000 7f848e7fc640 1 -- 172.21.15.119:0/2279391212 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f848800a370 con 0x7f8498102ed0 2024-09-13T21:42:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.093+0000 7f849fff7640 1 -- 172.21.15.119:0/2279391212 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8498119940 con 0x7f8498102ed0 2024-09-13T21:42:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.094+0000 7f849fff7640 1 -- 172.21.15.119:0/2279391212 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84980fdcb0 con 0x7f8498102ed0 2024-09-13T21:42:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.095+0000 7f848e7fc640 1 -- 172.21.15.119:0/2279391212 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8488011380 con 0x7f8498102ed0 2024-09-13T21:42:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.095+0000 7f848e7fc640 1 --2- 172.21.15.119:0/2279391212 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f848406ed60 0x7f8484071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.095+0000 7f848e7fc640 1 -- 172.21.15.119:0/2279391212 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f848808e680 con 0x7f8498102ed0 2024-09-13T21:42:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.095+0000 7f849dd93640 1 --2- 172.21.15.119:0/2279391212 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f848406ed60 0x7f8484071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:41.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.096+0000 7f849dd93640 1 --2- 172.21.15.119:0/2279391212 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f848406ed60 0x7f8484071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f84940043d0 tx=0x7f8494009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:41.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.099+0000 7f848e7fc640 1 -- 172.21.15.119:0/2279391212 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f848805b7d0 con 0x7f8498102ed0 2024-09-13T21:42:41.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.286+0000 7f849fff7640 1 -- 172.21.15.119:0/2279391212 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84980fbd30 con 0x7f8498102ed0 2024-09-13T21:42:41.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.286+0000 7f848e7fc640 1 -- 172.21.15.119:0/2279391212 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f8488001f00 con 0x7f8498102ed0 2024-09-13T21:42:41.288 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:42:41.288 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24283,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/1506378601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1506378601},{"type":"v1","addr":"172.21.15.119:6827","nonce":1506378601}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:42:30.479212+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14472,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi155.yblkxo","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6825/1473450727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1473450727},{"type":"v1","addr":"172.21.15.155:6825","nonce":1473450727}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-13T21:42:41.289 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 18 2024-09-13T21:42:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.289+0000 7f849fff7640 1 -- 172.21.15.119:0/2279391212 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f848406ed60 msgr2=0x7f8484071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.289+0000 7f849fff7640 1 --2- 172.21.15.119:0/2279391212 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f848406ed60 0x7f8484071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f84940043d0 tx=0x7f8494009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.289+0000 7f849fff7640 1 -- 172.21.15.119:0/2279391212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8498102ed0 msgr2=0x7f849806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.289+0000 7f849fff7640 1 --2- 172.21.15.119:0/2279391212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8498102ed0 0x7f849806ff50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f848800c740 tx=0x7f84880043c0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.289+0000 7f849fff7640 1 -- 172.21.15.119:0/2279391212 shutdown_connections 2024-09-13T21:42:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.289+0000 7f849fff7640 1 --2- 172.21.15.119:0/2279391212 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f848406ed60 0x7f8484071210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.289+0000 7f849fff7640 1 --2- 172.21.15.119:0/2279391212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8498102ed0 0x7f849806ff50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.289+0000 7f849fff7640 1 --2- 172.21.15.119:0/2279391212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8498102530 0x7f849806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.289+0000 7f849fff7640 1 -- 172.21.15.119:0/2279391212 >> 172.21.15.119:0/2279391212 conn(0x7f84980f80f0 msgr2=0x7f84980f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.289+0000 7f849fff7640 1 -- 172.21.15.119:0/2279391212 shutdown_connections 2024-09-13T21:42:41.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:41.289+0000 7f849fff7640 1 -- 172.21.15.119:0/2279391212 wait complete. 2024-09-13T21:42:41.963 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:41 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2279391212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:42:41.989 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 18} 2024-09-13T21:42:41.989 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T21:42:42.070 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T21:42:42.070 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-13T21:42:42.070 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T21:42:42.071 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T21:42:42.071 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T21:42:42.071 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-13T21:42:42.071 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T21:42:42.071 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T21:42:42.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:42.071 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-13T21:42:42.082 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:41 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2279391212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:42:42.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:42.089 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2024-09-13T21:42:42.158 INFO:teuthology.orchestra.run.smithi119.stderr:Cannot find device "ceph-brx" 2024-09-13T21:42:42.159 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:42:42.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:42.160 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-13T21:42:42.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:42.177 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-09-13T21:42:42.247 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-09-13T21:42:42.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:42:42.248 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T21:42:42.249 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T21:42:42.249 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T21:42:42.497 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:42.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:42 smithi119 ceph-mon[27653]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T21:42:43.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:42 smithi155 ceph-mon[34732]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T21:42:44.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.048+0000 7f8597469640 1 -- 172.21.15.119:0/23065605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8590102ed0 msgr2=0x7f85900fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:44.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.048+0000 7f8597469640 1 --2- 172.21.15.119:0/23065605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8590102ed0 0x7f85900fc590 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f85800048d0 tx=0x7f8580009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:44.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.048+0000 7f8597469640 1 -- 172.21.15.119:0/23065605 shutdown_connections 2024-09-13T21:42:44.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.048+0000 7f8597469640 1 --2- 172.21.15.119:0/23065605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8590102ed0 0x7f85900fc590 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:44.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.048+0000 7f8597469640 1 --2- 172.21.15.119:0/23065605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8590102530 0x7f8590102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:44.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.048+0000 7f8597469640 1 -- 172.21.15.119:0/23065605 >> 172.21.15.119:0/23065605 conn(0x7f85900f80f0 msgr2=0x7f85900fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:44.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.048+0000 7f8597469640 1 -- 172.21.15.119:0/23065605 shutdown_connections 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.048+0000 7f8597469640 1 -- 172.21.15.119:0/23065605 wait complete. 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.048+0000 7f8597469640 1 Processor -- start 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.048+0000 7f8597469640 1 -- start start 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.048+0000 7f8597469640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8590102530 0x7f85901131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8597469640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8590102ed0 0x7f8590113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8597469640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8590113d30 con 0x7f8590102ed0 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8597469640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859010d170 con 0x7f8590102530 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8594a04640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8590102ed0 0x7f8590113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8594a04640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8590102ed0 0x7f8590113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49054/0 (socket says 172.21.15.119:49054) 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8594a04640 1 -- 172.21.15.119:0/2977352345 learned_addr learned my addr 172.21.15.119:0/2977352345 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8595205640 1 --2- 172.21.15.119:0/2977352345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8590102530 0x7f85901131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8594a04640 1 -- 172.21.15.119:0/2977352345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8590102530 msgr2=0x7f85901131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:44.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8594a04640 1 --2- 172.21.15.119:0/2977352345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8590102530 0x7f85901131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:44.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8594a04640 1 -- 172.21.15.119:0/2977352345 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580005040 con 0x7f8590102ed0 2024-09-13T21:42:44.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8594a04640 1 --2- 172.21.15.119:0/2977352345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8590102ed0 0x7f8590113730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8580003080 tx=0x7f8580009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:44.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8585ffb640 1 -- 172.21.15.119:0/2977352345 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8580038070 con 0x7f8590102ed0 2024-09-13T21:42:44.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8597469640 1 -- 172.21.15.119:0/2977352345 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859010d3f0 con 0x7f8590102ed0 2024-09-13T21:42:44.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8585ffb640 1 -- 172.21.15.119:0/2977352345 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8580009760 con 0x7f8590102ed0 2024-09-13T21:42:44.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8585ffb640 1 -- 172.21.15.119:0/2977352345 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8580033420 con 0x7f8590102ed0 2024-09-13T21:42:44.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.049+0000 7f8597469640 1 -- 172.21.15.119:0/2977352345 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859010d8d0 con 0x7f8590102ed0 2024-09-13T21:42:44.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.051+0000 7f8597469640 1 -- 172.21.15.119:0/2977352345 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85900fdcb0 con 0x7f8590102ed0 2024-09-13T21:42:44.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.051+0000 7f8585ffb640 1 -- 172.21.15.119:0/2977352345 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8580030020 con 0x7f8590102ed0 2024-09-13T21:42:44.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.051+0000 7f8585ffb640 1 --2- 172.21.15.119:0/2977352345 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f857c06ed60 0x7f857c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:44.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.052+0000 7f8585ffb640 1 -- 172.21.15.119:0/2977352345 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f85800adf00 con 0x7f8590102ed0 2024-09-13T21:42:44.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.052+0000 7f8595205640 1 --2- 172.21.15.119:0/2977352345 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f857c06ed60 0x7f857c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:44.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.052+0000 7f8595205640 1 --2- 172.21.15.119:0/2977352345 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f857c06ed60 0x7f857c071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f858c0041d0 tx=0x7f858c009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:44.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.056+0000 7f8585ffb640 1 -- 172.21.15.119:0/2977352345 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f858007afd0 con 0x7f8590102ed0 2024-09-13T21:42:44.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.246+0000 7f8597469640 1 -- 172.21.15.119:0/2977352345 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f85901095f0 con 0x7f8590102ed0 2024-09-13T21:42:44.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.247+0000 7f8585ffb640 1 -- 172.21.15.119:0/2977352345 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7f858007a970 con 0x7f8590102ed0 2024-09-13T21:42:44.249 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T21:42:44.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.249+0000 7f8597469640 1 -- 172.21.15.119:0/2977352345 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f857c06ed60 msgr2=0x7f857c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:44.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.249+0000 7f8597469640 1 --2- 172.21.15.119:0/2977352345 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f857c06ed60 0x7f857c071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f858c0041d0 tx=0x7f858c009040 comp rx=0 tx=0).stop 2024-09-13T21:42:44.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.249+0000 7f8597469640 1 -- 172.21.15.119:0/2977352345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8590102ed0 msgr2=0x7f8590113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:44.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.249+0000 7f8597469640 1 --2- 172.21.15.119:0/2977352345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8590102ed0 0x7f8590113730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8580003080 tx=0x7f8580009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:44.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.249+0000 7f8597469640 1 -- 172.21.15.119:0/2977352345 shutdown_connections 2024-09-13T21:42:44.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.249+0000 7f8597469640 1 --2- 172.21.15.119:0/2977352345 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f857c06ed60 0x7f857c071210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:44.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.249+0000 7f8597469640 1 --2- 172.21.15.119:0/2977352345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8590102ed0 0x7f8590113730 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:44.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.249+0000 7f8597469640 1 --2- 172.21.15.119:0/2977352345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8590102530 0x7f85901131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:44.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.249+0000 7f8597469640 1 -- 172.21.15.119:0/2977352345 >> 172.21.15.119:0/2977352345 conn(0x7f85900f80f0 msgr2=0x7f85900f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:44.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.249+0000 7f8597469640 1 -- 172.21.15.119:0/2977352345 shutdown_connections 2024-09-13T21:42:44.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:44.249+0000 7f8597469640 1 -- 172.21.15.119:0/2977352345 wait complete. 2024-09-13T21:42:44.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:44 smithi119 ceph-mon[27653]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-13T21:42:44.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:44 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2977352345' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T21:42:44.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:44 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:44.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:44 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:44.924 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T21:42:44.924 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T21:42:44.924 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-09-13T21:42:44.924 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T21:42:44.924 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T21:42:44.924 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T21:42:44.924 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T21:42:44.924 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T21:42:44.924 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T21:42:44.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:44.925 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-09-13T21:42:44.941 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T21:42:44.941 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T21:42:44.941 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T21:42:44.941 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:42:44.941 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-09-13T21:42:44.941 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:42:44.941 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42305sec preferred_lft 42305sec 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link noprefixroute 2024-09-13T21:42:44.942 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:42:44.943 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T21:42:44.943 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:42:44.943 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T21:42:44.943 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2024-09-13T21:42:44.943 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2024-09-13T21:42:44.943 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2024-09-13T21:42:44.943 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T21:42:44.944 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T21:42:45.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:42:45.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:44 smithi155 ceph-mon[34732]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-13T21:42:45.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:44 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2977352345' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T21:42:45.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:44 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:42:45.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:44 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:42:45.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:45.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:45.146 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T21:42:45.171 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-09-13T21:42:45.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:45.173 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-09-13T21:42:45.247 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-09-13T21:42:45.247 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T21:42:45.247 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T21:42:45.247 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T21:42:45.248 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T21:42:45.248 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:42:45.248 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T21:42:45.248 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T21:42:45.248 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T21:42:45.248 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T21:42:45.248 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T21:42:45.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:42:45.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:45.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:45.569 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-09-13T21:42:45.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:45.585 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2024-09-13T21:42:45.641 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:42:45.641 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T21:42:45.641 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T21:42:45.641 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T21:42:45.641 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T21:42:45.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:42:45.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:45.758 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T21:42:45.759 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:42:45.759 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T21:42:45.759 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T21:42:45.759 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T21:42:45.759 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T21:42:45.759 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T21:42:45.759 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T21:42:45.759 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T21:42:45.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:42:45.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:45.881 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:42:45.882 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-09-13T21:42:45.882 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2024-09-13T21:42:45.882 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T21:42:45.882 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-09-13T21:42:45.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:42:45.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:45.958 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T21:42:45.958 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T21:42:45.958 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T21:42:45.973 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T21:42:45.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T21:42:45.973 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T21:42:46.029 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-09-13T21:42:46.094 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T21:42:46.151 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2024-09-13T21:42:46.151 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2024-09-13T21:42:46.151 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2024-09-13T21:42:46.151 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2024-09-13T21:42:46.151 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2024-09-13T21:42:46.151 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/selinux 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2024-09-13T21:42:46.152 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/3ed65192f79a3b4419adaf8ddab2421ef1803cb73f0ad82f40ba949a6f24911e/merged 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/78232d66a1c21e132fb16155ce86eb911980832888112512ed76cf50e0464972/merged 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/0 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T21:42:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/102c53988c8cff44eeb44ff61df0dec0eafc850bf926e9a3413121b7adf8a153/merged 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/1a35f141e4d8c7ec545b210de6c248b684862599e6304c6d3b91f97b1ee8eadd/merged 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/aea3e89f1b18b400657718e0c5777cbfbc688e676bbabee53ac62714a4d446b1/merged 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/77becaca071d36ca65168d1ba1c5f17e332755a2156bd7e87c89026edc900657/merged 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/34842ff9a3c00d2a4ea559b80c8c10082337737a0c799ba9c288fdef9a8c2ea6/merged 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/22ce4b0b3528a5fe1ae90fe74cb048ab0c01fa218155536ba308485475fe2240/merged 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/26c22c5bbf3cfa256d9edfb5ba5cd0ca3bd25a06589e27fcaca5b9366992212b/merged 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/4d4695b8e66c058f1e2309efdfe3ee3cb0472ad93833b3d2cf62e66c466c4884/merged 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/15a72899934717ce864b5038c8620dcbbee9c377041313e67d505b0acd495f17/merged 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/2087e9d75c931ac0e12bf62dfd8630f504d7790cdee6eaed61de77ef6a101818/merged 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T21:42:46.154 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T21:42:46.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:46.155 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-09-13T21:42:46.206 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T21:42:46.207 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T21:42:46.248 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-09-13T21:42:46.272 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T21:42:46.329 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2024-09-13T21:42:46.329 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2024-09-13T21:42:46.329 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2024-09-13T21:42:46.329 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2024-09-13T21:42:46.329 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2024-09-13T21:42:46.329 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2024-09-13T21:42:46.329 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/selinux 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2024-09-13T21:42:46.330 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/3ed65192f79a3b4419adaf8ddab2421ef1803cb73f0ad82f40ba949a6f24911e/merged 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/78232d66a1c21e132fb16155ce86eb911980832888112512ed76cf50e0464972/merged 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/0 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/102c53988c8cff44eeb44ff61df0dec0eafc850bf926e9a3413121b7adf8a153/merged 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/1a35f141e4d8c7ec545b210de6c248b684862599e6304c6d3b91f97b1ee8eadd/merged 2024-09-13T21:42:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/aea3e89f1b18b400657718e0c5777cbfbc688e676bbabee53ac62714a4d446b1/merged 2024-09-13T21:42:46.332 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/77becaca071d36ca65168d1ba1c5f17e332755a2156bd7e87c89026edc900657/merged 2024-09-13T21:42:46.332 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/34842ff9a3c00d2a4ea559b80c8c10082337737a0c799ba9c288fdef9a8c2ea6/merged 2024-09-13T21:42:46.332 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/22ce4b0b3528a5fe1ae90fe74cb048ab0c01fa218155536ba308485475fe2240/merged 2024-09-13T21:42:46.332 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/26c22c5bbf3cfa256d9edfb5ba5cd0ca3bd25a06589e27fcaca5b9366992212b/merged 2024-09-13T21:42:46.332 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/4d4695b8e66c058f1e2309efdfe3ee3cb0472ad93833b3d2cf62e66c466c4884/merged 2024-09-13T21:42:46.332 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/15a72899934717ce864b5038c8620dcbbee9c377041313e67d505b0acd495f17/merged 2024-09-13T21:42:46.332 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/containers/storage/overlay/2087e9d75c931ac0e12bf62dfd8630f504d7790cdee6eaed61de77ef6a101818/merged 2024-09-13T21:42:46.332 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2024-09-13T21:42:46.332 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T21:42:46.332 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T21:42:46.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:46.333 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-09-13T21:42:46.358 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2024-09-13T21:42:46.356+0000 7f71d9cc8300 -1 init, newargv = 0x5572736d54f0 newargc=15 2024-09-13T21:42:46.358 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[74127]: starting ceph client 2024-09-13T21:42:46.365 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[74127]: starting fuse 2024-09-13T21:42:46.375 INFO:teuthology.orchestra.run.smithi119.stdout:122 2024-09-13T21:42:46.376 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [122] 2024-09-13T21:42:46.376 DEBUG:teuthology.orchestra.run.smithi119:> sudo stdin-killer -- python3 -c ' 2024-09-13T21:42:46.376 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2024-09-13T21:42:46.376 DEBUG:teuthology.orchestra.run.smithi119:> import re 2024-09-13T21:42:46.376 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-09-13T21:42:46.376 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2024-09-13T21:42:46.376 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T21:42:46.376 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2024-09-13T21:42:46.377 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2024-09-13T21:42:46.378 DEBUG:teuthology.orchestra.run.smithi119:> return f 2024-09-13T21:42:46.378 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T21:42:46.378 DEBUG:teuthology.orchestra.run.smithi119:> 2024-09-13T21:42:46.378 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2024-09-13T21:42:46.378 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-09-13T21:42:46.493 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.74127.asok 2024-09-13T21:42:46.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:46.503 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.74127.asok 2024-09-13T21:42:46.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:46.504 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.74127.asok status 2024-09-13T21:42:46.632 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:42:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2024-09-13T21:42:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b", 2024-09-13T21:42:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)", 2024-09-13T21:42:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2024-09-13T21:42:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2024-09-13T21:42:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T21:42:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "74127", 2024-09-13T21:42:46.632 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 14506, 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 14506 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3612892378 2024-09-13T21:42:46.633 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3612892378 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.14506 192.168.0.1:0/3612892378", 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/3612892378", 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 18, 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 44, 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2024-09-13T21:42:46.634 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2024-09-13T21:42:46.635 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2024-09-13T21:42:46.635 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:42:46.640 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T21:42:46.640 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T21:42:46.883 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:47.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:46 smithi155 ceph-mon[34732]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-09-13T21:42:47.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:46 smithi119 ceph-mon[27653]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-09-13T21:42:48.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 -- 172.21.15.119:0/3419256097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ac0fb480 msgr2=0x7f27ac0fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:48.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 --2- 172.21.15.119:0/3419256097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ac0fb480 0x7f27ac0fb8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f27940048d0 tx=0x7f2794009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:48.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 -- 172.21.15.119:0/3419256097 shutdown_connections 2024-09-13T21:42:48.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 --2- 172.21.15.119:0/3419256097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ac0fb480 0x7f27ac0fb8f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:48.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 --2- 172.21.15.119:0/3419256097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27ac1014c0 0x7f27ac101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:48.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 -- 172.21.15.119:0/3419256097 >> 172.21.15.119:0/3419256097 conn(0x7f27ac0f7000 msgr2=0x7f27ac0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:48.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 -- 172.21.15.119:0/3419256097 shutdown_connections 2024-09-13T21:42:48.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 -- 172.21.15.119:0/3419256097 wait complete. 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 Processor -- start 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 -- start start 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ac0fb480 0x7f27ac112150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27ac1014c0 0x7f27ac112690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac112d20 con 0x7f27ac0fb480 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.462+0000 7f27b2784640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac10c0d0 con 0x7f27ac1014c0 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ac0fb480 0x7f27ac112150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27abfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ac0fb480 0x7f27ac112150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49074/0 (socket says 172.21.15.119:49074) 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27abfff640 1 -- 172.21.15.119:0/1233086874 learned_addr learned my addr 172.21.15.119:0/1233086874 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27a3fff640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27ac1014c0 0x7f27ac112690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27abfff640 1 -- 172.21.15.119:0/1233086874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27ac1014c0 msgr2=0x7f27ac112690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27abfff640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27ac1014c0 0x7f27ac112690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:48.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27abfff640 1 -- 172.21.15.119:0/1233086874 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2794005040 con 0x7f27ac0fb480 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27a3fff640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27ac1014c0 0x7f27ac112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27abfff640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ac0fb480 0x7f27ac112150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f279c00b790 tx=0x7f279c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27a97fa640 1 -- 172.21.15.119:0/1233086874 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f279c00c700 con 0x7f27ac0fb480 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27a97fa640 1 -- 172.21.15.119:0/1233086874 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f279c00cd00 con 0x7f27ac0fb480 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27b2784640 1 -- 172.21.15.119:0/1233086874 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ac10c3b0 con 0x7f27ac0fb480 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27a97fa640 1 -- 172.21.15.119:0/1233086874 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f279c015e70 con 0x7f27ac0fb480 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.463+0000 7f27b2784640 1 -- 172.21.15.119:0/1233086874 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ac10c8d0 con 0x7f27ac0fb480 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.464+0000 7f27b2784640 1 -- 172.21.15.119:0/1233086874 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ac0fcbc0 con 0x7f27ac0fb480 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.465+0000 7f27a97fa640 1 -- 172.21.15.119:0/1233086874 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f279c012070 con 0x7f27ac0fb480 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.465+0000 7f27a97fa640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f279806ed60 0x7f2798071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.465+0000 7f27a3fff640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f279806ed60 0x7f2798071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.465+0000 7f27a97fa640 1 -- 172.21.15.119:0/1233086874 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f279c08dd50 con 0x7f27ac0fb480 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.466+0000 7f27a3fff640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f279806ed60 0x7f2798071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f279400b020 tx=0x7f2794009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:48.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.469+0000 7f27a97fa640 1 -- 172.21.15.119:0/1233086874 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f279c05ae20 con 0x7f27ac0fb480 2024-09-13T21:42:48.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.663+0000 7f27b2784640 1 -- 172.21.15.119:0/1233086874 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27ac04b7b0 con 0x7f27ac0fb480 2024-09-13T21:42:48.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.664+0000 7f27a97fa640 1 -- 172.21.15.119:0/1233086874 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7f279c05a7c0 con 0x7f27ac0fb480 2024-09-13T21:42:48.665 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T21:42:48.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.665+0000 7f27b2784640 1 -- 172.21.15.119:0/1233086874 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f279806ed60 msgr2=0x7f2798071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:48.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.665+0000 7f27b2784640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f279806ed60 0x7f2798071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f279400b020 tx=0x7f2794009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:48.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.665+0000 7f27b2784640 1 -- 172.21.15.119:0/1233086874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ac0fb480 msgr2=0x7f27ac112150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:48.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.665+0000 7f27b2784640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ac0fb480 0x7f27ac112150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f279c00b790 tx=0x7f279c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:42:48.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.666+0000 7f27b2784640 1 -- 172.21.15.119:0/1233086874 shutdown_connections 2024-09-13T21:42:48.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.666+0000 7f27b2784640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f279806ed60 0x7f2798071210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:48.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.666+0000 7f27b2784640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27ac1014c0 0x7f27ac112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:48.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.666+0000 7f27b2784640 1 --2- 172.21.15.119:0/1233086874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27ac0fb480 0x7f27ac112150 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:48.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.666+0000 7f27b2784640 1 -- 172.21.15.119:0/1233086874 >> 172.21.15.119:0/1233086874 conn(0x7f27ac0f7000 msgr2=0x7f27ac0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:48.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.666+0000 7f27b2784640 1 -- 172.21.15.119:0/1233086874 shutdown_connections 2024-09-13T21:42:48.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:48.666+0000 7f27b2784640 1 -- 172.21.15.119:0/1233086874 wait complete. 2024-09-13T21:42:49.037 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:48 smithi119 ceph-mon[27653]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-13T21:42:49.037 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:48 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1233086874' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T21:42:49.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:48 smithi155 ceph-mon[34732]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-13T21:42:49.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:48 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1233086874' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T21:42:49.522 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T21:42:49.522 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T21:42:49.522 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-13T21:42:49.522 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T21:42:49.522 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T21:42:49.522 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T21:42:49.522 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T21:42:49.522 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T21:42:49.522 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T21:42:49.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:49.523 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-13T21:42:49.542 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T21:42:49.542 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T21:42:49.542 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T21:42:49.542 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-13T21:42:49.543 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T21:42:49.544 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42307sec preferred_lft 42307sec 2024-09-13T21:42:49.544 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link noprefixroute 2024-09-13T21:42:49.544 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-13T21:42:49.544 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T21:42:49.544 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:42:49.544 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-13T21:42:49.544 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2024-09-13T21:42:49.544 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2024-09-13T21:42:49.544 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2024-09-13T21:42:49.545 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T21:42:49.545 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-13T21:42:49.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:42:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:42:49.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:42:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:49.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:49.773 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T21:42:49.799 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-13T21:42:49.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:49.801 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-13T21:42:49.872 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-13T21:42:49.872 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T21:42:49.873 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T21:42:49.873 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T21:42:49.873 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T21:42:49.873 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:42:49.873 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-13T21:42:49.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T21:42:49.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T21:42:49.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T21:42:49.873 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-13T21:42:49.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:42:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:42:50.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:42:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:50.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:50.204 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-13T21:42:50.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:50.220 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-09-13T21:42:50.275 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:42:50.275 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-13T21:42:50.275 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T21:42:50.275 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T21:42:50.275 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-13T21:42:50.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:42:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:42:50.387 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:42:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:50.394 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T21:42:50.394 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:42:50.394 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-13T21:42:50.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T21:42:50.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T21:42:50.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T21:42:50.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T21:42:50.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T21:42:50.394 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-13T21:42:50.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:42:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:42:50.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:42:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:50.525 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T21:42:50.525 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-13T21:42:50.525 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-13T21:42:50.525 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T21:42:50.526 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-13T21:42:50.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:42:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T21:42:50.595 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:42:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:50.601 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T21:42:50.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T21:42:50.602 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T21:42:50.617 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T21:42:50.617 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T21:42:50.617 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T21:42:50.672 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-09-13T21:42:50.739 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T21:42:50.795 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-09-13T21:42:50.795 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-09-13T21:42:50.795 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-09-13T21:42:50.795 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-09-13T21:42:50.795 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-09-13T21:42:50.795 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/selinux 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-09-13T21:42:50.796 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/0 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/cd0b6d073182d23150c849a7ed78b1edf7cd0c5f093b502dc40500d90900be95/merged 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/16c41227bbfee3734d7203a7c686e17eca24403b4125e2c4ecbad21fe2831deb/merged 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/03fc85edd0f2e4bc11dc02cedd2519321111df47e24d95756eeb7b1ca2637475/merged 2024-09-13T21:42:50.797 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/40d7d04295d8723941e77c30ffd9614f869b69f8ce9bd0056cd0fb298821bfe5/merged 2024-09-13T21:42:50.798 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/10ee43865ccbef53ee0c685a37f3616706b754dac84d0e471ac390dcdc4183b7/merged 2024-09-13T21:42:50.798 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/faf752bccb464665882988739283b59d13bd73931fb3bee0203f71677d906dcb/merged 2024-09-13T21:42:50.798 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/f2cd7d4378ec1da6a8e2b44587541885803d8b40168f8fd960c7961041c84366/merged 2024-09-13T21:42:50.798 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/57c6f249654e51ccb53e3b89e7c2f184aaf497e0bc7d15d79a25a145756c64b7/merged 2024-09-13T21:42:50.798 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/e0e3d1797ce8e7aa5b15827123950e34f9ce1d05dc829d25539cca703004c192/merged 2024-09-13T21:42:50.798 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-09-13T21:42:50.798 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T21:42:50.798 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T21:42:50.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:50.798 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-09-13T21:42:50.850 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T21:42:50.850 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T21:42:50.893 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-09-13T21:42:50.917 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T21:42:50.974 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-09-13T21:42:50.974 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-09-13T21:42:50.974 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-09-13T21:42:50.974 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-09-13T21:42:50.974 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-09-13T21:42:50.974 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/selinux 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-09-13T21:42:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/0 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/cd0b6d073182d23150c849a7ed78b1edf7cd0c5f093b502dc40500d90900be95/merged 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/16c41227bbfee3734d7203a7c686e17eca24403b4125e2c4ecbad21fe2831deb/merged 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/03fc85edd0f2e4bc11dc02cedd2519321111df47e24d95756eeb7b1ca2637475/merged 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/40d7d04295d8723941e77c30ffd9614f869b69f8ce9bd0056cd0fb298821bfe5/merged 2024-09-13T21:42:50.976 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/10ee43865ccbef53ee0c685a37f3616706b754dac84d0e471ac390dcdc4183b7/merged 2024-09-13T21:42:50.977 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/faf752bccb464665882988739283b59d13bd73931fb3bee0203f71677d906dcb/merged 2024-09-13T21:42:50.977 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/f2cd7d4378ec1da6a8e2b44587541885803d8b40168f8fd960c7961041c84366/merged 2024-09-13T21:42:50.977 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/57c6f249654e51ccb53e3b89e7c2f184aaf497e0bc7d15d79a25a145756c64b7/merged 2024-09-13T21:42:50.977 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/containers/storage/overlay/e0e3d1797ce8e7aa5b15827123950e34f9ce1d05dc829d25539cca703004c192/merged 2024-09-13T21:42:50.977 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-09-13T21:42:50.977 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T21:42:50.977 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T21:42:50.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:50.977 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-09-13T21:42:50.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:2024-09-13T21:42:50.987+0000 7f34548d7300 -1 init, newargv = 0x559d96e85480 newargc=15 2024-09-13T21:42:50.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:ceph-fuse[59694]: starting ceph client 2024-09-13T21:42:50.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:ceph-fuse[59694]: starting fuse 2024-09-13T21:42:51.005 INFO:teuthology.orchestra.run.smithi155.stdout:117 2024-09-13T21:42:51.005 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [117] 2024-09-13T21:42:51.005 DEBUG:teuthology.orchestra.run.smithi155:> sudo stdin-killer -- python3 -c ' 2024-09-13T21:42:51.005 DEBUG:teuthology.orchestra.run.smithi155:> import glob 2024-09-13T21:42:51.005 DEBUG:teuthology.orchestra.run.smithi155:> import re 2024-09-13T21:42:51.005 DEBUG:teuthology.orchestra.run.smithi155:> import os 2024-09-13T21:42:51.005 DEBUG:teuthology.orchestra.run.smithi155:> import subprocess 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> def _find_admin_socket(client_name): 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> return files[0] 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> for f in files: 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T21:42:51.006 DEBUG:teuthology.orchestra.run.smithi155:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T21:42:51.007 DEBUG:teuthology.orchestra.run.smithi155:> contents = proc_f.read() 2024-09-13T21:42:51.007 DEBUG:teuthology.orchestra.run.smithi155:> if mountpoint in contents: 2024-09-13T21:42:51.007 DEBUG:teuthology.orchestra.run.smithi155:> return f 2024-09-13T21:42:51.007 DEBUG:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T21:42:51.007 DEBUG:teuthology.orchestra.run.smithi155:> 2024-09-13T21:42:51.007 DEBUG:teuthology.orchestra.run.smithi155:> print(_find_admin_socket("client.1")) 2024-09-13T21:42:51.007 DEBUG:teuthology.orchestra.run.smithi155:> ' 2024-09-13T21:42:51.066 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:50 smithi155 ceph-mon[34732]: pgmap v192: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T21:42:51.122 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.1.59694.asok 2024-09-13T21:42:51.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-13T21:42:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T21:42:51.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:50 smithi119 ceph-mon[27653]: pgmap v192: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T21:42:51.133 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.59694.asok 2024-09-13T21:42:51.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:51.133 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.59694.asok status 2024-09-13T21:42:51.263 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-13T21:42:51.263 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2024-09-13T21:42:51.263 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b", 2024-09-13T21:42:51.263 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)", 2024-09-13T21:42:51.263 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "1", 2024-09-13T21:42:51.263 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2024-09-13T21:42:51.263 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T21:42:51.263 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "59694", 2024-09-13T21:42:51.263 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2024-09-13T21:42:51.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-13T21:42:51.263 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 24295, 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 24295 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 1537294791 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-13T21:42:51.264 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 1537294791 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.24295 192.168.0.1:0/1537294791", 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "192.168.0.1:0/1537294791", 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 18, 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 44, 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: "blocklisted": false, 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs" 2024-09-13T21:42:51.265 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-13T21:42:51.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:51.271 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2024-09-13T21:42:51.271 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T21:42:51.288 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2024-09-13T21:42:51.289 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T21:42:51.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:51.289 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T21:42:51.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:51.358 DEBUG:teuthology.orchestra.run.smithi155:> stat --file-system '--printf=%T 2024-09-13T21:42:51.358 DEBUG:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T21:42:51.375 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2024-09-13T21:42:51.375 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T21:42:51.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:42:51.375 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T21:42:51.530 INFO:teuthology.run_tasks:Running task print... 2024-09-13T21:42:51.540 INFO:teuthology.task.print:**** done client 2024-09-13T21:42:51.540 INFO:teuthology.run_tasks:Running task parallel... 2024-09-13T21:42:51.550 INFO:teuthology.task.parallel:starting parallel... 2024-09-13T21:42:51.551 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T21:42:51.551 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T21:42:51.552 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:42:51.552 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-13T21:42:51.552 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T21:42:51.552 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-13T21:42:51.557 INFO:tasks.workunit:Pulling workunits from ref ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:42:51.558 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T21:42:51.558 INFO:tasks.workunit:timeout=3h 2024-09-13T21:42:51.558 INFO:tasks.workunit:cleanup=True 2024-09-13T21:42:51.558 DEBUG:teuthology.orchestra.run.smithi119:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T21:42:51.575 INFO:teuthology.orchestra.run.smithi119.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T21:42:51.575 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T21:42:51.576 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 7ah/122d Inode: 1 Links: 2 2024-09-13T21:42:51.576 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:42:51.576 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-13T21:42:51.576 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T21:42:51.576 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-13 21:42:15.374096771 +0000 2024-09-13T21:42:51.576 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-13 21:42:51.354783804 +0000 2024-09-13T21:42:51.576 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-09-13T21:42:51.576 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T21:42:51.576 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T21:42:51.646 DEBUG:teuthology.orchestra.run.smithi155:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-13T21:42:51.663 INFO:teuthology.orchestra.run.smithi155.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-13T21:42:51.664 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T21:42:51.664 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-13T21:42:51.664 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T21:42:51.664 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-13T21:42:51.664 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T21:42:51.664 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-13 21:42:51.640431759 +0000 2024-09-13T21:42:51.664 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-13 21:42:51.640431759 +0000 2024-09-13T21:42:51.664 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-09-13T21:42:51.664 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-13T21:42:51.664 DEBUG:teuthology.orchestra.run.smithi155:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-13T21:42:51.735 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:42:51.735 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:42:51.752 INFO:tasks.workunit.client.0.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T21:42:51.791 INFO:tasks.workunit.client.1.smithi155.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-13T21:42:51.822 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:53.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:52 smithi155 ceph-mon[34732]: pgmap v193: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:42:53.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:52 smithi119 ceph-mon[27653]: pgmap v193: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:42:53.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 -- 172.21.15.119:0/107452528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e580ff700 msgr2=0x7f3e58101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 --2- 172.21.15.119:0/107452528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e580ff700 0x7f3e58101ae0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0048d0 tx=0x7f3e4c009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 -- 172.21.15.119:0/107452528 shutdown_connections 2024-09-13T21:42:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 --2- 172.21.15.119:0/107452528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e580ff700 0x7f3e58101ae0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 --2- 172.21.15.119:0/107452528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e58065bc0 0x7f3e580ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 -- 172.21.15.119:0/107452528 >> 172.21.15.119:0/107452528 conn(0x7f3e580f6c10 msgr2=0x7f3e580f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 -- 172.21.15.119:0/107452528 shutdown_connections 2024-09-13T21:42:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 -- 172.21.15.119:0/107452528 wait complete. 2024-09-13T21:42:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 Processor -- start 2024-09-13T21:42:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 -- start start 2024-09-13T21:42:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e58065bc0 0x7f3e580fcb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e580ff700 0x7f3e580fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e580fb690 con 0x7f3e58065bc0 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e60159640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e580fb800 con 0x7f3e580ff700 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e5def5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e58065bc0 0x7f3e580fcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e5def5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e58065bc0 0x7f3e580fcb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49102/0 (socket says 172.21.15.119:49102) 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.495+0000 7f3e5def5640 1 -- 172.21.15.119:0/1135804511 learned_addr learned my addr 172.21.15.119:0/1135804511 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.496+0000 7f3e5d6f4640 1 --2- 172.21.15.119:0/1135804511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e580ff700 0x7f3e580fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.496+0000 7f3e5def5640 1 -- 172.21.15.119:0/1135804511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e580ff700 msgr2=0x7f3e580fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.496+0000 7f3e5def5640 1 --2- 172.21.15.119:0/1135804511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e580ff700 0x7f3e580fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.496+0000 7f3e5def5640 1 -- 172.21.15.119:0/1135804511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c005040 con 0x7f3e58065bc0 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.496+0000 7f3e5def5640 1 --2- 172.21.15.119:0/1135804511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e58065bc0 0x7f3e580fcb30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800bae0 tx=0x7f3e48009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.496+0000 7f3e567fc640 1 -- 172.21.15.119:0/1135804511 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e4800cb90 con 0x7f3e58065bc0 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.496+0000 7f3e567fc640 1 -- 172.21.15.119:0/1135804511 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3e4800ccf0 con 0x7f3e58065bc0 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.496+0000 7f3e60159640 1 -- 172.21.15.119:0/1135804511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e580fbae0 con 0x7f3e58065bc0 2024-09-13T21:42:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.496+0000 7f3e567fc640 1 -- 172.21.15.119:0/1135804511 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e48007790 con 0x7f3e58065bc0 2024-09-13T21:42:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.496+0000 7f3e60159640 1 -- 172.21.15.119:0/1135804511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e581151f0 con 0x7f3e58065bc0 2024-09-13T21:42:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.497+0000 7f3e60159640 1 -- 172.21.15.119:0/1135804511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e580fa890 con 0x7f3e58065bc0 2024-09-13T21:42:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.498+0000 7f3e567fc640 1 -- 172.21.15.119:0/1135804511 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3e48007910 con 0x7f3e58065bc0 2024-09-13T21:42:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.498+0000 7f3e567fc640 1 --2- 172.21.15.119:0/1135804511 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3e4006ed60 0x7f3e40071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.498+0000 7f3e567fc640 1 -- 172.21.15.119:0/1135804511 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3e4808e550 con 0x7f3e58065bc0 2024-09-13T21:42:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.498+0000 7f3e5d6f4640 1 --2- 172.21.15.119:0/1135804511 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3e4006ed60 0x7f3e40071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.498+0000 7f3e5d6f4640 1 --2- 172.21.15.119:0/1135804511 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3e4006ed60 0x7f3e40071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c007ac0 tx=0x7f3e4c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.502+0000 7f3e567fc640 1 -- 172.21.15.119:0/1135804511 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3e4804d2a0 con 0x7f3e58065bc0 2024-09-13T21:42:53.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.658+0000 7f3e60159640 1 -- 172.21.15.119:0/1135804511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f3e5804b720 con 0x7f3e58065bc0 2024-09-13T21:42:53.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:53.659+0000 7f3e567fc640 1 -- 172.21.15.119:0/1135804511 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f3e4805b6a0 con 0x7f3e58065bc0 2024-09-13T21:42:53.660 INFO:teuthology.orchestra.run.smithi119.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-09-13T21:42:54.371 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T21:42:54.371 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:42:54.372 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T21:42:54.656 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:55.033 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:54 smithi119 ceph-mon[27653]: pgmap v194: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:42:55.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:54 smithi155 ceph-mon[34732]: pgmap v194: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T21:42:56.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.327+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/1705044316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1e80fd820 msgr2=0x7fb1e80fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:56.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.327+0000 7fb1ee7f2640 1 --2- 172.21.15.119:0/1705044316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1e80fd820 0x7fb1e80fdc90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0048d0 tx=0x7fb1dc009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:56.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.327+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/1705044316 shutdown_connections 2024-09-13T21:42:56.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.327+0000 7fb1ee7f2640 1 --2- 172.21.15.119:0/1705044316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1e80fd820 0x7fb1e80fdc90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:56.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.327+0000 7fb1ee7f2640 1 --2- 172.21.15.119:0/1705044316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1e80fc550 0x7fb1e80fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:56.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.327+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/1705044316 >> 172.21.15.119:0/1705044316 conn(0x7fb1e80f7d30 msgr2=0x7fb1e80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:56.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.327+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/1705044316 shutdown_connections 2024-09-13T21:42:56.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.327+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/1705044316 wait complete. 2024-09-13T21:42:56.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.328+0000 7fb1ee7f2640 1 Processor -- start 2024-09-13T21:42:56.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.328+0000 7fb1ee7f2640 1 -- start start 2024-09-13T21:42:56.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.328+0000 7fb1ee7f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1e80fc550 0x7fb1e8071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.328+0000 7fb1ee7f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1e80fd820 0x7fb1e806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.328+0000 7fb1ee7f2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8070080 con 0x7fb1e80fc550 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.328+0000 7fb1ee7f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80701c0 con 0x7fb1e80fd820 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.328+0000 7fb1e7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1e80fc550 0x7fb1e8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.328+0000 7fb1e7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1e80fc550 0x7fb1e8071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48450/0 (socket says 172.21.15.119:48450) 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.328+0000 7fb1e7fff640 1 -- 172.21.15.119:0/3180797131 learned_addr learned my addr 172.21.15.119:0/3180797131 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.329+0000 7fb1e77fe640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1e80fd820 0x7fb1e806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.329+0000 7fb1e7fff640 1 -- 172.21.15.119:0/3180797131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1e80fd820 msgr2=0x7fb1e806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.329+0000 7fb1e7fff640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1e80fd820 0x7fb1e806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.329+0000 7fb1e7fff640 1 -- 172.21.15.119:0/3180797131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc005040 con 0x7fb1e80fc550 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.329+0000 7fb1e77fe640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1e80fd820 0x7fb1e806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.329+0000 7fb1e7fff640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1e80fc550 0x7fb1e8071570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800b790 tx=0x7fb1d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.329+0000 7fb1e4ff9640 1 -- 172.21.15.119:0/3180797131 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1d800c700 con 0x7fb1e80fc550 2024-09-13T21:42:56.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.329+0000 7fb1e4ff9640 1 -- 172.21.15.119:0/3180797131 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb1d800cd00 con 0x7fb1e80fc550 2024-09-13T21:42:56.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.329+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/3180797131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e80704a0 con 0x7fb1e80fc550 2024-09-13T21:42:56.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.329+0000 7fb1e4ff9640 1 -- 172.21.15.119:0/3180797131 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1d8015e70 con 0x7fb1e80fc550 2024-09-13T21:42:56.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.329+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/3180797131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e8115150 con 0x7fb1e80fc550 2024-09-13T21:42:56.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.330+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/3180797131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e80fb9b0 con 0x7fb1e80fc550 2024-09-13T21:42:56.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.331+0000 7fb1e4ff9640 1 -- 172.21.15.119:0/3180797131 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb1d8012070 con 0x7fb1e80fc550 2024-09-13T21:42:56.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.331+0000 7fb1e4ff9640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb1d006ed50 0x7fb1d0071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:56.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.331+0000 7fb1e4ff9640 1 -- 172.21.15.119:0/3180797131 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb1d808dd50 con 0x7fb1e80fc550 2024-09-13T21:42:56.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.331+0000 7fb1e77fe640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb1d006ed50 0x7fb1d0071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:56.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.332+0000 7fb1e77fe640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb1d006ed50 0x7fb1d0071200 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc007ac0 tx=0x7fb1dc035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:56.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.335+0000 7fb1e4ff9640 1 -- 172.21.15.119:0/3180797131 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb1d805ae20 con 0x7fb1e80fc550 2024-09-13T21:42:56.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.493+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/3180797131 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fb1e804b720 con 0x7fb1e80fc550 2024-09-13T21:42:56.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.493+0000 7fb1e4ff9640 1 -- 172.21.15.119:0/3180797131 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fb1d805a7c0 con 0x7fb1e80fc550 2024-09-13T21:42:56.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.495+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/3180797131 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb1d006ed50 msgr2=0x7fb1d0071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.495+0000 7fb1ee7f2640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb1d006ed50 0x7fb1d0071200 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc007ac0 tx=0x7fb1dc035040 comp rx=0 tx=0).stop 2024-09-13T21:42:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.495+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/3180797131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1e80fc550 msgr2=0x7fb1e8071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.495+0000 7fb1ee7f2640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1e80fc550 0x7fb1e8071570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800b790 tx=0x7fb1d80091d0 comp rx=0 tx=0).stop 2024-09-13T21:42:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.495+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/3180797131 shutdown_connections 2024-09-13T21:42:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.495+0000 7fb1ee7f2640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fb1d006ed50 0x7fb1d0071200 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.495+0000 7fb1ee7f2640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1e80fd820 0x7fb1e806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.495+0000 7fb1ee7f2640 1 --2- 172.21.15.119:0/3180797131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1e80fc550 0x7fb1e8071570 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.495+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/3180797131 >> 172.21.15.119:0/3180797131 conn(0x7fb1e80f7d30 msgr2=0x7fb1e80f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.495+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/3180797131 shutdown_connections 2024-09-13T21:42:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:56.495+0000 7fb1ee7f2640 1 -- 172.21.15.119:0/3180797131 wait complete. 2024-09-13T21:42:57.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:56 smithi155 ceph-mon[34732]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-13T21:42:57.110 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:56 smithi119 ceph-mon[27653]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-13T21:42:57.134 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T21:42:57.377 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:42:58.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.843+0000 7f61e375a640 1 -- 172.21.15.119:0/4121213943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61dc0ff6a0 msgr2=0x7f61dc101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:58.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.843+0000 7f61e375a640 1 --2- 172.21.15.119:0/4121213943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61dc0ff6a0 0x7f61dc101a80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0048d0 tx=0x7f61cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:58.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.843+0000 7f61e375a640 1 -- 172.21.15.119:0/4121213943 shutdown_connections 2024-09-13T21:42:58.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.843+0000 7f61e375a640 1 --2- 172.21.15.119:0/4121213943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61dc0ff6a0 0x7f61dc101a80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:58.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.843+0000 7f61e375a640 1 --2- 172.21.15.119:0/4121213943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61dc066730 0x7f61dc0ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.843+0000 7f61e375a640 1 -- 172.21.15.119:0/4121213943 >> 172.21.15.119:0/4121213943 conn(0x7f61dc0f6c10 msgr2=0x7f61dc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.843+0000 7f61e375a640 1 -- 172.21.15.119:0/4121213943 shutdown_connections 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.843+0000 7f61e375a640 1 -- 172.21.15.119:0/4121213943 wait complete. 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e375a640 1 Processor -- start 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e375a640 1 -- start start 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e375a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61dc066730 0x7f61dc10d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e375a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61dc0ff6a0 0x7f61dc10d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e375a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc10e4e0 con 0x7f61dc0ff6a0 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e375a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc10e650 con 0x7f61dc066730 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e0cf5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61dc0ff6a0 0x7f61dc10d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e0cf5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61dc0ff6a0 0x7f61dc10d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48470/0 (socket says 172.21.15.119:48470) 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e0cf5640 1 -- 172.21.15.119:0/3024854919 learned_addr learned my addr 172.21.15.119:0/3024854919 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:42:58.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e14f6640 1 --2- 172.21.15.119:0/3024854919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61dc066730 0x7f61dc10d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:58.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e0cf5640 1 -- 172.21.15.119:0/3024854919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61dc066730 msgr2=0x7f61dc10d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:58.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e0cf5640 1 --2- 172.21.15.119:0/3024854919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61dc066730 0x7f61dc10d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:58.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e0cf5640 1 -- 172.21.15.119:0/3024854919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc005040 con 0x7f61dc0ff6a0 2024-09-13T21:42:58.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.844+0000 7f61e0cf5640 1 --2- 172.21.15.119:0/3024854919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61dc0ff6a0 0x7f61dc10d670 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f61cc003080 tx=0x7f61cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:58.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.845+0000 7f61d1ffb640 1 -- 172.21.15.119:0/3024854919 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61cc038070 con 0x7f61dc0ff6a0 2024-09-13T21:42:58.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.845+0000 7f61e375a640 1 -- 172.21.15.119:0/3024854919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc10e8d0 con 0x7f61dc0ff6a0 2024-09-13T21:42:58.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.845+0000 7f61d1ffb640 1 -- 172.21.15.119:0/3024854919 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f61cc02abd0 con 0x7f61dc0ff6a0 2024-09-13T21:42:58.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.845+0000 7f61d1ffb640 1 -- 172.21.15.119:0/3024854919 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61cc03e670 con 0x7f61dc0ff6a0 2024-09-13T21:42:58.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.845+0000 7f61e375a640 1 -- 172.21.15.119:0/3024854919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc10edf0 con 0x7f61dc0ff6a0 2024-09-13T21:42:58.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.846+0000 7f61e375a640 1 -- 172.21.15.119:0/3024854919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61dc0fa8b0 con 0x7f61dc0ff6a0 2024-09-13T21:42:58.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.846+0000 7f61d1ffb640 1 -- 172.21.15.119:0/3024854919 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f61cc030020 con 0x7f61dc0ff6a0 2024-09-13T21:42:58.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.847+0000 7f61d1ffb640 1 --2- 172.21.15.119:0/3024854919 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f61c806ed60 0x7f61c8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:42:58.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.847+0000 7f61d1ffb640 1 -- 172.21.15.119:0/3024854919 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f61cc0ae530 con 0x7f61dc0ff6a0 2024-09-13T21:42:58.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.847+0000 7f61e14f6640 1 --2- 172.21.15.119:0/3024854919 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f61c806ed60 0x7f61c8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:42:58.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.847+0000 7f61e14f6640 1 --2- 172.21.15.119:0/3024854919 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f61c806ed60 0x7f61c8071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61dc066490 tx=0x7f61d8009120 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:42:58.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:58.851+0000 7f61d1ffb640 1 -- 172.21.15.119:0/3024854919 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f61cc07b6b0 con 0x7f61dc0ff6a0 2024-09-13T21:42:59.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.005+0000 7f61e375a640 1 -- 172.21.15.119:0/3024854919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f61dc04b720 con 0x7f61dc0ff6a0 2024-09-13T21:42:59.007 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:58 smithi119 ceph-mon[27653]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-13T21:42:59.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.005+0000 7f61d1ffb640 1 -- 172.21.15.119:0/3024854919 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f61cc07b050 con 0x7f61dc0ff6a0 2024-09-13T21:42:59.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.007+0000 7f61e375a640 1 -- 172.21.15.119:0/3024854919 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f61c806ed60 msgr2=0x7f61c8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:59.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.007+0000 7f61e375a640 1 --2- 172.21.15.119:0/3024854919 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f61c806ed60 0x7f61c8071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61dc066490 tx=0x7f61d8009120 comp rx=0 tx=0).stop 2024-09-13T21:42:59.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.007+0000 7f61e375a640 1 -- 172.21.15.119:0/3024854919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61dc0ff6a0 msgr2=0x7f61dc10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:42:59.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.007+0000 7f61e375a640 1 --2- 172.21.15.119:0/3024854919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61dc0ff6a0 0x7f61dc10d670 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f61cc003080 tx=0x7f61cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:42:59.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.007+0000 7f61e375a640 1 -- 172.21.15.119:0/3024854919 shutdown_connections 2024-09-13T21:42:59.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.007+0000 7f61e375a640 1 --2- 172.21.15.119:0/3024854919 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f61c806ed60 0x7f61c8071210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:59.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.007+0000 7f61e375a640 1 --2- 172.21.15.119:0/3024854919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61dc0ff6a0 0x7f61dc10d670 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:59.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.007+0000 7f61e375a640 1 --2- 172.21.15.119:0/3024854919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61dc066730 0x7f61dc10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:42:59.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.007+0000 7f61e375a640 1 -- 172.21.15.119:0/3024854919 >> 172.21.15.119:0/3024854919 conn(0x7f61dc0f6c10 msgr2=0x7f61dc0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:42:59.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.007+0000 7f61e375a640 1 -- 172.21.15.119:0/3024854919 shutdown_connections 2024-09-13T21:42:59.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:42:59.007+0000 7f61e375a640 1 -- 172.21.15.119:0/3024854919 wait complete. 2024-09-13T21:42:59.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:58 smithi155 ceph-mon[34732]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-13T21:42:59.616 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T21:42:59.865 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:43:00.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:42:59 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:00.119 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:42:59 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:00.932 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:00 smithi119 ceph-mon[27653]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-13T21:43:01.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:00 smithi155 ceph-mon[34732]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-13T21:43:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 -- 172.21.15.119:0/2953598561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe01c0666d0 msgr2=0x7fe01c0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 --2- 172.21.15.119:0/2953598561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe01c0666d0 0x7fe01c0ff1c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe0180048d0 tx=0x7fe018009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 -- 172.21.15.119:0/2953598561 shutdown_connections 2024-09-13T21:43:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 --2- 172.21.15.119:0/2953598561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe01c0ff700 0x7fe01c101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 --2- 172.21.15.119:0/2953598561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe01c0666d0 0x7fe01c0ff1c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 -- 172.21.15.119:0/2953598561 >> 172.21.15.119:0/2953598561 conn(0x7fe01c0f6c10 msgr2=0x7fe01c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 -- 172.21.15.119:0/2953598561 shutdown_connections 2024-09-13T21:43:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 -- 172.21.15.119:0/2953598561 wait complete. 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 Processor -- start 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 -- start start 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe01c0666d0 0x7fe01c0fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe01c0ff700 0x7fe01c0fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.431+0000 7fe023979640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0fb690 con 0x7fe01c0666d0 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe023979640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0fb7d0 con 0x7fe01c0ff700 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe021715640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe01c0666d0 0x7fe01c0fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe021715640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe01c0666d0 0x7fe01c0fcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48482/0 (socket says 172.21.15.119:48482) 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe021715640 1 -- 172.21.15.119:0/2211809914 learned_addr learned my addr 172.21.15.119:0/2211809914 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe020f14640 1 --2- 172.21.15.119:0/2211809914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe01c0ff700 0x7fe01c0fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe021715640 1 -- 172.21.15.119:0/2211809914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe01c0ff700 msgr2=0x7fe01c0fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe021715640 1 --2- 172.21.15.119:0/2211809914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe01c0ff700 0x7fe01c0fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe021715640 1 -- 172.21.15.119:0/2211809914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe018005040 con 0x7fe01c0666d0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe021715640 1 --2- 172.21.15.119:0/2211809914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe01c0666d0 0x7fe01c0fcb80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe018000c00 tx=0x7fe018009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe011ffb640 1 -- 172.21.15.119:0/2211809914 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe018038070 con 0x7fe01c0666d0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe011ffb640 1 -- 172.21.15.119:0/2211809914 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe018009760 con 0x7fe01c0666d0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe011ffb640 1 -- 172.21.15.119:0/2211809914 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01803db90 con 0x7fe01c0666d0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe023979640 1 -- 172.21.15.119:0/2211809914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c0fba50 con 0x7fe01c0666d0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.432+0000 7fe023979640 1 -- 172.21.15.119:0/2211809914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c0fbf10 con 0x7fe01c0666d0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.433+0000 7fe023979640 1 -- 172.21.15.119:0/2211809914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c0fa8b0 con 0x7fe01c0666d0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.434+0000 7fe011ffb640 1 -- 172.21.15.119:0/2211809914 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe018030020 con 0x7fe01c0666d0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.434+0000 7fe011ffb640 1 --2- 172.21.15.119:0/2211809914 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe00806ed60 0x7fe008071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.434+0000 7fe011ffb640 1 -- 172.21.15.119:0/2211809914 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe0180aec50 con 0x7fe01c0666d0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.435+0000 7fe020f14640 1 --2- 172.21.15.119:0/2211809914 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe00806ed60 0x7fe008071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.435+0000 7fe020f14640 1 --2- 172.21.15.119:0/2211809914 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe00806ed60 0x7fe008071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe00c006fd0 tx=0x7fe00c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:01.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.438+0000 7fe011ffb640 1 -- 172.21.15.119:0/2211809914 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe01807bda0 con 0x7fe01c0666d0 2024-09-13T21:43:01.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.596+0000 7fe023979640 1 -- 172.21.15.119:0/2211809914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fe01c04b720 con 0x7fe01c0666d0 2024-09-13T21:43:01.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.596+0000 7fe011ffb640 1 -- 172.21.15.119:0/2211809914 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fe01807b740 con 0x7fe01c0666d0 2024-09-13T21:43:01.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.599+0000 7fe023979640 1 -- 172.21.15.119:0/2211809914 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe00806ed60 msgr2=0x7fe008071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.599+0000 7fe023979640 1 --2- 172.21.15.119:0/2211809914 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe00806ed60 0x7fe008071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe00c006fd0 tx=0x7fe00c008040 comp rx=0 tx=0).stop 2024-09-13T21:43:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.599+0000 7fe023979640 1 -- 172.21.15.119:0/2211809914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe01c0666d0 msgr2=0x7fe01c0fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.599+0000 7fe023979640 1 --2- 172.21.15.119:0/2211809914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe01c0666d0 0x7fe01c0fcb80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe018000c00 tx=0x7fe018009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.599+0000 7fe023979640 1 -- 172.21.15.119:0/2211809914 shutdown_connections 2024-09-13T21:43:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.599+0000 7fe023979640 1 --2- 172.21.15.119:0/2211809914 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fe00806ed60 0x7fe008071210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.599+0000 7fe023979640 1 --2- 172.21.15.119:0/2211809914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe01c0ff700 0x7fe01c0fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.599+0000 7fe023979640 1 --2- 172.21.15.119:0/2211809914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe01c0666d0 0x7fe01c0fcb80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.599+0000 7fe023979640 1 -- 172.21.15.119:0/2211809914 >> 172.21.15.119:0/2211809914 conn(0x7fe01c0f6c10 msgr2=0x7fe01c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.599+0000 7fe023979640 1 -- 172.21.15.119:0/2211809914 shutdown_connections 2024-09-13T21:43:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:01.599+0000 7fe023979640 1 -- 172.21.15.119:0/2211809914 wait complete. 2024-09-13T21:43:02.381 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-13T21:43:02.643 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:43:02.976 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:02 smithi119 ceph-mon[27653]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-13T21:43:03.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:02 smithi155 ceph-mon[34732]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-13T21:43:04.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.170+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/3494248337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cb00fb440 msgr2=0x7f4cb00fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:04.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.170+0000 7f4cb6fa3640 1 --2- 172.21.15.119:0/3494248337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cb00fb440 0x7f4cb00fb850 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40048d0 tx=0x7f4ca4009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:04.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.170+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/3494248337 shutdown_connections 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.170+0000 7f4cb6fa3640 1 --2- 172.21.15.119:0/3494248337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb00fc710 0x7f4cb00fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.170+0000 7f4cb6fa3640 1 --2- 172.21.15.119:0/3494248337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cb00fb440 0x7f4cb00fb850 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.170+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/3494248337 >> 172.21.15.119:0/3494248337 conn(0x7f4cb00f6c00 msgr2=0x7f4cb00f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.170+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/3494248337 shutdown_connections 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.170+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/3494248337 wait complete. 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.170+0000 7f4cb6fa3640 1 Processor -- start 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4cb6fa3640 1 -- start start 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4cb6fa3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb00fb440 0x7f4cb010fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4cb6fa3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cb00fc710 0x7f4cb0112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4cb6fa3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0066860 con 0x7f4cb00fc710 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4cb6fa3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb00669d0 con 0x7f4cb00fb440 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4caffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cb00fc710 0x7f4cb0112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:04.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4caffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cb00fc710 0x7f4cb0112300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34836/0 (socket says 172.21.15.119:34836) 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4caffff640 1 -- 172.21.15.119:0/673551285 learned_addr learned my addr 172.21.15.119:0/673551285 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4caffff640 1 -- 172.21.15.119:0/673551285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb00fb440 msgr2=0x7f4cb010fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4caffff640 1 --2- 172.21.15.119:0/673551285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb00fb440 0x7f4cb010fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4caffff640 1 -- 172.21.15.119:0/673551285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca4005040 con 0x7f4cb00fc710 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4caffff640 1 --2- 172.21.15.119:0/673551285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cb00fc710 0x7f4cb0112300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00b7c0 tx=0x7f4c9c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.171+0000 7f4cad7fa640 1 -- 172.21.15.119:0/673551285 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c00c730 con 0x7f4cb00fc710 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.172+0000 7f4cad7fa640 1 -- 172.21.15.119:0/673551285 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4c9c00cd30 con 0x7f4cb00fc710 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.172+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/673551285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb0112960 con 0x7f4cb00fc710 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.172+0000 7f4cad7fa640 1 -- 172.21.15.119:0/673551285 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c013370 con 0x7f4cb00fc710 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.172+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/673551285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb0112e80 con 0x7f4cb00fc710 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.172+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/673551285 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb00fa8a0 con 0x7f4cb00fc710 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.173+0000 7f4cad7fa640 1 -- 172.21.15.119:0/673551285 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4c9c012070 con 0x7f4cb00fc710 2024-09-13T21:43:04.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.174+0000 7f4cad7fa640 1 --2- 172.21.15.119:0/673551285 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4ca006ed60 0x7f4ca0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:04.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.174+0000 7f4cb4d3f640 1 --2- 172.21.15.119:0/673551285 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4ca006ed60 0x7f4ca0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:04.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.174+0000 7f4cad7fa640 1 -- 172.21.15.119:0/673551285 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4c9c08dcb0 con 0x7f4cb00fc710 2024-09-13T21:43:04.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.174+0000 7f4cb4d3f640 1 --2- 172.21.15.119:0/673551285 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4ca006ed60 0x7f4ca0071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ca402a530 tx=0x7f4ca4009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:04.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.178+0000 7f4cad7fa640 1 -- 172.21.15.119:0/673551285 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4c9c05ad80 con 0x7f4cb00fc710 2024-09-13T21:43:04.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.347+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/673551285 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cb0100b10 con 0x7f4ca006ed60 2024-09-13T21:43:04.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.353+0000 7f4cad7fa640 1 -- 172.21.15.119:0/673551285 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f4cb0100b10 con 0x7f4ca006ed60 2024-09-13T21:43:04.354 INFO:teuthology.orchestra.run.smithi119.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:43:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.355+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/673551285 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4ca006ed60 msgr2=0x7f4ca0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.355+0000 7f4cb6fa3640 1 --2- 172.21.15.119:0/673551285 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4ca006ed60 0x7f4ca0071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ca402a530 tx=0x7f4ca4009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.355+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/673551285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cb00fc710 msgr2=0x7f4cb0112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.355+0000 7f4cb6fa3640 1 --2- 172.21.15.119:0/673551285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cb00fc710 0x7f4cb0112300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00b7c0 tx=0x7f4c9c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:43:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.355+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/673551285 shutdown_connections 2024-09-13T21:43:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.355+0000 7f4cb6fa3640 1 --2- 172.21.15.119:0/673551285 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4ca006ed60 0x7f4ca0071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.355+0000 7f4cb6fa3640 1 --2- 172.21.15.119:0/673551285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cb00fc710 0x7f4cb0112300 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.355+0000 7f4cb6fa3640 1 --2- 172.21.15.119:0/673551285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cb00fb440 0x7f4cb010fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.355+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/673551285 >> 172.21.15.119:0/673551285 conn(0x7f4cb00f6c00 msgr2=0x7f4cb00f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.355+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/673551285 shutdown_connections 2024-09-13T21:43:04.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:04.355+0000 7f4cb6fa3640 1 -- 172.21.15.119:0/673551285 wait complete. 2024-09-13T21:43:05.114 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T21:43:05.115 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:43:05.115 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-13T21:43:05.381 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:43:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:05 smithi119 ceph-mon[27653]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-13T21:43:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:05 smithi119 ceph-mon[27653]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:05 smithi119 ceph-mon[27653]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:43:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:05 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:43:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:05 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:05 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:43:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:05 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:43:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:05 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:43:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:05 smithi155 ceph-mon[34732]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-13T21:43:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:05 smithi155 ceph-mon[34732]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:05 smithi155 ceph-mon[34732]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:43:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:05 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:43:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:05 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:05 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:43:05.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:05 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:43:05.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:05 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:43:06.622 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:06 smithi119 ceph-mon[27653]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:43:06.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:06 smithi155 ceph-mon[34732]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:43:07.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.147+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/3610621957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bd40fc700 msgr2=0x7f9bd40fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.147+0000 7f9bdc3b3640 1 --2- 172.21.15.119:0/3610621957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bd40fc700 0x7f9bd40fcb70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40048d0 tx=0x7f9bc4009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.147+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/3610621957 shutdown_connections 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.147+0000 7f9bdc3b3640 1 --2- 172.21.15.119:0/3610621957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bd40fc700 0x7f9bd40fcb70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.147+0000 7f9bdc3b3640 1 --2- 172.21.15.119:0/3610621957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bd40fb430 0x7f9bd40fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.147+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/3610621957 >> 172.21.15.119:0/3610621957 conn(0x7f9bd40f6c10 msgr2=0x7f9bd40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.147+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/3610621957 shutdown_connections 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.147+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/3610621957 wait complete. 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.147+0000 7f9bdc3b3640 1 Processor -- start 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.147+0000 7f9bdc3b3640 1 -- start start 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bdc3b3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bd40fb430 0x7f9bd410fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bdc3b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bd40fc700 0x7f9bd4112270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:07.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bdc3b3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd4065cc0 con 0x7f9bd40fc700 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bdc3b3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd4065e30 con 0x7f9bd40fb430 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bd994e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bd40fc700 0x7f9bd4112270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bd994e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bd40fc700 0x7f9bd4112270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34864/0 (socket says 172.21.15.119:34864) 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bd994e640 1 -- 172.21.15.119:0/259899467 learned_addr learned my addr 172.21.15.119:0/259899467 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bda14f640 1 --2- 172.21.15.119:0/259899467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bd40fb430 0x7f9bd410fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bd994e640 1 -- 172.21.15.119:0/259899467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bd40fb430 msgr2=0x7f9bd410fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bd994e640 1 --2- 172.21.15.119:0/259899467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bd40fb430 0x7f9bd410fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bd994e640 1 -- 172.21.15.119:0/259899467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc4005040 con 0x7f9bd40fc700 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bd994e640 1 --2- 172.21.15.119:0/259899467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bd40fc700 0x7f9bd4112270 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4003080 tx=0x7f9bc4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bcaffd640 1 -- 172.21.15.119:0/259899467 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4038070 con 0x7f9bd40fc700 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bcaffd640 1 -- 172.21.15.119:0/259899467 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9bc402abd0 con 0x7f9bd40fc700 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.148+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/259899467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd4112810 con 0x7f9bd40fc700 2024-09-13T21:43:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.149+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/259899467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd4112d80 con 0x7f9bd40fc700 2024-09-13T21:43:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.149+0000 7f9bcaffd640 1 -- 172.21.15.119:0/259899467 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc403e670 con 0x7f9bd40fc700 2024-09-13T21:43:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.150+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/259899467 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb8005240 con 0x7f9bd40fc700 2024-09-13T21:43:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.150+0000 7f9bcaffd640 1 -- 172.21.15.119:0/259899467 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9bc4030020 con 0x7f9bd40fc700 2024-09-13T21:43:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.151+0000 7f9bcaffd640 1 --2- 172.21.15.119:0/259899467 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9bc006ed60 0x7f9bc0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.151+0000 7f9bcaffd640 1 -- 172.21.15.119:0/259899467 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9bc40ae4b0 con 0x7f9bd40fc700 2024-09-13T21:43:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.151+0000 7f9bda14f640 1 --2- 172.21.15.119:0/259899467 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9bc006ed60 0x7f9bc0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.151+0000 7f9bda14f640 1 --2- 172.21.15.119:0/259899467 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9bc006ed60 0x7f9bc0071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40659b0 tx=0x7f9bd0009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.155+0000 7f9bcaffd640 1 -- 172.21.15.119:0/259899467 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9bc407b580 con 0x7f9bd40fc700 2024-09-13T21:43:07.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.355+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/259899467 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bb8000bf0 con 0x7f9bc006ed60 2024-09-13T21:43:07.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.356+0000 7f9bcaffd640 1 -- 172.21.15.119:0/259899467 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f9bb8000bf0 con 0x7f9bc006ed60 2024-09-13T21:43:07.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.359+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/259899467 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9bc006ed60 msgr2=0x7f9bc0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.359+0000 7f9bdc3b3640 1 --2- 172.21.15.119:0/259899467 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9bc006ed60 0x7f9bc0071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40659b0 tx=0x7f9bd0009040 comp rx=0 tx=0).stop 2024-09-13T21:43:07.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.359+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/259899467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bd40fc700 msgr2=0x7f9bd4112270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.359+0000 7f9bdc3b3640 1 --2- 172.21.15.119:0/259899467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bd40fc700 0x7f9bd4112270 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4003080 tx=0x7f9bc4009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.360+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/259899467 shutdown_connections 2024-09-13T21:43:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.360+0000 7f9bdc3b3640 1 --2- 172.21.15.119:0/259899467 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9bc006ed60 0x7f9bc0071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.360+0000 7f9bdc3b3640 1 --2- 172.21.15.119:0/259899467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bd40fc700 0x7f9bd4112270 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.360+0000 7f9bdc3b3640 1 --2- 172.21.15.119:0/259899467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bd40fb430 0x7f9bd410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.360+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/259899467 >> 172.21.15.119:0/259899467 conn(0x7f9bd40f6c10 msgr2=0x7f9bd40f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.360+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/259899467 shutdown_connections 2024-09-13T21:43:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.360+0000 7f9bdc3b3640 1 -- 172.21.15.119:0/259899467 wait complete. 2024-09-13T21:43:07.371 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:43:07.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 -- 172.21.15.119:0/1928560528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a0c0fc520 msgr2=0x7f8a0c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 --2- 172.21.15.119:0/1928560528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a0c0fc520 0x7f8a0c0fc930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8a080048d0 tx=0x7f8a08009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 -- 172.21.15.119:0/1928560528 shutdown_connections 2024-09-13T21:43:07.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 --2- 172.21.15.119:0/1928560528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0c0fd7f0 0x7f8a0c0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 --2- 172.21.15.119:0/1928560528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a0c0fc520 0x7f8a0c0fc930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 -- 172.21.15.119:0/1928560528 >> 172.21.15.119:0/1928560528 conn(0x7f8a0c0f7ce0 msgr2=0x7f8a0c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 -- 172.21.15.119:0/1928560528 shutdown_connections 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 -- 172.21.15.119:0/1928560528 wait complete. 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 Processor -- start 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 -- start start 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a0c0fc520 0x7f8a0c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0c0fd7f0 0x7f8a0c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c10e450 con 0x7f8a0c0fc520 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.451+0000 7f8a14271640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c10e5c0 con 0x7f8a0c0fd7f0 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a1200d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a0c0fc520 0x7f8a0c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a1200d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a0c0fc520 0x7f8a0c10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34886/0 (socket says 172.21.15.119:34886) 2024-09-13T21:43:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a1200d640 1 -- 172.21.15.119:0/892753112 learned_addr learned my addr 172.21.15.119:0/892753112 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:07.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a1180c640 1 --2- 172.21.15.119:0/892753112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0c0fd7f0 0x7f8a0c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:07.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a1200d640 1 -- 172.21.15.119:0/892753112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0c0fd7f0 msgr2=0x7f8a0c10d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a1200d640 1 --2- 172.21.15.119:0/892753112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0c0fd7f0 0x7f8a0c10d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a1200d640 1 -- 172.21.15.119:0/892753112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a08005040 con 0x7f8a0c0fc520 2024-09-13T21:43:07.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a1200d640 1 --2- 172.21.15.119:0/892753112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a0c0fc520 0x7f8a0c10d0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8a08003080 tx=0x7f8a08009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:07.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a02ffd640 1 -- 172.21.15.119:0/892753112 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a08038070 con 0x7f8a0c0fc520 2024-09-13T21:43:07.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a02ffd640 1 -- 172.21.15.119:0/892753112 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a0802abd0 con 0x7f8a0c0fc520 2024-09-13T21:43:07.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a14271640 1 -- 172.21.15.119:0/892753112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c10e840 con 0x7f8a0c0fc520 2024-09-13T21:43:07.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a02ffd640 1 -- 172.21.15.119:0/892753112 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a0803e670 con 0x7f8a0c0fc520 2024-09-13T21:43:07.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.452+0000 7f8a14271640 1 -- 172.21.15.119:0/892753112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c10ed60 con 0x7f8a0c0fc520 2024-09-13T21:43:07.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.454+0000 7f8a14271640 1 -- 172.21.15.119:0/892753112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c1057b0 con 0x7f8a0c0fc520 2024-09-13T21:43:07.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.454+0000 7f8a02ffd640 1 -- 172.21.15.119:0/892753112 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8a08030020 con 0x7f8a0c0fc520 2024-09-13T21:43:07.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.455+0000 7f8a02ffd640 1 --2- 172.21.15.119:0/892753112 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f89f806ed60 0x7f89f8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:07.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.455+0000 7f8a02ffd640 1 -- 172.21.15.119:0/892753112 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8a080ae5e0 con 0x7f8a0c0fc520 2024-09-13T21:43:07.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.455+0000 7f8a1180c640 1 --2- 172.21.15.119:0/892753112 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f89f806ed60 0x7f89f8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:07.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.455+0000 7f8a1180c640 1 --2- 172.21.15.119:0/892753112 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f89f806ed60 0x7f89f8071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c10ce50 tx=0x7f89fc008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:07.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.459+0000 7f8a02ffd640 1 -- 172.21.15.119:0/892753112 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8a0807b6b0 con 0x7f8a0c0fc520 2024-09-13T21:43:07.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:07 smithi119 ceph-mon[27653]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-13T21:43:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.654+0000 7f8a14271640 1 -- 172.21.15.119:0/892753112 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a0c10efd0 con 0x7f89f806ed60 2024-09-13T21:43:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.655+0000 7f8a02ffd640 1 -- 172.21.15.119:0/892753112 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f8a0c10efd0 con 0x7f89f806ed60 2024-09-13T21:43:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.657+0000 7f8a14271640 1 -- 172.21.15.119:0/892753112 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f89f806ed60 msgr2=0x7f89f8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.657+0000 7f8a14271640 1 --2- 172.21.15.119:0/892753112 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f89f806ed60 0x7f89f8071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c10ce50 tx=0x7f89fc008040 comp rx=0 tx=0).stop 2024-09-13T21:43:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.657+0000 7f8a14271640 1 -- 172.21.15.119:0/892753112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a0c0fc520 msgr2=0x7f8a0c10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.657+0000 7f8a14271640 1 --2- 172.21.15.119:0/892753112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a0c0fc520 0x7f8a0c10d0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8a08003080 tx=0x7f8a08009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.657+0000 7f8a14271640 1 -- 172.21.15.119:0/892753112 shutdown_connections 2024-09-13T21:43:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.657+0000 7f8a14271640 1 --2- 172.21.15.119:0/892753112 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f89f806ed60 0x7f89f8071210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.657+0000 7f8a14271640 1 --2- 172.21.15.119:0/892753112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a0c0fd7f0 0x7f8a0c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.657+0000 7f8a14271640 1 --2- 172.21.15.119:0/892753112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a0c0fc520 0x7f8a0c10d0a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.657+0000 7f8a14271640 1 -- 172.21.15.119:0/892753112 >> 172.21.15.119:0/892753112 conn(0x7f8a0c0f7ce0 msgr2=0x7f8a0c0f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.657+0000 7f8a14271640 1 -- 172.21.15.119:0/892753112 shutdown_connections 2024-09-13T21:43:07.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.658+0000 7f8a14271640 1 -- 172.21.15.119:0/892753112 wait complete. 2024-09-13T21:43:07.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.746+0000 7f1b8cc46640 1 -- 172.21.15.119:0/2579892822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b880fb430 msgr2=0x7f1b880fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.746+0000 7f1b8cc46640 1 --2- 172.21.15.119:0/2579892822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b880fb430 0x7f1b880fb840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1b780048d0 tx=0x7f1b78009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.746+0000 7f1b8cc46640 1 -- 172.21.15.119:0/2579892822 shutdown_connections 2024-09-13T21:43:07.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.746+0000 7f1b8cc46640 1 --2- 172.21.15.119:0/2579892822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b880fc700 0x7f1b880fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.746+0000 7f1b8cc46640 1 --2- 172.21.15.119:0/2579892822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b880fb430 0x7f1b880fb840 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.746+0000 7f1b8cc46640 1 -- 172.21.15.119:0/2579892822 >> 172.21.15.119:0/2579892822 conn(0x7f1b880f6c10 msgr2=0x7f1b880f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:07.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.746+0000 7f1b8cc46640 1 -- 172.21.15.119:0/2579892822 shutdown_connections 2024-09-13T21:43:07.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.746+0000 7f1b8cc46640 1 -- 172.21.15.119:0/2579892822 wait complete. 2024-09-13T21:43:07.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.747+0000 7f1b8cc46640 1 Processor -- start 2024-09-13T21:43:07.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.747+0000 7f1b8cc46640 1 -- start start 2024-09-13T21:43:07.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.747+0000 7f1b8cc46640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b880fb430 0x7f1b8810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:07.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.747+0000 7f1b8cc46640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b880fc700 0x7f1b88112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:07.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.747+0000 7f1b8cc46640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88065c60 con 0x7f1b880fb430 2024-09-13T21:43:07.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.747+0000 7f1b8cc46640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88065dd0 con 0x7f1b880fc700 2024-09-13T21:43:07.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.747+0000 7f1b8659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b880fb430 0x7f1b8810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:07.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.747+0000 7f1b8659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b880fb430 0x7f1b8810fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34910/0 (socket says 172.21.15.119:34910) 2024-09-13T21:43:07.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.747+0000 7f1b8659c640 1 -- 172.21.15.119:0/1469533731 learned_addr learned my addr 172.21.15.119:0/1469533731 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:07.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.747+0000 7f1b7ffff640 1 --2- 172.21.15.119:0/1469533731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b880fc700 0x7f1b88112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:07.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.748+0000 7f1b8659c640 1 -- 172.21.15.119:0/1469533731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b880fc700 msgr2=0x7f1b88112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.748+0000 7f1b8659c640 1 --2- 172.21.15.119:0/1469533731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b880fc700 0x7f1b88112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.748+0000 7f1b8659c640 1 -- 172.21.15.119:0/1469533731 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b78005040 con 0x7f1b880fb430 2024-09-13T21:43:07.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.748+0000 7f1b8659c640 1 --2- 172.21.15.119:0/1469533731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b880fb430 0x7f1b8810fdc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1b780043d0 tx=0x7f1b78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:07.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.748+0000 7f1b7effd640 1 -- 172.21.15.119:0/1469533731 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b78038070 con 0x7f1b880fb430 2024-09-13T21:43:07.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.748+0000 7f1b8cc46640 1 -- 172.21.15.119:0/1469533731 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b88112850 con 0x7f1b880fb430 2024-09-13T21:43:07.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.748+0000 7f1b7effd640 1 -- 172.21.15.119:0/1469533731 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1b7802ae90 con 0x7f1b880fb430 2024-09-13T21:43:07.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.748+0000 7f1b7effd640 1 -- 172.21.15.119:0/1469533731 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b7803e670 con 0x7f1b880fb430 2024-09-13T21:43:07.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.748+0000 7f1b8cc46640 1 -- 172.21.15.119:0/1469533731 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b88112dc0 con 0x7f1b880fb430 2024-09-13T21:43:07.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.749+0000 7f1b8cc46640 1 -- 172.21.15.119:0/1469533731 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b880fa890 con 0x7f1b880fb430 2024-09-13T21:43:07.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.750+0000 7f1b7effd640 1 -- 172.21.15.119:0/1469533731 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1b78030020 con 0x7f1b880fb430 2024-09-13T21:43:07.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.750+0000 7f1b7effd640 1 --2- 172.21.15.119:0/1469533731 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1b7406ed60 0x7f1b74071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:07.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.751+0000 7f1b7effd640 1 -- 172.21.15.119:0/1469533731 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1b780ae3c0 con 0x7f1b880fb430 2024-09-13T21:43:07.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.751+0000 7f1b7ffff640 1 --2- 172.21.15.119:0/1469533731 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1b7406ed60 0x7f1b74071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:07.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.751+0000 7f1b7ffff640 1 --2- 172.21.15.119:0/1469533731 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1b7406ed60 0x7f1b74071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b70004ed0 tx=0x7f1b7000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:07.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.755+0000 7f1b7effd640 1 -- 172.21.15.119:0/1469533731 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1b7807b540 con 0x7f1b880fb430 2024-09-13T21:43:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:07 smithi155 ceph-mon[34732]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-13T21:43:07.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.963+0000 7f1b8cc46640 1 -- 172.21.15.119:0/1469533731 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b88100b60 con 0x7f1b7406ed60 2024-09-13T21:43:07.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.973+0000 7f1b7effd640 1 -- 172.21.15.119:0/1469533731 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1b88100b60 con 0x7f1b7406ed60 2024-09-13T21:43:07.975 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:43:07.975 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (4m) 29s ago 6m 23.4M - 0.25.0 c8568f914cd2 d48a0a37f6f5 2024-09-13T21:43:07.975 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (6m) 29s ago 6m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 c6a79bd22109 2024-09-13T21:43:07.975 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (5m) 35s ago 5m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 1bccd1b9bda0 2024-09-13T21:43:07.975 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (4m) 29s ago 5m 84.6M - 9.4.7 954c08fa6188 b9b173631489 2024-09-13T21:43:07.975 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (53s) 29s ago 53s 10.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:43:07.975 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (46s) 29s ago 46s 17.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:43:07.975 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (44s) 35s ago 43s 14.0M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (51s) 35s ago 50s 14.0M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:9283,8765,8443 running (7m) 29s ago 7m 448M - 17.2.7-1629-geb16b97b ab51d1bebd12 b7b1f8308caa 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283 running (5m) 35s ago 5m 402M - 17.2.7-1629-geb16b97b ab51d1bebd12 bdaf3e955341 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (7m) 29s ago 7m 41.3M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 f49a62e4f3c3 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (5m) 35s ago 5m 31.8M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 66c9116315ae 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (6m) 29s ago 6m 16.4M - 1.5.0 0da6a335fe13 d6e79b36f728 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (5m) 35s ago 5m 15.6M - 1.5.0 0da6a335fe13 513bc6bacbbd 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (4m) 29s ago 4m 44.6M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 6e0bbff1ac3f 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (4m) 29s ago 4m 45.7M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (3m) 29s ago 3m 43.5M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (3m) 35s ago 3m 44.6M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:43:07.976 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (2m) 35s ago 2m 42.4M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:43:07.977 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (2m) 35s ago 2m 44.9M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:43:07.977 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (4m) 29s ago 5m 51.5M - 2.43.0 a07b618ecd1d 5d5878bd99c5 2024-09-13T21:43:07.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.976+0000 7f1b8cc46640 1 -- 172.21.15.119:0/1469533731 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1b7406ed60 msgr2=0x7f1b74071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.976+0000 7f1b8cc46640 1 --2- 172.21.15.119:0/1469533731 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1b7406ed60 0x7f1b74071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b70004ed0 tx=0x7f1b7000b040 comp rx=0 tx=0).stop 2024-09-13T21:43:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.976+0000 7f1b8cc46640 1 -- 172.21.15.119:0/1469533731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b880fb430 msgr2=0x7f1b8810fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.976+0000 7f1b8cc46640 1 --2- 172.21.15.119:0/1469533731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b880fb430 0x7f1b8810fdc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1b780043d0 tx=0x7f1b78009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.976+0000 7f1b8cc46640 1 -- 172.21.15.119:0/1469533731 shutdown_connections 2024-09-13T21:43:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.976+0000 7f1b8cc46640 1 --2- 172.21.15.119:0/1469533731 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1b7406ed60 0x7f1b74071210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.976+0000 7f1b8cc46640 1 --2- 172.21.15.119:0/1469533731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b880fc700 0x7f1b88112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.976+0000 7f1b8cc46640 1 --2- 172.21.15.119:0/1469533731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b880fb430 0x7f1b8810fdc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.976+0000 7f1b8cc46640 1 -- 172.21.15.119:0/1469533731 >> 172.21.15.119:0/1469533731 conn(0x7f1b880f6c10 msgr2=0x7f1b880f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.976+0000 7f1b8cc46640 1 -- 172.21.15.119:0/1469533731 shutdown_connections 2024-09-13T21:43:07.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:07.976+0000 7f1b8cc46640 1 -- 172.21.15.119:0/1469533731 wait complete. 2024-09-13T21:43:08.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.063+0000 7f3c8c21b640 1 -- 172.21.15.119:0/4174124558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c840fb460 msgr2=0x7f3c840fb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.063+0000 7f3c8c21b640 1 --2- 172.21.15.119:0/4174124558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c840fb460 0x7f3c840fb870 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3c800048d0 tx=0x7f3c80009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 -- 172.21.15.119:0/4174124558 shutdown_connections 2024-09-13T21:43:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 --2- 172.21.15.119:0/4174124558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c840fc730 0x7f3c840fcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 --2- 172.21.15.119:0/4174124558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c840fb460 0x7f3c840fb870 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 -- 172.21.15.119:0/4174124558 >> 172.21.15.119:0/4174124558 conn(0x7f3c840f6c40 msgr2=0x7f3c840f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 -- 172.21.15.119:0/4174124558 shutdown_connections 2024-09-13T21:43:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 -- 172.21.15.119:0/4174124558 wait complete. 2024-09-13T21:43:08.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 Processor -- start 2024-09-13T21:43:08.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 -- start start 2024-09-13T21:43:08.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c840fb460 0x7f3c8410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:08.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c840fc730 0x7f3c8410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:08.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8410dc30 con 0x7f3c840fc730 2024-09-13T21:43:08.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.064+0000 7f3c8c21b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8410e400 con 0x7f3c840fb460 2024-09-13T21:43:08.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c897b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c840fc730 0x7f3c8410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:08.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c89fb7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c840fb460 0x7f3c8410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:08.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c897b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c840fc730 0x7f3c8410d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34928/0 (socket says 172.21.15.119:34928) 2024-09-13T21:43:08.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c897b6640 1 -- 172.21.15.119:0/3092603032 learned_addr learned my addr 172.21.15.119:0/3092603032 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:08.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c897b6640 1 -- 172.21.15.119:0/3092603032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c840fb460 msgr2=0x7f3c8410d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c897b6640 1 --2- 172.21.15.119:0/3092603032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c840fb460 0x7f3c8410d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c897b6640 1 -- 172.21.15.119:0/3092603032 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c80005040 con 0x7f3c840fc730 2024-09-13T21:43:08.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c897b6640 1 --2- 172.21.15.119:0/3092603032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c840fc730 0x7f3c8410d5e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400eb70 tx=0x7f3c7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:08.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c7a7fc640 1 -- 172.21.15.119:0/3092603032 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c74007c30 con 0x7f3c840fc730 2024-09-13T21:43:08.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c7a7fc640 1 -- 172.21.15.119:0/3092603032 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c7400f040 con 0x7f3c840fc730 2024-09-13T21:43:08.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c8c21b640 1 -- 172.21.15.119:0/3092603032 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8410e630 con 0x7f3c840fc730 2024-09-13T21:43:08.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c8c21b640 1 -- 172.21.15.119:0/3092603032 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8410ebd0 con 0x7f3c840fc730 2024-09-13T21:43:08.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.065+0000 7f3c7a7fc640 1 -- 172.21.15.119:0/3092603032 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c740094e0 con 0x7f3c840fc730 2024-09-13T21:43:08.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.067+0000 7f3c8c21b640 1 -- 172.21.15.119:0/3092603032 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c840fa8c0 con 0x7f3c840fc730 2024-09-13T21:43:08.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.067+0000 7f3c7a7fc640 1 -- 172.21.15.119:0/3092603032 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3c74009780 con 0x7f3c840fc730 2024-09-13T21:43:08.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.068+0000 7f3c7a7fc640 1 --2- 172.21.15.119:0/3092603032 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c7006ed50 0x7f3c70071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:08.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.068+0000 7f3c7a7fc640 1 -- 172.21.15.119:0/3092603032 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3c7408dda0 con 0x7f3c840fc730 2024-09-13T21:43:08.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.068+0000 7f3c89fb7640 1 --2- 172.21.15.119:0/3092603032 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c7006ed50 0x7f3c70071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:08.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.069+0000 7f3c89fb7640 1 --2- 172.21.15.119:0/3092603032 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c7006ed50 0x7f3c70071200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3c80000c00 tx=0x7f3c80035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:08.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.073+0000 7f3c7a7fc640 1 -- 172.21.15.119:0/3092603032 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3c7404e2a0 con 0x7f3c840fc730 2024-09-13T21:43:08.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.345+0000 7f3c8c21b640 1 -- 172.21.15.119:0/3092603032 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3c84104f60 con 0x7f3c840fc730 2024-09-13T21:43:08.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.346+0000 7f3c7a7fc640 1 -- 172.21.15.119:0/3092603032 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f3c7405afa0 con 0x7f3c840fc730 2024-09-13T21:43:08.347 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:43:08.347 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:43:08.348 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 14 2024-09-13T21:43:08.349 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:43:08.349 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:43:08.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.348+0000 7f3c8c21b640 1 -- 172.21.15.119:0/3092603032 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c7006ed50 msgr2=0x7f3c70071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.348+0000 7f3c8c21b640 1 --2- 172.21.15.119:0/3092603032 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c7006ed50 0x7f3c70071200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3c80000c00 tx=0x7f3c80035040 comp rx=0 tx=0).stop 2024-09-13T21:43:08.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.348+0000 7f3c8c21b640 1 -- 172.21.15.119:0/3092603032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c840fc730 msgr2=0x7f3c8410d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.348+0000 7f3c8c21b640 1 --2- 172.21.15.119:0/3092603032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c840fc730 0x7f3c8410d5e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400eb70 tx=0x7f3c7400b040 comp rx=0 tx=0).stop 2024-09-13T21:43:08.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.349+0000 7f3c8c21b640 1 -- 172.21.15.119:0/3092603032 shutdown_connections 2024-09-13T21:43:08.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.349+0000 7f3c8c21b640 1 --2- 172.21.15.119:0/3092603032 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f3c7006ed50 0x7f3c70071200 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.349+0000 7f3c8c21b640 1 --2- 172.21.15.119:0/3092603032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c840fc730 0x7f3c8410d5e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.349+0000 7f3c8c21b640 1 --2- 172.21.15.119:0/3092603032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c840fb460 0x7f3c8410d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.349+0000 7f3c8c21b640 1 -- 172.21.15.119:0/3092603032 >> 172.21.15.119:0/3092603032 conn(0x7f3c840f6c40 msgr2=0x7f3c840f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:08.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.349+0000 7f3c8c21b640 1 -- 172.21.15.119:0/3092603032 shutdown_connections 2024-09-13T21:43:08.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.349+0000 7f3c8c21b640 1 -- 172.21.15.119:0/3092603032 wait complete. 2024-09-13T21:43:08.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.439+0000 7f4f61ec8640 1 -- 172.21.15.119:0/1975969131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f5c0fc700 msgr2=0x7f4f5c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.439+0000 7f4f61ec8640 1 --2- 172.21.15.119:0/1975969131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f5c0fc700 0x7f4f5c0fcb70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4f500048d0 tx=0x7f4f50009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.439+0000 7f4f61ec8640 1 -- 172.21.15.119:0/1975969131 shutdown_connections 2024-09-13T21:43:08.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.439+0000 7f4f61ec8640 1 --2- 172.21.15.119:0/1975969131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f5c0fc700 0x7f4f5c0fcb70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.439+0000 7f4f61ec8640 1 --2- 172.21.15.119:0/1975969131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f5c0fb430 0x7f4f5c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.439+0000 7f4f61ec8640 1 -- 172.21.15.119:0/1975969131 >> 172.21.15.119:0/1975969131 conn(0x7f4f5c0f6c10 msgr2=0x7f4f5c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:08.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.439+0000 7f4f61ec8640 1 -- 172.21.15.119:0/1975969131 shutdown_connections 2024-09-13T21:43:08.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.439+0000 7f4f61ec8640 1 -- 172.21.15.119:0/1975969131 wait complete. 2024-09-13T21:43:08.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.440+0000 7f4f61ec8640 1 Processor -- start 2024-09-13T21:43:08.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.440+0000 7f4f61ec8640 1 -- start start 2024-09-13T21:43:08.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.440+0000 7f4f61ec8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f5c0fb430 0x7f4f5c10fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:08.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.440+0000 7f4f61ec8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f5c0fc700 0x7f4f5c1122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:08.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.440+0000 7f4f61ec8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c065c80 con 0x7f4f5c0fb430 2024-09-13T21:43:08.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.440+0000 7f4f61ec8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c065df0 con 0x7f4f5c0fc700 2024-09-13T21:43:08.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.440+0000 7f4f5b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f5c0fb430 0x7f4f5c10fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:08.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.440+0000 7f4f5b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f5c0fb430 0x7f4f5c10fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34938/0 (socket says 172.21.15.119:34938) 2024-09-13T21:43:08.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.440+0000 7f4f5b7fe640 1 -- 172.21.15.119:0/2932354937 learned_addr learned my addr 172.21.15.119:0/2932354937 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:08.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.440+0000 7f4f5affd640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f5c0fc700 0x7f4f5c1122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:08.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.441+0000 7f4f5b7fe640 1 -- 172.21.15.119:0/2932354937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f5c0fc700 msgr2=0x7f4f5c1122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.441+0000 7f4f5b7fe640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f5c0fc700 0x7f4f5c1122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.441+0000 7f4f5b7fe640 1 -- 172.21.15.119:0/2932354937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f50005040 con 0x7f4f5c0fb430 2024-09-13T21:43:08.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.441+0000 7f4f5affd640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f5c0fc700 0x7f4f5c1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:43:08.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.441+0000 7f4f5b7fe640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f5c0fb430 0x7f4f5c10fda0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00eb70 tx=0x7f4f4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:08.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.441+0000 7f4f43fff640 1 -- 172.21.15.119:0/2932354937 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4c007c30 con 0x7f4f5c0fb430 2024-09-13T21:43:08.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.441+0000 7f4f61ec8640 1 -- 172.21.15.119:0/2932354937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c112830 con 0x7f4f5c0fb430 2024-09-13T21:43:08.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.441+0000 7f4f43fff640 1 -- 172.21.15.119:0/2932354937 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4f4c00f040 con 0x7f4f5c0fb430 2024-09-13T21:43:08.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.441+0000 7f4f61ec8640 1 -- 172.21.15.119:0/2932354937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c112dd0 con 0x7f4f5c0fb430 2024-09-13T21:43:08.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.442+0000 7f4f43fff640 1 -- 172.21.15.119:0/2932354937 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4c009420 con 0x7f4f5c0fb430 2024-09-13T21:43:08.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.442+0000 7f4f61ec8640 1 -- 172.21.15.119:0/2932354937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c0fa890 con 0x7f4f5c0fb430 2024-09-13T21:43:08.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.443+0000 7f4f43fff640 1 -- 172.21.15.119:0/2932354937 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4f4c009660 con 0x7f4f5c0fb430 2024-09-13T21:43:08.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.443+0000 7f4f43fff640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4f4406ed60 0x7f4f44071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:08.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.444+0000 7f4f43fff640 1 -- 172.21.15.119:0/2932354937 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4f4c08dda0 con 0x7f4f5c0fb430 2024-09-13T21:43:08.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.444+0000 7f4f5affd640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4f4406ed60 0x7f4f44071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:08.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.444+0000 7f4f5affd640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4f4406ed60 0x7f4f44071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4f50000c00 tx=0x7f4f50035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:08.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.448+0000 7f4f43fff640 1 -- 172.21.15.119:0/2932354937 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4f4c05afa0 con 0x7f4f5c0fb430 2024-09-13T21:43:08.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:08 smithi119 ceph-mon[27653]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:08.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:08 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3092603032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:08.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.678+0000 7f4f61ec8640 1 -- 172.21.15.119:0/2932354937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4f5c113170 con 0x7f4f5c0fb430 2024-09-13T21:43:08.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.678+0000 7f4f43fff640 1 -- 172.21.15.119:0/2932354937 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1820 (secure 0 0 0) 0x7f4f4c019730 con 0x7f4f5c0fb430 2024-09-13T21:43:08.680 INFO:teuthology.orchestra.run.smithi119.stdout:e18 2024-09-13T21:43:08.680 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:43:08.680 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:43:08.680 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 18 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:42:30.479212+0000 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:43:08.681 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:43:08.682 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:43:08.682 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:43:08.682 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:43:08.682 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:43:08.683 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:43:08.684 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:43:08.685 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:43:08.685 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:43:08.685 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:43:08.685 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:43:08.685 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:43:08.686 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 18 2024-09-13T21:43:08.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.681+0000 7f4f61ec8640 1 -- 172.21.15.119:0/2932354937 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4f4406ed60 msgr2=0x7f4f44071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.681+0000 7f4f61ec8640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4f4406ed60 0x7f4f44071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4f50000c00 tx=0x7f4f50035040 comp rx=0 tx=0).stop 2024-09-13T21:43:08.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.681+0000 7f4f61ec8640 1 -- 172.21.15.119:0/2932354937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f5c0fb430 msgr2=0x7f4f5c10fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.681+0000 7f4f61ec8640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f5c0fb430 0x7f4f5c10fda0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00eb70 tx=0x7f4f4c00b040 comp rx=0 tx=0).stop 2024-09-13T21:43:08.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.681+0000 7f4f61ec8640 1 -- 172.21.15.119:0/2932354937 shutdown_connections 2024-09-13T21:43:08.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.681+0000 7f4f61ec8640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4f4406ed60 0x7f4f44071210 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.681+0000 7f4f61ec8640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f5c0fc700 0x7f4f5c1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.681+0000 7f4f61ec8640 1 --2- 172.21.15.119:0/2932354937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f5c0fb430 0x7f4f5c10fda0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.681+0000 7f4f61ec8640 1 -- 172.21.15.119:0/2932354937 >> 172.21.15.119:0/2932354937 conn(0x7f4f5c0f6c10 msgr2=0x7f4f5c0f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:08.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.681+0000 7f4f61ec8640 1 -- 172.21.15.119:0/2932354937 shutdown_connections 2024-09-13T21:43:08.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.681+0000 7f4f61ec8640 1 -- 172.21.15.119:0/2932354937 wait complete. 2024-09-13T21:43:08.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.772+0000 7f9307611640 1 -- 172.21.15.119:0/1825945508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9300071570 msgr2=0x7f930006faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.772+0000 7f9307611640 1 --2- 172.21.15.119:0/1825945508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9300071570 0x7f930006faa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009c50 tx=0x7f92fc004d10 comp rx=0 tx=0).stop 2024-09-13T21:43:08.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.772+0000 7f9307611640 1 -- 172.21.15.119:0/1825945508 shutdown_connections 2024-09-13T21:43:08.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.772+0000 7f9307611640 1 --2- 172.21.15.119:0/1825945508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930006ffe0 0x7f9300070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.772+0000 7f9307611640 1 --2- 172.21.15.119:0/1825945508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9300071570 0x7f930006faa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.772+0000 7f9307611640 1 -- 172.21.15.119:0/1825945508 >> 172.21.15.119:0/1825945508 conn(0x7f93000f7ce0 msgr2=0x7f93000fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:08.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.773+0000 7f9307611640 1 -- 172.21.15.119:0/1825945508 shutdown_connections 2024-09-13T21:43:08.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.773+0000 7f9307611640 1 -- 172.21.15.119:0/1825945508 wait complete. 2024-09-13T21:43:08.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.773+0000 7f9307611640 1 Processor -- start 2024-09-13T21:43:08.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.773+0000 7f9307611640 1 -- start start 2024-09-13T21:43:08.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.773+0000 7f9307611640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f930006ffe0 0x7f930010f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:08.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.773+0000 7f9307611640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9300071570 0x7f930010f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:08.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.773+0000 7f9307611640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930010fe10 con 0x7f930006ffe0 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.773+0000 7f9307611640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9300110630 con 0x7f9300071570 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.774+0000 7f93053ad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f930006ffe0 0x7f930010f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.774+0000 7f93053ad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f930006ffe0 0x7f930010f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34962/0 (socket says 172.21.15.119:34962) 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.774+0000 7f93053ad640 1 -- 172.21.15.119:0/3422393950 learned_addr learned my addr 172.21.15.119:0/3422393950 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.774+0000 7f9304bac640 1 --2- 172.21.15.119:0/3422393950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9300071570 0x7f930010f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.774+0000 7f93053ad640 1 -- 172.21.15.119:0/3422393950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9300071570 msgr2=0x7f930010f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.774+0000 7f93053ad640 1 --2- 172.21.15.119:0/3422393950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9300071570 0x7f930010f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.774+0000 7f93053ad640 1 -- 172.21.15.119:0/3422393950 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc0098b0 con 0x7f930006ffe0 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.774+0000 7f93053ad640 1 --2- 172.21.15.119:0/3422393950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f930006ffe0 0x7f930010f280 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f92fc000f80 tx=0x7f92fc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.774+0000 7f92f5ffb640 1 -- 172.21.15.119:0/3422393950 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92fc009710 con 0x7f930006ffe0 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.775+0000 7f92f5ffb640 1 -- 172.21.15.119:0/3422393950 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f92fc032b10 con 0x7f930006ffe0 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.775+0000 7f9307611640 1 -- 172.21.15.119:0/3422393950 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9300110860 con 0x7f930006ffe0 2024-09-13T21:43:08.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.775+0000 7f92f5ffb640 1 -- 172.21.15.119:0/3422393950 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92fc03db30 con 0x7f930006ffe0 2024-09-13T21:43:08.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.775+0000 7f9307611640 1 -- 172.21.15.119:0/3422393950 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9300110d80 con 0x7f930006ffe0 2024-09-13T21:43:08.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.776+0000 7f9307611640 1 -- 172.21.15.119:0/3422393950 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93000fb9a0 con 0x7f930006ffe0 2024-09-13T21:43:08.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.776+0000 7f92f5ffb640 1 -- 172.21.15.119:0/3422393950 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f92fc02f030 con 0x7f930006ffe0 2024-09-13T21:43:08.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.777+0000 7f92f5ffb640 1 --2- 172.21.15.119:0/3422393950 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f92ec06ed50 0x7f92ec071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:08.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.777+0000 7f9304bac640 1 --2- 172.21.15.119:0/3422393950 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f92ec06ed50 0x7f92ec071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:08.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.777+0000 7f92f5ffb640 1 -- 172.21.15.119:0/3422393950 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f92fc0af230 con 0x7f930006ffe0 2024-09-13T21:43:08.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.778+0000 7f9304bac640 1 --2- 172.21.15.119:0/3422393950 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f92ec06ed50 0x7f92ec071200 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f930010f030 tx=0x7f92f000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:08.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.782+0000 7f92f5ffb640 1 -- 172.21.15.119:0/3422393950 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f92fc07c300 con 0x7f930006ffe0 2024-09-13T21:43:08.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:08 smithi155 ceph-mon[34732]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:08.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:08 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3092603032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:08.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.991+0000 7f9307611640 1 -- 172.21.15.119:0/3422393950 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93001110d0 con 0x7f92ec06ed50 2024-09-13T21:43:08.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.992+0000 7f92f5ffb640 1 -- 172.21.15.119:0/3422393950 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f93001110d0 con 0x7f92ec06ed50 2024-09-13T21:43:08.994 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:43:08.994 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", 2024-09-13T21:43:08.994 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:43:08.994 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:43:08.994 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [], 2024-09-13T21:43:08.994 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "", 2024-09-13T21:43:08.994 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 image", 2024-09-13T21:43:08.995 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:43:08.995 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:43:08.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.995+0000 7f9307611640 1 -- 172.21.15.119:0/3422393950 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f92ec06ed50 msgr2=0x7f92ec071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.995+0000 7f9307611640 1 --2- 172.21.15.119:0/3422393950 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f92ec06ed50 0x7f92ec071200 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f930010f030 tx=0x7f92f000b040 comp rx=0 tx=0).stop 2024-09-13T21:43:08.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.995+0000 7f9307611640 1 -- 172.21.15.119:0/3422393950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f930006ffe0 msgr2=0x7f930010f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:08.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.995+0000 7f9307611640 1 --2- 172.21.15.119:0/3422393950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f930006ffe0 0x7f930010f280 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f92fc000f80 tx=0x7f92fc004d10 comp rx=0 tx=0).stop 2024-09-13T21:43:08.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.995+0000 7f9307611640 1 -- 172.21.15.119:0/3422393950 shutdown_connections 2024-09-13T21:43:08.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.995+0000 7f9307611640 1 --2- 172.21.15.119:0/3422393950 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f92ec06ed50 0x7f92ec071200 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.995+0000 7f9307611640 1 --2- 172.21.15.119:0/3422393950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9300071570 0x7f930010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.995+0000 7f9307611640 1 --2- 172.21.15.119:0/3422393950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f930006ffe0 0x7f930010f280 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:08.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.995+0000 7f9307611640 1 -- 172.21.15.119:0/3422393950 >> 172.21.15.119:0/3422393950 conn(0x7f93000f7ce0 msgr2=0x7f93000f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:08.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.996+0000 7f9307611640 1 -- 172.21.15.119:0/3422393950 shutdown_connections 2024-09-13T21:43:08.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:08.996+0000 7f9307611640 1 -- 172.21.15.119:0/3422393950 wait complete. 2024-09-13T21:43:09.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.088+0000 7f604df01640 1 -- 172.21.15.119:0/3275145078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60480fd810 msgr2=0x7f60480fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:09.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.088+0000 7f604df01640 1 --2- 172.21.15.119:0/3275145078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60480fd810 0x7f60480fdc80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f603c0048d0 tx=0x7f603c009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:09.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.088+0000 7f604df01640 1 -- 172.21.15.119:0/3275145078 shutdown_connections 2024-09-13T21:43:09.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.088+0000 7f604df01640 1 --2- 172.21.15.119:0/3275145078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60480fd810 0x7f60480fdc80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:09.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.088+0000 7f604df01640 1 --2- 172.21.15.119:0/3275145078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60480fc540 0x7f60480fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:09.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.088+0000 7f604df01640 1 -- 172.21.15.119:0/3275145078 >> 172.21.15.119:0/3275145078 conn(0x7f60480f7d00 msgr2=0x7f60480fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:09.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.088+0000 7f604df01640 1 -- 172.21.15.119:0/3275145078 shutdown_connections 2024-09-13T21:43:09.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.088+0000 7f604df01640 1 -- 172.21.15.119:0/3275145078 wait complete. 2024-09-13T21:43:09.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f604df01640 1 Processor -- start 2024-09-13T21:43:09.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f604df01640 1 -- start start 2024-09-13T21:43:09.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f604df01640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60480fc540 0x7f604810d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:09.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f604df01640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60480fd810 0x7f604810d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f604df01640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604810dbe0 con 0x7f60480fc540 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f604df01640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604810e400 con 0x7f60480fd810 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f60477fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60480fc540 0x7f604810d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f60477fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60480fc540 0x7f604810d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34978/0 (socket says 172.21.15.119:34978) 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f60477fe640 1 -- 172.21.15.119:0/1783277646 learned_addr learned my addr 172.21.15.119:0/1783277646 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f6046ffd640 1 --2- 172.21.15.119:0/1783277646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60480fd810 0x7f604810d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f60477fe640 1 -- 172.21.15.119:0/1783277646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60480fd810 msgr2=0x7f604810d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f60477fe640 1 --2- 172.21.15.119:0/1783277646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60480fd810 0x7f604810d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.089+0000 7f60477fe640 1 -- 172.21.15.119:0/1783277646 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c005040 con 0x7f60480fc540 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.090+0000 7f60477fe640 1 --2- 172.21.15.119:0/1783277646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60480fc540 0x7f604810d050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f603800eb70 tx=0x7f603800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.090+0000 7f602ffff640 1 -- 172.21.15.119:0/1783277646 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6038007c30 con 0x7f60480fc540 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.090+0000 7f602ffff640 1 -- 172.21.15.119:0/1783277646 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f603800f040 con 0x7f60480fc540 2024-09-13T21:43:09.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.090+0000 7f604df01640 1 -- 172.21.15.119:0/1783277646 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604810e630 con 0x7f60480fc540 2024-09-13T21:43:09.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.090+0000 7f604df01640 1 -- 172.21.15.119:0/1783277646 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604810ebd0 con 0x7f60480fc540 2024-09-13T21:43:09.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.090+0000 7f602ffff640 1 -- 172.21.15.119:0/1783277646 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f603800ca60 con 0x7f60480fc540 2024-09-13T21:43:09.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.091+0000 7f604df01640 1 -- 172.21.15.119:0/1783277646 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6034005240 con 0x7f60480fc540 2024-09-13T21:43:09.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.092+0000 7f602ffff640 1 -- 172.21.15.119:0/1783277646 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f603800cbc0 con 0x7f60480fc540 2024-09-13T21:43:09.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.092+0000 7f602ffff640 1 --2- 172.21.15.119:0/1783277646 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f603006ed60 0x7f6030071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:09.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.092+0000 7f602ffff640 1 -- 172.21.15.119:0/1783277646 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f603808dcf0 con 0x7f60480fc540 2024-09-13T21:43:09.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.092+0000 7f6046ffd640 1 --2- 172.21.15.119:0/1783277646 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f603006ed60 0x7f6030071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:09.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.093+0000 7f6046ffd640 1 --2- 172.21.15.119:0/1783277646 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f603006ed60 0x7f6030071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f603c007ac0 tx=0x7f603c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:09.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.100+0000 7f602ffff640 1 -- 172.21.15.119:0/1783277646 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f603805afb0 con 0x7f60480fc540 2024-09-13T21:43:09.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.365+0000 7f604df01640 1 -- 172.21.15.119:0/1783277646 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f60340054f0 con 0x7f60480fc540 2024-09-13T21:43:09.369 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:43:09.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.367+0000 7f602ffff640 1 -- 172.21.15.119:0/1783277646 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f603805a950 con 0x7f60480fc540 2024-09-13T21:43:09.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.370+0000 7f604df01640 1 -- 172.21.15.119:0/1783277646 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f603006ed60 msgr2=0x7f6030071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:09.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.370+0000 7f604df01640 1 --2- 172.21.15.119:0/1783277646 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f603006ed60 0x7f6030071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f603c007ac0 tx=0x7f603c035040 comp rx=0 tx=0).stop 2024-09-13T21:43:09.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.370+0000 7f604df01640 1 -- 172.21.15.119:0/1783277646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60480fc540 msgr2=0x7f604810d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:09.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.370+0000 7f604df01640 1 --2- 172.21.15.119:0/1783277646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60480fc540 0x7f604810d050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f603800eb70 tx=0x7f603800b040 comp rx=0 tx=0).stop 2024-09-13T21:43:09.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.370+0000 7f604df01640 1 -- 172.21.15.119:0/1783277646 shutdown_connections 2024-09-13T21:43:09.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.370+0000 7f604df01640 1 --2- 172.21.15.119:0/1783277646 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f603006ed60 0x7f6030071210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:09.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.370+0000 7f604df01640 1 --2- 172.21.15.119:0/1783277646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60480fd810 0x7f604810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:09.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.370+0000 7f604df01640 1 --2- 172.21.15.119:0/1783277646 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60480fc540 0x7f604810d050 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:09.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.370+0000 7f604df01640 1 -- 172.21.15.119:0/1783277646 >> 172.21.15.119:0/1783277646 conn(0x7f60480f7d00 msgr2=0x7f60480f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:09.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.371+0000 7f604df01640 1 -- 172.21.15.119:0/1783277646 shutdown_connections 2024-09-13T21:43:09.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:09.371+0000 7f604df01640 1 -- 172.21.15.119:0/1783277646 wait complete. 2024-09-13T21:43:09.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:09 smithi119 ceph-mon[27653]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:09.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:09 smithi119 ceph-mon[27653]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-13T21:43:09.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:09 smithi119 ceph-mon[27653]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:09.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:09 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2932354937' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:43:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:09 smithi155 ceph-mon[34732]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:09 smithi155 ceph-mon[34732]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-13T21:43:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:09 smithi155 ceph-mon[34732]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:09 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2932354937' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:43:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:10 smithi119 ceph-mon[27653]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:10 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1783277646' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:43:10.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:10 smithi155 ceph-mon[34732]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:10.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:10 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1783277646' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:43:11.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:11 smithi119 ceph-mon[27653]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T21:43:11.734 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:11 smithi155 ceph-mon[34732]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T21:43:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:13 smithi155 ceph-mon[34732]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T21:43:13.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:13 smithi119 ceph-mon[27653]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T21:43:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:15 smithi119 ceph-mon[27653]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:15.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:15 smithi155 ceph-mon[34732]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:15.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:17.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:17 smithi119 ceph-mon[27653]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:17 smithi155 ceph-mon[34732]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:43:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:19 smithi155 ceph-mon[34732]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:43:19.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:19 smithi119 ceph-mon[27653]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T21:43:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:21 smithi155 ceph-mon[34732]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:21.867 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:21 smithi119 ceph-mon[27653]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:23 smithi155 ceph-mon[34732]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:23 smithi119 ceph-mon[27653]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:25 smithi155 ceph-mon[34732]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:25.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:25 smithi119 ceph-mon[27653]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:27 smithi155 ceph-mon[34732]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:27.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:27 smithi119 ceph-mon[27653]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:29.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:29 smithi155 ceph-mon[34732]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:29.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:29 smithi119 ceph-mon[27653]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:30.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:31.602 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:31 smithi119 ceph-mon[27653]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:31.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:31 smithi155 ceph-mon[34732]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:33 smithi155 ceph-mon[34732]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:43:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:33 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:43:33.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:33 smithi119 ceph-mon[27653]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:33.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:43:33.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:43:33.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:33 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:43:34.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:34 smithi155 ceph-mon[34732]: Upgrade: Target is version 19.1.1-324-gecab7be5 (unknown) 2024-09-13T21:43:34.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:34 smithi155 ceph-mon[34732]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T21:43:34.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:34 smithi155 ceph-mon[34732]: Upgrade: Need to upgrade myself (mgr.smithi119.gwjxmq) 2024-09-13T21:43:34.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:34 smithi155 ceph-mon[34732]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 on smithi155 2024-09-13T21:43:34.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:34 smithi119 ceph-mon[27653]: Upgrade: Target is version 19.1.1-324-gecab7be5 (unknown) 2024-09-13T21:43:34.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:34 smithi119 ceph-mon[27653]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T21:43:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:34 smithi119 ceph-mon[27653]: Upgrade: Need to upgrade myself (mgr.smithi119.gwjxmq) 2024-09-13T21:43:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:34 smithi119 ceph-mon[27653]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 on smithi155 2024-09-13T21:43:35.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:35 smithi155 ceph-mon[34732]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:35.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:35 smithi119 ceph-mon[27653]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:37 smithi155 ceph-mon[34732]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:37.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:37 smithi119 ceph-mon[27653]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:39.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.494+0000 7f4a90e3f640 1 -- 172.21.15.119:0/837391556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a8c0fe4c0 msgr2=0x7f4a8c0fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:39.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.494+0000 7f4a90e3f640 1 --2- 172.21.15.119:0/837391556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a8c0fe4c0 0x7f4a8c0fa620 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a800048d0 tx=0x7f4a80009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.495+0000 7f4a90e3f640 1 -- 172.21.15.119:0/837391556 shutdown_connections 2024-09-13T21:43:39.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.495+0000 7f4a90e3f640 1 --2- 172.21.15.119:0/837391556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a8c0fe4c0 0x7f4a8c0fa620 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.495+0000 7f4a90e3f640 1 --2- 172.21.15.119:0/837391556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c0fdb70 0x7f4a8c0fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.495+0000 7f4a90e3f640 1 -- 172.21.15.119:0/837391556 >> 172.21.15.119:0/837391556 conn(0x7f4a8c0f6390 msgr2=0x7f4a8c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:39.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.495+0000 7f4a90e3f640 1 -- 172.21.15.119:0/837391556 shutdown_connections 2024-09-13T21:43:39.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.495+0000 7f4a90e3f640 1 -- 172.21.15.119:0/837391556 wait complete. 2024-09-13T21:43:39.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.495+0000 7f4a90e3f640 1 Processor -- start 2024-09-13T21:43:39.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a90e3f640 1 -- start start 2024-09-13T21:43:39.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a90e3f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a8c0fdb70 0x7f4a8c10cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:39.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a90e3f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c0fe4c0 0x7f4a8c10d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:39.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a90e3f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c10dab0 con 0x7f4a8c0fdb70 2024-09-13T21:43:39.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a90e3f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c10e260 con 0x7f4a8c0fe4c0 2024-09-13T21:43:39.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a89d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c0fe4c0 0x7f4a8c10d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:39.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a89d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c0fe4c0 0x7f4a8c10d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:60840/0 (socket says 172.21.15.119:60840) 2024-09-13T21:43:39.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a89d9b640 1 -- 172.21.15.119:0/4168584188 learned_addr learned my addr 172.21.15.119:0/4168584188 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:39.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a8a59c640 1 --2- 172.21.15.119:0/4168584188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a8c0fdb70 0x7f4a8c10cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:39.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a89d9b640 1 -- 172.21.15.119:0/4168584188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a8c0fdb70 msgr2=0x7f4a8c10cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:39.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a89d9b640 1 --2- 172.21.15.119:0/4168584188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a8c0fdb70 0x7f4a8c10cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.496+0000 7f4a89d9b640 1 -- 172.21.15.119:0/4168584188 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a80005040 con 0x7f4a8c0fe4c0 2024-09-13T21:43:39.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.497+0000 7f4a89d9b640 1 --2- 172.21.15.119:0/4168584188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c0fe4c0 0x7f4a8c10d460 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4a800047f0 tx=0x7f4a80009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:39.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.497+0000 7f4a7affd640 1 -- 172.21.15.119:0/4168584188 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a80038070 con 0x7f4a8c0fe4c0 2024-09-13T21:43:39.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.497+0000 7f4a7affd640 1 -- 172.21.15.119:0/4168584188 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4a8002ac00 con 0x7f4a8c0fe4c0 2024-09-13T21:43:39.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.497+0000 7f4a7affd640 1 -- 172.21.15.119:0/4168584188 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a8003d660 con 0x7f4a8c0fe4c0 2024-09-13T21:43:39.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.497+0000 7f4a90e3f640 1 -- 172.21.15.119:0/4168584188 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8c10e490 con 0x7f4a8c0fe4c0 2024-09-13T21:43:39.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.497+0000 7f4a90e3f640 1 -- 172.21.15.119:0/4168584188 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8c10e890 con 0x7f4a8c0fe4c0 2024-09-13T21:43:39.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.499+0000 7f4a90e3f640 1 -- 172.21.15.119:0/4168584188 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8c0fa010 con 0x7f4a8c0fe4c0 2024-09-13T21:43:39.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.499+0000 7f4a7affd640 1 -- 172.21.15.119:0/4168584188 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4a80030020 con 0x7f4a8c0fe4c0 2024-09-13T21:43:39.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.500+0000 7f4a7affd640 1 --2- 172.21.15.119:0/4168584188 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4a7406ed50 0x7f4a74071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:39.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.500+0000 7f4a8a59c640 1 --2- 172.21.15.119:0/4168584188 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4a7406ed50 0x7f4a74071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:39.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.500+0000 7f4a7affd640 1 -- 172.21.15.119:0/4168584188 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4a800ae9e0 con 0x7f4a8c0fe4c0 2024-09-13T21:43:39.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.501+0000 7f4a8a59c640 1 --2- 172.21.15.119:0/4168584188 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4a7406ed50 0x7f4a74071200 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c004a70 tx=0x7f4a7c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:39.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.508+0000 7f4a7affd640 1 -- 172.21.15.119:0/4168584188 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4a8007ba90 con 0x7f4a8c0fe4c0 2024-09-13T21:43:39.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.748+0000 7f4a90e3f640 1 -- 172.21.15.119:0/4168584188 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a8c10ec00 con 0x7f4a7406ed50 2024-09-13T21:43:39.750 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:39 smithi119 ceph-mon[27653]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:39.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.749+0000 7f4a7affd640 1 -- 172.21.15.119:0/4168584188 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f4a8c10ec00 con 0x7f4a7406ed50 2024-09-13T21:43:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.752+0000 7f4a90e3f640 1 -- 172.21.15.119:0/4168584188 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4a7406ed50 msgr2=0x7f4a74071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.752+0000 7f4a90e3f640 1 --2- 172.21.15.119:0/4168584188 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4a7406ed50 0x7f4a74071200 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c004a70 tx=0x7f4a7c00b040 comp rx=0 tx=0).stop 2024-09-13T21:43:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.752+0000 7f4a90e3f640 1 -- 172.21.15.119:0/4168584188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c0fe4c0 msgr2=0x7f4a8c10d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.752+0000 7f4a90e3f640 1 --2- 172.21.15.119:0/4168584188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c0fe4c0 0x7f4a8c10d460 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4a800047f0 tx=0x7f4a80009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.752+0000 7f4a90e3f640 1 -- 172.21.15.119:0/4168584188 shutdown_connections 2024-09-13T21:43:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.752+0000 7f4a90e3f640 1 --2- 172.21.15.119:0/4168584188 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f4a7406ed50 0x7f4a74071200 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.752+0000 7f4a90e3f640 1 --2- 172.21.15.119:0/4168584188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c0fe4c0 0x7f4a8c10d460 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.752+0000 7f4a90e3f640 1 --2- 172.21.15.119:0/4168584188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a8c0fdb70 0x7f4a8c10cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.752+0000 7f4a90e3f640 1 -- 172.21.15.119:0/4168584188 >> 172.21.15.119:0/4168584188 conn(0x7f4a8c0f6390 msgr2=0x7f4a8c0f79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.752+0000 7f4a90e3f640 1 -- 172.21.15.119:0/4168584188 shutdown_connections 2024-09-13T21:43:39.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.752+0000 7f4a90e3f640 1 -- 172.21.15.119:0/4168584188 wait complete. 2024-09-13T21:43:39.766 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:43:39.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:39 smithi155 ceph-mon[34732]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:39.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.838+0000 7f8842481640 1 -- 172.21.15.119:0/2633198834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f883c0ff720 msgr2=0x7f883c101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:39.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.838+0000 7f8842481640 1 --2- 172.21.15.119:0/2633198834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f883c0ff720 0x7f883c101b00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f88300048d0 tx=0x7f8830009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.838+0000 7f8842481640 1 -- 172.21.15.119:0/2633198834 shutdown_connections 2024-09-13T21:43:39.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.838+0000 7f8842481640 1 --2- 172.21.15.119:0/2633198834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f883c0ff720 0x7f883c101b00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.838+0000 7f8842481640 1 --2- 172.21.15.119:0/2633198834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c065ba0 0x7f883c0ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.838+0000 7f8842481640 1 -- 172.21.15.119:0/2633198834 >> 172.21.15.119:0/2633198834 conn(0x7f883c0f6c10 msgr2=0x7f883c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:39.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.838+0000 7f8842481640 1 -- 172.21.15.119:0/2633198834 shutdown_connections 2024-09-13T21:43:39.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.838+0000 7f8842481640 1 -- 172.21.15.119:0/2633198834 wait complete. 2024-09-13T21:43:39.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.839+0000 7f8842481640 1 Processor -- start 2024-09-13T21:43:39.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.839+0000 7f8842481640 1 -- start start 2024-09-13T21:43:39.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.839+0000 7f8842481640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f883c065ba0 0x7f883c10aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:39.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.839+0000 7f8842481640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c0ff720 0x7f883c10b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:39.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.839+0000 7f8842481640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c10ba70 con 0x7f883c065ba0 2024-09-13T21:43:39.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.839+0000 7f8842481640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c10c140 con 0x7f883c0ff720 2024-09-13T21:43:39.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.839+0000 7f883bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f883c065ba0 0x7f883c10aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:39.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.839+0000 7f883bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f883c065ba0 0x7f883c10aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50906/0 (socket says 172.21.15.119:50906) 2024-09-13T21:43:39.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.839+0000 7f883bfff640 1 -- 172.21.15.119:0/3939610051 learned_addr learned my addr 172.21.15.119:0/3939610051 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:39.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.839+0000 7f883b7fe640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c0ff720 0x7f883c10b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:39.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.840+0000 7f883bfff640 1 -- 172.21.15.119:0/3939610051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c0ff720 msgr2=0x7f883c10b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:39.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.840+0000 7f883bfff640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c0ff720 0x7f883c10b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:39.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.840+0000 7f883bfff640 1 -- 172.21.15.119:0/3939610051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830005040 con 0x7f883c065ba0 2024-09-13T21:43:39.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.840+0000 7f883b7fe640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c0ff720 0x7f883c10b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:43:39.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.840+0000 7f883bfff640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f883c065ba0 0x7f883c10aee0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f882c002a80 tx=0x7f882c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:39.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.840+0000 7f8838ff9640 1 -- 172.21.15.119:0/3939610051 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f882c007c30 con 0x7f883c065ba0 2024-09-13T21:43:39.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.840+0000 7f8838ff9640 1 -- 172.21.15.119:0/3939610051 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f882c00f040 con 0x7f883c065ba0 2024-09-13T21:43:39.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.841+0000 7f8842481640 1 -- 172.21.15.119:0/3939610051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c10c3d0 con 0x7f883c065ba0 2024-09-13T21:43:39.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.841+0000 7f8842481640 1 -- 172.21.15.119:0/3939610051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c10c970 con 0x7f883c065ba0 2024-09-13T21:43:39.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.842+0000 7f8838ff9640 1 -- 172.21.15.119:0/3939610051 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f882c009600 con 0x7f883c065ba0 2024-09-13T21:43:39.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.842+0000 7f8842481640 1 -- 172.21.15.119:0/3939610051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c0fa890 con 0x7f883c065ba0 2024-09-13T21:43:39.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.843+0000 7f8838ff9640 1 -- 172.21.15.119:0/3939610051 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f882c00d6b0 con 0x7f883c065ba0 2024-09-13T21:43:39.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.843+0000 7f8838ff9640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f882406eb80 0x7f8824071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:39.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.844+0000 7f8838ff9640 1 -- 172.21.15.119:0/3939610051 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f882c08dfd0 con 0x7f883c065ba0 2024-09-13T21:43:39.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.844+0000 7f883b7fe640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f882406eb80 0x7f8824071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:39.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.844+0000 7f883b7fe640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f882406eb80 0x7f8824071030 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f88300043d0 tx=0x7f883003a040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:39.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:39.848+0000 7f8838ff9640 1 -- 172.21.15.119:0/3939610051 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f882c05b100 con 0x7f883c065ba0 2024-09-13T21:43:40.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.023+0000 7f8842481640 1 -- 172.21.15.119:0/3939610051 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f883c10cc50 con 0x7f882406eb80 2024-09-13T21:43:40.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.024+0000 7f8838ff9640 1 -- 172.21.15.119:0/3939610051 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f883c10cc50 con 0x7f882406eb80 2024-09-13T21:43:40.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.027+0000 7f8842481640 1 -- 172.21.15.119:0/3939610051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f882406eb80 msgr2=0x7f8824071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.027+0000 7f8842481640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f882406eb80 0x7f8824071030 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f88300043d0 tx=0x7f883003a040 comp rx=0 tx=0).stop 2024-09-13T21:43:40.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.027+0000 7f8842481640 1 -- 172.21.15.119:0/3939610051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f883c065ba0 msgr2=0x7f883c10aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.027+0000 7f8842481640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f883c065ba0 0x7f883c10aee0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f882c002a80 tx=0x7f882c004570 comp rx=0 tx=0).stop 2024-09-13T21:43:40.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.027+0000 7f8842481640 1 -- 172.21.15.119:0/3939610051 shutdown_connections 2024-09-13T21:43:40.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.027+0000 7f8842481640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f882406eb80 0x7f8824071030 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.027+0000 7f8842481640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c0ff720 0x7f883c10b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.027+0000 7f8842481640 1 --2- 172.21.15.119:0/3939610051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f883c065ba0 0x7f883c10aee0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.027+0000 7f8842481640 1 -- 172.21.15.119:0/3939610051 >> 172.21.15.119:0/3939610051 conn(0x7f883c0f6c10 msgr2=0x7f883c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:40.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.028+0000 7f8842481640 1 -- 172.21.15.119:0/3939610051 shutdown_connections 2024-09-13T21:43:40.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.028+0000 7f8842481640 1 -- 172.21.15.119:0/3939610051 wait complete. 2024-09-13T21:43:40.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.109+0000 7fd444c67640 1 -- 172.21.15.119:0/1245985952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd440065ba0 msgr2=0x7fd4400ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.109+0000 7fd444c67640 1 --2- 172.21.15.119:0/1245985952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd440065ba0 0x7fd4400ff1e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd4300048d0 tx=0x7fd430009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.109+0000 7fd444c67640 1 -- 172.21.15.119:0/1245985952 shutdown_connections 2024-09-13T21:43:40.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.109+0000 7fd444c67640 1 --2- 172.21.15.119:0/1245985952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4400ff720 0x7fd440101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.109+0000 7fd444c67640 1 --2- 172.21.15.119:0/1245985952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd440065ba0 0x7fd4400ff1e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.109+0000 7fd444c67640 1 -- 172.21.15.119:0/1245985952 >> 172.21.15.119:0/1245985952 conn(0x7fd4400f6c10 msgr2=0x7fd4400f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:40.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.109+0000 7fd444c67640 1 -- 172.21.15.119:0/1245985952 shutdown_connections 2024-09-13T21:43:40.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.109+0000 7fd444c67640 1 -- 172.21.15.119:0/1245985952 wait complete. 2024-09-13T21:43:40.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.110+0000 7fd444c67640 1 Processor -- start 2024-09-13T21:43:40.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.110+0000 7fd444c67640 1 -- start start 2024-09-13T21:43:40.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.110+0000 7fd444c67640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd440065ba0 0x7fd44010d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:40.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.110+0000 7fd444c67640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4400ff720 0x7fd44010d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:40.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.110+0000 7fd444c67640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44010dcb0 con 0x7fd440065ba0 2024-09-13T21:43:40.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.110+0000 7fd444c67640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44010e480 con 0x7fd4400ff720 2024-09-13T21:43:40.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.111+0000 7fd43dd9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4400ff720 0x7fd44010d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:40.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.111+0000 7fd43dd9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4400ff720 0x7fd44010d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:60880/0 (socket says 172.21.15.119:60880) 2024-09-13T21:43:40.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.111+0000 7fd43dd9b640 1 -- 172.21.15.119:0/2433036054 learned_addr learned my addr 172.21.15.119:0/2433036054 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:40.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.111+0000 7fd43e59c640 1 --2- 172.21.15.119:0/2433036054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd440065ba0 0x7fd44010d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:40.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.111+0000 7fd43e59c640 1 -- 172.21.15.119:0/2433036054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4400ff720 msgr2=0x7fd44010d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.111+0000 7fd43e59c640 1 --2- 172.21.15.119:0/2433036054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4400ff720 0x7fd44010d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.111+0000 7fd43e59c640 1 -- 172.21.15.119:0/2433036054 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd430005040 con 0x7fd440065ba0 2024-09-13T21:43:40.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.111+0000 7fd43e59c640 1 --2- 172.21.15.119:0/2433036054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd440065ba0 0x7fd44010d120 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4300048a0 tx=0x7fd430009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:40.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.111+0000 7fd42effd640 1 -- 172.21.15.119:0/2433036054 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd430038070 con 0x7fd440065ba0 2024-09-13T21:43:40.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.112+0000 7fd444c67640 1 -- 172.21.15.119:0/2433036054 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44010e6b0 con 0x7fd440065ba0 2024-09-13T21:43:40.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.112+0000 7fd42effd640 1 -- 172.21.15.119:0/2433036054 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd43002ae90 con 0x7fd440065ba0 2024-09-13T21:43:40.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.112+0000 7fd42effd640 1 -- 172.21.15.119:0/2433036054 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd430038070 con 0x7fd440065ba0 2024-09-13T21:43:40.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.112+0000 7fd444c67640 1 -- 172.21.15.119:0/2433036054 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44010eba0 con 0x7fd440065ba0 2024-09-13T21:43:40.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.113+0000 7fd444c67640 1 -- 172.21.15.119:0/2433036054 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd440105770 con 0x7fd440065ba0 2024-09-13T21:43:40.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.114+0000 7fd42effd640 1 -- 172.21.15.119:0/2433036054 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd430030020 con 0x7fd440065ba0 2024-09-13T21:43:40.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.115+0000 7fd42effd640 1 --2- 172.21.15.119:0/2433036054 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd42806ee20 0x7fd4280712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:40.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.115+0000 7fd42effd640 1 -- 172.21.15.119:0/2433036054 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd4300adf20 con 0x7fd440065ba0 2024-09-13T21:43:40.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.115+0000 7fd43dd9b640 1 --2- 172.21.15.119:0/2433036054 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd42806ee20 0x7fd4280712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:40.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.115+0000 7fd43dd9b640 1 --2- 172.21.15.119:0/2433036054 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd42806ee20 0x7fd4280712d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd44010ced0 tx=0x7fd43400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:40.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.119+0000 7fd42effd640 1 -- 172.21.15.119:0/2433036054 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd43007b0a0 con 0x7fd440065ba0 2024-09-13T21:43:40.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.289+0000 7fd444c67640 1 -- 172.21.15.119:0/2433036054 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd44010eed0 con 0x7fd42806ee20 2024-09-13T21:43:40.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.299+0000 7fd42effd640 1 -- 172.21.15.119:0/2433036054 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd44010eed0 con 0x7fd42806ee20 2024-09-13T21:43:40.300 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:43:40.300 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (5m) 61s ago 6m 23.4M - 0.25.0 c8568f914cd2 d48a0a37f6f5 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (6m) 61s ago 6m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 c6a79bd22109 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (6m) 67s ago 5m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 1bccd1b9bda0 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (5m) 61s ago 6m 84.6M - 9.4.7 954c08fa6188 b9b173631489 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (86s) 61s ago 85s 10.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (79s) 61s ago 78s 17.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (76s) 67s ago 75s 14.0M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (83s) 67s ago 83s 14.0M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:9283,8765,8443 running (7m) 61s ago 7m 448M - 17.2.7-1629-geb16b97b ab51d1bebd12 b7b1f8308caa 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283 running (5m) 67s ago 5m 402M - 17.2.7-1629-geb16b97b ab51d1bebd12 bdaf3e955341 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (7m) 61s ago 8m 41.3M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 f49a62e4f3c3 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (5m) 67s ago 5m 31.8M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 66c9116315ae 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (6m) 61s ago 6m 16.4M - 1.5.0 0da6a335fe13 d6e79b36f728 2024-09-13T21:43:40.301 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (5m) 67s ago 5m 15.6M - 1.5.0 0da6a335fe13 513bc6bacbbd 2024-09-13T21:43:40.302 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (5m) 61s ago 5m 44.6M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 6e0bbff1ac3f 2024-09-13T21:43:40.302 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (4m) 61s ago 4m 45.7M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:43:40.302 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (4m) 61s ago 4m 43.5M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:43:40.302 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (3m) 67s ago 3m 44.6M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:43:40.302 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (3m) 67s ago 3m 42.4M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:43:40.302 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (2m) 67s ago 2m 44.9M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:43:40.302 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (5m) 61s ago 6m 51.5M - 2.43.0 a07b618ecd1d 5d5878bd99c5 2024-09-13T21:43:40.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.301+0000 7fd444c67640 1 -- 172.21.15.119:0/2433036054 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd42806ee20 msgr2=0x7fd4280712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.301+0000 7fd444c67640 1 --2- 172.21.15.119:0/2433036054 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd42806ee20 0x7fd4280712d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd44010ced0 tx=0x7fd43400b040 comp rx=0 tx=0).stop 2024-09-13T21:43:40.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.301+0000 7fd444c67640 1 -- 172.21.15.119:0/2433036054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd440065ba0 msgr2=0x7fd44010d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.301+0000 7fd444c67640 1 --2- 172.21.15.119:0/2433036054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd440065ba0 0x7fd44010d120 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4300048a0 tx=0x7fd430009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.301+0000 7fd444c67640 1 -- 172.21.15.119:0/2433036054 shutdown_connections 2024-09-13T21:43:40.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.301+0000 7fd444c67640 1 --2- 172.21.15.119:0/2433036054 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fd42806ee20 0x7fd4280712d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.301+0000 7fd444c67640 1 --2- 172.21.15.119:0/2433036054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4400ff720 0x7fd44010d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.301+0000 7fd444c67640 1 --2- 172.21.15.119:0/2433036054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd440065ba0 0x7fd44010d120 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.301+0000 7fd444c67640 1 -- 172.21.15.119:0/2433036054 >> 172.21.15.119:0/2433036054 conn(0x7fd4400f6c10 msgr2=0x7fd4400f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:40.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.302+0000 7fd444c67640 1 -- 172.21.15.119:0/2433036054 shutdown_connections 2024-09-13T21:43:40.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.302+0000 7fd444c67640 1 -- 172.21.15.119:0/2433036054 wait complete. 2024-09-13T21:43:40.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.381+0000 7efc34bca640 1 -- 172.21.15.119:0/1811815033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc300fc700 msgr2=0x7efc300fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.382+0000 7efc34bca640 1 --2- 172.21.15.119:0/1811815033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc300fc700 0x7efc300fcb70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efc240048d0 tx=0x7efc24009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.382+0000 7efc34bca640 1 -- 172.21.15.119:0/1811815033 shutdown_connections 2024-09-13T21:43:40.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.382+0000 7efc34bca640 1 --2- 172.21.15.119:0/1811815033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc300fc700 0x7efc300fcb70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.382+0000 7efc34bca640 1 --2- 172.21.15.119:0/1811815033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc300fb430 0x7efc300fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.382+0000 7efc34bca640 1 -- 172.21.15.119:0/1811815033 >> 172.21.15.119:0/1811815033 conn(0x7efc300f6c10 msgr2=0x7efc300f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:40.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.382+0000 7efc34bca640 1 -- 172.21.15.119:0/1811815033 shutdown_connections 2024-09-13T21:43:40.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.382+0000 7efc34bca640 1 -- 172.21.15.119:0/1811815033 wait complete. 2024-09-13T21:43:40.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.383+0000 7efc34bca640 1 Processor -- start 2024-09-13T21:43:40.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.383+0000 7efc34bca640 1 -- start start 2024-09-13T21:43:40.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.383+0000 7efc34bca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc300fb430 0x7efc3010db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:40.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.383+0000 7efc34bca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc300fc700 0x7efc301100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:40.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.383+0000 7efc34bca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc30065c80 con 0x7efc300fc700 2024-09-13T21:43:40.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.383+0000 7efc34bca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc30065df0 con 0x7efc300fb430 2024-09-13T21:43:40.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.383+0000 7efc2e59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc300fb430 0x7efc3010db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:40.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.383+0000 7efc2e59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc300fb430 0x7efc3010db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:60898/0 (socket says 172.21.15.119:60898) 2024-09-13T21:43:40.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.383+0000 7efc2e59c640 1 -- 172.21.15.119:0/2553992104 learned_addr learned my addr 172.21.15.119:0/2553992104 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:40.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.384+0000 7efc2e59c640 1 -- 172.21.15.119:0/2553992104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc300fc700 msgr2=0x7efc301100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.384+0000 7efc2e59c640 1 --2- 172.21.15.119:0/2553992104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc300fc700 0x7efc301100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.384+0000 7efc2e59c640 1 -- 172.21.15.119:0/2553992104 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24005040 con 0x7efc300fb430 2024-09-13T21:43:40.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.384+0000 7efc2e59c640 1 --2- 172.21.15.119:0/2553992104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc300fb430 0x7efc3010db90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efc2000eb70 tx=0x7efc2000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:40.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.384+0000 7efc1effd640 1 -- 172.21.15.119:0/2553992104 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc20007c30 con 0x7efc300fb430 2024-09-13T21:43:40.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.384+0000 7efc1effd640 1 -- 172.21.15.119:0/2553992104 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efc2000f040 con 0x7efc300fb430 2024-09-13T21:43:40.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.384+0000 7efc34bca640 1 -- 172.21.15.119:0/2553992104 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc30110620 con 0x7efc300fb430 2024-09-13T21:43:40.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.384+0000 7efc1effd640 1 -- 172.21.15.119:0/2553992104 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc200094e0 con 0x7efc300fb430 2024-09-13T21:43:40.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.384+0000 7efc34bca640 1 -- 172.21.15.119:0/2553992104 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc30110b00 con 0x7efc300fb430 2024-09-13T21:43:40.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.387+0000 7efc1effd640 1 -- 172.21.15.119:0/2553992104 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7efc20009640 con 0x7efc300fb430 2024-09-13T21:43:40.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.387+0000 7efc1effd640 1 --2- 172.21.15.119:0/2553992104 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efc1806ed60 0x7efc18071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:40.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.387+0000 7efc2dd9b640 1 --2- 172.21.15.119:0/2553992104 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efc1806ed60 0x7efc18071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:40.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.387+0000 7efc1effd640 1 -- 172.21.15.119:0/2553992104 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efc2008df00 con 0x7efc300fb430 2024-09-13T21:43:40.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.387+0000 7efc34bca640 1 -- 172.21.15.119:0/2553992104 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc300fa890 con 0x7efc300fb430 2024-09-13T21:43:40.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.388+0000 7efc2dd9b640 1 --2- 172.21.15.119:0/2553992104 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efc1806ed60 0x7efc18071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efc2402a530 tx=0x7efc24009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:40.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.394+0000 7efc1effd640 1 -- 172.21.15.119:0/2553992104 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efc2005b110 con 0x7efc300fb430 2024-09-13T21:43:40.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.620+0000 7efc34bca640 1 -- 172.21.15.119:0/2553992104 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efc30110e00 con 0x7efc300fb430 2024-09-13T21:43:40.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.621+0000 7efc1effd640 1 -- 172.21.15.119:0/2553992104 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7efc20019030 con 0x7efc300fb430 2024-09-13T21:43:40.622 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:43:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:43:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T21:43:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 14 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:43:40.623 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:43:40.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.623+0000 7efc34bca640 1 -- 172.21.15.119:0/2553992104 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efc1806ed60 msgr2=0x7efc18071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.623+0000 7efc34bca640 1 --2- 172.21.15.119:0/2553992104 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efc1806ed60 0x7efc18071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efc2402a530 tx=0x7efc24009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.623+0000 7efc34bca640 1 -- 172.21.15.119:0/2553992104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc300fb430 msgr2=0x7efc3010db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.623+0000 7efc34bca640 1 --2- 172.21.15.119:0/2553992104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc300fb430 0x7efc3010db90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efc2000eb70 tx=0x7efc2000b040 comp rx=0 tx=0).stop 2024-09-13T21:43:40.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.623+0000 7efc34bca640 1 -- 172.21.15.119:0/2553992104 shutdown_connections 2024-09-13T21:43:40.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.624+0000 7efc34bca640 1 --2- 172.21.15.119:0/2553992104 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7efc1806ed60 0x7efc18071210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.624+0000 7efc34bca640 1 --2- 172.21.15.119:0/2553992104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc300fc700 0x7efc301100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.624+0000 7efc34bca640 1 --2- 172.21.15.119:0/2553992104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc300fb430 0x7efc3010db90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.624+0000 7efc34bca640 1 -- 172.21.15.119:0/2553992104 >> 172.21.15.119:0/2553992104 conn(0x7efc300f6c10 msgr2=0x7efc300f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:40.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.624+0000 7efc34bca640 1 -- 172.21.15.119:0/2553992104 shutdown_connections 2024-09-13T21:43:40.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.624+0000 7efc34bca640 1 -- 172.21.15.119:0/2553992104 wait complete. 2024-09-13T21:43:40.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.722+0000 7f33aff86640 1 -- 172.21.15.119:0/3950054632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a8065c40 msgr2=0x7f33a80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.722+0000 7f33aff86640 1 --2- 172.21.15.119:0/3950054632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a8065c40 0x7f33a80ff140 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f33a40048d0 tx=0x7f33a4009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.722+0000 7f33aff86640 1 -- 172.21.15.119:0/3950054632 shutdown_connections 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.722+0000 7f33aff86640 1 --2- 172.21.15.119:0/3950054632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a80ff680 0x7f33a8101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.722+0000 7f33aff86640 1 --2- 172.21.15.119:0/3950054632 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a8065c40 0x7f33a80ff140 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.722+0000 7f33aff86640 1 -- 172.21.15.119:0/3950054632 >> 172.21.15.119:0/3950054632 conn(0x7f33a80f6c10 msgr2=0x7f33a80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.722+0000 7f33aff86640 1 -- 172.21.15.119:0/3950054632 shutdown_connections 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.722+0000 7f33aff86640 1 -- 172.21.15.119:0/3950054632 wait complete. 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.723+0000 7f33aff86640 1 Processor -- start 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.723+0000 7f33aff86640 1 -- start start 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.723+0000 7f33aff86640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a8065c40 0x7f33a80fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.723+0000 7f33aff86640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a80ff680 0x7f33a80fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.723+0000 7f33aff86640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a8110d50 con 0x7f33a8065c40 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.723+0000 7f33aff86640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a8110e90 con 0x7f33a80ff680 2024-09-13T21:43:40.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.723+0000 7f33ad521640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a80ff680 0x7f33a80fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:40.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.723+0000 7f33ad521640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a80ff680 0x7f33a80fb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:60930/0 (socket says 172.21.15.119:60930) 2024-09-13T21:43:40.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.723+0000 7f33ad521640 1 -- 172.21.15.119:0/1216041766 learned_addr learned my addr 172.21.15.119:0/1216041766 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:40.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.724+0000 7f33add22640 1 --2- 172.21.15.119:0/1216041766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a8065c40 0x7f33a80fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:40.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.724+0000 7f33ad521640 1 -- 172.21.15.119:0/1216041766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a8065c40 msgr2=0x7f33a80fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:40.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.724+0000 7f33ad521640 1 --2- 172.21.15.119:0/1216041766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a8065c40 0x7f33a80fcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:40.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.724+0000 7f33ad521640 1 -- 172.21.15.119:0/1216041766 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a4005040 con 0x7f33a80ff680 2024-09-13T21:43:40.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.724+0000 7f33ad521640 1 --2- 172.21.15.119:0/1216041766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a80ff680 0x7f33a80fb040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f339800eb70 tx=0x7f339800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:40.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.724+0000 7f339e7fc640 1 -- 172.21.15.119:0/1216041766 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3398007c30 con 0x7f33a80ff680 2024-09-13T21:43:40.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.724+0000 7f33aff86640 1 -- 172.21.15.119:0/1216041766 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a80fb580 con 0x7f33a80ff680 2024-09-13T21:43:40.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.724+0000 7f339e7fc640 1 -- 172.21.15.119:0/1216041766 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f339800f040 con 0x7f33a80ff680 2024-09-13T21:43:40.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.724+0000 7f339e7fc640 1 -- 172.21.15.119:0/1216041766 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33980094e0 con 0x7f33a80ff680 2024-09-13T21:43:40.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.724+0000 7f33aff86640 1 -- 172.21.15.119:0/1216041766 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a80fbaf0 con 0x7f33a80ff680 2024-09-13T21:43:40.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.726+0000 7f33aff86640 1 -- 172.21.15.119:0/1216041766 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a80fa890 con 0x7f33a80ff680 2024-09-13T21:43:40.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.726+0000 7f339e7fc640 1 -- 172.21.15.119:0/1216041766 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3398009640 con 0x7f33a80ff680 2024-09-13T21:43:40.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.727+0000 7f339e7fc640 1 --2- 172.21.15.119:0/1216041766 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f339406ed60 0x7f3394071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:40.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.727+0000 7f339e7fc640 1 -- 172.21.15.119:0/1216041766 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f339808dfa0 con 0x7f33a80ff680 2024-09-13T21:43:40.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.727+0000 7f33add22640 1 --2- 172.21.15.119:0/1216041766 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f339406ed60 0x7f3394071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:40.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.728+0000 7f33add22640 1 --2- 172.21.15.119:0/1216041766 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f339406ed60 0x7f3394071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f33a4000c00 tx=0x7f33a4035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:40.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:40.733+0000 7f339e7fc640 1 -- 172.21.15.119:0/1216041766 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f339805b110 con 0x7f33a80ff680 2024-09-13T21:43:41.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.023+0000 7f33aff86640 1 -- 172.21.15.119:0/1216041766 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f33a804b720 con 0x7f33a80ff680 2024-09-13T21:43:41.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.024+0000 7f339e7fc640 1 -- 172.21.15.119:0/1216041766 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1820 (secure 0 0 0) 0x7f3398019070 con 0x7f33a80ff680 2024-09-13T21:43:41.025 INFO:teuthology.orchestra.run.smithi119.stdout:e18 2024-09-13T21:43:41.025 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 18 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:42:30.479212+0000 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:43:41.026 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:43:41.027 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:43:41.028 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:43:41.028 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:43:41.028 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:43:41.028 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:43:41.028 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:43:41.028 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:43:41.028 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:43:41.028 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:43:41.028 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:43:41.028 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:43:41.028 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:43:41.029 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 18 2024-09-13T21:43:41.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.026+0000 7f33aff86640 1 -- 172.21.15.119:0/1216041766 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f339406ed60 msgr2=0x7f3394071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:41.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.026+0000 7f33aff86640 1 --2- 172.21.15.119:0/1216041766 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f339406ed60 0x7f3394071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f33a4000c00 tx=0x7f33a4035040 comp rx=0 tx=0).stop 2024-09-13T21:43:41.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.026+0000 7f33aff86640 1 -- 172.21.15.119:0/1216041766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a80ff680 msgr2=0x7f33a80fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:41.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.026+0000 7f33aff86640 1 --2- 172.21.15.119:0/1216041766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a80ff680 0x7f33a80fb040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f339800eb70 tx=0x7f339800b040 comp rx=0 tx=0).stop 2024-09-13T21:43:41.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.026+0000 7f33aff86640 1 -- 172.21.15.119:0/1216041766 shutdown_connections 2024-09-13T21:43:41.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.026+0000 7f33aff86640 1 --2- 172.21.15.119:0/1216041766 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f339406ed60 0x7f3394071210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.026+0000 7f33aff86640 1 --2- 172.21.15.119:0/1216041766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a80ff680 0x7f33a80fb040 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.026+0000 7f33aff86640 1 --2- 172.21.15.119:0/1216041766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a8065c40 0x7f33a80fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.026+0000 7f33aff86640 1 -- 172.21.15.119:0/1216041766 >> 172.21.15.119:0/1216041766 conn(0x7f33a80f6c10 msgr2=0x7f33a80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:41.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.026+0000 7f33aff86640 1 -- 172.21.15.119:0/1216041766 shutdown_connections 2024-09-13T21:43:41.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.027+0000 7f33aff86640 1 -- 172.21.15.119:0/1216041766 wait complete. 2024-09-13T21:43:41.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.151+0000 7f1d0a62c640 1 -- 172.21.15.119:0/528898826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d040fc700 msgr2=0x7f1d040fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:41.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.151+0000 7f1d0a62c640 1 --2- 172.21.15.119:0/528898826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d040fc700 0x7f1d040fcb70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80048d0 tx=0x7f1cf8009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.151+0000 7f1d0a62c640 1 -- 172.21.15.119:0/528898826 shutdown_connections 2024-09-13T21:43:41.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.151+0000 7f1d0a62c640 1 --2- 172.21.15.119:0/528898826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d040fc700 0x7f1d040fcb70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.151+0000 7f1d0a62c640 1 --2- 172.21.15.119:0/528898826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d040fb430 0x7f1d040fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.151+0000 7f1d0a62c640 1 -- 172.21.15.119:0/528898826 >> 172.21.15.119:0/528898826 conn(0x7f1d040f6c10 msgr2=0x7f1d040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:41.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.151+0000 7f1d0a62c640 1 -- 172.21.15.119:0/528898826 shutdown_connections 2024-09-13T21:43:41.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.151+0000 7f1d0a62c640 1 -- 172.21.15.119:0/528898826 wait complete. 2024-09-13T21:43:41.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.152+0000 7f1d0a62c640 1 Processor -- start 2024-09-13T21:43:41.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.152+0000 7f1d0a62c640 1 -- start start 2024-09-13T21:43:41.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.153+0000 7f1d0a62c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d040fb430 0x7f1d0410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:41.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.153+0000 7f1d0a62c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d040fc700 0x7f1d0410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:41.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.153+0000 7f1d0a62c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0410dc10 con 0x7f1d040fc700 2024-09-13T21:43:41.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.153+0000 7f1d0a62c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0410e430 con 0x7f1d040fb430 2024-09-13T21:43:41.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.153+0000 7f1d03fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d040fb430 0x7f1d0410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:41.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.153+0000 7f1d037fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d040fc700 0x7f1d0410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:41.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.153+0000 7f1d037fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d040fc700 0x7f1d0410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50998/0 (socket says 172.21.15.119:50998) 2024-09-13T21:43:41.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.153+0000 7f1d037fe640 1 -- 172.21.15.119:0/2159156577 learned_addr learned my addr 172.21.15.119:0/2159156577 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:41.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.153+0000 7f1d037fe640 1 -- 172.21.15.119:0/2159156577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d040fb430 msgr2=0x7f1d0410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:41.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.153+0000 7f1d037fe640 1 --2- 172.21.15.119:0/2159156577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d040fb430 0x7f1d0410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.153+0000 7f1d037fe640 1 -- 172.21.15.119:0/2159156577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8005040 con 0x7f1d040fc700 2024-09-13T21:43:41.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.154+0000 7f1d037fe640 1 --2- 172.21.15.119:0/2159156577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d040fc700 0x7f1d0410d5c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8004930 tx=0x7f1cf8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:41.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.154+0000 7f1d00ff9640 1 -- 172.21.15.119:0/2159156577 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cf8038070 con 0x7f1d040fc700 2024-09-13T21:43:41.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.154+0000 7f1d00ff9640 1 -- 172.21.15.119:0/2159156577 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1cf8004290 con 0x7f1d040fc700 2024-09-13T21:43:41.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.154+0000 7f1d0a62c640 1 -- 172.21.15.119:0/2159156577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0410e660 con 0x7f1d040fc700 2024-09-13T21:43:41.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.154+0000 7f1d00ff9640 1 -- 172.21.15.119:0/2159156577 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cf8033660 con 0x7f1d040fc700 2024-09-13T21:43:41.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.154+0000 7f1d0a62c640 1 -- 172.21.15.119:0/2159156577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0410ec00 con 0x7f1d040fc700 2024-09-13T21:43:41.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.156+0000 7f1d0a62c640 1 -- 172.21.15.119:0/2159156577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d040fa890 con 0x7f1d040fc700 2024-09-13T21:43:41.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.157+0000 7f1d00ff9640 1 -- 172.21.15.119:0/2159156577 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1cf8030020 con 0x7f1d040fc700 2024-09-13T21:43:41.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.157+0000 7f1d00ff9640 1 --2- 172.21.15.119:0/2159156577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1cec06ee20 0x7f1cec0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:41.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.158+0000 7f1d03fff640 1 --2- 172.21.15.119:0/2159156577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1cec06ee20 0x7f1cec0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:41.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.158+0000 7f1d00ff9640 1 -- 172.21.15.119:0/2159156577 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1cf80ae320 con 0x7f1d040fc700 2024-09-13T21:43:41.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.158+0000 7f1d03fff640 1 --2- 172.21.15.119:0/2159156577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1cec06ee20 0x7f1cec0712d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009af0 tx=0x7f1cf400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:41.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.165+0000 7f1d00ff9640 1 -- 172.21.15.119:0/2159156577 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1cf807b480 con 0x7f1d040fc700 2024-09-13T21:43:41.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.415+0000 7f1d0a62c640 1 -- 172.21.15.119:0/2159156577 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d04103f60 con 0x7f1cec06ee20 2024-09-13T21:43:41.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.416+0000 7f1d00ff9640 1 -- 172.21.15.119:0/2159156577 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f1d04103f60 con 0x7f1cec06ee20 2024-09-13T21:43:41.418 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:43:41.418 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:43:41.418 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:43:41.418 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:43:41.418 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [], 2024-09-13T21:43:41.418 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "0/21 daemons upgraded", 2024-09-13T21:43:41.418 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 image on host smithi155", 2024-09-13T21:43:41.418 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:43:41.418 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:43:41.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.419+0000 7f1d0a62c640 1 -- 172.21.15.119:0/2159156577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1cec06ee20 msgr2=0x7f1cec0712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:41.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.419+0000 7f1d0a62c640 1 --2- 172.21.15.119:0/2159156577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1cec06ee20 0x7f1cec0712d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009af0 tx=0x7f1cf400b040 comp rx=0 tx=0).stop 2024-09-13T21:43:41.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.419+0000 7f1d0a62c640 1 -- 172.21.15.119:0/2159156577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d040fc700 msgr2=0x7f1d0410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:41.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.419+0000 7f1d0a62c640 1 --2- 172.21.15.119:0/2159156577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d040fc700 0x7f1d0410d5c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8004930 tx=0x7f1cf8009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.419+0000 7f1d0a62c640 1 -- 172.21.15.119:0/2159156577 shutdown_connections 2024-09-13T21:43:41.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.419+0000 7f1d0a62c640 1 --2- 172.21.15.119:0/2159156577 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f1cec06ee20 0x7f1cec0712d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.419+0000 7f1d0a62c640 1 --2- 172.21.15.119:0/2159156577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d040fc700 0x7f1d0410d5c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.419+0000 7f1d0a62c640 1 --2- 172.21.15.119:0/2159156577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d040fb430 0x7f1d0410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.419+0000 7f1d0a62c640 1 -- 172.21.15.119:0/2159156577 >> 172.21.15.119:0/2159156577 conn(0x7f1d040f6c10 msgr2=0x7f1d04065600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:41.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.419+0000 7f1d0a62c640 1 -- 172.21.15.119:0/2159156577 shutdown_connections 2024-09-13T21:43:41.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.419+0000 7f1d0a62c640 1 -- 172.21.15.119:0/2159156577 wait complete. 2024-09-13T21:43:41.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.498+0000 7f950d030640 1 -- 172.21.15.119:0/219785092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95080fdb70 msgr2=0x7f95080fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:41.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.498+0000 7f950d030640 1 --2- 172.21.15.119:0/219785092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95080fdb70 0x7f95080fdf80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f94f80048d0 tx=0x7f94f8009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.499+0000 7f950d030640 1 -- 172.21.15.119:0/219785092 shutdown_connections 2024-09-13T21:43:41.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.499+0000 7f950d030640 1 --2- 172.21.15.119:0/219785092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95080fe4c0 0x7f95080fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.499+0000 7f950d030640 1 --2- 172.21.15.119:0/219785092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95080fdb70 0x7f95080fdf80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.499+0000 7f950d030640 1 -- 172.21.15.119:0/219785092 >> 172.21.15.119:0/219785092 conn(0x7f95080f6390 msgr2=0x7f95080f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:41.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.499+0000 7f950d030640 1 -- 172.21.15.119:0/219785092 shutdown_connections 2024-09-13T21:43:41.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.499+0000 7f950d030640 1 -- 172.21.15.119:0/219785092 wait complete. 2024-09-13T21:43:41.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.499+0000 7f950d030640 1 Processor -- start 2024-09-13T21:43:41.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f950d030640 1 -- start start 2024-09-13T21:43:41.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f950d030640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95080fdb70 0x7f950810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:41.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f950d030640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95080fe4c0 0x7f950810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:41.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f950d030640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950810dc20 con 0x7f95080fdb70 2024-09-13T21:43:41.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f950d030640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950810e440 con 0x7f95080fe4c0 2024-09-13T21:43:41.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f9506d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95080fdb70 0x7f950810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:41.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f950659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95080fe4c0 0x7f950810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:41.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f9506d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95080fdb70 0x7f950810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51028/0 (socket says 172.21.15.119:51028) 2024-09-13T21:43:41.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f9506d9d640 1 -- 172.21.15.119:0/3647010920 learned_addr learned my addr 172.21.15.119:0/3647010920 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:43:41.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f9506d9d640 1 -- 172.21.15.119:0/3647010920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95080fe4c0 msgr2=0x7f950810d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:41.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f9506d9d640 1 --2- 172.21.15.119:0/3647010920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95080fe4c0 0x7f950810d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.500+0000 7f9506d9d640 1 -- 172.21.15.119:0/3647010920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f8005040 con 0x7f95080fdb70 2024-09-13T21:43:41.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.501+0000 7f9506d9d640 1 --2- 172.21.15.119:0/3647010920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95080fdb70 0x7f950810d090 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f94f80048a0 tx=0x7f94f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:41.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.501+0000 7f94ef7fe640 1 -- 172.21.15.119:0/3647010920 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94f8009700 con 0x7f95080fdb70 2024-09-13T21:43:41.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.501+0000 7f94ef7fe640 1 -- 172.21.15.119:0/3647010920 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f94f802ae90 con 0x7f95080fdb70 2024-09-13T21:43:41.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.501+0000 7f950d030640 1 -- 172.21.15.119:0/3647010920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950810e670 con 0x7f95080fdb70 2024-09-13T21:43:41.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.501+0000 7f94ef7fe640 1 -- 172.21.15.119:0/3647010920 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94f802c360 con 0x7f95080fdb70 2024-09-13T21:43:41.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.501+0000 7f950d030640 1 -- 172.21.15.119:0/3647010920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950810ebb0 con 0x7f95080fdb70 2024-09-13T21:43:41.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.502+0000 7f950d030640 1 -- 172.21.15.119:0/3647010920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95080fa010 con 0x7f95080fdb70 2024-09-13T21:43:41.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.503+0000 7f94ef7fe640 1 -- 172.21.15.119:0/3647010920 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f94f8044020 con 0x7f95080fdb70 2024-09-13T21:43:41.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.504+0000 7f94ef7fe640 1 --2- 172.21.15.119:0/3647010920 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94f006ee20 0x7f94f00712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:43:41.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.504+0000 7f950659c640 1 --2- 172.21.15.119:0/3647010920 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94f006ee20 0x7f94f00712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:43:41.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.504+0000 7f94ef7fe640 1 -- 172.21.15.119:0/3647010920 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f94f80b6570 con 0x7f95080fdb70 2024-09-13T21:43:41.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.504+0000 7f950659c640 1 --2- 172.21.15.119:0/3647010920 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94f006ee20 0x7f94f00712d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f950810ce40 tx=0x7f94fc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:43:41.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.511+0000 7f94ef7fe640 1 -- 172.21.15.119:0/3647010920 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f94f8083810 con 0x7f95080fdb70 2024-09-13T21:43:41.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.816+0000 7f950d030640 1 -- 172.21.15.119:0/3647010920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f950804b720 con 0x7f95080fdb70 2024-09-13T21:43:41.817 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:41 smithi119 ceph-mon[27653]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:41.818 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:41 smithi119 ceph-mon[27653]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:41.818 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:41 smithi119 ceph-mon[27653]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:41.818 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:41 smithi119 ceph-mon[27653]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:41.818 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:41 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2553992104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:41.818 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:41 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1216041766' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:43:41.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.817+0000 7f94ef7fe640 1 -- 172.21.15.119:0/3647010920 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f94f80831b0 con 0x7f95080fdb70 2024-09-13T21:43:41.818 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:43:41.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.820+0000 7f950d030640 1 -- 172.21.15.119:0/3647010920 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94f006ee20 msgr2=0x7f94f00712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:41.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.820+0000 7f950d030640 1 --2- 172.21.15.119:0/3647010920 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94f006ee20 0x7f94f00712d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f950810ce40 tx=0x7f94fc00b040 comp rx=0 tx=0).stop 2024-09-13T21:43:41.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.820+0000 7f950d030640 1 -- 172.21.15.119:0/3647010920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95080fdb70 msgr2=0x7f950810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:43:41.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.820+0000 7f950d030640 1 --2- 172.21.15.119:0/3647010920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95080fdb70 0x7f950810d090 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f94f80048a0 tx=0x7f94f8009da0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.820+0000 7f950d030640 1 -- 172.21.15.119:0/3647010920 shutdown_connections 2024-09-13T21:43:41.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.820+0000 7f950d030640 1 --2- 172.21.15.119:0/3647010920 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f94f006ee20 0x7f94f00712d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.820+0000 7f950d030640 1 --2- 172.21.15.119:0/3647010920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95080fe4c0 0x7f950810d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.820+0000 7f950d030640 1 --2- 172.21.15.119:0/3647010920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95080fdb70 0x7f950810d090 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:43:41.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.820+0000 7f950d030640 1 -- 172.21.15.119:0/3647010920 >> 172.21.15.119:0/3647010920 conn(0x7f95080f6390 msgr2=0x7f95080f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:43:41.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.820+0000 7f950d030640 1 -- 172.21.15.119:0/3647010920 shutdown_connections 2024-09-13T21:43:41.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:43:41.820+0000 7f950d030640 1 -- 172.21.15.119:0/3647010920 wait complete. 2024-09-13T21:43:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:41 smithi155 ceph-mon[34732]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:41 smithi155 ceph-mon[34732]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:41 smithi155 ceph-mon[34732]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:41 smithi155 ceph-mon[34732]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:41 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2553992104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:43:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:41 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1216041766' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:43:42.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:42 smithi155 ceph-mon[34732]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:42.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:42 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3647010920' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:43:42.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:42 smithi119 ceph-mon[27653]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:43:42.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:42 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3647010920' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:43:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:43 smithi155 ceph-mon[34732]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:43.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:43 smithi119 ceph-mon[27653]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:45.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:45 smithi155 ceph-mon[34732]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:45.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:45 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:45.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:45 smithi119 ceph-mon[27653]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:45.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:45 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:43:47.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:47 smithi155 ceph-mon[34732]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:47.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:47 smithi119 ceph-mon[27653]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:49.681 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:49 smithi119 ceph-mon[27653]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:49.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:49 smithi155 ceph-mon[34732]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:51.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:51 smithi155 ceph-mon[34732]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:51.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:51 smithi119 ceph-mon[27653]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:52.325 INFO:tasks.workunit.client.0.smithi119.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T21:43:52.325 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-13T21:43:52.325 INFO:tasks.workunit.client.0.smithi119.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T21:43:52.325 INFO:tasks.workunit.client.0.smithi119.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T21:43:52.325 INFO:tasks.workunit.client.0.smithi119.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T21:43:52.325 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr: git switch -c 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr:Or undo this operation with: 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr: git switch - 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-13T21:43:52.326 INFO:tasks.workunit.client.0.smithi119.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T21:43:52.331 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T21:43:52.358 INFO:tasks.workunit.client.0.smithi119.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T21:43:52.360 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T21:43:52.360 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T21:43:52.420 INFO:tasks.workunit.client.1.smithi155.stderr:Updating files: 88% (11364/12889) Updating files: 89% (11472/12889) Updating files: 90% (11601/12889) Updating files: 91% (11729/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-13T21:43:53.031 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T21:43:53.109 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T21:43:53.151 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T21:43:53.152 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T21:43:53.152 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T21:43:53.178 INFO:tasks.workunit.client.1.smithi155.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T21:43:53.178 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-09-13T21:43:53.178 INFO:tasks.workunit.client.1.smithi155.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T21:43:53.178 INFO:tasks.workunit.client.1.smithi155.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T21:43:53.178 INFO:tasks.workunit.client.1.smithi155.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr: git switch -c 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr:Or undo this operation with: 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr: git switch - 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-09-13T21:43:53.179 INFO:tasks.workunit.client.1.smithi155.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T21:43:53.184 DEBUG:teuthology.orchestra.run.smithi155:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-13T21:43:53.192 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T21:43:53.195 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:43:53.196 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T21:43:53.252 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-13T21:43:53.254 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T21:43:53.254 DEBUG:teuthology.orchestra.run.smithi119:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-13T21:43:53.317 INFO:tasks.workunit.client.0.smithi119.stderr:+ mkdir -p fsstress 2024-09-13T21:43:53.319 INFO:tasks.workunit.client.0.smithi119.stderr:+ pushd fsstress 2024-09-13T21:43:53.320 INFO:tasks.workunit.client.0.smithi119.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T21:43:53.320 INFO:tasks.workunit.client.0.smithi119.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T21:43:53.366 INFO:tasks.workunit.client.1.smithi155.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T21:43:53.368 INFO:tasks.workunit.client.1.smithi155.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T21:43:53.368 INFO:tasks.workunit.client.1.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T21:43:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:53 smithi155 ceph-mon[34732]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:53.842 INFO:tasks.workunit.client.0.smithi119.stderr:+ tar xzf ltp-full.tgz 2024-09-13T21:43:53.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:53 smithi119 ceph-mon[27653]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:54.287 INFO:tasks.workunit.client.1.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T21:43:54.386 INFO:tasks.workunit.client.1.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T21:43:54.439 INFO:tasks.workunit.client.1.smithi155.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T21:43:54.441 INFO:tasks.workunit.client.1.smithi155.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T21:43:54.442 INFO:tasks.workunit.client.1.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T21:43:54.495 INFO:tasks.workunit.client.1.smithi155.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T21:43:54.499 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-13T21:43:54.499 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-13T21:43:54.517 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-13T21:43:54.519 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T21:43:54.519 DEBUG:teuthology.orchestra.run.smithi155:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-13T21:43:54.590 INFO:tasks.workunit.client.1.smithi155.stderr:+ mkdir -p fsstress 2024-09-13T21:43:54.593 INFO:tasks.workunit.client.1.smithi155.stderr:+ pushd fsstress 2024-09-13T21:43:54.595 INFO:tasks.workunit.client.1.smithi155.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T21:43:54.595 INFO:tasks.workunit.client.1.smithi155.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T21:43:55.244 INFO:tasks.workunit.client.1.smithi155.stderr:+ tar xzf ltp-full.tgz 2024-09-13T21:43:55.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:55 smithi155 ceph-mon[34732]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:55.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:55 smithi119 ceph-mon[27653]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:43:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:57 smithi155 ceph-mon[34732]: pgmap v225: 65 pgs: 65 active+clean; 12 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 991 KiB/s wr, 27 op/s 2024-09-13T21:43:57.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:57 smithi119 ceph-mon[27653]: pgmap v225: 65 pgs: 65 active+clean; 12 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 991 KiB/s wr, 27 op/s 2024-09-13T21:43:59.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:43:59 smithi155 ceph-mon[34732]: pgmap v226: 65 pgs: 65 active+clean; 19 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 45 op/s 2024-09-13T21:43:59.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:43:59 smithi119 ceph-mon[27653]: pgmap v226: 65 pgs: 65 active+clean; 19 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 45 op/s 2024-09-13T21:44:00.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:00 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:00.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:00 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:01.689 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:01 smithi155 ceph-mon[34732]: pgmap v227: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s wr, 149 op/s 2024-09-13T21:44:01.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:01 smithi119 ceph-mon[27653]: pgmap v227: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s wr, 149 op/s 2024-09-13T21:44:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:03 smithi155 ceph-mon[34732]: pgmap v228: 65 pgs: 65 active+clean; 40 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.5 MiB/s wr, 282 op/s 2024-09-13T21:44:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:03 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:03 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.wuuxfd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:44:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:03 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:44:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:03 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:03 smithi119 ceph-mon[27653]: pgmap v228: 65 pgs: 65 active+clean; 40 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.5 MiB/s wr, 282 op/s 2024-09-13T21:44:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:03 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:03 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.wuuxfd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:44:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:03 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:44:03.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:03 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:04.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:04 smithi155 ceph-mon[34732]: Upgrade: Updating mgr.smithi155.wuuxfd 2024-09-13T21:44:04.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:04 smithi155 ceph-mon[34732]: Deploying daemon mgr.smithi155.wuuxfd on smithi155 2024-09-13T21:44:04.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:04 smithi119 ceph-mon[27653]: Upgrade: Updating mgr.smithi155.wuuxfd 2024-09-13T21:44:04.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:04 smithi119 ceph-mon[27653]: Deploying daemon mgr.smithi155.wuuxfd on smithi155 2024-09-13T21:44:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:05 smithi155 ceph-mon[34732]: pgmap v229: 65 pgs: 65 active+clean; 47 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.1 MiB/s wr, 348 op/s 2024-09-13T21:44:05.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:05 smithi119 ceph-mon[27653]: pgmap v229: 65 pgs: 65 active+clean; 47 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.1 MiB/s wr, 348 op/s 2024-09-13T21:44:07.669 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:07 smithi155 ceph-mon[34732]: pgmap v230: 65 pgs: 65 active+clean; 58 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s wr, 456 op/s 2024-09-13T21:44:07.669 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:07.669 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:07.669 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:07 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:07.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:07 smithi119 ceph-mon[27653]: pgmap v230: 65 pgs: 65 active+clean; 58 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s wr, 456 op/s 2024-09-13T21:44:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:07 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:08.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:08 smithi155 ceph-mon[34732]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:44:08.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:08 smithi119 ceph-mon[27653]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:44:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:09 smithi155 ceph-mon[34732]: pgmap v231: 65 pgs: 65 active+clean; 60 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 458 op/s 2024-09-13T21:44:09.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:09 smithi119 ceph-mon[27653]: pgmap v231: 65 pgs: 65 active+clean; 60 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 458 op/s 2024-09-13T21:44:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:11 smithi155 ceph-mon[34732]: pgmap v232: 65 pgs: 65 active+clean; 73 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s wr, 520 op/s 2024-09-13T21:44:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:11 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:11.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:11 smithi119 ceph-mon[27653]: pgmap v232: 65 pgs: 65 active+clean; 73 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s wr, 520 op/s 2024-09-13T21:44:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:11 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:11.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.937+0000 7f9815068640 1 -- 172.21.15.119:0/3797742607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98100fc720 msgr2=0x7f98100fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:11.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.937+0000 7f9815068640 1 --2- 172.21.15.119:0/3797742607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98100fc720 0x7f98100fcb90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f97f8004810 tx=0x7f97f8009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:11.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.937+0000 7f9815068640 1 -- 172.21.15.119:0/3797742607 shutdown_connections 2024-09-13T21:44:11.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.937+0000 7f9815068640 1 --2- 172.21.15.119:0/3797742607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98100fc720 0x7f98100fcb90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:11.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.937+0000 7f9815068640 1 --2- 172.21.15.119:0/3797742607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98100fb450 0x7f98100fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:11.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.937+0000 7f9815068640 1 -- 172.21.15.119:0/3797742607 >> 172.21.15.119:0/3797742607 conn(0x7f98100f6c10 msgr2=0x7f98100f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:11.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.938+0000 7f9815068640 1 -- 172.21.15.119:0/3797742607 shutdown_connections 2024-09-13T21:44:11.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.938+0000 7f9815068640 1 -- 172.21.15.119:0/3797742607 wait complete. 2024-09-13T21:44:11.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.938+0000 7f9815068640 1 Processor -- start 2024-09-13T21:44:11.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.938+0000 7f9815068640 1 -- start start 2024-09-13T21:44:11.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.938+0000 7f9815068640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98100fb450 0x7f9810112200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:11.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.938+0000 7f9815068640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98100fc720 0x7f9810114750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:11.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.939+0000 7f9815068640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981010dcb0 con 0x7f98100fc720 2024-09-13T21:44:11.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.939+0000 7f9815068640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98100666a0 con 0x7f98100fb450 2024-09-13T21:44:11.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.939+0000 7f980ed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98100fb450 0x7f9810112200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:11.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.939+0000 7f980ed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98100fb450 0x7f9810112200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:60810/0 (socket says 172.21.15.119:60810) 2024-09-13T21:44:11.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.939+0000 7f980ed9d640 1 -- 172.21.15.119:0/281745293 learned_addr learned my addr 172.21.15.119:0/281745293 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:11.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.939+0000 7f9807fff640 1 --2- 172.21.15.119:0/281745293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98100fc720 0x7f9810114750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:11.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.939+0000 7f9807fff640 1 -- 172.21.15.119:0/281745293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98100fb450 msgr2=0x7f9810112200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:11.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.939+0000 7f9807fff640 1 --2- 172.21.15.119:0/281745293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98100fb450 0x7f9810112200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:11.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.939+0000 7f9807fff640 1 -- 172.21.15.119:0/281745293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800005040 con 0x7f98100fc720 2024-09-13T21:44:11.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.940+0000 7f9807fff640 1 --2- 172.21.15.119:0/281745293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98100fc720 0x7f9810114750 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f97f80047e0 tx=0x7f97f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:11.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.940+0000 7f98077fe640 1 -- 172.21.15.119:0/281745293 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f8038070 con 0x7f98100fc720 2024-09-13T21:44:11.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.940+0000 7f9815068640 1 -- 172.21.15.119:0/281745293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f8005040 con 0x7f98100fc720 2024-09-13T21:44:11.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.940+0000 7f9815068640 1 -- 172.21.15.119:0/281745293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9810114e30 con 0x7f98100fc720 2024-09-13T21:44:11.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.940+0000 7f98077fe640 1 -- 172.21.15.119:0/281745293 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f97f8009700 con 0x7f98100fc720 2024-09-13T21:44:11.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.940+0000 7f98077fe640 1 -- 172.21.15.119:0/281745293 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f803c650 con 0x7f98100fc720 2024-09-13T21:44:11.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.941+0000 7f9815068640 1 -- 172.21.15.119:0/281745293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f0005240 con 0x7f98100fc720 2024-09-13T21:44:11.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.942+0000 7f98077fe640 1 -- 172.21.15.119:0/281745293 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f97f8030020 con 0x7f98100fc720 2024-09-13T21:44:11.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.943+0000 7f98077fe640 1 --2- 172.21.15.119:0/281745293 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f97fc06ed60 0x7f97fc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:11.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.943+0000 7f98077fe640 1 -- 172.21.15.119:0/281745293 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f97f80add90 con 0x7f98100fc720 2024-09-13T21:44:11.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.943+0000 7f980ed9d640 1 --2- 172.21.15.119:0/281745293 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f97fc06ed60 0x7f97fc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:11.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.944+0000 7f980ed9d640 1 --2- 172.21.15.119:0/281745293 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f97fc06ed60 0x7f97fc071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9810066420 tx=0x7f980000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:11.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:11.948+0000 7f98077fe640 1 -- 172.21.15.119:0/281745293 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f97f807af90 con 0x7f98100fc720 2024-09-13T21:44:12.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.202+0000 7f9815068640 1 -- 172.21.15.119:0/281745293 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97f0000bf0 con 0x7f97fc06ed60 2024-09-13T21:44:12.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.203+0000 7f98077fe640 1 -- 172.21.15.119:0/281745293 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f97f0000bf0 con 0x7f97fc06ed60 2024-09-13T21:44:12.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.205+0000 7f9815068640 1 -- 172.21.15.119:0/281745293 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f97fc06ed60 msgr2=0x7f97fc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.206+0000 7f9815068640 1 --2- 172.21.15.119:0/281745293 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f97fc06ed60 0x7f97fc071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9810066420 tx=0x7f980000b040 comp rx=0 tx=0).stop 2024-09-13T21:44:12.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.206+0000 7f9815068640 1 -- 172.21.15.119:0/281745293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98100fc720 msgr2=0x7f9810114750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.206+0000 7f9815068640 1 --2- 172.21.15.119:0/281745293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98100fc720 0x7f9810114750 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f97f80047e0 tx=0x7f97f8009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.206+0000 7f9815068640 1 -- 172.21.15.119:0/281745293 shutdown_connections 2024-09-13T21:44:12.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.206+0000 7f9815068640 1 --2- 172.21.15.119:0/281745293 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f97fc06ed60 0x7f97fc071210 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.206+0000 7f9815068640 1 --2- 172.21.15.119:0/281745293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98100fc720 0x7f9810114750 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.206+0000 7f9815068640 1 --2- 172.21.15.119:0/281745293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98100fb450 0x7f9810112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.206+0000 7f9815068640 1 -- 172.21.15.119:0/281745293 >> 172.21.15.119:0/281745293 conn(0x7f98100f6c10 msgr2=0x7f98100f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:12.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.206+0000 7f9815068640 1 -- 172.21.15.119:0/281745293 shutdown_connections 2024-09-13T21:44:12.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.206+0000 7f9815068640 1 -- 172.21.15.119:0/281745293 wait complete. 2024-09-13T21:44:12.220 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:44:12.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.312+0000 7fc25b9a7640 1 -- 172.21.15.119:0/186575824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2540fd7c0 msgr2=0x7fc2540fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.312+0000 7fc25b9a7640 1 --2- 172.21.15.119:0/186575824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2540fd7c0 0x7fc2540fdc30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc2440048d0 tx=0x7fc244009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.312+0000 7fc25b9a7640 1 -- 172.21.15.119:0/186575824 shutdown_connections 2024-09-13T21:44:12.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.312+0000 7fc25b9a7640 1 --2- 172.21.15.119:0/186575824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2540fd7c0 0x7fc2540fdc30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.312+0000 7fc25b9a7640 1 --2- 172.21.15.119:0/186575824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2540fc4f0 0x7fc2540fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.312+0000 7fc25b9a7640 1 -- 172.21.15.119:0/186575824 >> 172.21.15.119:0/186575824 conn(0x7fc2540f7cd0 msgr2=0x7fc2540fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:12.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.312+0000 7fc25b9a7640 1 -- 172.21.15.119:0/186575824 shutdown_connections 2024-09-13T21:44:12.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.312+0000 7fc25b9a7640 1 -- 172.21.15.119:0/186575824 wait complete. 2024-09-13T21:44:12.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.313+0000 7fc25b9a7640 1 Processor -- start 2024-09-13T21:44:12.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.313+0000 7fc25b9a7640 1 -- start start 2024-09-13T21:44:12.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.313+0000 7fc25b9a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2540fc4f0 0x7fc25410d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:12.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.313+0000 7fc25b9a7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2540fd7c0 0x7fc25410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:12.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.313+0000 7fc25b9a7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25410dbd0 con 0x7fc2540fc4f0 2024-09-13T21:44:12.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.313+0000 7fc25b9a7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25410e3a0 con 0x7fc2540fd7c0 2024-09-13T21:44:12.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.314+0000 7fc259743640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2540fc4f0 0x7fc25410d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:12.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.314+0000 7fc259743640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2540fc4f0 0x7fc25410d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43092/0 (socket says 172.21.15.119:43092) 2024-09-13T21:44:12.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.314+0000 7fc259743640 1 -- 172.21.15.119:0/2257586405 learned_addr learned my addr 172.21.15.119:0/2257586405 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:12.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.314+0000 7fc258f42640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2540fd7c0 0x7fc25410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:12.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.314+0000 7fc259743640 1 -- 172.21.15.119:0/2257586405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2540fd7c0 msgr2=0x7fc25410d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.314+0000 7fc259743640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2540fd7c0 0x7fc25410d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.314+0000 7fc259743640 1 -- 172.21.15.119:0/2257586405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc244005040 con 0x7fc2540fc4f0 2024-09-13T21:44:12.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.314+0000 7fc258f42640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2540fd7c0 0x7fc25410d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:44:12.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.315+0000 7fc259743640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2540fc4f0 0x7fc25410d040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc25000eb70 tx=0x7fc25000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:12.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.315+0000 7fc249ffb640 1 -- 172.21.15.119:0/2257586405 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc250007c30 con 0x7fc2540fc4f0 2024-09-13T21:44:12.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.315+0000 7fc249ffb640 1 -- 172.21.15.119:0/2257586405 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc25000f040 con 0x7fc2540fc4f0 2024-09-13T21:44:12.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.315+0000 7fc249ffb640 1 -- 172.21.15.119:0/2257586405 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc250009550 con 0x7fc2540fc4f0 2024-09-13T21:44:12.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.315+0000 7fc25b9a7640 1 -- 172.21.15.119:0/2257586405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25410e5d0 con 0x7fc2540fc4f0 2024-09-13T21:44:12.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.316+0000 7fc25b9a7640 1 -- 172.21.15.119:0/2257586405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25410eb70 con 0x7fc2540fc4f0 2024-09-13T21:44:12.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.317+0000 7fc25b9a7640 1 -- 172.21.15.119:0/2257586405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25405ed70 con 0x7fc2540fc4f0 2024-09-13T21:44:12.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.317+0000 7fc249ffb640 1 -- 172.21.15.119:0/2257586405 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc2500096b0 con 0x7fc2540fc4f0 2024-09-13T21:44:12.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.318+0000 7fc249ffb640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc24006ee20 0x7fc2400712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:12.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.318+0000 7fc249ffb640 1 -- 172.21.15.119:0/2257586405 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc25008de40 con 0x7fc2540fc4f0 2024-09-13T21:44:12.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.318+0000 7fc258f42640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc24006ee20 0x7fc2400712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:12.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.319+0000 7fc258f42640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc24006ee20 0x7fc2400712d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc25410cdf0 tx=0x7fc244035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:12.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.324+0000 7fc249ffb640 1 -- 172.21.15.119:0/2257586405 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc25004e2a0 con 0x7fc2540fc4f0 2024-09-13T21:44:12.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.571+0000 7fc25b9a7640 1 -- 172.21.15.119:0/2257586405 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc25410ef70 con 0x7fc24006ee20 2024-09-13T21:44:12.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.573+0000 7fc249ffb640 1 -- 172.21.15.119:0/2257586405 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fc25410ef70 con 0x7fc24006ee20 2024-09-13T21:44:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.575+0000 7fc25b9a7640 1 -- 172.21.15.119:0/2257586405 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc24006ee20 msgr2=0x7fc2400712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.575+0000 7fc25b9a7640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc24006ee20 0x7fc2400712d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc25410cdf0 tx=0x7fc244035040 comp rx=0 tx=0).stop 2024-09-13T21:44:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.575+0000 7fc25b9a7640 1 -- 172.21.15.119:0/2257586405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2540fc4f0 msgr2=0x7fc25410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.575+0000 7fc25b9a7640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2540fc4f0 0x7fc25410d040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc25000eb70 tx=0x7fc25000b040 comp rx=0 tx=0).stop 2024-09-13T21:44:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.575+0000 7fc25b9a7640 1 -- 172.21.15.119:0/2257586405 shutdown_connections 2024-09-13T21:44:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.575+0000 7fc25b9a7640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fc24006ee20 0x7fc2400712d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.575+0000 7fc25b9a7640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2540fd7c0 0x7fc25410d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.575+0000 7fc25b9a7640 1 --2- 172.21.15.119:0/2257586405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2540fc4f0 0x7fc25410d040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.575+0000 7fc25b9a7640 1 -- 172.21.15.119:0/2257586405 >> 172.21.15.119:0/2257586405 conn(0x7fc2540f7cd0 msgr2=0x7fc2540f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:12.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.576+0000 7fc25b9a7640 1 -- 172.21.15.119:0/2257586405 shutdown_connections 2024-09-13T21:44:12.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.576+0000 7fc25b9a7640 1 -- 172.21.15.119:0/2257586405 wait complete. 2024-09-13T21:44:12.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.683+0000 7fbc8559a640 1 -- 172.21.15.119:0/1986593280 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7c032610 con 0x7fbc880fd810 2024-09-13T21:44:12.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.684+0000 7fbc8cf31640 1 -- 172.21.15.119:0/1986593280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc880fd810 msgr2=0x7fbc880fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.684+0000 7fbc8cf31640 1 --2- 172.21.15.119:0/1986593280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc880fd810 0x7fbc880fdc80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0048d0 tx=0x7fbc7c009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.684+0000 7fbc8cf31640 1 -- 172.21.15.119:0/1986593280 shutdown_connections 2024-09-13T21:44:12.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.684+0000 7fbc8cf31640 1 --2- 172.21.15.119:0/1986593280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc880fd810 0x7fbc880fdc80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.684+0000 7fbc8cf31640 1 --2- 172.21.15.119:0/1986593280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880fc540 0x7fbc880fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.684+0000 7fbc8cf31640 1 -- 172.21.15.119:0/1986593280 >> 172.21.15.119:0/1986593280 conn(0x7fbc880f7ce0 msgr2=0x7fbc880fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:12.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.684+0000 7fbc8cf31640 1 -- 172.21.15.119:0/1986593280 shutdown_connections 2024-09-13T21:44:12.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.684+0000 7fbc8cf31640 1 -- 172.21.15.119:0/1986593280 wait complete. 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.685+0000 7fbc8cf31640 1 Processor -- start 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.685+0000 7fbc8cf31640 1 -- start start 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.685+0000 7fbc8cf31640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc880fc540 0x7fbc88113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.685+0000 7fbc8cf31640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880fd810 0x7fbc88113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.685+0000 7fbc8cf31640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc881141e0 con 0x7fbc880fc540 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.685+0000 7fbc8cf31640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc88114a00 con 0x7fbc880fd810 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.685+0000 7fbc8659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc880fc540 0x7fbc88113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.685+0000 7fbc8659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc880fc540 0x7fbc88113650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43120/0 (socket says 172.21.15.119:43120) 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.686+0000 7fbc85d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880fd810 0x7fbc88113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.686+0000 7fbc8659c640 1 -- 172.21.15.119:0/3922192812 learned_addr learned my addr 172.21.15.119:0/3922192812 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.686+0000 7fbc85d9b640 1 -- 172.21.15.119:0/3922192812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc880fc540 msgr2=0x7fbc88113650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.686+0000 7fbc85d9b640 1 --2- 172.21.15.119:0/3922192812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc880fc540 0x7fbc88113650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.686+0000 7fbc85d9b640 1 -- 172.21.15.119:0/3922192812 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c005040 con 0x7fbc880fd810 2024-09-13T21:44:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.686+0000 7fbc85d9b640 1 --2- 172.21.15.119:0/3922192812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880fd810 0x7fbc88113b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c02a530 tx=0x7fbc7c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.687+0000 7fbc76ffd640 1 -- 172.21.15.119:0/3922192812 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7c038070 con 0x7fbc880fd810 2024-09-13T21:44:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.687+0000 7fbc76ffd640 1 -- 172.21.15.119:0/3922192812 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbc7c02ae90 con 0x7fbc880fd810 2024-09-13T21:44:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.687+0000 7fbc76ffd640 1 -- 172.21.15.119:0/3922192812 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7c03e670 con 0x7fbc880fd810 2024-09-13T21:44:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.687+0000 7fbc8cf31640 1 -- 172.21.15.119:0/3922192812 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc88114c30 con 0x7fbc880fd810 2024-09-13T21:44:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.687+0000 7fbc8cf31640 1 -- 172.21.15.119:0/3922192812 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc881151d0 con 0x7fbc880fd810 2024-09-13T21:44:12.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.688+0000 7fbc8cf31640 1 -- 172.21.15.119:0/3922192812 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc880fb9a0 con 0x7fbc880fd810 2024-09-13T21:44:12.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.690+0000 7fbc76ffd640 1 -- 172.21.15.119:0/3922192812 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fbc7c030020 con 0x7fbc880fd810 2024-09-13T21:44:12.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.690+0000 7fbc76ffd640 1 --2- 172.21.15.119:0/3922192812 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbc7006ed60 0x7fbc70071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:12.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.690+0000 7fbc76ffd640 1 -- 172.21.15.119:0/3922192812 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbc7c0ae190 con 0x7fbc880fd810 2024-09-13T21:44:12.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.690+0000 7fbc8659c640 1 --2- 172.21.15.119:0/3922192812 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbc7006ed60 0x7fbc70071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:12.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.691+0000 7fbc8659c640 1 --2- 172.21.15.119:0/3922192812 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbc7006ed60 0x7fbc70071210 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbc78004fa0 tx=0x7fbc7800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:12.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.699+0000 7fbc76ffd640 1 -- 172.21.15.119:0/3922192812 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbc7c07b390 con 0x7fbc880fd810 2024-09-13T21:44:12.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.943+0000 7fbc8cf31640 1 -- 172.21.15.119:0/3922192812 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc88105110 con 0x7fbc7006ed60 2024-09-13T21:44:12.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.956+0000 7fbc76ffd640 1 -- 172.21.15.119:0/3922192812 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fbc88105110 con 0x7fbc7006ed60 2024-09-13T21:44:12.958 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:44:12.958 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (6m) 94s ago 7m 23.4M - 0.25.0 c8568f914cd2 d48a0a37f6f5 2024-09-13T21:44:12.958 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (7m) 94s ago 7m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 c6a79bd22109 2024-09-13T21:44:12.958 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (6m) 2s ago 6m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 1bccd1b9bda0 2024-09-13T21:44:12.958 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (5m) 94s ago 6m 84.6M - 9.4.7 954c08fa6188 b9b173631489 2024-09-13T21:44:12.958 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (118s) 94s ago 118s 10.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:44:12.958 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (111s) 94s ago 111s 17.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:44:12.958 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (109s) 2s ago 108s 14.5M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:44:12.958 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (116s) 2s ago 115s 17.7M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:9283,8765,8443 running (8m) 94s ago 8m 448M - 17.2.7-1629-geb16b97b ab51d1bebd12 b7b1f8308caa 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283 running (6s) 2s ago 6m 63.8M - 19.1.1-324-gecab7be5 0652ff2b5d78 3869f6b2a429 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (8m) 94s ago 8m 41.3M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 f49a62e4f3c3 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (6m) 2s ago 6m 33.1M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 66c9116315ae 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (7m) 94s ago 7m 16.4M - 1.5.0 0da6a335fe13 d6e79b36f728 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (6m) 2s ago 6m 15.5M - 1.5.0 0da6a335fe13 513bc6bacbbd 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (5m) 94s ago 5m 44.6M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 6e0bbff1ac3f 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (5m) 94s ago 5m 45.7M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (4m) 94s ago 4m 43.5M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (4m) 2s ago 4m 83.4M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (3m) 2s ago 3m 78.8M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:44:12.959 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (3m) 2s ago 3m 77.3M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:44:12.960 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (5m) 94s ago 6m 51.5M - 2.43.0 a07b618ecd1d 5d5878bd99c5 2024-09-13T21:44:12.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.958+0000 7fbc8cf31640 1 -- 172.21.15.119:0/3922192812 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbc7006ed60 msgr2=0x7fbc70071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.958+0000 7fbc8cf31640 1 --2- 172.21.15.119:0/3922192812 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbc7006ed60 0x7fbc70071210 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbc78004fa0 tx=0x7fbc7800b040 comp rx=0 tx=0).stop 2024-09-13T21:44:12.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.958+0000 7fbc8cf31640 1 -- 172.21.15.119:0/3922192812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880fd810 msgr2=0x7fbc88113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:12.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.958+0000 7fbc8cf31640 1 --2- 172.21.15.119:0/3922192812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880fd810 0x7fbc88113b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c02a530 tx=0x7fbc7c009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.959+0000 7fbc8cf31640 1 -- 172.21.15.119:0/3922192812 shutdown_connections 2024-09-13T21:44:12.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.959+0000 7fbc8cf31640 1 --2- 172.21.15.119:0/3922192812 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbc7006ed60 0x7fbc70071210 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.959+0000 7fbc8cf31640 1 --2- 172.21.15.119:0/3922192812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880fd810 0x7fbc88113b90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.959+0000 7fbc8cf31640 1 --2- 172.21.15.119:0/3922192812 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc880fc540 0x7fbc88113650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:12.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.959+0000 7fbc8cf31640 1 -- 172.21.15.119:0/3922192812 >> 172.21.15.119:0/3922192812 conn(0x7fbc880f7ce0 msgr2=0x7fbc880f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:12.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.959+0000 7fbc8cf31640 1 -- 172.21.15.119:0/3922192812 shutdown_connections 2024-09-13T21:44:12.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:12.959+0000 7fbc8cf31640 1 -- 172.21.15.119:0/3922192812 wait complete. 2024-09-13T21:44:13.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.059+0000 7f9ff20ae640 1 -- 172.21.15.119:0/2266094428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fec0ffa40 msgr2=0x7f9fec0ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:13.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.059+0000 7f9ff20ae640 1 --2- 172.21.15.119:0/2266094428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fec0ffa40 0x7f9fec0ffeb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00048d0 tx=0x7f9fe0009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.060+0000 7f9ff20ae640 1 -- 172.21.15.119:0/2266094428 shutdown_connections 2024-09-13T21:44:13.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.060+0000 7f9ff20ae640 1 --2- 172.21.15.119:0/2266094428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fec0ffa40 0x7f9fec0ffeb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.060+0000 7f9ff20ae640 1 --2- 172.21.15.119:0/2266094428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0fe770 0x7f9fec0feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.060+0000 7f9ff20ae640 1 -- 172.21.15.119:0/2266094428 >> 172.21.15.119:0/2266094428 conn(0x7f9fec0fa060 msgr2=0x7f9fec0fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:13.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.060+0000 7f9ff20ae640 1 -- 172.21.15.119:0/2266094428 shutdown_connections 2024-09-13T21:44:13.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.060+0000 7f9ff20ae640 1 -- 172.21.15.119:0/2266094428 wait complete. 2024-09-13T21:44:13.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.060+0000 7f9ff20ae640 1 Processor -- start 2024-09-13T21:44:13.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.061+0000 7f9ff20ae640 1 -- start start 2024-09-13T21:44:13.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.061+0000 7f9ff20ae640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fec0fe770 0x7f9fec10f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:13.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.061+0000 7f9ff20ae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0ffa40 0x7f9fec10f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:13.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.061+0000 7f9ff20ae640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec10fdf0 con 0x7f9fec0fe770 2024-09-13T21:44:13.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.061+0000 7f9ff20ae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec110610 con 0x7f9fec0ffa40 2024-09-13T21:44:13.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.061+0000 7f9feb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fec0fe770 0x7f9fec10f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:13.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.062+0000 7f9feb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fec0fe770 0x7f9fec10f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43138/0 (socket says 172.21.15.119:43138) 2024-09-13T21:44:13.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.062+0000 7f9feb7fe640 1 -- 172.21.15.119:0/3945477870 learned_addr learned my addr 172.21.15.119:0/3945477870 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:13.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.062+0000 7f9feaffd640 1 --2- 172.21.15.119:0/3945477870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0ffa40 0x7f9fec10f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:13.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.062+0000 7f9feb7fe640 1 -- 172.21.15.119:0/3945477870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0ffa40 msgr2=0x7f9fec10f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:13.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.062+0000 7f9feb7fe640 1 --2- 172.21.15.119:0/3945477870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0ffa40 0x7f9fec10f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.062+0000 7f9feb7fe640 1 -- 172.21.15.119:0/3945477870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe0005040 con 0x7f9fec0fe770 2024-09-13T21:44:13.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.062+0000 7f9feb7fe640 1 --2- 172.21.15.119:0/3945477870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fec0fe770 0x7f9fec10f260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00eb70 tx=0x7f9fdc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:13.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.063+0000 7f9fd3fff640 1 -- 172.21.15.119:0/3945477870 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fdc007c30 con 0x7f9fec0fe770 2024-09-13T21:44:13.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.063+0000 7f9ff20ae640 1 -- 172.21.15.119:0/3945477870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec110840 con 0x7f9fec0fe770 2024-09-13T21:44:13.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.063+0000 7f9ff20ae640 1 -- 172.21.15.119:0/3945477870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec110de0 con 0x7f9fec0fe770 2024-09-13T21:44:13.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.063+0000 7f9fd3fff640 1 -- 172.21.15.119:0/3945477870 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9fdc00f040 con 0x7f9fec0fe770 2024-09-13T21:44:13.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.063+0000 7f9fd3fff640 1 -- 172.21.15.119:0/3945477870 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fdc00c910 con 0x7f9fec0fe770 2024-09-13T21:44:13.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.064+0000 7f9ff20ae640 1 -- 172.21.15.119:0/3945477870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec0fdbd0 con 0x7f9fec0fe770 2024-09-13T21:44:13.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.065+0000 7f9fd3fff640 1 -- 172.21.15.119:0/3945477870 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9fdc00ca70 con 0x7f9fec0fe770 2024-09-13T21:44:13.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.066+0000 7f9fd3fff640 1 --2- 172.21.15.119:0/3945477870 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9fd406ed50 0x7f9fd4071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:13.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.066+0000 7f9fd3fff640 1 -- 172.21.15.119:0/3945477870 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9fdc08ddf0 con 0x7f9fec0fe770 2024-09-13T21:44:13.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.066+0000 7f9feaffd640 1 --2- 172.21.15.119:0/3945477870 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9fd406ed50 0x7f9fd4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:13.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.067+0000 7f9feaffd640 1 --2- 172.21.15.119:0/3945477870 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9fd406ed50 0x7f9fd4071200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9fec10f010 tx=0x7f9fe0035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:13.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.072+0000 7f9fd3fff640 1 -- 172.21.15.119:0/3945477870 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9fdc04e2a0 con 0x7f9fec0fe770 2024-09-13T21:44:13.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.404+0000 7f9ff20ae640 1 -- 172.21.15.119:0/3945477870 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9fec04b720 con 0x7f9fec0fe770 2024-09-13T21:44:13.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.405+0000 7f9fd3fff640 1 -- 172.21.15.119:0/3945477870 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f9fdc05af70 con 0x7f9fec0fe770 2024-09-13T21:44:13.406 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:44:13.406 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:44:13.406 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T21:44:13.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:44:13.407 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:44:13.407 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T21:44:13.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:44:13.407 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:44:13.407 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T21:44:13.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:44:13.407 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:44:13.407 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:44:13.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:44:13.408 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:44:13.408 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 14 2024-09-13T21:44:13.408 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:44:13.408 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:44:13.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.407+0000 7f9ff20ae640 1 -- 172.21.15.119:0/3945477870 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9fd406ed50 msgr2=0x7f9fd4071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:13.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.407+0000 7f9ff20ae640 1 --2- 172.21.15.119:0/3945477870 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9fd406ed50 0x7f9fd4071200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9fec10f010 tx=0x7f9fe0035040 comp rx=0 tx=0).stop 2024-09-13T21:44:13.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.407+0000 7f9ff20ae640 1 -- 172.21.15.119:0/3945477870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fec0fe770 msgr2=0x7f9fec10f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:13.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.407+0000 7f9ff20ae640 1 --2- 172.21.15.119:0/3945477870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fec0fe770 0x7f9fec10f260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00eb70 tx=0x7f9fdc00b040 comp rx=0 tx=0).stop 2024-09-13T21:44:13.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.407+0000 7f9ff20ae640 1 -- 172.21.15.119:0/3945477870 shutdown_connections 2024-09-13T21:44:13.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.407+0000 7f9ff20ae640 1 --2- 172.21.15.119:0/3945477870 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f9fd406ed50 0x7f9fd4071200 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.407+0000 7f9ff20ae640 1 --2- 172.21.15.119:0/3945477870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0ffa40 0x7f9fec10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.407+0000 7f9ff20ae640 1 --2- 172.21.15.119:0/3945477870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fec0fe770 0x7f9fec10f260 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.407+0000 7f9ff20ae640 1 -- 172.21.15.119:0/3945477870 >> 172.21.15.119:0/3945477870 conn(0x7f9fec0fa060 msgr2=0x7f9fec0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:13.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.408+0000 7f9ff20ae640 1 -- 172.21.15.119:0/3945477870 shutdown_connections 2024-09-13T21:44:13.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.408+0000 7f9ff20ae640 1 -- 172.21.15.119:0/3945477870 wait complete. 2024-09-13T21:44:13.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.511+0000 7effbd568640 1 -- 172.21.15.119:0/3363339921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80fc370 msgr2=0x7effb80fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:13.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.511+0000 7effbd568640 1 --2- 172.21.15.119:0/3363339921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80fc370 0x7effb80fc7e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7effac0048d0 tx=0x7effac009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.511+0000 7effbd568640 1 -- 172.21.15.119:0/3363339921 shutdown_connections 2024-09-13T21:44:13.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.511+0000 7effbd568640 1 --2- 172.21.15.119:0/3363339921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80fc370 0x7effb80fc7e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.511+0000 7effbd568640 1 --2- 172.21.15.119:0/3363339921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effb80fba20 0x7effb80fbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.511+0000 7effbd568640 1 -- 172.21.15.119:0/3363339921 >> 172.21.15.119:0/3363339921 conn(0x7effb80f6390 msgr2=0x7effb80f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:13.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.511+0000 7effbd568640 1 -- 172.21.15.119:0/3363339921 shutdown_connections 2024-09-13T21:44:13.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.511+0000 7effbd568640 1 -- 172.21.15.119:0/3363339921 wait complete. 2024-09-13T21:44:13.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.512+0000 7effbd568640 1 Processor -- start 2024-09-13T21:44:13.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.512+0000 7effbd568640 1 -- start start 2024-09-13T21:44:13.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.512+0000 7effbd568640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effb80fba20 0x7effb810fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:13.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.512+0000 7effbd568640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80fc370 0x7effb8112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:13.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.513+0000 7effbd568640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb80fb3c0 con 0x7effb80fc370 2024-09-13T21:44:13.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.513+0000 7effbd568640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb80fb530 con 0x7effb80fba20 2024-09-13T21:44:13.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.513+0000 7effb6ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effb80fba20 0x7effb810fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:13.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.513+0000 7effb6ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effb80fba20 0x7effb810fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:60884/0 (socket says 172.21.15.119:60884) 2024-09-13T21:44:13.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.513+0000 7effb67fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80fc370 0x7effb8112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:13.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.513+0000 7effb6ffd640 1 -- 172.21.15.119:0/268415417 learned_addr learned my addr 172.21.15.119:0/268415417 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:13.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.513+0000 7effb6ffd640 1 -- 172.21.15.119:0/268415417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80fc370 msgr2=0x7effb8112330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:13.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.513+0000 7effb6ffd640 1 --2- 172.21.15.119:0/268415417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80fc370 0x7effb8112330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.513+0000 7effb6ffd640 1 -- 172.21.15.119:0/268415417 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac005040 con 0x7effb80fba20 2024-09-13T21:44:13.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.514+0000 7effb6ffd640 1 --2- 172.21.15.119:0/268415417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effb80fba20 0x7effb810fde0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7effa800eb70 tx=0x7effa800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:13.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.514+0000 7eff9f7fe640 1 -- 172.21.15.119:0/268415417 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa8007c30 con 0x7effb80fba20 2024-09-13T21:44:13.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.514+0000 7eff9f7fe640 1 -- 172.21.15.119:0/268415417 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7effa800f040 con 0x7effb80fba20 2024-09-13T21:44:13.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.514+0000 7effbd568640 1 -- 172.21.15.119:0/268415417 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb81128d0 con 0x7effb80fba20 2024-09-13T21:44:13.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.514+0000 7eff9f7fe640 1 -- 172.21.15.119:0/268415417 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa800caa0 con 0x7effb80fba20 2024-09-13T21:44:13.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.514+0000 7effbd568640 1 -- 172.21.15.119:0/268415417 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb8112e40 con 0x7effb80fba20 2024-09-13T21:44:13.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.515+0000 7effbd568640 1 -- 172.21.15.119:0/268415417 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb80fa010 con 0x7effb80fba20 2024-09-13T21:44:13.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.516+0000 7eff9f7fe640 1 -- 172.21.15.119:0/268415417 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7effa8009110 con 0x7effb80fba20 2024-09-13T21:44:13.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.516+0000 7eff9f7fe640 1 --2- 172.21.15.119:0/268415417 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7effa006ed60 0x7effa0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:13.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.516+0000 7eff9f7fe640 1 -- 172.21.15.119:0/268415417 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7effa808e430 con 0x7effb80fba20 2024-09-13T21:44:13.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.516+0000 7effb67fc640 1 --2- 172.21.15.119:0/268415417 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7effa006ed60 0x7effa0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:13.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.517+0000 7effb67fc640 1 --2- 172.21.15.119:0/268415417 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7effa006ed60 0x7effa0071210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7effac004540 tx=0x7effac035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:13.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.522+0000 7eff9f7fe640 1 -- 172.21.15.119:0/268415417 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7effa805b500 con 0x7effb80fba20 2024-09-13T21:44:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:13 smithi155 ceph-mon[34732]: pgmap v233: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s wr, 520 op/s 2024-09-13T21:44:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:13 smithi155 ceph-mon[34732]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:13.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:13 smithi119 ceph-mon[27653]: pgmap v233: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s wr, 520 op/s 2024-09-13T21:44:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:13 smithi119 ceph-mon[27653]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:13.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.801+0000 7effbd568640 1 -- 172.21.15.119:0/268415417 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7effb81132b0 con 0x7effb80fba20 2024-09-13T21:44:13.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.801+0000 7eff9f7fe640 1 -- 172.21.15.119:0/268415417 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1837 (secure 0 0 0) 0x7effa805aea0 con 0x7effb80fba20 2024-09-13T21:44:13.803 INFO:teuthology.orchestra.run.smithi119.stdout:e19 2024-09-13T21:44:13.803 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:44:13.803 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:13.803 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:44:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:44:13.803 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:44:13.803 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:44:13.804 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 19 2024-09-13T21:44:13.804 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:44:13.804 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:44:13.804 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:44:07.446483+0000 2024-09-13T21:44:13.804 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:44:13.804 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:44:13.804 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:44:13.804 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:44:13.804 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:44:13.804 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:44:13.804 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:44:13.805 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:44:13.805 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:13.805 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:44:13.805 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:44:13.805 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:44:13.805 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:44:13.806 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:44:13.806 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:44:13.806 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:44:13.806 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:44:13.806 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:44:13.806 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:44:13.807 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:44:13.807 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:13.807 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:44:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:44:13.807 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:44:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:44:13.808 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:13.808 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:13.809 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 19 2024-09-13T21:44:13.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.804+0000 7effbd568640 1 -- 172.21.15.119:0/268415417 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7effa006ed60 msgr2=0x7effa0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:13.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.804+0000 7effbd568640 1 --2- 172.21.15.119:0/268415417 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7effa006ed60 0x7effa0071210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7effac004540 tx=0x7effac035040 comp rx=0 tx=0).stop 2024-09-13T21:44:13.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.804+0000 7effbd568640 1 -- 172.21.15.119:0/268415417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effb80fba20 msgr2=0x7effb810fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:13.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.804+0000 7effbd568640 1 --2- 172.21.15.119:0/268415417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effb80fba20 0x7effb810fde0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7effa800eb70 tx=0x7effa800b040 comp rx=0 tx=0).stop 2024-09-13T21:44:13.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.805+0000 7effbd568640 1 -- 172.21.15.119:0/268415417 shutdown_connections 2024-09-13T21:44:13.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.805+0000 7effbd568640 1 --2- 172.21.15.119:0/268415417 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7effa006ed60 0x7effa0071210 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.805+0000 7effbd568640 1 --2- 172.21.15.119:0/268415417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80fc370 0x7effb8112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.805+0000 7effbd568640 1 --2- 172.21.15.119:0/268415417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effb80fba20 0x7effb810fde0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.805+0000 7effbd568640 1 -- 172.21.15.119:0/268415417 >> 172.21.15.119:0/268415417 conn(0x7effb80f6390 msgr2=0x7effb80f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:13.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.805+0000 7effbd568640 1 -- 172.21.15.119:0/268415417 shutdown_connections 2024-09-13T21:44:13.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.805+0000 7effbd568640 1 -- 172.21.15.119:0/268415417 wait complete. 2024-09-13T21:44:13.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.911+0000 7f6ccd259640 1 -- 172.21.15.119:0/4175278963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc80ff680 msgr2=0x7f6cc8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:13.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.911+0000 7f6ccd259640 1 --2- 172.21.15.119:0/4175278963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc80ff680 0x7f6cc8101a60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0048d0 tx=0x7f6cbc009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.911+0000 7f6ccd259640 1 -- 172.21.15.119:0/4175278963 shutdown_connections 2024-09-13T21:44:13.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.911+0000 7f6ccd259640 1 --2- 172.21.15.119:0/4175278963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc80ff680 0x7f6cc8101a60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.911+0000 7f6ccd259640 1 --2- 172.21.15.119:0/4175278963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cc8065c40 0x7f6cc80ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.911+0000 7f6ccd259640 1 -- 172.21.15.119:0/4175278963 >> 172.21.15.119:0/4175278963 conn(0x7f6cc80f6c10 msgr2=0x7f6cc80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:13.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.911+0000 7f6ccd259640 1 -- 172.21.15.119:0/4175278963 shutdown_connections 2024-09-13T21:44:13.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.911+0000 7f6ccd259640 1 -- 172.21.15.119:0/4175278963 wait complete. 2024-09-13T21:44:13.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.912+0000 7f6ccd259640 1 Processor -- start 2024-09-13T21:44:13.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.912+0000 7f6ccd259640 1 -- start start 2024-09-13T21:44:13.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.912+0000 7f6ccd259640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc8065c40 0x7f6cc810d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:13.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.912+0000 7f6ccd259640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cc80ff680 0x7f6cc810d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:13.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.912+0000 7f6ccd259640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc810dc80 con 0x7f6cc8065c40 2024-09-13T21:44:13.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.912+0000 7f6ccd259640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc810e400 con 0x7f6cc80ff680 2024-09-13T21:44:13.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.912+0000 7f6cc6d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc8065c40 0x7f6cc810d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:13.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.912+0000 7f6cc6d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc8065c40 0x7f6cc810d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43172/0 (socket says 172.21.15.119:43172) 2024-09-13T21:44:13.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.912+0000 7f6cc6d9d640 1 -- 172.21.15.119:0/1675253446 learned_addr learned my addr 172.21.15.119:0/1675253446 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:13.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.912+0000 7f6cc659c640 1 --2- 172.21.15.119:0/1675253446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cc80ff680 0x7f6cc810d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:13.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.913+0000 7f6cc6d9d640 1 -- 172.21.15.119:0/1675253446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cc80ff680 msgr2=0x7f6cc810d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:13.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.913+0000 7f6cc6d9d640 1 --2- 172.21.15.119:0/1675253446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cc80ff680 0x7f6cc810d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:13.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.913+0000 7f6cc6d9d640 1 -- 172.21.15.119:0/1675253446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc005040 con 0x7f6cc8065c40 2024-09-13T21:44:13.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.913+0000 7f6cc6d9d640 1 --2- 172.21.15.119:0/1675253446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc8065c40 0x7f6cc810d0f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800eb70 tx=0x7f6cb800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:13.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.913+0000 7f6caf7fe640 1 -- 172.21.15.119:0/1675253446 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb8007c30 con 0x7f6cc8065c40 2024-09-13T21:44:13.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.913+0000 7f6caf7fe640 1 -- 172.21.15.119:0/1675253446 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6cb800f040 con 0x7f6cc8065c40 2024-09-13T21:44:13.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.913+0000 7f6ccd259640 1 -- 172.21.15.119:0/1675253446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc810e690 con 0x7f6cc8065c40 2024-09-13T21:44:13.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.913+0000 7f6caf7fe640 1 -- 172.21.15.119:0/1675253446 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb800cb80 con 0x7f6cc8065c40 2024-09-13T21:44:13.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.913+0000 7f6ccd259640 1 -- 172.21.15.119:0/1675253446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc810ec30 con 0x7f6cc8065c40 2024-09-13T21:44:13.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.915+0000 7f6ccd259640 1 -- 172.21.15.119:0/1675253446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc80fa890 con 0x7f6cc8065c40 2024-09-13T21:44:13.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.915+0000 7f6caf7fe640 1 -- 172.21.15.119:0/1675253446 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f6cb8009110 con 0x7f6cc8065c40 2024-09-13T21:44:13.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.916+0000 7f6caf7fe640 1 --2- 172.21.15.119:0/1675253446 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6cb006ed50 0x7f6cb0071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:13.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.916+0000 7f6caf7fe640 1 -- 172.21.15.119:0/1675253446 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6cb808e380 con 0x7f6cc8065c40 2024-09-13T21:44:13.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.916+0000 7f6cc659c640 1 --2- 172.21.15.119:0/1675253446 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6cb006ed50 0x7f6cb0071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:13.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.916+0000 7f6cc659c640 1 --2- 172.21.15.119:0/1675253446 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6cb006ed50 0x7f6cb0071200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6cc810cea0 tx=0x7f6cbc035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:13.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:13.921+0000 7f6caf7fe640 1 -- 172.21.15.119:0/1675253446 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6cb805b450 con 0x7f6cc8065c40 2024-09-13T21:44:14.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.194+0000 7f6ccd259640 1 -- 172.21.15.119:0/1675253446 --> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cc810f010 con 0x7f6cb006ed50 2024-09-13T21:44:14.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.195+0000 7f6caf7fe640 1 -- 172.21.15.119:0/1675253446 <== mgr.14208 v2:172.21.15.119:6800/245070511 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f6cc810f010 con 0x7f6cb006ed50 2024-09-13T21:44:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:44:14.197 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:44:14.197 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:44:14.197 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:44:14.197 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [], 2024-09-13T21:44:14.197 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T21:44:14.197 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T21:44:14.197 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:44:14.197 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:44:14.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.197+0000 7f6ccd259640 1 -- 172.21.15.119:0/1675253446 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6cb006ed50 msgr2=0x7f6cb0071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:14.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.197+0000 7f6ccd259640 1 --2- 172.21.15.119:0/1675253446 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6cb006ed50 0x7f6cb0071200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6cc810cea0 tx=0x7f6cbc035040 comp rx=0 tx=0).stop 2024-09-13T21:44:14.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.197+0000 7f6ccd259640 1 -- 172.21.15.119:0/1675253446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc8065c40 msgr2=0x7f6cc810d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:14.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.197+0000 7f6ccd259640 1 --2- 172.21.15.119:0/1675253446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc8065c40 0x7f6cc810d0f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800eb70 tx=0x7f6cb800b040 comp rx=0 tx=0).stop 2024-09-13T21:44:14.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.197+0000 7f6ccd259640 1 -- 172.21.15.119:0/1675253446 shutdown_connections 2024-09-13T21:44:14.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.197+0000 7f6ccd259640 1 --2- 172.21.15.119:0/1675253446 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7f6cb006ed50 0x7f6cb0071200 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:14.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.197+0000 7f6ccd259640 1 --2- 172.21.15.119:0/1675253446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cc80ff680 0x7f6cc810d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:14.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.197+0000 7f6ccd259640 1 --2- 172.21.15.119:0/1675253446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc8065c40 0x7f6cc810d0f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:14.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.197+0000 7f6ccd259640 1 -- 172.21.15.119:0/1675253446 >> 172.21.15.119:0/1675253446 conn(0x7f6cc80f6c10 msgr2=0x7f6cc80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:14.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.198+0000 7f6ccd259640 1 -- 172.21.15.119:0/1675253446 shutdown_connections 2024-09-13T21:44:14.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.198+0000 7f6ccd259640 1 -- 172.21.15.119:0/1675253446 wait complete. 2024-09-13T21:44:14.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.295+0000 7fbb9e825640 1 -- 172.21.15.119:0/750469468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb98070040 msgr2=0x7fbb980704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:14.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.295+0000 7fbb9e825640 1 --2- 172.21.15.119:0/750469468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb98070040 0x7fbb980704b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbb800048d0 tx=0x7fbb80009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:14.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.295+0000 7fbb9e825640 1 -- 172.21.15.119:0/750469468 shutdown_connections 2024-09-13T21:44:14.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.295+0000 7fbb9e825640 1 --2- 172.21.15.119:0/750469468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb98070040 0x7fbb980704b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:14.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.295+0000 7fbb9e825640 1 --2- 172.21.15.119:0/750469468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb980715d0 0x7fbb9806fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:14.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.295+0000 7fbb9e825640 1 -- 172.21.15.119:0/750469468 >> 172.21.15.119:0/750469468 conn(0x7fbb980f7d30 msgr2=0x7fbb980fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:14.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.295+0000 7fbb9e825640 1 -- 172.21.15.119:0/750469468 shutdown_connections 2024-09-13T21:44:14.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.295+0000 7fbb9e825640 1 -- 172.21.15.119:0/750469468 wait complete. 2024-09-13T21:44:14.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.296+0000 7fbb9e825640 1 Processor -- start 2024-09-13T21:44:14.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.296+0000 7fbb9e825640 1 -- start start 2024-09-13T21:44:14.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.296+0000 7fbb9e825640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb98070040 0x7fbb98113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:14.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.296+0000 7fbb97fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb98070040 0x7fbb98113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:14.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.296+0000 7fbb9e825640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb980715d0 0x7fbb98113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:14.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.296+0000 7fbb9e825640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98114220 con 0x7fbb98070040 2024-09-13T21:44:14.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.296+0000 7fbb97fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb98070040 0x7fbb98113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46420/0 (socket says 172.21.15.119:46420) 2024-09-13T21:44:14.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.296+0000 7fbb97fff640 1 -- 172.21.15.119:0/3552935547 learned_addr learned my addr 172.21.15.119:0/3552935547 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:14.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.296+0000 7fbb9e825640 1 -- 172.21.15.119:0/3552935547 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98114a40 con 0x7fbb980715d0 2024-09-13T21:44:14.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.297+0000 7fbb8ffff640 1 --2- 172.21.15.119:0/3552935547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb980715d0 0x7fbb98113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:14.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.297+0000 7fbb97fff640 1 -- 172.21.15.119:0/3552935547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb980715d0 msgr2=0x7fbb98113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:14.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.297+0000 7fbb97fff640 1 --2- 172.21.15.119:0/3552935547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb980715d0 0x7fbb98113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:14.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.297+0000 7fbb97fff640 1 -- 172.21.15.119:0/3552935547 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80005040 con 0x7fbb98070040 2024-09-13T21:44:14.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.297+0000 7fbb97fff640 1 --2- 172.21.15.119:0/3552935547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb98070040 0x7fbb98113690 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800eb70 tx=0x7fbb8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:14.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.297+0000 7fbb957fa640 1 -- 172.21.15.119:0/3552935547 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb88007c30 con 0x7fbb98070040 2024-09-13T21:44:14.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.297+0000 7fbb957fa640 1 -- 172.21.15.119:0/3552935547 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbb8800f040 con 0x7fbb98070040 2024-09-13T21:44:14.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.297+0000 7fbb9e825640 1 -- 172.21.15.119:0/3552935547 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb98114cd0 con 0x7fbb98070040 2024-09-13T21:44:14.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.298+0000 7fbb957fa640 1 -- 172.21.15.119:0/3552935547 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb88009610 con 0x7fbb98070040 2024-09-13T21:44:14.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.298+0000 7fbb9e825640 1 -- 172.21.15.119:0/3552935547 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb98115210 con 0x7fbb98070040 2024-09-13T21:44:14.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.299+0000 7fbb9e825640 1 -- 172.21.15.119:0/3552935547 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb980fb9b0 con 0x7fbb98070040 2024-09-13T21:44:14.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.300+0000 7fbb957fa640 1 -- 172.21.15.119:0/3552935547 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fbb88009770 con 0x7fbb98070040 2024-09-13T21:44:14.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.300+0000 7fbb957fa640 1 --2- 172.21.15.119:0/3552935547 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbb8406ee20 0x7fbb840712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:14.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.301+0000 7fbb957fa640 1 -- 172.21.15.119:0/3552935547 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbb8808e240 con 0x7fbb98070040 2024-09-13T21:44:14.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.301+0000 7fbb8ffff640 1 --2- 172.21.15.119:0/3552935547 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbb8406ee20 0x7fbb840712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:14.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.301+0000 7fbb8ffff640 1 --2- 172.21.15.119:0/3552935547 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbb8406ee20 0x7fbb840712d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb80007ac0 tx=0x7fbb80035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:14.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.305+0000 7fbb957fa640 1 -- 172.21.15.119:0/3552935547 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbb8805b4f0 con 0x7fbb98070040 2024-09-13T21:44:14.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.324+0000 7fbb957fa640 1 -- 172.21.15.119:0/3552935547 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7fbb8800ccb0 con 0x7fbb98070040 2024-09-13T21:44:14.574 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:14 smithi155 ceph-mon[34732]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:14.574 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:14 smithi155 ceph-mon[34732]: from='client.24369 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:14.574 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:14 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3945477870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:14.574 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:14 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/268415417' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:44:14.574 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:14 smithi155 ceph-mon[34732]: Standby manager daemon smithi155.wuuxfd restarted 2024-09-13T21:44:14.574 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:14 smithi155 ceph-mon[34732]: Standby manager daemon smithi155.wuuxfd started 2024-09-13T21:44:14.574 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:14 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/crt"}]: dispatch 2024-09-13T21:44:14.575 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:14 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:44:14.575 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:14 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/key"}]: dispatch 2024-09-13T21:44:14.575 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:14 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:44:14.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.604+0000 7fbb9e825640 1 -- 172.21.15.119:0/3552935547 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbb9804b720 con 0x7fbb98070040 2024-09-13T21:44:14.606 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:14 smithi119 ceph-mon[27653]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:14.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:14 smithi119 ceph-mon[27653]: from='client.24369 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:14.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:14 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3945477870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:14.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:14 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/268415417' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:44:14.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:14 smithi119 ceph-mon[27653]: Standby manager daemon smithi155.wuuxfd restarted 2024-09-13T21:44:14.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:14 smithi119 ceph-mon[27653]: Standby manager daemon smithi155.wuuxfd started 2024-09-13T21:44:14.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:14 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/crt"}]: dispatch 2024-09-13T21:44:14.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:14 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:44:14.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:14 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/key"}]: dispatch 2024-09-13T21:44:14.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:14 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:44:14.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.605+0000 7fbb957fa640 1 -- 172.21.15.119:0/3552935547 <== mon.0 v2:172.21.15.119:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbb8805b070 con 0x7fbb98070040 2024-09-13T21:44:14.608 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:44:14.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.607+0000 7fbb9e825640 1 -- 172.21.15.119:0/3552935547 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbb8406ee20 msgr2=0x7fbb840712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:14.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.607+0000 7fbb9e825640 1 --2- 172.21.15.119:0/3552935547 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbb8406ee20 0x7fbb840712d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb80007ac0 tx=0x7fbb80035040 comp rx=0 tx=0).stop 2024-09-13T21:44:14.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.608+0000 7fbb9e825640 1 -- 172.21.15.119:0/3552935547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb98070040 msgr2=0x7fbb98113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:14.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.608+0000 7fbb9e825640 1 --2- 172.21.15.119:0/3552935547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb98070040 0x7fbb98113690 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800eb70 tx=0x7fbb8800b040 comp rx=0 tx=0).stop 2024-09-13T21:44:14.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.608+0000 7fbb9e825640 1 -- 172.21.15.119:0/3552935547 shutdown_connections 2024-09-13T21:44:14.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.608+0000 7fbb9e825640 1 --2- 172.21.15.119:0/3552935547 >> [v2:172.21.15.119:6800/245070511,v1:172.21.15.119:6801/245070511] conn(0x7fbb8406ee20 0x7fbb840712d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:14.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.608+0000 7fbb9e825640 1 --2- 172.21.15.119:0/3552935547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb980715d0 0x7fbb98113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:14.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.608+0000 7fbb9e825640 1 --2- 172.21.15.119:0/3552935547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb98070040 0x7fbb98113690 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:14.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.608+0000 7fbb9e825640 1 -- 172.21.15.119:0/3552935547 >> 172.21.15.119:0/3552935547 conn(0x7fbb980f7d30 msgr2=0x7fbb980f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:14.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.608+0000 7fbb9e825640 1 -- 172.21.15.119:0/3552935547 shutdown_connections 2024-09-13T21:44:14.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:14.608+0000 7fbb9e825640 1 -- 172.21.15.119:0/3552935547 wait complete. 2024-09-13T21:44:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:15 smithi155 ceph-mon[34732]: pgmap v234: 65 pgs: 65 active+clean; 92 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 461 op/s 2024-09-13T21:44:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:15 smithi155 ceph-mon[34732]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:15 smithi155 ceph-mon[34732]: mgrmap e20: smithi119.gwjxmq(active, since 6m), standbys: smithi155.wuuxfd 2024-09-13T21:44:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:15 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3552935547' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:44:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:15 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:15.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:15 smithi119 ceph-mon[27653]: pgmap v234: 65 pgs: 65 active+clean; 92 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 461 op/s 2024-09-13T21:44:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:15 smithi119 ceph-mon[27653]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:15 smithi119 ceph-mon[27653]: mgrmap e20: smithi119.gwjxmq(active, since 6m), standbys: smithi155.wuuxfd 2024-09-13T21:44:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:15 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3552935547' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:44:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:15 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:17.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:17 smithi155 ceph-mon[34732]: pgmap v235: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 550 op/s 2024-09-13T21:44:17.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:17 smithi119 ceph-mon[27653]: pgmap v235: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 550 op/s 2024-09-13T21:44:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:19 smithi155 ceph-mon[34732]: pgmap v236: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 483 op/s 2024-09-13T21:44:19.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:19 smithi119 ceph-mon[27653]: pgmap v236: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 483 op/s 2024-09-13T21:44:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:21 smithi155 ceph-mon[34732]: pgmap v237: 65 pgs: 65 active+clean; 124 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.7 MiB/s wr, 576 op/s 2024-09-13T21:44:21.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:21 smithi119 ceph-mon[27653]: pgmap v237: 65 pgs: 65 active+clean; 124 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.7 MiB/s wr, 576 op/s 2024-09-13T21:44:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:23 smithi155 ceph-mon[34732]: pgmap v238: 65 pgs: 65 active+clean; 131 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 618 op/s 2024-09-13T21:44:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:23 smithi119 ceph-mon[27653]: pgmap v238: 65 pgs: 65 active+clean; 131 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 618 op/s 2024-09-13T21:44:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:25 smithi155 ceph-mon[34732]: pgmap v239: 65 pgs: 65 active+clean; 138 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 573 op/s 2024-09-13T21:44:25.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:25 smithi119 ceph-mon[27653]: pgmap v239: 65 pgs: 65 active+clean; 138 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 573 op/s 2024-09-13T21:44:27.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:27 smithi155 ceph-mon[34732]: pgmap v240: 65 pgs: 65 active+clean; 153 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 627 op/s 2024-09-13T21:44:27.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:27 smithi119 ceph-mon[27653]: pgmap v240: 65 pgs: 65 active+clean; 153 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 627 op/s 2024-09-13T21:44:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:29 smithi155 ceph-mon[34732]: pgmap v241: 65 pgs: 65 active+clean; 156 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 504 op/s 2024-09-13T21:44:29.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:29 smithi119 ceph-mon[27653]: pgmap v241: 65 pgs: 65 active+clean; 156 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 504 op/s 2024-09-13T21:44:30.248 INFO:tasks.workunit.client.0.smithi119.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T21:44:30.255 INFO:tasks.workunit.client.0.smithi119.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T21:44:30.255 INFO:tasks.workunit.client.0.smithi119.stderr:+ make 2024-09-13T21:44:30.370 INFO:tasks.workunit.client.0.smithi119.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T21:44:30.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:30 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:30.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:30 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:31.239 INFO:tasks.workunit.client.0.smithi119.stderr:++ readlink -f fsstress 2024-09-13T21:44:31.240 INFO:tasks.workunit.client.0.smithi119.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T21:44:31.240 INFO:tasks.workunit.client.0.smithi119.stderr:+ popd 2024-09-13T21:44:31.241 INFO:tasks.workunit.client.0.smithi119.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T21:44:31.241 INFO:tasks.workunit.client.0.smithi119.stderr:+ popd 2024-09-13T21:44:31.242 INFO:tasks.workunit.client.0.smithi119.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-13T21:44:31.242 INFO:tasks.workunit.client.0.smithi119.stderr:++ mktemp -d -p . 2024-09-13T21:44:31.244 INFO:tasks.workunit.client.0.smithi119.stderr:+ T=./tmp.KT6xd1IvCk 2024-09-13T21:44:31.244 INFO:tasks.workunit.client.0.smithi119.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.KT6xd1IvCk -l 1 -n 1000 -p 10 -v 2024-09-13T21:44:31.247 INFO:tasks.workunit.client.0.smithi119.stdout:seed = 1726445179 2024-09-13T21:44:31.251 INFO:tasks.workunit.client.0.smithi119.stdout:1/0: rmdir - no directory 2024-09-13T21:44:31.251 INFO:tasks.workunit.client.0.smithi119.stdout:1/1: dread - no filename 2024-09-13T21:44:31.251 INFO:tasks.workunit.client.0.smithi119.stdout:0/0: symlink l0 0 2024-09-13T21:44:31.251 INFO:tasks.workunit.client.0.smithi119.stdout:0/1: write - no filename 2024-09-13T21:44:31.251 INFO:tasks.workunit.client.0.smithi119.stdout:0/2: read - no filename 2024-09-13T21:44:31.252 INFO:tasks.workunit.client.0.smithi119.stdout:0/3: fdatasync - no filename 2024-09-13T21:44:31.252 INFO:tasks.workunit.client.0.smithi119.stdout:0/4: chown l0 156318536 1 2024-09-13T21:44:31.253 INFO:tasks.workunit.client.0.smithi119.stdout:2/0: link - no file 2024-09-13T21:44:31.253 INFO:tasks.workunit.client.0.smithi119.stdout:2/1: rename - no filename 2024-09-13T21:44:31.253 INFO:tasks.workunit.client.0.smithi119.stdout:2/2: dread - no filename 2024-09-13T21:44:31.253 INFO:tasks.workunit.client.0.smithi119.stdout:2/3: readlink - no filename 2024-09-13T21:44:31.253 INFO:tasks.workunit.client.0.smithi119.stdout:1/2: creat f0 x:0 0 0 2024-09-13T21:44:31.253 INFO:tasks.workunit.client.0.smithi119.stdout:1/3: rmdir - no directory 2024-09-13T21:44:31.254 INFO:tasks.workunit.client.0.smithi119.stdout:1/4: chown f0 552133 1 2024-09-13T21:44:31.254 INFO:tasks.workunit.client.0.smithi119.stdout:1/5: dread - f0 zero size 2024-09-13T21:44:31.255 INFO:tasks.workunit.client.0.smithi119.stdout:3/0: chown . 1470 1 2024-09-13T21:44:31.255 INFO:tasks.workunit.client.0.smithi119.stdout:0/5: rename l0 to l1 0 2024-09-13T21:44:31.255 INFO:tasks.workunit.client.0.smithi119.stdout:0/6: read - no filename 2024-09-13T21:44:31.255 INFO:tasks.workunit.client.0.smithi119.stdout:3/1: chown . 707 1 2024-09-13T21:44:31.256 INFO:tasks.workunit.client.0.smithi119.stdout:1/6: read - f0 zero size 2024-09-13T21:44:31.257 INFO:tasks.workunit.client.0.smithi119.stdout:4/0: write - no filename 2024-09-13T21:44:31.257 INFO:tasks.workunit.client.0.smithi119.stdout:4/1: link - no file 2024-09-13T21:44:31.257 INFO:tasks.workunit.client.0.smithi119.stdout:4/2: dread - no filename 2024-09-13T21:44:31.257 INFO:tasks.workunit.client.0.smithi119.stdout:0/7: symlink l2 0 2024-09-13T21:44:31.257 INFO:tasks.workunit.client.0.smithi119.stdout:4/3: chown . 1 1 2024-09-13T21:44:31.257 INFO:tasks.workunit.client.0.smithi119.stdout:1/7: mkdir d1 0 2024-09-13T21:44:31.259 INFO:tasks.workunit.client.0.smithi119.stdout:5/0: fdatasync - no filename 2024-09-13T21:44:31.259 INFO:tasks.workunit.client.0.smithi119.stdout:5/1: dread - no filename 2024-09-13T21:44:31.259 INFO:tasks.workunit.client.0.smithi119.stdout:5/2: stat - no entries 2024-09-13T21:44:31.260 INFO:tasks.workunit.client.0.smithi119.stdout:3/2: creat f0 x:0 0 0 2024-09-13T21:44:31.261 INFO:tasks.workunit.client.0.smithi119.stdout:3/3: fdatasync f0 0 2024-09-13T21:44:31.262 INFO:tasks.workunit.client.0.smithi119.stdout:3/4: write f0 [984553,6905] 0 2024-09-13T21:44:31.262 INFO:tasks.workunit.client.0.smithi119.stdout:4/4: mknod c0 0 2024-09-13T21:44:31.263 INFO:tasks.workunit.client.0.smithi119.stdout:4/5: write - no filename 2024-09-13T21:44:31.263 INFO:tasks.workunit.client.0.smithi119.stdout:4/6: truncate - no filename 2024-09-13T21:44:31.263 INFO:tasks.workunit.client.0.smithi119.stdout:1/8: mkdir d1/d2 0 2024-09-13T21:44:31.265 INFO:tasks.workunit.client.0.smithi119.stdout:7/0: dread - no filename 2024-09-13T21:44:31.265 INFO:tasks.workunit.client.0.smithi119.stdout:7/1: chown . 9456 1 2024-09-13T21:44:31.265 INFO:tasks.workunit.client.0.smithi119.stdout:7/2: unlink - no file 2024-09-13T21:44:31.265 INFO:tasks.workunit.client.0.smithi119.stdout:7/3: dwrite - no filename 2024-09-13T21:44:31.265 INFO:tasks.workunit.client.0.smithi119.stdout:7/4: dwrite - no filename 2024-09-13T21:44:31.265 INFO:tasks.workunit.client.0.smithi119.stdout:7/5: stat - no entries 2024-09-13T21:44:31.265 INFO:tasks.workunit.client.0.smithi119.stdout:3/5: symlink l1 0 2024-09-13T21:44:31.266 INFO:tasks.workunit.client.0.smithi119.stdout:3/6: chown f0 221185192 1 2024-09-13T21:44:31.266 INFO:tasks.workunit.client.0.smithi119.stdout:5/3: mkdir d0 0 2024-09-13T21:44:31.266 INFO:tasks.workunit.client.0.smithi119.stdout:5/4: readlink - no filename 2024-09-13T21:44:31.266 INFO:tasks.workunit.client.0.smithi119.stdout:5/5: dread - no filename 2024-09-13T21:44:31.267 INFO:tasks.workunit.client.0.smithi119.stdout:4/7: symlink l1 0 2024-09-13T21:44:31.268 INFO:tasks.workunit.client.0.smithi119.stdout:1/9: rename d1/d2 to d1/d3 0 2024-09-13T21:44:31.270 INFO:tasks.workunit.client.0.smithi119.stdout:8/0: readlink - no filename 2024-09-13T21:44:31.270 INFO:tasks.workunit.client.0.smithi119.stdout:8/1: dread - no filename 2024-09-13T21:44:31.270 INFO:tasks.workunit.client.0.smithi119.stdout:8/2: write - no filename 2024-09-13T21:44:31.271 INFO:tasks.workunit.client.0.smithi119.stdout:3/7: creat f2 x:0 0 0 2024-09-13T21:44:31.272 INFO:tasks.workunit.client.0.smithi119.stdout:6/0: creat f0 x:0 0 0 2024-09-13T21:44:31.274 INFO:tasks.workunit.client.0.smithi119.stdout:4/8: creat f2 x:0 0 0 2024-09-13T21:44:31.275 INFO:tasks.workunit.client.0.smithi119.stdout:4/9: readlink l1 0 2024-09-13T21:44:31.276 INFO:tasks.workunit.client.0.smithi119.stdout:4/10: chown f2 136683 1 2024-09-13T21:44:31.276 INFO:tasks.workunit.client.0.smithi119.stdout:7/6: creat f0 x:0 0 0 2024-09-13T21:44:31.277 INFO:tasks.workunit.client.0.smithi119.stdout:4/11: stat f2 0 2024-09-13T21:44:31.278 INFO:tasks.workunit.client.0.smithi119.stdout:7/7: dread - f0 zero size 2024-09-13T21:44:31.278 INFO:tasks.workunit.client.0.smithi119.stdout:7/8: readlink - no filename 2024-09-13T21:44:31.278 INFO:tasks.workunit.client.0.smithi119.stdout:7/9: rmdir - no directory 2024-09-13T21:44:31.279 INFO:tasks.workunit.client.0.smithi119.stdout:5/6: mknod d0/c1 0 2024-09-13T21:44:31.279 INFO:tasks.workunit.client.0.smithi119.stdout:6/1: mknod c1 0 2024-09-13T21:44:31.280 INFO:tasks.workunit.client.0.smithi119.stdout:8/3: creat f0 x:0 0 0 2024-09-13T21:44:31.282 INFO:tasks.workunit.client.0.smithi119.stdout:4/12: symlink l3 0 2024-09-13T21:44:31.282 INFO:tasks.workunit.client.0.smithi119.stdout:4/13: rmdir - no directory 2024-09-13T21:44:31.282 INFO:tasks.workunit.client.0.smithi119.stdout:8/4: chown f0 5 1 2024-09-13T21:44:31.282 INFO:tasks.workunit.client.0.smithi119.stdout:7/10: mknod c1 0 2024-09-13T21:44:31.282 INFO:tasks.workunit.client.0.smithi119.stdout:3/8: dwrite f0 [0,4194304] 0 2024-09-13T21:44:31.283 INFO:tasks.workunit.client.0.smithi119.stdout:8/5: fdatasync f0 0 2024-09-13T21:44:31.283 INFO:tasks.workunit.client.0.smithi119.stdout:4/14: dread - f2 zero size 2024-09-13T21:44:31.283 INFO:tasks.workunit.client.0.smithi119.stdout:6/2: symlink l2 0 2024-09-13T21:44:31.284 INFO:tasks.workunit.client.0.smithi119.stdout:7/11: dread - f0 zero size 2024-09-13T21:44:31.284 INFO:tasks.workunit.client.0.smithi119.stdout:4/15: readlink l1 0 2024-09-13T21:44:31.284 INFO:tasks.workunit.client.0.smithi119.stdout:5/7: symlink d0/l2 0 2024-09-13T21:44:31.285 INFO:tasks.workunit.client.0.smithi119.stdout:7/12: dread - f0 zero size 2024-09-13T21:44:31.285 INFO:tasks.workunit.client.0.smithi119.stdout:9/0: mkdir d0 0 2024-09-13T21:44:31.287 INFO:tasks.workunit.client.0.smithi119.stdout:8/6: rename f0 to f1 0 2024-09-13T21:44:31.288 INFO:tasks.workunit.client.0.smithi119.stdout:3/9: mknod c3 0 2024-09-13T21:44:31.289 INFO:tasks.workunit.client.0.smithi119.stdout:6/3: symlink l3 0 2024-09-13T21:44:31.290 INFO:tasks.workunit.client.0.smithi119.stdout:6/4: dread - f0 zero size 2024-09-13T21:44:31.290 INFO:tasks.workunit.client.0.smithi119.stdout:5/8: mkdir d0/d3 0 2024-09-13T21:44:31.290 INFO:tasks.workunit.client.0.smithi119.stdout:5/9: write - no filename 2024-09-13T21:44:31.291 INFO:tasks.workunit.client.0.smithi119.stdout:7/13: mknod c2 0 2024-09-13T21:44:31.292 INFO:tasks.workunit.client.0.smithi119.stdout:6/5: dread - f0 zero size 2024-09-13T21:44:31.293 INFO:tasks.workunit.client.0.smithi119.stdout:8/7: creat f2 x:0 0 0 2024-09-13T21:44:31.294 INFO:tasks.workunit.client.0.smithi119.stdout:8/8: stat f1 0 2024-09-13T21:44:31.294 INFO:tasks.workunit.client.0.smithi119.stdout:3/10: symlink l4 0 2024-09-13T21:44:31.294 INFO:tasks.workunit.client.0.smithi119.stdout:4/16: dwrite f2 [0,4194304] 0 2024-09-13T21:44:31.297 INFO:tasks.workunit.client.0.smithi119.stdout:8/9: write f2 [470230,109025] 0 2024-09-13T21:44:31.298 INFO:tasks.workunit.client.0.smithi119.stdout:9/1: getdents d0 0 2024-09-13T21:44:31.298 INFO:tasks.workunit.client.0.smithi119.stdout:9/2: truncate - no filename 2024-09-13T21:44:31.298 INFO:tasks.workunit.client.0.smithi119.stdout:9/3: dread - no filename 2024-09-13T21:44:31.298 INFO:tasks.workunit.client.0.smithi119.stdout:3/11: truncate f2 249944 0 2024-09-13T21:44:31.298 INFO:tasks.workunit.client.0.smithi119.stdout:7/14: rename f0 to f3 0 2024-09-13T21:44:31.299 INFO:tasks.workunit.client.0.smithi119.stdout:5/10: mkdir d0/d3/d4 0 2024-09-13T21:44:31.299 INFO:tasks.workunit.client.0.smithi119.stdout:5/11: fdatasync - no filename 2024-09-13T21:44:31.299 INFO:tasks.workunit.client.0.smithi119.stdout:4/17: truncate f2 4639880 0 2024-09-13T21:44:31.302 INFO:tasks.workunit.client.0.smithi119.stdout:8/10: truncate f2 1352226 0 2024-09-13T21:44:31.302 INFO:tasks.workunit.client.0.smithi119.stdout:7/15: fdatasync f3 0 2024-09-13T21:44:31.302 INFO:tasks.workunit.client.0.smithi119.stdout:4/18: mkdir d4 0 2024-09-13T21:44:31.303 INFO:tasks.workunit.client.0.smithi119.stdout:3/12: write f2 [696798,116539] 0 2024-09-13T21:44:31.305 INFO:tasks.workunit.client.0.smithi119.stdout:8/11: write f2 [1380402,83643] 0 2024-09-13T21:44:31.306 INFO:tasks.workunit.client.0.smithi119.stdout:3/13: write f0 [1561597,102733] 0 2024-09-13T21:44:31.307 INFO:tasks.workunit.client.0.smithi119.stdout:7/16: symlink l4 0 2024-09-13T21:44:31.307 INFO:tasks.workunit.client.0.smithi119.stdout:9/4: mknod d0/c1 0 2024-09-13T21:44:31.308 INFO:tasks.workunit.client.0.smithi119.stdout:9/5: dwrite - no filename 2024-09-13T21:44:31.308 INFO:tasks.workunit.client.0.smithi119.stdout:9/6: dwrite - no filename 2024-09-13T21:44:31.308 INFO:tasks.workunit.client.0.smithi119.stdout:3/14: readlink l4 0 2024-09-13T21:44:31.308 INFO:tasks.workunit.client.0.smithi119.stdout:6/6: dwrite f0 [0,4194304] 0 2024-09-13T21:44:31.309 INFO:tasks.workunit.client.0.smithi119.stdout:7/17: write f3 [806172,27313] 0 2024-09-13T21:44:31.309 INFO:tasks.workunit.client.0.smithi119.stdout:5/12: creat d0/d3/d4/f5 x:0 0 0 2024-09-13T21:44:31.310 INFO:tasks.workunit.client.0.smithi119.stdout:7/18: truncate f3 1200909 0 2024-09-13T21:44:31.312 INFO:tasks.workunit.client.0.smithi119.stdout:3/15: creat f5 x:0 0 0 2024-09-13T21:44:31.313 INFO:tasks.workunit.client.0.smithi119.stdout:6/7: symlink l4 0 2024-09-13T21:44:31.313 INFO:tasks.workunit.client.0.smithi119.stdout:6/8: rmdir - no directory 2024-09-13T21:44:31.315 INFO:tasks.workunit.client.0.smithi119.stdout:5/13: mknod d0/d3/d4/c6 0 2024-09-13T21:44:31.316 INFO:tasks.workunit.client.0.smithi119.stdout:3/16: mkdir d6 0 2024-09-13T21:44:31.317 INFO:tasks.workunit.client.0.smithi119.stdout:3/17: readlink l4 0 2024-09-13T21:44:31.319 INFO:tasks.workunit.client.0.smithi119.stdout:7/19: dwrite f3 [0,4194304] 0 2024-09-13T21:44:31.319 INFO:tasks.workunit.client.0.smithi119.stdout:5/14: symlink d0/d3/d4/l7 0 2024-09-13T21:44:31.320 INFO:tasks.workunit.client.0.smithi119.stdout:7/20: chown l4 3 1 2024-09-13T21:44:31.321 INFO:tasks.workunit.client.0.smithi119.stdout:3/18: mknod d6/c7 0 2024-09-13T21:44:31.322 INFO:tasks.workunit.client.0.smithi119.stdout:3/19: rename d6 to d6/d8 22 2024-09-13T21:44:31.323 INFO:tasks.workunit.client.0.smithi119.stdout:7/21: creat f5 x:0 0 0 2024-09-13T21:44:31.324 INFO:tasks.workunit.client.0.smithi119.stdout:7/22: write f3 [3229290,119373] 0 2024-09-13T21:44:31.327 INFO:tasks.workunit.client.0.smithi119.stdout:3/20: dread f0 [0,4194304] 0 2024-09-13T21:44:31.328 INFO:tasks.workunit.client.0.smithi119.stdout:3/21: chown d6/c7 1045565612 1 2024-09-13T21:44:31.328 INFO:tasks.workunit.client.0.smithi119.stdout:3/22: dread - f5 zero size 2024-09-13T21:44:31.329 INFO:tasks.workunit.client.0.smithi119.stdout:7/23: dread f3 [0,4194304] 0 2024-09-13T21:44:31.329 INFO:tasks.workunit.client.0.smithi119.stdout:7/24: chown c1 166259299 1 2024-09-13T21:44:31.329 INFO:tasks.workunit.client.0.smithi119.stdout:7/25: stat l4 0 2024-09-13T21:44:31.331 INFO:tasks.workunit.client.0.smithi119.stdout:7/26: write f3 [3852672,25464] 0 2024-09-13T21:44:31.334 INFO:tasks.workunit.client.0.smithi119.stdout:7/27: dread f3 [0,4194304] 0 2024-09-13T21:44:31.335 INFO:tasks.workunit.client.0.smithi119.stdout:7/28: dread - f5 zero size 2024-09-13T21:44:31.336 INFO:tasks.workunit.client.0.smithi119.stdout:7/29: creat f6 x:0 0 0 2024-09-13T21:44:31.337 INFO:tasks.workunit.client.0.smithi119.stdout:7/30: read f3 [810163,118176] 0 2024-09-13T21:44:31.338 INFO:tasks.workunit.client.0.smithi119.stdout:7/31: symlink l7 0 2024-09-13T21:44:31.346 INFO:tasks.workunit.client.0.smithi119.stdout:7/32: dwrite f6 [0,4194304] 0 2024-09-13T21:44:31.348 INFO:tasks.workunit.client.0.smithi119.stdout:7/33: mkdir d8 0 2024-09-13T21:44:31.386 INFO:tasks.workunit.client.0.smithi119.stdout:1/10: fsync f0 0 2024-09-13T21:44:31.386 INFO:tasks.workunit.client.0.smithi119.stdout:1/11: fsync f0 0 2024-09-13T21:44:31.387 INFO:tasks.workunit.client.0.smithi119.stdout:0/8: readlink l1 0 2024-09-13T21:44:31.388 INFO:tasks.workunit.client.0.smithi119.stdout:0/9: write - no filename 2024-09-13T21:44:31.388 INFO:tasks.workunit.client.0.smithi119.stdout:0/10: write - no filename 2024-09-13T21:44:31.388 INFO:tasks.workunit.client.0.smithi119.stdout:0/11: fdatasync - no filename 2024-09-13T21:44:31.388 INFO:tasks.workunit.client.0.smithi119.stdout:0/12: dwrite - no filename 2024-09-13T21:44:31.389 INFO:tasks.workunit.client.0.smithi119.stdout:1/12: creat d1/d3/f4 x:0 0 0 2024-09-13T21:44:31.389 INFO:tasks.workunit.client.0.smithi119.stdout:1/13: dread - d1/d3/f4 zero size 2024-09-13T21:44:31.389 INFO:tasks.workunit.client.0.smithi119.stdout:0/13: symlink l3 0 2024-09-13T21:44:31.390 INFO:tasks.workunit.client.0.smithi119.stdout:1/14: stat d1/d3/f4 0 2024-09-13T21:44:31.390 INFO:tasks.workunit.client.0.smithi119.stdout:0/14: symlink l4 0 2024-09-13T21:44:31.392 INFO:tasks.workunit.client.0.smithi119.stdout:1/15: creat d1/f5 x:0 0 0 2024-09-13T21:44:31.392 INFO:tasks.workunit.client.0.smithi119.stdout:1/16: readlink - no filename 2024-09-13T21:44:31.392 INFO:tasks.workunit.client.0.smithi119.stdout:1/17: read - d1/f5 zero size 2024-09-13T21:44:31.393 INFO:tasks.workunit.client.0.smithi119.stdout:1/18: chown f0 867211 1 2024-09-13T21:44:31.395 INFO:tasks.workunit.client.0.smithi119.stdout:1/19: creat d1/d3/f6 x:0 0 0 2024-09-13T21:44:31.395 INFO:tasks.workunit.client.0.smithi119.stdout:1/20: readlink - no filename 2024-09-13T21:44:31.395 INFO:tasks.workunit.client.0.smithi119.stdout:0/15: link l4 l5 0 2024-09-13T21:44:31.402 INFO:tasks.workunit.client.0.smithi119.stdout:4/19: fsync f2 0 2024-09-13T21:44:31.405 INFO:tasks.workunit.client.0.smithi119.stdout:0/16: link l5 l6 0 2024-09-13T21:44:31.410 INFO:tasks.workunit.client.0.smithi119.stdout:1/21: dwrite d1/f5 [0,4194304] 0 2024-09-13T21:44:31.413 INFO:tasks.workunit.client.0.smithi119.stdout:4/20: mkdir d4/d5 0 2024-09-13T21:44:31.413 INFO:tasks.workunit.client.0.smithi119.stdout:4/21: chown l1 1 1 2024-09-13T21:44:31.415 INFO:tasks.workunit.client.0.smithi119.stdout:1/22: unlink d1/d3/f6 0 2024-09-13T21:44:31.419 INFO:tasks.workunit.client.0.smithi119.stdout:8/12: fsync f2 0 2024-09-13T21:44:31.420 INFO:tasks.workunit.client.0.smithi119.stdout:3/23: dread f2 [0,4194304] 0 2024-09-13T21:44:31.420 INFO:tasks.workunit.client.0.smithi119.stdout:6/9: fsync f0 0 2024-09-13T21:44:31.420 INFO:tasks.workunit.client.0.smithi119.stdout:8/13: chown f2 66471087 1 2024-09-13T21:44:31.421 INFO:tasks.workunit.client.0.smithi119.stdout:3/24: write f5 [689141,87518] 0 2024-09-13T21:44:31.422 INFO:tasks.workunit.client.0.smithi119.stdout:1/23: rename f0 to d1/d3/f7 0 2024-09-13T21:44:31.422 INFO:tasks.workunit.client.0.smithi119.stdout:3/25: chown d6/c7 818465 1 2024-09-13T21:44:31.423 INFO:tasks.workunit.client.0.smithi119.stdout:0/17: link l1 l7 0 2024-09-13T21:44:31.424 INFO:tasks.workunit.client.0.smithi119.stdout:4/22: creat d4/d5/f6 x:0 0 0 2024-09-13T21:44:31.426 INFO:tasks.workunit.client.0.smithi119.stdout:8/14: unlink f1 0 2024-09-13T21:44:31.427 INFO:tasks.workunit.client.0.smithi119.stdout:8/15: chown f2 249 1 2024-09-13T21:44:31.429 INFO:tasks.workunit.client.0.smithi119.stdout:1/24: symlink d1/l8 0 2024-09-13T21:44:31.429 INFO:tasks.workunit.client.0.smithi119.stdout:8/16: truncate f2 2353686 0 2024-09-13T21:44:31.429 INFO:tasks.workunit.client.0.smithi119.stdout:3/26: mknod d6/c9 0 2024-09-13T21:44:31.431 INFO:tasks.workunit.client.0.smithi119.stdout:1/25: chown d1/l8 0 1 2024-09-13T21:44:31.432 INFO:tasks.workunit.client.0.smithi119.stdout:1/26: dread - d1/d3/f4 zero size 2024-09-13T21:44:31.432 INFO:tasks.workunit.client.0.smithi119.stdout:9/7: getdents d0 0 2024-09-13T21:44:31.433 INFO:tasks.workunit.client.0.smithi119.stdout:9/8: dwrite - no filename 2024-09-13T21:44:31.433 INFO:tasks.workunit.client.0.smithi119.stdout:9/9: dwrite - no filename 2024-09-13T21:44:31.433 INFO:tasks.workunit.client.0.smithi119.stdout:4/23: dwrite f2 [0,4194304] 0 2024-09-13T21:44:31.434 INFO:tasks.workunit.client.0.smithi119.stdout:4/24: write d4/d5/f6 [145888,111459] 0 2024-09-13T21:44:31.435 INFO:tasks.workunit.client.0.smithi119.stdout:8/17: rename f2 to f3 0 2024-09-13T21:44:31.435 INFO:tasks.workunit.client.0.smithi119.stdout:8/18: rmdir - no directory 2024-09-13T21:44:31.438 INFO:tasks.workunit.client.0.smithi119.stdout:1/27: unlink d1/l8 0 2024-09-13T21:44:31.438 INFO:tasks.workunit.client.0.smithi119.stdout:0/18: link l2 l8 0 2024-09-13T21:44:31.438 INFO:tasks.workunit.client.0.smithi119.stdout:0/19: write - no filename 2024-09-13T21:44:31.438 INFO:tasks.workunit.client.0.smithi119.stdout:0/20: truncate - no filename 2024-09-13T21:44:31.440 INFO:tasks.workunit.client.0.smithi119.stdout:9/10: creat d0/f2 x:0 0 0 2024-09-13T21:44:31.440 INFO:tasks.workunit.client.0.smithi119.stdout:9/11: dread - d0/f2 zero size 2024-09-13T21:44:31.443 INFO:tasks.workunit.client.0.smithi119.stdout:8/19: dread f3 [0,4194304] 0 2024-09-13T21:44:31.443 INFO:tasks.workunit.client.0.smithi119.stdout:0/21: symlink l9 0 2024-09-13T21:44:31.443 INFO:tasks.workunit.client.0.smithi119.stdout:0/22: rmdir - no directory 2024-09-13T21:44:31.443 INFO:tasks.workunit.client.0.smithi119.stdout:0/23: dwrite - no filename 2024-09-13T21:44:31.443 INFO:tasks.workunit.client.0.smithi119.stdout:0/24: dwrite - no filename 2024-09-13T21:44:31.443 INFO:tasks.workunit.client.0.smithi119.stdout:0/25: dread - no filename 2024-09-13T21:44:31.443 INFO:tasks.workunit.client.0.smithi119.stdout:0/26: truncate - no filename 2024-09-13T21:44:31.446 INFO:tasks.workunit.client.0.smithi119.stdout:8/20: dread f3 [0,4194304] 0 2024-09-13T21:44:31.447 INFO:tasks.workunit.client.0.smithi119.stdout:0/27: symlink la 0 2024-09-13T21:44:31.447 INFO:tasks.workunit.client.0.smithi119.stdout:0/28: dread - no filename 2024-09-13T21:44:31.448 INFO:tasks.workunit.client.0.smithi119.stdout:1/28: link d1/d3/f4 d1/d3/f9 0 2024-09-13T21:44:31.449 INFO:tasks.workunit.client.0.smithi119.stdout:9/12: link d0/f2 d0/f3 0 2024-09-13T21:44:31.450 INFO:tasks.workunit.client.0.smithi119.stdout:8/21: mknod c4 0 2024-09-13T21:44:31.450 INFO:tasks.workunit.client.0.smithi119.stdout:8/22: rmdir - no directory 2024-09-13T21:44:31.450 INFO:tasks.workunit.client.0.smithi119.stdout:8/23: readlink - no filename 2024-09-13T21:44:31.450 INFO:tasks.workunit.client.0.smithi119.stdout:8/24: stat f3 0 2024-09-13T21:44:31.451 INFO:tasks.workunit.client.0.smithi119.stdout:8/25: chown c4 46 1 2024-09-13T21:44:31.453 INFO:tasks.workunit.client.0.smithi119.stdout:9/13: mknod d0/c4 0 2024-09-13T21:44:31.454 INFO:tasks.workunit.client.0.smithi119.stdout:8/26: write f3 [2215473,121575] 0 2024-09-13T21:44:31.454 INFO:tasks.workunit.client.0.smithi119.stdout:8/27: stat c4 0 2024-09-13T21:44:31.455 INFO:tasks.workunit.client.0.smithi119.stdout:0/29: rename l6 to lb 0 2024-09-13T21:44:31.456 INFO:tasks.workunit.client.0.smithi119.stdout:7/34: write f6 [4983572,49735] 0 2024-09-13T21:44:31.459 INFO:tasks.workunit.client.0.smithi119.stdout:0/30: creat fc x:0 0 0 2024-09-13T21:44:31.469 INFO:tasks.workunit.client.0.smithi119.stdout:4/25: rmdir d4/d5 39 2024-09-13T21:44:31.472 INFO:tasks.workunit.client.0.smithi119.stdout:9/14: dwrite d0/f3 [0,4194304] 0 2024-09-13T21:44:31.474 INFO:tasks.workunit.client.0.smithi119.stdout:8/28: dwrite f3 [0,4194304] 0 2024-09-13T21:44:31.478 INFO:tasks.workunit.client.0.smithi119.stdout:7/35: dread f3 [0,4194304] 0 2024-09-13T21:44:31.480 INFO:tasks.workunit.client.0.smithi119.stdout:0/31: dwrite fc [0,4194304] 0 2024-09-13T21:44:31.480 INFO:tasks.workunit.client.0.smithi119.stdout:1/29: fsync d1/d3/f4 0 2024-09-13T21:44:31.480 INFO:tasks.workunit.client.0.smithi119.stdout:7/36: write f6 [3638352,37807] 0 2024-09-13T21:44:31.481 INFO:tasks.workunit.client.0.smithi119.stdout:9/15: mknod d0/c5 0 2024-09-13T21:44:31.481 INFO:tasks.workunit.client.0.smithi119.stdout:7/37: stat f5 0 2024-09-13T21:44:31.483 INFO:tasks.workunit.client.0.smithi119.stdout:8/29: write f3 [694389,22896] 0 2024-09-13T21:44:31.483 INFO:tasks.workunit.client.0.smithi119.stdout:1/30: write d1/d3/f4 [857117,37854] 0 2024-09-13T21:44:31.484 INFO:tasks.workunit.client.0.smithi119.stdout:0/32: creat fd x:0 0 0 2024-09-13T21:44:31.489 INFO:tasks.workunit.client.0.smithi119.stdout:7/38: mkdir d8/d9 0 2024-09-13T21:44:31.490 INFO:tasks.workunit.client.0.smithi119.stdout:0/33: mkdir de 0 2024-09-13T21:44:31.491 INFO:tasks.workunit.client.0.smithi119.stdout:1/31: mknod d1/d3/ca 0 2024-09-13T21:44:31.492 INFO:tasks.workunit.client.0.smithi119.stdout:9/16: dread d0/f2 [0,4194304] 0 2024-09-13T21:44:31.494 INFO:tasks.workunit.client.0.smithi119.stdout:4/26: getdents d4/d5 0 2024-09-13T21:44:31.494 INFO:tasks.workunit.client.0.smithi119.stdout:8/30: dwrite f3 [0,4194304] 0 2024-09-13T21:44:31.496 INFO:tasks.workunit.client.0.smithi119.stdout:1/32: mknod d1/cb 0 2024-09-13T21:44:31.498 INFO:tasks.workunit.client.0.smithi119.stdout:1/33: stat d1/d3/f9 0 2024-09-13T21:44:31.498 INFO:tasks.workunit.client.0.smithi119.stdout:9/17: creat d0/f6 x:0 0 0 2024-09-13T21:44:31.500 INFO:tasks.workunit.client.0.smithi119.stdout:7/39: creat d8/d9/fa x:0 0 0 2024-09-13T21:44:31.500 INFO:tasks.workunit.client.0.smithi119.stdout:0/34: symlink de/lf 0 2024-09-13T21:44:31.502 INFO:tasks.workunit.client.0.smithi119.stdout:9/18: rename d0/f3 to d0/f7 0 2024-09-13T21:44:31.502 INFO:tasks.workunit.client.0.smithi119.stdout:1/34: mkdir d1/d3/dc 0 2024-09-13T21:44:31.504 INFO:tasks.workunit.client.0.smithi119.stdout:9/19: chown d0/f7 21 1 2024-09-13T21:44:31.504 INFO:tasks.workunit.client.0.smithi119.stdout:0/35: rmdir de 39 2024-09-13T21:44:31.504 INFO:tasks.workunit.client.0.smithi119.stdout:4/27: creat d4/f7 x:0 0 0 2024-09-13T21:44:31.505 INFO:tasks.workunit.client.0.smithi119.stdout:7/40: symlink d8/d9/lb 0 2024-09-13T21:44:31.506 INFO:tasks.workunit.client.0.smithi119.stdout:8/31: dwrite f3 [4194304,4194304] 0 2024-09-13T21:44:31.506 INFO:tasks.workunit.client.0.smithi119.stdout:9/20: dread - d0/f6 zero size 2024-09-13T21:44:31.508 INFO:tasks.workunit.client.0.smithi119.stdout:4/28: chown c0 10549 1 2024-09-13T21:44:31.509 INFO:tasks.workunit.client.0.smithi119.stdout:9/21: read d0/f7 [1305514,67179] 0 2024-09-13T21:44:31.509 INFO:tasks.workunit.client.0.smithi119.stdout:1/35: write d1/d3/f7 [456704,109169] 0 2024-09-13T21:44:31.509 INFO:tasks.workunit.client.0.smithi119.stdout:8/32: write f3 [2671576,82535] 0 2024-09-13T21:44:31.509 INFO:tasks.workunit.client.0.smithi119.stdout:0/36: truncate fd 746666 0 2024-09-13T21:44:31.512 INFO:tasks.workunit.client.0.smithi119.stdout:1/36: write d1/d3/f9 [1417874,96601] 0 2024-09-13T21:44:31.513 INFO:tasks.workunit.client.0.smithi119.stdout:4/29: creat d4/f8 x:0 0 0 2024-09-13T21:44:31.513 INFO:tasks.workunit.client.0.smithi119.stdout:1/37: write d1/d3/f9 [78332,22118] 0 2024-09-13T21:44:31.516 INFO:tasks.workunit.client.0.smithi119.stdout:1/38: unlink d1/d3/ca 0 2024-09-13T21:44:31.517 INFO:tasks.workunit.client.0.smithi119.stdout:1/39: write d1/d3/f4 [2025587,105839] 0 2024-09-13T21:44:31.522 INFO:tasks.workunit.client.0.smithi119.stdout:0/37: creat de/f10 x:0 0 0 2024-09-13T21:44:31.523 INFO:tasks.workunit.client.0.smithi119.stdout:9/22: getdents d0 0 2024-09-13T21:44:31.524 INFO:tasks.workunit.client.0.smithi119.stdout:0/38: symlink de/l11 0 2024-09-13T21:44:31.525 INFO:tasks.workunit.client.0.smithi119.stdout:1/40: dwrite d1/d3/f7 [0,4194304] 0 2024-09-13T21:44:31.526 INFO:tasks.workunit.client.0.smithi119.stdout:9/23: write d0/f6 [43988,59063] 0 2024-09-13T21:44:31.527 INFO:tasks.workunit.client.0.smithi119.stdout:0/39: write fd [933975,85679] 0 2024-09-13T21:44:31.527 INFO:tasks.workunit.client.0.smithi119.stdout:0/40: chown de 16400936 1 2024-09-13T21:44:31.528 INFO:tasks.workunit.client.0.smithi119.stdout:1/41: fdatasync d1/f5 0 2024-09-13T21:44:31.528 INFO:tasks.workunit.client.0.smithi119.stdout:4/30: truncate f2 1328310 0 2024-09-13T21:44:31.530 INFO:tasks.workunit.client.0.smithi119.stdout:1/42: write d1/f5 [3949239,2049] 0 2024-09-13T21:44:31.530 INFO:tasks.workunit.client.0.smithi119.stdout:1/43: readlink - no filename 2024-09-13T21:44:31.538 INFO:tasks.workunit.client.0.smithi119.stdout:1/44: dwrite d1/d3/f4 [0,4194304] 0 2024-09-13T21:44:31.539 INFO:tasks.workunit.client.0.smithi119.stdout:1/45: write d1/d3/f9 [602034,81886] 0 2024-09-13T21:44:31.545 INFO:tasks.workunit.client.0.smithi119.stdout:4/31: unlink d4/f7 0 2024-09-13T21:44:31.546 INFO:tasks.workunit.client.0.smithi119.stdout:4/32: write d4/d5/f6 [1286188,29419] 0 2024-09-13T21:44:31.560 INFO:tasks.workunit.client.0.smithi119.stdout:0/41: link de/f10 de/f12 0 2024-09-13T21:44:31.563 INFO:tasks.workunit.client.0.smithi119.stdout:1/46: unlink d1/f5 0 2024-09-13T21:44:31.564 INFO:tasks.workunit.client.0.smithi119.stdout:1/47: write d1/d3/f7 [2446767,121405] 0 2024-09-13T21:44:31.565 INFO:tasks.workunit.client.0.smithi119.stdout:4/33: getdents d4/d5 0 2024-09-13T21:44:31.568 INFO:tasks.workunit.client.0.smithi119.stdout:1/48: mknod d1/cd 0 2024-09-13T21:44:31.569 INFO:tasks.workunit.client.0.smithi119.stdout:1/49: read d1/d3/f9 [490868,52876] 0 2024-09-13T21:44:31.571 INFO:tasks.workunit.client.0.smithi119.stdout:1/50: chown d1/d3/f4 40133 1 2024-09-13T21:44:31.572 INFO:tasks.workunit.client.0.smithi119.stdout:9/24: truncate d0/f6 59049 0 2024-09-13T21:44:31.574 INFO:tasks.workunit.client.0.smithi119.stdout:4/34: dwrite d4/d5/f6 [0,4194304] 0 2024-09-13T21:44:31.574 INFO:tasks.workunit.client.0.smithi119.stdout:1/51: write d1/d3/f4 [3830524,81549] 0 2024-09-13T21:44:31.575 INFO:tasks.workunit.client.0.smithi119.stdout:1/52: stat d1/d3/f4 0 2024-09-13T21:44:31.576 INFO:tasks.workunit.client.0.smithi119.stdout:1/53: chown d1/d3 29396 1 2024-09-13T21:44:31.577 INFO:tasks.workunit.client.0.smithi119.stdout:0/42: fsync de/f10 0 2024-09-13T21:44:31.579 INFO:tasks.workunit.client.0.smithi119.stdout:0/43: write fc [2879213,94552] 0 2024-09-13T21:44:31.579 INFO:tasks.workunit.client.0.smithi119.stdout:1/54: mkdir d1/d3/de 0 2024-09-13T21:44:31.582 INFO:tasks.workunit.client.0.smithi119.stdout:4/35: rename c0 to d4/c9 0 2024-09-13T21:44:31.582 INFO:tasks.workunit.client.0.smithi119.stdout:0/44: write fc [5050278,10905] 0 2024-09-13T21:44:31.584 INFO:tasks.workunit.client.0.smithi119.stdout:0/45: read fd [808482,40002] 0 2024-09-13T21:44:31.585 INFO:tasks.workunit.client.0.smithi119.stdout:9/25: dwrite d0/f7 [0,4194304] 0 2024-09-13T21:44:31.586 INFO:tasks.workunit.client.0.smithi119.stdout:9/26: truncate d0/f2 4771562 0 2024-09-13T21:44:31.588 INFO:tasks.workunit.client.0.smithi119.stdout:1/55: write d1/d3/f7 [4818493,12129] 0 2024-09-13T21:44:31.590 INFO:tasks.workunit.client.0.smithi119.stdout:1/56: fdatasync d1/d3/f9 0 2024-09-13T21:44:31.592 INFO:tasks.workunit.client.0.smithi119.stdout:1/57: stat d1/d3/de 0 2024-09-13T21:44:31.595 INFO:tasks.workunit.client.0.smithi119.stdout:0/46: dwrite fc [0,4194304] 0 2024-09-13T21:44:31.596 INFO:tasks.workunit.client.0.smithi119.stdout:0/47: readlink la 0 2024-09-13T21:44:31.599 INFO:tasks.workunit.client.0.smithi119.stdout:1/58: dread d1/d3/f7 [0,4194304] 0 2024-09-13T21:44:31.600 INFO:tasks.workunit.client.0.smithi119.stdout:1/59: rename d1/d3/de to d1/d3/de/df 22 2024-09-13T21:44:31.600 INFO:tasks.workunit.client.0.smithi119.stdout:0/48: creat de/f13 x:0 0 0 2024-09-13T21:44:31.606 INFO:tasks.workunit.client.0.smithi119.stdout:1/60: truncate d1/d3/f4 4151948 0 2024-09-13T21:44:31.607 INFO:tasks.workunit.client.0.smithi119.stdout:9/27: write d0/f6 [793542,40256] 0 2024-09-13T21:44:31.607 INFO:tasks.workunit.client.0.smithi119.stdout:0/49: link l2 de/l14 0 2024-09-13T21:44:31.610 INFO:tasks.workunit.client.0.smithi119.stdout:1/61: rename d1/d3/de to d1/d3/dc/d10 0 2024-09-13T21:44:31.611 INFO:tasks.workunit.client.0.smithi119.stdout:0/50: chown lb 61060803 1 2024-09-13T21:44:31.611 INFO:tasks.workunit.client.0.smithi119.stdout:9/28: mkdir d0/d8 0 2024-09-13T21:44:31.613 INFO:tasks.workunit.client.0.smithi119.stdout:0/51: symlink de/l15 0 2024-09-13T21:44:31.616 INFO:tasks.workunit.client.0.smithi119.stdout:0/52: creat de/f16 x:0 0 0 2024-09-13T21:44:31.618 INFO:tasks.workunit.client.0.smithi119.stdout:0/53: chown de/f16 11 1 2024-09-13T21:44:31.619 INFO:tasks.workunit.client.0.smithi119.stdout:9/29: dwrite d0/f7 [0,4194304] 0 2024-09-13T21:44:31.620 INFO:tasks.workunit.client.0.smithi119.stdout:1/62: dwrite d1/d3/f7 [0,4194304] 0 2024-09-13T21:44:31.626 INFO:tasks.workunit.client.0.smithi119.stdout:9/30: dread d0/f7 [0,4194304] 0 2024-09-13T21:44:31.626 INFO:tasks.workunit.client.0.smithi119.stdout:1/63: rename d1/d3/dc/d10 to d1/d3/dc/d11 0 2024-09-13T21:44:31.626 INFO:tasks.workunit.client.0.smithi119.stdout:9/31: chown d0/c1 1 1 2024-09-13T21:44:31.628 INFO:tasks.workunit.client.0.smithi119.stdout:1/64: read d1/d3/f9 [996739,94425] 0 2024-09-13T21:44:31.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:31 smithi119 ceph-mon[27653]: pgmap v242: 65 pgs: 65 active+clean; 173 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.6 MiB/s wr, 565 op/s 2024-09-13T21:44:31.631 INFO:tasks.workunit.client.0.smithi119.stdout:0/54: getdents de 0 2024-09-13T21:44:31.631 INFO:tasks.workunit.client.0.smithi119.stdout:1/65: symlink d1/d3/dc/d11/l12 0 2024-09-13T21:44:31.632 INFO:tasks.workunit.client.0.smithi119.stdout:0/55: fsync de/f16 0 2024-09-13T21:44:31.634 INFO:tasks.workunit.client.0.smithi119.stdout:1/66: rmdir d1/d3/dc 39 2024-09-13T21:44:31.636 INFO:tasks.workunit.client.0.smithi119.stdout:0/56: creat de/f17 x:0 0 0 2024-09-13T21:44:31.636 INFO:tasks.workunit.client.0.smithi119.stdout:9/32: dwrite d0/f2 [4194304,4194304] 0 2024-09-13T21:44:31.638 INFO:tasks.workunit.client.0.smithi119.stdout:9/33: write d0/f6 [1740377,36795] 0 2024-09-13T21:44:31.640 INFO:tasks.workunit.client.0.smithi119.stdout:1/67: dread d1/d3/f4 [0,4194304] 0 2024-09-13T21:44:31.642 INFO:tasks.workunit.client.0.smithi119.stdout:9/34: creat d0/f9 x:0 0 0 2024-09-13T21:44:31.642 INFO:tasks.workunit.client.0.smithi119.stdout:0/57: link l3 de/l18 0 2024-09-13T21:44:31.644 INFO:tasks.workunit.client.0.smithi119.stdout:9/35: write d0/f6 [1563920,42481] 0 2024-09-13T21:44:31.646 INFO:tasks.workunit.client.0.smithi119.stdout:9/36: unlink d0/c5 0 2024-09-13T21:44:31.648 INFO:tasks.workunit.client.0.smithi119.stdout:9/37: creat d0/fa x:0 0 0 2024-09-13T21:44:31.648 INFO:tasks.workunit.client.0.smithi119.stdout:0/58: rmdir de 39 2024-09-13T21:44:31.651 INFO:tasks.workunit.client.0.smithi119.stdout:9/38: creat d0/d8/fb x:0 0 0 2024-09-13T21:44:31.654 INFO:tasks.workunit.client.0.smithi119.stdout:0/59: getdents de 0 2024-09-13T21:44:31.656 INFO:tasks.workunit.client.0.smithi119.stdout:1/68: dwrite d1/d3/f9 [0,4194304] 0 2024-09-13T21:44:31.658 INFO:tasks.workunit.client.0.smithi119.stdout:9/39: dread d0/f7 [0,4194304] 0 2024-09-13T21:44:31.658 INFO:tasks.workunit.client.0.smithi119.stdout:1/69: write d1/d3/f7 [3820123,22825] 0 2024-09-13T21:44:31.660 INFO:tasks.workunit.client.0.smithi119.stdout:9/40: symlink d0/lc 0 2024-09-13T21:44:31.663 INFO:tasks.workunit.client.0.smithi119.stdout:9/41: symlink d0/d8/ld 0 2024-09-13T21:44:31.665 INFO:tasks.workunit.client.0.smithi119.stdout:0/60: dwrite de/f13 [0,4194304] 0 2024-09-13T21:44:31.666 INFO:tasks.workunit.client.0.smithi119.stdout:9/42: dread - d0/d8/fb zero size 2024-09-13T21:44:31.667 INFO:tasks.workunit.client.0.smithi119.stdout:0/61: read fc [3224192,16888] 0 2024-09-13T21:44:31.668 INFO:tasks.workunit.client.0.smithi119.stdout:9/43: fdatasync d0/f9 0 2024-09-13T21:44:31.669 INFO:tasks.workunit.client.0.smithi119.stdout:9/44: rename d0/d8 to d0/d8/de 22 2024-09-13T21:44:31.670 INFO:tasks.workunit.client.0.smithi119.stdout:1/70: dwrite d1/d3/f9 [0,4194304] 0 2024-09-13T21:44:31.673 INFO:tasks.workunit.client.0.smithi119.stdout:9/45: mknod d0/d8/cf 0 2024-09-13T21:44:31.674 INFO:tasks.workunit.client.0.smithi119.stdout:1/71: rmdir d1/d3/dc/d11 39 2024-09-13T21:44:31.679 INFO:tasks.workunit.client.0.smithi119.stdout:0/62: truncate de/f13 1470216 0 2024-09-13T21:44:31.679 INFO:tasks.workunit.client.0.smithi119.stdout:9/46: dread d0/f6 [0,4194304] 0 2024-09-13T21:44:31.680 INFO:tasks.workunit.client.0.smithi119.stdout:9/47: stat d0/d8/cf 0 2024-09-13T21:44:31.680 INFO:tasks.workunit.client.0.smithi119.stdout:1/72: dread d1/d3/f4 [0,4194304] 0 2024-09-13T21:44:31.682 INFO:tasks.workunit.client.0.smithi119.stdout:1/73: write d1/d3/f9 [3037875,106897] 0 2024-09-13T21:44:31.686 INFO:tasks.workunit.client.0.smithi119.stdout:1/74: write d1/d3/f7 [3217616,92983] 0 2024-09-13T21:44:31.688 INFO:tasks.workunit.client.0.smithi119.stdout:0/63: dwrite de/f16 [0,4194304] 0 2024-09-13T21:44:31.691 INFO:tasks.workunit.client.0.smithi119.stdout:9/48: dwrite d0/f9 [0,4194304] 0 2024-09-13T21:44:31.695 INFO:tasks.workunit.client.0.smithi119.stdout:9/49: creat d0/d8/f10 x:0 0 0 2024-09-13T21:44:31.696 INFO:tasks.workunit.client.0.smithi119.stdout:1/75: dread d1/d3/f9 [0,4194304] 0 2024-09-13T21:44:31.698 INFO:tasks.workunit.client.0.smithi119.stdout:9/50: dread d0/f6 [0,4194304] 0 2024-09-13T21:44:31.699 INFO:tasks.workunit.client.0.smithi119.stdout:0/64: write fd [1452606,56370] 0 2024-09-13T21:44:31.701 INFO:tasks.workunit.client.0.smithi119.stdout:9/51: unlink d0/d8/fb 0 2024-09-13T21:44:31.703 INFO:tasks.workunit.client.0.smithi119.stdout:1/76: link d1/d3/f7 d1/d3/f13 0 2024-09-13T21:44:31.705 INFO:tasks.workunit.client.0.smithi119.stdout:1/77: fdatasync d1/d3/f7 0 2024-09-13T21:44:31.707 INFO:tasks.workunit.client.0.smithi119.stdout:1/78: symlink d1/d3/l14 0 2024-09-13T21:44:31.708 INFO:tasks.workunit.client.0.smithi119.stdout:9/52: getdents d0/d8 0 2024-09-13T21:44:31.709 INFO:tasks.workunit.client.0.smithi119.stdout:9/53: write d0/d8/f10 [568698,44647] 0 2024-09-13T21:44:31.709 INFO:tasks.workunit.client.0.smithi119.stdout:1/79: mknod d1/d3/dc/c15 0 2024-09-13T21:44:31.712 INFO:tasks.workunit.client.0.smithi119.stdout:1/80: write d1/d3/f7 [142877,88942] 0 2024-09-13T21:44:31.715 INFO:tasks.workunit.client.0.smithi119.stdout:1/81: link d1/cb d1/d3/dc/d11/c16 0 2024-09-13T21:44:31.718 INFO:tasks.workunit.client.0.smithi119.stdout:1/82: link d1/d3/f13 d1/d3/dc/d11/f17 0 2024-09-13T21:44:31.719 INFO:tasks.workunit.client.0.smithi119.stdout:1/83: fdatasync d1/d3/f4 0 2024-09-13T21:44:31.720 INFO:tasks.workunit.client.0.smithi119.stdout:1/84: mknod d1/c18 0 2024-09-13T21:44:31.724 INFO:tasks.workunit.client.0.smithi119.stdout:1/85: getdents d1/d3/dc 0 2024-09-13T21:44:31.725 INFO:tasks.workunit.client.0.smithi119.stdout:1/86: mkdir d1/d3/dc/d11/d19 0 2024-09-13T21:44:31.727 INFO:tasks.workunit.client.0.smithi119.stdout:1/87: creat d1/f1a x:0 0 0 2024-09-13T21:44:31.728 INFO:tasks.workunit.client.0.smithi119.stdout:1/88: read d1/d3/dc/d11/f17 [490774,127997] 0 2024-09-13T21:44:31.728 INFO:tasks.workunit.client.0.smithi119.stdout:1/89: stat d1/c18 0 2024-09-13T21:44:31.729 INFO:tasks.workunit.client.0.smithi119.stdout:1/90: rmdir d1/d3/dc/d11 39 2024-09-13T21:44:31.731 INFO:tasks.workunit.client.0.smithi119.stdout:1/91: creat d1/f1b x:0 0 0 2024-09-13T21:44:31.736 INFO:tasks.workunit.client.0.smithi119.stdout:1/92: truncate d1/d3/dc/d11/f17 5427373 0 2024-09-13T21:44:31.741 INFO:tasks.workunit.client.0.smithi119.stdout:1/93: write d1/d3/dc/d11/f17 [3808450,70066] 0 2024-09-13T21:44:31.742 INFO:tasks.workunit.client.0.smithi119.stdout:1/94: write d1/d3/f7 [1981669,90460] 0 2024-09-13T21:44:31.748 INFO:tasks.workunit.client.0.smithi119.stdout:1/95: dwrite d1/f1b [0,4194304] 0 2024-09-13T21:44:31.749 INFO:tasks.workunit.client.0.smithi119.stdout:1/96: write d1/d3/dc/d11/f17 [6428829,76753] 0 2024-09-13T21:44:31.756 INFO:tasks.workunit.client.0.smithi119.stdout:1/97: dwrite d1/d3/f13 [0,4194304] 0 2024-09-13T21:44:31.757 INFO:tasks.workunit.client.0.smithi119.stdout:1/98: dread - d1/f1a zero size 2024-09-13T21:44:31.758 INFO:tasks.workunit.client.0.smithi119.stdout:1/99: write d1/d3/f7 [1143127,47966] 0 2024-09-13T21:44:31.767 INFO:tasks.workunit.client.0.smithi119.stdout:1/100: fsync d1/f1b 0 2024-09-13T21:44:31.770 INFO:tasks.workunit.client.0.smithi119.stdout:1/101: creat d1/d3/dc/f1c x:0 0 0 2024-09-13T21:44:31.770 INFO:tasks.workunit.client.0.smithi119.stdout:1/102: chown d1/f1a 1697852847 1 2024-09-13T21:44:31.771 INFO:tasks.workunit.client.0.smithi119.stdout:1/103: mknod d1/c1d 0 2024-09-13T21:44:31.774 INFO:tasks.workunit.client.0.smithi119.stdout:1/104: rename d1/d3/dc/c15 to d1/d3/dc/c1e 0 2024-09-13T21:44:31.777 INFO:tasks.workunit.client.0.smithi119.stdout:1/105: dread d1/d3/dc/d11/f17 [0,4194304] 0 2024-09-13T21:44:31.779 INFO:tasks.workunit.client.0.smithi119.stdout:1/106: creat d1/f1f x:0 0 0 2024-09-13T21:44:31.780 INFO:tasks.workunit.client.0.smithi119.stdout:1/107: chown d1/f1f 15836 1 2024-09-13T21:44:31.780 INFO:tasks.workunit.client.0.smithi119.stdout:1/108: dread - d1/f1a zero size 2024-09-13T21:44:31.783 INFO:tasks.workunit.client.0.smithi119.stdout:1/109: rename d1/c18 to d1/d3/dc/c20 0 2024-09-13T21:44:31.786 INFO:tasks.workunit.client.0.smithi119.stdout:1/110: dread d1/d3/f4 [0,4194304] 0 2024-09-13T21:44:31.788 INFO:tasks.workunit.client.0.smithi119.stdout:1/111: mknod d1/d3/dc/d11/d19/c21 0 2024-09-13T21:44:31.788 INFO:tasks.workunit.client.0.smithi119.stdout:1/112: creat d1/f22 x:0 0 0 2024-09-13T21:44:31.790 INFO:tasks.workunit.client.0.smithi119.stdout:1/113: symlink d1/d3/dc/d11/l23 0 2024-09-13T21:44:31.791 INFO:tasks.workunit.client.0.smithi119.stdout:1/114: fsync d1/d3/dc/d11/f17 0 2024-09-13T21:44:31.792 INFO:tasks.workunit.client.0.smithi119.stdout:1/115: write d1/d3/dc/f1c [948329,70185] 0 2024-09-13T21:44:31.795 INFO:tasks.workunit.client.0.smithi119.stdout:1/116: dread d1/d3/dc/f1c [0,4194304] 0 2024-09-13T21:44:31.798 INFO:tasks.workunit.client.0.smithi119.stdout:1/117: dread d1/f1b [0,4194304] 0 2024-09-13T21:44:31.798 INFO:tasks.workunit.client.0.smithi119.stdout:1/118: fdatasync d1/d3/f4 0 2024-09-13T21:44:31.799 INFO:tasks.workunit.client.0.smithi119.stdout:1/119: write d1/f22 [683952,59255] 0 2024-09-13T21:44:31.802 INFO:tasks.workunit.client.0.smithi119.stdout:1/120: mkdir d1/d3/dc/d24 0 2024-09-13T21:44:31.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:31 smithi155 ceph-mon[34732]: pgmap v242: 65 pgs: 65 active+clean; 173 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.6 MiB/s wr, 565 op/s 2024-09-13T21:44:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:33 smithi155 ceph-mon[34732]: pgmap v243: 65 pgs: 65 active+clean; 187 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 551 op/s 2024-09-13T21:44:33.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:33 smithi119 ceph-mon[27653]: pgmap v243: 65 pgs: 65 active+clean; 187 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 551 op/s 2024-09-13T21:44:33.995 INFO:tasks.workunit.client.0.smithi119.stdout:2/4: sync 2024-09-13T21:44:33.995 INFO:tasks.workunit.client.0.smithi119.stdout:2/5: fsync - no filename 2024-09-13T21:44:33.995 INFO:tasks.workunit.client.0.smithi119.stdout:2/6: dread - no filename 2024-09-13T21:44:33.996 INFO:tasks.workunit.client.0.smithi119.stdout:2/7: symlink l0 0 2024-09-13T21:44:33.996 INFO:tasks.workunit.client.0.smithi119.stdout:2/8: write - no filename 2024-09-13T21:44:33.996 INFO:tasks.workunit.client.0.smithi119.stdout:2/9: dread - no filename 2024-09-13T21:44:33.996 INFO:tasks.workunit.client.0.smithi119.stdout:2/10: rmdir - no directory 2024-09-13T21:44:33.997 INFO:tasks.workunit.client.0.smithi119.stdout:2/11: dwrite - no filename 2024-09-13T21:44:33.997 INFO:tasks.workunit.client.0.smithi119.stdout:2/12: chown l0 14433492 1 2024-09-13T21:44:33.998 INFO:tasks.workunit.client.0.smithi119.stdout:2/13: mkdir d1 0 2024-09-13T21:44:33.998 INFO:tasks.workunit.client.0.smithi119.stdout:2/14: dread - no filename 2024-09-13T21:44:33.998 INFO:tasks.workunit.client.0.smithi119.stdout:2/15: dwrite - no filename 2024-09-13T21:44:33.998 INFO:tasks.workunit.client.0.smithi119.stdout:2/16: truncate - no filename 2024-09-13T21:44:33.998 INFO:tasks.workunit.client.0.smithi119.stdout:2/17: read - no filename 2024-09-13T21:44:33.998 INFO:tasks.workunit.client.0.smithi119.stdout:2/18: dread - no filename 2024-09-13T21:44:34.127 INFO:tasks.workunit.client.0.smithi119.stdout:5/15: sync 2024-09-13T21:44:34.170 INFO:tasks.workunit.client.0.smithi119.stdout:6/10: sync 2024-09-13T21:44:34.170 INFO:tasks.workunit.client.0.smithi119.stdout:8/33: sync 2024-09-13T21:44:34.170 INFO:tasks.workunit.client.0.smithi119.stdout:2/19: sync 2024-09-13T21:44:34.171 INFO:tasks.workunit.client.0.smithi119.stdout:2/20: dread - no filename 2024-09-13T21:44:34.171 INFO:tasks.workunit.client.0.smithi119.stdout:7/41: sync 2024-09-13T21:44:34.171 INFO:tasks.workunit.client.0.smithi119.stdout:1/121: sync 2024-09-13T21:44:34.171 INFO:tasks.workunit.client.0.smithi119.stdout:0/65: sync 2024-09-13T21:44:34.171 INFO:tasks.workunit.client.0.smithi119.stdout:3/27: sync 2024-09-13T21:44:34.171 INFO:tasks.workunit.client.0.smithi119.stdout:9/54: sync 2024-09-13T21:44:34.171 INFO:tasks.workunit.client.0.smithi119.stdout:4/36: sync 2024-09-13T21:44:34.172 INFO:tasks.workunit.client.0.smithi119.stdout:9/55: read d0/f9 [126757,26522] 0 2024-09-13T21:44:34.174 INFO:tasks.workunit.client.0.smithi119.stdout:0/66: dread de/f16 [0,4194304] 0 2024-09-13T21:44:34.217 INFO:tasks.workunit.client.0.smithi119.stdout:5/16: rmdir d0/d3 39 2024-09-13T21:44:34.217 INFO:tasks.workunit.client.0.smithi119.stdout:7/42: fdatasync f3 0 2024-09-13T21:44:34.217 INFO:tasks.workunit.client.0.smithi119.stdout:6/11: symlink l5 0 2024-09-13T21:44:34.218 INFO:tasks.workunit.client.0.smithi119.stdout:3/28: creat d6/fa x:0 0 0 2024-09-13T21:44:34.220 INFO:tasks.workunit.client.0.smithi119.stdout:8/34: rename f3 to f5 0 2024-09-13T21:44:34.221 INFO:tasks.workunit.client.0.smithi119.stdout:8/35: chown c4 11 1 2024-09-13T21:44:34.221 INFO:tasks.workunit.client.0.smithi119.stdout:8/36: stat f5 0 2024-09-13T21:44:34.222 INFO:tasks.workunit.client.0.smithi119.stdout:4/37: mknod d4/d5/ca 0 2024-09-13T21:44:34.223 INFO:tasks.workunit.client.0.smithi119.stdout:0/67: symlink de/l19 0 2024-09-13T21:44:34.225 INFO:tasks.workunit.client.0.smithi119.stdout:5/17: dread - d0/d3/d4/f5 zero size 2024-09-13T21:44:34.225 INFO:tasks.workunit.client.0.smithi119.stdout:7/43: symlink d8/lc 0 2024-09-13T21:44:34.225 INFO:tasks.workunit.client.0.smithi119.stdout:8/37: dread f5 [0,4194304] 0 2024-09-13T21:44:34.226 INFO:tasks.workunit.client.0.smithi119.stdout:6/12: mknod c6 0 2024-09-13T21:44:34.226 INFO:tasks.workunit.client.0.smithi119.stdout:6/13: rmdir - no directory 2024-09-13T21:44:34.227 INFO:tasks.workunit.client.0.smithi119.stdout:3/29: creat d6/fb x:0 0 0 2024-09-13T21:44:34.227 INFO:tasks.workunit.client.0.smithi119.stdout:5/18: truncate d0/d3/d4/f5 708935 0 2024-09-13T21:44:34.228 INFO:tasks.workunit.client.0.smithi119.stdout:5/19: chown d0/d3/d4/l7 254342 1 2024-09-13T21:44:34.229 INFO:tasks.workunit.client.0.smithi119.stdout:2/21: mkdir d1/d2 0 2024-09-13T21:44:34.229 INFO:tasks.workunit.client.0.smithi119.stdout:2/22: dwrite - no filename 2024-09-13T21:44:34.229 INFO:tasks.workunit.client.0.smithi119.stdout:2/23: dwrite - no filename 2024-09-13T21:44:34.231 INFO:tasks.workunit.client.0.smithi119.stdout:1/122: mknod d1/d3/c25 0 2024-09-13T21:44:34.233 INFO:tasks.workunit.client.0.smithi119.stdout:1/123: chown d1/d3/c25 20397353 1 2024-09-13T21:44:34.234 INFO:tasks.workunit.client.0.smithi119.stdout:6/14: dwrite f0 [0,4194304] 0 2024-09-13T21:44:34.235 INFO:tasks.workunit.client.0.smithi119.stdout:4/38: symlink d4/d5/lb 0 2024-09-13T21:44:34.238 INFO:tasks.workunit.client.0.smithi119.stdout:8/38: rename c4 to c6 0 2024-09-13T21:44:34.239 INFO:tasks.workunit.client.0.smithi119.stdout:8/39: rmdir - no directory 2024-09-13T21:44:34.239 INFO:tasks.workunit.client.0.smithi119.stdout:4/39: chown l3 1512504 1 2024-09-13T21:44:34.240 INFO:tasks.workunit.client.0.smithi119.stdout:3/30: creat d6/fc x:0 0 0 2024-09-13T21:44:34.245 INFO:tasks.workunit.client.0.smithi119.stdout:5/20: dwrite d0/d3/d4/f5 [0,4194304] 0 2024-09-13T21:44:34.248 INFO:tasks.workunit.client.0.smithi119.stdout:2/24: getdents d1/d2 0 2024-09-13T21:44:34.249 INFO:tasks.workunit.client.0.smithi119.stdout:2/25: read - no filename 2024-09-13T21:44:34.249 INFO:tasks.workunit.client.0.smithi119.stdout:2/26: write - no filename 2024-09-13T21:44:34.254 INFO:tasks.workunit.client.0.smithi119.stdout:1/124: dwrite d1/f1f [0,4194304] 0 2024-09-13T21:44:34.256 INFO:tasks.workunit.client.0.smithi119.stdout:6/15: dread f0 [0,4194304] 0 2024-09-13T21:44:34.257 INFO:tasks.workunit.client.0.smithi119.stdout:6/16: rmdir - no directory 2024-09-13T21:44:34.262 INFO:tasks.workunit.client.0.smithi119.stdout:8/40: dread f5 [0,4194304] 0 2024-09-13T21:44:34.262 INFO:tasks.workunit.client.0.smithi119.stdout:2/27: rmdir d1/d2 0 2024-09-13T21:44:34.262 INFO:tasks.workunit.client.0.smithi119.stdout:2/28: fsync - no filename 2024-09-13T21:44:34.262 INFO:tasks.workunit.client.0.smithi119.stdout:2/29: write - no filename 2024-09-13T21:44:34.265 INFO:tasks.workunit.client.0.smithi119.stdout:1/125: creat d1/f26 x:0 0 0 2024-09-13T21:44:34.266 INFO:tasks.workunit.client.0.smithi119.stdout:3/31: dwrite f5 [0,4194304] 0 2024-09-13T21:44:34.267 INFO:tasks.workunit.client.0.smithi119.stdout:4/40: dwrite d4/f8 [0,4194304] 0 2024-09-13T21:44:34.267 INFO:tasks.workunit.client.0.smithi119.stdout:2/30: symlink d1/l3 0 2024-09-13T21:44:34.269 INFO:tasks.workunit.client.0.smithi119.stdout:5/21: dread d0/d3/d4/f5 [0,4194304] 0 2024-09-13T21:44:34.270 INFO:tasks.workunit.client.0.smithi119.stdout:4/41: readlink l1 0 2024-09-13T21:44:34.271 INFO:tasks.workunit.client.0.smithi119.stdout:4/42: read d4/d5/f6 [3136898,64100] 0 2024-09-13T21:44:34.272 INFO:tasks.workunit.client.0.smithi119.stdout:4/43: readlink l3 0 2024-09-13T21:44:34.273 INFO:tasks.workunit.client.0.smithi119.stdout:2/31: mknod d1/c4 0 2024-09-13T21:44:34.273 INFO:tasks.workunit.client.0.smithi119.stdout:2/32: write - no filename 2024-09-13T21:44:34.273 INFO:tasks.workunit.client.0.smithi119.stdout:2/33: rename d1 to d1/d5 22 2024-09-13T21:44:34.273 INFO:tasks.workunit.client.0.smithi119.stdout:2/34: fsync - no filename 2024-09-13T21:44:34.273 INFO:tasks.workunit.client.0.smithi119.stdout:2/35: dread - no filename 2024-09-13T21:44:34.273 INFO:tasks.workunit.client.0.smithi119.stdout:2/36: dwrite - no filename 2024-09-13T21:44:34.277 INFO:tasks.workunit.client.0.smithi119.stdout:3/32: rename d6/c9 to d6/cd 0 2024-09-13T21:44:34.279 INFO:tasks.workunit.client.0.smithi119.stdout:3/33: chown l1 3735 1 2024-09-13T21:44:34.279 INFO:tasks.workunit.client.0.smithi119.stdout:5/22: write d0/d3/d4/f5 [2881027,105574] 0 2024-09-13T21:44:34.282 INFO:tasks.workunit.client.0.smithi119.stdout:2/37: creat d1/f6 x:0 0 0 2024-09-13T21:44:34.283 INFO:tasks.workunit.client.0.smithi119.stdout:1/126: truncate d1/d3/f9 2622023 0 2024-09-13T21:44:34.285 INFO:tasks.workunit.client.0.smithi119.stdout:3/34: symlink d6/le 0 2024-09-13T21:44:34.287 INFO:tasks.workunit.client.0.smithi119.stdout:5/23: symlink d0/d3/d4/l8 0 2024-09-13T21:44:34.288 INFO:tasks.workunit.client.0.smithi119.stdout:5/24: stat d0/d3/d4 0 2024-09-13T21:44:34.288 INFO:tasks.workunit.client.0.smithi119.stdout:2/38: mkdir d1/d7 0 2024-09-13T21:44:34.289 INFO:tasks.workunit.client.0.smithi119.stdout:5/25: read d0/d3/d4/f5 [1708891,9565] 0 2024-09-13T21:44:34.289 INFO:tasks.workunit.client.0.smithi119.stdout:2/39: chown d1/l3 2289 1 2024-09-13T21:44:34.290 INFO:tasks.workunit.client.0.smithi119.stdout:1/127: creat d1/f27 x:0 0 0 2024-09-13T21:44:34.291 INFO:tasks.workunit.client.0.smithi119.stdout:3/35: unlink f2 0 2024-09-13T21:44:34.292 INFO:tasks.workunit.client.0.smithi119.stdout:3/36: read f5 [1032634,2771] 0 2024-09-13T21:44:34.293 INFO:tasks.workunit.client.0.smithi119.stdout:3/37: dread - d6/fc zero size 2024-09-13T21:44:34.294 INFO:tasks.workunit.client.0.smithi119.stdout:3/38: write d6/fb [1036557,68192] 0 2024-09-13T21:44:34.295 INFO:tasks.workunit.client.0.smithi119.stdout:5/26: dread d0/d3/d4/f5 [0,4194304] 0 2024-09-13T21:44:34.295 INFO:tasks.workunit.client.0.smithi119.stdout:1/128: mkdir d1/d3/dc/d11/d28 0 2024-09-13T21:44:34.297 INFO:tasks.workunit.client.0.smithi119.stdout:1/129: chown d1/f1b 4434740 1 2024-09-13T21:44:34.298 INFO:tasks.workunit.client.0.smithi119.stdout:2/40: link d1/f6 d1/f8 0 2024-09-13T21:44:34.299 INFO:tasks.workunit.client.0.smithi119.stdout:2/41: read - d1/f6 zero size 2024-09-13T21:44:34.299 INFO:tasks.workunit.client.0.smithi119.stdout:3/39: creat d6/ff x:0 0 0 2024-09-13T21:44:34.300 INFO:tasks.workunit.client.0.smithi119.stdout:2/42: read - d1/f8 zero size 2024-09-13T21:44:34.301 INFO:tasks.workunit.client.0.smithi119.stdout:5/27: mkdir d0/d3/d4/d9 0 2024-09-13T21:44:34.305 INFO:tasks.workunit.client.0.smithi119.stdout:5/28: dread d0/d3/d4/f5 [0,4194304] 0 2024-09-13T21:44:34.305 INFO:tasks.workunit.client.0.smithi119.stdout:3/40: rename f0 to d6/f10 0 2024-09-13T21:44:34.308 INFO:tasks.workunit.client.0.smithi119.stdout:1/130: creat d1/d3/dc/d24/f29 x:0 0 0 2024-09-13T21:44:34.310 INFO:tasks.workunit.client.0.smithi119.stdout:1/131: dread - d1/f26 zero size 2024-09-13T21:44:34.311 INFO:tasks.workunit.client.0.smithi119.stdout:5/29: write d0/d3/d4/f5 [1225505,34284] 0 2024-09-13T21:44:34.316 INFO:tasks.workunit.client.0.smithi119.stdout:2/43: dwrite d1/f6 [0,4194304] 0 2024-09-13T21:44:34.321 INFO:tasks.workunit.client.0.smithi119.stdout:2/44: creat d1/d7/f9 x:0 0 0 2024-09-13T21:44:34.322 INFO:tasks.workunit.client.0.smithi119.stdout:3/41: dwrite f5 [0,4194304] 0 2024-09-13T21:44:34.327 INFO:tasks.workunit.client.0.smithi119.stdout:5/30: dwrite d0/d3/d4/f5 [0,4194304] 0 2024-09-13T21:44:34.328 INFO:tasks.workunit.client.0.smithi119.stdout:2/45: rename l0 to d1/d7/la 0 2024-09-13T21:44:34.328 INFO:tasks.workunit.client.0.smithi119.stdout:2/46: chown d1/f6 63 1 2024-09-13T21:44:34.332 INFO:tasks.workunit.client.0.smithi119.stdout:3/42: rename f5 to d6/f11 0 2024-09-13T21:44:34.334 INFO:tasks.workunit.client.0.smithi119.stdout:5/31: creat d0/d3/d4/fa x:0 0 0 2024-09-13T21:44:34.335 INFO:tasks.workunit.client.0.smithi119.stdout:5/32: write d0/d3/d4/fa [289054,17121] 0 2024-09-13T21:44:34.336 INFO:tasks.workunit.client.0.smithi119.stdout:5/33: chown d0/d3/d4/l7 1019673941 1 2024-09-13T21:44:34.337 INFO:tasks.workunit.client.0.smithi119.stdout:3/43: creat d6/f12 x:0 0 0 2024-09-13T21:44:34.341 INFO:tasks.workunit.client.0.smithi119.stdout:3/44: link d6/fc d6/f13 0 2024-09-13T21:44:34.344 INFO:tasks.workunit.client.0.smithi119.stdout:3/45: creat d6/f14 x:0 0 0 2024-09-13T21:44:34.344 INFO:tasks.workunit.client.0.smithi119.stdout:5/34: link d0/d3/d4/l8 d0/lb 0 2024-09-13T21:44:34.344 INFO:tasks.workunit.client.0.smithi119.stdout:3/46: dread - d6/f12 zero size 2024-09-13T21:44:34.346 INFO:tasks.workunit.client.0.smithi119.stdout:5/35: write d0/d3/d4/fa [227318,110306] 0 2024-09-13T21:44:34.347 INFO:tasks.workunit.client.0.smithi119.stdout:3/47: write d6/f10 [4492018,75129] 0 2024-09-13T21:44:34.349 INFO:tasks.workunit.client.0.smithi119.stdout:3/48: truncate d6/f11 4656479 0 2024-09-13T21:44:34.349 INFO:tasks.workunit.client.0.smithi119.stdout:5/36: creat d0/d3/fc x:0 0 0 2024-09-13T21:44:34.351 INFO:tasks.workunit.client.0.smithi119.stdout:5/37: write d0/d3/d4/fa [1341013,9001] 0 2024-09-13T21:44:34.351 INFO:tasks.workunit.client.0.smithi119.stdout:3/49: mkdir d6/d15 0 2024-09-13T21:44:34.355 INFO:tasks.workunit.client.0.smithi119.stdout:5/38: creat d0/fd x:0 0 0 2024-09-13T21:44:34.357 INFO:tasks.workunit.client.0.smithi119.stdout:5/39: chown d0/lb 24 1 2024-09-13T21:44:34.358 INFO:tasks.workunit.client.0.smithi119.stdout:5/40: chown d0/d3/fc 66664 1 2024-09-13T21:44:34.482 INFO:tasks.workunit.client.0.smithi119.stdout:0/68: getdents de 0 2024-09-13T21:44:34.482 INFO:tasks.workunit.client.0.smithi119.stdout:7/44: getdents d8 0 2024-09-13T21:44:34.483 INFO:tasks.workunit.client.0.smithi119.stdout:0/69: creat de/f1a x:0 0 0 2024-09-13T21:44:34.484 INFO:tasks.workunit.client.0.smithi119.stdout:0/70: chown fd 1 1 2024-09-13T21:44:34.484 INFO:tasks.workunit.client.0.smithi119.stdout:6/17: getdents . 0 2024-09-13T21:44:34.485 INFO:tasks.workunit.client.0.smithi119.stdout:7/45: unlink l7 0 2024-09-13T21:44:34.489 INFO:tasks.workunit.client.0.smithi119.stdout:7/46: rename c2 to d8/d9/cd 0 2024-09-13T21:44:34.489 INFO:tasks.workunit.client.0.smithi119.stdout:7/47: write d8/d9/fa [872748,98773] 0 2024-09-13T21:44:34.491 INFO:tasks.workunit.client.0.smithi119.stdout:7/48: creat d8/d9/fe x:0 0 0 2024-09-13T21:44:34.492 INFO:tasks.workunit.client.0.smithi119.stdout:9/56: truncate d0/f7 7881480 0 2024-09-13T21:44:34.493 INFO:tasks.workunit.client.0.smithi119.stdout:8/41: getdents . 0 2024-09-13T21:44:34.496 INFO:tasks.workunit.client.0.smithi119.stdout:9/57: link d0/d8/cf d0/c11 0 2024-09-13T21:44:34.500 INFO:tasks.workunit.client.0.smithi119.stdout:9/58: mknod d0/d8/c12 0 2024-09-13T21:44:34.500 INFO:tasks.workunit.client.0.smithi119.stdout:7/49: dwrite f5 [0,4194304] 0 2024-09-13T21:44:34.501 INFO:tasks.workunit.client.0.smithi119.stdout:8/42: dread f5 [4194304,4194304] 0 2024-09-13T21:44:34.501 INFO:tasks.workunit.client.0.smithi119.stdout:7/50: truncate f3 4242598 0 2024-09-13T21:44:34.502 INFO:tasks.workunit.client.0.smithi119.stdout:9/59: symlink d0/l13 0 2024-09-13T21:44:34.504 INFO:tasks.workunit.client.0.smithi119.stdout:8/43: mknod c7 0 2024-09-13T21:44:34.506 INFO:tasks.workunit.client.0.smithi119.stdout:9/60: unlink d0/f9 0 2024-09-13T21:44:34.508 INFO:tasks.workunit.client.0.smithi119.stdout:8/44: mknod c8 0 2024-09-13T21:44:34.509 INFO:tasks.workunit.client.0.smithi119.stdout:4/44: truncate d4/d5/f6 326471 0 2024-09-13T21:44:34.510 INFO:tasks.workunit.client.0.smithi119.stdout:8/45: chown c8 1817845 1 2024-09-13T21:44:34.510 INFO:tasks.workunit.client.0.smithi119.stdout:7/51: dwrite f6 [4194304,4194304] 0 2024-09-13T21:44:34.511 INFO:tasks.workunit.client.0.smithi119.stdout:8/46: stat f5 0 2024-09-13T21:44:34.511 INFO:tasks.workunit.client.0.smithi119.stdout:8/47: rmdir - no directory 2024-09-13T21:44:34.513 INFO:tasks.workunit.client.0.smithi119.stdout:9/61: link d0/d8/f10 d0/f14 0 2024-09-13T21:44:34.514 INFO:tasks.workunit.client.0.smithi119.stdout:7/52: unlink l4 0 2024-09-13T21:44:34.514 INFO:tasks.workunit.client.0.smithi119.stdout:7/53: chown d8 5752167 1 2024-09-13T21:44:34.515 INFO:tasks.workunit.client.0.smithi119.stdout:7/54: fsync d8/d9/fa 0 2024-09-13T21:44:34.516 INFO:tasks.workunit.client.0.smithi119.stdout:8/48: write f5 [8998753,110473] 0 2024-09-13T21:44:34.517 INFO:tasks.workunit.client.0.smithi119.stdout:9/62: write d0/f14 [1281229,34568] 0 2024-09-13T21:44:34.518 INFO:tasks.workunit.client.0.smithi119.stdout:9/63: readlink d0/d8/ld 0 2024-09-13T21:44:34.523 INFO:tasks.workunit.client.0.smithi119.stdout:8/49: creat f9 x:0 0 0 2024-09-13T21:44:34.523 INFO:tasks.workunit.client.0.smithi119.stdout:8/50: stat f5 0 2024-09-13T21:44:34.525 INFO:tasks.workunit.client.0.smithi119.stdout:4/45: link l3 d4/d5/lc 0 2024-09-13T21:44:34.527 INFO:tasks.workunit.client.0.smithi119.stdout:9/64: dread d0/d8/f10 [0,4194304] 0 2024-09-13T21:44:34.527 INFO:tasks.workunit.client.0.smithi119.stdout:8/51: mknod ca 0 2024-09-13T21:44:34.531 INFO:tasks.workunit.client.0.smithi119.stdout:4/46: dread d4/f8 [0,4194304] 0 2024-09-13T21:44:34.532 INFO:tasks.workunit.client.0.smithi119.stdout:9/65: mkdir d0/d8/d15 0 2024-09-13T21:44:34.537 INFO:tasks.workunit.client.0.smithi119.stdout:8/52: dwrite f9 [0,4194304] 0 2024-09-13T21:44:34.541 INFO:tasks.workunit.client.0.smithi119.stdout:8/53: creat fb x:0 0 0 2024-09-13T21:44:34.544 INFO:tasks.workunit.client.0.smithi119.stdout:8/54: stat c6 0 2024-09-13T21:44:34.544 INFO:tasks.workunit.client.0.smithi119.stdout:5/41: truncate d0/d3/d4/f5 2380879 0 2024-09-13T21:44:34.545 INFO:tasks.workunit.client.0.smithi119.stdout:0/71: rmdir de 39 2024-09-13T21:44:34.546 INFO:tasks.workunit.client.0.smithi119.stdout:4/47: dwrite d4/f8 [0,4194304] 0 2024-09-13T21:44:34.547 INFO:tasks.workunit.client.0.smithi119.stdout:8/55: creat fc x:0 0 0 2024-09-13T21:44:34.547 INFO:tasks.workunit.client.0.smithi119.stdout:8/56: rmdir - no directory 2024-09-13T21:44:34.549 INFO:tasks.workunit.client.0.smithi119.stdout:6/18: truncate f0 2573840 0 2024-09-13T21:44:34.550 INFO:tasks.workunit.client.0.smithi119.stdout:9/66: dwrite d0/d8/f10 [0,4194304] 0 2024-09-13T21:44:34.552 INFO:tasks.workunit.client.0.smithi119.stdout:8/57: creat fd x:0 0 0 2024-09-13T21:44:34.553 INFO:tasks.workunit.client.0.smithi119.stdout:7/55: getdents d8/d9 0 2024-09-13T21:44:34.556 INFO:tasks.workunit.client.0.smithi119.stdout:7/56: write f3 [864001,78668] 0 2024-09-13T21:44:34.559 INFO:tasks.workunit.client.0.smithi119.stdout:0/72: creat de/f1b x:0 0 0 2024-09-13T21:44:34.562 INFO:tasks.workunit.client.0.smithi119.stdout:7/57: write d8/d9/fe [940377,50262] 0 2024-09-13T21:44:34.564 INFO:tasks.workunit.client.0.smithi119.stdout:8/58: dwrite fd [0,4194304] 0 2024-09-13T21:44:34.565 INFO:tasks.workunit.client.0.smithi119.stdout:9/67: dread d0/f14 [0,4194304] 0 2024-09-13T21:44:34.568 INFO:tasks.workunit.client.0.smithi119.stdout:1/132: write d1/d3/f4 [3449377,65545] 0 2024-09-13T21:44:34.579 INFO:tasks.workunit.client.0.smithi119.stdout:4/48: getdents d4/d5 0 2024-09-13T21:44:34.579 INFO:tasks.workunit.client.0.smithi119.stdout:4/49: chown d4 216585 1 2024-09-13T21:44:34.580 INFO:tasks.workunit.client.0.smithi119.stdout:9/68: dwrite d0/d8/f10 [0,4194304] 0 2024-09-13T21:44:34.582 INFO:tasks.workunit.client.0.smithi119.stdout:7/58: truncate d8/d9/fa 803024 0 2024-09-13T21:44:34.585 INFO:tasks.workunit.client.0.smithi119.stdout:9/69: dread d0/d8/f10 [0,4194304] 0 2024-09-13T21:44:34.595 INFO:tasks.workunit.client.0.smithi119.stdout:4/50: dread d4/d5/f6 [0,4194304] 0 2024-09-13T21:44:34.596 INFO:tasks.workunit.client.0.smithi119.stdout:1/133: truncate d1/f1f 3626704 0 2024-09-13T21:44:34.598 INFO:tasks.workunit.client.0.smithi119.stdout:9/70: truncate d0/d8/f10 1432013 0 2024-09-13T21:44:34.599 INFO:tasks.workunit.client.0.smithi119.stdout:5/42: truncate d0/d3/d4/f5 2803104 0 2024-09-13T21:44:34.601 INFO:tasks.workunit.client.0.smithi119.stdout:0/73: dwrite de/f16 [0,4194304] 0 2024-09-13T21:44:34.603 INFO:tasks.workunit.client.0.smithi119.stdout:4/51: getdents d4 0 2024-09-13T21:44:34.604 INFO:tasks.workunit.client.0.smithi119.stdout:0/74: dread - de/f1a zero size 2024-09-13T21:44:34.604 INFO:tasks.workunit.client.0.smithi119.stdout:7/59: truncate d8/d9/fe 915433 0 2024-09-13T21:44:34.606 INFO:tasks.workunit.client.0.smithi119.stdout:1/134: dread d1/f1b [0,4194304] 0 2024-09-13T21:44:34.606 INFO:tasks.workunit.client.0.smithi119.stdout:0/75: chown de/l19 1851950 1 2024-09-13T21:44:34.611 INFO:tasks.workunit.client.0.smithi119.stdout:0/76: truncate de/f1b 272836 0 2024-09-13T21:44:34.614 INFO:tasks.workunit.client.0.smithi119.stdout:1/135: unlink d1/d3/dc/d11/l23 0 2024-09-13T21:44:34.614 INFO:tasks.workunit.client.0.smithi119.stdout:6/19: dwrite f0 [0,4194304] 0 2024-09-13T21:44:34.614 INFO:tasks.workunit.client.0.smithi119.stdout:9/71: dread d0/f14 [0,4194304] 0 2024-09-13T21:44:34.615 INFO:tasks.workunit.client.0.smithi119.stdout:4/52: dread d4/f8 [0,4194304] 0 2024-09-13T21:44:34.617 INFO:tasks.workunit.client.0.smithi119.stdout:5/43: getdents d0 0 2024-09-13T21:44:34.619 INFO:tasks.workunit.client.0.smithi119.stdout:7/60: dread d8/d9/fa [0,4194304] 0 2024-09-13T21:44:34.620 INFO:tasks.workunit.client.0.smithi119.stdout:6/20: creat f7 x:0 0 0 2024-09-13T21:44:34.621 INFO:tasks.workunit.client.0.smithi119.stdout:6/21: chown l2 1503996575 1 2024-09-13T21:44:34.621 INFO:tasks.workunit.client.0.smithi119.stdout:6/22: stat l2 0 2024-09-13T21:44:34.622 INFO:tasks.workunit.client.0.smithi119.stdout:4/53: fsync d4/d5/f6 0 2024-09-13T21:44:34.625 INFO:tasks.workunit.client.0.smithi119.stdout:9/72: fdatasync d0/f7 0 2024-09-13T21:44:34.625 INFO:tasks.workunit.client.0.smithi119.stdout:7/61: symlink d8/d9/lf 0 2024-09-13T21:44:34.627 INFO:tasks.workunit.client.0.smithi119.stdout:0/77: truncate fd 839775 0 2024-09-13T21:44:34.628 INFO:tasks.workunit.client.0.smithi119.stdout:6/23: rename c6 to c8 0 2024-09-13T21:44:34.629 INFO:tasks.workunit.client.0.smithi119.stdout:6/24: fsync f7 0 2024-09-13T21:44:34.629 INFO:tasks.workunit.client.0.smithi119.stdout:5/44: getdents d0/d3/d4/d9 0 2024-09-13T21:44:34.630 INFO:tasks.workunit.client.0.smithi119.stdout:9/73: fdatasync d0/f6 0 2024-09-13T21:44:34.631 INFO:tasks.workunit.client.0.smithi119.stdout:1/136: creat d1/d3/f2a x:0 0 0 2024-09-13T21:44:34.632 INFO:tasks.workunit.client.0.smithi119.stdout:7/62: creat d8/f10 x:0 0 0 2024-09-13T21:44:34.632 INFO:tasks.workunit.client.0.smithi119.stdout:0/78: dread de/f16 [0,4194304] 0 2024-09-13T21:44:34.634 INFO:tasks.workunit.client.0.smithi119.stdout:6/25: unlink f0 0 2024-09-13T21:44:34.635 INFO:tasks.workunit.client.0.smithi119.stdout:6/26: fsync f7 0 2024-09-13T21:44:34.635 INFO:tasks.workunit.client.0.smithi119.stdout:5/45: mknod d0/d3/ce 0 2024-09-13T21:44:34.636 INFO:tasks.workunit.client.0.smithi119.stdout:6/27: write f7 [452343,96453] 0 2024-09-13T21:44:34.637 INFO:tasks.workunit.client.0.smithi119.stdout:6/28: truncate f7 1033405 0 2024-09-13T21:44:34.638 INFO:tasks.workunit.client.0.smithi119.stdout:6/29: chown l4 26827636 1 2024-09-13T21:44:34.641 INFO:tasks.workunit.client.0.smithi119.stdout:0/79: mkdir de/d1c 0 2024-09-13T21:44:34.643 INFO:tasks.workunit.client.0.smithi119.stdout:9/74: creat d0/d8/d15/f16 x:0 0 0 2024-09-13T21:44:34.643 INFO:tasks.workunit.client.0.smithi119.stdout:6/30: dread f7 [0,4194304] 0 2024-09-13T21:44:34.644 INFO:tasks.workunit.client.0.smithi119.stdout:5/46: dwrite d0/fd [0,4194304] 0 2024-09-13T21:44:34.645 INFO:tasks.workunit.client.0.smithi119.stdout:4/54: write f2 [1786048,72245] 0 2024-09-13T21:44:34.646 INFO:tasks.workunit.client.0.smithi119.stdout:5/47: stat d0/fd 0 2024-09-13T21:44:34.650 INFO:tasks.workunit.client.0.smithi119.stdout:6/31: creat f9 x:0 0 0 2024-09-13T21:44:34.657 INFO:tasks.workunit.client.0.smithi119.stdout:1/137: getdents d1/d3/dc/d11 0 2024-09-13T21:44:34.660 INFO:tasks.workunit.client.0.smithi119.stdout:9/75: link d0/f6 d0/d8/d15/f17 0 2024-09-13T21:44:34.661 INFO:tasks.workunit.client.0.smithi119.stdout:4/55: dwrite d4/d5/f6 [0,4194304] 0 2024-09-13T21:44:34.661 INFO:tasks.workunit.client.0.smithi119.stdout:5/48: mknod d0/d3/d4/d9/cf 0 2024-09-13T21:44:34.661 INFO:tasks.workunit.client.0.smithi119.stdout:0/80: dread fc [0,4194304] 0 2024-09-13T21:44:34.666 INFO:tasks.workunit.client.0.smithi119.stdout:4/56: truncate f2 2075676 0 2024-09-13T21:44:34.666 INFO:tasks.workunit.client.0.smithi119.stdout:1/138: rmdir d1/d3/dc/d24 39 2024-09-13T21:44:34.671 INFO:tasks.workunit.client.0.smithi119.stdout:4/57: mknod d4/cd 0 2024-09-13T21:44:34.672 INFO:tasks.workunit.client.0.smithi119.stdout:7/63: dwrite d8/d9/fe [0,4194304] 0 2024-09-13T21:44:34.673 INFO:tasks.workunit.client.0.smithi119.stdout:6/32: dwrite f9 [0,4194304] 0 2024-09-13T21:44:34.679 INFO:tasks.workunit.client.0.smithi119.stdout:0/81: creat de/d1c/f1d x:0 0 0 2024-09-13T21:44:34.681 INFO:tasks.workunit.client.0.smithi119.stdout:6/33: creat fa x:0 0 0 2024-09-13T21:44:34.683 INFO:tasks.workunit.client.0.smithi119.stdout:0/82: readlink l1 0 2024-09-13T21:44:34.688 INFO:tasks.workunit.client.0.smithi119.stdout:5/49: dwrite d0/fd [4194304,4194304] 0 2024-09-13T21:44:34.693 INFO:tasks.workunit.client.0.smithi119.stdout:9/76: dwrite d0/d8/d15/f16 [0,4194304] 0 2024-09-13T21:44:34.695 INFO:tasks.workunit.client.0.smithi119.stdout:1/139: dread d1/f1f [0,4194304] 0 2024-09-13T21:44:34.698 INFO:tasks.workunit.client.0.smithi119.stdout:7/64: dwrite f5 [4194304,4194304] 0 2024-09-13T21:44:34.701 INFO:tasks.workunit.client.0.smithi119.stdout:9/77: chown d0/c4 180075 1 2024-09-13T21:44:34.704 INFO:tasks.workunit.client.0.smithi119.stdout:5/50: creat d0/d3/d4/d9/f10 x:0 0 0 2024-09-13T21:44:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:6/34: dwrite f9 [0,4194304] 0 2024-09-13T21:44:34.707 INFO:tasks.workunit.client.0.smithi119.stdout:7/65: creat d8/d9/f11 x:0 0 0 2024-09-13T21:44:34.712 INFO:tasks.workunit.client.0.smithi119.stdout:9/78: mkdir d0/d8/d18 0 2024-09-13T21:44:34.712 INFO:tasks.workunit.client.0.smithi119.stdout:5/51: creat d0/d3/f11 x:0 0 0 2024-09-13T21:44:34.713 INFO:tasks.workunit.client.0.smithi119.stdout:1/140: write d1/d3/dc/d24/f29 [887942,109890] 0 2024-09-13T21:44:34.716 INFO:tasks.workunit.client.0.smithi119.stdout:7/66: creat d8/d9/f12 x:0 0 0 2024-09-13T21:44:34.719 INFO:tasks.workunit.client.0.smithi119.stdout:0/83: dwrite fd [0,4194304] 0 2024-09-13T21:44:34.720 INFO:tasks.workunit.client.0.smithi119.stdout:4/58: dread d4/d5/f6 [0,4194304] 0 2024-09-13T21:44:34.721 INFO:tasks.workunit.client.0.smithi119.stdout:9/79: mkdir d0/d19 0 2024-09-13T21:44:34.721 INFO:tasks.workunit.client.0.smithi119.stdout:4/59: stat d4 0 2024-09-13T21:44:34.721 INFO:tasks.workunit.client.0.smithi119.stdout:7/67: symlink d8/d9/l13 0 2024-09-13T21:44:34.722 INFO:tasks.workunit.client.0.smithi119.stdout:5/52: creat d0/d3/f12 x:0 0 0 2024-09-13T21:44:34.724 INFO:tasks.workunit.client.0.smithi119.stdout:7/68: read f5 [4410704,92708] 0 2024-09-13T21:44:34.725 INFO:tasks.workunit.client.0.smithi119.stdout:0/84: mknod de/d1c/c1e 0 2024-09-13T21:44:34.726 INFO:tasks.workunit.client.0.smithi119.stdout:4/60: write f2 [2858920,44683] 0 2024-09-13T21:44:34.727 INFO:tasks.workunit.client.0.smithi119.stdout:6/35: dread f9 [0,4194304] 0 2024-09-13T21:44:34.727 INFO:tasks.workunit.client.0.smithi119.stdout:6/36: rmdir - no directory 2024-09-13T21:44:34.730 INFO:tasks.workunit.client.0.smithi119.stdout:5/53: symlink d0/d3/l13 0 2024-09-13T21:44:34.731 INFO:tasks.workunit.client.0.smithi119.stdout:1/141: dwrite d1/f1a [0,4194304] 0 2024-09-13T21:44:34.731 INFO:tasks.workunit.client.0.smithi119.stdout:7/69: mknod d8/c14 0 2024-09-13T21:44:34.734 INFO:tasks.workunit.client.0.smithi119.stdout:0/85: symlink de/d1c/l1f 0 2024-09-13T21:44:34.734 INFO:tasks.workunit.client.0.smithi119.stdout:1/142: dread d1/d3/dc/f1c [0,4194304] 0 2024-09-13T21:44:34.734 INFO:tasks.workunit.client.0.smithi119.stdout:0/86: dread - de/f10 zero size 2024-09-13T21:44:34.735 INFO:tasks.workunit.client.0.smithi119.stdout:9/80: mkdir d0/d19/d1a 0 2024-09-13T21:44:34.738 INFO:tasks.workunit.client.0.smithi119.stdout:2/47: sync 2024-09-13T21:44:34.738 INFO:tasks.workunit.client.0.smithi119.stdout:5/54: rmdir d0/d3/d4/d9 39 2024-09-13T21:44:34.740 INFO:tasks.workunit.client.0.smithi119.stdout:7/70: truncate d8/d9/fa 1795005 0 2024-09-13T21:44:34.741 INFO:tasks.workunit.client.0.smithi119.stdout:5/55: chown d0/d3/d4 1689139 1 2024-09-13T21:44:34.741 INFO:tasks.workunit.client.0.smithi119.stdout:7/71: fsync d8/f10 0 2024-09-13T21:44:34.742 INFO:tasks.workunit.client.0.smithi119.stdout:9/81: rename d0/f2 to d0/d8/d15/f1b 0 2024-09-13T21:44:34.743 INFO:tasks.workunit.client.0.smithi119.stdout:0/87: creat de/d1c/f20 x:0 0 0 2024-09-13T21:44:34.743 INFO:tasks.workunit.client.0.smithi119.stdout:5/56: read - d0/d3/f12 zero size 2024-09-13T21:44:34.744 INFO:tasks.workunit.client.0.smithi119.stdout:1/143: dwrite d1/f1b [0,4194304] 0 2024-09-13T21:44:34.746 INFO:tasks.workunit.client.0.smithi119.stdout:2/48: symlink d1/d7/lb 0 2024-09-13T21:44:34.747 INFO:tasks.workunit.client.0.smithi119.stdout:7/72: mkdir d8/d15 0 2024-09-13T21:44:34.747 INFO:tasks.workunit.client.0.smithi119.stdout:2/49: chown d1/f8 355 1 2024-09-13T21:44:34.748 INFO:tasks.workunit.client.0.smithi119.stdout:1/144: unlink d1/f27 0 2024-09-13T21:44:34.748 INFO:tasks.workunit.client.0.smithi119.stdout:2/50: readlink d1/d7/lb 0 2024-09-13T21:44:34.749 INFO:tasks.workunit.client.0.smithi119.stdout:1/145: stat d1/f22 0 2024-09-13T21:44:34.749 INFO:tasks.workunit.client.0.smithi119.stdout:2/51: fsync d1/f6 0 2024-09-13T21:44:34.753 INFO:tasks.workunit.client.0.smithi119.stdout:4/61: truncate d4/d5/f6 1247850 0 2024-09-13T21:44:34.758 INFO:tasks.workunit.client.0.smithi119.stdout:1/146: dread d1/d3/f4 [0,4194304] 0 2024-09-13T21:44:34.758 INFO:tasks.workunit.client.0.smithi119.stdout:6/37: getdents . 0 2024-09-13T21:44:34.761 INFO:tasks.workunit.client.0.smithi119.stdout:0/88: rename de/l14 to de/l21 0 2024-09-13T21:44:34.761 INFO:tasks.workunit.client.0.smithi119.stdout:2/52: dwrite d1/f6 [4194304,4194304] 0 2024-09-13T21:44:34.761 INFO:tasks.workunit.client.0.smithi119.stdout:5/57: mkdir d0/d3/d4/d9/d14 0 2024-09-13T21:44:34.762 INFO:tasks.workunit.client.0.smithi119.stdout:9/82: truncate d0/d8/d15/f17 170963 0 2024-09-13T21:44:34.763 INFO:tasks.workunit.client.0.smithi119.stdout:6/38: creat fb x:0 0 0 2024-09-13T21:44:34.764 INFO:tasks.workunit.client.0.smithi119.stdout:5/58: rmdir d0 39 2024-09-13T21:44:34.767 INFO:tasks.workunit.client.0.smithi119.stdout:7/73: write f5 [8734182,88751] 0 2024-09-13T21:44:34.769 INFO:tasks.workunit.client.0.smithi119.stdout:6/39: write f9 [2221122,115954] 0 2024-09-13T21:44:34.770 INFO:tasks.workunit.client.0.smithi119.stdout:9/83: creat d0/d8/d18/f1c x:0 0 0 2024-09-13T21:44:34.773 INFO:tasks.workunit.client.0.smithi119.stdout:7/74: unlink d8/f10 0 2024-09-13T21:44:34.773 INFO:tasks.workunit.client.0.smithi119.stdout:6/40: mkdir dc 0 2024-09-13T21:44:34.774 INFO:tasks.workunit.client.0.smithi119.stdout:6/41: dread - fa zero size 2024-09-13T21:44:34.774 INFO:tasks.workunit.client.0.smithi119.stdout:5/59: creat d0/d3/f15 x:0 0 0 2024-09-13T21:44:34.775 INFO:tasks.workunit.client.0.smithi119.stdout:2/53: link d1/c4 d1/d7/cc 0 2024-09-13T21:44:34.775 INFO:tasks.workunit.client.0.smithi119.stdout:9/84: write d0/f14 [1234134,49269] 0 2024-09-13T21:44:34.776 INFO:tasks.workunit.client.0.smithi119.stdout:5/60: chown d0/d3/l13 1506603 1 2024-09-13T21:44:34.776 INFO:tasks.workunit.client.0.smithi119.stdout:7/75: symlink d8/d9/l16 0 2024-09-13T21:44:34.776 INFO:tasks.workunit.client.0.smithi119.stdout:9/85: read d0/d8/d15/f16 [4087855,54741] 0 2024-09-13T21:44:34.777 INFO:tasks.workunit.client.0.smithi119.stdout:5/61: fdatasync d0/d3/f12 0 2024-09-13T21:44:34.777 INFO:tasks.workunit.client.0.smithi119.stdout:6/42: unlink c8 0 2024-09-13T21:44:34.781 INFO:tasks.workunit.client.0.smithi119.stdout:6/43: mkdir dc/dd 0 2024-09-13T21:44:34.783 INFO:tasks.workunit.client.0.smithi119.stdout:6/44: chown l3 107605227 1 2024-09-13T21:44:34.785 INFO:tasks.workunit.client.0.smithi119.stdout:6/45: fdatasync fa 0 2024-09-13T21:44:34.787 INFO:tasks.workunit.client.0.smithi119.stdout:7/76: dwrite d8/d9/f12 [0,4194304] 0 2024-09-13T21:44:34.789 INFO:tasks.workunit.client.0.smithi119.stdout:5/62: dwrite d0/fd [4194304,4194304] 0 2024-09-13T21:44:34.789 INFO:tasks.workunit.client.0.smithi119.stdout:5/63: dread - d0/d3/f12 zero size 2024-09-13T21:44:34.790 INFO:tasks.workunit.client.0.smithi119.stdout:6/46: rename f7 to dc/dd/fe 0 2024-09-13T21:44:34.790 INFO:tasks.workunit.client.0.smithi119.stdout:7/77: creat d8/f17 x:0 0 0 2024-09-13T21:44:34.791 INFO:tasks.workunit.client.0.smithi119.stdout:5/64: truncate d0/d3/fc 210811 0 2024-09-13T21:44:34.795 INFO:tasks.workunit.client.0.smithi119.stdout:7/78: dread f3 [0,4194304] 0 2024-09-13T21:44:34.799 INFO:tasks.workunit.client.0.smithi119.stdout:5/65: dwrite d0/d3/f15 [0,4194304] 0 2024-09-13T21:44:34.801 INFO:tasks.workunit.client.0.smithi119.stdout:7/79: dread d8/d9/fe [0,4194304] 0 2024-09-13T21:44:34.802 INFO:tasks.workunit.client.0.smithi119.stdout:7/80: chown d8/d9/f11 1811898 1 2024-09-13T21:44:34.802 INFO:tasks.workunit.client.0.smithi119.stdout:5/66: rename d0/d3/d4/l7 to d0/d3/d4/d9/l16 0 2024-09-13T21:44:34.805 INFO:tasks.workunit.client.0.smithi119.stdout:7/81: symlink d8/d9/l18 0 2024-09-13T21:44:34.806 INFO:tasks.workunit.client.0.smithi119.stdout:5/67: creat d0/d3/d4/d9/d14/f17 x:0 0 0 2024-09-13T21:44:34.810 INFO:tasks.workunit.client.0.smithi119.stdout:5/68: chown d0/d3/d4/d9/d14/f17 246784940 1 2024-09-13T21:44:34.810 INFO:tasks.workunit.client.0.smithi119.stdout:7/82: rename d8/d15 to d8/d19 0 2024-09-13T21:44:34.810 INFO:tasks.workunit.client.0.smithi119.stdout:7/83: fsync f3 0 2024-09-13T21:44:34.811 INFO:tasks.workunit.client.0.smithi119.stdout:7/84: read d8/d9/fe [1247721,104194] 0 2024-09-13T21:44:34.813 INFO:tasks.workunit.client.0.smithi119.stdout:5/69: rename d0/d3/d4/d9/cf to d0/d3/d4/d9/d14/c18 0 2024-09-13T21:44:34.814 INFO:tasks.workunit.client.0.smithi119.stdout:7/85: creat d8/d19/f1a x:0 0 0 2024-09-13T21:44:34.815 INFO:tasks.workunit.client.0.smithi119.stdout:9/86: truncate d0/d8/d15/f17 404142 0 2024-09-13T21:44:34.816 INFO:tasks.workunit.client.0.smithi119.stdout:5/70: symlink d0/l19 0 2024-09-13T21:44:34.817 INFO:tasks.workunit.client.0.smithi119.stdout:9/87: rename d0/c1 to d0/d19/c1d 0 2024-09-13T21:44:34.819 INFO:tasks.workunit.client.0.smithi119.stdout:4/62: read d4/d5/f6 [10575,72248] 0 2024-09-13T21:44:34.821 INFO:tasks.workunit.client.0.smithi119.stdout:2/54: getdents d1/d7 0 2024-09-13T21:44:34.822 INFO:tasks.workunit.client.0.smithi119.stdout:4/63: rename d4/d5/f6 to d4/d5/fe 0 2024-09-13T21:44:34.831 INFO:tasks.workunit.client.0.smithi119.stdout:2/55: dread d1/f6 [4194304,4194304] 0 2024-09-13T21:44:34.832 INFO:tasks.workunit.client.0.smithi119.stdout:6/47: fdatasync dc/dd/fe 0 2024-09-13T21:44:34.834 INFO:tasks.workunit.client.0.smithi119.stdout:2/56: creat d1/d7/fd x:0 0 0 2024-09-13T21:44:34.837 INFO:tasks.workunit.client.0.smithi119.stdout:2/57: mknod d1/ce 0 2024-09-13T21:44:34.840 INFO:tasks.workunit.client.0.smithi119.stdout:2/58: creat d1/d7/ff x:0 0 0 2024-09-13T21:44:34.841 INFO:tasks.workunit.client.0.smithi119.stdout:6/48: getdents dc/dd 0 2024-09-13T21:44:34.843 INFO:tasks.workunit.client.0.smithi119.stdout:2/59: mknod d1/d7/c10 0 2024-09-13T21:44:34.844 INFO:tasks.workunit.client.0.smithi119.stdout:6/49: rmdir dc 39 2024-09-13T21:44:34.845 INFO:tasks.workunit.client.0.smithi119.stdout:4/64: truncate f2 2124518 0 2024-09-13T21:44:34.846 INFO:tasks.workunit.client.0.smithi119.stdout:6/50: write f9 [2779700,129403] 0 2024-09-13T21:44:34.846 INFO:tasks.workunit.client.0.smithi119.stdout:5/71: creat d0/d3/f1a x:0 0 0 2024-09-13T21:44:34.849 INFO:tasks.workunit.client.0.smithi119.stdout:4/65: creat d4/d5/ff x:0 0 0 2024-09-13T21:44:34.851 INFO:tasks.workunit.client.0.smithi119.stdout:5/72: write d0/d3/f12 [316114,89341] 0 2024-09-13T21:44:34.852 INFO:tasks.workunit.client.0.smithi119.stdout:9/88: dwrite d0/d8/d15/f1b [4194304,4194304] 0 2024-09-13T21:44:34.855 INFO:tasks.workunit.client.0.smithi119.stdout:4/66: write d4/d5/ff [400372,57246] 0 2024-09-13T21:44:34.858 INFO:tasks.workunit.client.0.smithi119.stdout:5/73: dread - d0/d3/d4/d9/f10 zero size 2024-09-13T21:44:34.858 INFO:tasks.workunit.client.0.smithi119.stdout:2/60: dwrite d1/f6 [4194304,4194304] 0 2024-09-13T21:44:34.863 INFO:tasks.workunit.client.0.smithi119.stdout:2/61: dread - d1/d7/f9 zero size 2024-09-13T21:44:34.866 INFO:tasks.workunit.client.0.smithi119.stdout:6/51: dwrite fa [0,4194304] 0 2024-09-13T21:44:34.869 INFO:tasks.workunit.client.0.smithi119.stdout:4/67: dread d4/d5/ff [0,4194304] 0 2024-09-13T21:44:34.869 INFO:tasks.workunit.client.0.smithi119.stdout:2/62: creat d1/d7/f11 x:0 0 0 2024-09-13T21:44:34.875 INFO:tasks.workunit.client.0.smithi119.stdout:5/74: dwrite d0/d3/f12 [0,4194304] 0 2024-09-13T21:44:34.875 INFO:tasks.workunit.client.0.smithi119.stdout:6/52: fsync dc/dd/fe 0 2024-09-13T21:44:34.876 INFO:tasks.workunit.client.0.smithi119.stdout:5/75: chown d0/l19 2779561 1 2024-09-13T21:44:34.877 INFO:tasks.workunit.client.0.smithi119.stdout:6/53: mkdir dc/df 0 2024-09-13T21:44:34.877 INFO:tasks.workunit.client.0.smithi119.stdout:2/63: dread d1/f6 [0,4194304] 0 2024-09-13T21:44:34.878 INFO:tasks.workunit.client.0.smithi119.stdout:5/76: truncate d0/d3/f1a 74402 0 2024-09-13T21:44:34.879 INFO:tasks.workunit.client.0.smithi119.stdout:6/54: write fb [1020529,116600] 0 2024-09-13T21:44:34.880 INFO:tasks.workunit.client.0.smithi119.stdout:6/55: chown dc/dd/fe 121 1 2024-09-13T21:44:34.881 INFO:tasks.workunit.client.0.smithi119.stdout:5/77: symlink d0/d3/l1b 0 2024-09-13T21:44:34.883 INFO:tasks.workunit.client.0.smithi119.stdout:5/78: fdatasync d0/d3/d4/fa 0 2024-09-13T21:44:34.884 INFO:tasks.workunit.client.0.smithi119.stdout:5/79: stat d0/d3/l1b 0 2024-09-13T21:44:34.884 INFO:tasks.workunit.client.0.smithi119.stdout:6/56: rename c1 to dc/dd/c10 0 2024-09-13T21:44:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:2/64: dread d1/f6 [4194304,4194304] 0 2024-09-13T21:44:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:6/57: chown l3 2 1 2024-09-13T21:44:34.888 INFO:tasks.workunit.client.0.smithi119.stdout:6/58: mknod dc/df/c11 0 2024-09-13T21:44:34.889 INFO:tasks.workunit.client.0.smithi119.stdout:6/59: chown dc/df 512207720 1 2024-09-13T21:44:34.890 INFO:tasks.workunit.client.0.smithi119.stdout:2/65: link d1/c4 d1/d7/c12 0 2024-09-13T21:44:34.892 INFO:tasks.workunit.client.0.smithi119.stdout:6/60: creat dc/df/f12 x:0 0 0 2024-09-13T21:44:34.893 INFO:tasks.workunit.client.0.smithi119.stdout:5/80: dwrite d0/d3/f15 [0,4194304] 0 2024-09-13T21:44:34.897 INFO:tasks.workunit.client.0.smithi119.stdout:6/61: write fa [1345471,83542] 0 2024-09-13T21:44:34.898 INFO:tasks.workunit.client.0.smithi119.stdout:4/68: fsync f2 0 2024-09-13T21:44:34.904 INFO:tasks.workunit.client.0.smithi119.stdout:9/89: dread d0/f6 [0,4194304] 0 2024-09-13T21:44:34.905 INFO:tasks.workunit.client.0.smithi119.stdout:6/62: rmdir dc 39 2024-09-13T21:44:34.906 INFO:tasks.workunit.client.0.smithi119.stdout:2/66: dwrite d1/d7/ff [0,4194304] 0 2024-09-13T21:44:34.909 INFO:tasks.workunit.client.0.smithi119.stdout:5/81: rename d0/c1 to d0/d3/d4/d9/c1c 0 2024-09-13T21:44:34.912 INFO:tasks.workunit.client.0.smithi119.stdout:4/69: mkdir d4/d5/d10 0 2024-09-13T21:44:34.913 INFO:tasks.workunit.client.0.smithi119.stdout:9/90: symlink d0/d8/d18/l1e 0 2024-09-13T21:44:34.913 INFO:tasks.workunit.client.0.smithi119.stdout:2/67: rmdir d1 39 2024-09-13T21:44:34.915 INFO:tasks.workunit.client.0.smithi119.stdout:4/70: rename d4/d5/lb to d4/d5/l11 0 2024-09-13T21:44:34.916 INFO:tasks.workunit.client.0.smithi119.stdout:2/68: chown d1 4183 1 2024-09-13T21:44:34.918 INFO:tasks.workunit.client.0.smithi119.stdout:9/91: creat d0/d19/d1a/f1f x:0 0 0 2024-09-13T21:44:34.920 INFO:tasks.workunit.client.0.smithi119.stdout:2/69: mknod d1/d7/c13 0 2024-09-13T21:44:34.920 INFO:tasks.workunit.client.0.smithi119.stdout:4/71: dread f2 [0,4194304] 0 2024-09-13T21:44:34.921 INFO:tasks.workunit.client.0.smithi119.stdout:2/70: chown d1/l3 5872 1 2024-09-13T21:44:34.922 INFO:tasks.workunit.client.0.smithi119.stdout:6/63: getdents dc 0 2024-09-13T21:44:34.928 INFO:tasks.workunit.client.0.smithi119.stdout:2/71: unlink d1/d7/la 0 2024-09-13T21:44:34.929 INFO:tasks.workunit.client.0.smithi119.stdout:2/72: readlink d1/d7/lb 0 2024-09-13T21:44:34.930 INFO:tasks.workunit.client.0.smithi119.stdout:6/64: rename l4 to dc/l13 0 2024-09-13T21:44:34.931 INFO:tasks.workunit.client.0.smithi119.stdout:6/65: stat dc 0 2024-09-13T21:44:34.931 INFO:tasks.workunit.client.0.smithi119.stdout:2/73: readlink d1/l3 0 2024-09-13T21:44:34.932 INFO:tasks.workunit.client.0.smithi119.stdout:9/92: dwrite d0/d19/d1a/f1f [0,4194304] 0 2024-09-13T21:44:34.934 INFO:tasks.workunit.client.0.smithi119.stdout:2/74: read d1/d7/ff [319600,42166] 0 2024-09-13T21:44:34.934 INFO:tasks.workunit.client.0.smithi119.stdout:9/93: chown d0/d19 140166 1 2024-09-13T21:44:34.937 INFO:tasks.workunit.client.0.smithi119.stdout:9/94: unlink d0/f6 0 2024-09-13T21:44:34.939 INFO:tasks.workunit.client.0.smithi119.stdout:2/75: symlink d1/d7/l14 0 2024-09-13T21:44:34.939 INFO:tasks.workunit.client.0.smithi119.stdout:4/72: dwrite d4/d5/fe [0,4194304] 0 2024-09-13T21:44:34.941 INFO:tasks.workunit.client.0.smithi119.stdout:9/95: fsync d0/d8/d15/f16 0 2024-09-13T21:44:34.941 INFO:tasks.workunit.client.0.smithi119.stdout:2/76: chown d1/f6 0 1 2024-09-13T21:44:34.942 INFO:tasks.workunit.client.0.smithi119.stdout:6/66: getdents dc/df 0 2024-09-13T21:44:34.943 INFO:tasks.workunit.client.0.smithi119.stdout:9/96: read d0/d8/d15/f16 [1779547,66560] 0 2024-09-13T21:44:34.943 INFO:tasks.workunit.client.0.smithi119.stdout:2/77: fsync d1/d7/fd 0 2024-09-13T21:44:34.945 INFO:tasks.workunit.client.0.smithi119.stdout:9/97: truncate d0/f14 1877555 0 2024-09-13T21:44:34.945 INFO:tasks.workunit.client.0.smithi119.stdout:2/78: truncate d1/d7/f9 724081 0 2024-09-13T21:44:34.947 INFO:tasks.workunit.client.0.smithi119.stdout:6/67: chown dc/dd/c10 110 1 2024-09-13T21:44:34.950 INFO:tasks.workunit.client.0.smithi119.stdout:6/68: creat dc/f14 x:0 0 0 2024-09-13T21:44:34.952 INFO:tasks.workunit.client.0.smithi119.stdout:2/79: rename d1/d7/c12 to d1/c15 0 2024-09-13T21:44:34.953 INFO:tasks.workunit.client.0.smithi119.stdout:4/73: write f2 [3032820,2251] 0 2024-09-13T21:44:34.954 INFO:tasks.workunit.client.0.smithi119.stdout:4/74: rename d4 to d4/d5/d10/d12 22 2024-09-13T21:44:34.954 INFO:tasks.workunit.client.0.smithi119.stdout:6/69: dread fb [0,4194304] 0 2024-09-13T21:44:34.955 INFO:tasks.workunit.client.0.smithi119.stdout:4/75: truncate d4/d5/fe 4994039 0 2024-09-13T21:44:34.956 INFO:tasks.workunit.client.0.smithi119.stdout:2/80: fdatasync d1/d7/ff 0 2024-09-13T21:44:34.957 INFO:tasks.workunit.client.0.smithi119.stdout:9/98: getdents d0/d19 0 2024-09-13T21:44:34.958 INFO:tasks.workunit.client.0.smithi119.stdout:2/81: write d1/d7/fd [173110,15894] 0 2024-09-13T21:44:34.959 INFO:tasks.workunit.client.0.smithi119.stdout:4/76: mknod d4/c13 0 2024-09-13T21:44:34.960 INFO:tasks.workunit.client.0.smithi119.stdout:6/70: dread f9 [0,4194304] 0 2024-09-13T21:44:34.960 INFO:tasks.workunit.client.0.smithi119.stdout:2/82: write d1/f6 [3227873,55947] 0 2024-09-13T21:44:34.964 INFO:tasks.workunit.client.0.smithi119.stdout:6/71: write fb [362253,108955] 0 2024-09-13T21:44:34.966 INFO:tasks.workunit.client.0.smithi119.stdout:4/77: symlink d4/l14 0 2024-09-13T21:44:34.966 INFO:tasks.workunit.client.0.smithi119.stdout:4/78: stat d4/l14 0 2024-09-13T21:44:34.967 INFO:tasks.workunit.client.0.smithi119.stdout:6/72: rmdir dc 39 2024-09-13T21:44:34.968 INFO:tasks.workunit.client.0.smithi119.stdout:2/83: stat d1/d7/cc 0 2024-09-13T21:44:34.972 INFO:tasks.workunit.client.0.smithi119.stdout:2/84: unlink d1/f8 0 2024-09-13T21:44:34.972 INFO:tasks.workunit.client.0.smithi119.stdout:6/73: truncate dc/df/f12 76954 0 2024-09-13T21:44:34.974 INFO:tasks.workunit.client.0.smithi119.stdout:4/79: rename d4/cd to d4/d5/d10/c15 0 2024-09-13T21:44:34.975 INFO:tasks.workunit.client.0.smithi119.stdout:6/74: symlink dc/df/l15 0 2024-09-13T21:44:34.976 INFO:tasks.workunit.client.0.smithi119.stdout:4/80: rename d4/l14 to d4/d5/l16 0 2024-09-13T21:44:34.979 INFO:tasks.workunit.client.0.smithi119.stdout:9/99: truncate d0/d8/d15/f16 689425 0 2024-09-13T21:44:34.981 INFO:tasks.workunit.client.0.smithi119.stdout:6/75: rename fb to dc/f16 0 2024-09-13T21:44:34.984 INFO:tasks.workunit.client.0.smithi119.stdout:9/100: symlink d0/d19/l20 0 2024-09-13T21:44:34.985 INFO:tasks.workunit.client.0.smithi119.stdout:4/81: dwrite d4/d5/fe [4194304,4194304] 0 2024-09-13T21:44:34.987 INFO:tasks.workunit.client.0.smithi119.stdout:2/85: dread d1/f6 [4194304,4194304] 0 2024-09-13T21:44:34.988 INFO:tasks.workunit.client.0.smithi119.stdout:9/101: creat d0/d8/d18/f21 x:0 0 0 2024-09-13T21:44:34.989 INFO:tasks.workunit.client.0.smithi119.stdout:6/76: truncate dc/dd/fe 677375 0 2024-09-13T21:44:34.996 INFO:tasks.workunit.client.0.smithi119.stdout:4/82: getdents d4/d5 0 2024-09-13T21:44:34.996 INFO:tasks.workunit.client.0.smithi119.stdout:6/77: link dc/df/l15 dc/l17 0 2024-09-13T21:44:34.997 INFO:tasks.workunit.client.0.smithi119.stdout:2/86: write d1/d7/ff [4911461,47939] 0 2024-09-13T21:44:34.999 INFO:tasks.workunit.client.0.smithi119.stdout:4/83: creat d4/d5/f17 x:0 0 0 2024-09-13T21:44:35.001 INFO:tasks.workunit.client.0.smithi119.stdout:4/84: chown f2 104717195 1 2024-09-13T21:44:35.001 INFO:tasks.workunit.client.0.smithi119.stdout:9/102: link d0/d8/d15/f1b d0/d8/d15/f22 0 2024-09-13T21:44:35.005 INFO:tasks.workunit.client.0.smithi119.stdout:9/103: mkdir d0/d8/d18/d23 0 2024-09-13T21:44:35.005 INFO:tasks.workunit.client.0.smithi119.stdout:4/85: write d4/d5/ff [1360885,22264] 0 2024-09-13T21:44:35.007 INFO:tasks.workunit.client.0.smithi119.stdout:6/78: getdents dc 0 2024-09-13T21:44:35.007 INFO:tasks.workunit.client.0.smithi119.stdout:2/87: dwrite d1/d7/f11 [0,4194304] 0 2024-09-13T21:44:35.009 INFO:tasks.workunit.client.0.smithi119.stdout:9/104: mknod d0/c24 0 2024-09-13T21:44:35.011 INFO:tasks.workunit.client.0.smithi119.stdout:2/88: symlink d1/l16 0 2024-09-13T21:44:35.012 INFO:tasks.workunit.client.0.smithi119.stdout:6/79: rename dc/l13 to dc/l18 0 2024-09-13T21:44:35.013 INFO:tasks.workunit.client.0.smithi119.stdout:2/89: chown d1/d7/cc 874844 1 2024-09-13T21:44:35.013 INFO:tasks.workunit.client.0.smithi119.stdout:4/86: dread f2 [0,4194304] 0 2024-09-13T21:44:35.014 INFO:tasks.workunit.client.0.smithi119.stdout:6/80: fsync dc/df/f12 0 2024-09-13T21:44:35.014 INFO:tasks.workunit.client.0.smithi119.stdout:9/105: mknod d0/c25 0 2024-09-13T21:44:35.014 INFO:tasks.workunit.client.0.smithi119.stdout:3/50: sync 2024-09-13T21:44:35.015 INFO:tasks.workunit.client.0.smithi119.stdout:2/90: write d1/d7/f9 [1282945,15675] 0 2024-09-13T21:44:35.015 INFO:tasks.workunit.client.0.smithi119.stdout:3/51: chown d6/f12 1 1 2024-09-13T21:44:35.017 INFO:tasks.workunit.client.0.smithi119.stdout:2/91: symlink d1/l17 0 2024-09-13T21:44:35.018 INFO:tasks.workunit.client.0.smithi119.stdout:3/52: creat d6/f16 x:0 0 0 2024-09-13T21:44:35.019 INFO:tasks.workunit.client.0.smithi119.stdout:4/87: creat d4/f18 x:0 0 0 2024-09-13T21:44:35.019 INFO:tasks.workunit.client.0.smithi119.stdout:4/88: chown d4 9341 1 2024-09-13T21:44:35.021 INFO:tasks.workunit.client.0.smithi119.stdout:6/81: rename dc/l17 to dc/df/l19 0 2024-09-13T21:44:35.024 INFO:tasks.workunit.client.0.smithi119.stdout:4/89: unlink d4/d5/l16 0 2024-09-13T21:44:35.025 INFO:tasks.workunit.client.0.smithi119.stdout:4/90: stat d4/c13 0 2024-09-13T21:44:35.026 INFO:tasks.workunit.client.0.smithi119.stdout:6/82: creat dc/f1a x:0 0 0 2024-09-13T21:44:35.028 INFO:tasks.workunit.client.0.smithi119.stdout:3/53: dwrite d6/f16 [0,4194304] 0 2024-09-13T21:44:35.028 INFO:tasks.workunit.client.0.smithi119.stdout:6/83: creat dc/f1b x:0 0 0 2024-09-13T21:44:35.029 INFO:tasks.workunit.client.0.smithi119.stdout:3/54: fdatasync d6/f10 0 2024-09-13T21:44:35.030 INFO:tasks.workunit.client.0.smithi119.stdout:6/84: write dc/f1b [745603,26999] 0 2024-09-13T21:44:35.030 INFO:tasks.workunit.client.0.smithi119.stdout:3/55: dread - d6/f14 zero size 2024-09-13T21:44:35.032 INFO:tasks.workunit.client.0.smithi119.stdout:3/56: truncate d6/fc 163496 0 2024-09-13T21:44:35.114 INFO:tasks.workunit.client.0.smithi119.stdout:8/59: sync 2024-09-13T21:44:35.126 INFO:tasks.workunit.client.0.smithi119.stdout:8/60: fdatasync fc 0 2024-09-13T21:44:35.138 INFO:tasks.workunit.client.0.smithi119.stdout:4/91: getdents d4 0 2024-09-13T21:44:35.138 INFO:tasks.workunit.client.0.smithi119.stdout:4/92: stat f2 0 2024-09-13T21:44:35.138 INFO:tasks.workunit.client.0.smithi119.stdout:4/93: rename d4/d5 to d4/d5/d19 22 2024-09-13T21:44:35.139 INFO:tasks.workunit.client.0.smithi119.stdout:9/106: truncate d0/f14 722343 0 2024-09-13T21:44:35.140 INFO:tasks.workunit.client.0.smithi119.stdout:2/92: write d1/f6 [6834938,4494] 0 2024-09-13T21:44:35.142 INFO:tasks.workunit.client.0.smithi119.stdout:2/93: dread d1/d7/fd [0,4194304] 0 2024-09-13T21:44:35.207 INFO:tasks.workunit.client.0.smithi119.stdout:1/147: sync 2024-09-13T21:44:35.254 INFO:tasks.workunit.client.0.smithi119.stdout:0/89: sync 2024-09-13T21:44:35.254 INFO:tasks.workunit.client.0.smithi119.stdout:5/82: sync 2024-09-13T21:44:35.254 INFO:tasks.workunit.client.0.smithi119.stdout:7/86: sync 2024-09-13T21:44:35.255 INFO:tasks.workunit.client.0.smithi119.stdout:7/87: read d8/d9/f12 [2281283,44007] 0 2024-09-13T21:44:35.294 INFO:tasks.workunit.client.0.smithi119.stdout:8/61: mknod ce 0 2024-09-13T21:44:35.295 INFO:tasks.workunit.client.0.smithi119.stdout:4/94: rename d4/d5/fe to d4/d5/d10/f1a 0 2024-09-13T21:44:35.296 INFO:tasks.workunit.client.0.smithi119.stdout:9/107: unlink d0/d8/d18/f1c 0 2024-09-13T21:44:35.297 INFO:tasks.workunit.client.0.smithi119.stdout:9/108: read d0/f7 [5392533,116332] 0 2024-09-13T21:44:35.297 INFO:tasks.workunit.client.0.smithi119.stdout:2/94: mkdir d1/d7/d18 0 2024-09-13T21:44:35.298 INFO:tasks.workunit.client.0.smithi119.stdout:2/95: fdatasync d1/d7/f9 0 2024-09-13T21:44:35.299 INFO:tasks.workunit.client.0.smithi119.stdout:0/90: creat de/f22 x:0 0 0 2024-09-13T21:44:35.299 INFO:tasks.workunit.client.0.smithi119.stdout:2/96: read d1/d7/f11 [1248129,25261] 0 2024-09-13T21:44:35.300 INFO:tasks.workunit.client.0.smithi119.stdout:2/97: chown d1/d7/f9 3081 1 2024-09-13T21:44:35.301 INFO:tasks.workunit.client.0.smithi119.stdout:8/62: creat ff x:0 0 0 2024-09-13T21:44:35.302 INFO:tasks.workunit.client.0.smithi119.stdout:3/57: link c3 d6/c17 0 2024-09-13T21:44:35.305 INFO:tasks.workunit.client.0.smithi119.stdout:8/63: dread f5 [0,4194304] 0 2024-09-13T21:44:35.308 INFO:tasks.workunit.client.0.smithi119.stdout:0/91: symlink de/d1c/l23 0 2024-09-13T21:44:35.308 INFO:tasks.workunit.client.0.smithi119.stdout:6/85: getdents dc/dd 0 2024-09-13T21:44:35.309 INFO:tasks.workunit.client.0.smithi119.stdout:6/86: fdatasync fa 0 2024-09-13T21:44:35.310 INFO:tasks.workunit.client.0.smithi119.stdout:4/95: unlink l3 0 2024-09-13T21:44:35.312 INFO:tasks.workunit.client.0.smithi119.stdout:1/148: creat d1/d3/f2b x:0 0 0 2024-09-13T21:44:35.312 INFO:tasks.workunit.client.0.smithi119.stdout:8/64: creat f10 x:0 0 0 2024-09-13T21:44:35.313 INFO:tasks.workunit.client.0.smithi119.stdout:5/83: dwrite d0/d3/d4/d9/d14/f17 [0,4194304] 0 2024-09-13T21:44:35.314 INFO:tasks.workunit.client.0.smithi119.stdout:0/92: mknod de/d1c/c24 0 2024-09-13T21:44:35.315 INFO:tasks.workunit.client.0.smithi119.stdout:6/87: write dc/f16 [1657297,112577] 0 2024-09-13T21:44:35.316 INFO:tasks.workunit.client.0.smithi119.stdout:3/58: link d6/f14 d6/f18 0 2024-09-13T21:44:35.317 INFO:tasks.workunit.client.0.smithi119.stdout:6/88: chown l2 7894 1 2024-09-13T21:44:35.318 INFO:tasks.workunit.client.0.smithi119.stdout:8/65: mknod c11 0 2024-09-13T21:44:35.318 INFO:tasks.workunit.client.0.smithi119.stdout:4/96: dread d4/d5/d10/f1a [0,4194304] 0 2024-09-13T21:44:35.319 INFO:tasks.workunit.client.0.smithi119.stdout:4/97: truncate d4/d5/f17 83950 0 2024-09-13T21:44:35.320 INFO:tasks.workunit.client.0.smithi119.stdout:9/109: getdents d0 0 2024-09-13T21:44:35.321 INFO:tasks.workunit.client.0.smithi119.stdout:6/89: write f9 [4399124,114761] 0 2024-09-13T21:44:35.322 INFO:tasks.workunit.client.0.smithi119.stdout:1/149: symlink d1/d3/dc/d11/d28/l2c 0 2024-09-13T21:44:35.323 INFO:tasks.workunit.client.0.smithi119.stdout:5/84: mknod d0/d3/d4/c1d 0 2024-09-13T21:44:35.324 INFO:tasks.workunit.client.0.smithi119.stdout:4/98: fdatasync d4/d5/d10/f1a 0 2024-09-13T21:44:35.325 INFO:tasks.workunit.client.0.smithi119.stdout:5/85: fsync d0/d3/f1a 0 2024-09-13T21:44:35.326 INFO:tasks.workunit.client.0.smithi119.stdout:6/90: creat dc/df/f1c x:0 0 0 2024-09-13T21:44:35.328 INFO:tasks.workunit.client.0.smithi119.stdout:5/86: chown d0/d3/d4/d9 1184196 1 2024-09-13T21:44:35.329 INFO:tasks.workunit.client.0.smithi119.stdout:8/66: link ca c12 0 2024-09-13T21:44:35.330 INFO:tasks.workunit.client.0.smithi119.stdout:4/99: write d4/f8 [3583737,64770] 0 2024-09-13T21:44:35.332 INFO:tasks.workunit.client.0.smithi119.stdout:3/59: dwrite d6/f18 [0,4194304] 0 2024-09-13T21:44:35.335 INFO:tasks.workunit.client.0.smithi119.stdout:5/87: write d0/fd [5167678,75845] 0 2024-09-13T21:44:35.337 INFO:tasks.workunit.client.0.smithi119.stdout:4/100: mknod d4/c1b 0 2024-09-13T21:44:35.339 INFO:tasks.workunit.client.0.smithi119.stdout:4/101: chown f2 88618133 1 2024-09-13T21:44:35.339 INFO:tasks.workunit.client.0.smithi119.stdout:5/88: write d0/d3/f11 [253323,93584] 0 2024-09-13T21:44:35.342 INFO:tasks.workunit.client.0.smithi119.stdout:6/91: dwrite f9 [0,4194304] 0 2024-09-13T21:44:35.344 INFO:tasks.workunit.client.0.smithi119.stdout:5/89: dread - d0/d3/d4/d9/f10 zero size 2024-09-13T21:44:35.346 INFO:tasks.workunit.client.0.smithi119.stdout:6/92: read fa [3543379,66608] 0 2024-09-13T21:44:35.346 INFO:tasks.workunit.client.0.smithi119.stdout:8/67: dwrite f5 [4194304,4194304] 0 2024-09-13T21:44:35.347 INFO:tasks.workunit.client.0.smithi119.stdout:8/68: stat ce 0 2024-09-13T21:44:35.349 INFO:tasks.workunit.client.0.smithi119.stdout:6/93: chown dc/dd/fe 3 1 2024-09-13T21:44:35.350 INFO:tasks.workunit.client.0.smithi119.stdout:8/69: chown c6 13578 1 2024-09-13T21:44:35.352 INFO:tasks.workunit.client.0.smithi119.stdout:5/90: mkdir d0/d3/d4/d9/d1e 0 2024-09-13T21:44:35.355 INFO:tasks.workunit.client.0.smithi119.stdout:5/91: truncate d0/fd 8436990 0 2024-09-13T21:44:35.356 INFO:tasks.workunit.client.0.smithi119.stdout:8/70: creat f13 x:0 0 0 2024-09-13T21:44:35.358 INFO:tasks.workunit.client.0.smithi119.stdout:6/94: creat dc/df/f1d x:0 0 0 2024-09-13T21:44:35.358 INFO:tasks.workunit.client.0.smithi119.stdout:4/102: dwrite d4/d5/f17 [0,4194304] 0 2024-09-13T21:44:35.359 INFO:tasks.workunit.client.0.smithi119.stdout:6/95: fdatasync dc/f1a 0 2024-09-13T21:44:35.360 INFO:tasks.workunit.client.0.smithi119.stdout:4/103: chown d4/d5/l11 509627444 1 2024-09-13T21:44:35.364 INFO:tasks.workunit.client.0.smithi119.stdout:4/104: mknod d4/d5/d10/c1c 0 2024-09-13T21:44:35.365 INFO:tasks.workunit.client.0.smithi119.stdout:5/92: dread d0/fd [4194304,4194304] 0 2024-09-13T21:44:35.371 INFO:tasks.workunit.client.0.smithi119.stdout:5/93: mkdir d0/d3/d1f 0 2024-09-13T21:44:35.375 INFO:tasks.workunit.client.0.smithi119.stdout:6/96: dwrite dc/df/f1c [0,4194304] 0 2024-09-13T21:44:35.376 INFO:tasks.workunit.client.0.smithi119.stdout:6/97: readlink l3 0 2024-09-13T21:44:35.376 INFO:tasks.workunit.client.0.smithi119.stdout:5/94: mknod d0/d3/c20 0 2024-09-13T21:44:35.382 INFO:tasks.workunit.client.0.smithi119.stdout:6/98: fsync dc/dd/fe 0 2024-09-13T21:44:35.384 INFO:tasks.workunit.client.0.smithi119.stdout:4/105: dwrite d4/d5/d10/f1a [0,4194304] 0 2024-09-13T21:44:35.384 INFO:tasks.workunit.client.0.smithi119.stdout:5/95: write d0/d3/f12 [3798384,32079] 0 2024-09-13T21:44:35.385 INFO:tasks.workunit.client.0.smithi119.stdout:4/106: rename d4 to d4/d5/d1d 22 2024-09-13T21:44:35.385 INFO:tasks.workunit.client.0.smithi119.stdout:6/99: creat dc/f1e x:0 0 0 2024-09-13T21:44:35.388 INFO:tasks.workunit.client.0.smithi119.stdout:5/96: mkdir d0/d3/d1f/d21 0 2024-09-13T21:44:35.392 INFO:tasks.workunit.client.0.smithi119.stdout:5/97: mknod d0/d3/c22 0 2024-09-13T21:44:35.396 INFO:tasks.workunit.client.0.smithi119.stdout:5/98: symlink d0/d3/d1f/d21/l23 0 2024-09-13T21:44:35.457 INFO:tasks.workunit.client.0.smithi119.stdout:2/98: rmdir d1/d7 39 2024-09-13T21:44:35.461 INFO:tasks.workunit.client.0.smithi119.stdout:2/99: rmdir d1/d7/d18 0 2024-09-13T21:44:35.467 INFO:tasks.workunit.client.0.smithi119.stdout:2/100: link d1/d7/c13 d1/c19 0 2024-09-13T21:44:35.469 INFO:tasks.workunit.client.0.smithi119.stdout:0/93: write de/f16 [3638159,22651] 0 2024-09-13T21:44:35.471 INFO:tasks.workunit.client.0.smithi119.stdout:2/101: dread d1/d7/ff [0,4194304] 0 2024-09-13T21:44:35.474 INFO:tasks.workunit.client.0.smithi119.stdout:2/102: mkdir d1/d7/d1a 0 2024-09-13T21:44:35.476 INFO:tasks.workunit.client.0.smithi119.stdout:0/94: rename de/l21 to de/d1c/l25 0 2024-09-13T21:44:35.476 INFO:tasks.workunit.client.0.smithi119.stdout:9/110: dwrite d0/f7 [0,4194304] 0 2024-09-13T21:44:35.477 INFO:tasks.workunit.client.0.smithi119.stdout:0/95: chown de/f13 3984623 1 2024-09-13T21:44:35.478 INFO:tasks.workunit.client.0.smithi119.stdout:1/150: truncate d1/f22 326957 0 2024-09-13T21:44:35.480 INFO:tasks.workunit.client.0.smithi119.stdout:2/103: truncate d1/d7/f9 496864 0 2024-09-13T21:44:35.483 INFO:tasks.workunit.client.0.smithi119.stdout:0/96: creat de/f26 x:0 0 0 2024-09-13T21:44:35.483 INFO:tasks.workunit.client.0.smithi119.stdout:9/111: dread d0/f7 [4194304,4194304] 0 2024-09-13T21:44:35.484 INFO:tasks.workunit.client.0.smithi119.stdout:3/60: fsync d6/f11 0 2024-09-13T21:44:35.485 INFO:tasks.workunit.client.0.smithi119.stdout:1/151: mkdir d1/d3/dc/d11/d19/d2d 0 2024-09-13T21:44:35.486 INFO:tasks.workunit.client.0.smithi119.stdout:2/104: dread d1/f6 [0,4194304] 0 2024-09-13T21:44:35.487 INFO:tasks.workunit.client.0.smithi119.stdout:2/105: chown d1/d7/f9 350 1 2024-09-13T21:44:35.488 INFO:tasks.workunit.client.0.smithi119.stdout:0/97: fdatasync de/f12 0 2024-09-13T21:44:35.489 INFO:tasks.workunit.client.0.smithi119.stdout:0/98: chown de/f1a 2 1 2024-09-13T21:44:35.490 INFO:tasks.workunit.client.0.smithi119.stdout:9/112: dread d0/d8/d15/f1b [0,4194304] 0 2024-09-13T21:44:35.491 INFO:tasks.workunit.client.0.smithi119.stdout:0/99: fdatasync de/d1c/f1d 0 2024-09-13T21:44:35.492 INFO:tasks.workunit.client.0.smithi119.stdout:8/71: truncate f5 1510310 0 2024-09-13T21:44:35.492 INFO:tasks.workunit.client.0.smithi119.stdout:1/152: dread d1/d3/f7 [0,4194304] 0 2024-09-13T21:44:35.493 INFO:tasks.workunit.client.0.smithi119.stdout:4/107: rename d4/d5 to d4/d1e 0 2024-09-13T21:44:35.496 INFO:tasks.workunit.client.0.smithi119.stdout:9/113: creat d0/d19/f26 x:0 0 0 2024-09-13T21:44:35.497 INFO:tasks.workunit.client.0.smithi119.stdout:0/100: creat de/d1c/f27 x:0 0 0 2024-09-13T21:44:35.498 INFO:tasks.workunit.client.0.smithi119.stdout:8/72: rename c11 to c14 0 2024-09-13T21:44:35.498 INFO:tasks.workunit.client.0.smithi119.stdout:8/73: chown fd 6891 1 2024-09-13T21:44:35.499 INFO:tasks.workunit.client.0.smithi119.stdout:1/153: unlink d1/d3/l14 0 2024-09-13T21:44:35.499 INFO:tasks.workunit.client.0.smithi119.stdout:8/74: write fd [1036280,101170] 0 2024-09-13T21:44:35.499 INFO:tasks.workunit.client.0.smithi119.stdout:4/108: rmdir d4 39 2024-09-13T21:44:35.500 INFO:tasks.workunit.client.0.smithi119.stdout:8/75: write fd [4425395,85262] 0 2024-09-13T21:44:35.501 INFO:tasks.workunit.client.0.smithi119.stdout:1/154: write d1/d3/f2a [993763,123402] 0 2024-09-13T21:44:35.501 INFO:tasks.workunit.client.0.smithi119.stdout:8/76: stat f9 0 2024-09-13T21:44:35.501 INFO:tasks.workunit.client.0.smithi119.stdout:8/77: fsync f10 0 2024-09-13T21:44:35.503 INFO:tasks.workunit.client.0.smithi119.stdout:8/78: dread - fb zero size 2024-09-13T21:44:35.503 INFO:tasks.workunit.client.0.smithi119.stdout:6/100: getdents dc 0 2024-09-13T21:44:35.504 INFO:tasks.workunit.client.0.smithi119.stdout:9/114: rename d0/d8/d15 to d0/d8/d18/d23/d27 0 2024-09-13T21:44:35.507 INFO:tasks.workunit.client.0.smithi119.stdout:5/99: truncate d0/d3/d4/d9/d14/f17 2982897 0 2024-09-13T21:44:35.510 INFO:tasks.workunit.client.0.smithi119.stdout:3/61: link d6/cd d6/d15/c19 0 2024-09-13T21:44:35.511 INFO:tasks.workunit.client.0.smithi119.stdout:3/62: readlink d6/le 0 2024-09-13T21:44:35.512 INFO:tasks.workunit.client.0.smithi119.stdout:8/79: creat f15 x:0 0 0 2024-09-13T21:44:35.512 INFO:tasks.workunit.client.0.smithi119.stdout:7/88: sync 2024-09-13T21:44:35.513 INFO:tasks.workunit.client.0.smithi119.stdout:8/80: truncate fb 175103 0 2024-09-13T21:44:35.513 INFO:tasks.workunit.client.0.smithi119.stdout:6/101: creat dc/dd/f1f x:0 0 0 2024-09-13T21:44:35.514 INFO:tasks.workunit.client.0.smithi119.stdout:6/102: readlink l3 0 2024-09-13T21:44:35.517 INFO:tasks.workunit.client.0.smithi119.stdout:5/100: mkdir d0/d3/d4/d9/d14/d24 0 2024-09-13T21:44:35.517 INFO:tasks.workunit.client.0.smithi119.stdout:9/115: dread d0/d8/f10 [0,4194304] 0 2024-09-13T21:44:35.519 INFO:tasks.workunit.client.0.smithi119.stdout:4/109: mkdir d4/d1e/d10/d1f 0 2024-09-13T21:44:35.521 INFO:tasks.workunit.client.0.smithi119.stdout:8/81: dwrite f13 [0,4194304] 0 2024-09-13T21:44:35.523 INFO:tasks.workunit.client.0.smithi119.stdout:4/110: truncate d4/d1e/ff 1826390 0 2024-09-13T21:44:35.524 INFO:tasks.workunit.client.0.smithi119.stdout:4/111: chown d4/d1e/f17 26080343 1 2024-09-13T21:44:35.525 INFO:tasks.workunit.client.0.smithi119.stdout:4/112: chown d4/d1e/f17 2103642503 1 2024-09-13T21:44:35.525 INFO:tasks.workunit.client.0.smithi119.stdout:5/101: dread d0/d3/f12 [0,4194304] 0 2024-09-13T21:44:35.526 INFO:tasks.workunit.client.0.smithi119.stdout:9/116: symlink d0/d8/d18/l28 0 2024-09-13T21:44:35.530 INFO:tasks.workunit.client.0.smithi119.stdout:3/63: mkdir d6/d15/d1a 0 2024-09-13T21:44:35.530 INFO:tasks.workunit.client.0.smithi119.stdout:3/64: readlink l1 0 2024-09-13T21:44:35.530 INFO:tasks.workunit.client.0.smithi119.stdout:3/65: fdatasync d6/f16 0 2024-09-13T21:44:35.533 INFO:tasks.workunit.client.0.smithi119.stdout:6/103: truncate fa 2461563 0 2024-09-13T21:44:35.539 INFO:tasks.workunit.client.0.smithi119.stdout:1/155: getdents d1/d3/dc 0 2024-09-13T21:44:35.542 INFO:tasks.workunit.client.0.smithi119.stdout:6/104: dwrite dc/f16 [0,4194304] 0 2024-09-13T21:44:35.542 INFO:tasks.workunit.client.0.smithi119.stdout:9/117: write d0/f7 [3856996,23689] 0 2024-09-13T21:44:35.545 INFO:tasks.workunit.client.0.smithi119.stdout:3/66: symlink d6/l1b 0 2024-09-13T21:44:35.546 INFO:tasks.workunit.client.0.smithi119.stdout:7/89: link d8/d9/lf d8/l1b 0 2024-09-13T21:44:35.547 INFO:tasks.workunit.client.0.smithi119.stdout:0/101: dwrite de/f12 [0,4194304] 0 2024-09-13T21:44:35.549 INFO:tasks.workunit.client.0.smithi119.stdout:9/118: chown d0/d8/d18/d23/d27/f1b 6227555 1 2024-09-13T21:44:35.551 INFO:tasks.workunit.client.0.smithi119.stdout:2/106: write d1/d7/f9 [1196185,38966] 0 2024-09-13T21:44:35.554 INFO:tasks.workunit.client.0.smithi119.stdout:5/102: mkdir d0/d3/d4/d9/d14/d24/d25 0 2024-09-13T21:44:35.558 INFO:tasks.workunit.client.0.smithi119.stdout:0/102: symlink de/l28 0 2024-09-13T21:44:35.559 INFO:tasks.workunit.client.0.smithi119.stdout:1/156: write d1/d3/dc/f1c [1356299,90194] 0 2024-09-13T21:44:35.562 INFO:tasks.workunit.client.0.smithi119.stdout:6/105: dwrite dc/df/f12 [0,4194304] 0 2024-09-13T21:44:35.563 INFO:tasks.workunit.client.0.smithi119.stdout:9/119: rename d0/fa to d0/d8/d18/d23/f29 0 2024-09-13T21:44:35.564 INFO:tasks.workunit.client.0.smithi119.stdout:8/82: link c14 c16 0 2024-09-13T21:44:35.564 INFO:tasks.workunit.client.0.smithi119.stdout:7/90: dread f3 [0,4194304] 0 2024-09-13T21:44:35.566 INFO:tasks.workunit.client.0.smithi119.stdout:6/106: chown dc/l18 112 1 2024-09-13T21:44:35.566 INFO:tasks.workunit.client.0.smithi119.stdout:4/113: getdents d4/d1e/d10 0 2024-09-13T21:44:35.567 INFO:tasks.workunit.client.0.smithi119.stdout:3/67: dwrite d6/f12 [0,4194304] 0 2024-09-13T21:44:35.567 INFO:tasks.workunit.client.0.smithi119.stdout:0/103: creat de/d1c/f29 x:0 0 0 2024-09-13T21:44:35.572 INFO:tasks.workunit.client.0.smithi119.stdout:3/68: read d6/f14 [310855,3480] 0 2024-09-13T21:44:35.572 INFO:tasks.workunit.client.0.smithi119.stdout:7/91: chown d8/d9/fa 395 1 2024-09-13T21:44:35.572 INFO:tasks.workunit.client.0.smithi119.stdout:6/107: creat dc/dd/f20 x:0 0 0 2024-09-13T21:44:35.575 INFO:tasks.workunit.client.0.smithi119.stdout:5/103: rename d0/d3/c20 to d0/d3/d4/c26 0 2024-09-13T21:44:35.575 INFO:tasks.workunit.client.0.smithi119.stdout:6/108: stat dc/df/f12 0 2024-09-13T21:44:35.577 INFO:tasks.workunit.client.0.smithi119.stdout:6/109: stat l3 0 2024-09-13T21:44:35.580 INFO:tasks.workunit.client.0.smithi119.stdout:9/120: rename d0/d8/d18/d23/d27/f1b to d0/d8/d18/d23/d27/f2a 0 2024-09-13T21:44:35.580 INFO:tasks.workunit.client.0.smithi119.stdout:5/104: mknod d0/d3/c27 0 2024-09-13T21:44:35.581 INFO:tasks.workunit.client.0.smithi119.stdout:6/110: mknod dc/df/c21 0 2024-09-13T21:44:35.584 INFO:tasks.workunit.client.0.smithi119.stdout:8/83: dwrite f13 [0,4194304] 0 2024-09-13T21:44:35.587 INFO:tasks.workunit.client.0.smithi119.stdout:5/105: mknod d0/d3/d1f/d21/c28 0 2024-09-13T21:44:35.590 INFO:tasks.workunit.client.0.smithi119.stdout:0/104: dwrite de/f22 [0,4194304] 0 2024-09-13T21:44:35.590 INFO:tasks.workunit.client.0.smithi119.stdout:7/92: dwrite d8/f17 [0,4194304] 0 2024-09-13T21:44:35.591 INFO:tasks.workunit.client.0.smithi119.stdout:3/69: dread d6/f14 [0,4194304] 0 2024-09-13T21:44:35.593 INFO:tasks.workunit.client.0.smithi119.stdout:5/106: creat d0/d3/d4/d9/d14/f29 x:0 0 0 2024-09-13T21:44:35.594 INFO:tasks.workunit.client.0.smithi119.stdout:9/121: truncate d0/d8/d18/d23/d27/f16 1491455 0 2024-09-13T21:44:35.595 INFO:tasks.workunit.client.0.smithi119.stdout:8/84: link c16 c17 0 2024-09-13T21:44:35.595 INFO:tasks.workunit.client.0.smithi119.stdout:0/105: mknod de/d1c/c2a 0 2024-09-13T21:44:35.596 INFO:tasks.workunit.client.0.smithi119.stdout:7/93: creat d8/d19/f1c x:0 0 0 2024-09-13T21:44:35.597 INFO:tasks.workunit.client.0.smithi119.stdout:3/70: creat d6/f1c x:0 0 0 2024-09-13T21:44:35.598 INFO:tasks.workunit.client.0.smithi119.stdout:3/71: chown d6/l1b 7 1 2024-09-13T21:44:35.599 INFO:tasks.workunit.client.0.smithi119.stdout:9/122: write d0/f7 [3645493,20728] 0 2024-09-13T21:44:35.602 INFO:tasks.workunit.client.0.smithi119.stdout:9/123: dread - d0/d19/f26 zero size 2024-09-13T21:44:35.605 INFO:tasks.workunit.client.0.smithi119.stdout:7/94: dread d8/f17 [0,4194304] 0 2024-09-13T21:44:35.608 INFO:tasks.workunit.client.0.smithi119.stdout:9/124: chown d0/d8/cf 21334161 1 2024-09-13T21:44:35.609 INFO:tasks.workunit.client.0.smithi119.stdout:8/85: dwrite f5 [0,4194304] 0 2024-09-13T21:44:35.611 INFO:tasks.workunit.client.0.smithi119.stdout:8/86: write fd [1513432,6276] 0 2024-09-13T21:44:35.614 INFO:tasks.workunit.client.0.smithi119.stdout:8/87: rename ff to f18 0 2024-09-13T21:44:35.616 INFO:tasks.workunit.client.0.smithi119.stdout:9/125: fdatasync d0/d8/d18/d23/d27/f17 0 2024-09-13T21:44:35.619 INFO:tasks.workunit.client.0.smithi119.stdout:3/72: truncate d6/f16 2106772 0 2024-09-13T21:44:35.619 INFO:tasks.workunit.client.0.smithi119.stdout:3/73: stat d6/c7 0 2024-09-13T21:44:35.621 INFO:tasks.workunit.client.0.smithi119.stdout:8/88: unlink fb 0 2024-09-13T21:44:35.626 INFO:tasks.workunit.client.0.smithi119.stdout:9/126: mkdir d0/d19/d1a/d2b 0 2024-09-13T21:44:35.627 INFO:tasks.workunit.client.0.smithi119.stdout:7/95: dread d8/d9/fa [0,4194304] 0 2024-09-13T21:44:35.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:35 smithi119 ceph-mon[27653]: pgmap v244: 65 pgs: 65 active+clean; 206 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 181 KiB/s rd, 6.9 MiB/s wr, 472 op/s 2024-09-13T21:44:35.631 INFO:tasks.workunit.client.0.smithi119.stdout:8/89: dwrite f13 [4194304,4194304] 0 2024-09-13T21:44:35.634 INFO:tasks.workunit.client.0.smithi119.stdout:2/107: truncate d1/d7/ff 2108961 0 2024-09-13T21:44:35.634 INFO:tasks.workunit.client.0.smithi119.stdout:1/157: write d1/d3/f4 [3103499,85415] 0 2024-09-13T21:44:35.638 INFO:tasks.workunit.client.0.smithi119.stdout:8/90: rename ce to c19 0 2024-09-13T21:44:35.639 INFO:tasks.workunit.client.0.smithi119.stdout:2/108: dread d1/f6 [0,4194304] 0 2024-09-13T21:44:35.640 INFO:tasks.workunit.client.0.smithi119.stdout:4/114: rename f2 to d4/d1e/f20 0 2024-09-13T21:44:35.643 INFO:tasks.workunit.client.0.smithi119.stdout:8/91: symlink l1a 0 2024-09-13T21:44:35.645 INFO:tasks.workunit.client.0.smithi119.stdout:1/158: mknod d1/d3/dc/d11/d19/d2d/c2e 0 2024-09-13T21:44:35.646 INFO:tasks.workunit.client.0.smithi119.stdout:2/109: truncate d1/d7/f11 4578942 0 2024-09-13T21:44:35.648 INFO:tasks.workunit.client.0.smithi119.stdout:9/127: rename d0/d8/d18/f21 to d0/f2c 0 2024-09-13T21:44:35.649 INFO:tasks.workunit.client.0.smithi119.stdout:8/92: mkdir d1b 0 2024-09-13T21:44:35.650 INFO:tasks.workunit.client.0.smithi119.stdout:8/93: fsync fc 0 2024-09-13T21:44:35.650 INFO:tasks.workunit.client.0.smithi119.stdout:3/74: link d6/cd d6/c1d 0 2024-09-13T21:44:35.653 INFO:tasks.workunit.client.0.smithi119.stdout:1/159: stat d1/f22 0 2024-09-13T21:44:35.653 INFO:tasks.workunit.client.0.smithi119.stdout:0/106: getdents de/d1c 0 2024-09-13T21:44:35.655 INFO:tasks.workunit.client.0.smithi119.stdout:2/110: dread d1/d7/fd [0,4194304] 0 2024-09-13T21:44:35.656 INFO:tasks.workunit.client.0.smithi119.stdout:1/160: write d1/d3/f2a [1581087,44385] 0 2024-09-13T21:44:35.657 INFO:tasks.workunit.client.0.smithi119.stdout:3/75: creat d6/f1e x:0 0 0 2024-09-13T21:44:35.660 INFO:tasks.workunit.client.0.smithi119.stdout:8/94: dread fd [0,4194304] 0 2024-09-13T21:44:35.660 INFO:tasks.workunit.client.0.smithi119.stdout:6/111: write fa [3399694,12122] 0 2024-09-13T21:44:35.661 INFO:tasks.workunit.client.0.smithi119.stdout:1/161: chown d1/d3/dc/d11/d28/l2c 11933 1 2024-09-13T21:44:35.661 INFO:tasks.workunit.client.0.smithi119.stdout:6/112: dread - dc/f1a zero size 2024-09-13T21:44:35.663 INFO:tasks.workunit.client.0.smithi119.stdout:2/111: mknod d1/d7/c1b 0 2024-09-13T21:44:35.665 INFO:tasks.workunit.client.0.smithi119.stdout:0/107: dwrite de/d1c/f29 [0,4194304] 0 2024-09-13T21:44:35.667 INFO:tasks.workunit.client.0.smithi119.stdout:1/162: mkdir d1/d3/dc/d24/d2f 0 2024-09-13T21:44:35.667 INFO:tasks.workunit.client.0.smithi119.stdout:0/108: write de/d1c/f27 [160718,98461] 0 2024-09-13T21:44:35.669 INFO:tasks.workunit.client.0.smithi119.stdout:0/109: fdatasync de/f10 0 2024-09-13T21:44:35.670 INFO:tasks.workunit.client.0.smithi119.stdout:6/113: fsync dc/dd/fe 0 2024-09-13T21:44:35.671 INFO:tasks.workunit.client.0.smithi119.stdout:7/96: write d8/d9/fa [1248846,59712] 0 2024-09-13T21:44:35.672 INFO:tasks.workunit.client.0.smithi119.stdout:3/76: link d6/f1c d6/d15/d1a/f1f 0 2024-09-13T21:44:35.672 INFO:tasks.workunit.client.0.smithi119.stdout:8/95: mknod d1b/c1c 0 2024-09-13T21:44:35.673 INFO:tasks.workunit.client.0.smithi119.stdout:8/96: write fc [158215,62177] 0 2024-09-13T21:44:35.674 INFO:tasks.workunit.client.0.smithi119.stdout:8/97: read fd [2303762,45982] 0 2024-09-13T21:44:35.675 INFO:tasks.workunit.client.0.smithi119.stdout:5/107: truncate d0/d3/d4/d9/d14/f17 1788288 0 2024-09-13T21:44:35.676 INFO:tasks.workunit.client.0.smithi119.stdout:3/77: dread d6/f13 [0,4194304] 0 2024-09-13T21:44:35.677 INFO:tasks.workunit.client.0.smithi119.stdout:0/110: rmdir de 39 2024-09-13T21:44:35.679 INFO:tasks.workunit.client.0.smithi119.stdout:1/163: symlink d1/d3/dc/d11/d28/l30 0 2024-09-13T21:44:35.680 INFO:tasks.workunit.client.0.smithi119.stdout:1/164: fdatasync d1/d3/f2b 0 2024-09-13T21:44:35.682 INFO:tasks.workunit.client.0.smithi119.stdout:7/97: mknod d8/c1d 0 2024-09-13T21:44:35.683 INFO:tasks.workunit.client.0.smithi119.stdout:6/114: mkdir dc/dd/d22 0 2024-09-13T21:44:35.683 INFO:tasks.workunit.client.0.smithi119.stdout:6/115: chown dc/df/c21 167792 1 2024-09-13T21:44:35.685 INFO:tasks.workunit.client.0.smithi119.stdout:9/128: truncate d0/f7 2178243 0 2024-09-13T21:44:35.686 INFO:tasks.workunit.client.0.smithi119.stdout:8/98: mkdir d1b/d1d 0 2024-09-13T21:44:35.688 INFO:tasks.workunit.client.0.smithi119.stdout:5/108: mknod d0/d3/d4/d9/d14/d24/c2a 0 2024-09-13T21:44:35.693 INFO:tasks.workunit.client.0.smithi119.stdout:7/98: mkdir d8/d19/d1e 0 2024-09-13T21:44:35.697 INFO:tasks.workunit.client.0.smithi119.stdout:0/111: dwrite de/f22 [0,4194304] 0 2024-09-13T21:44:35.697 INFO:tasks.workunit.client.0.smithi119.stdout:8/99: mknod d1b/c1e 0 2024-09-13T21:44:35.698 INFO:tasks.workunit.client.0.smithi119.stdout:3/78: truncate d6/f18 488440 0 2024-09-13T21:44:35.702 INFO:tasks.workunit.client.0.smithi119.stdout:5/109: chown d0/d3/d4/f5 375666489 1 2024-09-13T21:44:35.704 INFO:tasks.workunit.client.0.smithi119.stdout:8/100: dread f5 [0,4194304] 0 2024-09-13T21:44:35.704 INFO:tasks.workunit.client.0.smithi119.stdout:2/112: rename d1/d7/ff to d1/d7/d1a/f1c 0 2024-09-13T21:44:35.705 INFO:tasks.workunit.client.0.smithi119.stdout:1/165: mkdir d1/d3/dc/d24/d2f/d31 0 2024-09-13T21:44:35.709 INFO:tasks.workunit.client.0.smithi119.stdout:7/99: fsync d8/d9/f12 0 2024-09-13T21:44:35.710 INFO:tasks.workunit.client.0.smithi119.stdout:5/110: dwrite d0/d3/f15 [0,4194304] 0 2024-09-13T21:44:35.712 INFO:tasks.workunit.client.0.smithi119.stdout:0/112: mkdir de/d1c/d2b 0 2024-09-13T21:44:35.713 INFO:tasks.workunit.client.0.smithi119.stdout:0/113: truncate de/d1c/f1d 703974 0 2024-09-13T21:44:35.716 INFO:tasks.workunit.client.0.smithi119.stdout:0/114: write de/d1c/f20 [136959,81100] 0 2024-09-13T21:44:35.717 INFO:tasks.workunit.client.0.smithi119.stdout:0/115: read - de/f1a zero size 2024-09-13T21:44:35.718 INFO:tasks.workunit.client.0.smithi119.stdout:6/116: rename l2 to dc/l23 0 2024-09-13T21:44:35.719 INFO:tasks.workunit.client.0.smithi119.stdout:5/111: dread d0/d3/d4/fa [0,4194304] 0 2024-09-13T21:44:35.720 INFO:tasks.workunit.client.0.smithi119.stdout:6/117: write dc/f16 [3096350,39462] 0 2024-09-13T21:44:35.721 INFO:tasks.workunit.client.0.smithi119.stdout:8/101: creat d1b/f1f x:0 0 0 2024-09-13T21:44:35.721 INFO:tasks.workunit.client.0.smithi119.stdout:8/102: readlink l1a 0 2024-09-13T21:44:35.723 INFO:tasks.workunit.client.0.smithi119.stdout:6/118: write dc/dd/f1f [903306,97770] 0 2024-09-13T21:44:35.723 INFO:tasks.workunit.client.0.smithi119.stdout:6/119: chown l3 237586 1 2024-09-13T21:44:35.724 INFO:tasks.workunit.client.0.smithi119.stdout:6/120: dread - dc/df/f1d zero size 2024-09-13T21:44:35.724 INFO:tasks.workunit.client.0.smithi119.stdout:4/115: truncate d4/d1e/d10/f1a 1194218 0 2024-09-13T21:44:35.725 INFO:tasks.workunit.client.0.smithi119.stdout:6/121: write dc/f1b [562535,71061] 0 2024-09-13T21:44:35.726 INFO:tasks.workunit.client.0.smithi119.stdout:6/122: dread - dc/df/f1d zero size 2024-09-13T21:44:35.727 INFO:tasks.workunit.client.0.smithi119.stdout:3/79: symlink d6/d15/d1a/l20 0 2024-09-13T21:44:35.730 INFO:tasks.workunit.client.0.smithi119.stdout:2/113: mknod d1/c1d 0 2024-09-13T21:44:35.731 INFO:tasks.workunit.client.0.smithi119.stdout:5/112: mknod d0/d3/c2b 0 2024-09-13T21:44:35.733 INFO:tasks.workunit.client.0.smithi119.stdout:1/166: mkdir d1/d3/dc/d24/d2f/d31/d32 0 2024-09-13T21:44:35.734 INFO:tasks.workunit.client.0.smithi119.stdout:8/103: unlink f10 0 2024-09-13T21:44:35.738 INFO:tasks.workunit.client.0.smithi119.stdout:4/116: chown d4/d1e/f20 734634 1 2024-09-13T21:44:35.738 INFO:tasks.workunit.client.0.smithi119.stdout:4/117: stat d4/d1e/d10/d1f 0 2024-09-13T21:44:35.741 INFO:tasks.workunit.client.0.smithi119.stdout:6/123: rename dc/f16 to dc/df/f24 0 2024-09-13T21:44:35.741 INFO:tasks.workunit.client.0.smithi119.stdout:3/80: fdatasync d6/f13 0 2024-09-13T21:44:35.742 INFO:tasks.workunit.client.0.smithi119.stdout:0/116: creat de/d1c/d2b/f2c x:0 0 0 2024-09-13T21:44:35.744 INFO:tasks.workunit.client.0.smithi119.stdout:0/117: dread de/f1b [0,4194304] 0 2024-09-13T21:44:35.748 INFO:tasks.workunit.client.0.smithi119.stdout:8/104: creat d1b/f20 x:0 0 0 2024-09-13T21:44:35.748 INFO:tasks.workunit.client.0.smithi119.stdout:0/118: dread de/f22 [0,4194304] 0 2024-09-13T21:44:35.748 INFO:tasks.workunit.client.0.smithi119.stdout:8/105: chown d1b 1 1 2024-09-13T21:44:35.748 INFO:tasks.workunit.client.0.smithi119.stdout:8/106: chown l1a 3 1 2024-09-13T21:44:35.749 INFO:tasks.workunit.client.0.smithi119.stdout:7/100: rmdir d8/d19/d1e 0 2024-09-13T21:44:35.752 INFO:tasks.workunit.client.0.smithi119.stdout:6/124: symlink dc/df/l25 0 2024-09-13T21:44:35.753 INFO:tasks.workunit.client.0.smithi119.stdout:7/101: dread d8/f17 [0,4194304] 0 2024-09-13T21:44:35.753 INFO:tasks.workunit.client.0.smithi119.stdout:3/81: rename d6/d15/d1a/f1f to d6/d15/f21 0 2024-09-13T21:44:35.756 INFO:tasks.workunit.client.0.smithi119.stdout:1/167: mkdir d1/d3/dc/d24/d2f/d31/d32/d33 0 2024-09-13T21:44:35.757 INFO:tasks.workunit.client.0.smithi119.stdout:0/119: mknod de/d1c/c2d 0 2024-09-13T21:44:35.758 INFO:tasks.workunit.client.0.smithi119.stdout:9/129: truncate d0/f7 2631588 0 2024-09-13T21:44:35.761 INFO:tasks.workunit.client.0.smithi119.stdout:3/82: mkdir d6/d15/d22 0 2024-09-13T21:44:35.761 INFO:tasks.workunit.client.0.smithi119.stdout:2/114: link d1/l17 d1/d7/l1e 0 2024-09-13T21:44:35.762 INFO:tasks.workunit.client.0.smithi119.stdout:5/113: link d0/d3/c2b d0/d3/d4/d9/c2c 0 2024-09-13T21:44:35.763 INFO:tasks.workunit.client.0.smithi119.stdout:1/168: rename d1/d3/dc/c20 to d1/d3/dc/c34 0 2024-09-13T21:44:35.764 INFO:tasks.workunit.client.0.smithi119.stdout:4/118: creat d4/f21 x:0 0 0 2024-09-13T21:44:35.764 INFO:tasks.workunit.client.0.smithi119.stdout:0/120: mknod de/d1c/d2b/c2e 0 2024-09-13T21:44:35.766 INFO:tasks.workunit.client.0.smithi119.stdout:6/125: mkdir dc/dd/d22/d26 0 2024-09-13T21:44:35.767 INFO:tasks.workunit.client.0.smithi119.stdout:3/83: mknod d6/d15/d1a/c23 0 2024-09-13T21:44:35.770 INFO:tasks.workunit.client.0.smithi119.stdout:5/114: chown d0/d3/d4/d9/c1c 38544 1 2024-09-13T21:44:35.771 INFO:tasks.workunit.client.0.smithi119.stdout:0/121: mkdir de/d1c/d2f 0 2024-09-13T21:44:35.772 INFO:tasks.workunit.client.0.smithi119.stdout:5/115: readlink d0/d3/l1b 0 2024-09-13T21:44:35.772 INFO:tasks.workunit.client.0.smithi119.stdout:8/107: link d1b/c1e d1b/d1d/c21 0 2024-09-13T21:44:35.775 INFO:tasks.workunit.client.0.smithi119.stdout:6/126: dwrite fa [0,4194304] 0 2024-09-13T21:44:35.777 INFO:tasks.workunit.client.0.smithi119.stdout:3/84: symlink d6/d15/d1a/l24 0 2024-09-13T21:44:35.778 INFO:tasks.workunit.client.0.smithi119.stdout:3/85: write d6/f11 [5311890,94705] 0 2024-09-13T21:44:35.778 INFO:tasks.workunit.client.0.smithi119.stdout:4/119: dread d4/d1e/f17 [0,4194304] 0 2024-09-13T21:44:35.780 INFO:tasks.workunit.client.0.smithi119.stdout:4/120: chown d4/f21 7915999 1 2024-09-13T21:44:35.781 INFO:tasks.workunit.client.0.smithi119.stdout:8/108: symlink d1b/l22 0 2024-09-13T21:44:35.782 INFO:tasks.workunit.client.0.smithi119.stdout:7/102: getdents d8/d19 0 2024-09-13T21:44:35.785 INFO:tasks.workunit.client.0.smithi119.stdout:5/116: creat d0/d3/d4/d9/d14/d24/f2d x:0 0 0 2024-09-13T21:44:35.787 INFO:tasks.workunit.client.0.smithi119.stdout:5/117: dread d0/d3/f11 [0,4194304] 0 2024-09-13T21:44:35.790 INFO:tasks.workunit.client.0.smithi119.stdout:7/103: creat d8/d19/f1f x:0 0 0 2024-09-13T21:44:35.791 INFO:tasks.workunit.client.0.smithi119.stdout:7/104: write d8/d9/fa [2058941,73249] 0 2024-09-13T21:44:35.792 INFO:tasks.workunit.client.0.smithi119.stdout:0/122: link de/f16 de/d1c/d2b/f30 0 2024-09-13T21:44:35.792 INFO:tasks.workunit.client.0.smithi119.stdout:8/109: dread f5 [0,4194304] 0 2024-09-13T21:44:35.794 INFO:tasks.workunit.client.0.smithi119.stdout:0/123: write de/f12 [114042,86292] 0 2024-09-13T21:44:35.796 INFO:tasks.workunit.client.0.smithi119.stdout:9/130: write d0/d8/f10 [1767897,116291] 0 2024-09-13T21:44:35.798 INFO:tasks.workunit.client.0.smithi119.stdout:4/121: mknod d4/d1e/c22 0 2024-09-13T21:44:35.800 INFO:tasks.workunit.client.0.smithi119.stdout:5/118: write d0/d3/f12 [3562913,72676] 0 2024-09-13T21:44:35.805 INFO:tasks.workunit.client.0.smithi119.stdout:8/110: dwrite fc [0,4194304] 0 2024-09-13T21:44:35.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:35 smithi155 ceph-mon[34732]: pgmap v244: 65 pgs: 65 active+clean; 206 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 181 KiB/s rd, 6.9 MiB/s wr, 472 op/s 2024-09-13T21:44:35.918 INFO:tasks.workunit.client.0.smithi119.stdout:6/127: rmdir dc/dd/d22/d26 0 2024-09-13T21:44:35.919 INFO:tasks.workunit.client.0.smithi119.stdout:8/111: readlink l1a 0 2024-09-13T21:44:35.919 INFO:tasks.workunit.client.0.smithi119.stdout:0/124: creat de/d1c/f31 x:0 0 0 2024-09-13T21:44:35.919 INFO:tasks.workunit.client.0.smithi119.stdout:3/86: rmdir d6/d15/d22 0 2024-09-13T21:44:35.921 INFO:tasks.workunit.client.0.smithi119.stdout:3/87: readlink l4 0 2024-09-13T21:44:35.921 INFO:tasks.workunit.client.0.smithi119.stdout:6/128: write dc/f1e [80816,30295] 0 2024-09-13T21:44:35.922 INFO:tasks.workunit.client.0.smithi119.stdout:5/119: fsync d0/d3/d4/f5 0 2024-09-13T21:44:35.950 INFO:tasks.workunit.client.0.smithi119.stdout:9/131: fsync d0/f7 0 2024-09-13T21:44:35.950 INFO:tasks.workunit.client.0.smithi119.stdout:0/125: unlink de/f16 0 2024-09-13T21:44:35.951 INFO:tasks.workunit.client.0.smithi119.stdout:4/122: symlink d4/l23 0 2024-09-13T21:44:35.952 INFO:tasks.workunit.client.0.smithi119.stdout:2/115: dwrite d1/d7/fd [0,4194304] 0 2024-09-13T21:44:35.953 INFO:tasks.workunit.client.0.smithi119.stdout:3/88: unlink l1 0 2024-09-13T21:44:35.955 INFO:tasks.workunit.client.0.smithi119.stdout:7/105: getdents d8/d9 0 2024-09-13T21:44:35.955 INFO:tasks.workunit.client.0.smithi119.stdout:6/129: creat dc/df/f27 x:0 0 0 2024-09-13T21:44:35.957 INFO:tasks.workunit.client.0.smithi119.stdout:0/126: creat de/d1c/d2b/f32 x:0 0 0 2024-09-13T21:44:35.957 INFO:tasks.workunit.client.0.smithi119.stdout:4/123: write d4/d1e/ff [1468739,16049] 0 2024-09-13T21:44:35.960 INFO:tasks.workunit.client.0.smithi119.stdout:7/106: creat d8/f20 x:0 0 0 2024-09-13T21:44:35.960 INFO:tasks.workunit.client.0.smithi119.stdout:6/130: readlink dc/l23 0 2024-09-13T21:44:35.962 INFO:tasks.workunit.client.0.smithi119.stdout:7/107: dread - d8/f20 zero size 2024-09-13T21:44:35.964 INFO:tasks.workunit.client.0.smithi119.stdout:7/108: truncate f3 4863104 0 2024-09-13T21:44:35.965 INFO:tasks.workunit.client.0.smithi119.stdout:8/112: link ca d1b/d1d/c23 0 2024-09-13T21:44:35.966 INFO:tasks.workunit.client.0.smithi119.stdout:9/132: dwrite d0/d8/d18/d23/f29 [0,4194304] 0 2024-09-13T21:44:35.967 INFO:tasks.workunit.client.0.smithi119.stdout:3/89: truncate d6/f16 1281239 0 2024-09-13T21:44:35.968 INFO:tasks.workunit.client.0.smithi119.stdout:0/127: symlink de/d1c/l33 0 2024-09-13T21:44:35.969 INFO:tasks.workunit.client.0.smithi119.stdout:7/109: truncate d8/d19/f1c 647005 0 2024-09-13T21:44:35.971 INFO:tasks.workunit.client.0.smithi119.stdout:8/113: mknod d1b/d1d/c24 0 2024-09-13T21:44:35.975 INFO:tasks.workunit.client.0.smithi119.stdout:7/110: creat d8/f21 x:0 0 0 2024-09-13T21:44:35.975 INFO:tasks.workunit.client.0.smithi119.stdout:2/116: truncate d1/d7/fd 2259203 0 2024-09-13T21:44:35.976 INFO:tasks.workunit.client.0.smithi119.stdout:8/114: chown c19 43380 1 2024-09-13T21:44:35.978 INFO:tasks.workunit.client.0.smithi119.stdout:6/131: dread dc/dd/f1f [0,4194304] 0 2024-09-13T21:44:35.979 INFO:tasks.workunit.client.0.smithi119.stdout:0/128: rmdir de 39 2024-09-13T21:44:35.982 INFO:tasks.workunit.client.0.smithi119.stdout:7/111: mkdir d8/d19/d22 0 2024-09-13T21:44:35.982 INFO:tasks.workunit.client.0.smithi119.stdout:7/112: chown d8/d9/lb 77 1 2024-09-13T21:44:35.984 INFO:tasks.workunit.client.0.smithi119.stdout:4/124: truncate d4/d1e/f20 1423756 0 2024-09-13T21:44:35.985 INFO:tasks.workunit.client.0.smithi119.stdout:8/115: rename c7 to d1b/d1d/c25 0 2024-09-13T21:44:35.986 INFO:tasks.workunit.client.0.smithi119.stdout:9/133: write d0/d8/d18/d23/d27/f2a [872839,60215] 0 2024-09-13T21:44:35.987 INFO:tasks.workunit.client.0.smithi119.stdout:9/134: read d0/f14 [492034,83647] 0 2024-09-13T21:44:35.987 INFO:tasks.workunit.client.0.smithi119.stdout:9/135: stat d0/d8/d18/l1e 0 2024-09-13T21:44:35.990 INFO:tasks.workunit.client.0.smithi119.stdout:2/117: mkdir d1/d1f 0 2024-09-13T21:44:35.994 INFO:tasks.workunit.client.0.smithi119.stdout:3/90: dwrite d6/f16 [0,4194304] 0 2024-09-13T21:44:35.994 INFO:tasks.workunit.client.0.smithi119.stdout:8/116: truncate f5 1783914 0 2024-09-13T21:44:35.995 INFO:tasks.workunit.client.0.smithi119.stdout:8/117: truncate fd 5467164 0 2024-09-13T21:44:35.995 INFO:tasks.workunit.client.0.smithi119.stdout:3/91: write d6/ff [494120,116667] 0 2024-09-13T21:44:35.997 INFO:tasks.workunit.client.0.smithi119.stdout:3/92: read d6/f12 [3013009,9945] 0 2024-09-13T21:44:35.997 INFO:tasks.workunit.client.0.smithi119.stdout:7/113: symlink d8/d19/d22/l23 0 2024-09-13T21:44:36.007 INFO:tasks.workunit.client.0.smithi119.stdout:2/118: fsync d1/d7/f11 0 2024-09-13T21:44:36.007 INFO:tasks.workunit.client.0.smithi119.stdout:8/118: dwrite f13 [8388608,4194304] 0 2024-09-13T21:44:36.007 INFO:tasks.workunit.client.0.smithi119.stdout:3/93: dwrite d6/f12 [0,4194304] 0 2024-09-13T21:44:36.009 INFO:tasks.workunit.client.0.smithi119.stdout:7/114: creat d8/f24 x:0 0 0 2024-09-13T21:44:36.012 INFO:tasks.workunit.client.0.smithi119.stdout:6/132: getdents dc/df 0 2024-09-13T21:44:36.014 INFO:tasks.workunit.client.0.smithi119.stdout:0/129: mkdir de/d1c/d2b/d34 0 2024-09-13T21:44:36.015 INFO:tasks.workunit.client.0.smithi119.stdout:9/136: truncate d0/f14 1397963 0 2024-09-13T21:44:36.015 INFO:tasks.workunit.client.0.smithi119.stdout:0/130: chown fd 3 1 2024-09-13T21:44:36.017 INFO:tasks.workunit.client.0.smithi119.stdout:8/119: write f18 [317491,25224] 0 2024-09-13T21:44:36.018 INFO:tasks.workunit.client.0.smithi119.stdout:2/119: creat d1/d7/f20 x:0 0 0 2024-09-13T21:44:36.021 INFO:tasks.workunit.client.0.smithi119.stdout:7/115: creat d8/d19/f25 x:0 0 0 2024-09-13T21:44:36.021 INFO:tasks.workunit.client.0.smithi119.stdout:4/125: truncate d4/f8 2972352 0 2024-09-13T21:44:36.022 INFO:tasks.workunit.client.0.smithi119.stdout:6/133: mknod dc/dd/c28 0 2024-09-13T21:44:36.023 INFO:tasks.workunit.client.0.smithi119.stdout:6/134: read - dc/dd/f20 zero size 2024-09-13T21:44:36.023 INFO:tasks.workunit.client.0.smithi119.stdout:6/135: fsync f9 0 2024-09-13T21:44:36.023 INFO:tasks.workunit.client.0.smithi119.stdout:8/120: mkdir d1b/d1d/d26 0 2024-09-13T21:44:36.024 INFO:tasks.workunit.client.0.smithi119.stdout:2/120: symlink d1/d7/d1a/l21 0 2024-09-13T21:44:36.025 INFO:tasks.workunit.client.0.smithi119.stdout:7/116: mknod d8/c26 0 2024-09-13T21:44:36.030 INFO:tasks.workunit.client.0.smithi119.stdout:2/121: dwrite d1/d7/f9 [0,4194304] 0 2024-09-13T21:44:36.030 INFO:tasks.workunit.client.0.smithi119.stdout:2/122: readlink d1/l16 0 2024-09-13T21:44:36.031 INFO:tasks.workunit.client.0.smithi119.stdout:8/121: dread f18 [0,4194304] 0 2024-09-13T21:44:36.074 INFO:tasks.workunit.client.0.smithi119.stdout:6/136: mknod dc/df/c29 0 2024-09-13T21:44:36.077 INFO:tasks.workunit.client.0.smithi119.stdout:4/126: unlink d4/f18 0 2024-09-13T21:44:36.078 INFO:tasks.workunit.client.0.smithi119.stdout:7/117: symlink d8/d9/l27 0 2024-09-13T21:44:36.078 INFO:tasks.workunit.client.0.smithi119.stdout:3/94: write d6/d15/f21 [386361,30702] 0 2024-09-13T21:44:36.079 INFO:tasks.workunit.client.0.smithi119.stdout:6/137: dread dc/df/f24 [0,4194304] 0 2024-09-13T21:44:36.079 INFO:tasks.workunit.client.0.smithi119.stdout:2/123: stat d1/d7/c13 0 2024-09-13T21:44:36.080 INFO:tasks.workunit.client.0.smithi119.stdout:8/122: creat d1b/f27 x:0 0 0 2024-09-13T21:44:36.080 INFO:tasks.workunit.client.0.smithi119.stdout:6/138: dread - dc/df/f1d zero size 2024-09-13T21:44:36.082 INFO:tasks.workunit.client.0.smithi119.stdout:2/124: write d1/d7/f20 [366300,110308] 0 2024-09-13T21:44:36.082 INFO:tasks.workunit.client.0.smithi119.stdout:0/131: stat de/d1c/d2b/f2c 0 2024-09-13T21:44:36.083 INFO:tasks.workunit.client.0.smithi119.stdout:2/125: truncate d1/d7/f20 848650 0 2024-09-13T21:44:36.086 INFO:tasks.workunit.client.0.smithi119.stdout:3/95: unlink d6/f10 0 2024-09-13T21:44:36.087 INFO:tasks.workunit.client.0.smithi119.stdout:6/139: symlink dc/l2a 0 2024-09-13T21:44:36.088 INFO:tasks.workunit.client.0.smithi119.stdout:9/137: truncate d0/d8/d18/d23/f29 2293567 0 2024-09-13T21:44:36.090 INFO:tasks.workunit.client.0.smithi119.stdout:0/132: dread de/f1b [0,4194304] 0 2024-09-13T21:44:36.091 INFO:tasks.workunit.client.0.smithi119.stdout:7/118: dwrite d8/d9/fe [4194304,4194304] 0 2024-09-13T21:44:36.093 INFO:tasks.workunit.client.0.smithi119.stdout:8/123: mkdir d1b/d1d/d26/d28 0 2024-09-13T21:44:36.093 INFO:tasks.workunit.client.0.smithi119.stdout:7/119: write d8/d9/fe [1332309,7965] 0 2024-09-13T21:44:36.093 INFO:tasks.workunit.client.0.smithi119.stdout:3/96: dread d6/f18 [0,4194304] 0 2024-09-13T21:44:36.096 INFO:tasks.workunit.client.0.smithi119.stdout:4/127: creat d4/d1e/d10/d1f/f24 x:0 0 0 2024-09-13T21:44:36.101 INFO:tasks.workunit.client.0.smithi119.stdout:2/126: rename d1/d7/d1a to d1/d22 0 2024-09-13T21:44:36.101 INFO:tasks.workunit.client.0.smithi119.stdout:2/127: chown d1/d7/c1b 48 1 2024-09-13T21:44:36.101 INFO:tasks.workunit.client.0.smithi119.stdout:2/128: chown d1/c19 28344 1 2024-09-13T21:44:36.102 INFO:tasks.workunit.client.0.smithi119.stdout:7/120: creat d8/d19/d22/f28 x:0 0 0 2024-09-13T21:44:36.102 INFO:tasks.workunit.client.0.smithi119.stdout:2/129: chown d1/c15 4 1 2024-09-13T21:44:36.103 INFO:tasks.workunit.client.0.smithi119.stdout:3/97: mkdir d6/d25 0 2024-09-13T21:44:36.104 INFO:tasks.workunit.client.0.smithi119.stdout:9/138: mkdir d0/d8/d18/d23/d27/d2d 0 2024-09-13T21:44:36.106 INFO:tasks.workunit.client.0.smithi119.stdout:4/128: creat d4/d1e/d10/d1f/f25 x:0 0 0 2024-09-13T21:44:36.106 INFO:tasks.workunit.client.0.smithi119.stdout:0/133: mkdir de/d1c/d2f/d35 0 2024-09-13T21:44:36.108 INFO:tasks.workunit.client.0.smithi119.stdout:0/134: read fd [1064332,72185] 0 2024-09-13T21:44:36.111 INFO:tasks.workunit.client.0.smithi119.stdout:7/121: dwrite d8/d9/f11 [0,4194304] 0 2024-09-13T21:44:36.111 INFO:tasks.workunit.client.0.smithi119.stdout:3/98: dread d6/f12 [0,4194304] 0 2024-09-13T21:44:36.114 INFO:tasks.workunit.client.0.smithi119.stdout:9/139: mkdir d0/d8/d18/d2e 0 2024-09-13T21:44:36.114 INFO:tasks.workunit.client.0.smithi119.stdout:9/140: write d0/d19/f26 [181155,83572] 0 2024-09-13T21:44:36.117 INFO:tasks.workunit.client.0.smithi119.stdout:6/140: getdents dc/df 0 2024-09-13T21:44:36.118 INFO:tasks.workunit.client.0.smithi119.stdout:8/124: rmdir d1b/d1d/d26/d28 0 2024-09-13T21:44:36.119 INFO:tasks.workunit.client.0.smithi119.stdout:8/125: chown d1b/f20 1505907406 1 2024-09-13T21:44:36.119 INFO:tasks.workunit.client.0.smithi119.stdout:0/135: rmdir de/d1c 39 2024-09-13T21:44:36.123 INFO:tasks.workunit.client.0.smithi119.stdout:7/122: mknod d8/d19/d22/c29 0 2024-09-13T21:44:36.125 INFO:tasks.workunit.client.0.smithi119.stdout:3/99: symlink d6/d15/l26 0 2024-09-13T21:44:36.125 INFO:tasks.workunit.client.0.smithi119.stdout:3/100: chown d6/ff 4 1 2024-09-13T21:44:36.132 INFO:tasks.workunit.client.0.smithi119.stdout:4/129: mkdir d4/d1e/d26 0 2024-09-13T21:44:36.134 INFO:tasks.workunit.client.0.smithi119.stdout:7/123: symlink d8/l2a 0 2024-09-13T21:44:36.134 INFO:tasks.workunit.client.0.smithi119.stdout:7/124: readlink d8/d9/l16 0 2024-09-13T21:44:36.135 INFO:tasks.workunit.client.0.smithi119.stdout:2/130: truncate d1/d7/fd 748362 0 2024-09-13T21:44:36.136 INFO:tasks.workunit.client.0.smithi119.stdout:7/125: write d8/f21 [380714,15845] 0 2024-09-13T21:44:36.136 INFO:tasks.workunit.client.0.smithi119.stdout:3/101: mknod d6/d15/d1a/c27 0 2024-09-13T21:44:36.137 INFO:tasks.workunit.client.0.smithi119.stdout:7/126: write d8/f21 [407320,126091] 0 2024-09-13T21:44:36.141 INFO:tasks.workunit.client.0.smithi119.stdout:8/126: rename d1b/d1d/c21 to d1b/c29 0 2024-09-13T21:44:36.142 INFO:tasks.workunit.client.0.smithi119.stdout:2/131: creat d1/d7/f23 x:0 0 0 2024-09-13T21:44:36.144 INFO:tasks.workunit.client.0.smithi119.stdout:7/127: dwrite f6 [0,4194304] 0 2024-09-13T21:44:36.146 INFO:tasks.workunit.client.0.smithi119.stdout:3/102: creat d6/d15/d1a/f28 x:0 0 0 2024-09-13T21:44:36.149 INFO:tasks.workunit.client.0.smithi119.stdout:8/127: mkdir d1b/d1d/d26/d2a 0 2024-09-13T21:44:36.149 INFO:tasks.workunit.client.0.smithi119.stdout:8/128: stat d1b/f27 0 2024-09-13T21:44:36.151 INFO:tasks.workunit.client.0.smithi119.stdout:2/132: creat d1/d22/f24 x:0 0 0 2024-09-13T21:44:36.152 INFO:tasks.workunit.client.0.smithi119.stdout:4/130: creat d4/f27 x:0 0 0 2024-09-13T21:44:36.153 INFO:tasks.workunit.client.0.smithi119.stdout:7/128: creat d8/d19/d22/f2b x:0 0 0 2024-09-13T21:44:36.154 INFO:tasks.workunit.client.0.smithi119.stdout:3/103: unlink d6/d15/d1a/l24 0 2024-09-13T21:44:36.154 INFO:tasks.workunit.client.0.smithi119.stdout:0/136: truncate de/f13 898318 0 2024-09-13T21:44:36.155 INFO:tasks.workunit.client.0.smithi119.stdout:7/129: write d8/d19/f1c [1364880,123112] 0 2024-09-13T21:44:36.155 INFO:tasks.workunit.client.0.smithi119.stdout:6/141: link dc/df/l15 dc/l2b 0 2024-09-13T21:44:36.157 INFO:tasks.workunit.client.0.smithi119.stdout:8/129: mknod d1b/d1d/c2b 0 2024-09-13T21:44:36.158 INFO:tasks.workunit.client.0.smithi119.stdout:7/130: chown f6 409639328 1 2024-09-13T21:44:36.158 INFO:tasks.workunit.client.0.smithi119.stdout:0/137: write de/f1a [549573,91836] 0 2024-09-13T21:44:36.160 INFO:tasks.workunit.client.0.smithi119.stdout:9/141: dwrite d0/d8/d18/d23/d27/f16 [0,4194304] 0 2024-09-13T21:44:36.162 INFO:tasks.workunit.client.0.smithi119.stdout:7/131: write d8/f21 [624518,61502] 0 2024-09-13T21:44:36.164 INFO:tasks.workunit.client.0.smithi119.stdout:3/104: fsync d6/fc 0 2024-09-13T21:44:36.166 INFO:tasks.workunit.client.0.smithi119.stdout:6/142: mknod dc/df/c2c 0 2024-09-13T21:44:36.166 INFO:tasks.workunit.client.0.smithi119.stdout:3/105: fdatasync d6/f16 0 2024-09-13T21:44:36.168 INFO:tasks.workunit.client.0.smithi119.stdout:6/143: truncate dc/f1e 358238 0 2024-09-13T21:44:36.170 INFO:tasks.workunit.client.0.smithi119.stdout:8/130: dwrite f9 [0,4194304] 0 2024-09-13T21:44:36.172 INFO:tasks.workunit.client.0.smithi119.stdout:6/144: write dc/df/f27 [55215,8616] 0 2024-09-13T21:44:36.172 INFO:tasks.workunit.client.0.smithi119.stdout:7/132: creat d8/f2c x:0 0 0 2024-09-13T21:44:36.173 INFO:tasks.workunit.client.0.smithi119.stdout:9/142: mkdir d0/d8/d18/d2f 0 2024-09-13T21:44:36.173 INFO:tasks.workunit.client.0.smithi119.stdout:8/131: truncate d1b/f20 995785 0 2024-09-13T21:44:36.176 INFO:tasks.workunit.client.0.smithi119.stdout:2/133: creat d1/f25 x:0 0 0 2024-09-13T21:44:36.178 INFO:tasks.workunit.client.0.smithi119.stdout:2/134: dread - d1/d7/f23 zero size 2024-09-13T21:44:36.179 INFO:tasks.workunit.client.0.smithi119.stdout:0/138: creat de/d1c/f36 x:0 0 0 2024-09-13T21:44:36.181 INFO:tasks.workunit.client.0.smithi119.stdout:8/132: dwrite f9 [0,4194304] 0 2024-09-13T21:44:36.181 INFO:tasks.workunit.client.0.smithi119.stdout:9/143: dread d0/d8/d18/d23/d27/f16 [0,4194304] 0 2024-09-13T21:44:36.183 INFO:tasks.workunit.client.0.smithi119.stdout:2/135: write d1/d7/f9 [2650344,3636] 0 2024-09-13T21:44:36.186 INFO:tasks.workunit.client.0.smithi119.stdout:9/144: truncate d0/f2c 541688 0 2024-09-13T21:44:36.186 INFO:tasks.workunit.client.0.smithi119.stdout:3/106: link d6/f1e d6/f29 0 2024-09-13T21:44:36.188 INFO:tasks.workunit.client.0.smithi119.stdout:2/136: readlink d1/d7/l14 0 2024-09-13T21:44:36.190 INFO:tasks.workunit.client.0.smithi119.stdout:9/145: readlink d0/d8/ld 0 2024-09-13T21:44:36.190 INFO:tasks.workunit.client.0.smithi119.stdout:3/107: chown d6/l1b 378 1 2024-09-13T21:44:36.192 INFO:tasks.workunit.client.0.smithi119.stdout:4/131: write d4/d1e/d10/f1a [740603,18311] 0 2024-09-13T21:44:36.192 INFO:tasks.workunit.client.0.smithi119.stdout:8/133: unlink fc 0 2024-09-13T21:44:36.195 INFO:tasks.workunit.client.0.smithi119.stdout:3/108: readlink d6/le 0 2024-09-13T21:44:36.195 INFO:tasks.workunit.client.0.smithi119.stdout:4/132: chown d4/f27 98378423 1 2024-09-13T21:44:36.196 INFO:tasks.workunit.client.0.smithi119.stdout:9/146: write d0/d19/f26 [653168,122542] 0 2024-09-13T21:44:36.196 INFO:tasks.workunit.client.0.smithi119.stdout:7/133: dwrite d8/f17 [4194304,4194304] 0 2024-09-13T21:44:36.197 INFO:tasks.workunit.client.0.smithi119.stdout:6/145: dwrite dc/dd/f1f [0,4194304] 0 2024-09-13T21:44:36.200 INFO:tasks.workunit.client.0.smithi119.stdout:8/134: read f5 [1268134,56940] 0 2024-09-13T21:44:36.200 INFO:tasks.workunit.client.0.smithi119.stdout:9/147: chown d0/d8/d18/d2f 0 1 2024-09-13T21:44:36.202 INFO:tasks.workunit.client.0.smithi119.stdout:3/109: rename d6/fb to d6/d25/f2a 0 2024-09-13T21:44:36.203 INFO:tasks.workunit.client.0.smithi119.stdout:8/135: write f9 [472588,69268] 0 2024-09-13T21:44:36.205 INFO:tasks.workunit.client.0.smithi119.stdout:2/137: dread d1/d22/f1c [0,4194304] 0 2024-09-13T21:44:36.205 INFO:tasks.workunit.client.0.smithi119.stdout:3/110: truncate d6/f29 868419 0 2024-09-13T21:44:36.205 INFO:tasks.workunit.client.0.smithi119.stdout:7/134: creat d8/d9/f2d x:0 0 0 2024-09-13T21:44:36.210 INFO:tasks.workunit.client.0.smithi119.stdout:6/146: dwrite dc/f1a [0,4194304] 0 2024-09-13T21:44:36.211 INFO:tasks.workunit.client.0.smithi119.stdout:6/147: write dc/dd/f20 [201327,82533] 0 2024-09-13T21:44:36.211 INFO:tasks.workunit.client.0.smithi119.stdout:9/148: creat d0/d19/f30 x:0 0 0 2024-09-13T21:44:36.212 INFO:tasks.workunit.client.0.smithi119.stdout:8/136: fdatasync fd 0 2024-09-13T21:44:36.216 INFO:tasks.workunit.client.0.smithi119.stdout:0/139: link l8 de/d1c/d2b/l37 0 2024-09-13T21:44:36.217 INFO:tasks.workunit.client.0.smithi119.stdout:9/149: truncate d0/d19/f30 163600 0 2024-09-13T21:44:36.217 INFO:tasks.workunit.client.0.smithi119.stdout:8/137: stat d1b/d1d/d26 0 2024-09-13T21:44:36.217 INFO:tasks.workunit.client.0.smithi119.stdout:2/138: write d1/f6 [174425,31974] 0 2024-09-13T21:44:36.217 INFO:tasks.workunit.client.0.smithi119.stdout:9/150: readlink d0/l13 0 2024-09-13T21:44:36.217 INFO:tasks.workunit.client.0.smithi119.stdout:3/111: symlink d6/d25/l2b 0 2024-09-13T21:44:36.217 INFO:tasks.workunit.client.0.smithi119.stdout:7/135: mkdir d8/d19/d2e 0 2024-09-13T21:44:36.217 INFO:tasks.workunit.client.0.smithi119.stdout:9/151: truncate d0/f7 2978035 0 2024-09-13T21:44:36.218 INFO:tasks.workunit.client.0.smithi119.stdout:3/112: dread - d6/fa zero size 2024-09-13T21:44:36.219 INFO:tasks.workunit.client.0.smithi119.stdout:7/136: chown d8/l2a 1033038122 1 2024-09-13T21:44:36.219 INFO:tasks.workunit.client.0.smithi119.stdout:6/148: readlink dc/df/l15 0 2024-09-13T21:44:36.219 INFO:tasks.workunit.client.0.smithi119.stdout:2/139: stat d1/d7/fd 0 2024-09-13T21:44:36.220 INFO:tasks.workunit.client.0.smithi119.stdout:8/138: rename c6 to d1b/d1d/c2c 0 2024-09-13T21:44:36.221 INFO:tasks.workunit.client.0.smithi119.stdout:7/137: write d8/f17 [3637939,77081] 0 2024-09-13T21:44:36.223 INFO:tasks.workunit.client.0.smithi119.stdout:0/140: creat de/d1c/d2f/d35/f38 x:0 0 0 2024-09-13T21:44:36.224 INFO:tasks.workunit.client.0.smithi119.stdout:8/139: write d1b/f27 [51892,28138] 0 2024-09-13T21:44:36.224 INFO:tasks.workunit.client.0.smithi119.stdout:3/113: dread d6/f1c [0,4194304] 0 2024-09-13T21:44:36.224 INFO:tasks.workunit.client.0.smithi119.stdout:4/133: getdents d4/d1e 0 2024-09-13T21:44:36.225 INFO:tasks.workunit.client.0.smithi119.stdout:9/152: rename d0/d19/c1d to d0/d8/c31 0 2024-09-13T21:44:36.225 INFO:tasks.workunit.client.0.smithi119.stdout:7/138: write d8/f17 [9183625,130363] 0 2024-09-13T21:44:36.229 INFO:tasks.workunit.client.0.smithi119.stdout:0/141: mknod de/d1c/c39 0 2024-09-13T21:44:36.229 INFO:tasks.workunit.client.0.smithi119.stdout:3/114: read d6/ff [370565,38526] 0 2024-09-13T21:44:36.230 INFO:tasks.workunit.client.0.smithi119.stdout:4/134: rename d4/d1e/d10/d1f to d4/d1e/d28 0 2024-09-13T21:44:36.234 INFO:tasks.workunit.client.0.smithi119.stdout:3/115: rename d6/l1b to d6/d15/l2c 0 2024-09-13T21:44:36.235 INFO:tasks.workunit.client.0.smithi119.stdout:7/139: mknod d8/d19/d2e/c2f 0 2024-09-13T21:44:36.236 INFO:tasks.workunit.client.0.smithi119.stdout:7/140: write f5 [8553621,35343] 0 2024-09-13T21:44:36.236 INFO:tasks.workunit.client.0.smithi119.stdout:0/142: creat de/d1c/d2b/d34/f3a x:0 0 0 2024-09-13T21:44:36.240 INFO:tasks.workunit.client.0.smithi119.stdout:7/141: dread d8/d9/fe [0,4194304] 0 2024-09-13T21:44:36.242 INFO:tasks.workunit.client.0.smithi119.stdout:3/116: link d6/f1c d6/f2d 0 2024-09-13T21:44:36.243 INFO:tasks.workunit.client.0.smithi119.stdout:0/143: mknod de/c3b 0 2024-09-13T21:44:36.245 INFO:tasks.workunit.client.0.smithi119.stdout:3/117: write d6/ff [515393,16905] 0 2024-09-13T21:44:36.248 INFO:tasks.workunit.client.0.smithi119.stdout:0/144: mkdir de/d3c 0 2024-09-13T21:44:36.250 INFO:tasks.workunit.client.0.smithi119.stdout:3/118: creat d6/d15/f2e x:0 0 0 2024-09-13T21:44:36.250 INFO:tasks.workunit.client.0.smithi119.stdout:6/149: write dc/dd/fe [772767,68591] 0 2024-09-13T21:44:36.250 INFO:tasks.workunit.client.0.smithi119.stdout:7/142: link d8/d19/d2e/c2f d8/c30 0 2024-09-13T21:44:36.251 INFO:tasks.workunit.client.0.smithi119.stdout:8/140: write f5 [1847459,73940] 0 2024-09-13T21:44:36.253 INFO:tasks.workunit.client.0.smithi119.stdout:7/143: write d8/d19/f1f [146893,83941] 0 2024-09-13T21:44:36.255 INFO:tasks.workunit.client.0.smithi119.stdout:6/150: symlink dc/dd/l2d 0 2024-09-13T21:44:36.256 INFO:tasks.workunit.client.0.smithi119.stdout:8/141: creat d1b/d1d/f2d x:0 0 0 2024-09-13T21:44:36.258 INFO:tasks.workunit.client.0.smithi119.stdout:7/144: creat d8/f31 x:0 0 0 2024-09-13T21:44:36.259 INFO:tasks.workunit.client.0.smithi119.stdout:0/145: dwrite de/d1c/f29 [0,4194304] 0 2024-09-13T21:44:36.261 INFO:tasks.workunit.client.0.smithi119.stdout:8/142: mknod d1b/d1d/c2e 0 2024-09-13T21:44:36.262 INFO:tasks.workunit.client.0.smithi119.stdout:6/151: dread dc/df/f24 [0,4194304] 0 2024-09-13T21:44:36.263 INFO:tasks.workunit.client.0.smithi119.stdout:0/146: dread de/d1c/f27 [0,4194304] 0 2024-09-13T21:44:36.264 INFO:tasks.workunit.client.0.smithi119.stdout:4/135: fdatasync d4/d1e/f17 0 2024-09-13T21:44:36.267 INFO:tasks.workunit.client.0.smithi119.stdout:8/143: creat d1b/d1d/d26/f2f x:0 0 0 2024-09-13T21:44:36.273 INFO:tasks.workunit.client.0.smithi119.stdout:4/136: dwrite d4/f27 [0,4194304] 0 2024-09-13T21:44:36.274 INFO:tasks.workunit.client.0.smithi119.stdout:8/144: creat d1b/d1d/d26/f30 x:0 0 0 2024-09-13T21:44:36.275 INFO:tasks.workunit.client.0.smithi119.stdout:7/145: getdents d8/d19 0 2024-09-13T21:44:36.281 INFO:tasks.workunit.client.0.smithi119.stdout:0/147: dread de/f22 [0,4194304] 0 2024-09-13T21:44:36.282 INFO:tasks.workunit.client.0.smithi119.stdout:7/146: chown d8/d9/f2d 351312 1 2024-09-13T21:44:36.282 INFO:tasks.workunit.client.0.smithi119.stdout:0/148: stat de/d1c/l1f 0 2024-09-13T21:44:36.283 INFO:tasks.workunit.client.0.smithi119.stdout:8/145: rename d1b/d1d/c2b to d1b/c31 0 2024-09-13T21:44:36.284 INFO:tasks.workunit.client.0.smithi119.stdout:6/152: dwrite dc/df/f24 [0,4194304] 0 2024-09-13T21:44:36.286 INFO:tasks.workunit.client.0.smithi119.stdout:4/137: creat d4/f29 x:0 0 0 2024-09-13T21:44:36.286 INFO:tasks.workunit.client.0.smithi119.stdout:7/147: chown d8/l1b 5141389 1 2024-09-13T21:44:36.288 INFO:tasks.workunit.client.0.smithi119.stdout:6/153: write dc/dd/fe [1110278,3024] 0 2024-09-13T21:44:36.289 INFO:tasks.workunit.client.0.smithi119.stdout:3/119: dwrite d6/fc [0,4194304] 0 2024-09-13T21:44:36.289 INFO:tasks.workunit.client.0.smithi119.stdout:7/148: chown c1 2 1 2024-09-13T21:44:36.293 INFO:tasks.workunit.client.0.smithi119.stdout:4/138: creat d4/d1e/d28/f2a x:0 0 0 2024-09-13T21:44:36.297 INFO:tasks.workunit.client.0.smithi119.stdout:7/149: rename d8/f2c to d8/d9/f32 0 2024-09-13T21:44:36.299 INFO:tasks.workunit.client.0.smithi119.stdout:7/150: dread - d8/d9/f32 zero size 2024-09-13T21:44:36.300 INFO:tasks.workunit.client.0.smithi119.stdout:6/154: dwrite dc/dd/f20 [0,4194304] 0 2024-09-13T21:44:36.302 INFO:tasks.workunit.client.0.smithi119.stdout:0/149: truncate de/d1c/d2b/f30 2315588 0 2024-09-13T21:44:36.302 INFO:tasks.workunit.client.0.smithi119.stdout:6/155: fsync f9 0 2024-09-13T21:44:36.303 INFO:tasks.workunit.client.0.smithi119.stdout:4/139: chown d4/d1e/d10/c1c 15177136 1 2024-09-13T21:44:36.303 INFO:tasks.workunit.client.0.smithi119.stdout:0/150: chown l4 607603 1 2024-09-13T21:44:36.303 INFO:tasks.workunit.client.0.smithi119.stdout:7/151: truncate d8/d19/f1f 562828 0 2024-09-13T21:44:36.304 INFO:tasks.workunit.client.0.smithi119.stdout:6/156: chown dc/df/f24 1469 1 2024-09-13T21:44:36.304 INFO:tasks.workunit.client.0.smithi119.stdout:8/146: getdents d1b/d1d/d26 0 2024-09-13T21:44:36.305 INFO:tasks.workunit.client.0.smithi119.stdout:0/151: chown de/d1c/c2a 66493229 1 2024-09-13T21:44:36.305 INFO:tasks.workunit.client.0.smithi119.stdout:6/157: chown dc/dd/f1f 1502 1 2024-09-13T21:44:36.305 INFO:tasks.workunit.client.0.smithi119.stdout:0/152: stat de/l11 0 2024-09-13T21:44:36.306 INFO:tasks.workunit.client.0.smithi119.stdout:6/158: truncate dc/f14 67605 0 2024-09-13T21:44:36.307 INFO:tasks.workunit.client.0.smithi119.stdout:7/152: mknod d8/d19/d2e/c33 0 2024-09-13T21:44:36.316 INFO:tasks.workunit.client.0.smithi119.stdout:0/153: truncate de/f13 524088 0 2024-09-13T21:44:36.318 INFO:tasks.workunit.client.0.smithi119.stdout:7/153: mkdir d8/d19/d2e/d34 0 2024-09-13T21:44:36.320 INFO:tasks.workunit.client.0.smithi119.stdout:6/159: dread dc/df/f24 [0,4194304] 0 2024-09-13T21:44:36.322 INFO:tasks.workunit.client.0.smithi119.stdout:0/154: rmdir de/d1c/d2f/d35 39 2024-09-13T21:44:36.323 INFO:tasks.workunit.client.0.smithi119.stdout:7/154: creat d8/d19/f35 x:0 0 0 2024-09-13T21:44:36.323 INFO:tasks.workunit.client.0.smithi119.stdout:6/160: stat dc/df/f24 0 2024-09-13T21:44:36.323 INFO:tasks.workunit.client.0.smithi119.stdout:8/147: dwrite f15 [0,4194304] 0 2024-09-13T21:44:36.324 INFO:tasks.workunit.client.0.smithi119.stdout:3/120: dwrite d6/f14 [0,4194304] 0 2024-09-13T21:44:36.327 INFO:tasks.workunit.client.0.smithi119.stdout:6/161: chown dc/df/f1c 21 1 2024-09-13T21:44:36.329 INFO:tasks.workunit.client.0.smithi119.stdout:3/121: readlink d6/d25/l2b 0 2024-09-13T21:44:36.334 INFO:tasks.workunit.client.0.smithi119.stdout:8/148: write d1b/d1d/d26/f2f [52205,34325] 0 2024-09-13T21:44:36.335 INFO:tasks.workunit.client.0.smithi119.stdout:8/149: dread - d1b/d1d/f2d zero size 2024-09-13T21:44:36.336 INFO:tasks.workunit.client.0.smithi119.stdout:7/155: dread d8/f17 [4194304,4194304] 0 2024-09-13T21:44:36.337 INFO:tasks.workunit.client.0.smithi119.stdout:0/155: rename de/f13 to de/d3c/f3d 0 2024-09-13T21:44:36.338 INFO:tasks.workunit.client.0.smithi119.stdout:8/150: readlink l1a 0 2024-09-13T21:44:36.338 INFO:tasks.workunit.client.0.smithi119.stdout:3/122: dread d6/f1e [0,4194304] 0 2024-09-13T21:44:36.338 INFO:tasks.workunit.client.0.smithi119.stdout:4/140: dread d4/f8 [0,4194304] 0 2024-09-13T21:44:36.342 INFO:tasks.workunit.client.0.smithi119.stdout:7/156: dread - d8/d19/f35 zero size 2024-09-13T21:44:36.345 INFO:tasks.workunit.client.0.smithi119.stdout:4/141: readlink d4/d1e/l11 0 2024-09-13T21:44:36.347 INFO:tasks.workunit.client.0.smithi119.stdout:6/162: dwrite dc/dd/f1f [4194304,4194304] 0 2024-09-13T21:44:36.348 INFO:tasks.workunit.client.0.smithi119.stdout:7/157: unlink f5 0 2024-09-13T21:44:36.349 INFO:tasks.workunit.client.0.smithi119.stdout:0/156: creat de/f3e x:0 0 0 2024-09-13T21:44:36.350 INFO:tasks.workunit.client.0.smithi119.stdout:7/158: dread - d8/f31 zero size 2024-09-13T21:44:36.350 INFO:tasks.workunit.client.0.smithi119.stdout:8/151: mknod d1b/d1d/d26/d2a/c32 0 2024-09-13T21:44:36.356 INFO:tasks.workunit.client.0.smithi119.stdout:3/123: dwrite d6/fc [0,4194304] 0 2024-09-13T21:44:36.357 INFO:tasks.workunit.client.0.smithi119.stdout:0/157: symlink de/d1c/d2b/l3f 0 2024-09-13T21:44:36.361 INFO:tasks.workunit.client.0.smithi119.stdout:8/152: creat d1b/d1d/d26/f33 x:0 0 0 2024-09-13T21:44:36.367 INFO:tasks.workunit.client.0.smithi119.stdout:3/124: mkdir d6/d25/d2f 0 2024-09-13T21:44:36.369 INFO:tasks.workunit.client.0.smithi119.stdout:4/142: dwrite d4/d1e/d28/f2a [0,4194304] 0 2024-09-13T21:44:36.370 INFO:tasks.workunit.client.0.smithi119.stdout:3/125: read d6/f13 [2881270,122300] 0 2024-09-13T21:44:36.372 INFO:tasks.workunit.client.0.smithi119.stdout:8/153: mknod d1b/d1d/d26/d2a/c34 0 2024-09-13T21:44:36.372 INFO:tasks.workunit.client.0.smithi119.stdout:4/143: stat d4/d1e/d10 0 2024-09-13T21:44:36.375 INFO:tasks.workunit.client.0.smithi119.stdout:8/154: truncate f13 13560033 0 2024-09-13T21:44:36.375 INFO:tasks.workunit.client.0.smithi119.stdout:6/163: dwrite dc/df/f24 [0,4194304] 0 2024-09-13T21:44:36.376 INFO:tasks.workunit.client.0.smithi119.stdout:7/159: dwrite d8/d9/f11 [0,4194304] 0 2024-09-13T21:44:36.378 INFO:tasks.workunit.client.0.smithi119.stdout:0/158: write de/d1c/d2b/f30 [542276,101161] 0 2024-09-13T21:44:36.379 INFO:tasks.workunit.client.0.smithi119.stdout:3/126: write d6/d25/f2a [2075828,107180] 0 2024-09-13T21:44:36.379 INFO:tasks.workunit.client.0.smithi119.stdout:6/164: chown fa 0 1 2024-09-13T21:44:36.379 INFO:tasks.workunit.client.0.smithi119.stdout:4/144: dread d4/f8 [0,4194304] 0 2024-09-13T21:44:36.382 INFO:tasks.workunit.client.0.smithi119.stdout:6/165: write dc/df/f27 [25821,23281] 0 2024-09-13T21:44:36.383 INFO:tasks.workunit.client.0.smithi119.stdout:4/145: write d4/f21 [669459,83260] 0 2024-09-13T21:44:36.386 INFO:tasks.workunit.client.0.smithi119.stdout:7/160: mknod d8/d19/d22/c36 0 2024-09-13T21:44:36.387 INFO:tasks.workunit.client.0.smithi119.stdout:4/146: fsync d4/d1e/f17 0 2024-09-13T21:44:36.387 INFO:tasks.workunit.client.0.smithi119.stdout:1/169: sync 2024-09-13T21:44:36.387 INFO:tasks.workunit.client.0.smithi119.stdout:5/120: sync 2024-09-13T21:44:36.389 INFO:tasks.workunit.client.0.smithi119.stdout:0/159: mkdir de/d1c/d2f/d40 0 2024-09-13T21:44:36.389 INFO:tasks.workunit.client.0.smithi119.stdout:1/170: fdatasync d1/d3/f4 0 2024-09-13T21:44:36.389 INFO:tasks.workunit.client.0.smithi119.stdout:4/147: chown d4/f8 2491719 1 2024-09-13T21:44:36.392 INFO:tasks.workunit.client.0.smithi119.stdout:6/166: getdents dc/df 0 2024-09-13T21:44:36.393 INFO:tasks.workunit.client.0.smithi119.stdout:5/121: mkdir d0/d3/d4/d2e 0 2024-09-13T21:44:36.396 INFO:tasks.workunit.client.0.smithi119.stdout:8/155: rmdir d1b/d1d 39 2024-09-13T21:44:36.398 INFO:tasks.workunit.client.0.smithi119.stdout:7/161: dread f6 [0,4194304] 0 2024-09-13T21:44:36.398 INFO:tasks.workunit.client.0.smithi119.stdout:6/167: creat dc/dd/f2e x:0 0 0 2024-09-13T21:44:36.399 INFO:tasks.workunit.client.0.smithi119.stdout:5/122: write d0/d3/d4/fa [2393115,70218] 0 2024-09-13T21:44:36.400 INFO:tasks.workunit.client.0.smithi119.stdout:0/160: creat de/d1c/d2f/f41 x:0 0 0 2024-09-13T21:44:36.401 INFO:tasks.workunit.client.0.smithi119.stdout:6/168: stat l3 0 2024-09-13T21:44:36.403 INFO:tasks.workunit.client.0.smithi119.stdout:6/169: fdatasync dc/df/f1c 0 2024-09-13T21:44:36.403 INFO:tasks.workunit.client.0.smithi119.stdout:1/171: symlink d1/d3/dc/d24/d2f/d31/d32/d33/l35 0 2024-09-13T21:44:36.405 INFO:tasks.workunit.client.0.smithi119.stdout:0/161: stat de/d1c/c2a 0 2024-09-13T21:44:36.405 INFO:tasks.workunit.client.0.smithi119.stdout:4/148: dwrite d4/d1e/d10/f1a [0,4194304] 0 2024-09-13T21:44:36.405 INFO:tasks.workunit.client.0.smithi119.stdout:7/162: write d8/d9/fe [2506314,21492] 0 2024-09-13T21:44:36.406 INFO:tasks.workunit.client.0.smithi119.stdout:8/156: creat d1b/d1d/d26/d2a/f35 x:0 0 0 2024-09-13T21:44:36.408 INFO:tasks.workunit.client.0.smithi119.stdout:1/172: fsync d1/d3/f7 0 2024-09-13T21:44:36.411 INFO:tasks.workunit.client.0.smithi119.stdout:6/170: write dc/df/f27 [107610,4840] 0 2024-09-13T21:44:36.412 INFO:tasks.workunit.client.0.smithi119.stdout:4/149: rmdir d4/d1e/d10 39 2024-09-13T21:44:36.412 INFO:tasks.workunit.client.0.smithi119.stdout:7/163: write d8/d19/d22/f2b [124385,13236] 0 2024-09-13T21:44:36.412 INFO:tasks.workunit.client.0.smithi119.stdout:6/171: truncate fa 4621645 0 2024-09-13T21:44:36.416 INFO:tasks.workunit.client.0.smithi119.stdout:7/164: readlink d8/d19/d22/l23 0 2024-09-13T21:44:36.416 INFO:tasks.workunit.client.0.smithi119.stdout:6/172: stat dc/dd/fe 0 2024-09-13T21:44:36.418 INFO:tasks.workunit.client.0.smithi119.stdout:8/157: creat d1b/f36 x:0 0 0 2024-09-13T21:44:36.418 INFO:tasks.workunit.client.0.smithi119.stdout:1/173: rename d1/cd to d1/d3/dc/d24/d2f/d31/c36 0 2024-09-13T21:44:36.420 INFO:tasks.workunit.client.0.smithi119.stdout:8/158: stat d1b/d1d/d26/f33 0 2024-09-13T21:44:36.423 INFO:tasks.workunit.client.0.smithi119.stdout:0/162: dwrite de/d1c/f1d [0,4194304] 0 2024-09-13T21:44:36.424 INFO:tasks.workunit.client.0.smithi119.stdout:8/159: creat d1b/d1d/d26/d2a/f37 x:0 0 0 2024-09-13T21:44:36.427 INFO:tasks.workunit.client.0.smithi119.stdout:1/174: mkdir d1/d3/dc/d11/d19/d2d/d37 0 2024-09-13T21:44:36.430 INFO:tasks.workunit.client.0.smithi119.stdout:0/163: creat de/d3c/f42 x:0 0 0 2024-09-13T21:44:36.430 INFO:tasks.workunit.client.0.smithi119.stdout:0/164: chown l4 430828764 1 2024-09-13T21:44:36.431 INFO:tasks.workunit.client.0.smithi119.stdout:8/160: creat d1b/d1d/d26/d2a/f38 x:0 0 0 2024-09-13T21:44:36.432 INFO:tasks.workunit.client.0.smithi119.stdout:4/150: dread d4/d1e/ff [0,4194304] 0 2024-09-13T21:44:36.433 INFO:tasks.workunit.client.0.smithi119.stdout:6/173: truncate dc/dd/f20 1519357 0 2024-09-13T21:44:36.433 INFO:tasks.workunit.client.0.smithi119.stdout:4/151: truncate d4/f27 4962215 0 2024-09-13T21:44:36.435 INFO:tasks.workunit.client.0.smithi119.stdout:0/165: unlink l1 0 2024-09-13T21:44:36.437 INFO:tasks.workunit.client.0.smithi119.stdout:6/174: rename dc/dd/l2d to dc/dd/d22/l2f 0 2024-09-13T21:44:36.445 INFO:tasks.workunit.client.0.smithi119.stdout:6/175: dwrite dc/f14 [0,4194304] 0 2024-09-13T21:44:36.445 INFO:tasks.workunit.client.0.smithi119.stdout:1/175: write d1/f22 [745469,122419] 0 2024-09-13T21:44:36.447 INFO:tasks.workunit.client.0.smithi119.stdout:4/152: getdents d4/d1e/d26 0 2024-09-13T21:44:36.449 INFO:tasks.workunit.client.0.smithi119.stdout:8/161: getdents d1b/d1d/d26/d2a 0 2024-09-13T21:44:36.449 INFO:tasks.workunit.client.0.smithi119.stdout:0/166: creat de/d1c/d2f/f43 x:0 0 0 2024-09-13T21:44:36.450 INFO:tasks.workunit.client.0.smithi119.stdout:6/176: dread dc/df/f27 [0,4194304] 0 2024-09-13T21:44:36.450 INFO:tasks.workunit.client.0.smithi119.stdout:1/176: rmdir d1/d3/dc/d11/d28 39 2024-09-13T21:44:36.455 INFO:tasks.workunit.client.0.smithi119.stdout:0/167: creat de/d3c/f44 x:0 0 0 2024-09-13T21:44:36.456 INFO:tasks.workunit.client.0.smithi119.stdout:0/168: fdatasync de/f3e 0 2024-09-13T21:44:36.457 INFO:tasks.workunit.client.0.smithi119.stdout:6/177: dread dc/df/f1c [0,4194304] 0 2024-09-13T21:44:36.460 INFO:tasks.workunit.client.0.smithi119.stdout:1/177: symlink d1/d3/dc/d24/d2f/d31/l38 0 2024-09-13T21:44:36.461 INFO:tasks.workunit.client.0.smithi119.stdout:1/178: chown d1/d3/dc/d11/d19/d2d/d37 25271587 1 2024-09-13T21:44:36.463 INFO:tasks.workunit.client.0.smithi119.stdout:4/153: creat d4/f2b x:0 0 0 2024-09-13T21:44:36.463 INFO:tasks.workunit.client.0.smithi119.stdout:1/179: write d1/f22 [1377588,60255] 0 2024-09-13T21:44:36.464 INFO:tasks.workunit.client.0.smithi119.stdout:6/178: chown dc/dd/d22/l2f 2374592 1 2024-09-13T21:44:36.464 INFO:tasks.workunit.client.0.smithi119.stdout:4/154: truncate d4/f2b 628345 0 2024-09-13T21:44:36.465 INFO:tasks.workunit.client.0.smithi119.stdout:0/169: fsync de/d1c/f27 0 2024-09-13T21:44:36.466 INFO:tasks.workunit.client.0.smithi119.stdout:0/170: chown de/f10 128709681 1 2024-09-13T21:44:36.468 INFO:tasks.workunit.client.0.smithi119.stdout:8/162: truncate f9 628237 0 2024-09-13T21:44:36.470 INFO:tasks.workunit.client.0.smithi119.stdout:6/179: rename dc/dd/c10 to dc/dd/c30 0 2024-09-13T21:44:36.471 INFO:tasks.workunit.client.0.smithi119.stdout:0/171: dread de/d1c/f1d [0,4194304] 0 2024-09-13T21:44:36.475 INFO:tasks.workunit.client.0.smithi119.stdout:4/155: creat d4/d1e/d28/f2c x:0 0 0 2024-09-13T21:44:36.476 INFO:tasks.workunit.client.0.smithi119.stdout:8/163: chown c16 2084 1 2024-09-13T21:44:36.476 INFO:tasks.workunit.client.0.smithi119.stdout:6/180: creat dc/f31 x:0 0 0 2024-09-13T21:44:36.478 INFO:tasks.workunit.client.0.smithi119.stdout:8/164: write d1b/d1d/d26/d2a/f38 [96992,46874] 0 2024-09-13T21:44:36.481 INFO:tasks.workunit.client.0.smithi119.stdout:8/165: truncate d1b/f36 567963 0 2024-09-13T21:44:36.483 INFO:tasks.workunit.client.0.smithi119.stdout:6/181: rename dc/dd/d22 to dc/df/d32 0 2024-09-13T21:44:36.483 INFO:tasks.workunit.client.0.smithi119.stdout:1/180: dread d1/f1b [0,4194304] 0 2024-09-13T21:44:36.484 INFO:tasks.workunit.client.0.smithi119.stdout:8/166: mkdir d1b/d1d/d39 0 2024-09-13T21:44:36.489 INFO:tasks.workunit.client.0.smithi119.stdout:1/181: write d1/d3/dc/f1c [575355,43527] 0 2024-09-13T21:44:36.489 INFO:tasks.workunit.client.0.smithi119.stdout:4/156: dread d4/d1e/f20 [0,4194304] 0 2024-09-13T21:44:36.491 INFO:tasks.workunit.client.0.smithi119.stdout:4/157: readlink l1 0 2024-09-13T21:44:36.491 INFO:tasks.workunit.client.0.smithi119.stdout:6/182: dwrite dc/dd/f1f [4194304,4194304] 0 2024-09-13T21:44:36.491 INFO:tasks.workunit.client.0.smithi119.stdout:8/167: creat d1b/d1d/d39/f3a x:0 0 0 2024-09-13T21:44:36.497 INFO:tasks.workunit.client.0.smithi119.stdout:6/183: creat dc/f33 x:0 0 0 2024-09-13T21:44:36.498 INFO:tasks.workunit.client.0.smithi119.stdout:8/168: mknod d1b/d1d/c3b 0 2024-09-13T21:44:36.502 INFO:tasks.workunit.client.0.smithi119.stdout:6/184: mkdir dc/df/d34 0 2024-09-13T21:44:36.504 INFO:tasks.workunit.client.0.smithi119.stdout:8/169: mkdir d1b/d1d/d39/d3c 0 2024-09-13T21:44:36.505 INFO:tasks.workunit.client.0.smithi119.stdout:4/158: dwrite d4/f21 [0,4194304] 0 2024-09-13T21:44:36.506 INFO:tasks.workunit.client.0.smithi119.stdout:8/170: dread - d1b/d1d/d26/d2a/f37 zero size 2024-09-13T21:44:36.507 INFO:tasks.workunit.client.0.smithi119.stdout:4/159: fdatasync d4/d1e/f20 0 2024-09-13T21:44:36.509 INFO:tasks.workunit.client.0.smithi119.stdout:1/182: dwrite d1/f1b [0,4194304] 0 2024-09-13T21:44:36.511 INFO:tasks.workunit.client.0.smithi119.stdout:6/185: rename dc/f33 to dc/df/d32/f35 0 2024-09-13T21:44:36.515 INFO:tasks.workunit.client.0.smithi119.stdout:8/171: unlink c8 0 2024-09-13T21:44:36.516 INFO:tasks.workunit.client.0.smithi119.stdout:4/160: stat d4/d1e/d10/f1a 0 2024-09-13T21:44:36.523 INFO:tasks.workunit.client.0.smithi119.stdout:8/172: rename d1b/d1d/d39/f3a to d1b/d1d/d26/f3d 0 2024-09-13T21:44:36.525 INFO:tasks.workunit.client.0.smithi119.stdout:6/186: dwrite dc/dd/f2e [0,4194304] 0 2024-09-13T21:44:36.527 INFO:tasks.workunit.client.0.smithi119.stdout:4/161: dread d4/d1e/d28/f2a [0,4194304] 0 2024-09-13T21:44:36.527 INFO:tasks.workunit.client.0.smithi119.stdout:6/187: chown l5 0 1 2024-09-13T21:44:36.527 INFO:tasks.workunit.client.0.smithi119.stdout:1/183: rename d1/d3/dc/d11/d28/l2c to d1/d3/dc/d24/d2f/d31/l39 0 2024-09-13T21:44:36.528 INFO:tasks.workunit.client.0.smithi119.stdout:6/188: read dc/f1a [4065706,46449] 0 2024-09-13T21:44:36.528 INFO:tasks.workunit.client.0.smithi119.stdout:8/173: mkdir d1b/d1d/d26/d3e 0 2024-09-13T21:44:36.531 INFO:tasks.workunit.client.0.smithi119.stdout:6/189: truncate dc/df/f1d 810518 0 2024-09-13T21:44:36.531 INFO:tasks.workunit.client.0.smithi119.stdout:8/174: write d1b/d1d/d26/f2f [622010,58353] 0 2024-09-13T21:44:36.534 INFO:tasks.workunit.client.0.smithi119.stdout:6/190: read dc/df/f12 [185318,104304] 0 2024-09-13T21:44:36.536 INFO:tasks.workunit.client.0.smithi119.stdout:8/175: dread d1b/d1d/d26/d2a/f38 [0,4194304] 0 2024-09-13T21:44:36.538 INFO:tasks.workunit.client.0.smithi119.stdout:8/176: fsync d1b/d1d/d26/d2a/f38 0 2024-09-13T21:44:36.545 INFO:tasks.workunit.client.0.smithi119.stdout:6/191: dwrite dc/f1b [0,4194304] 0 2024-09-13T21:44:36.574 INFO:tasks.workunit.client.0.smithi119.stdout:8/177: symlink d1b/d1d/l3f 0 2024-09-13T21:44:36.576 INFO:tasks.workunit.client.0.smithi119.stdout:8/178: dread d1b/f36 [0,4194304] 0 2024-09-13T21:44:36.577 INFO:tasks.workunit.client.0.smithi119.stdout:4/162: creat d4/d1e/d26/f2d x:0 0 0 2024-09-13T21:44:36.578 INFO:tasks.workunit.client.0.smithi119.stdout:1/184: unlink d1/d3/dc/c1e 0 2024-09-13T21:44:36.586 INFO:tasks.workunit.client.0.smithi119.stdout:6/192: link dc/df/f12 dc/f36 0 2024-09-13T21:44:36.587 INFO:tasks.workunit.client.0.smithi119.stdout:8/179: symlink d1b/d1d/d39/l40 0 2024-09-13T21:44:36.589 INFO:tasks.workunit.client.0.smithi119.stdout:4/163: creat d4/d1e/d10/f2e x:0 0 0 2024-09-13T21:44:36.592 INFO:tasks.workunit.client.0.smithi119.stdout:6/193: mkdir dc/d37 0 2024-09-13T21:44:36.593 INFO:tasks.workunit.client.0.smithi119.stdout:4/164: dread d4/d1e/d28/f2a [0,4194304] 0 2024-09-13T21:44:36.594 INFO:tasks.workunit.client.0.smithi119.stdout:4/165: write d4/f2b [1002846,60792] 0 2024-09-13T21:44:36.595 INFO:tasks.workunit.client.0.smithi119.stdout:4/166: fdatasync d4/d1e/d28/f24 0 2024-09-13T21:44:36.597 INFO:tasks.workunit.client.0.smithi119.stdout:6/194: creat dc/dd/f38 x:0 0 0 2024-09-13T21:44:36.599 INFO:tasks.workunit.client.0.smithi119.stdout:6/195: write dc/f14 [215456,39664] 0 2024-09-13T21:44:36.600 INFO:tasks.workunit.client.0.smithi119.stdout:8/180: symlink d1b/d1d/d26/d3e/l41 0 2024-09-13T21:44:36.601 INFO:tasks.workunit.client.0.smithi119.stdout:8/181: fsync f15 0 2024-09-13T21:44:36.606 INFO:tasks.workunit.client.0.smithi119.stdout:6/196: symlink dc/l39 0 2024-09-13T21:44:36.609 INFO:tasks.workunit.client.0.smithi119.stdout:8/182: read d1b/d1d/d26/d2a/f38 [31722,102231] 0 2024-09-13T21:44:36.610 INFO:tasks.workunit.client.0.smithi119.stdout:1/185: link d1/d3/dc/d11/d19/d2d/c2e d1/d3/dc/c3a 0 2024-09-13T21:44:36.612 INFO:tasks.workunit.client.0.smithi119.stdout:6/197: mkdir dc/d3a 0 2024-09-13T21:44:36.616 INFO:tasks.workunit.client.0.smithi119.stdout:6/198: dread dc/f1b [0,4194304] 0 2024-09-13T21:44:36.616 INFO:tasks.workunit.client.0.smithi119.stdout:8/183: fsync d1b/f36 0 2024-09-13T21:44:36.617 INFO:tasks.workunit.client.0.smithi119.stdout:1/186: symlink d1/d3/dc/d24/d2f/d31/d32/d33/l3b 0 2024-09-13T21:44:36.621 INFO:tasks.workunit.client.0.smithi119.stdout:6/199: symlink dc/l3b 0 2024-09-13T21:44:36.623 INFO:tasks.workunit.client.0.smithi119.stdout:1/187: rmdir d1/d3/dc/d24/d2f 39 2024-09-13T21:44:36.630 INFO:tasks.workunit.client.0.smithi119.stdout:6/200: dread dc/dd/f20 [0,4194304] 0 2024-09-13T21:44:36.630 INFO:tasks.workunit.client.0.smithi119.stdout:8/184: link f18 d1b/f42 0 2024-09-13T21:44:36.631 INFO:tasks.workunit.client.0.smithi119.stdout:1/188: dwrite d1/f26 [0,4194304] 0 2024-09-13T21:44:36.636 INFO:tasks.workunit.client.0.smithi119.stdout:8/185: symlink d1b/d1d/l43 0 2024-09-13T21:44:36.643 INFO:tasks.workunit.client.0.smithi119.stdout:8/186: dread d1b/d1d/d26/f2f [0,4194304] 0 2024-09-13T21:44:36.645 INFO:tasks.workunit.client.0.smithi119.stdout:6/201: dwrite dc/f1b [0,4194304] 0 2024-09-13T21:44:36.645 INFO:tasks.workunit.client.0.smithi119.stdout:1/189: creat d1/d3/dc/d11/f3c x:0 0 0 2024-09-13T21:44:36.651 INFO:tasks.workunit.client.0.smithi119.stdout:6/202: creat dc/df/d34/f3c x:0 0 0 2024-09-13T21:44:36.654 INFO:tasks.workunit.client.0.smithi119.stdout:8/187: dwrite d1b/f27 [0,4194304] 0 2024-09-13T21:44:36.662 INFO:tasks.workunit.client.0.smithi119.stdout:8/188: rmdir d1b/d1d/d39/d3c 0 2024-09-13T21:44:36.662 INFO:tasks.workunit.client.0.smithi119.stdout:6/203: dwrite dc/f1e [0,4194304] 0 2024-09-13T21:44:36.668 INFO:tasks.workunit.client.0.smithi119.stdout:8/189: dread f15 [0,4194304] 0 2024-09-13T21:44:36.669 INFO:tasks.workunit.client.0.smithi119.stdout:6/204: mkdir dc/d3d 0 2024-09-13T21:44:36.671 INFO:tasks.workunit.client.0.smithi119.stdout:6/205: symlink dc/d3a/l3e 0 2024-09-13T21:44:36.675 INFO:tasks.workunit.client.0.smithi119.stdout:6/206: dread dc/f14 [0,4194304] 0 2024-09-13T21:44:36.679 INFO:tasks.workunit.client.0.smithi119.stdout:6/207: dread dc/df/f12 [0,4194304] 0 2024-09-13T21:44:36.682 INFO:tasks.workunit.client.0.smithi119.stdout:6/208: dread dc/df/f27 [0,4194304] 0 2024-09-13T21:44:36.683 INFO:tasks.workunit.client.0.smithi119.stdout:6/209: write dc/df/f1d [597757,22375] 0 2024-09-13T21:44:36.688 INFO:tasks.workunit.client.0.smithi119.stdout:6/210: rename dc/df/c2c to dc/c3f 0 2024-09-13T21:44:36.691 INFO:tasks.workunit.client.0.smithi119.stdout:6/211: mkdir dc/d3d/d40 0 2024-09-13T21:44:36.693 INFO:tasks.workunit.client.0.smithi119.stdout:4/167: link d4/d1e/f17 d4/f2f 0 2024-09-13T21:44:36.697 INFO:tasks.workunit.client.0.smithi119.stdout:6/212: dread dc/f1a [0,4194304] 0 2024-09-13T21:44:36.698 INFO:tasks.workunit.client.0.smithi119.stdout:4/168: read d4/d1e/f17 [403634,131024] 0 2024-09-13T21:44:36.699 INFO:tasks.workunit.client.0.smithi119.stdout:6/213: write dc/f1b [5238872,62863] 0 2024-09-13T21:44:36.700 INFO:tasks.workunit.client.0.smithi119.stdout:6/214: chown dc/dd/f38 2 1 2024-09-13T21:44:36.702 INFO:tasks.workunit.client.0.smithi119.stdout:4/169: readlink d4/d1e/lc 0 2024-09-13T21:44:36.704 INFO:tasks.workunit.client.0.smithi119.stdout:4/170: mknod d4/d1e/d10/c30 0 2024-09-13T21:44:36.706 INFO:tasks.workunit.client.0.smithi119.stdout:6/215: dread dc/dd/fe [0,4194304] 0 2024-09-13T21:44:36.792 INFO:tasks.workunit.client.0.smithi119.stdout:2/140: sync 2024-09-13T21:44:36.807 INFO:tasks.workunit.client.0.smithi119.stdout:9/153: sync 2024-09-13T21:44:36.808 INFO:tasks.workunit.client.0.smithi119.stdout:9/154: write d0/d19/f26 [821728,64932] 0 2024-09-13T21:44:36.812 INFO:tasks.workunit.client.0.smithi119.stdout:9/155: rename d0/d8/d18/d23/d27/f22 to d0/d8/d18/d23/d27/f32 0 2024-09-13T21:44:36.814 INFO:tasks.workunit.client.0.smithi119.stdout:9/156: creat d0/d19/d1a/f33 x:0 0 0 2024-09-13T21:44:36.820 INFO:tasks.workunit.client.0.smithi119.stdout:9/157: link d0/f14 d0/d8/d18/d23/f34 0 2024-09-13T21:44:37.017 INFO:tasks.workunit.client.0.smithi119.stdout:3/127: sync 2024-09-13T21:44:37.018 INFO:tasks.workunit.client.0.smithi119.stdout:3/128: dread d6/d15/f21 [0,4194304] 0 2024-09-13T21:44:37.021 INFO:tasks.workunit.client.0.smithi119.stdout:3/129: dread d6/ff [0,4194304] 0 2024-09-13T21:44:37.023 INFO:tasks.workunit.client.0.smithi119.stdout:3/130: creat d6/d15/f30 x:0 0 0 2024-09-13T21:44:37.023 INFO:tasks.workunit.client.0.smithi119.stdout:3/131: fsync d6/d25/f2a 0 2024-09-13T21:44:37.025 INFO:tasks.workunit.client.0.smithi119.stdout:3/132: mknod d6/d25/d2f/c31 0 2024-09-13T21:44:37.031 INFO:tasks.workunit.client.0.smithi119.stdout:3/133: dwrite d6/f16 [0,4194304] 0 2024-09-13T21:44:37.155 INFO:tasks.workunit.client.0.smithi119.stdout:7/165: sync 2024-09-13T21:44:37.156 INFO:tasks.workunit.client.0.smithi119.stdout:5/123: sync 2024-09-13T21:44:37.158 INFO:tasks.workunit.client.0.smithi119.stdout:7/166: mkdir d8/d19/d22/d37 0 2024-09-13T21:44:37.160 INFO:tasks.workunit.client.0.smithi119.stdout:5/124: write d0/d3/f11 [1100207,55817] 0 2024-09-13T21:44:37.162 INFO:tasks.workunit.client.0.smithi119.stdout:5/125: creat d0/d3/d4/d2e/f2f x:0 0 0 2024-09-13T21:44:37.167 INFO:tasks.workunit.client.0.smithi119.stdout:7/167: truncate d8/d9/fa 907466 0 2024-09-13T21:44:37.169 INFO:tasks.workunit.client.0.smithi119.stdout:7/168: getdents d8/d19/d22/d37 0 2024-09-13T21:44:37.170 INFO:tasks.workunit.client.0.smithi119.stdout:7/169: read - d8/f31 zero size 2024-09-13T21:44:37.172 INFO:tasks.workunit.client.0.smithi119.stdout:7/170: fdatasync d8/d19/f1c 0 2024-09-13T21:44:37.173 INFO:tasks.workunit.client.0.smithi119.stdout:5/126: dwrite d0/d3/d4/f5 [0,4194304] 0 2024-09-13T21:44:37.176 INFO:tasks.workunit.client.0.smithi119.stdout:7/171: rename d8/d9/l18 to d8/d19/d2e/l38 0 2024-09-13T21:44:37.178 INFO:tasks.workunit.client.0.smithi119.stdout:5/127: dread d0/d3/f11 [0,4194304] 0 2024-09-13T21:44:37.179 INFO:tasks.workunit.client.0.smithi119.stdout:7/172: rename d8/d19/d22/l23 to d8/d9/l39 0 2024-09-13T21:44:37.180 INFO:tasks.workunit.client.0.smithi119.stdout:5/128: creat d0/d3/d1f/f30 x:0 0 0 2024-09-13T21:44:37.181 INFO:tasks.workunit.client.0.smithi119.stdout:5/129: write d0/d3/fc [910690,74076] 0 2024-09-13T21:44:37.182 INFO:tasks.workunit.client.0.smithi119.stdout:8/190: sync 2024-09-13T21:44:37.182 INFO:tasks.workunit.client.0.smithi119.stdout:2/141: sync 2024-09-13T21:44:37.183 INFO:tasks.workunit.client.0.smithi119.stdout:1/190: sync 2024-09-13T21:44:37.183 INFO:tasks.workunit.client.0.smithi119.stdout:3/134: sync 2024-09-13T21:44:37.183 INFO:tasks.workunit.client.0.smithi119.stdout:9/158: sync 2024-09-13T21:44:37.183 INFO:tasks.workunit.client.0.smithi119.stdout:4/171: sync 2024-09-13T21:44:37.183 INFO:tasks.workunit.client.0.smithi119.stdout:0/172: sync 2024-09-13T21:44:37.183 INFO:tasks.workunit.client.0.smithi119.stdout:6/216: sync 2024-09-13T21:44:37.183 INFO:tasks.workunit.client.0.smithi119.stdout:1/191: fsync d1/f22 0 2024-09-13T21:44:37.184 INFO:tasks.workunit.client.0.smithi119.stdout:2/142: chown d1/f6 1 1 2024-09-13T21:44:37.184 INFO:tasks.workunit.client.0.smithi119.stdout:4/172: readlink d4/d1e/lc 0 2024-09-13T21:44:37.185 INFO:tasks.workunit.client.0.smithi119.stdout:0/173: chown de/d1c/d2f/f43 5469 1 2024-09-13T21:44:37.186 INFO:tasks.workunit.client.0.smithi119.stdout:3/135: mknod d6/d15/c32 0 2024-09-13T21:44:37.188 INFO:tasks.workunit.client.0.smithi119.stdout:4/173: dread d4/d1e/d10/f1a [0,4194304] 0 2024-09-13T21:44:37.189 INFO:tasks.workunit.client.0.smithi119.stdout:5/130: link d0/d3/f15 d0/d3/d4/d9/d14/d24/f31 0 2024-09-13T21:44:37.190 INFO:tasks.workunit.client.0.smithi119.stdout:5/131: write d0/d3/d4/d2e/f2f [366543,114762] 0 2024-09-13T21:44:37.191 INFO:tasks.workunit.client.0.smithi119.stdout:3/136: mkdir d6/d25/d2f/d33 0 2024-09-13T21:44:37.194 INFO:tasks.workunit.client.0.smithi119.stdout:8/191: dread - d1b/d1d/d26/d2a/f37 zero size 2024-09-13T21:44:37.194 INFO:tasks.workunit.client.0.smithi119.stdout:3/137: dread d6/f2d [0,4194304] 0 2024-09-13T21:44:37.195 INFO:tasks.workunit.client.0.smithi119.stdout:1/192: mkdir d1/d3/dc/d11/d3d 0 2024-09-13T21:44:37.196 INFO:tasks.workunit.client.0.smithi119.stdout:8/192: dread - d1b/d1d/f2d zero size 2024-09-13T21:44:37.197 INFO:tasks.workunit.client.0.smithi119.stdout:6/217: mkdir dc/df/d41 0 2024-09-13T21:44:37.198 INFO:tasks.workunit.client.0.smithi119.stdout:1/193: write d1/d3/f7 [4180,44366] 0 2024-09-13T21:44:37.198 INFO:tasks.workunit.client.0.smithi119.stdout:5/132: dread d0/d3/f15 [0,4194304] 0 2024-09-13T21:44:37.199 INFO:tasks.workunit.client.0.smithi119.stdout:1/194: fdatasync d1/f1b 0 2024-09-13T21:44:37.200 INFO:tasks.workunit.client.0.smithi119.stdout:6/218: fsync dc/f1b 0 2024-09-13T21:44:37.201 INFO:tasks.workunit.client.0.smithi119.stdout:0/174: link de/d1c/d2b/f32 de/d1c/d2f/d35/f45 0 2024-09-13T21:44:37.202 INFO:tasks.workunit.client.0.smithi119.stdout:0/175: stat de/d1c/l33 0 2024-09-13T21:44:37.202 INFO:tasks.workunit.client.0.smithi119.stdout:7/173: write d8/d9/f12 [1114859,47665] 0 2024-09-13T21:44:37.204 INFO:tasks.workunit.client.0.smithi119.stdout:3/138: rename d6/d15/f2e to d6/d15/f34 0 2024-09-13T21:44:37.210 INFO:tasks.workunit.client.0.smithi119.stdout:5/133: creat d0/d3/d4/d2e/f32 x:0 0 0 2024-09-13T21:44:37.212 INFO:tasks.workunit.client.0.smithi119.stdout:7/174: dwrite d8/d19/f1c [0,4194304] 0 2024-09-13T21:44:37.213 INFO:tasks.workunit.client.0.smithi119.stdout:5/134: dread - d0/d3/d4/d9/f10 zero size 2024-09-13T21:44:37.216 INFO:tasks.workunit.client.0.smithi119.stdout:0/176: unlink de/d1c/f31 0 2024-09-13T21:44:37.216 INFO:tasks.workunit.client.0.smithi119.stdout:5/135: fdatasync d0/d3/d1f/f30 0 2024-09-13T21:44:37.216 INFO:tasks.workunit.client.0.smithi119.stdout:7/175: write d8/f21 [217483,49821] 0 2024-09-13T21:44:37.216 INFO:tasks.workunit.client.0.smithi119.stdout:9/159: truncate d0/d8/d18/d23/f34 1997389 0 2024-09-13T21:44:37.216 INFO:tasks.workunit.client.0.smithi119.stdout:8/193: dwrite d1b/d1d/d26/f2f [0,4194304] 0 2024-09-13T21:44:37.218 INFO:tasks.workunit.client.0.smithi119.stdout:4/174: write d4/f2f [1867948,116770] 0 2024-09-13T21:44:37.221 INFO:tasks.workunit.client.0.smithi119.stdout:5/136: dread - d0/d3/d4/d9/d14/f29 zero size 2024-09-13T21:44:37.222 INFO:tasks.workunit.client.0.smithi119.stdout:0/177: write de/d1c/d2f/f43 [276135,124545] 0 2024-09-13T21:44:37.225 INFO:tasks.workunit.client.0.smithi119.stdout:6/219: write dc/f36 [1422928,48228] 0 2024-09-13T21:44:37.225 INFO:tasks.workunit.client.0.smithi119.stdout:0/178: chown de/f1b 59900 1 2024-09-13T21:44:37.227 INFO:tasks.workunit.client.0.smithi119.stdout:5/137: dread d0/d3/f1a [0,4194304] 0 2024-09-13T21:44:37.227 INFO:tasks.workunit.client.0.smithi119.stdout:0/179: chown de/f10 2 1 2024-09-13T21:44:37.229 INFO:tasks.workunit.client.0.smithi119.stdout:8/194: creat d1b/d1d/d39/f44 x:0 0 0 2024-09-13T21:44:37.231 INFO:tasks.workunit.client.0.smithi119.stdout:8/195: chown d1b/d1d/d26/f30 448960687 1 2024-09-13T21:44:37.232 INFO:tasks.workunit.client.0.smithi119.stdout:4/175: symlink d4/l31 0 2024-09-13T21:44:37.232 INFO:tasks.workunit.client.0.smithi119.stdout:7/176: creat d8/d19/d2e/d34/f3a x:0 0 0 2024-09-13T21:44:37.233 INFO:tasks.workunit.client.0.smithi119.stdout:9/160: dwrite d0/d19/d1a/f1f [4194304,4194304] 0 2024-09-13T21:44:37.235 INFO:tasks.workunit.client.0.smithi119.stdout:7/177: dread - d8/d9/f32 zero size 2024-09-13T21:44:37.237 INFO:tasks.workunit.client.0.smithi119.stdout:5/138: mknod d0/d3/d4/c33 0 2024-09-13T21:44:37.237 INFO:tasks.workunit.client.0.smithi119.stdout:7/178: chown d8/d19/d22 24176 1 2024-09-13T21:44:37.238 INFO:tasks.workunit.client.0.smithi119.stdout:4/176: creat d4/d1e/d26/f32 x:0 0 0 2024-09-13T21:44:37.240 INFO:tasks.workunit.client.0.smithi119.stdout:8/196: rename d1b/d1d/l3f to d1b/d1d/l45 0 2024-09-13T21:44:37.243 INFO:tasks.workunit.client.0.smithi119.stdout:0/180: link la de/d1c/l46 0 2024-09-13T21:44:37.244 INFO:tasks.workunit.client.0.smithi119.stdout:2/143: truncate d1/d7/f9 4111699 0 2024-09-13T21:44:37.244 INFO:tasks.workunit.client.0.smithi119.stdout:6/220: dwrite dc/dd/fe [0,4194304] 0 2024-09-13T21:44:37.245 INFO:tasks.workunit.client.0.smithi119.stdout:9/161: dread d0/d19/f26 [0,4194304] 0 2024-09-13T21:44:37.246 INFO:tasks.workunit.client.0.smithi119.stdout:0/181: chown de/d1c/c2a 58183 1 2024-09-13T21:44:37.246 INFO:tasks.workunit.client.0.smithi119.stdout:7/179: mkdir d8/d19/d22/d3b 0 2024-09-13T21:44:37.248 INFO:tasks.workunit.client.0.smithi119.stdout:7/180: truncate d8/f31 845336 0 2024-09-13T21:44:37.249 INFO:tasks.workunit.client.0.smithi119.stdout:4/177: rmdir d4/d1e/d28 39 2024-09-13T21:44:37.250 INFO:tasks.workunit.client.0.smithi119.stdout:0/182: dread - de/d3c/f42 zero size 2024-09-13T21:44:37.251 INFO:tasks.workunit.client.0.smithi119.stdout:2/144: dread d1/d7/fd [0,4194304] 0 2024-09-13T21:44:37.251 INFO:tasks.workunit.client.0.smithi119.stdout:5/139: dread d0/d3/d4/fa [0,4194304] 0 2024-09-13T21:44:37.252 INFO:tasks.workunit.client.0.smithi119.stdout:3/139: truncate d6/f18 1018758 0 2024-09-13T21:44:37.253 INFO:tasks.workunit.client.0.smithi119.stdout:6/221: symlink dc/df/d32/l42 0 2024-09-13T21:44:37.254 INFO:tasks.workunit.client.0.smithi119.stdout:5/140: truncate d0/d3/f12 4787963 0 2024-09-13T21:44:37.255 INFO:tasks.workunit.client.0.smithi119.stdout:7/181: mkdir d8/d3c 0 2024-09-13T21:44:37.257 INFO:tasks.workunit.client.0.smithi119.stdout:2/145: symlink d1/d22/l26 0 2024-09-13T21:44:37.258 INFO:tasks.workunit.client.0.smithi119.stdout:7/182: dread - d8/d19/f1a zero size 2024-09-13T21:44:37.258 INFO:tasks.workunit.client.0.smithi119.stdout:3/140: creat d6/d15/f35 x:0 0 0 2024-09-13T21:44:37.260 INFO:tasks.workunit.client.0.smithi119.stdout:3/141: chown d6/d15/d1a/l20 400 1 2024-09-13T21:44:37.260 INFO:tasks.workunit.client.0.smithi119.stdout:5/141: creat d0/d3/d1f/d21/f34 x:0 0 0 2024-09-13T21:44:37.261 INFO:tasks.workunit.client.0.smithi119.stdout:4/178: creat d4/d1e/f33 x:0 0 0 2024-09-13T21:44:37.262 INFO:tasks.workunit.client.0.smithi119.stdout:0/183: creat de/d1c/d2f/f47 x:0 0 0 2024-09-13T21:44:37.262 INFO:tasks.workunit.client.0.smithi119.stdout:2/146: creat d1/d22/f27 x:0 0 0 2024-09-13T21:44:37.263 INFO:tasks.workunit.client.0.smithi119.stdout:5/142: chown d0/d3/ce 17433 1 2024-09-13T21:44:37.265 INFO:tasks.workunit.client.0.smithi119.stdout:6/222: dwrite dc/f1b [0,4194304] 0 2024-09-13T21:44:37.266 INFO:tasks.workunit.client.0.smithi119.stdout:2/147: write d1/d7/f23 [538372,82580] 0 2024-09-13T21:44:37.268 INFO:tasks.workunit.client.0.smithi119.stdout:6/223: readlink dc/l2b 0 2024-09-13T21:44:37.268 INFO:tasks.workunit.client.0.smithi119.stdout:0/184: symlink de/d1c/l48 0 2024-09-13T21:44:37.268 INFO:tasks.workunit.client.0.smithi119.stdout:9/162: dread d0/f14 [0,4194304] 0 2024-09-13T21:44:37.268 INFO:tasks.workunit.client.0.smithi119.stdout:2/148: dread - d1/d22/f27 zero size 2024-09-13T21:44:37.269 INFO:tasks.workunit.client.0.smithi119.stdout:4/179: mkdir d4/d1e/d28/d34 0 2024-09-13T21:44:37.270 INFO:tasks.workunit.client.0.smithi119.stdout:4/180: chown d4/f2f 12915 1 2024-09-13T21:44:37.270 INFO:tasks.workunit.client.0.smithi119.stdout:5/143: symlink d0/d3/d4/d2e/l35 0 2024-09-13T21:44:37.273 INFO:tasks.workunit.client.0.smithi119.stdout:6/224: unlink l3 0 2024-09-13T21:44:37.279 INFO:tasks.workunit.client.0.smithi119.stdout:5/144: rmdir d0/d3/d4/d9 39 2024-09-13T21:44:37.279 INFO:tasks.workunit.client.0.smithi119.stdout:6/225: dread dc/df/f24 [0,4194304] 0 2024-09-13T21:44:37.280 INFO:tasks.workunit.client.0.smithi119.stdout:6/226: chown dc/d3d/d40 10 1 2024-09-13T21:44:37.281 INFO:tasks.workunit.client.0.smithi119.stdout:6/227: fdatasync dc/dd/f1f 0 2024-09-13T21:44:37.281 INFO:tasks.workunit.client.0.smithi119.stdout:0/185: mkdir de/d49 0 2024-09-13T21:44:37.283 INFO:tasks.workunit.client.0.smithi119.stdout:9/163: symlink d0/d19/d1a/d2b/l35 0 2024-09-13T21:44:37.284 INFO:tasks.workunit.client.0.smithi119.stdout:3/142: getdents d6/d25 0 2024-09-13T21:44:37.284 INFO:tasks.workunit.client.0.smithi119.stdout:5/145: truncate d0/d3/d4/d2e/f32 253655 0 2024-09-13T21:44:37.285 INFO:tasks.workunit.client.0.smithi119.stdout:5/146: fsync d0/d3/d1f/f30 0 2024-09-13T21:44:37.288 INFO:tasks.workunit.client.0.smithi119.stdout:8/197: truncate d1b/f27 384614 0 2024-09-13T21:44:37.288 INFO:tasks.workunit.client.0.smithi119.stdout:6/228: fsync dc/df/d32/f35 0 2024-09-13T21:44:37.289 INFO:tasks.workunit.client.0.smithi119.stdout:0/186: mkdir de/d1c/d2f/d35/d4a 0 2024-09-13T21:44:37.290 INFO:tasks.workunit.client.0.smithi119.stdout:6/229: dread dc/df/f27 [0,4194304] 0 2024-09-13T21:44:37.290 INFO:tasks.workunit.client.0.smithi119.stdout:4/181: link d4/d1e/d10/c30 d4/d1e/d28/c35 0 2024-09-13T21:44:37.290 INFO:tasks.workunit.client.0.smithi119.stdout:0/187: chown de/d1c/d2f/d40 1 1 2024-09-13T21:44:37.291 INFO:tasks.workunit.client.0.smithi119.stdout:3/143: mknod d6/d25/d2f/c36 0 2024-09-13T21:44:37.293 INFO:tasks.workunit.client.0.smithi119.stdout:2/149: link d1/d7/cc d1/c28 0 2024-09-13T21:44:37.294 INFO:tasks.workunit.client.0.smithi119.stdout:3/144: fdatasync d6/d25/f2a 0 2024-09-13T21:44:37.295 INFO:tasks.workunit.client.0.smithi119.stdout:0/188: truncate de/d1c/d2b/d34/f3a 354242 0 2024-09-13T21:44:37.295 INFO:tasks.workunit.client.0.smithi119.stdout:2/150: readlink d1/d22/l21 0 2024-09-13T21:44:37.297 INFO:tasks.workunit.client.0.smithi119.stdout:0/189: dread - de/d3c/f44 zero size 2024-09-13T21:44:37.300 INFO:tasks.workunit.client.0.smithi119.stdout:0/190: read de/f10 [1848669,92637] 0 2024-09-13T21:44:37.301 INFO:tasks.workunit.client.0.smithi119.stdout:2/151: fdatasync d1/d7/fd 0 2024-09-13T21:44:37.302 INFO:tasks.workunit.client.0.smithi119.stdout:4/182: dwrite d4/f21 [0,4194304] 0 2024-09-13T21:44:37.302 INFO:tasks.workunit.client.0.smithi119.stdout:0/191: chown de/c3b 544400 1 2024-09-13T21:44:37.303 INFO:tasks.workunit.client.0.smithi119.stdout:0/192: dread - de/d3c/f42 zero size 2024-09-13T21:44:37.304 INFO:tasks.workunit.client.0.smithi119.stdout:4/183: stat d4/d1e/d28/f2a 0 2024-09-13T21:44:37.305 INFO:tasks.workunit.client.0.smithi119.stdout:5/147: creat d0/d3/d4/d9/d14/d24/d25/f36 x:0 0 0 2024-09-13T21:44:37.307 INFO:tasks.workunit.client.0.smithi119.stdout:8/198: creat d1b/f46 x:0 0 0 2024-09-13T21:44:37.310 INFO:tasks.workunit.client.0.smithi119.stdout:0/193: read de/d1c/d2b/f30 [2256692,32003] 0 2024-09-13T21:44:37.311 INFO:tasks.workunit.client.0.smithi119.stdout:2/152: mknod d1/d22/c29 0 2024-09-13T21:44:37.313 INFO:tasks.workunit.client.0.smithi119.stdout:2/153: dread d1/d7/fd [0,4194304] 0 2024-09-13T21:44:37.315 INFO:tasks.workunit.client.0.smithi119.stdout:5/148: symlink d0/d3/d4/d9/d14/l37 0 2024-09-13T21:44:37.317 INFO:tasks.workunit.client.0.smithi119.stdout:8/199: dread f18 [0,4194304] 0 2024-09-13T21:44:37.318 INFO:tasks.workunit.client.0.smithi119.stdout:6/230: getdents dc/df 0 2024-09-13T21:44:37.318 INFO:tasks.workunit.client.0.smithi119.stdout:8/200: fsync f13 0 2024-09-13T21:44:37.319 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: pgmap v245: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 585 KiB/s rd, 17 MiB/s wr, 495 op/s 2024-09-13T21:44:37.319 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:37.319 INFO:tasks.workunit.client.0.smithi119.stdout:6/231: truncate dc/df/f1d 1792296 0 2024-09-13T21:44:37.324 INFO:tasks.workunit.client.0.smithi119.stdout:0/194: symlink de/d1c/d2f/l4b 0 2024-09-13T21:44:37.325 INFO:tasks.workunit.client.0.smithi119.stdout:6/232: rename dc/df/d32/l2f to dc/df/d32/l43 0 2024-09-13T21:44:37.325 INFO:tasks.workunit.client.0.smithi119.stdout:6/233: chown dc/df/d32 27334934 1 2024-09-13T21:44:37.326 INFO:tasks.workunit.client.0.smithi119.stdout:4/184: rename d4/d1e/d10/f2e to d4/d1e/f36 0 2024-09-13T21:44:37.327 INFO:tasks.workunit.client.0.smithi119.stdout:4/185: write d4/f21 [144550,59177] 0 2024-09-13T21:44:37.328 INFO:tasks.workunit.client.0.smithi119.stdout:8/201: truncate f9 1068053 0 2024-09-13T21:44:37.332 INFO:tasks.workunit.client.0.smithi119.stdout:5/149: rename d0/d3/d4/d9/d14/d24/f2d to d0/d3/d4/d9/d1e/f38 0 2024-09-13T21:44:37.333 INFO:tasks.workunit.client.0.smithi119.stdout:2/154: truncate d1/d7/fd 1576582 0 2024-09-13T21:44:37.333 INFO:tasks.workunit.client.0.smithi119.stdout:5/150: chown d0/d3/f1a 6108 1 2024-09-13T21:44:37.334 INFO:tasks.workunit.client.0.smithi119.stdout:2/155: readlink d1/d22/l26 0 2024-09-13T21:44:37.336 INFO:tasks.workunit.client.0.smithi119.stdout:2/156: fdatasync d1/d7/f23 0 2024-09-13T21:44:37.336 INFO:tasks.workunit.client.0.smithi119.stdout:4/186: dwrite d4/d1e/d26/f2d [0,4194304] 0 2024-09-13T21:44:37.341 INFO:tasks.workunit.client.0.smithi119.stdout:8/202: creat d1b/f47 x:0 0 0 2024-09-13T21:44:37.341 INFO:tasks.workunit.client.0.smithi119.stdout:5/151: dread d0/d3/d4/f5 [0,4194304] 0 2024-09-13T21:44:37.342 INFO:tasks.workunit.client.0.smithi119.stdout:4/187: write d4/d1e/d28/f2a [975183,78504] 0 2024-09-13T21:44:37.343 INFO:tasks.workunit.client.0.smithi119.stdout:2/157: creat d1/d7/f2a x:0 0 0 2024-09-13T21:44:37.344 INFO:tasks.workunit.client.0.smithi119.stdout:8/203: chown d1b/d1d/d26/d3e/l41 4 1 2024-09-13T21:44:37.348 INFO:tasks.workunit.client.0.smithi119.stdout:4/188: write d4/d1e/f36 [709085,71484] 0 2024-09-13T21:44:37.350 INFO:tasks.workunit.client.0.smithi119.stdout:8/204: mkdir d1b/d1d/d48 0 2024-09-13T21:44:37.351 INFO:tasks.workunit.client.0.smithi119.stdout:2/158: mkdir d1/d2b 0 2024-09-13T21:44:37.351 INFO:tasks.workunit.client.0.smithi119.stdout:4/189: read d4/d1e/ff [74281,114200] 0 2024-09-13T21:44:37.353 INFO:tasks.workunit.client.0.smithi119.stdout:8/205: truncate d1b/f20 1575109 0 2024-09-13T21:44:37.353 INFO:tasks.workunit.client.0.smithi119.stdout:3/145: write d6/f14 [37970,63638] 0 2024-09-13T21:44:37.353 INFO:tasks.workunit.client.0.smithi119.stdout:4/190: readlink d4/l23 0 2024-09-13T21:44:37.354 INFO:tasks.workunit.client.0.smithi119.stdout:0/195: dwrite de/d1c/f1d [4194304,4194304] 0 2024-09-13T21:44:37.354 INFO:tasks.workunit.client.0.smithi119.stdout:8/206: stat fd 0 2024-09-13T21:44:37.355 INFO:tasks.workunit.client.0.smithi119.stdout:3/146: readlink d6/le 0 2024-09-13T21:44:37.356 INFO:tasks.workunit.client.0.smithi119.stdout:2/159: chown d1/d7/cc 163407 1 2024-09-13T21:44:37.357 INFO:tasks.workunit.client.0.smithi119.stdout:0/196: write de/d1c/f29 [2060964,102946] 0 2024-09-13T21:44:37.358 INFO:tasks.workunit.client.0.smithi119.stdout:8/207: chown d1b/f20 741795 1 2024-09-13T21:44:37.358 INFO:tasks.workunit.client.0.smithi119.stdout:8/208: chown l1a 31 1 2024-09-13T21:44:37.359 INFO:tasks.workunit.client.0.smithi119.stdout:3/147: fdatasync d6/d15/f21 0 2024-09-13T21:44:37.361 INFO:tasks.workunit.client.0.smithi119.stdout:2/160: fsync d1/d22/f1c 0 2024-09-13T21:44:37.364 INFO:tasks.workunit.client.0.smithi119.stdout:4/191: link d4/c1b d4/d1e/d28/c37 0 2024-09-13T21:44:37.364 INFO:tasks.workunit.client.0.smithi119.stdout:3/148: mknod d6/d25/d2f/c37 0 2024-09-13T21:44:37.365 INFO:tasks.workunit.client.0.smithi119.stdout:4/192: write d4/d1e/f17 [4497158,17357] 0 2024-09-13T21:44:37.366 INFO:tasks.workunit.client.0.smithi119.stdout:0/197: creat de/d49/f4c x:0 0 0 2024-09-13T21:44:37.366 INFO:tasks.workunit.client.0.smithi119.stdout:3/149: dread - d6/d15/f35 zero size 2024-09-13T21:44:37.367 INFO:tasks.workunit.client.0.smithi119.stdout:8/209: creat d1b/d1d/d48/f49 x:0 0 0 2024-09-13T21:44:37.368 INFO:tasks.workunit.client.0.smithi119.stdout:8/210: readlink d1b/l22 0 2024-09-13T21:44:37.371 INFO:tasks.workunit.client.0.smithi119.stdout:0/198: rmdir de/d1c 39 2024-09-13T21:44:37.376 INFO:tasks.workunit.client.0.smithi119.stdout:4/193: creat d4/f38 x:0 0 0 2024-09-13T21:44:37.377 INFO:tasks.workunit.client.0.smithi119.stdout:4/194: readlink d4/l31 0 2024-09-13T21:44:37.378 INFO:tasks.workunit.client.0.smithi119.stdout:2/161: dwrite d1/d22/f1c [0,4194304] 0 2024-09-13T21:44:37.378 INFO:tasks.workunit.client.0.smithi119.stdout:4/195: dread - d4/d1e/d28/f24 zero size 2024-09-13T21:44:37.380 INFO:tasks.workunit.client.0.smithi119.stdout:5/152: dread d0/fd [4194304,4194304] 0 2024-09-13T21:44:37.381 INFO:tasks.workunit.client.0.smithi119.stdout:3/150: truncate d6/f11 4682960 0 2024-09-13T21:44:37.383 INFO:tasks.workunit.client.0.smithi119.stdout:8/211: creat d1b/f4a x:0 0 0 2024-09-13T21:44:37.384 INFO:tasks.workunit.client.0.smithi119.stdout:3/151: mkdir d6/d25/d2f/d38 0 2024-09-13T21:44:37.385 INFO:tasks.workunit.client.0.smithi119.stdout:5/153: symlink d0/d3/d4/d9/l39 0 2024-09-13T21:44:37.387 INFO:tasks.workunit.client.0.smithi119.stdout:8/212: dread - d1b/d1d/d26/f33 zero size 2024-09-13T21:44:37.387 INFO:tasks.workunit.client.0.smithi119.stdout:0/199: getdents de 0 2024-09-13T21:44:37.387 INFO:tasks.workunit.client.0.smithi119.stdout:2/162: mkdir d1/d2b/d2c 0 2024-09-13T21:44:37.391 INFO:tasks.workunit.client.0.smithi119.stdout:3/152: write d6/fc [2751619,98892] 0 2024-09-13T21:44:37.392 INFO:tasks.workunit.client.0.smithi119.stdout:8/213: creat d1b/d1d/f4b x:0 0 0 2024-09-13T21:44:37.394 INFO:tasks.workunit.client.0.smithi119.stdout:4/196: getdents d4/d1e/d28 0 2024-09-13T21:44:37.394 INFO:tasks.workunit.client.0.smithi119.stdout:0/200: mknod de/d1c/d2b/c4d 0 2024-09-13T21:44:37.396 INFO:tasks.workunit.client.0.smithi119.stdout:5/154: dwrite d0/d3/d1f/f30 [0,4194304] 0 2024-09-13T21:44:37.403 INFO:tasks.workunit.client.0.smithi119.stdout:0/201: dwrite de/d1c/f36 [0,4194304] 0 2024-09-13T21:44:37.455 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: pgmap v245: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 585 KiB/s rd, 17 MiB/s wr, 495 op/s 2024-09-13T21:44:37.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:37.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:37.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:37.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:44:37.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:37.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:37.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr fail", "who": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:44:37.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: Activating manager daemon smithi155.wuuxfd 2024-09-13T21:44:37.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:44:37.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mgr metadata", "who": "smithi155.wuuxfd", "id": "smithi155.wuuxfd"}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T21:44:37.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "mgr fail", "who": "smithi119.gwjxmq"}]': finished 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: mgrmap e21: smithi155.wuuxfd(active, starting, since 0.0145579s) 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: Manager daemon smithi155.wuuxfd is now available 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.wuuxfd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.wuuxfd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:44:37.458 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.wuuxfd/trash_purge_schedule"}]: dispatch 2024-09-13T21:44:37.459 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:37 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.wuuxfd/trash_purge_schedule"}]: dispatch 2024-09-13T21:44:37.495 INFO:tasks.workunit.client.0.smithi119.stdout:3/153: creat d6/d25/d2f/f39 x:0 0 0 2024-09-13T21:44:37.497 INFO:tasks.workunit.client.0.smithi119.stdout:8/214: unlink d1b/d1d/f4b 0 2024-09-13T21:44:37.499 INFO:tasks.workunit.client.0.smithi119.stdout:8/215: dread - d1b/d1d/d26/d2a/f37 zero size 2024-09-13T21:44:37.502 INFO:tasks.workunit.client.0.smithi119.stdout:5/155: chown d0/l2 0 1 2024-09-13T21:44:37.502 INFO:tasks.workunit.client.0.smithi119.stdout:3/154: dread d6/f13 [0,4194304] 0 2024-09-13T21:44:37.506 INFO:tasks.workunit.client.0.smithi119.stdout:2/163: dwrite d1/d7/f11 [4194304,4194304] 0 2024-09-13T21:44:37.508 INFO:tasks.workunit.client.0.smithi119.stdout:4/197: dwrite d4/d1e/ff [0,4194304] 0 2024-09-13T21:44:37.516 INFO:tasks.workunit.client.0.smithi119.stdout:4/198: dwrite d4/d1e/d28/f25 [0,4194304] 0 2024-09-13T21:44:37.560 INFO:tasks.workunit.client.0.smithi119.stdout:1/195: sync 2024-09-13T21:44:37.578 INFO:tasks.workunit.client.0.smithi119.stdout:8/216: rename d1b/d1d/d26/d2a/f35 to d1b/d1d/d26/d3e/f4c 0 2024-09-13T21:44:37.578 INFO:tasks.workunit.client.0.smithi119.stdout:3/155: creat d6/d15/d1a/f3a x:0 0 0 2024-09-13T21:44:37.579 INFO:tasks.workunit.client.0.smithi119.stdout:3/156: chown d6/f1c 0 1 2024-09-13T21:44:37.580 INFO:tasks.workunit.client.0.smithi119.stdout:2/164: creat d1/d22/f2d x:0 0 0 2024-09-13T21:44:37.581 INFO:tasks.workunit.client.0.smithi119.stdout:3/157: chown d6/d25/d2f/d33 89688868 1 2024-09-13T21:44:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:44:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:44:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr fail", "who": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: Activating manager daemon smithi155.wuuxfd 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mgr metadata", "who": "smithi155.wuuxfd", "id": "smithi155.wuuxfd"}]: dispatch 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:44:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:44:37.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:44:37.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:44:37.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:44:37.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:44:37.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T21:44:37.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.14208 172.21.15.119:0/3204093338' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "mgr fail", "who": "smithi119.gwjxmq"}]': finished 2024-09-13T21:44:37.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: mgrmap e21: smithi155.wuuxfd(active, starting, since 0.0145579s) 2024-09-13T21:44:37.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:44:37.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:44:37.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:44:37.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: Manager daemon smithi155.wuuxfd is now available 2024-09-13T21:44:37.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:37.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:37.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:37.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:44:37.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:37.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.wuuxfd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:44:37.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.wuuxfd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:44:37.586 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.wuuxfd/trash_purge_schedule"}]: dispatch 2024-09-13T21:44:37.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:37 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi155.wuuxfd/trash_purge_schedule"}]: dispatch 2024-09-13T21:44:37.587 INFO:tasks.workunit.client.0.smithi119.stdout:8/217: dread f5 [0,4194304] 0 2024-09-13T21:44:37.587 INFO:tasks.workunit.client.0.smithi119.stdout:4/199: mknod d4/d1e/d10/c39 0 2024-09-13T21:44:37.587 INFO:tasks.workunit.client.0.smithi119.stdout:1/196: unlink d1/f1a 0 2024-09-13T21:44:37.588 INFO:tasks.workunit.client.0.smithi119.stdout:3/158: truncate d6/f12 4352394 0 2024-09-13T21:44:37.590 INFO:tasks.workunit.client.0.smithi119.stdout:8/218: dread d1b/d1d/d26/f2f [0,4194304] 0 2024-09-13T21:44:37.590 INFO:tasks.workunit.client.0.smithi119.stdout:4/200: readlink d4/d1e/l11 0 2024-09-13T21:44:37.592 INFO:tasks.workunit.client.0.smithi119.stdout:8/219: write d1b/f4a [873730,122429] 0 2024-09-13T21:44:37.594 INFO:tasks.workunit.client.0.smithi119.stdout:8/220: truncate d1b/d1d/d48/f49 25231 0 2024-09-13T21:44:37.595 INFO:tasks.workunit.client.0.smithi119.stdout:2/165: creat d1/d1f/f2e x:0 0 0 2024-09-13T21:44:37.596 INFO:tasks.workunit.client.0.smithi119.stdout:8/221: stat d1b/f42 0 2024-09-13T21:44:37.597 INFO:tasks.workunit.client.0.smithi119.stdout:3/159: dwrite d6/f16 [0,4194304] 0 2024-09-13T21:44:37.602 INFO:tasks.workunit.client.0.smithi119.stdout:5/156: getdents d0/d3/d4/d9 0 2024-09-13T21:44:37.603 INFO:tasks.workunit.client.0.smithi119.stdout:8/222: unlink d1b/f4a 0 2024-09-13T21:44:37.603 INFO:tasks.workunit.client.0.smithi119.stdout:5/157: dread - d0/d3/d4/d9/f10 zero size 2024-09-13T21:44:37.605 INFO:tasks.workunit.client.0.smithi119.stdout:2/166: rename d1/d22/l21 to d1/d7/l2f 0 2024-09-13T21:44:37.609 INFO:tasks.workunit.client.0.smithi119.stdout:3/160: creat d6/d25/d2f/f3b x:0 0 0 2024-09-13T21:44:37.610 INFO:tasks.workunit.client.0.smithi119.stdout:4/201: unlink d4/c13 0 2024-09-13T21:44:37.611 INFO:tasks.workunit.client.0.smithi119.stdout:4/202: dread - d4/d1e/d28/f24 zero size 2024-09-13T21:44:37.612 INFO:tasks.workunit.client.0.smithi119.stdout:4/203: stat d4/d1e/d26/f32 0 2024-09-13T21:44:37.612 INFO:tasks.workunit.client.0.smithi119.stdout:8/223: mknod d1b/d1d/c4d 0 2024-09-13T21:44:37.613 INFO:tasks.workunit.client.0.smithi119.stdout:5/158: symlink d0/d3/d4/d9/d14/d24/l3a 0 2024-09-13T21:44:37.613 INFO:tasks.workunit.client.0.smithi119.stdout:2/167: symlink d1/d1f/l30 0 2024-09-13T21:44:37.614 INFO:tasks.workunit.client.0.smithi119.stdout:4/204: write d4/d1e/d28/f24 [992238,41281] 0 2024-09-13T21:44:37.615 INFO:tasks.workunit.client.0.smithi119.stdout:3/161: creat d6/d15/d1a/f3c x:0 0 0 2024-09-13T21:44:37.616 INFO:tasks.workunit.client.0.smithi119.stdout:8/224: fsync d1b/d1d/d26/f2f 0 2024-09-13T21:44:37.616 INFO:tasks.workunit.client.0.smithi119.stdout:5/159: truncate d0/d3/d4/f5 4339495 0 2024-09-13T21:44:37.618 INFO:tasks.workunit.client.0.smithi119.stdout:1/197: getdents d1/d3/dc/d24/d2f/d31/d32/d33 0 2024-09-13T21:44:37.619 INFO:tasks.workunit.client.0.smithi119.stdout:2/168: mkdir d1/d2b/d2c/d31 0 2024-09-13T21:44:37.620 INFO:tasks.workunit.client.0.smithi119.stdout:3/162: dread d6/f29 [0,4194304] 0 2024-09-13T21:44:37.620 INFO:tasks.workunit.client.0.smithi119.stdout:1/198: stat d1/d3/dc/d11/d19/d2d/d37 0 2024-09-13T21:44:37.620 INFO:tasks.workunit.client.0.smithi119.stdout:5/160: truncate d0/d3/d4/d9/f10 793760 0 2024-09-13T21:44:37.621 INFO:tasks.workunit.client.0.smithi119.stdout:4/205: mknod d4/d1e/c3a 0 2024-09-13T21:44:37.622 INFO:tasks.workunit.client.0.smithi119.stdout:8/225: mkdir d1b/d4e 0 2024-09-13T21:44:37.623 INFO:tasks.workunit.client.0.smithi119.stdout:3/163: stat d6/f11 0 2024-09-13T21:44:37.625 INFO:tasks.workunit.client.0.smithi119.stdout:1/199: creat d1/d3/dc/d24/d2f/d31/d32/f3e x:0 0 0 2024-09-13T21:44:37.626 INFO:tasks.workunit.client.0.smithi119.stdout:5/161: mknod d0/d3/d4/d9/d14/d24/c3b 0 2024-09-13T21:44:37.627 INFO:tasks.workunit.client.0.smithi119.stdout:8/226: truncate f18 1180078 0 2024-09-13T21:44:37.628 INFO:tasks.workunit.client.0.smithi119.stdout:1/200: write d1/d3/dc/d11/f3c [175643,40219] 0 2024-09-13T21:44:37.628 INFO:tasks.workunit.client.0.smithi119.stdout:2/169: creat d1/f32 x:0 0 0 2024-09-13T21:44:37.630 INFO:tasks.workunit.client.0.smithi119.stdout:4/206: mknod d4/c3b 0 2024-09-13T21:44:37.631 INFO:tasks.workunit.client.0.smithi119.stdout:5/162: mknod d0/d3/c3c 0 2024-09-13T21:44:37.635 INFO:tasks.workunit.client.0.smithi119.stdout:2/170: symlink d1/d2b/d2c/d31/l33 0 2024-09-13T21:44:37.640 INFO:tasks.workunit.client.0.smithi119.stdout:4/207: dread d4/f2f [0,4194304] 0 2024-09-13T21:44:37.642 INFO:tasks.workunit.client.0.smithi119.stdout:1/201: dwrite d1/d3/f7 [0,4194304] 0 2024-09-13T21:44:37.643 INFO:tasks.workunit.client.0.smithi119.stdout:2/171: dread d1/d7/f23 [0,4194304] 0 2024-09-13T21:44:37.644 INFO:tasks.workunit.client.0.smithi119.stdout:8/227: dwrite d1b/d1d/d26/f3d [0,4194304] 0 2024-09-13T21:44:37.645 INFO:tasks.workunit.client.0.smithi119.stdout:1/202: stat d1/d3/f13 0 2024-09-13T21:44:37.648 INFO:tasks.workunit.client.0.smithi119.stdout:4/208: mkdir d4/d1e/d28/d3c 0 2024-09-13T21:44:37.651 INFO:tasks.workunit.client.0.smithi119.stdout:4/209: chown d4/d1e/f33 710 1 2024-09-13T21:44:37.652 INFO:tasks.workunit.client.0.smithi119.stdout:2/172: rename d1/f6 to d1/d2b/f34 0 2024-09-13T21:44:37.655 INFO:tasks.workunit.client.0.smithi119.stdout:1/203: dwrite d1/d3/f2b [0,4194304] 0 2024-09-13T21:44:37.656 INFO:tasks.workunit.client.0.smithi119.stdout:1/204: chown d1/f1f 783596 1 2024-09-13T21:44:37.658 INFO:tasks.workunit.client.0.smithi119.stdout:1/205: fsync d1/d3/dc/d11/f3c 0 2024-09-13T21:44:37.660 INFO:tasks.workunit.client.0.smithi119.stdout:8/228: link d1b/d1d/d26/d3e/f4c d1b/d1d/f4f 0 2024-09-13T21:44:37.665 INFO:tasks.workunit.client.0.smithi119.stdout:4/210: mknod d4/c3d 0 2024-09-13T21:44:37.665 INFO:tasks.workunit.client.0.smithi119.stdout:4/211: readlink l1 0 2024-09-13T21:44:37.665 INFO:tasks.workunit.client.0.smithi119.stdout:2/173: dwrite d1/d7/f20 [0,4194304] 0 2024-09-13T21:44:37.667 INFO:tasks.workunit.client.0.smithi119.stdout:2/174: write d1/d7/f2a [281776,40534] 0 2024-09-13T21:44:37.668 INFO:tasks.workunit.client.0.smithi119.stdout:8/229: creat d1b/d1d/d26/f50 x:0 0 0 2024-09-13T21:44:37.669 INFO:tasks.workunit.client.0.smithi119.stdout:8/230: dread - d1b/d1d/d26/f33 zero size 2024-09-13T21:44:37.671 INFO:tasks.workunit.client.0.smithi119.stdout:1/206: truncate d1/d3/f9 1406837 0 2024-09-13T21:44:37.677 INFO:tasks.workunit.client.0.smithi119.stdout:2/175: link d1/d22/c29 d1/d2b/d2c/c35 0 2024-09-13T21:44:37.679 INFO:tasks.workunit.client.0.smithi119.stdout:2/176: dread - d1/f25 zero size 2024-09-13T21:44:37.680 INFO:tasks.workunit.client.0.smithi119.stdout:3/164: dwrite d6/f12 [0,4194304] 0 2024-09-13T21:44:37.682 INFO:tasks.workunit.client.0.smithi119.stdout:8/231: getdents d1b/d1d/d48 0 2024-09-13T21:44:37.684 INFO:tasks.workunit.client.0.smithi119.stdout:4/212: rmdir d4 39 2024-09-13T21:44:37.686 INFO:tasks.workunit.client.0.smithi119.stdout:3/165: chown l4 14345229 1 2024-09-13T21:44:37.688 INFO:tasks.workunit.client.0.smithi119.stdout:3/166: readlink d6/d15/l26 0 2024-09-13T21:44:37.692 INFO:tasks.workunit.client.0.smithi119.stdout:4/213: chown d4/c3d 1119 1 2024-09-13T21:44:37.694 INFO:tasks.workunit.client.0.smithi119.stdout:8/232: dwrite d1b/d1d/d26/f2f [0,4194304] 0 2024-09-13T21:44:37.694 INFO:tasks.workunit.client.0.smithi119.stdout:2/177: dwrite d1/d7/f23 [0,4194304] 0 2024-09-13T21:44:37.694 INFO:tasks.workunit.client.0.smithi119.stdout:3/167: mknod d6/c3d 0 2024-09-13T21:44:37.697 INFO:tasks.workunit.client.0.smithi119.stdout:3/168: fdatasync d6/d15/d1a/f28 0 2024-09-13T21:44:37.698 INFO:tasks.workunit.client.0.smithi119.stdout:8/233: chown f18 19 1 2024-09-13T21:44:37.700 INFO:tasks.workunit.client.0.smithi119.stdout:2/178: mkdir d1/d2b/d2c/d31/d36 0 2024-09-13T21:44:37.702 INFO:tasks.workunit.client.0.smithi119.stdout:3/169: creat d6/f3e x:0 0 0 2024-09-13T21:44:37.703 INFO:tasks.workunit.client.0.smithi119.stdout:2/179: chown d1/l16 1802 1 2024-09-13T21:44:37.704 INFO:tasks.workunit.client.0.smithi119.stdout:4/214: getdents d4 0 2024-09-13T21:44:37.706 INFO:tasks.workunit.client.0.smithi119.stdout:3/170: creat d6/d15/f3f x:0 0 0 2024-09-13T21:44:37.709 INFO:tasks.workunit.client.0.smithi119.stdout:1/207: truncate d1/d3/f9 182136 0 2024-09-13T21:44:37.709 INFO:tasks.workunit.client.0.smithi119.stdout:3/171: symlink d6/d15/d1a/l40 0 2024-09-13T21:44:37.710 INFO:tasks.workunit.client.0.smithi119.stdout:3/172: truncate d6/f18 2038851 0 2024-09-13T21:44:37.711 INFO:tasks.workunit.client.0.smithi119.stdout:1/208: unlink d1/c1d 0 2024-09-13T21:44:37.712 INFO:tasks.workunit.client.0.smithi119.stdout:3/173: creat d6/d15/d1a/f41 x:0 0 0 2024-09-13T21:44:37.715 INFO:tasks.workunit.client.0.smithi119.stdout:3/174: creat d6/d15/d1a/f42 x:0 0 0 2024-09-13T21:44:37.715 INFO:tasks.workunit.client.0.smithi119.stdout:3/175: fsync d6/d15/d1a/f3a 0 2024-09-13T21:44:37.716 INFO:tasks.workunit.client.0.smithi119.stdout:3/176: chown d6/ff 3766907 1 2024-09-13T21:44:37.717 INFO:tasks.workunit.client.0.smithi119.stdout:1/209: dread d1/d3/dc/d24/f29 [0,4194304] 0 2024-09-13T21:44:37.718 INFO:tasks.workunit.client.0.smithi119.stdout:3/177: creat d6/d25/d2f/d33/f43 x:0 0 0 2024-09-13T21:44:37.720 INFO:tasks.workunit.client.0.smithi119.stdout:3/178: mkdir d6/d44 0 2024-09-13T21:44:37.721 INFO:tasks.workunit.client.0.smithi119.stdout:3/179: dread - d6/d15/d1a/f42 zero size 2024-09-13T21:44:37.722 INFO:tasks.workunit.client.0.smithi119.stdout:1/210: dread d1/f1b [0,4194304] 0 2024-09-13T21:44:37.723 INFO:tasks.workunit.client.0.smithi119.stdout:3/180: fsync d6/f1e 0 2024-09-13T21:44:37.724 INFO:tasks.workunit.client.0.smithi119.stdout:1/211: fdatasync d1/f26 0 2024-09-13T21:44:37.728 INFO:tasks.workunit.client.0.smithi119.stdout:2/180: truncate d1/d7/f23 905790 0 2024-09-13T21:44:37.730 INFO:tasks.workunit.client.0.smithi119.stdout:3/181: mkdir d6/d15/d1a/d45 0 2024-09-13T21:44:37.731 INFO:tasks.workunit.client.0.smithi119.stdout:4/215: dwrite d4/f8 [0,4194304] 0 2024-09-13T21:44:37.733 INFO:tasks.workunit.client.0.smithi119.stdout:2/181: read d1/d7/fd [11366,48870] 0 2024-09-13T21:44:37.737 INFO:tasks.workunit.client.0.smithi119.stdout:1/212: link d1/d3/f13 d1/d3/dc/d11/d28/f3f 0 2024-09-13T21:44:37.738 INFO:tasks.workunit.client.0.smithi119.stdout:7/183: sync 2024-09-13T21:44:37.741 INFO:tasks.workunit.client.0.smithi119.stdout:4/216: rename d4/f8 to d4/d1e/d28/d34/f3e 0 2024-09-13T21:44:37.743 INFO:tasks.workunit.client.0.smithi119.stdout:1/213: mknod d1/d3/dc/d24/d2f/d31/d32/d33/c40 0 2024-09-13T21:44:37.745 INFO:tasks.workunit.client.0.smithi119.stdout:2/182: creat d1/f37 x:0 0 0 2024-09-13T21:44:37.748 INFO:tasks.workunit.client.0.smithi119.stdout:7/184: getdents d8/d19/d22 0 2024-09-13T21:44:37.748 INFO:tasks.workunit.client.0.smithi119.stdout:7/185: dread - d8/f20 zero size 2024-09-13T21:44:37.750 INFO:tasks.workunit.client.0.smithi119.stdout:1/214: creat d1/d3/dc/f41 x:0 0 0 2024-09-13T21:44:37.754 INFO:tasks.workunit.client.0.smithi119.stdout:2/183: rename d1/d1f to d1/d38 0 2024-09-13T21:44:37.756 INFO:tasks.workunit.client.0.smithi119.stdout:3/182: write d6/f29 [105660,45743] 0 2024-09-13T21:44:37.758 INFO:tasks.workunit.client.0.smithi119.stdout:1/215: mknod d1/d3/dc/d11/d19/d2d/d37/c42 0 2024-09-13T21:44:37.758 INFO:tasks.workunit.client.0.smithi119.stdout:7/186: dwrite d8/d19/f1f [0,4194304] 0 2024-09-13T21:44:37.759 INFO:tasks.workunit.client.0.smithi119.stdout:2/184: rename d1/d7/c10 to d1/d2b/d2c/d31/d36/c39 0 2024-09-13T21:44:37.760 INFO:tasks.workunit.client.0.smithi119.stdout:2/185: fsync d1/d22/f24 0 2024-09-13T21:44:37.762 INFO:tasks.workunit.client.0.smithi119.stdout:2/186: readlink d1/d2b/d2c/d31/l33 0 2024-09-13T21:44:37.768 INFO:tasks.workunit.client.0.smithi119.stdout:7/187: mkdir d8/d9/d3d 0 2024-09-13T21:44:37.768 INFO:tasks.workunit.client.0.smithi119.stdout:1/216: chown d1/d3/dc/c34 154684047 1 2024-09-13T21:44:37.769 INFO:tasks.workunit.client.0.smithi119.stdout:7/188: truncate d8/d9/f11 4306768 0 2024-09-13T21:44:37.770 INFO:tasks.workunit.client.0.smithi119.stdout:2/187: creat d1/d2b/d2c/f3a x:0 0 0 2024-09-13T21:44:37.771 INFO:tasks.workunit.client.0.smithi119.stdout:7/189: write d8/f21 [662886,24305] 0 2024-09-13T21:44:37.771 INFO:tasks.workunit.client.0.smithi119.stdout:1/217: mkdir d1/d3/dc/d24/d2f/d31/d32/d33/d43 0 2024-09-13T21:44:37.773 INFO:tasks.workunit.client.0.smithi119.stdout:2/188: unlink d1/ce 0 2024-09-13T21:44:37.775 INFO:tasks.workunit.client.0.smithi119.stdout:4/217: rename d4/d1e/d28/f25 to d4/d1e/d10/f3f 0 2024-09-13T21:44:37.776 INFO:tasks.workunit.client.0.smithi119.stdout:2/189: dread - d1/d22/f24 zero size 2024-09-13T21:44:37.777 INFO:tasks.workunit.client.0.smithi119.stdout:1/218: unlink d1/f1f 0 2024-09-13T21:44:37.782 INFO:tasks.workunit.client.0.smithi119.stdout:7/190: dwrite d8/d19/f25 [0,4194304] 0 2024-09-13T21:44:37.782 INFO:tasks.workunit.client.0.smithi119.stdout:2/190: fdatasync d1/d7/f9 0 2024-09-13T21:44:37.784 INFO:tasks.workunit.client.0.smithi119.stdout:3/183: write d6/f11 [453386,57408] 0 2024-09-13T21:44:37.785 INFO:tasks.workunit.client.0.smithi119.stdout:2/191: write d1/d22/f2d [815550,88348] 0 2024-09-13T21:44:37.791 INFO:tasks.workunit.client.0.smithi119.stdout:1/219: dwrite d1/d3/dc/d11/f3c [0,4194304] 0 2024-09-13T21:44:37.792 INFO:tasks.workunit.client.0.smithi119.stdout:2/192: truncate d1/d2b/d2c/f3a 917433 0 2024-09-13T21:44:37.794 INFO:tasks.workunit.client.0.smithi119.stdout:7/191: symlink d8/d9/l3e 0 2024-09-13T21:44:37.794 INFO:tasks.workunit.client.0.smithi119.stdout:2/193: fdatasync d1/d22/f27 0 2024-09-13T21:44:37.794 INFO:tasks.workunit.client.0.smithi119.stdout:7/192: readlink d8/lc 0 2024-09-13T21:44:37.796 INFO:tasks.workunit.client.0.smithi119.stdout:1/220: creat d1/d3/dc/d11/d19/d2d/f44 x:0 0 0 2024-09-13T21:44:37.797 INFO:tasks.workunit.client.0.smithi119.stdout:3/184: getdents d6/d25/d2f/d38 0 2024-09-13T21:44:37.797 INFO:tasks.workunit.client.0.smithi119.stdout:7/193: write d8/f20 [280172,2059] 0 2024-09-13T21:44:37.800 INFO:tasks.workunit.client.0.smithi119.stdout:1/221: read d1/d3/dc/f1c [697219,46812] 0 2024-09-13T21:44:37.803 INFO:tasks.workunit.client.0.smithi119.stdout:2/194: dread d1/d7/fd [0,4194304] 0 2024-09-13T21:44:37.808 INFO:tasks.workunit.client.0.smithi119.stdout:2/195: mknod d1/d22/c3b 0 2024-09-13T21:44:37.810 INFO:tasks.workunit.client.0.smithi119.stdout:3/185: dwrite d6/d15/f30 [0,4194304] 0 2024-09-13T21:44:37.812 INFO:tasks.workunit.client.0.smithi119.stdout:7/194: dwrite d8/d9/fe [4194304,4194304] 0 2024-09-13T21:44:37.813 INFO:tasks.workunit.client.0.smithi119.stdout:1/222: rename d1/d3/dc/d24/d2f/d31/l39 to d1/d3/dc/d11/d3d/l45 0 2024-09-13T21:44:37.814 INFO:tasks.workunit.client.0.smithi119.stdout:3/186: write d6/d15/d1a/f3a [805493,114194] 0 2024-09-13T21:44:37.815 INFO:tasks.workunit.client.0.smithi119.stdout:2/196: mknod d1/c3c 0 2024-09-13T21:44:37.818 INFO:tasks.workunit.client.0.smithi119.stdout:2/197: write d1/d22/f24 [768583,44797] 0 2024-09-13T21:44:37.818 INFO:tasks.workunit.client.0.smithi119.stdout:1/223: dread d1/d3/dc/d24/f29 [0,4194304] 0 2024-09-13T21:44:37.822 INFO:tasks.workunit.client.0.smithi119.stdout:3/187: truncate d6/d15/d1a/f28 1039813 0 2024-09-13T21:44:37.823 INFO:tasks.workunit.client.0.smithi119.stdout:1/224: fdatasync d1/d3/f2a 0 2024-09-13T21:44:37.825 INFO:tasks.workunit.client.0.smithi119.stdout:3/188: creat d6/f46 x:0 0 0 2024-09-13T21:44:37.826 INFO:tasks.workunit.client.0.smithi119.stdout:7/195: dwrite d8/f31 [0,4194304] 0 2024-09-13T21:44:37.831 INFO:tasks.workunit.client.0.smithi119.stdout:3/189: truncate d6/f13 326344 0 2024-09-13T21:44:37.833 INFO:tasks.workunit.client.0.smithi119.stdout:2/198: dwrite d1/f25 [0,4194304] 0 2024-09-13T21:44:37.833 INFO:tasks.workunit.client.0.smithi119.stdout:1/225: readlink d1/d3/dc/d11/d3d/l45 0 2024-09-13T21:44:37.836 INFO:tasks.workunit.client.0.smithi119.stdout:1/226: mknod d1/d3/dc/d11/d19/d2d/d37/c46 0 2024-09-13T21:44:37.838 INFO:tasks.workunit.client.0.smithi119.stdout:1/227: chown d1/d3/dc/d11/d19 119495 1 2024-09-13T21:44:37.838 INFO:tasks.workunit.client.0.smithi119.stdout:3/190: write d6/d15/f34 [97218,3676] 0 2024-09-13T21:44:37.839 INFO:tasks.workunit.client.0.smithi119.stdout:7/196: symlink d8/d3c/l3f 0 2024-09-13T21:44:37.844 INFO:tasks.workunit.client.0.smithi119.stdout:2/199: creat d1/f3d x:0 0 0 2024-09-13T21:44:37.845 INFO:tasks.workunit.client.0.smithi119.stdout:7/197: mknod d8/d19/d22/c40 0 2024-09-13T21:44:37.847 INFO:tasks.workunit.client.0.smithi119.stdout:3/191: mkdir d6/d15/d1a/d45/d47 0 2024-09-13T21:44:37.849 INFO:tasks.workunit.client.0.smithi119.stdout:2/200: write d1/d7/f23 [1843776,48419] 0 2024-09-13T21:44:37.849 INFO:tasks.workunit.client.0.smithi119.stdout:1/228: dwrite d1/f1b [4194304,4194304] 0 2024-09-13T21:44:37.851 INFO:tasks.workunit.client.0.smithi119.stdout:1/229: stat d1/d3/f2a 0 2024-09-13T21:44:37.851 INFO:tasks.workunit.client.0.smithi119.stdout:7/198: write d8/d9/f32 [455675,58400] 0 2024-09-13T21:44:37.853 INFO:tasks.workunit.client.0.smithi119.stdout:1/230: truncate d1/f26 5048043 0 2024-09-13T21:44:37.854 INFO:tasks.workunit.client.0.smithi119.stdout:2/201: mknod d1/d2b/d2c/d31/d36/c3e 0 2024-09-13T21:44:37.854 INFO:tasks.workunit.client.0.smithi119.stdout:7/199: write d8/d19/f1a [723363,124638] 0 2024-09-13T21:44:37.856 INFO:tasks.workunit.client.0.smithi119.stdout:2/202: stat d1/d22/f1c 0 2024-09-13T21:44:37.858 INFO:tasks.workunit.client.0.smithi119.stdout:3/192: rmdir d6/d25/d2f/d38 0 2024-09-13T21:44:37.859 INFO:tasks.workunit.client.0.smithi119.stdout:1/231: readlink d1/d3/dc/d11/d28/l30 0 2024-09-13T21:44:37.864 INFO:tasks.workunit.client.0.smithi119.stdout:7/200: symlink d8/d19/d22/d37/l41 0 2024-09-13T21:44:37.864 INFO:tasks.workunit.client.0.smithi119.stdout:1/232: mkdir d1/d3/dc/d11/d19/d47 0 2024-09-13T21:44:37.867 INFO:tasks.workunit.client.0.smithi119.stdout:1/233: readlink d1/d3/dc/d11/d3d/l45 0 2024-09-13T21:44:37.868 INFO:tasks.workunit.client.0.smithi119.stdout:2/203: dwrite d1/d7/f2a [0,4194304] 0 2024-09-13T21:44:37.869 INFO:tasks.workunit.client.0.smithi119.stdout:1/234: fdatasync d1/d3/dc/d11/f3c 0 2024-09-13T21:44:37.873 INFO:tasks.workunit.client.0.smithi119.stdout:1/235: symlink d1/d3/dc/d24/d2f/l48 0 2024-09-13T21:44:37.877 INFO:tasks.workunit.client.0.smithi119.stdout:2/204: dwrite d1/d2b/d2c/f3a [0,4194304] 0 2024-09-13T21:44:37.879 INFO:tasks.workunit.client.0.smithi119.stdout:2/205: write d1/d7/f2a [2979991,79068] 0 2024-09-13T21:44:37.880 INFO:tasks.workunit.client.0.smithi119.stdout:1/236: rename d1/d3/dc/d11/d28/l30 to d1/d3/dc/d11/d28/l49 0 2024-09-13T21:44:37.881 INFO:tasks.workunit.client.0.smithi119.stdout:7/201: truncate d8/d9/f32 154941 0 2024-09-13T21:44:37.884 INFO:tasks.workunit.client.0.smithi119.stdout:7/202: write d8/d19/d2e/d34/f3a [857046,51844] 0 2024-09-13T21:44:37.890 INFO:tasks.workunit.client.0.smithi119.stdout:1/237: dread d1/d3/f4 [0,4194304] 0 2024-09-13T21:44:37.893 INFO:tasks.workunit.client.0.smithi119.stdout:1/238: unlink d1/d3/f9 0 2024-09-13T21:44:37.902 INFO:tasks.workunit.client.0.smithi119.stdout:7/203: rename d8/d9 to d8/d19/d2e/d34/d42 0 2024-09-13T21:44:37.903 INFO:tasks.workunit.client.0.smithi119.stdout:7/204: fdatasync d8/d19/d2e/d34/d42/fe 0 2024-09-13T21:44:37.905 INFO:tasks.workunit.client.0.smithi119.stdout:2/206: truncate d1/d7/f2a 1711649 0 2024-09-13T21:44:37.907 INFO:tasks.workunit.client.0.smithi119.stdout:7/205: fdatasync d8/d19/d2e/d34/d42/fa 0 2024-09-13T21:44:37.909 INFO:tasks.workunit.client.0.smithi119.stdout:2/207: creat d1/d38/f3f x:0 0 0 2024-09-13T21:44:37.912 INFO:tasks.workunit.client.0.smithi119.stdout:7/206: rename d8/d19/d2e/d34/d42/l27 to d8/l43 0 2024-09-13T21:44:37.913 INFO:tasks.workunit.client.0.smithi119.stdout:1/239: dwrite d1/d3/f13 [0,4194304] 0 2024-09-13T21:44:37.915 INFO:tasks.workunit.client.0.smithi119.stdout:7/207: dread - d8/d19/d22/f28 zero size 2024-09-13T21:44:37.916 INFO:tasks.workunit.client.0.smithi119.stdout:7/208: write d8/f31 [3046422,47854] 0 2024-09-13T21:44:37.918 INFO:tasks.workunit.client.0.smithi119.stdout:2/208: getdents d1/d2b/d2c/d31/d36 0 2024-09-13T21:44:37.918 INFO:tasks.workunit.client.0.smithi119.stdout:7/209: write d8/d19/f35 [734743,50878] 0 2024-09-13T21:44:37.918 INFO:tasks.workunit.client.0.smithi119.stdout:2/209: fsync d1/d38/f2e 0 2024-09-13T21:44:37.920 INFO:tasks.workunit.client.0.smithi119.stdout:2/210: write d1/f32 [553067,129659] 0 2024-09-13T21:44:37.930 INFO:tasks.workunit.client.0.smithi119.stdout:7/210: dwrite d8/d19/f1c [0,4194304] 0 2024-09-13T21:44:37.931 INFO:tasks.workunit.client.0.smithi119.stdout:2/211: dwrite d1/d7/f20 [0,4194304] 0 2024-09-13T21:44:37.934 INFO:tasks.workunit.client.0.smithi119.stdout:7/211: chown d8/d19/d2e/d34/d42/fa 962289 1 2024-09-13T21:44:37.935 INFO:tasks.workunit.client.0.smithi119.stdout:7/212: readlink d8/d19/d2e/d34/d42/l3e 0 2024-09-13T21:44:37.936 INFO:tasks.workunit.client.0.smithi119.stdout:7/213: rmdir d8 39 2024-09-13T21:44:37.937 INFO:tasks.workunit.client.0.smithi119.stdout:7/214: chown d8/d19/d2e/d34/d42/l3e 15 1 2024-09-13T21:44:37.939 INFO:tasks.workunit.client.0.smithi119.stdout:7/215: mknod d8/d19/d22/d3b/c44 0 2024-09-13T21:44:37.965 INFO:tasks.workunit.client.0.smithi119.stdout:7/216: dwrite d8/d19/d2e/d34/d42/f32 [0,4194304] 0 2024-09-13T21:44:37.980 INFO:tasks.workunit.client.0.smithi119.stdout:9/164: sync 2024-09-13T21:44:37.983 INFO:tasks.workunit.client.0.smithi119.stdout:9/165: symlink d0/d8/d18/d23/d27/l36 0 2024-09-13T21:44:37.985 INFO:tasks.workunit.client.0.smithi119.stdout:9/166: dread d0/d19/f30 [0,4194304] 0 2024-09-13T21:44:37.986 INFO:tasks.workunit.client.0.smithi119.stdout:9/167: chown d0/d19/d1a/d2b 346288516 1 2024-09-13T21:44:37.988 INFO:tasks.workunit.client.0.smithi119.stdout:9/168: mknod d0/d19/d1a/c37 0 2024-09-13T21:44:37.999 INFO:tasks.workunit.client.0.smithi119.stdout:9/169: dread d0/f7 [0,4194304] 0 2024-09-13T21:44:38.000 INFO:tasks.workunit.client.0.smithi119.stdout:9/170: dread d0/d19/f26 [0,4194304] 0 2024-09-13T21:44:38.003 INFO:tasks.workunit.client.0.smithi119.stdout:9/171: dread d0/d8/d18/d23/d27/f32 [0,4194304] 0 2024-09-13T21:44:38.014 INFO:tasks.workunit.client.0.smithi119.stdout:9/172: dread d0/d8/d18/d23/d27/f16 [0,4194304] 0 2024-09-13T21:44:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:6/234: sync 2024-09-13T21:44:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:6/235: write dc/df/f24 [351776,11590] 0 2024-09-13T21:44:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:6/236: dwrite dc/df/f24 [4194304,4194304] 0 2024-09-13T21:44:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:6/237: link dc/df/f12 dc/df/f44 0 2024-09-13T21:44:38.253 INFO:tasks.workunit.client.0.smithi119.stdout:6/238: dread dc/dd/f20 [0,4194304] 0 2024-09-13T21:44:38.255 INFO:tasks.workunit.client.0.smithi119.stdout:6/239: symlink dc/dd/l45 0 2024-09-13T21:44:38.256 INFO:tasks.workunit.client.0.smithi119.stdout:6/240: rmdir dc/df 39 2024-09-13T21:44:38.258 INFO:tasks.workunit.client.0.smithi119.stdout:6/241: mknod dc/dd/c46 0 2024-09-13T21:44:38.268 INFO:tasks.workunit.client.0.smithi119.stdout:6/242: dwrite dc/f36 [0,4194304] 0 2024-09-13T21:44:38.274 INFO:tasks.workunit.client.0.smithi119.stdout:6/243: dwrite dc/dd/fe [0,4194304] 0 2024-09-13T21:44:38.277 INFO:tasks.workunit.client.0.smithi119.stdout:6/244: rmdir dc/df/d34 39 2024-09-13T21:44:38.279 INFO:tasks.workunit.client.0.smithi119.stdout:6/245: link dc/df/f24 dc/dd/f47 0 2024-09-13T21:44:38.282 INFO:tasks.workunit.client.0.smithi119.stdout:6/246: rename dc/f1a to dc/d37/f48 0 2024-09-13T21:44:38.289 INFO:tasks.workunit.client.0.smithi119.stdout:6/247: dwrite dc/f14 [4194304,4194304] 0 2024-09-13T21:44:38.294 INFO:tasks.workunit.client.0.smithi119.stdout:6/248: unlink dc/df/d34/f3c 0 2024-09-13T21:44:38.297 INFO:tasks.workunit.client.0.smithi119.stdout:6/249: creat dc/d3d/d40/f49 x:0 0 0 2024-09-13T21:44:38.301 INFO:tasks.workunit.client.0.smithi119.stdout:6/250: link dc/df/f44 dc/df/d34/f4a 0 2024-09-13T21:44:38.357 INFO:tasks.workunit.client.0.smithi119.stdout:0/202: sync 2024-09-13T21:44:38.357 INFO:tasks.workunit.client.0.smithi119.stdout:0/203: chown de/d1c/d2f/f41 7763586 1 2024-09-13T21:44:38.359 INFO:tasks.workunit.client.0.smithi119.stdout:0/204: mkdir de/d4e 0 2024-09-13T21:44:38.364 INFO:tasks.workunit.client.0.smithi119.stdout:0/205: creat de/d49/f4f x:0 0 0 2024-09-13T21:44:38.380 INFO:tasks.workunit.client.0.smithi119.stdout:0/206: dread de/f12 [0,4194304] 0 2024-09-13T21:44:38.382 INFO:tasks.workunit.client.0.smithi119.stdout:0/207: write de/f1a [529600,119221] 0 2024-09-13T21:44:38.386 INFO:tasks.workunit.client.0.smithi119.stdout:0/208: write de/d1c/d2b/f30 [1620483,67117] 0 2024-09-13T21:44:38.389 INFO:tasks.workunit.client.0.smithi119.stdout:0/209: mkdir de/d1c/d2f/d35/d50 0 2024-09-13T21:44:38.390 INFO:tasks.workunit.client.0.smithi119.stdout:0/210: mknod de/c51 0 2024-09-13T21:44:38.391 INFO:tasks.workunit.client.0.smithi119.stdout:0/211: chown de/d3c/f44 6071 1 2024-09-13T21:44:38.393 INFO:tasks.workunit.client.0.smithi119.stdout:0/212: mkdir de/d1c/d52 0 2024-09-13T21:44:38.394 INFO:tasks.workunit.client.0.smithi119.stdout:0/213: truncate de/f26 166888 0 2024-09-13T21:44:38.398 INFO:tasks.workunit.client.0.smithi119.stdout:0/214: dread de/d1c/f36 [0,4194304] 0 2024-09-13T21:44:38.404 INFO:tasks.workunit.client.0.smithi119.stdout:0/215: dwrite de/d1c/d2f/f47 [0,4194304] 0 2024-09-13T21:44:38.407 INFO:tasks.workunit.client.0.smithi119.stdout:0/216: rename de/d1c/c24 to de/d3c/c53 0 2024-09-13T21:44:38.409 INFO:tasks.workunit.client.0.smithi119.stdout:0/217: rename de/d1c/d2f/d35 to de/d1c/d2f/d35/d4a/d54 22 2024-09-13T21:44:38.413 INFO:tasks.workunit.client.0.smithi119.stdout:0/218: link de/d1c/d2f/d35/f45 de/d1c/d52/f55 0 2024-09-13T21:44:38.415 INFO:tasks.workunit.client.0.smithi119.stdout:0/219: symlink de/d1c/d2f/d35/l56 0 2024-09-13T21:44:38.419 INFO:tasks.workunit.client.0.smithi119.stdout:0/220: dread de/f12 [0,4194304] 0 2024-09-13T21:44:38.422 INFO:tasks.workunit.client.0.smithi119.stdout:0/221: rename de/d1c/l48 to de/d1c/d2f/l57 0 2024-09-13T21:44:38.424 INFO:tasks.workunit.client.0.smithi119.stdout:0/222: dread - de/d1c/d2f/d35/f45 zero size 2024-09-13T21:44:38.425 INFO:tasks.workunit.client.0.smithi119.stdout:0/223: creat de/d1c/f58 x:0 0 0 2024-09-13T21:44:38.436 INFO:tasks.workunit.client.0.smithi119.stdout:0/224: dwrite de/f10 [4194304,4194304] 0 2024-09-13T21:44:38.438 INFO:tasks.workunit.client.0.smithi119.stdout:0/225: getdents de/d1c/d2f/d35/d4a 0 2024-09-13T21:44:38.440 INFO:tasks.workunit.client.0.smithi119.stdout:0/226: mkdir de/d1c/d59 0 2024-09-13T21:44:38.441 INFO:tasks.workunit.client.0.smithi119.stdout:0/227: symlink de/d1c/d59/l5a 0 2024-09-13T21:44:38.445 INFO:tasks.workunit.client.0.smithi119.stdout:0/228: rename de/f26 to de/d1c/d2b/d34/f5b 0 2024-09-13T21:44:38.445 INFO:tasks.workunit.client.0.smithi119.stdout:8/234: sync 2024-09-13T21:44:38.445 INFO:tasks.workunit.client.0.smithi119.stdout:4/218: sync 2024-09-13T21:44:38.445 INFO:tasks.workunit.client.0.smithi119.stdout:7/217: sync 2024-09-13T21:44:38.446 INFO:tasks.workunit.client.0.smithi119.stdout:2/212: sync 2024-09-13T21:44:38.446 INFO:tasks.workunit.client.0.smithi119.stdout:3/193: sync 2024-09-13T21:44:38.446 INFO:tasks.workunit.client.0.smithi119.stdout:9/173: sync 2024-09-13T21:44:38.446 INFO:tasks.workunit.client.0.smithi119.stdout:5/163: sync 2024-09-13T21:44:38.446 INFO:tasks.workunit.client.0.smithi119.stdout:1/240: sync 2024-09-13T21:44:38.446 INFO:tasks.workunit.client.0.smithi119.stdout:0/229: chown de/d1c/d52 154670580 1 2024-09-13T21:44:38.448 INFO:tasks.workunit.client.0.smithi119.stdout:3/194: chown d6/d15/d1a/f3c 0 1 2024-09-13T21:44:38.449 INFO:tasks.workunit.client.0.smithi119.stdout:8/235: rmdir d1b/d1d/d48 39 2024-09-13T21:44:38.449 INFO:tasks.workunit.client.0.smithi119.stdout:1/241: chown d1/d3/dc/d11/d3d 2 1 2024-09-13T21:44:38.449 INFO:tasks.workunit.client.0.smithi119.stdout:9/174: mknod d0/c38 0 2024-09-13T21:44:38.451 INFO:tasks.workunit.client.0.smithi119.stdout:0/230: creat de/d1c/f5c x:0 0 0 2024-09-13T21:44:38.453 INFO:tasks.workunit.client.0.smithi119.stdout:9/175: readlink d0/d8/d18/l1e 0 2024-09-13T21:44:38.453 INFO:tasks.workunit.client.0.smithi119.stdout:7/218: creat d8/d19/d2e/f45 x:0 0 0 2024-09-13T21:44:38.454 INFO:tasks.workunit.client.0.smithi119.stdout:9/176: stat d0/d8/f10 0 2024-09-13T21:44:38.454 INFO:tasks.workunit.client.0.smithi119.stdout:3/195: unlink d6/f1e 0 2024-09-13T21:44:38.455 INFO:tasks.workunit.client.0.smithi119.stdout:7/219: dread - d8/d19/d2e/d34/d42/f2d zero size 2024-09-13T21:44:38.456 INFO:tasks.workunit.client.0.smithi119.stdout:4/219: creat d4/f40 x:0 0 0 2024-09-13T21:44:38.456 INFO:tasks.workunit.client.0.smithi119.stdout:8/236: mknod d1b/d1d/d26/c51 0 2024-09-13T21:44:38.457 INFO:tasks.workunit.client.0.smithi119.stdout:2/213: mknod d1/d2b/d2c/d31/d36/c40 0 2024-09-13T21:44:38.458 INFO:tasks.workunit.client.0.smithi119.stdout:7/220: truncate d8/d19/d2e/f45 200894 0 2024-09-13T21:44:38.460 INFO:tasks.workunit.client.0.smithi119.stdout:1/242: mknod d1/d3/dc/d11/d19/d2d/c4a 0 2024-09-13T21:44:38.466 INFO:tasks.workunit.client.0.smithi119.stdout:7/221: mkdir d8/d3c/d46 0 2024-09-13T21:44:38.466 INFO:tasks.workunit.client.0.smithi119.stdout:2/214: fdatasync d1/d7/fd 0 2024-09-13T21:44:38.467 INFO:tasks.workunit.client.0.smithi119.stdout:9/177: fdatasync d0/d8/d18/d23/f29 0 2024-09-13T21:44:38.467 INFO:tasks.workunit.client.0.smithi119.stdout:8/237: dwrite d1b/d1d/d39/f44 [0,4194304] 0 2024-09-13T21:44:38.472 INFO:tasks.workunit.client.0.smithi119.stdout:7/222: write d8/d19/d2e/f45 [348378,100099] 0 2024-09-13T21:44:38.472 INFO:tasks.workunit.client.0.smithi119.stdout:4/220: mkdir d4/d1e/d26/d41 0 2024-09-13T21:44:38.476 INFO:tasks.workunit.client.0.smithi119.stdout:1/243: creat d1/d3/dc/d24/d2f/d31/d32/f4b x:0 0 0 2024-09-13T21:44:38.476 INFO:tasks.workunit.client.0.smithi119.stdout:5/164: getdents d0/d3/d1f 0 2024-09-13T21:44:38.480 INFO:tasks.workunit.client.0.smithi119.stdout:3/196: link d6/c3d d6/d25/c48 0 2024-09-13T21:44:38.483 INFO:tasks.workunit.client.0.smithi119.stdout:4/221: creat d4/d1e/d28/f42 x:0 0 0 2024-09-13T21:44:38.486 INFO:tasks.workunit.client.0.smithi119.stdout:5/165: dwrite d0/d3/d4/d9/d14/f29 [0,4194304] 0 2024-09-13T21:44:38.486 INFO:tasks.workunit.client.0.smithi119.stdout:4/222: chown d4/d1e/d10/f3f 2586606 1 2024-09-13T21:44:38.488 INFO:tasks.workunit.client.0.smithi119.stdout:1/244: symlink d1/d3/dc/d11/d19/d2d/l4c 0 2024-09-13T21:44:38.489 INFO:tasks.workunit.client.0.smithi119.stdout:0/231: link de/d1c/c2d de/d1c/d2b/c5d 0 2024-09-13T21:44:38.491 INFO:tasks.workunit.client.0.smithi119.stdout:8/238: symlink d1b/d4e/l52 0 2024-09-13T21:44:38.493 INFO:tasks.workunit.client.0.smithi119.stdout:6/251: sync 2024-09-13T21:44:38.494 INFO:tasks.workunit.client.0.smithi119.stdout:9/178: dread d0/d8/d18/d23/f29 [0,4194304] 0 2024-09-13T21:44:38.497 INFO:tasks.workunit.client.0.smithi119.stdout:4/223: fdatasync d4/f38 0 2024-09-13T21:44:38.500 INFO:tasks.workunit.client.0.smithi119.stdout:7/223: truncate d8/d19/d2e/d34/d42/f32 1100689 0 2024-09-13T21:44:38.503 INFO:tasks.workunit.client.0.smithi119.stdout:6/252: dwrite dc/dd/f38 [0,4194304] 0 2024-09-13T21:44:38.505 INFO:tasks.workunit.client.0.smithi119.stdout:9/179: unlink d0/d8/d18/d23/f34 0 2024-09-13T21:44:38.506 INFO:tasks.workunit.client.0.smithi119.stdout:4/224: write d4/f2b [1761196,114234] 0 2024-09-13T21:44:38.508 INFO:tasks.workunit.client.0.smithi119.stdout:3/197: dread d6/d15/f21 [0,4194304] 0 2024-09-13T21:44:38.508 INFO:tasks.workunit.client.0.smithi119.stdout:2/215: getdents d1/d2b 0 2024-09-13T21:44:38.508 INFO:tasks.workunit.client.0.smithi119.stdout:4/225: readlink l1 0 2024-09-13T21:44:38.510 INFO:tasks.workunit.client.0.smithi119.stdout:1/245: mkdir d1/d3/dc/d11/d19/d47/d4d 0 2024-09-13T21:44:38.511 INFO:tasks.workunit.client.0.smithi119.stdout:8/239: link f15 d1b/d4e/f53 0 2024-09-13T21:44:38.511 INFO:tasks.workunit.client.0.smithi119.stdout:1/246: chown d1/d3/f2a 102 1 2024-09-13T21:44:38.512 INFO:tasks.workunit.client.0.smithi119.stdout:0/232: creat de/f5e x:0 0 0 2024-09-13T21:44:38.515 INFO:tasks.workunit.client.0.smithi119.stdout:2/216: mknod d1/d7/c41 0 2024-09-13T21:44:38.518 INFO:tasks.workunit.client.0.smithi119.stdout:8/240: unlink c17 0 2024-09-13T21:44:38.519 INFO:tasks.workunit.client.0.smithi119.stdout:2/217: dread d1/f32 [0,4194304] 0 2024-09-13T21:44:38.520 INFO:tasks.workunit.client.0.smithi119.stdout:0/233: chown de/d1c/d2b/c2e 67383 1 2024-09-13T21:44:38.521 INFO:tasks.workunit.client.0.smithi119.stdout:5/166: write d0/d3/d4/d9/d14/f17 [1213051,58558] 0 2024-09-13T21:44:38.521 INFO:tasks.workunit.client.0.smithi119.stdout:3/198: chown d6/c3d 99757189 1 2024-09-13T21:44:38.522 INFO:tasks.workunit.client.0.smithi119.stdout:4/226: mkdir d4/d43 0 2024-09-13T21:44:38.523 INFO:tasks.workunit.client.0.smithi119.stdout:2/218: write d1/f32 [1326863,94467] 0 2024-09-13T21:44:38.524 INFO:tasks.workunit.client.0.smithi119.stdout:3/199: dread - d6/d15/d1a/f42 zero size 2024-09-13T21:44:38.525 INFO:tasks.workunit.client.0.smithi119.stdout:3/200: dread - d6/d15/f3f zero size 2024-09-13T21:44:38.526 INFO:tasks.workunit.client.0.smithi119.stdout:3/201: chown d6/d15/d1a 376535492 1 2024-09-13T21:44:38.530 INFO:tasks.workunit.client.0.smithi119.stdout:6/253: dread dc/dd/f2e [0,4194304] 0 2024-09-13T21:44:38.532 INFO:tasks.workunit.client.0.smithi119.stdout:6/254: write dc/f1b [1440760,53370] 0 2024-09-13T21:44:38.533 INFO:tasks.workunit.client.0.smithi119.stdout:2/219: creat d1/d22/f42 x:0 0 0 2024-09-13T21:44:38.535 INFO:tasks.workunit.client.0.smithi119.stdout:5/167: chown d0/d3/d4/d9/d14/c18 7471 1 2024-09-13T21:44:38.537 INFO:tasks.workunit.client.0.smithi119.stdout:1/247: creat d1/d3/dc/d11/f4e x:0 0 0 2024-09-13T21:44:38.537 INFO:tasks.workunit.client.0.smithi119.stdout:2/220: truncate d1/d22/f27 305435 0 2024-09-13T21:44:38.538 INFO:tasks.workunit.client.0.smithi119.stdout:3/202: dwrite d6/d15/d1a/f3c [0,4194304] 0 2024-09-13T21:44:38.539 INFO:tasks.workunit.client.0.smithi119.stdout:0/234: rename de/f1b to de/d1c/d2b/d34/f5f 0 2024-09-13T21:44:38.540 INFO:tasks.workunit.client.0.smithi119.stdout:4/227: mknod d4/c44 0 2024-09-13T21:44:38.543 INFO:tasks.workunit.client.0.smithi119.stdout:3/203: chown d6/d15/c32 59 1 2024-09-13T21:44:38.544 INFO:tasks.workunit.client.0.smithi119.stdout:2/221: symlink d1/d2b/d2c/l43 0 2024-09-13T21:44:38.545 INFO:tasks.workunit.client.0.smithi119.stdout:9/180: dwrite d0/d8/f10 [0,4194304] 0 2024-09-13T21:44:38.546 INFO:tasks.workunit.client.0.smithi119.stdout:1/248: chown d1/d3/dc/d11/d19/d2d/c4a 10902 1 2024-09-13T21:44:38.548 INFO:tasks.workunit.client.0.smithi119.stdout:8/241: rename d1b/d1d/d26/d2a to d1b/d1d/d48/d54 0 2024-09-13T21:44:38.551 INFO:tasks.workunit.client.0.smithi119.stdout:2/222: read d1/d7/f2a [1337916,59637] 0 2024-09-13T21:44:38.557 INFO:tasks.workunit.client.0.smithi119.stdout:0/235: creat de/d1c/d2f/d35/d4a/f60 x:0 0 0 2024-09-13T21:44:38.562 INFO:tasks.workunit.client.0.smithi119.stdout:8/242: symlink d1b/d1d/d39/l55 0 2024-09-13T21:44:38.564 INFO:tasks.workunit.client.1.smithi155.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T21:44:38.565 INFO:tasks.workunit.client.0.smithi119.stdout:5/168: dwrite d0/d3/d4/d9/d14/f29 [0,4194304] 0 2024-09-13T21:44:38.568 INFO:tasks.workunit.client.0.smithi119.stdout:2/223: creat d1/d2b/d2c/f44 x:0 0 0 2024-09-13T21:44:38.569 INFO:tasks.workunit.client.0.smithi119.stdout:6/255: rename dc/df/d34 to dc/d4b 0 2024-09-13T21:44:38.572 INFO:tasks.workunit.client.0.smithi119.stdout:9/181: link d0/d19/d1a/f1f d0/d8/d18/d23/f39 0 2024-09-13T21:44:38.573 INFO:tasks.workunit.client.0.smithi119.stdout:2/224: chown d1/d7/f9 457 1 2024-09-13T21:44:38.574 INFO:tasks.workunit.client.0.smithi119.stdout:1/249: dwrite d1/d3/f13 [4194304,4194304] 0 2024-09-13T21:44:38.574 INFO:tasks.workunit.client.0.smithi119.stdout:5/169: stat d0/d3/d4/d2e/l35 0 2024-09-13T21:44:38.578 INFO:tasks.workunit.client.0.smithi119.stdout:3/204: dwrite d6/d15/f35 [0,4194304] 0 2024-09-13T21:44:38.578 INFO:tasks.workunit.client.0.smithi119.stdout:9/182: dread d0/f2c [0,4194304] 0 2024-09-13T21:44:38.580 INFO:tasks.workunit.client.0.smithi119.stdout:8/243: mknod d1b/d1d/d48/d54/c56 0 2024-09-13T21:44:38.584 INFO:tasks.workunit.client.0.smithi119.stdout:4/228: truncate d4/f2b 1537529 0 2024-09-13T21:44:38.584 INFO:tasks.workunit.client.0.smithi119.stdout:6/256: creat dc/d3d/d40/f4c x:0 0 0 2024-09-13T21:44:38.587 INFO:tasks.workunit.client.0.smithi119.stdout:4/229: chown d4/d1e/d26 0 1 2024-09-13T21:44:38.587 INFO:tasks.workunit.client.1.smithi155.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T21:44:38.587 INFO:tasks.workunit.client.1.smithi155.stderr:+ make 2024-09-13T21:44:38.588 INFO:tasks.workunit.client.0.smithi119.stdout:3/205: write d6/d25/d2f/f3b [638457,33694] 0 2024-09-13T21:44:38.589 INFO:tasks.workunit.client.0.smithi119.stdout:3/206: stat d6/d25/c48 0 2024-09-13T21:44:38.590 INFO:tasks.workunit.client.0.smithi119.stdout:5/170: creat d0/d3/d4/d2e/f3d x:0 0 0 2024-09-13T21:44:38.590 INFO:tasks.workunit.client.0.smithi119.stdout:2/225: symlink d1/l45 0 2024-09-13T21:44:38.591 INFO:tasks.workunit.client.0.smithi119.stdout:1/250: mknod d1/d3/dc/d24/d2f/d31/c4f 0 2024-09-13T21:44:38.593 INFO:tasks.workunit.client.0.smithi119.stdout:8/244: read f5 [1233218,114102] 0 2024-09-13T21:44:38.595 INFO:tasks.workunit.client.0.smithi119.stdout:4/230: fsync d4/d1e/d28/d34/f3e 0 2024-09-13T21:44:38.599 INFO:tasks.workunit.client.0.smithi119.stdout:3/207: chown d6/f18 45658 1 2024-09-13T21:44:38.600 INFO:tasks.workunit.client.0.smithi119.stdout:9/183: symlink d0/d8/d18/d2f/l3a 0 2024-09-13T21:44:38.603 INFO:tasks.workunit.client.0.smithi119.stdout:6/257: mknod dc/df/c4d 0 2024-09-13T21:44:38.604 INFO:tasks.workunit.client.0.smithi119.stdout:5/171: symlink d0/d3/d4/l3e 0 2024-09-13T21:44:38.604 INFO:tasks.workunit.client.0.smithi119.stdout:3/208: chown d6/d15/f35 870 1 2024-09-13T21:44:38.605 INFO:tasks.workunit.client.0.smithi119.stdout:8/245: creat d1b/d1d/d48/d54/f57 x:0 0 0 2024-09-13T21:44:38.605 INFO:tasks.workunit.client.0.smithi119.stdout:2/226: dwrite d1/d22/f2d [0,4194304] 0 2024-09-13T21:44:38.608 INFO:tasks.workunit.client.0.smithi119.stdout:6/258: mkdir dc/d3d/d4e 0 2024-09-13T21:44:38.616 INFO:tasks.workunit.client.0.smithi119.stdout:3/209: chown d6/f14 1 1 2024-09-13T21:44:38.617 INFO:tasks.workunit.client.0.smithi119.stdout:1/251: dwrite d1/d3/dc/d24/d2f/d31/d32/f3e [0,4194304] 0 2024-09-13T21:44:38.618 INFO:tasks.workunit.client.0.smithi119.stdout:8/246: mkdir d1b/d1d/d48/d58 0 2024-09-13T21:44:38.620 INFO:tasks.workunit.client.0.smithi119.stdout:9/184: dwrite d0/d8/f10 [0,4194304] 0 2024-09-13T21:44:38.622 INFO:tasks.workunit.client.0.smithi119.stdout:0/236: dread de/d1c/f1d [0,4194304] 0 2024-09-13T21:44:38.622 INFO:tasks.workunit.client.0.smithi119.stdout:8/247: read - d1b/d1d/f4f zero size 2024-09-13T21:44:38.622 INFO:tasks.workunit.client.0.smithi119.stdout:3/210: write d6/d15/d1a/f28 [516241,127006] 0 2024-09-13T21:44:38.623 INFO:tasks.workunit.client.0.smithi119.stdout:6/259: creat dc/dd/f4f x:0 0 0 2024-09-13T21:44:38.626 INFO:tasks.workunit.client.0.smithi119.stdout:5/172: dwrite d0/d3/f12 [0,4194304] 0 2024-09-13T21:44:38.628 INFO:tasks.workunit.client.0.smithi119.stdout:9/185: creat d0/d19/d1a/f3b x:0 0 0 2024-09-13T21:44:38.629 INFO:tasks.workunit.client.0.smithi119.stdout:3/211: dread d6/d15/f21 [0,4194304] 0 2024-09-13T21:44:38.629 INFO:tasks.workunit.client.0.smithi119.stdout:8/248: fsync d1b/d4e/f53 0 2024-09-13T21:44:38.631 INFO:tasks.workunit.client.0.smithi119.stdout:1/252: creat d1/d3/dc/d24/d2f/d31/f50 x:0 0 0 2024-09-13T21:44:38.633 INFO:tasks.workunit.client.0.smithi119.stdout:8/249: dread - d1b/f1f zero size 2024-09-13T21:44:38.637 INFO:tasks.workunit.client.0.smithi119.stdout:2/227: rename d1/d2b/d2c/l43 to d1/l46 0 2024-09-13T21:44:38.640 INFO:tasks.workunit.client.0.smithi119.stdout:9/186: mknod d0/d8/c3c 0 2024-09-13T21:44:38.642 INFO:tasks.workunit.client.0.smithi119.stdout:3/212: dwrite d6/d25/d2f/f39 [0,4194304] 0 2024-09-13T21:44:38.645 INFO:tasks.workunit.client.0.smithi119.stdout:2/228: mkdir d1/d7/d47 0 2024-09-13T21:44:38.647 INFO:tasks.workunit.client.0.smithi119.stdout:1/253: link d1/d3/f2b d1/d3/dc/d11/d19/d2d/f51 0 2024-09-13T21:44:38.649 INFO:tasks.workunit.client.0.smithi119.stdout:2/229: creat d1/d2b/d2c/f48 x:0 0 0 2024-09-13T21:44:38.652 INFO:tasks.workunit.client.0.smithi119.stdout:8/250: dread d1b/d1d/d48/d54/f38 [0,4194304] 0 2024-09-13T21:44:38.657 INFO:tasks.workunit.client.0.smithi119.stdout:1/254: getdents d1/d3/dc/d24/d2f/d31/d32/d33/d43 0 2024-09-13T21:44:38.657 INFO:tasks.workunit.client.0.smithi119.stdout:9/187: dwrite d0/f2c [0,4194304] 0 2024-09-13T21:44:38.661 INFO:tasks.workunit.client.0.smithi119.stdout:8/251: symlink d1b/d1d/d48/d58/l59 0 2024-09-13T21:44:38.666 INFO:tasks.workunit.client.0.smithi119.stdout:2/230: dwrite d1/d22/f2d [0,4194304] 0 2024-09-13T21:44:38.667 INFO:tasks.workunit.client.0.smithi119.stdout:9/188: mknod d0/d8/d18/d23/d27/c3d 0 2024-09-13T21:44:38.667 INFO:tasks.workunit.client.0.smithi119.stdout:2/231: chown d1/d22 0 1 2024-09-13T21:44:38.669 INFO:tasks.workunit.client.0.smithi119.stdout:0/237: dwrite de/d1c/d2b/f32 [0,4194304] 0 2024-09-13T21:44:38.672 INFO:tasks.workunit.client.0.smithi119.stdout:8/252: creat d1b/d4e/f5a x:0 0 0 2024-09-13T21:44:38.673 INFO:tasks.workunit.client.0.smithi119.stdout:2/232: write d1/d2b/d2c/f48 [901232,119059] 0 2024-09-13T21:44:38.675 INFO:tasks.workunit.client.0.smithi119.stdout:0/238: write de/f12 [210686,111392] 0 2024-09-13T21:44:38.677 INFO:tasks.workunit.client.0.smithi119.stdout:3/213: dwrite d6/f29 [0,4194304] 0 2024-09-13T21:44:38.680 INFO:tasks.workunit.client.0.smithi119.stdout:0/239: chown de/d1c/d2f/d35/l56 57 1 2024-09-13T21:44:38.681 INFO:tasks.workunit.client.0.smithi119.stdout:2/233: mknod d1/d2b/d2c/d31/d36/c49 0 2024-09-13T21:44:38.682 INFO:tasks.workunit.client.0.smithi119.stdout:3/214: stat d6/fc 0 2024-09-13T21:44:38.683 INFO:tasks.workunit.client.0.smithi119.stdout:0/240: dread - de/d49/f4c zero size 2024-09-13T21:44:38.684 INFO:tasks.workunit.client.0.smithi119.stdout:1/255: getdents d1/d3/dc/d24/d2f 0 2024-09-13T21:44:38.685 INFO:tasks.workunit.client.0.smithi119.stdout:2/234: write d1/d7/f2a [578437,47280] 0 2024-09-13T21:44:38.686 INFO:tasks.workunit.client.0.smithi119.stdout:1/256: dread - d1/d3/dc/d11/d19/d2d/f44 zero size 2024-09-13T21:44:38.689 INFO:tasks.workunit.client.0.smithi119.stdout:0/241: fsync de/f22 0 2024-09-13T21:44:38.691 INFO:tasks.workunit.client.0.smithi119.stdout:1/257: symlink d1/d3/dc/l52 0 2024-09-13T21:44:38.692 INFO:tasks.workunit.client.0.smithi119.stdout:3/215: rename d6/le to d6/l49 0 2024-09-13T21:44:38.693 INFO:tasks.workunit.client.0.smithi119.stdout:1/258: write d1/d3/dc/d24/d2f/d31/d32/f4b [604996,5335] 0 2024-09-13T21:44:38.695 INFO:tasks.workunit.client.0.smithi119.stdout:3/216: symlink d6/d25/d2f/d33/l4a 0 2024-09-13T21:44:38.696 INFO:tasks.workunit.client.0.smithi119.stdout:0/242: rename de/f12 to de/f61 0 2024-09-13T21:44:38.697 INFO:tasks.workunit.client.0.smithi119.stdout:1/259: mkdir d1/d3/dc/d24/d2f/d53 0 2024-09-13T21:44:38.697 INFO:tasks.workunit.client.0.smithi119.stdout:0/243: chown de/d1c/d2f/d35/l56 7967309 1 2024-09-13T21:44:38.698 INFO:tasks.workunit.client.0.smithi119.stdout:3/217: symlink d6/d15/d1a/d45/d47/l4b 0 2024-09-13T21:44:38.698 INFO:tasks.workunit.client.0.smithi119.stdout:1/260: chown d1/d3/dc/d24/d2f/d31/d32/f3e 164 1 2024-09-13T21:44:38.700 INFO:tasks.workunit.client.0.smithi119.stdout:0/244: fdatasync fd 0 2024-09-13T21:44:38.701 INFO:tasks.workunit.client.0.smithi119.stdout:3/218: symlink d6/d15/d1a/d45/l4c 0 2024-09-13T21:44:38.703 INFO:tasks.workunit.client.0.smithi119.stdout:0/245: mkdir de/d1c/d2f/d35/d4a/d62 0 2024-09-13T21:44:38.705 INFO:tasks.workunit.client.0.smithi119.stdout:3/219: mkdir d6/d15/d1a/d45/d47/d4d 0 2024-09-13T21:44:38.707 INFO:tasks.workunit.client.0.smithi119.stdout:1/261: getdents d1/d3 0 2024-09-13T21:44:38.707 INFO:tasks.workunit.client.0.smithi119.stdout:3/220: fdatasync d6/d15/d1a/f42 0 2024-09-13T21:44:38.708 INFO:tasks.workunit.client.0.smithi119.stdout:0/246: dread de/d1c/f36 [0,4194304] 0 2024-09-13T21:44:38.710 INFO:tasks.workunit.client.0.smithi119.stdout:1/262: mknod d1/d3/dc/d11/d3d/c54 0 2024-09-13T21:44:38.712 INFO:tasks.workunit.client.0.smithi119.stdout:0/247: dread de/d1c/f27 [0,4194304] 0 2024-09-13T21:44:38.716 INFO:tasks.workunit.client.0.smithi119.stdout:3/221: dwrite d6/f46 [0,4194304] 0 2024-09-13T21:44:38.718 INFO:tasks.workunit.client.0.smithi119.stdout:0/248: mknod de/d1c/d2f/d35/d4a/c63 0 2024-09-13T21:44:38.720 INFO:tasks.workunit.client.0.smithi119.stdout:1/263: dwrite d1/f26 [4194304,4194304] 0 2024-09-13T21:44:38.727 INFO:tasks.workunit.client.0.smithi119.stdout:1/264: unlink d1/d3/dc/d11/f4e 0 2024-09-13T21:44:38.728 INFO:tasks.workunit.client.0.smithi119.stdout:3/222: dwrite d6/d15/d1a/f42 [0,4194304] 0 2024-09-13T21:44:38.730 INFO:tasks.workunit.client.0.smithi119.stdout:0/249: dwrite de/d1c/d2f/f43 [0,4194304] 0 2024-09-13T21:44:38.731 INFO:tasks.workunit.client.0.smithi119.stdout:3/223: truncate d6/d25/d2f/f3b 947815 0 2024-09-13T21:44:38.732 INFO:tasks.workunit.client.0.smithi119.stdout:3/224: fdatasync d6/d15/d1a/f28 0 2024-09-13T21:44:38.733 INFO:tasks.workunit.client.0.smithi119.stdout:1/265: mknod d1/d3/dc/d24/d2f/d31/d32/d33/c55 0 2024-09-13T21:44:38.734 INFO:tasks.workunit.client.0.smithi119.stdout:3/225: chown d6/d15/d1a/c27 21937991 1 2024-09-13T21:44:38.753 INFO:tasks.workunit.client.0.smithi119.stdout:0/250: truncate de/d1c/f1d 6808530 0 2024-09-13T21:44:38.754 INFO:tasks.workunit.client.0.smithi119.stdout:0/251: fdatasync de/f5e 0 2024-09-13T21:44:38.754 INFO:tasks.workunit.client.0.smithi119.stdout:3/226: truncate d6/d15/d1a/f42 2662559 0 2024-09-13T21:44:38.755 INFO:tasks.workunit.client.0.smithi119.stdout:3/227: chown d6/cd 9763 1 2024-09-13T21:44:38.761 INFO:tasks.workunit.client.0.smithi119.stdout:3/228: dwrite d6/d25/f2a [0,4194304] 0 2024-09-13T21:44:38.768 INFO:tasks.workunit.client.0.smithi119.stdout:0/252: dread de/f22 [0,4194304] 0 2024-09-13T21:44:38.773 INFO:tasks.workunit.client.0.smithi119.stdout:3/229: dwrite d6/fc [0,4194304] 0 2024-09-13T21:44:38.775 INFO:tasks.workunit.client.0.smithi119.stdout:0/253: dread de/f10 [4194304,4194304] 0 2024-09-13T21:44:38.775 INFO:tasks.workunit.client.0.smithi119.stdout:3/230: write d6/d25/d2f/d33/f43 [633062,22386] 0 2024-09-13T21:44:38.778 INFO:tasks.workunit.client.0.smithi119.stdout:0/254: mkdir de/d1c/d64 0 2024-09-13T21:44:38.780 INFO:tasks.workunit.client.0.smithi119.stdout:0/255: symlink de/d1c/d59/l65 0 2024-09-13T21:44:38.782 INFO:tasks.workunit.client.0.smithi119.stdout:0/256: mkdir de/d1c/d2f/d40/d66 0 2024-09-13T21:44:38.786 INFO:tasks.workunit.client.0.smithi119.stdout:3/231: dread d6/f18 [0,4194304] 0 2024-09-13T21:44:38.787 INFO:tasks.workunit.client.0.smithi119.stdout:3/232: write d6/d25/d2f/f39 [2426092,112886] 0 2024-09-13T21:44:38.789 INFO:tasks.workunit.client.0.smithi119.stdout:3/233: mknod d6/d15/d1a/d45/c4e 0 2024-09-13T21:44:38.791 INFO:tasks.workunit.client.0.smithi119.stdout:3/234: write d6/fa [117206,45135] 0 2024-09-13T21:44:38.795 INFO:tasks.workunit.client.0.smithi119.stdout:3/235: rename d6/d15/l2c to d6/d15/d1a/d45/d47/l4f 0 2024-09-13T21:44:38.799 INFO:tasks.workunit.client.1.smithi155.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T21:44:38.804 INFO:tasks.workunit.client.0.smithi119.stdout:3/236: dwrite d6/f1c [0,4194304] 0 2024-09-13T21:44:38.809 INFO:tasks.workunit.client.0.smithi119.stdout:3/237: rename d6/d25/d2f/c36 to d6/d15/d1a/d45/d47/c50 0 2024-09-13T21:44:38.810 INFO:tasks.workunit.client.0.smithi119.stdout:3/238: write d6/d15/d1a/f42 [1280236,20097] 0 2024-09-13T21:44:38.813 INFO:tasks.workunit.client.0.smithi119.stdout:3/239: getdents d6/d25 0 2024-09-13T21:44:38.816 INFO:tasks.workunit.client.0.smithi119.stdout:3/240: creat d6/d44/f51 x:0 0 0 2024-09-13T21:44:38.817 INFO:tasks.workunit.client.0.smithi119.stdout:3/241: mkdir d6/d44/d52 0 2024-09-13T21:44:38.818 INFO:tasks.workunit.client.0.smithi119.stdout:3/242: rmdir d6/d15/d1a/d45 39 2024-09-13T21:44:38.819 INFO:tasks.workunit.client.0.smithi119.stdout:3/243: fdatasync d6/d15/d1a/f3a 0 2024-09-13T21:44:38.822 INFO:tasks.workunit.client.0.smithi119.stdout:3/244: rename d6/d15/d1a/d45/c4e to d6/d25/d2f/d33/c53 0 2024-09-13T21:44:38.823 INFO:tasks.workunit.client.0.smithi119.stdout:3/245: mknod d6/d15/d1a/c54 0 2024-09-13T21:44:38.830 INFO:tasks.workunit.client.0.smithi119.stdout:3/246: dwrite d6/f46 [0,4194304] 0 2024-09-13T21:44:38.833 INFO:tasks.workunit.client.0.smithi119.stdout:3/247: creat d6/d15/d1a/f55 x:0 0 0 2024-09-13T21:44:38.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:38 smithi155 ceph-mon[34732]: Checking for cert/key for grafana.smithi119 2024-09-13T21:44:38.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:38 smithi155 ceph-mon[34732]: Migrating grafana.smithi119 cert to cert store 2024-09-13T21:44:38.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:38 smithi155 ceph-mon[34732]: Migrating grafana.smithi119 key to cert store 2024-09-13T21:44:38.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:38 smithi155 ceph-mon[34732]: mgrmap e22: smithi155.wuuxfd(active, since 1.01062s) 2024-09-13T21:44:38.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:38 smithi155 ceph-mon[34732]: pgmap v3: 65 pgs: 65 active+clean; 555 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-09-13T21:44:38.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:38 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:38.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:38 smithi155 ceph-mon[34732]: Deploying cephadm binary to smithi119 2024-09-13T21:44:38.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:38 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:38.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:38 smithi155 ceph-mon[34732]: Deploying cephadm binary to smithi155 2024-09-13T21:44:38.834 INFO:tasks.workunit.client.0.smithi119.stdout:3/248: mkdir d6/d25/d2f/d33/d56 0 2024-09-13T21:44:38.836 INFO:tasks.workunit.client.0.smithi119.stdout:3/249: creat d6/d25/d2f/f57 x:0 0 0 2024-09-13T21:44:38.838 INFO:tasks.workunit.client.0.smithi119.stdout:3/250: dread d6/d15/d1a/f42 [0,4194304] 0 2024-09-13T21:44:38.841 INFO:tasks.workunit.client.0.smithi119.stdout:3/251: creat d6/d44/d52/f58 x:0 0 0 2024-09-13T21:44:38.842 INFO:tasks.workunit.client.0.smithi119.stdout:3/252: fdatasync d6/d15/d1a/f28 0 2024-09-13T21:44:38.846 INFO:tasks.workunit.client.0.smithi119.stdout:3/253: dread d6/d25/d2f/d33/f43 [0,4194304] 0 2024-09-13T21:44:38.847 INFO:tasks.workunit.client.0.smithi119.stdout:3/254: truncate d6/d15/d1a/f55 496154 0 2024-09-13T21:44:38.848 INFO:tasks.workunit.client.0.smithi119.stdout:3/255: dread - d6/d25/d2f/f57 zero size 2024-09-13T21:44:38.849 INFO:tasks.workunit.client.0.smithi119.stdout:3/256: mknod d6/d15/d1a/d45/c59 0 2024-09-13T21:44:38.853 INFO:tasks.workunit.client.0.smithi119.stdout:3/257: dread d6/fc [0,4194304] 0 2024-09-13T21:44:38.857 INFO:tasks.workunit.client.0.smithi119.stdout:3/258: dread d6/d25/d2f/f3b [0,4194304] 0 2024-09-13T21:44:38.857 INFO:tasks.workunit.client.0.smithi119.stdout:3/259: chown d6/d25/d2f/f57 3053178 1 2024-09-13T21:44:38.858 INFO:tasks.workunit.client.0.smithi119.stdout:3/260: rmdir d6 39 2024-09-13T21:44:38.861 INFO:tasks.workunit.client.0.smithi119.stdout:3/261: creat d6/d44/f5a x:0 0 0 2024-09-13T21:44:38.862 INFO:tasks.workunit.client.0.smithi119.stdout:3/262: chown d6/ff 2660415 1 2024-09-13T21:44:38.864 INFO:tasks.workunit.client.0.smithi119.stdout:3/263: truncate d6/f14 605562 0 2024-09-13T21:44:38.864 INFO:tasks.workunit.client.0.smithi119.stdout:3/264: chown d6 3649 1 2024-09-13T21:44:38.865 INFO:tasks.workunit.client.0.smithi119.stdout:3/265: chown d6/d25/d2f/d33/d56 23469 1 2024-09-13T21:44:38.867 INFO:tasks.workunit.client.0.smithi119.stdout:3/266: creat d6/d15/d1a/f5b x:0 0 0 2024-09-13T21:44:38.868 INFO:tasks.workunit.client.0.smithi119.stdout:3/267: rmdir d6/d15/d1a/d45 39 2024-09-13T21:44:38.869 INFO:tasks.workunit.client.0.smithi119.stdout:3/268: read d6/f46 [3162641,1109] 0 2024-09-13T21:44:38.870 INFO:tasks.workunit.client.0.smithi119.stdout:3/269: stat d6/d15/d1a/d45/d47/d4d 0 2024-09-13T21:44:38.873 INFO:tasks.workunit.client.0.smithi119.stdout:3/270: dread d6/f1c [0,4194304] 0 2024-09-13T21:44:38.873 INFO:tasks.workunit.client.0.smithi119.stdout:3/271: chown d6/ff 480628809 1 2024-09-13T21:44:38.876 INFO:tasks.workunit.client.0.smithi119.stdout:3/272: dread d6/d15/d1a/f42 [0,4194304] 0 2024-09-13T21:44:38.878 INFO:tasks.workunit.client.0.smithi119.stdout:3/273: mknod d6/d15/d1a/c5c 0 2024-09-13T21:44:38.879 INFO:tasks.workunit.client.0.smithi119.stdout:3/274: mknod d6/d15/d1a/d45/d47/c5d 0 2024-09-13T21:44:38.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:38 smithi119 ceph-mon[27653]: Checking for cert/key for grafana.smithi119 2024-09-13T21:44:38.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:38 smithi119 ceph-mon[27653]: Migrating grafana.smithi119 cert to cert store 2024-09-13T21:44:38.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:38 smithi119 ceph-mon[27653]: Migrating grafana.smithi119 key to cert store 2024-09-13T21:44:38.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:38 smithi119 ceph-mon[27653]: mgrmap e22: smithi155.wuuxfd(active, since 1.01062s) 2024-09-13T21:44:38.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:38 smithi119 ceph-mon[27653]: pgmap v3: 65 pgs: 65 active+clean; 555 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-09-13T21:44:38.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:38 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:38.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:38 smithi119 ceph-mon[27653]: Deploying cephadm binary to smithi119 2024-09-13T21:44:38.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:38 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:38.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:38 smithi119 ceph-mon[27653]: Deploying cephadm binary to smithi155 2024-09-13T21:44:38.886 INFO:tasks.workunit.client.0.smithi119.stdout:3/275: dwrite d6/f46 [0,4194304] 0 2024-09-13T21:44:38.887 INFO:tasks.workunit.client.0.smithi119.stdout:3/276: write d6/f46 [5046000,1304] 0 2024-09-13T21:44:38.889 INFO:tasks.workunit.client.0.smithi119.stdout:3/277: write d6/d15/f35 [4370616,48650] 0 2024-09-13T21:44:38.899 INFO:tasks.workunit.client.0.smithi119.stdout:3/278: dwrite d6/d25/d2f/f3b [0,4194304] 0 2024-09-13T21:44:38.986 INFO:tasks.workunit.client.0.smithi119.stdout:7/224: sync 2024-09-13T21:44:38.986 INFO:tasks.workunit.client.0.smithi119.stdout:7/225: chown d8/c26 2031848669 1 2024-09-13T21:44:39.188 INFO:tasks.workunit.client.0.smithi119.stdout:4/231: sync 2024-09-13T21:44:39.189 INFO:tasks.workunit.client.0.smithi119.stdout:4/232: stat d4/c9 0 2024-09-13T21:44:39.193 INFO:tasks.workunit.client.0.smithi119.stdout:4/233: dread d4/d1e/d28/f24 [0,4194304] 0 2024-09-13T21:44:39.198 INFO:tasks.workunit.client.0.smithi119.stdout:4/234: dwrite d4/f40 [0,4194304] 0 2024-09-13T21:44:39.199 INFO:tasks.workunit.client.0.smithi119.stdout:4/235: write d4/d1e/d28/f42 [105395,57546] 0 2024-09-13T21:44:39.203 INFO:tasks.workunit.client.0.smithi119.stdout:4/236: creat d4/d1e/d26/d41/f45 x:0 0 0 2024-09-13T21:44:39.203 INFO:tasks.workunit.client.0.smithi119.stdout:4/237: stat d4/d1e/d28/d34 0 2024-09-13T21:44:39.210 INFO:tasks.workunit.client.0.smithi119.stdout:4/238: dwrite d4/d1e/d28/f2c [0,4194304] 0 2024-09-13T21:44:39.217 INFO:tasks.workunit.client.0.smithi119.stdout:4/239: dwrite d4/d1e/d26/d41/f45 [0,4194304] 0 2024-09-13T21:44:39.220 INFO:tasks.workunit.client.0.smithi119.stdout:4/240: chown d4/f21 3774 1 2024-09-13T21:44:39.222 INFO:tasks.workunit.client.0.smithi119.stdout:4/241: write d4/f40 [520225,113620] 0 2024-09-13T21:44:39.225 INFO:tasks.workunit.client.0.smithi119.stdout:4/242: rmdir d4/d1e/d28/d3c 0 2024-09-13T21:44:39.295 INFO:tasks.workunit.client.0.smithi119.stdout:2/235: sync 2024-09-13T21:44:39.296 INFO:tasks.workunit.client.0.smithi119.stdout:7/226: sync 2024-09-13T21:44:39.296 INFO:tasks.workunit.client.0.smithi119.stdout:8/253: sync 2024-09-13T21:44:39.296 INFO:tasks.workunit.client.0.smithi119.stdout:9/189: sync 2024-09-13T21:44:39.296 INFO:tasks.workunit.client.0.smithi119.stdout:5/173: sync 2024-09-13T21:44:39.296 INFO:tasks.workunit.client.0.smithi119.stdout:3/279: sync 2024-09-13T21:44:39.296 INFO:tasks.workunit.client.0.smithi119.stdout:6/260: sync 2024-09-13T21:44:39.296 INFO:tasks.workunit.client.0.smithi119.stdout:0/257: sync 2024-09-13T21:44:39.296 INFO:tasks.workunit.client.0.smithi119.stdout:1/266: sync 2024-09-13T21:44:39.296 INFO:tasks.workunit.client.0.smithi119.stdout:8/254: readlink l1a 0 2024-09-13T21:44:39.298 INFO:tasks.workunit.client.0.smithi119.stdout:8/255: write f13 [4462936,116559] 0 2024-09-13T21:44:39.298 INFO:tasks.workunit.client.0.smithi119.stdout:6/261: rmdir dc/dd 39 2024-09-13T21:44:39.300 INFO:tasks.workunit.client.0.smithi119.stdout:0/258: write de/d1c/d2f/f41 [664883,56590] 0 2024-09-13T21:44:39.300 INFO:tasks.workunit.client.0.smithi119.stdout:1/267: dread d1/d3/f4 [0,4194304] 0 2024-09-13T21:44:39.302 INFO:tasks.workunit.client.0.smithi119.stdout:7/227: mkdir d8/d19/d2e/d34/d42/d47 0 2024-09-13T21:44:39.302 INFO:tasks.workunit.client.0.smithi119.stdout:2/236: write d1/d7/fd [895435,94657] 0 2024-09-13T21:44:39.304 INFO:tasks.workunit.client.0.smithi119.stdout:9/190: creat d0/d19/d1a/d2b/f3e x:0 0 0 2024-09-13T21:44:39.305 INFO:tasks.workunit.client.0.smithi119.stdout:6/262: chown dc/dd/c28 667 1 2024-09-13T21:44:39.306 INFO:tasks.workunit.client.0.smithi119.stdout:6/263: stat dc/df/f24 0 2024-09-13T21:44:39.307 INFO:tasks.workunit.client.0.smithi119.stdout:1/268: rmdir d1/d3/dc/d11 39 2024-09-13T21:44:39.309 INFO:tasks.workunit.client.0.smithi119.stdout:3/280: creat d6/d25/d2f/d33/d56/f5e x:0 0 0 2024-09-13T21:44:39.311 INFO:tasks.workunit.client.0.smithi119.stdout:7/228: mkdir d8/d19/d22/d3b/d48 0 2024-09-13T21:44:39.313 INFO:tasks.workunit.client.0.smithi119.stdout:6/264: mknod dc/d3d/c50 0 2024-09-13T21:44:39.315 INFO:tasks.workunit.client.0.smithi119.stdout:5/174: link d0/d3/d4/d9/d14/c18 d0/d3/d1f/c3f 0 2024-09-13T21:44:39.316 INFO:tasks.workunit.client.0.smithi119.stdout:2/237: creat d1/f4a x:0 0 0 2024-09-13T21:44:39.316 INFO:tasks.workunit.client.0.smithi119.stdout:6/265: truncate dc/df/f27 389212 0 2024-09-13T21:44:39.317 INFO:tasks.workunit.client.0.smithi119.stdout:7/229: dread d8/f31 [0,4194304] 0 2024-09-13T21:44:39.318 INFO:tasks.workunit.client.0.smithi119.stdout:9/191: getdents d0/d8/d18/d23 0 2024-09-13T21:44:39.320 INFO:tasks.workunit.client.0.smithi119.stdout:9/192: fsync d0/f2c 0 2024-09-13T21:44:39.322 INFO:tasks.workunit.client.0.smithi119.stdout:2/238: rename d1/d7/cc to d1/d2b/d2c/d31/c4b 0 2024-09-13T21:44:39.323 INFO:tasks.workunit.client.0.smithi119.stdout:3/281: dwrite d6/f1c [4194304,4194304] 0 2024-09-13T21:44:39.324 INFO:tasks.workunit.client.0.smithi119.stdout:9/193: read d0/d8/d18/d23/d27/f17 [138451,43584] 0 2024-09-13T21:44:39.326 INFO:tasks.workunit.client.0.smithi119.stdout:6/266: getdents dc/df 0 2024-09-13T21:44:39.327 INFO:tasks.workunit.client.0.smithi119.stdout:6/267: stat dc/df/f44 0 2024-09-13T21:44:39.327 INFO:tasks.workunit.client.0.smithi119.stdout:9/194: write d0/d8/f10 [4357239,4029] 0 2024-09-13T21:44:39.329 INFO:tasks.workunit.client.0.smithi119.stdout:3/282: dread d6/d25/d2f/d33/f43 [0,4194304] 0 2024-09-13T21:44:39.332 INFO:tasks.workunit.client.0.smithi119.stdout:2/239: creat d1/d22/f4c x:0 0 0 2024-09-13T21:44:39.334 INFO:tasks.workunit.client.0.smithi119.stdout:7/230: fsync d8/d19/d2e/d34/d42/f32 0 2024-09-13T21:44:39.335 INFO:tasks.workunit.client.0.smithi119.stdout:6/268: rmdir dc/d3d/d40 39 2024-09-13T21:44:39.335 INFO:tasks.workunit.client.0.smithi119.stdout:2/240: dread d1/f32 [0,4194304] 0 2024-09-13T21:44:39.336 INFO:tasks.workunit.client.0.smithi119.stdout:7/231: chown d8/d19/d22/c36 96522 1 2024-09-13T21:44:39.337 INFO:tasks.workunit.client.0.smithi119.stdout:3/283: chown c3 62 1 2024-09-13T21:44:39.337 INFO:tasks.workunit.client.0.smithi119.stdout:5/175: link d0/d3/d4/d9/l39 d0/d3/d4/d9/l40 0 2024-09-13T21:44:39.338 INFO:tasks.workunit.client.0.smithi119.stdout:5/176: readlink d0/l2 0 2024-09-13T21:44:39.338 INFO:tasks.workunit.client.0.smithi119.stdout:2/241: write d1/d2b/d2c/f48 [1773203,4795] 0 2024-09-13T21:44:39.338 INFO:tasks.workunit.client.0.smithi119.stdout:7/232: chown d8/d19/d2e/d34/d42/f2d 769087 1 2024-09-13T21:44:39.339 INFO:tasks.workunit.client.0.smithi119.stdout:2/242: fdatasync d1/f3d 0 2024-09-13T21:44:39.340 INFO:tasks.workunit.client.0.smithi119.stdout:3/284: truncate d6/d15/d1a/f41 470248 0 2024-09-13T21:44:39.343 INFO:tasks.workunit.client.0.smithi119.stdout:6/269: fdatasync dc/d37/f48 0 2024-09-13T21:44:39.345 INFO:tasks.workunit.client.0.smithi119.stdout:2/243: symlink d1/d2b/d2c/l4d 0 2024-09-13T21:44:39.348 INFO:tasks.workunit.client.0.smithi119.stdout:7/233: creat d8/d19/d22/d3b/d48/f49 x:0 0 0 2024-09-13T21:44:39.349 INFO:tasks.workunit.client.0.smithi119.stdout:9/195: getdents d0/d8/d18/d23/d27 0 2024-09-13T21:44:39.352 INFO:tasks.workunit.client.0.smithi119.stdout:2/244: rename d1/d2b/d2c/f3a to d1/d2b/f4e 0 2024-09-13T21:44:39.352 INFO:tasks.workunit.client.0.smithi119.stdout:5/177: link d0/d3/d4/c26 d0/d3/d4/d9/d14/d24/d25/c41 0 2024-09-13T21:44:39.353 INFO:tasks.workunit.client.0.smithi119.stdout:3/285: dwrite d6/f11 [0,4194304] 0 2024-09-13T21:44:39.356 INFO:tasks.workunit.client.0.smithi119.stdout:9/196: creat d0/d8/d18/d23/d27/f3f x:0 0 0 2024-09-13T21:44:39.356 INFO:tasks.workunit.client.0.smithi119.stdout:4/243: sync 2024-09-13T21:44:39.360 INFO:tasks.workunit.client.0.smithi119.stdout:7/234: dwrite d8/d19/d22/f2b [0,4194304] 0 2024-09-13T21:44:39.362 INFO:tasks.workunit.client.0.smithi119.stdout:9/197: creat d0/d19/d1a/f40 x:0 0 0 2024-09-13T21:44:39.363 INFO:tasks.workunit.client.0.smithi119.stdout:7/235: write d8/d19/d2e/d34/d42/f12 [2259435,10949] 0 2024-09-13T21:44:39.395 INFO:tasks.workunit.client.0.smithi119.stdout:4/244: rename d4/d1e/f20 to d4/d1e/d10/f46 0 2024-09-13T21:44:39.395 INFO:tasks.workunit.client.0.smithi119.stdout:3/286: truncate d6/d15/f35 4312048 0 2024-09-13T21:44:39.395 INFO:tasks.workunit.client.0.smithi119.stdout:3/287: read - d6/d44/f51 zero size 2024-09-13T21:44:39.396 INFO:tasks.workunit.client.0.smithi119.stdout:3/288: fsync d6/fa 0 2024-09-13T21:44:39.399 INFO:tasks.workunit.client.0.smithi119.stdout:4/245: truncate d4/f29 149225 0 2024-09-13T21:44:39.399 INFO:tasks.workunit.client.0.smithi119.stdout:5/178: link d0/d3/d4/d9/l16 d0/d3/d4/d9/l42 0 2024-09-13T21:44:39.401 INFO:tasks.workunit.client.0.smithi119.stdout:3/289: creat d6/d15/d1a/d45/f5f x:0 0 0 2024-09-13T21:44:39.404 INFO:tasks.workunit.client.0.smithi119.stdout:4/246: unlink d4/d1e/d10/f1a 0 2024-09-13T21:44:39.405 INFO:tasks.workunit.client.0.smithi119.stdout:3/290: readlink d6/d15/d1a/d45/d47/l4f 0 2024-09-13T21:44:39.408 INFO:tasks.workunit.client.0.smithi119.stdout:5/179: dwrite d0/d3/f1a [0,4194304] 0 2024-09-13T21:44:39.415 INFO:tasks.workunit.client.0.smithi119.stdout:3/291: rename d6/d25/d2f/d33/f43 to d6/d25/d2f/f60 0 2024-09-13T21:44:39.416 INFO:tasks.workunit.client.0.smithi119.stdout:9/198: dwrite d0/d19/f30 [0,4194304] 0 2024-09-13T21:44:39.420 INFO:tasks.workunit.client.0.smithi119.stdout:3/292: creat d6/d25/f61 x:0 0 0 2024-09-13T21:44:39.420 INFO:tasks.workunit.client.0.smithi119.stdout:9/199: rmdir d0/d8 39 2024-09-13T21:44:39.424 INFO:tasks.workunit.client.0.smithi119.stdout:9/200: mknod d0/d19/c41 0 2024-09-13T21:44:39.425 INFO:tasks.workunit.client.0.smithi119.stdout:3/293: mknod d6/d15/c62 0 2024-09-13T21:44:39.429 INFO:tasks.workunit.client.0.smithi119.stdout:9/201: mkdir d0/d8/d18/d23/d42 0 2024-09-13T21:44:39.429 INFO:tasks.workunit.client.0.smithi119.stdout:5/180: dread d0/d3/d1f/f30 [0,4194304] 0 2024-09-13T21:44:39.432 INFO:tasks.workunit.client.0.smithi119.stdout:9/202: creat d0/d19/d1a/d2b/f43 x:0 0 0 2024-09-13T21:44:39.433 INFO:tasks.workunit.client.0.smithi119.stdout:5/181: symlink d0/d3/d4/d9/d14/l43 0 2024-09-13T21:44:39.433 INFO:tasks.workunit.client.0.smithi119.stdout:3/294: dwrite d6/d15/d1a/f3c [0,4194304] 0 2024-09-13T21:44:39.434 INFO:tasks.workunit.client.0.smithi119.stdout:3/295: read d6/f29 [1020612,53236] 0 2024-09-13T21:44:39.437 INFO:tasks.workunit.client.0.smithi119.stdout:4/247: dread d4/f27 [0,4194304] 0 2024-09-13T21:44:39.437 INFO:tasks.workunit.client.0.smithi119.stdout:9/203: truncate d0/d19/d1a/d2b/f3e 592520 0 2024-09-13T21:44:39.438 INFO:tasks.workunit.client.0.smithi119.stdout:3/296: chown d6/d15/c32 9097 1 2024-09-13T21:44:39.441 INFO:tasks.workunit.client.0.smithi119.stdout:9/204: creat d0/d19/f44 x:0 0 0 2024-09-13T21:44:39.443 INFO:tasks.workunit.client.0.smithi119.stdout:3/297: rmdir d6/d15 39 2024-09-13T21:44:39.444 INFO:tasks.workunit.client.0.smithi119.stdout:5/182: dwrite d0/d3/d1f/d21/f34 [0,4194304] 0 2024-09-13T21:44:39.446 INFO:tasks.workunit.client.0.smithi119.stdout:5/183: chown d0/d3/d4/d9/c1c 252200374 1 2024-09-13T21:44:39.446 INFO:tasks.workunit.client.0.smithi119.stdout:4/248: rmdir d4/d43 0 2024-09-13T21:44:39.448 INFO:tasks.workunit.client.0.smithi119.stdout:9/205: mknod d0/d19/d1a/c45 0 2024-09-13T21:44:39.449 INFO:tasks.workunit.client.0.smithi119.stdout:4/249: write d4/d1e/d28/d34/f3e [1273662,10642] 0 2024-09-13T21:44:39.449 INFO:tasks.workunit.client.0.smithi119.stdout:5/184: dread - d0/d3/d4/d9/d14/d24/d25/f36 zero size 2024-09-13T21:44:39.452 INFO:tasks.workunit.client.0.smithi119.stdout:3/298: creat d6/d15/f63 x:0 0 0 2024-09-13T21:44:39.452 INFO:tasks.workunit.client.0.smithi119.stdout:4/250: read d4/d1e/d26/f2d [430750,40608] 0 2024-09-13T21:44:39.457 INFO:tasks.workunit.client.0.smithi119.stdout:4/251: readlink d4/l23 0 2024-09-13T21:44:39.458 INFO:tasks.workunit.client.0.smithi119.stdout:3/299: dread d6/f11 [0,4194304] 0 2024-09-13T21:44:39.459 INFO:tasks.workunit.client.0.smithi119.stdout:9/206: getdents d0/d8/d18 0 2024-09-13T21:44:39.461 INFO:tasks.workunit.client.0.smithi119.stdout:4/252: rename d4/c9 to d4/d1e/d26/d41/c47 0 2024-09-13T21:44:39.462 INFO:tasks.workunit.client.0.smithi119.stdout:9/207: creat d0/d19/f46 x:0 0 0 2024-09-13T21:44:39.465 INFO:tasks.workunit.client.0.smithi119.stdout:9/208: symlink d0/d19/d1a/l47 0 2024-09-13T21:44:39.466 INFO:tasks.workunit.client.0.smithi119.stdout:5/185: dread d0/d3/d4/d9/d14/f17 [0,4194304] 0 2024-09-13T21:44:39.467 INFO:tasks.workunit.client.0.smithi119.stdout:3/300: link d6/d15/d1a/f55 d6/d15/d1a/d45/d47/f64 0 2024-09-13T21:44:39.468 INFO:tasks.workunit.client.0.smithi119.stdout:3/301: chown d6/f11 0 1 2024-09-13T21:44:39.470 INFO:tasks.workunit.client.0.smithi119.stdout:4/253: dwrite d4/d1e/d28/f42 [0,4194304] 0 2024-09-13T21:44:39.470 INFO:tasks.workunit.client.0.smithi119.stdout:9/209: rmdir d0/d8/d18/d2e 0 2024-09-13T21:44:39.471 INFO:tasks.workunit.client.0.smithi119.stdout:5/186: write d0/d3/d1f/d21/f34 [5236121,58871] 0 2024-09-13T21:44:39.471 INFO:tasks.workunit.client.0.smithi119.stdout:4/254: chown d4/f29 252 1 2024-09-13T21:44:39.476 INFO:tasks.workunit.client.0.smithi119.stdout:4/255: rmdir d4/d1e/d28 39 2024-09-13T21:44:39.479 INFO:tasks.workunit.client.0.smithi119.stdout:3/302: dwrite d6/d15/f30 [0,4194304] 0 2024-09-13T21:44:39.480 INFO:tasks.workunit.client.0.smithi119.stdout:9/210: truncate d0/d8/d18/d23/f29 2067250 0 2024-09-13T21:44:39.483 INFO:tasks.workunit.client.0.smithi119.stdout:4/256: mknod d4/d1e/d26/c48 0 2024-09-13T21:44:39.484 INFO:tasks.workunit.client.0.smithi119.stdout:3/303: mknod d6/d15/c65 0 2024-09-13T21:44:39.485 INFO:tasks.workunit.client.0.smithi119.stdout:3/304: chown d6/d25/f61 1 1 2024-09-13T21:44:39.486 INFO:tasks.workunit.client.0.smithi119.stdout:9/211: symlink d0/d8/d18/l48 0 2024-09-13T21:44:39.488 INFO:tasks.workunit.client.0.smithi119.stdout:9/212: write d0/d19/d1a/d2b/f43 [582306,33315] 0 2024-09-13T21:44:39.489 INFO:tasks.workunit.client.0.smithi119.stdout:5/187: rename d0/d3/d4/d9/l42 to d0/d3/d4/d9/d14/d24/l44 0 2024-09-13T21:44:39.490 INFO:tasks.workunit.client.0.smithi119.stdout:3/305: rmdir d6 39 2024-09-13T21:44:39.491 INFO:tasks.workunit.client.0.smithi119.stdout:5/188: write d0/d3/d4/d9/d14/f29 [1603709,79049] 0 2024-09-13T21:44:39.492 INFO:tasks.workunit.client.0.smithi119.stdout:9/213: mknod d0/d8/d18/d23/c49 0 2024-09-13T21:44:39.494 INFO:tasks.workunit.client.0.smithi119.stdout:5/189: chown d0/fd 382093 1 2024-09-13T21:44:39.494 INFO:tasks.workunit.client.0.smithi119.stdout:9/214: write d0/d19/f46 [737106,64244] 0 2024-09-13T21:44:39.499 INFO:tasks.workunit.client.0.smithi119.stdout:4/257: dwrite d4/d1e/d28/f2a [0,4194304] 0 2024-09-13T21:44:39.500 INFO:tasks.workunit.client.0.smithi119.stdout:5/190: dread d0/d3/d4/d9/d14/f17 [0,4194304] 0 2024-09-13T21:44:39.503 INFO:tasks.workunit.client.0.smithi119.stdout:5/191: write d0/d3/d4/d9/f10 [892083,93498] 0 2024-09-13T21:44:39.506 INFO:tasks.workunit.client.0.smithi119.stdout:8/256: sync 2024-09-13T21:44:39.508 INFO:tasks.workunit.client.0.smithi119.stdout:9/215: fdatasync d0/d8/d18/d23/d27/f32 0 2024-09-13T21:44:39.509 INFO:tasks.workunit.client.0.smithi119.stdout:9/216: readlink d0/d8/ld 0 2024-09-13T21:44:39.509 INFO:tasks.workunit.client.0.smithi119.stdout:9/217: readlink d0/d8/d18/d2f/l3a 0 2024-09-13T21:44:39.510 INFO:tasks.workunit.client.0.smithi119.stdout:8/257: mkdir d1b/d1d/d48/d58/d5b 0 2024-09-13T21:44:39.512 INFO:tasks.workunit.client.0.smithi119.stdout:4/258: getdents d4/d1e/d28 0 2024-09-13T21:44:39.514 INFO:tasks.workunit.client.0.smithi119.stdout:4/259: fdatasync d4/d1e/f36 0 2024-09-13T21:44:39.520 INFO:tasks.workunit.client.0.smithi119.stdout:3/306: dwrite d6/f14 [0,4194304] 0 2024-09-13T21:44:39.521 INFO:tasks.workunit.client.0.smithi119.stdout:4/260: creat d4/d1e/d26/d41/f49 x:0 0 0 2024-09-13T21:44:39.523 INFO:tasks.workunit.client.0.smithi119.stdout:9/218: dwrite d0/d19/f44 [0,4194304] 0 2024-09-13T21:44:39.524 INFO:tasks.workunit.client.0.smithi119.stdout:8/258: dwrite d1b/f47 [0,4194304] 0 2024-09-13T21:44:39.528 INFO:tasks.workunit.client.0.smithi119.stdout:3/307: creat d6/d25/d2f/d33/d56/f66 x:0 0 0 2024-09-13T21:44:39.533 INFO:tasks.workunit.client.0.smithi119.stdout:4/261: dwrite d4/d1e/d28/f42 [0,4194304] 0 2024-09-13T21:44:39.536 INFO:tasks.workunit.client.0.smithi119.stdout:3/308: creat d6/d15/d1a/d45/f67 x:0 0 0 2024-09-13T21:44:39.537 INFO:tasks.workunit.client.0.smithi119.stdout:4/262: symlink d4/d1e/d28/d34/l4a 0 2024-09-13T21:44:39.540 INFO:tasks.workunit.client.0.smithi119.stdout:4/263: write d4/d1e/f36 [987436,80039] 0 2024-09-13T21:44:39.540 INFO:tasks.workunit.client.0.smithi119.stdout:3/309: creat d6/d44/d52/f68 x:0 0 0 2024-09-13T21:44:39.541 INFO:tasks.workunit.client.0.smithi119.stdout:3/310: chown d6/cd 8 1 2024-09-13T21:44:39.544 INFO:tasks.workunit.client.0.smithi119.stdout:4/264: creat d4/f4b x:0 0 0 2024-09-13T21:44:39.547 INFO:tasks.workunit.client.0.smithi119.stdout:3/311: link d6/d25/d2f/f60 d6/d15/d1a/d45/f69 0 2024-09-13T21:44:39.548 INFO:tasks.workunit.client.0.smithi119.stdout:4/265: rename d4/d1e/d28/f42 to d4/d1e/d28/d34/f4c 0 2024-09-13T21:44:39.550 INFO:tasks.workunit.client.0.smithi119.stdout:9/219: write d0/d8/d18/d23/f29 [2414041,123698] 0 2024-09-13T21:44:39.551 INFO:tasks.workunit.client.0.smithi119.stdout:4/266: write d4/d1e/d28/d34/f4c [551171,26427] 0 2024-09-13T21:44:39.552 INFO:tasks.workunit.client.0.smithi119.stdout:3/312: mknod d6/c6a 0 2024-09-13T21:44:39.552 INFO:tasks.workunit.client.0.smithi119.stdout:4/267: fdatasync d4/d1e/ff 0 2024-09-13T21:44:39.553 INFO:tasks.workunit.client.0.smithi119.stdout:9/220: symlink d0/d19/d1a/l4a 0 2024-09-13T21:44:39.553 INFO:tasks.workunit.client.0.smithi119.stdout:4/268: write d4/f4b [512430,8718] 0 2024-09-13T21:44:39.555 INFO:tasks.workunit.client.0.smithi119.stdout:3/313: truncate d6/d15/d1a/d45/f5f 869784 0 2024-09-13T21:44:39.555 INFO:tasks.workunit.client.0.smithi119.stdout:4/269: write d4/d1e/ff [2696299,118738] 0 2024-09-13T21:44:39.556 INFO:tasks.workunit.client.0.smithi119.stdout:8/259: fsync d1b/f47 0 2024-09-13T21:44:39.557 INFO:tasks.workunit.client.0.smithi119.stdout:8/260: chown d1b/d1d/d48/d54/f38 1272 1 2024-09-13T21:44:39.558 INFO:tasks.workunit.client.0.smithi119.stdout:9/221: rename d0/d19/d1a/f33 to d0/d8/f4b 0 2024-09-13T21:44:39.561 INFO:tasks.workunit.client.0.smithi119.stdout:8/261: creat d1b/d1d/d48/d58/f5c x:0 0 0 2024-09-13T21:44:39.562 INFO:tasks.workunit.client.0.smithi119.stdout:8/262: fdatasync d1b/d1d/d48/f49 0 2024-09-13T21:44:39.564 INFO:tasks.workunit.client.0.smithi119.stdout:3/314: creat d6/f6b x:0 0 0 2024-09-13T21:44:39.566 INFO:tasks.workunit.client.0.smithi119.stdout:9/222: symlink d0/d8/d18/d23/d42/l4c 0 2024-09-13T21:44:39.566 INFO:tasks.workunit.client.0.smithi119.stdout:9/223: readlink d0/d19/d1a/l47 0 2024-09-13T21:44:39.567 INFO:tasks.workunit.client.0.smithi119.stdout:9/224: fsync d0/f7 0 2024-09-13T21:44:39.568 INFO:tasks.workunit.client.0.smithi119.stdout:4/270: rmdir d4 39 2024-09-13T21:44:39.575 INFO:tasks.workunit.client.0.smithi119.stdout:9/225: dwrite d0/d19/d1a/f40 [0,4194304] 0 2024-09-13T21:44:39.582 INFO:tasks.workunit.client.0.smithi119.stdout:9/226: link d0/d8/f4b d0/d19/d1a/f4d 0 2024-09-13T21:44:39.584 INFO:tasks.workunit.client.0.smithi119.stdout:8/263: dwrite d1b/f42 [0,4194304] 0 2024-09-13T21:44:39.586 INFO:tasks.workunit.client.0.smithi119.stdout:4/271: dwrite d4/d1e/d10/f46 [0,4194304] 0 2024-09-13T21:44:39.589 INFO:tasks.workunit.client.0.smithi119.stdout:9/227: mkdir d0/d8/d18/d23/d4e 0 2024-09-13T21:44:39.590 INFO:tasks.workunit.client.0.smithi119.stdout:4/272: truncate d4/d1e/f36 1765359 0 2024-09-13T21:44:39.590 INFO:tasks.workunit.client.0.smithi119.stdout:4/273: readlink l1 0 2024-09-13T21:44:39.594 INFO:tasks.workunit.client.0.smithi119.stdout:4/274: mknod d4/d1e/d28/c4d 0 2024-09-13T21:44:39.596 INFO:tasks.workunit.client.0.smithi119.stdout:8/264: rmdir d1b/d1d/d48/d58/d5b 0 2024-09-13T21:44:39.596 INFO:tasks.workunit.client.0.smithi119.stdout:4/275: chown d4/f40 3 1 2024-09-13T21:44:39.597 INFO:tasks.workunit.client.0.smithi119.stdout:8/265: truncate d1b/f20 2035887 0 2024-09-13T21:44:39.599 INFO:tasks.workunit.client.0.smithi119.stdout:4/276: creat d4/f4e x:0 0 0 2024-09-13T21:44:39.599 INFO:tasks.workunit.client.0.smithi119.stdout:4/277: fsync d4/f38 0 2024-09-13T21:44:39.600 INFO:tasks.workunit.client.0.smithi119.stdout:8/266: creat d1b/d1d/d26/d3e/f5d x:0 0 0 2024-09-13T21:44:39.601 INFO:tasks.workunit.client.0.smithi119.stdout:4/278: write d4/f21 [3581436,20811] 0 2024-09-13T21:44:39.602 INFO:tasks.workunit.client.0.smithi119.stdout:4/279: write d4/d1e/d28/d34/f3e [3183745,90833] 0 2024-09-13T21:44:39.604 INFO:tasks.workunit.client.0.smithi119.stdout:4/280: truncate d4/d1e/f33 296560 0 2024-09-13T21:44:39.606 INFO:tasks.workunit.client.0.smithi119.stdout:4/281: write d4/d1e/f33 [664295,108234] 0 2024-09-13T21:44:39.615 INFO:tasks.workunit.client.0.smithi119.stdout:9/228: dread d0/d8/d18/d23/f39 [4194304,4194304] 0 2024-09-13T21:44:39.618 INFO:tasks.workunit.client.0.smithi119.stdout:4/282: getdents d4/d1e/d28 0 2024-09-13T21:44:39.619 INFO:tasks.workunit.client.0.smithi119.stdout:8/267: write f9 [1167694,93523] 0 2024-09-13T21:44:39.621 INFO:tasks.workunit.client.0.smithi119.stdout:4/283: symlink d4/d1e/d28/l4f 0 2024-09-13T21:44:39.622 INFO:tasks.workunit.client.0.smithi119.stdout:9/229: dwrite d0/d19/d1a/d2b/f43 [0,4194304] 0 2024-09-13T21:44:39.626 INFO:tasks.workunit.client.0.smithi119.stdout:9/230: mkdir d0/d4f 0 2024-09-13T21:44:39.627 INFO:tasks.workunit.client.0.smithi119.stdout:4/284: creat d4/d1e/f50 x:0 0 0 2024-09-13T21:44:39.628 INFO:tasks.workunit.client.0.smithi119.stdout:8/268: write d1b/d4e/f53 [3147265,89043] 0 2024-09-13T21:44:39.630 INFO:tasks.workunit.client.0.smithi119.stdout:9/231: getdents d0/d8/d18/d2f 0 2024-09-13T21:44:39.632 INFO:tasks.workunit.client.0.smithi119.stdout:4/285: symlink d4/d1e/d26/d41/l51 0 2024-09-13T21:44:39.633 INFO:tasks.workunit.client.0.smithi119.stdout:9/232: write d0/d19/f30 [4467872,39406] 0 2024-09-13T21:44:39.634 INFO:tasks.workunit.client.0.smithi119.stdout:9/233: chown d0/d19 1680453 1 2024-09-13T21:44:39.636 INFO:tasks.workunit.client.0.smithi119.stdout:4/286: creat d4/f52 x:0 0 0 2024-09-13T21:44:39.639 INFO:tasks.workunit.client.0.smithi119.stdout:8/269: dwrite d1b/d1d/d26/f30 [0,4194304] 0 2024-09-13T21:44:39.639 INFO:tasks.workunit.client.0.smithi119.stdout:4/287: dread d4/f29 [0,4194304] 0 2024-09-13T21:44:39.642 INFO:tasks.workunit.client.0.smithi119.stdout:9/234: rename d0/d8/d18/d23/d27/c3d to d0/c50 0 2024-09-13T21:44:39.645 INFO:tasks.workunit.client.0.smithi119.stdout:4/288: creat d4/f53 x:0 0 0 2024-09-13T21:44:39.647 INFO:tasks.workunit.client.0.smithi119.stdout:9/235: creat d0/d8/d18/d23/f51 x:0 0 0 2024-09-13T21:44:39.649 INFO:tasks.workunit.client.0.smithi119.stdout:8/270: dwrite d1b/d1d/d26/d3e/f5d [0,4194304] 0 2024-09-13T21:44:39.658 INFO:tasks.workunit.client.0.smithi119.stdout:8/271: dwrite d1b/d1d/d48/f49 [0,4194304] 0 2024-09-13T21:44:39.666 INFO:tasks.workunit.client.0.smithi119.stdout:8/272: dwrite d1b/d4e/f5a [0,4194304] 0 2024-09-13T21:44:39.670 INFO:tasks.workunit.client.0.smithi119.stdout:8/273: unlink d1b/d1d/f2d 0 2024-09-13T21:44:39.676 INFO:tasks.workunit.client.0.smithi119.stdout:8/274: dwrite d1b/d1d/d39/f44 [0,4194304] 0 2024-09-13T21:44:39.677 INFO:tasks.workunit.client.0.smithi119.stdout:8/275: dread - d1b/d1d/d26/f33 zero size 2024-09-13T21:44:39.678 INFO:tasks.workunit.client.0.smithi119.stdout:8/276: write d1b/d1d/d26/f50 [312759,12330] 0 2024-09-13T21:44:39.682 INFO:tasks.workunit.client.0.smithi119.stdout:8/277: mkdir d1b/d1d/d5e 0 2024-09-13T21:44:39.692 INFO:tasks.workunit.client.0.smithi119.stdout:8/278: write d1b/d1d/d48/d54/f38 [882628,74219] 0 2024-09-13T21:44:39.692 INFO:tasks.workunit.client.0.smithi119.stdout:8/279: stat f9 0 2024-09-13T21:44:39.696 INFO:tasks.workunit.client.0.smithi119.stdout:8/280: dread d1b/d1d/d39/f44 [0,4194304] 0 2024-09-13T21:44:39.697 INFO:tasks.workunit.client.0.smithi119.stdout:8/281: chown d1b/c29 894738 1 2024-09-13T21:44:39.699 INFO:tasks.workunit.client.0.smithi119.stdout:8/282: truncate d1b/d1d/d26/d3e/f4c 649431 0 2024-09-13T21:44:39.699 INFO:tasks.workunit.client.0.smithi119.stdout:8/283: chown d1b/d1d/d26 209661027 1 2024-09-13T21:44:39.701 INFO:tasks.workunit.client.0.smithi119.stdout:8/284: creat d1b/d1d/f5f x:0 0 0 2024-09-13T21:44:39.701 INFO:tasks.workunit.client.0.smithi119.stdout:8/285: fsync d1b/d1d/d48/d54/f37 0 2024-09-13T21:44:39.709 INFO:tasks.workunit.client.0.smithi119.stdout:8/286: dwrite f5 [0,4194304] 0 2024-09-13T21:44:39.710 INFO:tasks.workunit.client.0.smithi119.stdout:8/287: chown d1b/c1e 38773 1 2024-09-13T21:44:39.714 INFO:tasks.workunit.client.0.smithi119.stdout:8/288: rename d1b/d1d/d48/d54/f38 to d1b/d1d/d26/d3e/f60 0 2024-09-13T21:44:39.714 INFO:tasks.workunit.client.0.smithi119.stdout:8/289: truncate d1b/f46 767674 0 2024-09-13T21:44:39.717 INFO:tasks.workunit.client.0.smithi119.stdout:8/290: dread d1b/d1d/d26/f50 [0,4194304] 0 2024-09-13T21:44:39.717 INFO:tasks.workunit.client.0.smithi119.stdout:8/291: chown d1b/d4e/f5a 4282582 1 2024-09-13T21:44:39.723 INFO:tasks.workunit.client.0.smithi119.stdout:8/292: dwrite f18 [0,4194304] 0 2024-09-13T21:44:39.724 INFO:tasks.workunit.client.0.smithi119.stdout:8/293: fsync d1b/d1d/d48/f49 0 2024-09-13T21:44:39.726 INFO:tasks.workunit.client.0.smithi119.stdout:1/269: sync 2024-09-13T21:44:39.726 INFO:tasks.workunit.client.0.smithi119.stdout:0/259: sync 2024-09-13T21:44:39.730 INFO:tasks.workunit.client.0.smithi119.stdout:1/270: chown d1/cb 3814 1 2024-09-13T21:44:39.733 INFO:tasks.workunit.client.0.smithi119.stdout:8/294: dwrite d1b/d4e/f53 [0,4194304] 0 2024-09-13T21:44:39.735 INFO:tasks.workunit.client.0.smithi119.stdout:1/271: dread - d1/d3/dc/d24/d2f/d31/f50 zero size 2024-09-13T21:44:39.739 INFO:tasks.workunit.client.0.smithi119.stdout:0/260: dwrite de/d1c/d2f/f47 [0,4194304] 0 2024-09-13T21:44:39.741 INFO:tasks.workunit.client.0.smithi119.stdout:8/295: rename d1b/d1d/f4f to d1b/d1d/d26/f61 0 2024-09-13T21:44:39.744 INFO:tasks.workunit.client.0.smithi119.stdout:1/272: creat d1/d3/dc/d11/d3d/f56 x:0 0 0 2024-09-13T21:44:39.745 INFO:tasks.workunit.client.0.smithi119.stdout:0/261: creat de/d1c/d2f/d35/f67 x:0 0 0 2024-09-13T21:44:39.748 INFO:tasks.workunit.client.0.smithi119.stdout:1/273: chown d1/d3/dc/d11/d19/d2d/l4c 169 1 2024-09-13T21:44:39.748 INFO:tasks.workunit.client.0.smithi119.stdout:0/262: write de/d1c/d2f/d35/f38 [20672,21025] 0 2024-09-13T21:44:39.750 INFO:tasks.workunit.client.0.smithi119.stdout:8/296: dwrite f9 [0,4194304] 0 2024-09-13T21:44:39.750 INFO:tasks.workunit.client.0.smithi119.stdout:0/263: read de/d1c/f36 [1974842,86711] 0 2024-09-13T21:44:39.752 INFO:tasks.workunit.client.0.smithi119.stdout:0/264: stat de/d1c/d59/l5a 0 2024-09-13T21:44:39.753 INFO:tasks.workunit.client.0.smithi119.stdout:1/274: mknod d1/d3/dc/d24/d2f/d53/c57 0 2024-09-13T21:44:39.755 INFO:tasks.workunit.client.0.smithi119.stdout:1/275: truncate d1/f1b 9129378 0 2024-09-13T21:44:39.755 INFO:tasks.workunit.client.0.smithi119.stdout:8/297: dread d1b/d1d/d26/d3e/f60 [0,4194304] 0 2024-09-13T21:44:39.756 INFO:tasks.workunit.client.0.smithi119.stdout:0/265: creat de/f68 x:0 0 0 2024-09-13T21:44:39.757 INFO:tasks.workunit.client.0.smithi119.stdout:0/266: dread - de/f68 zero size 2024-09-13T21:44:39.758 INFO:tasks.workunit.client.0.smithi119.stdout:8/298: mknod d1b/d1d/d5e/c62 0 2024-09-13T21:44:39.760 INFO:tasks.workunit.client.0.smithi119.stdout:8/299: rmdir d1b/d1d/d5e 39 2024-09-13T21:44:39.762 INFO:tasks.workunit.client.0.smithi119.stdout:0/267: symlink de/d1c/d2f/d35/d4a/d62/l69 0 2024-09-13T21:44:39.763 INFO:tasks.workunit.client.0.smithi119.stdout:8/300: creat d1b/d1d/d39/f63 x:0 0 0 2024-09-13T21:44:39.765 INFO:tasks.workunit.client.0.smithi119.stdout:0/268: symlink de/l6a 0 2024-09-13T21:44:39.767 INFO:tasks.workunit.client.0.smithi119.stdout:0/269: mknod de/d49/c6b 0 2024-09-13T21:44:39.770 INFO:tasks.workunit.client.0.smithi119.stdout:0/270: creat de/d1c/d2f/f6c x:0 0 0 2024-09-13T21:44:39.772 INFO:tasks.workunit.client.0.smithi119.stdout:0/271: write de/d49/f4f [237245,56026] 0 2024-09-13T21:44:39.772 INFO:tasks.workunit.client.0.smithi119.stdout:8/301: write d1b/d1d/d26/f61 [1663596,35568] 0 2024-09-13T21:44:39.774 INFO:tasks.workunit.client.0.smithi119.stdout:8/302: truncate d1b/f47 4698048 0 2024-09-13T21:44:39.775 INFO:tasks.workunit.client.0.smithi119.stdout:0/272: creat de/d3c/f6d x:0 0 0 2024-09-13T21:44:39.776 INFO:tasks.workunit.client.0.smithi119.stdout:8/303: symlink d1b/d1d/d48/l64 0 2024-09-13T21:44:39.776 INFO:tasks.workunit.client.0.smithi119.stdout:8/304: fsync d1b/f42 0 2024-09-13T21:44:39.777 INFO:tasks.workunit.client.0.smithi119.stdout:0/273: creat de/d4e/f6e x:0 0 0 2024-09-13T21:44:39.778 INFO:tasks.workunit.client.0.smithi119.stdout:8/305: write d1b/d1d/f5f [983767,34160] 0 2024-09-13T21:44:39.778 INFO:tasks.workunit.client.0.smithi119.stdout:1/276: dread d1/d3/dc/d11/f17 [4194304,4194304] 0 2024-09-13T21:44:39.780 INFO:tasks.workunit.client.0.smithi119.stdout:8/306: read d1b/d1d/d26/f50 [275872,43627] 0 2024-09-13T21:44:39.781 INFO:tasks.workunit.client.0.smithi119.stdout:1/277: creat d1/f58 x:0 0 0 2024-09-13T21:44:39.781 INFO:tasks.workunit.client.0.smithi119.stdout:8/307: stat d1b/d1d/d26/f61 0 2024-09-13T21:44:39.782 INFO:tasks.workunit.client.0.smithi119.stdout:8/308: write d1b/d1d/d26/f3d [3879511,3414] 0 2024-09-13T21:44:39.783 INFO:tasks.workunit.client.0.smithi119.stdout:1/278: truncate d1/d3/dc/d24/f29 1253415 0 2024-09-13T21:44:39.787 INFO:tasks.workunit.client.0.smithi119.stdout:8/309: getdents d1b 0 2024-09-13T21:44:39.788 INFO:tasks.workunit.client.0.smithi119.stdout:0/274: truncate de/d1c/d2b/f30 1964737 0 2024-09-13T21:44:39.791 INFO:tasks.workunit.client.0.smithi119.stdout:8/310: mkdir d1b/d1d/d26/d3e/d65 0 2024-09-13T21:44:39.791 INFO:tasks.workunit.client.0.smithi119.stdout:0/275: dread - de/d1c/d2f/d35/f67 zero size 2024-09-13T21:44:39.792 INFO:tasks.workunit.client.0.smithi119.stdout:1/279: dwrite d1/d3/dc/d24/d2f/d31/f50 [0,4194304] 0 2024-09-13T21:44:39.796 INFO:tasks.workunit.client.0.smithi119.stdout:8/311: unlink d1b/d1d/d26/f50 0 2024-09-13T21:44:39.800 INFO:tasks.workunit.client.0.smithi119.stdout:0/276: dread de/d1c/d2b/f32 [0,4194304] 0 2024-09-13T21:44:39.804 INFO:tasks.workunit.client.0.smithi119.stdout:1/280: dwrite d1/f26 [4194304,4194304] 0 2024-09-13T21:44:39.806 INFO:tasks.workunit.client.0.smithi119.stdout:0/277: getdents de/d1c/d2f 0 2024-09-13T21:44:39.808 INFO:tasks.workunit.client.0.smithi119.stdout:0/278: mknod de/d1c/c6f 0 2024-09-13T21:44:39.811 INFO:tasks.workunit.client.0.smithi119.stdout:0/279: fsync de/d1c/f1d 0 2024-09-13T21:44:39.813 INFO:tasks.workunit.client.0.smithi119.stdout:0/280: symlink de/d1c/d2f/d40/l70 0 2024-09-13T21:44:39.818 INFO:tasks.workunit.client.0.smithi119.stdout:8/312: dread d1b/d1d/d26/f2f [0,4194304] 0 2024-09-13T21:44:39.820 INFO:tasks.workunit.client.0.smithi119.stdout:8/313: mknod d1b/d1d/d5e/c66 0 2024-09-13T21:44:39.821 INFO:tasks.workunit.client.0.smithi119.stdout:0/281: truncate de/d1c/f1d 5058214 0 2024-09-13T21:44:39.821 INFO:tasks.workunit.client.0.smithi119.stdout:8/314: write d1b/d1d/d48/d54/f57 [55198,104282] 0 2024-09-13T21:44:39.828 INFO:tasks.workunit.client.0.smithi119.stdout:8/315: truncate d1b/d1d/d26/f61 743590 0 2024-09-13T21:44:39.828 INFO:tasks.workunit.client.0.smithi119.stdout:0/282: dwrite de/d1c/d52/f55 [0,4194304] 0 2024-09-13T21:44:39.834 INFO:tasks.workunit.client.0.smithi119.stdout:8/316: dwrite f18 [0,4194304] 0 2024-09-13T21:44:39.835 INFO:tasks.workunit.client.0.smithi119.stdout:0/283: rename de/d1c/d2b/f30 to de/d1c/d59/f71 0 2024-09-13T21:44:39.838 INFO:tasks.workunit.client.0.smithi119.stdout:0/284: creat de/d1c/d52/f72 x:0 0 0 2024-09-13T21:44:39.851 INFO:tasks.workunit.client.0.smithi119.stdout:8/317: dread d1b/f27 [0,4194304] 0 2024-09-13T21:44:39.854 INFO:tasks.workunit.client.0.smithi119.stdout:0/285: write de/d1c/f27 [256095,78117] 0 2024-09-13T21:44:39.859 INFO:tasks.workunit.client.0.smithi119.stdout:0/286: write fd [4922770,31120] 0 2024-09-13T21:44:39.860 INFO:tasks.workunit.client.0.smithi119.stdout:0/287: fdatasync de/d1c/d2f/d35/f45 0 2024-09-13T21:44:39.863 INFO:tasks.workunit.client.0.smithi119.stdout:0/288: creat de/d1c/d64/f73 x:0 0 0 2024-09-13T21:44:39.869 INFO:tasks.workunit.client.0.smithi119.stdout:8/318: dwrite d1b/d1d/d26/d3e/f4c [0,4194304] 0 2024-09-13T21:44:39.871 INFO:tasks.workunit.client.0.smithi119.stdout:8/319: creat d1b/d4e/f67 x:0 0 0 2024-09-13T21:44:39.873 INFO:tasks.workunit.client.0.smithi119.stdout:8/320: write d1b/f20 [2118016,17526] 0 2024-09-13T21:44:39.875 INFO:tasks.workunit.client.0.smithi119.stdout:8/321: creat d1b/d1d/d48/d54/f68 x:0 0 0 2024-09-13T21:44:39.880 INFO:tasks.workunit.client.0.smithi119.stdout:8/322: dwrite d1b/f47 [0,4194304] 0 2024-09-13T21:44:39.881 INFO:tasks.workunit.client.0.smithi119.stdout:8/323: fdatasync fd 0 2024-09-13T21:44:39.883 INFO:tasks.workunit.client.0.smithi119.stdout:8/324: creat d1b/d1d/d48/d58/f69 x:0 0 0 2024-09-13T21:44:39.885 INFO:tasks.workunit.client.0.smithi119.stdout:8/325: chown d1b/d4e/f67 15787098 1 2024-09-13T21:44:39.885 INFO:tasks.workunit.client.0.smithi119.stdout:8/326: chown d1b/d1d/d26 10 1 2024-09-13T21:44:39.885 INFO:tasks.workunit.client.0.smithi119.stdout:8/327: chown d1b/c1c 2673 1 2024-09-13T21:44:39.887 INFO:tasks.workunit.client.0.smithi119.stdout:8/328: mkdir d1b/d4e/d6a 0 2024-09-13T21:44:39.888 INFO:tasks.workunit.client.0.smithi119.stdout:8/329: mkdir d1b/d1d/d26/d6b 0 2024-09-13T21:44:39.890 INFO:tasks.workunit.client.0.smithi119.stdout:8/330: mkdir d1b/d1d/d39/d6c 0 2024-09-13T21:44:39.892 INFO:tasks.workunit.client.0.smithi119.stdout:0/289: dread de/d1c/d2f/f43 [0,4194304] 0 2024-09-13T21:44:39.896 INFO:tasks.workunit.client.0.smithi119.stdout:0/290: rename de/d1c/c6f to de/d1c/d2b/d34/c74 0 2024-09-13T21:44:39.897 INFO:tasks.workunit.client.0.smithi119.stdout:8/331: dwrite d1b/d1d/d39/f63 [0,4194304] 0 2024-09-13T21:44:39.897 INFO:tasks.workunit.client.0.smithi119.stdout:0/291: fsync de/d1c/f58 0 2024-09-13T21:44:39.899 INFO:tasks.workunit.client.0.smithi119.stdout:0/292: rmdir de/d1c/d59 39 2024-09-13T21:44:39.900 INFO:tasks.workunit.client.0.smithi119.stdout:6/270: sync 2024-09-13T21:44:39.902 INFO:tasks.workunit.client.0.smithi119.stdout:0/293: readlink de/d1c/d2f/d35/d4a/d62/l69 0 2024-09-13T21:44:39.902 INFO:tasks.workunit.client.0.smithi119.stdout:0/294: fdatasync de/d1c/f27 0 2024-09-13T21:44:39.903 INFO:tasks.workunit.client.0.smithi119.stdout:6/271: mknod dc/d3d/c51 0 2024-09-13T21:44:39.904 INFO:tasks.workunit.client.0.smithi119.stdout:6/272: chown dc/df/c4d 1998721 1 2024-09-13T21:44:39.905 INFO:tasks.workunit.client.0.smithi119.stdout:6/273: write dc/df/f1d [2147810,76559] 0 2024-09-13T21:44:39.906 INFO:tasks.workunit.client.0.smithi119.stdout:0/295: unlink de/d1c/d52/f72 0 2024-09-13T21:44:39.908 INFO:tasks.workunit.client.0.smithi119.stdout:6/274: fsync dc/f31 0 2024-09-13T21:44:39.908 INFO:tasks.workunit.client.0.smithi119.stdout:6/275: chown dc/f1b 475619334 1 2024-09-13T21:44:39.909 INFO:tasks.workunit.client.0.smithi119.stdout:6/276: readlink dc/l18 0 2024-09-13T21:44:39.909 INFO:tasks.workunit.client.0.smithi119.stdout:6/277: fdatasync fa 0 2024-09-13T21:44:39.909 INFO:tasks.workunit.client.0.smithi119.stdout:6/278: readlink dc/l3b 0 2024-09-13T21:44:39.909 INFO:tasks.workunit.client.0.smithi119.stdout:6/279: truncate dc/f1b 5533137 0 2024-09-13T21:44:39.911 INFO:tasks.workunit.client.0.smithi119.stdout:8/332: fdatasync d1b/d1d/d39/f63 0 2024-09-13T21:44:39.912 INFO:tasks.workunit.client.0.smithi119.stdout:6/280: creat dc/d3a/f52 x:0 0 0 2024-09-13T21:44:39.914 INFO:tasks.workunit.client.0.smithi119.stdout:8/333: creat d1b/d1d/d48/d58/f6d x:0 0 0 2024-09-13T21:44:39.915 INFO:tasks.workunit.client.0.smithi119.stdout:0/296: getdents de/d4e 0 2024-09-13T21:44:39.916 INFO:tasks.workunit.client.0.smithi119.stdout:8/334: write d1b/d1d/d48/d58/f5c [878501,111452] 0 2024-09-13T21:44:39.919 INFO:tasks.workunit.client.0.smithi119.stdout:8/335: rename d1b/d1d/d5e/c66 to d1b/d1d/d26/d6b/c6e 0 2024-09-13T21:44:39.920 INFO:tasks.workunit.client.0.smithi119.stdout:8/336: stat d1b/d1d/c2e 0 2024-09-13T21:44:39.921 INFO:tasks.workunit.client.0.smithi119.stdout:0/297: link de/d1c/d52/f55 de/d1c/d2f/d35/d4a/d62/f75 0 2024-09-13T21:44:39.921 INFO:tasks.workunit.client.0.smithi119.stdout:8/337: read d1b/f27 [218924,56947] 0 2024-09-13T21:44:39.923 INFO:tasks.workunit.client.0.smithi119.stdout:0/298: mkdir de/d1c/d2b/d76 0 2024-09-13T21:44:39.925 INFO:tasks.workunit.client.0.smithi119.stdout:0/299: creat de/f77 x:0 0 0 2024-09-13T21:44:39.925 INFO:tasks.workunit.client.0.smithi119.stdout:0/300: read - de/d49/f4c zero size 2024-09-13T21:44:39.926 INFO:tasks.workunit.client.0.smithi119.stdout:0/301: chown de/d1c/l33 74480987 1 2024-09-13T21:44:39.936 INFO:tasks.workunit.client.0.smithi119.stdout:0/302: dwrite de/d1c/f1d [0,4194304] 0 2024-09-13T21:44:39.937 INFO:tasks.workunit.client.0.smithi119.stdout:8/338: dread d1b/d1d/d26/f3d [0,4194304] 0 2024-09-13T21:44:39.938 INFO:tasks.workunit.client.0.smithi119.stdout:8/339: chown d1b/d1d/d26/f3d 1809195981 1 2024-09-13T21:44:39.938 INFO:tasks.workunit.client.0.smithi119.stdout:0/303: mknod de/d1c/d64/c78 0 2024-09-13T21:44:39.939 INFO:tasks.workunit.client.0.smithi119.stdout:8/340: write f9 [2786310,87020] 0 2024-09-13T21:44:39.941 INFO:tasks.workunit.client.0.smithi119.stdout:8/341: chown d1b/d1d/d26/d3e/d65 500644800 1 2024-09-13T21:44:39.945 INFO:tasks.workunit.client.0.smithi119.stdout:0/304: truncate de/d1c/d2f/d35/f45 4072892 0 2024-09-13T21:44:39.946 INFO:tasks.workunit.client.0.smithi119.stdout:8/342: creat d1b/d1d/d26/d3e/d65/f6f x:0 0 0 2024-09-13T21:44:39.947 INFO:tasks.workunit.client.0.smithi119.stdout:8/343: rename d1b to d1b/d1d/d39/d6c/d70 22 2024-09-13T21:44:39.949 INFO:tasks.workunit.client.0.smithi119.stdout:8/344: mkdir d1b/d4e/d71 0 2024-09-13T21:44:39.952 INFO:tasks.workunit.client.0.smithi119.stdout:0/305: dwrite de/d1c/f5c [0,4194304] 0 2024-09-13T21:44:39.955 INFO:tasks.workunit.client.0.smithi119.stdout:0/306: stat de/f17 0 2024-09-13T21:44:39.959 INFO:tasks.workunit.client.0.smithi119.stdout:8/345: dwrite d1b/f46 [0,4194304] 0 2024-09-13T21:44:39.990 INFO:tasks.workunit.client.0.smithi119.stdout:0/307: dread de/f22 [0,4194304] 0 2024-09-13T21:44:39.992 INFO:tasks.workunit.client.0.smithi119.stdout:0/308: creat de/d1c/d2f/d35/f79 x:0 0 0 2024-09-13T21:44:39.993 INFO:tasks.workunit.client.0.smithi119.stdout:0/309: unlink de/d3c/f44 0 2024-09-13T21:44:39.995 INFO:tasks.workunit.client.0.smithi119.stdout:0/310: creat de/d1c/d52/f7a x:0 0 0 2024-09-13T21:44:39.996 INFO:tasks.workunit.client.0.smithi119.stdout:0/311: rmdir de/d1c/d64 39 2024-09-13T21:44:39.998 INFO:tasks.workunit.client.0.smithi119.stdout:0/312: write de/f1a [1487545,121385] 0 2024-09-13T21:44:39.999 INFO:tasks.workunit.client.0.smithi119.stdout:0/313: fsync de/d49/f4c 0 2024-09-13T21:44:40.062 INFO:tasks.workunit.client.0.smithi119.stdout:2/245: sync 2024-09-13T21:44:40.062 INFO:tasks.workunit.client.0.smithi119.stdout:7/236: sync 2024-09-13T21:44:40.063 INFO:tasks.workunit.client.0.smithi119.stdout:7/237: chown d8/l2a 1280174 1 2024-09-13T21:44:40.069 INFO:tasks.workunit.client.0.smithi119.stdout:7/238: dwrite d8/d19/f25 [0,4194304] 0 2024-09-13T21:44:40.071 INFO:tasks.workunit.client.0.smithi119.stdout:7/239: mknod d8/d19/d2e/c4a 0 2024-09-13T21:44:40.072 INFO:tasks.workunit.client.0.smithi119.stdout:2/246: dread d1/d7/f2a [0,4194304] 0 2024-09-13T21:44:40.074 INFO:tasks.workunit.client.0.smithi119.stdout:2/247: fdatasync d1/d7/f20 0 2024-09-13T21:44:40.074 INFO:tasks.workunit.client.0.smithi119.stdout:2/248: truncate d1/f4a 745050 0 2024-09-13T21:44:40.074 INFO:tasks.workunit.client.0.smithi119.stdout:7/240: rmdir d8/d19/d22/d3b 39 2024-09-13T21:44:40.076 INFO:tasks.workunit.client.0.smithi119.stdout:2/249: truncate d1/d7/f11 8447632 0 2024-09-13T21:44:40.077 INFO:tasks.workunit.client.0.smithi119.stdout:2/250: fdatasync d1/d7/f23 0 2024-09-13T21:44:40.078 INFO:tasks.workunit.client.0.smithi119.stdout:7/241: unlink d8/l1b 0 2024-09-13T21:44:40.079 INFO:tasks.workunit.client.0.smithi119.stdout:2/251: write d1/d2b/f4e [4143858,35271] 0 2024-09-13T21:44:40.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:39 smithi155 ceph-mon[34732]: pgmap v4: 65 pgs: 65 active+clean; 555 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-09-13T21:44:40.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:39 smithi155 ceph-mon[34732]: mgrmap e23: smithi155.wuuxfd(active, since 2s) 2024-09-13T21:44:40.083 INFO:tasks.workunit.client.0.smithi119.stdout:2/252: rename d1/l3 to d1/d38/l4f 0 2024-09-13T21:44:40.083 INFO:tasks.workunit.client.0.smithi119.stdout:2/253: write d1/d2b/d2c/f48 [206521,95409] 0 2024-09-13T21:44:40.085 INFO:tasks.workunit.client.0.smithi119.stdout:2/254: write d1/d2b/d2c/f48 [205050,128628] 0 2024-09-13T21:44:40.085 INFO:tasks.workunit.client.0.smithi119.stdout:2/255: fsync d1/d38/f3f 0 2024-09-13T21:44:40.086 INFO:tasks.workunit.client.0.smithi119.stdout:2/256: stat d1/d7/f20 0 2024-09-13T21:44:40.091 INFO:tasks.workunit.client.0.smithi119.stdout:7/242: truncate d8/d19/f1c 2132446 0 2024-09-13T21:44:40.092 INFO:tasks.workunit.client.0.smithi119.stdout:2/257: dread d1/d22/f24 [0,4194304] 0 2024-09-13T21:44:40.093 INFO:tasks.workunit.client.0.smithi119.stdout:7/243: stat d8/d19/d2e/d34/d42/l13 0 2024-09-13T21:44:40.093 INFO:tasks.workunit.client.0.smithi119.stdout:7/244: fdatasync d8/d19/f25 0 2024-09-13T21:44:40.095 INFO:tasks.workunit.client.0.smithi119.stdout:2/258: dread d1/d7/f2a [0,4194304] 0 2024-09-13T21:44:40.098 INFO:tasks.workunit.client.0.smithi119.stdout:2/259: creat d1/f50 x:0 0 0 2024-09-13T21:44:40.099 INFO:tasks.workunit.client.0.smithi119.stdout:2/260: truncate d1/d22/f42 242749 0 2024-09-13T21:44:40.100 INFO:tasks.workunit.client.0.smithi119.stdout:7/245: getdents d8/d19/d22/d3b/d48 0 2024-09-13T21:44:40.101 INFO:tasks.workunit.client.0.smithi119.stdout:7/246: dread - d8/d19/d22/f28 zero size 2024-09-13T21:44:40.102 INFO:tasks.workunit.client.0.smithi119.stdout:7/247: chown f3 270 1 2024-09-13T21:44:40.103 INFO:tasks.workunit.client.0.smithi119.stdout:7/248: truncate d8/f21 1597281 0 2024-09-13T21:44:40.103 INFO:tasks.workunit.client.0.smithi119.stdout:2/261: rename d1/d38/f3f to d1/d7/f51 0 2024-09-13T21:44:40.105 INFO:tasks.workunit.client.0.smithi119.stdout:7/249: creat d8/d19/d2e/d34/d42/f4b x:0 0 0 2024-09-13T21:44:40.106 INFO:tasks.workunit.client.0.smithi119.stdout:7/250: fsync d8/d19/d2e/d34/d42/f12 0 2024-09-13T21:44:40.107 INFO:tasks.workunit.client.0.smithi119.stdout:7/251: write f3 [1278956,70620] 0 2024-09-13T21:44:40.108 INFO:tasks.workunit.client.0.smithi119.stdout:2/262: mknod d1/c52 0 2024-09-13T21:44:40.109 INFO:tasks.workunit.client.0.smithi119.stdout:2/263: dread - d1/d2b/d2c/f44 zero size 2024-09-13T21:44:40.116 INFO:tasks.workunit.client.0.smithi119.stdout:2/264: rename d1/d7/fd to d1/d2b/d2c/d31/f53 0 2024-09-13T21:44:40.116 INFO:tasks.workunit.client.0.smithi119.stdout:2/265: creat d1/d2b/d2c/f54 x:0 0 0 2024-09-13T21:44:40.117 INFO:tasks.workunit.client.0.smithi119.stdout:7/252: dwrite d8/d19/d2e/d34/d42/f12 [4194304,4194304] 0 2024-09-13T21:44:40.117 INFO:tasks.workunit.client.0.smithi119.stdout:2/266: write d1/f50 [38368,57126] 0 2024-09-13T21:44:40.118 INFO:tasks.workunit.client.0.smithi119.stdout:7/253: write d8/d19/d2e/f45 [267272,100883] 0 2024-09-13T21:44:40.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:39 smithi119 ceph-mon[27653]: pgmap v4: 65 pgs: 65 active+clean; 555 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-09-13T21:44:40.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:39 smithi119 ceph-mon[27653]: mgrmap e23: smithi155.wuuxfd(active, since 2s) 2024-09-13T21:44:40.133 INFO:tasks.workunit.client.0.smithi119.stdout:2/267: rename d1/d2b/d2c to d1/d22/d55 0 2024-09-13T21:44:40.134 INFO:tasks.workunit.client.0.smithi119.stdout:2/268: write d1/d22/f2d [2152005,110623] 0 2024-09-13T21:44:40.135 INFO:tasks.workunit.client.0.smithi119.stdout:2/269: chown d1/d22/c3b 154491 1 2024-09-13T21:44:40.136 INFO:tasks.workunit.client.0.smithi119.stdout:2/270: mknod d1/d22/d55/d31/c56 0 2024-09-13T21:44:40.137 INFO:tasks.workunit.client.0.smithi119.stdout:2/271: truncate d1/f50 1081465 0 2024-09-13T21:44:40.145 INFO:tasks.workunit.client.0.smithi119.stdout:7/254: dread f3 [0,4194304] 0 2024-09-13T21:44:40.148 INFO:tasks.workunit.client.0.smithi119.stdout:5/192: sync 2024-09-13T21:44:40.152 INFO:tasks.workunit.client.0.smithi119.stdout:5/193: rename d0/d3/c3c to d0/d3/d4/d9/c45 0 2024-09-13T21:44:40.153 INFO:tasks.workunit.client.0.smithi119.stdout:7/255: dread d8/d19/d2e/d34/d42/f32 [0,4194304] 0 2024-09-13T21:44:40.155 INFO:tasks.workunit.client.0.smithi119.stdout:2/272: dread d1/d2b/f34 [4194304,4194304] 0 2024-09-13T21:44:40.155 INFO:tasks.workunit.client.0.smithi119.stdout:5/194: creat d0/d3/d4/d9/f46 x:0 0 0 2024-09-13T21:44:40.157 INFO:tasks.workunit.client.0.smithi119.stdout:5/195: read d0/d3/d4/d2e/f2f [461531,33442] 0 2024-09-13T21:44:40.157 INFO:tasks.workunit.client.0.smithi119.stdout:7/256: dread d8/d19/d2e/d34/d42/fa [0,4194304] 0 2024-09-13T21:44:40.158 INFO:tasks.workunit.client.0.smithi119.stdout:2/273: rename d1/d22/f24 to d1/d7/d47/f57 0 2024-09-13T21:44:40.159 INFO:tasks.workunit.client.0.smithi119.stdout:5/196: truncate d0/d3/d4/d2e/f3d 365709 0 2024-09-13T21:44:40.160 INFO:tasks.workunit.client.0.smithi119.stdout:2/274: fdatasync d1/d22/d55/f48 0 2024-09-13T21:44:40.162 INFO:tasks.workunit.client.0.smithi119.stdout:2/275: symlink d1/d38/l58 0 2024-09-13T21:44:40.165 INFO:tasks.workunit.client.0.smithi119.stdout:2/276: creat d1/d38/f59 x:0 0 0 2024-09-13T21:44:40.166 INFO:tasks.workunit.client.0.smithi119.stdout:2/277: write d1/d22/f1c [4376081,78621] 0 2024-09-13T21:44:40.169 INFO:tasks.workunit.client.0.smithi119.stdout:2/278: mkdir d1/d22/d5a 0 2024-09-13T21:44:40.172 INFO:tasks.workunit.client.0.smithi119.stdout:2/279: symlink d1/d7/l5b 0 2024-09-13T21:44:40.173 INFO:tasks.workunit.client.0.smithi119.stdout:2/280: chown d1/d7/l14 51990 1 2024-09-13T21:44:40.175 INFO:tasks.workunit.client.0.smithi119.stdout:7/257: dwrite d8/d19/d2e/d34/d42/fa [0,4194304] 0 2024-09-13T21:44:40.177 INFO:tasks.workunit.client.0.smithi119.stdout:7/258: chown d8/d19/d2e/d34/d42/f4b 68 1 2024-09-13T21:44:40.179 INFO:tasks.workunit.client.0.smithi119.stdout:2/281: dread d1/d2b/f34 [4194304,4194304] 0 2024-09-13T21:44:40.179 INFO:tasks.workunit.client.0.smithi119.stdout:7/259: mknod d8/d19/d22/d37/c4c 0 2024-09-13T21:44:40.180 INFO:tasks.workunit.client.0.smithi119.stdout:5/197: dread d0/d3/d4/d9/d14/f29 [0,4194304] 0 2024-09-13T21:44:40.180 INFO:tasks.workunit.client.0.smithi119.stdout:7/260: dread - d8/d19/d2e/d34/d42/f4b zero size 2024-09-13T21:44:40.181 INFO:tasks.workunit.client.0.smithi119.stdout:2/282: fsync d1/d7/d47/f57 0 2024-09-13T21:44:40.182 INFO:tasks.workunit.client.0.smithi119.stdout:2/283: chown d1/d7/f23 205029519 1 2024-09-13T21:44:40.184 INFO:tasks.workunit.client.0.smithi119.stdout:7/261: readlink d8/d19/d2e/l38 0 2024-09-13T21:44:40.184 INFO:tasks.workunit.client.0.smithi119.stdout:2/284: rmdir d1/d7/d47 39 2024-09-13T21:44:40.189 INFO:tasks.workunit.client.0.smithi119.stdout:5/198: dwrite d0/d3/d4/d9/d14/f29 [4194304,4194304] 0 2024-09-13T21:44:40.191 INFO:tasks.workunit.client.0.smithi119.stdout:4/289: sync 2024-09-13T21:44:40.191 INFO:tasks.workunit.client.0.smithi119.stdout:3/315: sync 2024-09-13T21:44:40.191 INFO:tasks.workunit.client.0.smithi119.stdout:1/281: sync 2024-09-13T21:44:40.191 INFO:tasks.workunit.client.0.smithi119.stdout:6/281: sync 2024-09-13T21:44:40.192 INFO:tasks.workunit.client.0.smithi119.stdout:8/346: sync 2024-09-13T21:44:40.192 INFO:tasks.workunit.client.0.smithi119.stdout:0/314: sync 2024-09-13T21:44:40.192 INFO:tasks.workunit.client.0.smithi119.stdout:9/236: sync 2024-09-13T21:44:40.192 INFO:tasks.workunit.client.0.smithi119.stdout:4/290: chown d4/d1e 518749 1 2024-09-13T21:44:40.193 INFO:tasks.workunit.client.0.smithi119.stdout:7/262: dwrite f3 [0,4194304] 0 2024-09-13T21:44:40.196 INFO:tasks.workunit.client.0.smithi119.stdout:1/282: read - d1/d3/dc/f41 zero size 2024-09-13T21:44:40.200 INFO:tasks.workunit.client.0.smithi119.stdout:7/263: mkdir d8/d4d 0 2024-09-13T21:44:40.201 INFO:tasks.workunit.client.0.smithi119.stdout:8/347: dread d1b/f42 [0,4194304] 0 2024-09-13T21:44:40.203 INFO:tasks.workunit.client.0.smithi119.stdout:7/264: stat d8/d19/d2e/d34/d42/f4b 0 2024-09-13T21:44:40.203 INFO:tasks.workunit.client.0.smithi119.stdout:0/315: mkdir de/d1c/d2b/d34/d7b 0 2024-09-13T21:44:40.204 INFO:tasks.workunit.client.0.smithi119.stdout:9/237: dread d0/d19/f46 [0,4194304] 0 2024-09-13T21:44:40.205 INFO:tasks.workunit.client.0.smithi119.stdout:8/348: chown d1b/d4e/f5a 406058 1 2024-09-13T21:44:40.206 INFO:tasks.workunit.client.0.smithi119.stdout:4/291: symlink d4/l54 0 2024-09-13T21:44:40.207 INFO:tasks.workunit.client.0.smithi119.stdout:1/283: dwrite d1/d3/dc/d11/f3c [0,4194304] 0 2024-09-13T21:44:40.208 INFO:tasks.workunit.client.0.smithi119.stdout:5/199: link d0/d3/f15 d0/d3/d4/d9/f47 0 2024-09-13T21:44:40.209 INFO:tasks.workunit.client.0.smithi119.stdout:8/349: read f15 [2229395,43862] 0 2024-09-13T21:44:40.210 INFO:tasks.workunit.client.0.smithi119.stdout:4/292: read d4/d1e/d28/d34/f4c [1311906,42375] 0 2024-09-13T21:44:40.211 INFO:tasks.workunit.client.0.smithi119.stdout:0/316: rmdir de/d1c/d2f 39 2024-09-13T21:44:40.211 INFO:tasks.workunit.client.0.smithi119.stdout:5/200: chown d0/d3/ce 1252 1 2024-09-13T21:44:40.214 INFO:tasks.workunit.client.0.smithi119.stdout:8/350: write f18 [4096016,123834] 0 2024-09-13T21:44:40.215 INFO:tasks.workunit.client.0.smithi119.stdout:6/282: write dc/df/f44 [1516386,96172] 0 2024-09-13T21:44:40.219 INFO:tasks.workunit.client.0.smithi119.stdout:1/284: rename d1/d3/dc/d11/d19/d47/d4d to d1/d3/dc/d11/d19/d2d/d59 0 2024-09-13T21:44:40.219 INFO:tasks.workunit.client.0.smithi119.stdout:3/316: truncate d6/ff 329764 0 2024-09-13T21:44:40.221 INFO:tasks.workunit.client.0.smithi119.stdout:3/317: fsync d6/d44/d52/f58 0 2024-09-13T21:44:40.223 INFO:tasks.workunit.client.0.smithi119.stdout:4/293: rename d4/d1e/d28/f2c to d4/d1e/d28/f55 0 2024-09-13T21:44:40.224 INFO:tasks.workunit.client.0.smithi119.stdout:7/265: creat d8/d19/d22/f4e x:0 0 0 2024-09-13T21:44:40.226 INFO:tasks.workunit.client.0.smithi119.stdout:8/351: unlink d1b/d1d/d48/d58/f5c 0 2024-09-13T21:44:40.228 INFO:tasks.workunit.client.0.smithi119.stdout:5/201: rename d0/d3/d1f/f30 to d0/d3/d4/d2e/f48 0 2024-09-13T21:44:40.229 INFO:tasks.workunit.client.0.smithi119.stdout:8/352: fsync d1b/d1d/d48/d54/f68 0 2024-09-13T21:44:40.229 INFO:tasks.workunit.client.0.smithi119.stdout:9/238: dread d0/d8/d18/d23/d27/f2a [0,4194304] 0 2024-09-13T21:44:40.231 INFO:tasks.workunit.client.0.smithi119.stdout:7/266: fsync d8/f31 0 2024-09-13T21:44:40.232 INFO:tasks.workunit.client.0.smithi119.stdout:3/318: dwrite d6/f46 [0,4194304] 0 2024-09-13T21:44:40.233 INFO:tasks.workunit.client.0.smithi119.stdout:6/283: rename dc/dd/f1f to dc/d3d/d4e/f53 0 2024-09-13T21:44:40.236 INFO:tasks.workunit.client.0.smithi119.stdout:8/353: creat d1b/d1d/d48/f72 x:0 0 0 2024-09-13T21:44:40.239 INFO:tasks.workunit.client.0.smithi119.stdout:5/202: symlink d0/d3/d4/d9/d14/d24/l49 0 2024-09-13T21:44:40.243 INFO:tasks.workunit.client.0.smithi119.stdout:1/285: rename d1/d3/dc/d11/c16 to d1/d3/dc/d24/d2f/d53/c5a 0 2024-09-13T21:44:40.247 INFO:tasks.workunit.client.0.smithi119.stdout:7/267: creat d8/d4d/f4f x:0 0 0 2024-09-13T21:44:40.247 INFO:tasks.workunit.client.0.smithi119.stdout:9/239: dread d0/d8/d18/d23/d27/f16 [0,4194304] 0 2024-09-13T21:44:40.249 INFO:tasks.workunit.client.0.smithi119.stdout:5/203: mkdir d0/d3/d4/d2e/d4a 0 2024-09-13T21:44:40.250 INFO:tasks.workunit.client.0.smithi119.stdout:8/354: rename d1b/c31 to d1b/d1d/d39/c73 0 2024-09-13T21:44:40.250 INFO:tasks.workunit.client.0.smithi119.stdout:1/286: mknod d1/d3/dc/d24/d2f/d31/c5b 0 2024-09-13T21:44:40.251 INFO:tasks.workunit.client.0.smithi119.stdout:1/287: stat d1/d3/f2b 0 2024-09-13T21:44:40.252 INFO:tasks.workunit.client.0.smithi119.stdout:1/288: chown d1/d3/dc/d24 52525 1 2024-09-13T21:44:40.253 INFO:tasks.workunit.client.0.smithi119.stdout:3/319: creat d6/f6c x:0 0 0 2024-09-13T21:44:40.254 INFO:tasks.workunit.client.0.smithi119.stdout:1/289: write d1/f22 [42181,62203] 0 2024-09-13T21:44:40.256 INFO:tasks.workunit.client.0.smithi119.stdout:7/268: truncate d8/d19/d2e/d34/d42/fe 4644379 0 2024-09-13T21:44:40.258 INFO:tasks.workunit.client.0.smithi119.stdout:1/290: symlink d1/l5c 0 2024-09-13T21:44:40.259 INFO:tasks.workunit.client.0.smithi119.stdout:7/269: write d8/d19/f35 [573070,100044] 0 2024-09-13T21:44:40.264 INFO:tasks.workunit.client.0.smithi119.stdout:9/240: truncate d0/d8/d18/d23/d27/f32 2689258 0 2024-09-13T21:44:40.266 INFO:tasks.workunit.client.0.smithi119.stdout:1/291: dwrite d1/d3/dc/d11/f3c [0,4194304] 0 2024-09-13T21:44:40.267 INFO:tasks.workunit.client.0.smithi119.stdout:7/270: mknod d8/d19/d22/d3b/d48/c50 0 2024-09-13T21:44:40.268 INFO:tasks.workunit.client.0.smithi119.stdout:5/204: write d0/fd [3622041,74909] 0 2024-09-13T21:44:40.273 INFO:tasks.workunit.client.0.smithi119.stdout:9/241: mkdir d0/d8/d18/d23/d42/d52 0 2024-09-13T21:44:40.273 INFO:tasks.workunit.client.0.smithi119.stdout:5/205: write d0/d3/d4/d9/d14/f29 [8829806,97186] 0 2024-09-13T21:44:40.274 INFO:tasks.workunit.client.0.smithi119.stdout:7/271: write d8/d19/d2e/d34/d42/f12 [566351,37011] 0 2024-09-13T21:44:40.275 INFO:tasks.workunit.client.0.smithi119.stdout:8/355: creat d1b/d1d/d48/d58/f74 x:0 0 0 2024-09-13T21:44:40.279 INFO:tasks.workunit.client.0.smithi119.stdout:9/242: unlink d0/d19/d1a/l47 0 2024-09-13T21:44:40.281 INFO:tasks.workunit.client.0.smithi119.stdout:5/206: symlink d0/d3/d4/d9/d14/l4b 0 2024-09-13T21:44:40.282 INFO:tasks.workunit.client.0.smithi119.stdout:7/272: creat d8/d3c/f51 x:0 0 0 2024-09-13T21:44:40.283 INFO:tasks.workunit.client.0.smithi119.stdout:5/207: dread d0/d3/d4/d2e/f32 [0,4194304] 0 2024-09-13T21:44:40.285 INFO:tasks.workunit.client.0.smithi119.stdout:5/208: chown d0/d3/f12 1 1 2024-09-13T21:44:40.287 INFO:tasks.workunit.client.0.smithi119.stdout:8/356: creat d1b/d4e/d71/f75 x:0 0 0 2024-09-13T21:44:40.289 INFO:tasks.workunit.client.0.smithi119.stdout:7/273: creat d8/d4d/f52 x:0 0 0 2024-09-13T21:44:40.289 INFO:tasks.workunit.client.0.smithi119.stdout:8/357: stat c16 0 2024-09-13T21:44:40.290 INFO:tasks.workunit.client.1.smithi155.stderr:++ readlink -f fsstress 2024-09-13T21:44:40.293 INFO:tasks.workunit.client.1.smithi155.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T21:44:40.293 INFO:tasks.workunit.client.1.smithi155.stderr:+ popd 2024-09-13T21:44:40.293 INFO:tasks.workunit.client.1.smithi155.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T21:44:40.294 INFO:tasks.workunit.client.1.smithi155.stderr:+ popd 2024-09-13T21:44:40.294 INFO:tasks.workunit.client.1.smithi155.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-13T21:44:40.295 INFO:tasks.workunit.client.0.smithi119.stdout:8/358: fdatasync d1b/d1d/d26/d3e/f5d 0 2024-09-13T21:44:40.295 INFO:tasks.workunit.client.1.smithi155.stderr:++ mktemp -d -p . 2024-09-13T21:44:40.299 INFO:tasks.workunit.client.0.smithi119.stdout:9/243: dwrite d0/d19/f46 [0,4194304] 0 2024-09-13T21:44:40.299 INFO:tasks.workunit.client.0.smithi119.stdout:7/274: write d8/d19/d2e/d34/d42/f2d [107862,81376] 0 2024-09-13T21:44:40.302 INFO:tasks.workunit.client.0.smithi119.stdout:7/275: fdatasync d8/f31 0 2024-09-13T21:44:40.302 INFO:tasks.workunit.client.1.smithi155.stderr:+ T=./tmp.6e4fg9Jauw 2024-09-13T21:44:40.302 INFO:tasks.workunit.client.1.smithi155.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.6e4fg9Jauw -l 1 -n 1000 -p 10 -v 2024-09-13T21:44:40.304 INFO:tasks.workunit.client.0.smithi119.stdout:3/320: truncate d6/f13 1521346 0 2024-09-13T21:44:40.304 INFO:tasks.workunit.client.0.smithi119.stdout:1/292: fsync d1/d3/dc/d11/f3c 0 2024-09-13T21:44:40.305 INFO:tasks.workunit.client.0.smithi119.stdout:5/209: dwrite d0/d3/d4/d2e/f2f [0,4194304] 0 2024-09-13T21:44:40.305 INFO:tasks.workunit.client.0.smithi119.stdout:9/244: stat d0/d19/d1a/f4d 0 2024-09-13T21:44:40.307 INFO:tasks.workunit.client.0.smithi119.stdout:0/317: dread de/f10 [0,4194304] 0 2024-09-13T21:44:40.308 INFO:tasks.workunit.client.0.smithi119.stdout:2/285: dread d1/d2b/f34 [0,4194304] 0 2024-09-13T21:44:40.308 INFO:tasks.workunit.client.1.smithi155.stdout:seed = 1725956537 2024-09-13T21:44:40.311 INFO:tasks.workunit.client.0.smithi119.stdout:7/276: fdatasync d8/d19/d2e/d34/d42/f11 0 2024-09-13T21:44:40.314 INFO:tasks.workunit.client.0.smithi119.stdout:3/321: readlink d6/l49 0 2024-09-13T21:44:40.314 INFO:tasks.workunit.client.1.smithi155.stdout:0/0: truncate - no filename 2024-09-13T21:44:40.315 INFO:tasks.workunit.client.0.smithi119.stdout:8/359: dread d1b/d1d/d39/f44 [0,4194304] 0 2024-09-13T21:44:40.316 INFO:tasks.workunit.client.1.smithi155.stdout:1/0: fdatasync - no filename 2024-09-13T21:44:40.317 INFO:tasks.workunit.client.1.smithi155.stdout:0/1: creat f0 x:0 0 0 2024-09-13T21:44:40.320 INFO:tasks.workunit.client.1.smithi155.stdout:0/2: fdatasync f0 0 2024-09-13T21:44:40.321 INFO:tasks.workunit.client.0.smithi119.stdout:5/210: mkdir d0/d3/d4/d9/d1e/d4c 0 2024-09-13T21:44:40.322 INFO:tasks.workunit.client.0.smithi119.stdout:5/211: chown d0/d3/d1f 119399 1 2024-09-13T21:44:40.322 INFO:tasks.workunit.client.0.smithi119.stdout:1/293: creat d1/d3/dc/d11/d28/f5d x:0 0 0 2024-09-13T21:44:40.322 INFO:tasks.workunit.client.0.smithi119.stdout:7/277: unlink d8/d4d/f4f 0 2024-09-13T21:44:40.322 INFO:tasks.workunit.client.1.smithi155.stdout:3/0: write - no filename 2024-09-13T21:44:40.322 INFO:tasks.workunit.client.1.smithi155.stdout:3/1: chown . 1354 1 2024-09-13T21:44:40.322 INFO:tasks.workunit.client.1.smithi155.stdout:3/2: dread - no filename 2024-09-13T21:44:40.322 INFO:tasks.workunit.client.1.smithi155.stdout:3/3: fsync - no filename 2024-09-13T21:44:40.323 INFO:tasks.workunit.client.1.smithi155.stdout:3/4: stat - no entries 2024-09-13T21:44:40.323 INFO:tasks.workunit.client.1.smithi155.stdout:1/1: mknod c0 0 2024-09-13T21:44:40.323 INFO:tasks.workunit.client.1.smithi155.stdout:1/2: fsync - no filename 2024-09-13T21:44:40.323 INFO:tasks.workunit.client.1.smithi155.stdout:1/3: dread - no filename 2024-09-13T21:44:40.323 INFO:tasks.workunit.client.1.smithi155.stdout:0/3: mkdir d1 0 2024-09-13T21:44:40.323 INFO:tasks.workunit.client.1.smithi155.stdout:2/0: dwrite - no filename 2024-09-13T21:44:40.323 INFO:tasks.workunit.client.1.smithi155.stdout:2/1: dwrite - no filename 2024-09-13T21:44:40.323 INFO:tasks.workunit.client.1.smithi155.stdout:2/2: rename - no filename 2024-09-13T21:44:40.323 INFO:tasks.workunit.client.1.smithi155.stdout:2/3: chown . 27701320 1 2024-09-13T21:44:40.323 INFO:tasks.workunit.client.1.smithi155.stdout:1/4: creat f1 x:0 0 0 2024-09-13T21:44:40.324 INFO:tasks.workunit.client.1.smithi155.stdout:3/5: symlink l0 0 2024-09-13T21:44:40.324 INFO:tasks.workunit.client.1.smithi155.stdout:3/6: dread - no filename 2024-09-13T21:44:40.324 INFO:tasks.workunit.client.1.smithi155.stdout:3/7: dread - no filename 2024-09-13T21:44:40.324 INFO:tasks.workunit.client.1.smithi155.stdout:5/0: dread - no filename 2024-09-13T21:44:40.324 INFO:tasks.workunit.client.1.smithi155.stdout:5/1: stat - no entries 2024-09-13T21:44:40.324 INFO:tasks.workunit.client.1.smithi155.stdout:5/2: fdatasync - no filename 2024-09-13T21:44:40.324 INFO:tasks.workunit.client.1.smithi155.stdout:5/3: readlink - no filename 2024-09-13T21:44:40.325 INFO:tasks.workunit.client.1.smithi155.stdout:0/4: creat d1/f2 x:0 0 0 2024-09-13T21:44:40.325 INFO:tasks.workunit.client.0.smithi119.stdout:9/245: mkdir d0/d8/d18/d23/d42/d52/d53 0 2024-09-13T21:44:40.325 INFO:tasks.workunit.client.0.smithi119.stdout:0/318: rename de/d1c/d2b/d34/d7b to de/d3c/d7c 0 2024-09-13T21:44:40.325 INFO:tasks.workunit.client.0.smithi119.stdout:2/286: creat d1/d7/d47/f5c x:0 0 0 2024-09-13T21:44:40.326 INFO:tasks.workunit.client.1.smithi155.stdout:1/5: symlink l2 0 2024-09-13T21:44:40.327 INFO:tasks.workunit.client.1.smithi155.stdout:3/8: rename l0 to l1 0 2024-09-13T21:44:40.327 INFO:tasks.workunit.client.1.smithi155.stdout:3/9: write - no filename 2024-09-13T21:44:40.329 INFO:tasks.workunit.client.1.smithi155.stdout:2/4: creat f0 x:0 0 0 2024-09-13T21:44:40.330 INFO:tasks.workunit.client.1.smithi155.stdout:3/10: creat f2 x:0 0 0 2024-09-13T21:44:40.330 INFO:tasks.workunit.client.0.smithi119.stdout:1/294: stat d1/d3/dc/d11/f17 0 2024-09-13T21:44:40.331 INFO:tasks.workunit.client.0.smithi119.stdout:5/212: creat d0/d3/d4/d2e/d4a/f4d x:0 0 0 2024-09-13T21:44:40.331 INFO:tasks.workunit.client.1.smithi155.stdout:6/0: chown . 2064071 1 2024-09-13T21:44:40.331 INFO:tasks.workunit.client.1.smithi155.stdout:6/1: stat - no entries 2024-09-13T21:44:40.332 INFO:tasks.workunit.client.1.smithi155.stdout:6/2: dread - no filename 2024-09-13T21:44:40.332 INFO:tasks.workunit.client.0.smithi119.stdout:8/360: link d1b/f42 d1b/d1d/d26/d3e/d65/f76 0 2024-09-13T21:44:40.333 INFO:tasks.workunit.client.1.smithi155.stdout:3/11: dread - f2 zero size 2024-09-13T21:44:40.334 INFO:tasks.workunit.client.1.smithi155.stdout:2/5: write f0 [536316,40951] 0 2024-09-13T21:44:40.335 INFO:tasks.workunit.client.1.smithi155.stdout:8/0: dwrite - no filename 2024-09-13T21:44:40.336 INFO:tasks.workunit.client.1.smithi155.stdout:8/1: chown . 2735 1 2024-09-13T21:44:40.336 INFO:tasks.workunit.client.0.smithi119.stdout:2/287: chown d1/l46 31 1 2024-09-13T21:44:40.337 INFO:tasks.workunit.client.0.smithi119.stdout:2/288: dread - d1/d22/d55/f44 zero size 2024-09-13T21:44:40.338 INFO:tasks.workunit.client.1.smithi155.stdout:2/6: chown f0 20551 1 2024-09-13T21:44:40.340 INFO:tasks.workunit.client.1.smithi155.stdout:6/3: creat f0 x:0 0 0 2024-09-13T21:44:40.343 INFO:tasks.workunit.client.1.smithi155.stdout:0/5: dwrite d1/f2 [0,4194304] 0 2024-09-13T21:44:40.344 INFO:tasks.workunit.client.1.smithi155.stdout:8/2: symlink l0 0 2024-09-13T21:44:40.344 INFO:tasks.workunit.client.1.smithi155.stdout:8/3: dwrite - no filename 2024-09-13T21:44:40.344 INFO:tasks.workunit.client.0.smithi119.stdout:7/278: dwrite d8/f31 [4194304,4194304] 0 2024-09-13T21:44:40.345 INFO:tasks.workunit.client.0.smithi119.stdout:3/322: truncate d6/d15/d1a/f42 664634 0 2024-09-13T21:44:40.345 INFO:tasks.workunit.client.1.smithi155.stdout:1/6: dwrite f1 [0,4194304] 0 2024-09-13T21:44:40.345 INFO:tasks.workunit.client.0.smithi119.stdout:2/289: mkdir d1/d22/d5a/d5d 0 2024-09-13T21:44:40.346 INFO:tasks.workunit.client.0.smithi119.stdout:5/213: dread d0/d3/d4/d2e/f32 [0,4194304] 0 2024-09-13T21:44:40.347 INFO:tasks.workunit.client.1.smithi155.stdout:0/6: chown f0 1981 1 2024-09-13T21:44:40.349 INFO:tasks.workunit.client.1.smithi155.stdout:8/4: symlink l1 0 2024-09-13T21:44:40.349 INFO:tasks.workunit.client.0.smithi119.stdout:1/295: dwrite d1/d3/dc/d24/d2f/d31/d32/f4b [0,4194304] 0 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/0: dread - no filename 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/1: rmdir - no directory 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/2: rename - no filename 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/3: stat - no entries 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/4: write - no filename 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/5: dread - no filename 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/6: dread - no filename 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/7: dwrite - no filename 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/8: link - no file 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/9: rename - no filename 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/10: readlink - no filename 2024-09-13T21:44:40.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/11: write - no filename 2024-09-13T21:44:40.351 INFO:tasks.workunit.client.1.smithi155.stdout:4/12: truncate - no filename 2024-09-13T21:44:40.352 INFO:tasks.workunit.client.0.smithi119.stdout:2/290: chown d1/f37 106045 1 2024-09-13T21:44:40.354 INFO:tasks.workunit.client.1.smithi155.stdout:2/7: dread f0 [0,4194304] 0 2024-09-13T21:44:40.354 INFO:tasks.workunit.client.1.smithi155.stdout:9/0: symlink l0 0 2024-09-13T21:44:40.354 INFO:tasks.workunit.client.0.smithi119.stdout:1/296: chown d1/d3/dc/d11/l12 0 1 2024-09-13T21:44:40.355 INFO:tasks.workunit.client.0.smithi119.stdout:5/214: truncate d0/d3/d4/d9/d1e/f38 755493 0 2024-09-13T21:44:40.355 INFO:tasks.workunit.client.0.smithi119.stdout:9/246: dread d0/f14 [0,4194304] 0 2024-09-13T21:44:40.358 INFO:tasks.workunit.client.1.smithi155.stdout:0/7: creat d1/f3 x:0 0 0 2024-09-13T21:44:40.359 INFO:tasks.workunit.client.1.smithi155.stdout:2/8: chown f0 91686589 1 2024-09-13T21:44:40.363 INFO:tasks.workunit.client.1.smithi155.stdout:8/5: mkdir d2 0 2024-09-13T21:44:40.363 INFO:tasks.workunit.client.1.smithi155.stdout:8/6: write - no filename 2024-09-13T21:44:40.363 INFO:tasks.workunit.client.1.smithi155.stdout:1/7: rename c0 to c3 0 2024-09-13T21:44:40.365 INFO:tasks.workunit.client.1.smithi155.stdout:9/1: rename l0 to l1 0 2024-09-13T21:44:40.366 INFO:tasks.workunit.client.0.smithi119.stdout:7/279: rename d8/d19/d22 to d8/d3c/d53 0 2024-09-13T21:44:40.367 INFO:tasks.workunit.client.1.smithi155.stdout:4/13: mknod c0 0 2024-09-13T21:44:40.368 INFO:tasks.workunit.client.1.smithi155.stdout:6/4: dwrite f0 [0,4194304] 0 2024-09-13T21:44:40.368 INFO:tasks.workunit.client.1.smithi155.stdout:6/5: readlink - no filename 2024-09-13T21:44:40.368 INFO:tasks.workunit.client.1.smithi155.stdout:4/14: chown c0 6142 1 2024-09-13T21:44:40.368 INFO:tasks.workunit.client.1.smithi155.stdout:4/15: chown c0 429324385 1 2024-09-13T21:44:40.368 INFO:tasks.workunit.client.1.smithi155.stdout:4/16: truncate - no filename 2024-09-13T21:44:40.369 INFO:tasks.workunit.client.0.smithi119.stdout:8/361: truncate d1b/d1d/d26/d3e/d65/f76 2498582 0 2024-09-13T21:44:40.369 INFO:tasks.workunit.client.0.smithi119.stdout:1/297: dread d1/d3/dc/d24/d2f/d31/d32/f4b [0,4194304] 0 2024-09-13T21:44:40.369 INFO:tasks.workunit.client.0.smithi119.stdout:8/362: write d1b/d1d/d26/f33 [143821,100558] 0 2024-09-13T21:44:40.370 INFO:tasks.workunit.client.1.smithi155.stdout:0/8: mknod d1/c4 0 2024-09-13T21:44:40.372 INFO:tasks.workunit.client.1.smithi155.stdout:2/9: creat f1 x:0 0 0 2024-09-13T21:44:40.372 INFO:tasks.workunit.client.0.smithi119.stdout:2/291: creat d1/d22/d55/f5e x:0 0 0 2024-09-13T21:44:40.374 INFO:tasks.workunit.client.0.smithi119.stdout:3/323: mknod d6/d15/d1a/c6d 0 2024-09-13T21:44:40.377 INFO:tasks.workunit.client.1.smithi155.stdout:4/17: mkdir d1 0 2024-09-13T21:44:40.377 INFO:tasks.workunit.client.0.smithi119.stdout:5/215: write d0/d3/d4/f5 [2478475,23800] 0 2024-09-13T21:44:40.377 INFO:tasks.workunit.client.0.smithi119.stdout:1/298: rename d1/f26 to d1/d3/dc/d24/d2f/d31/d32/d33/d43/f5e 0 2024-09-13T21:44:40.378 INFO:tasks.workunit.client.1.smithi155.stdout:7/0: symlink l0 0 2024-09-13T21:44:40.378 INFO:tasks.workunit.client.1.smithi155.stdout:7/1: dread - no filename 2024-09-13T21:44:40.378 INFO:tasks.workunit.client.1.smithi155.stdout:7/2: stat l0 0 2024-09-13T21:44:40.379 INFO:tasks.workunit.client.1.smithi155.stdout:2/10: mkdir d2 0 2024-09-13T21:44:40.381 INFO:tasks.workunit.client.0.smithi119.stdout:9/247: dread d0/d8/d18/d23/f29 [0,4194304] 0 2024-09-13T21:44:40.382 INFO:tasks.workunit.client.0.smithi119.stdout:3/324: dread - d6/d44/d52/f68 zero size 2024-09-13T21:44:40.383 INFO:tasks.workunit.client.1.smithi155.stdout:7/3: rename l0 to l1 0 2024-09-13T21:44:40.383 INFO:tasks.workunit.client.1.smithi155.stdout:7/4: write - no filename 2024-09-13T21:44:40.384 INFO:tasks.workunit.client.1.smithi155.stdout:4/18: mknod d1/c2 0 2024-09-13T21:44:40.385 INFO:tasks.workunit.client.1.smithi155.stdout:2/11: symlink d2/l3 0 2024-09-13T21:44:40.386 INFO:tasks.workunit.client.0.smithi119.stdout:8/363: link d1b/d1d/l43 d1b/d4e/d6a/l77 0 2024-09-13T21:44:40.387 INFO:tasks.workunit.client.1.smithi155.stdout:4/19: rmdir d1 39 2024-09-13T21:44:40.388 INFO:tasks.workunit.client.1.smithi155.stdout:2/12: mkdir d2/d4 0 2024-09-13T21:44:40.389 INFO:tasks.workunit.client.0.smithi119.stdout:2/292: dwrite d1/d7/f11 [4194304,4194304] 0 2024-09-13T21:44:40.389 INFO:tasks.workunit.client.0.smithi119.stdout:9/248: dread d0/d19/d1a/d2b/f3e [0,4194304] 0 2024-09-13T21:44:40.391 INFO:tasks.workunit.client.1.smithi155.stdout:2/13: write f0 [792110,73752] 0 2024-09-13T21:44:40.393 INFO:tasks.workunit.client.1.smithi155.stdout:2/14: read f0 [101490,73180] 0 2024-09-13T21:44:40.395 INFO:tasks.workunit.client.0.smithi119.stdout:8/364: creat d1b/d1d/d48/f78 x:0 0 0 2024-09-13T21:44:40.396 INFO:tasks.workunit.client.0.smithi119.stdout:9/249: symlink d0/d8/d18/d2f/l54 0 2024-09-13T21:44:40.396 INFO:tasks.workunit.client.1.smithi155.stdout:2/15: dread f0 [0,4194304] 0 2024-09-13T21:44:40.397 INFO:tasks.workunit.client.0.smithi119.stdout:3/325: dwrite d6/d15/f21 [4194304,4194304] 0 2024-09-13T21:44:40.399 INFO:tasks.workunit.client.0.smithi119.stdout:9/250: chown d0/d8/d18 216309 1 2024-09-13T21:44:40.399 INFO:tasks.workunit.client.0.smithi119.stdout:2/293: creat d1/d22/f5f x:0 0 0 2024-09-13T21:44:40.399 INFO:tasks.workunit.client.1.smithi155.stdout:2/16: fdatasync f0 0 2024-09-13T21:44:40.400 INFO:tasks.workunit.client.1.smithi155.stdout:2/17: dread - f1 zero size 2024-09-13T21:44:40.402 INFO:tasks.workunit.client.0.smithi119.stdout:1/299: creat d1/d3/dc/f5f x:0 0 0 2024-09-13T21:44:40.403 INFO:tasks.workunit.client.0.smithi119.stdout:2/294: readlink d1/d7/l14 0 2024-09-13T21:44:40.405 INFO:tasks.workunit.client.0.smithi119.stdout:2/295: fsync d1/d22/d55/f44 0 2024-09-13T21:44:40.405 INFO:tasks.workunit.client.0.smithi119.stdout:8/365: unlink d1b/d1d/d26/d3e/d65/f6f 0 2024-09-13T21:44:40.406 INFO:tasks.workunit.client.0.smithi119.stdout:9/251: symlink d0/d19/l55 0 2024-09-13T21:44:40.408 INFO:tasks.workunit.client.0.smithi119.stdout:9/252: fdatasync d0/f2c 0 2024-09-13T21:44:40.409 INFO:tasks.workunit.client.0.smithi119.stdout:9/253: chown d0 23092532 1 2024-09-13T21:44:40.410 INFO:tasks.workunit.client.0.smithi119.stdout:8/366: creat d1b/d1d/d48/d58/f79 x:0 0 0 2024-09-13T21:44:40.412 INFO:tasks.workunit.client.0.smithi119.stdout:8/367: dread - d1b/d1d/d48/d58/f6d zero size 2024-09-13T21:44:40.412 INFO:tasks.workunit.client.0.smithi119.stdout:2/296: dread d1/f50 [0,4194304] 0 2024-09-13T21:44:40.413 INFO:tasks.workunit.client.0.smithi119.stdout:3/326: rename d6/c1d to d6/d25/c6e 0 2024-09-13T21:44:40.413 INFO:tasks.workunit.client.0.smithi119.stdout:1/300: mknod d1/d3/dc/d24/c60 0 2024-09-13T21:44:40.415 INFO:tasks.workunit.client.0.smithi119.stdout:9/254: mkdir d0/d4f/d56 0 2024-09-13T21:44:40.415 INFO:tasks.workunit.client.0.smithi119.stdout:5/216: dread d0/d3/d4/d9/d14/d24/f31 [0,4194304] 0 2024-09-13T21:44:40.417 INFO:tasks.workunit.client.0.smithi119.stdout:8/368: creat d1b/d1d/d48/d58/f7a x:0 0 0 2024-09-13T21:44:40.419 INFO:tasks.workunit.client.0.smithi119.stdout:9/255: unlink d0/d19/f44 0 2024-09-13T21:44:40.422 INFO:tasks.workunit.client.0.smithi119.stdout:9/256: read d0/d19/d1a/d2b/f43 [3779313,30553] 0 2024-09-13T21:44:40.422 INFO:tasks.workunit.client.0.smithi119.stdout:8/369: unlink d1b/d1d/c2e 0 2024-09-13T21:44:40.424 INFO:tasks.workunit.client.0.smithi119.stdout:9/257: readlink d0/d8/d18/l1e 0 2024-09-13T21:44:40.426 INFO:tasks.workunit.client.0.smithi119.stdout:8/370: fsync d1b/d1d/d48/d54/f68 0 2024-09-13T21:44:40.427 INFO:tasks.workunit.client.0.smithi119.stdout:5/217: dwrite d0/d3/d4/d9/d14/f29 [8388608,4194304] 0 2024-09-13T21:44:40.429 INFO:tasks.workunit.client.0.smithi119.stdout:8/371: read f13 [899328,90514] 0 2024-09-13T21:44:40.429 INFO:tasks.workunit.client.0.smithi119.stdout:5/218: stat d0/d3/d4/d9/d1e 0 2024-09-13T21:44:40.435 INFO:tasks.workunit.client.0.smithi119.stdout:8/372: stat d1b/f20 0 2024-09-13T21:44:40.442 INFO:tasks.workunit.client.0.smithi119.stdout:9/258: rmdir d0/d8/d18/d23/d4e 0 2024-09-13T21:44:40.444 INFO:tasks.workunit.client.0.smithi119.stdout:9/259: readlink d0/d19/l20 0 2024-09-13T21:44:40.446 INFO:tasks.workunit.client.0.smithi119.stdout:5/219: rmdir d0/d3/d4/d9/d1e/d4c 0 2024-09-13T21:44:40.447 INFO:tasks.workunit.client.0.smithi119.stdout:2/297: dread d1/f25 [0,4194304] 0 2024-09-13T21:44:40.448 INFO:tasks.workunit.client.0.smithi119.stdout:8/373: dwrite d1b/f1f [0,4194304] 0 2024-09-13T21:44:40.455 INFO:tasks.workunit.client.0.smithi119.stdout:2/298: dread d1/f25 [0,4194304] 0 2024-09-13T21:44:40.455 INFO:tasks.workunit.client.0.smithi119.stdout:9/260: creat d0/d8/d18/d23/d27/d2d/f57 x:0 0 0 2024-09-13T21:44:40.458 INFO:tasks.workunit.client.0.smithi119.stdout:9/261: mknod d0/d8/c58 0 2024-09-13T21:44:40.461 INFO:tasks.workunit.client.0.smithi119.stdout:2/299: symlink d1/d22/d5a/l60 0 2024-09-13T21:44:40.461 INFO:tasks.workunit.client.0.smithi119.stdout:5/220: getdents d0/d3/d1f/d21 0 2024-09-13T21:44:40.463 INFO:tasks.workunit.client.0.smithi119.stdout:9/262: write d0/d8/d18/d23/f39 [3038678,65955] 0 2024-09-13T21:44:40.463 INFO:tasks.workunit.client.0.smithi119.stdout:2/300: truncate d1/d22/f27 970159 0 2024-09-13T21:44:40.465 INFO:tasks.workunit.client.0.smithi119.stdout:8/374: dwrite d1b/d1d/d26/f2f [4194304,4194304] 0 2024-09-13T21:44:40.471 INFO:tasks.workunit.client.0.smithi119.stdout:8/375: dread d1b/d1d/d48/d54/f57 [0,4194304] 0 2024-09-13T21:44:40.471 INFO:tasks.workunit.client.0.smithi119.stdout:4/294: sync 2024-09-13T21:44:40.472 INFO:tasks.workunit.client.0.smithi119.stdout:8/376: chown l1a 1965 1 2024-09-13T21:44:40.473 INFO:tasks.workunit.client.0.smithi119.stdout:2/301: creat d1/d22/d5a/d5d/f61 x:0 0 0 2024-09-13T21:44:40.474 INFO:tasks.workunit.client.0.smithi119.stdout:2/302: chown d1/d7/l5b 1102 1 2024-09-13T21:44:40.475 INFO:tasks.workunit.client.0.smithi119.stdout:5/221: rename d0/d3/d4/d9/d14/d24/c3b to d0/c4e 0 2024-09-13T21:44:40.476 INFO:tasks.workunit.client.0.smithi119.stdout:8/377: symlink d1b/d4e/l7b 0 2024-09-13T21:44:40.477 INFO:tasks.workunit.client.0.smithi119.stdout:9/263: dwrite d0/d19/d1a/f40 [0,4194304] 0 2024-09-13T21:44:40.479 INFO:tasks.workunit.client.0.smithi119.stdout:8/378: write f9 [1844787,105616] 0 2024-09-13T21:44:40.479 INFO:tasks.workunit.client.0.smithi119.stdout:2/303: mkdir d1/d22/d55/d31/d36/d62 0 2024-09-13T21:44:40.482 INFO:tasks.workunit.client.0.smithi119.stdout:5/222: mkdir d0/d3/d1f/d21/d4f 0 2024-09-13T21:44:40.484 INFO:tasks.workunit.client.0.smithi119.stdout:4/295: creat d4/d1e/f56 x:0 0 0 2024-09-13T21:44:40.484 INFO:tasks.workunit.client.0.smithi119.stdout:2/304: getdents d1/d22/d55/d31/d36/d62 0 2024-09-13T21:44:40.485 INFO:tasks.workunit.client.0.smithi119.stdout:9/264: dread d0/d19/d1a/d2b/f3e [0,4194304] 0 2024-09-13T21:44:40.486 INFO:tasks.workunit.client.0.smithi119.stdout:8/379: creat d1b/d1d/d26/d3e/f7c x:0 0 0 2024-09-13T21:44:40.486 INFO:tasks.workunit.client.0.smithi119.stdout:5/223: creat d0/d3/f50 x:0 0 0 2024-09-13T21:44:40.490 INFO:tasks.workunit.client.0.smithi119.stdout:9/265: chown d0/d8/d18/d23/d42/d52/d53 7 1 2024-09-13T21:44:40.493 INFO:tasks.workunit.client.0.smithi119.stdout:9/266: write d0/f2c [3227082,46870] 0 2024-09-13T21:44:40.495 INFO:tasks.workunit.client.0.smithi119.stdout:8/380: rename d1b/d1d/d48/d54/f57 to d1b/d1d/d26/d3e/f7d 0 2024-09-13T21:44:40.496 INFO:tasks.workunit.client.0.smithi119.stdout:2/305: dwrite d1/d7/f11 [0,4194304] 0 2024-09-13T21:44:40.498 INFO:tasks.workunit.client.0.smithi119.stdout:9/267: chown d0/d19/d1a/d2b/f43 169 1 2024-09-13T21:44:40.500 INFO:tasks.workunit.client.0.smithi119.stdout:5/224: dread d0/d3/d4/d9/d14/f17 [0,4194304] 0 2024-09-13T21:44:40.500 INFO:tasks.workunit.client.0.smithi119.stdout:9/268: dread - d0/d8/d18/d23/f51 zero size 2024-09-13T21:44:40.501 INFO:tasks.workunit.client.0.smithi119.stdout:2/306: rename d1/d22/f27 to d1/d22/d5a/f63 0 2024-09-13T21:44:40.504 INFO:tasks.workunit.client.0.smithi119.stdout:4/296: dread d4/f2b [0,4194304] 0 2024-09-13T21:44:40.506 INFO:tasks.workunit.client.0.smithi119.stdout:2/307: mkdir d1/d22/d55/d64 0 2024-09-13T21:44:40.506 INFO:tasks.workunit.client.0.smithi119.stdout:9/269: write d0/d8/d18/d23/f39 [3292974,117028] 0 2024-09-13T21:44:40.508 INFO:tasks.workunit.client.0.smithi119.stdout:2/308: truncate d1/d22/d5a/f63 1057142 0 2024-09-13T21:44:40.510 INFO:tasks.workunit.client.0.smithi119.stdout:8/381: dread d1b/d1d/d26/d3e/d65/f76 [0,4194304] 0 2024-09-13T21:44:40.514 INFO:tasks.workunit.client.0.smithi119.stdout:4/297: rename d4/c3d to d4/c57 0 2024-09-13T21:44:40.515 INFO:tasks.workunit.client.0.smithi119.stdout:9/270: rename d0/d8/d18/d23/d27/d2d/f57 to d0/d19/f59 0 2024-09-13T21:44:40.518 INFO:tasks.workunit.client.0.smithi119.stdout:2/309: dwrite d1/d38/f59 [0,4194304] 0 2024-09-13T21:44:40.521 INFO:tasks.workunit.client.0.smithi119.stdout:4/298: mknod d4/d1e/d10/c58 0 2024-09-13T21:44:40.521 INFO:tasks.workunit.client.0.smithi119.stdout:4/299: readlink d4/d1e/lc 0 2024-09-13T21:44:40.522 INFO:tasks.workunit.client.0.smithi119.stdout:4/300: chown d4/f52 14 1 2024-09-13T21:44:40.523 INFO:tasks.workunit.client.0.smithi119.stdout:9/271: rmdir d0/d8/d18 39 2024-09-13T21:44:40.527 INFO:tasks.workunit.client.0.smithi119.stdout:4/301: symlink d4/d1e/d28/d34/l59 0 2024-09-13T21:44:40.529 INFO:tasks.workunit.client.0.smithi119.stdout:9/272: write d0/f14 [2678639,81463] 0 2024-09-13T21:44:40.531 INFO:tasks.workunit.client.0.smithi119.stdout:2/310: link d1/d22/d5a/f63 d1/d22/d55/d31/d36/f65 0 2024-09-13T21:44:40.533 INFO:tasks.workunit.client.0.smithi119.stdout:2/311: dread - d1/f3d zero size 2024-09-13T21:44:40.534 INFO:tasks.workunit.client.0.smithi119.stdout:8/382: getdents d1b/d1d/d26/d6b 0 2024-09-13T21:44:40.534 INFO:tasks.workunit.client.0.smithi119.stdout:9/273: creat d0/d19/d1a/f5a x:0 0 0 2024-09-13T21:44:40.539 INFO:tasks.workunit.client.0.smithi119.stdout:4/302: dwrite d4/d1e/f50 [0,4194304] 0 2024-09-13T21:44:40.546 INFO:tasks.workunit.client.0.smithi119.stdout:5/225: dwrite d0/d3/d4/d9/f47 [0,4194304] 0 2024-09-13T21:44:40.546 INFO:tasks.workunit.client.0.smithi119.stdout:4/303: creat d4/d1e/d28/f5a x:0 0 0 2024-09-13T21:44:40.548 INFO:tasks.workunit.client.1.smithi155.stdout:3/12: fsync f2 0 2024-09-13T21:44:40.552 INFO:tasks.workunit.client.0.smithi119.stdout:9/274: dread d0/d8/f10 [0,4194304] 0 2024-09-13T21:44:40.552 INFO:tasks.workunit.client.0.smithi119.stdout:4/304: mknod d4/d1e/d26/c5b 0 2024-09-13T21:44:40.556 INFO:tasks.workunit.client.0.smithi119.stdout:9/275: chown d0/f7 5495 1 2024-09-13T21:44:40.557 INFO:tasks.workunit.client.1.smithi155.stdout:1/8: getdents . 0 2024-09-13T21:44:40.558 INFO:tasks.workunit.client.1.smithi155.stdout:3/13: dwrite f2 [0,4194304] 0 2024-09-13T21:44:40.558 INFO:tasks.workunit.client.1.smithi155.stdout:9/2: readlink l1 0 2024-09-13T21:44:40.558 INFO:tasks.workunit.client.0.smithi119.stdout:8/383: dwrite d1b/f27 [0,4194304] 0 2024-09-13T21:44:40.560 INFO:tasks.workunit.client.1.smithi155.stdout:0/9: getdents d1 0 2024-09-13T21:44:40.560 INFO:tasks.workunit.client.1.smithi155.stdout:1/9: unlink l2 0 2024-09-13T21:44:40.561 INFO:tasks.workunit.client.0.smithi119.stdout:2/312: dwrite d1/d22/d55/d31/f53 [0,4194304] 0 2024-09-13T21:44:40.561 INFO:tasks.workunit.client.1.smithi155.stdout:0/10: chown f0 32299 1 2024-09-13T21:44:40.562 INFO:tasks.workunit.client.1.smithi155.stdout:9/3: mkdir d2 0 2024-09-13T21:44:40.562 INFO:tasks.workunit.client.1.smithi155.stdout:9/4: truncate - no filename 2024-09-13T21:44:40.563 INFO:tasks.workunit.client.1.smithi155.stdout:3/14: mkdir d3 0 2024-09-13T21:44:40.564 INFO:tasks.workunit.client.0.smithi119.stdout:2/313: chown d1/d22/l26 0 1 2024-09-13T21:44:40.564 INFO:tasks.workunit.client.0.smithi119.stdout:9/276: unlink d0/d8/c58 0 2024-09-13T21:44:40.566 INFO:tasks.workunit.client.0.smithi119.stdout:2/314: chown d1/d22/d5a 384 1 2024-09-13T21:44:40.567 INFO:tasks.workunit.client.1.smithi155.stdout:1/10: mknod c4 0 2024-09-13T21:44:40.569 INFO:tasks.workunit.client.1.smithi155.stdout:0/11: rename d1/f3 to d1/f5 0 2024-09-13T21:44:40.570 INFO:tasks.workunit.client.1.smithi155.stdout:1/11: write f1 [4903455,38374] 0 2024-09-13T21:44:40.573 INFO:tasks.workunit.client.0.smithi119.stdout:5/226: dread d0/d3/d4/d2e/f2f [0,4194304] 0 2024-09-13T21:44:40.574 INFO:tasks.workunit.client.0.smithi119.stdout:9/277: rename d0/d19/l20 to d0/d8/d18/d23/d42/d52/l5b 0 2024-09-13T21:44:40.575 INFO:tasks.workunit.client.1.smithi155.stdout:4/20: unlink d1/c2 0 2024-09-13T21:44:40.575 INFO:tasks.workunit.client.1.smithi155.stdout:4/21: truncate - no filename 2024-09-13T21:44:40.575 INFO:tasks.workunit.client.1.smithi155.stdout:4/22: fdatasync - no filename 2024-09-13T21:44:40.576 INFO:tasks.workunit.client.0.smithi119.stdout:8/384: dread d1b/d1d/f5f [0,4194304] 0 2024-09-13T21:44:40.576 INFO:tasks.workunit.client.0.smithi119.stdout:5/227: creat d0/d3/d1f/d21/f51 x:0 0 0 2024-09-13T21:44:40.577 INFO:tasks.workunit.client.1.smithi155.stdout:7/5: stat l1 0 2024-09-13T21:44:40.577 INFO:tasks.workunit.client.1.smithi155.stdout:7/6: dread - no filename 2024-09-13T21:44:40.577 INFO:tasks.workunit.client.1.smithi155.stdout:7/7: dwrite - no filename 2024-09-13T21:44:40.578 INFO:tasks.workunit.client.0.smithi119.stdout:9/278: fdatasync d0/d19/d1a/f5a 0 2024-09-13T21:44:40.579 INFO:tasks.workunit.client.0.smithi119.stdout:2/315: mkdir d1/d22/d55/d31/d66 0 2024-09-13T21:44:40.579 INFO:tasks.workunit.client.1.smithi155.stdout:1/12: dread f1 [0,4194304] 0 2024-09-13T21:44:40.580 INFO:tasks.workunit.client.0.smithi119.stdout:9/279: dread - d0/d8/d18/d23/d27/f3f zero size 2024-09-13T21:44:40.580 INFO:tasks.workunit.client.1.smithi155.stdout:0/12: mkdir d1/d6 0 2024-09-13T21:44:40.580 INFO:tasks.workunit.client.1.smithi155.stdout:1/13: write f1 [1557403,88648] 0 2024-09-13T21:44:40.580 INFO:tasks.workunit.client.0.smithi119.stdout:5/228: creat d0/d3/d1f/f52 x:0 0 0 2024-09-13T21:44:40.581 INFO:tasks.workunit.client.1.smithi155.stdout:3/15: getdents d3 0 2024-09-13T21:44:40.581 INFO:tasks.workunit.client.1.smithi155.stdout:1/14: truncate f1 5524614 0 2024-09-13T21:44:40.581 INFO:tasks.workunit.client.1.smithi155.stdout:3/16: rename d3 to d3/d4 22 2024-09-13T21:44:40.582 INFO:tasks.workunit.client.1.smithi155.stdout:4/23: symlink d1/l3 0 2024-09-13T21:44:40.583 INFO:tasks.workunit.client.0.smithi119.stdout:8/385: rename d1b/d1d/d26/c51 to d1b/d1d/d48/d58/c7e 0 2024-09-13T21:44:40.583 INFO:tasks.workunit.client.1.smithi155.stdout:7/8: mknod c2 0 2024-09-13T21:44:40.583 INFO:tasks.workunit.client.1.smithi155.stdout:7/9: truncate - no filename 2024-09-13T21:44:40.584 INFO:tasks.workunit.client.1.smithi155.stdout:7/10: chown l1 9 1 2024-09-13T21:44:40.584 INFO:tasks.workunit.client.1.smithi155.stdout:7/11: write - no filename 2024-09-13T21:44:40.584 INFO:tasks.workunit.client.1.smithi155.stdout:7/12: rmdir - no directory 2024-09-13T21:44:40.584 INFO:tasks.workunit.client.1.smithi155.stdout:9/5: rmdir d2 0 2024-09-13T21:44:40.584 INFO:tasks.workunit.client.0.smithi119.stdout:8/386: chown d1b/d1d/d26/d3e 209916680 1 2024-09-13T21:44:40.585 INFO:tasks.workunit.client.0.smithi119.stdout:5/229: dread d0/d3/d4/d2e/f32 [0,4194304] 0 2024-09-13T21:44:40.585 INFO:tasks.workunit.client.0.smithi119.stdout:2/316: write d1/f4a [1619576,123658] 0 2024-09-13T21:44:40.585 INFO:tasks.workunit.client.1.smithi155.stdout:1/15: write f1 [552835,37659] 0 2024-09-13T21:44:40.585 INFO:tasks.workunit.client.0.smithi119.stdout:9/280: creat d0/d8/d18/d23/d42/d52/f5c x:0 0 0 2024-09-13T21:44:40.586 INFO:tasks.workunit.client.1.smithi155.stdout:9/6: mknod c3 0 2024-09-13T21:44:40.587 INFO:tasks.workunit.client.1.smithi155.stdout:0/13: creat d1/d6/f7 x:0 0 0 2024-09-13T21:44:40.588 INFO:tasks.workunit.client.0.smithi119.stdout:9/281: chown d0/d8/d18/d23 0 1 2024-09-13T21:44:40.588 INFO:tasks.workunit.client.1.smithi155.stdout:0/14: dread - d1/f5 zero size 2024-09-13T21:44:40.588 INFO:tasks.workunit.client.1.smithi155.stdout:3/17: mknod d3/c5 0 2024-09-13T21:44:40.588 INFO:tasks.workunit.client.1.smithi155.stdout:0/15: stat f0 0 2024-09-13T21:44:40.588 INFO:tasks.workunit.client.0.smithi119.stdout:8/387: mkdir d1b/d1d/d48/d58/d7f 0 2024-09-13T21:44:40.589 INFO:tasks.workunit.client.1.smithi155.stdout:0/16: write d1/f2 [4886971,36865] 0 2024-09-13T21:44:40.590 INFO:tasks.workunit.client.1.smithi155.stdout:1/16: symlink l5 0 2024-09-13T21:44:40.592 INFO:tasks.workunit.client.1.smithi155.stdout:9/7: rename c3 to c4 0 2024-09-13T21:44:40.593 INFO:tasks.workunit.client.1.smithi155.stdout:3/18: mkdir d3/d6 0 2024-09-13T21:44:40.597 INFO:tasks.workunit.client.0.smithi119.stdout:2/317: dwrite d1/d7/f2a [0,4194304] 0 2024-09-13T21:44:40.597 INFO:tasks.workunit.client.1.smithi155.stdout:0/17: creat d1/d6/f8 x:0 0 0 2024-09-13T21:44:40.598 INFO:tasks.workunit.client.1.smithi155.stdout:1/17: dwrite f1 [0,4194304] 0 2024-09-13T21:44:40.600 INFO:tasks.workunit.client.1.smithi155.stdout:3/19: creat d3/f7 x:0 0 0 2024-09-13T21:44:40.600 INFO:tasks.workunit.client.1.smithi155.stdout:0/18: symlink d1/d6/l9 0 2024-09-13T21:44:40.601 INFO:tasks.workunit.client.1.smithi155.stdout:3/20: read f2 [3390605,88774] 0 2024-09-13T21:44:40.602 INFO:tasks.workunit.client.1.smithi155.stdout:1/18: mkdir d6 0 2024-09-13T21:44:40.606 INFO:tasks.workunit.client.1.smithi155.stdout:3/21: dread f2 [0,4194304] 0 2024-09-13T21:44:40.607 INFO:tasks.workunit.client.0.smithi119.stdout:8/388: creat d1b/d1d/f80 x:0 0 0 2024-09-13T21:44:40.607 INFO:tasks.workunit.client.1.smithi155.stdout:0/19: unlink d1/f2 0 2024-09-13T21:44:40.608 INFO:tasks.workunit.client.1.smithi155.stdout:4/24: getdents d1 0 2024-09-13T21:44:40.608 INFO:tasks.workunit.client.1.smithi155.stdout:4/25: dwrite - no filename 2024-09-13T21:44:40.608 INFO:tasks.workunit.client.1.smithi155.stdout:4/26: dread - no filename 2024-09-13T21:44:40.608 INFO:tasks.workunit.client.1.smithi155.stdout:4/27: truncate - no filename 2024-09-13T21:44:40.608 INFO:tasks.workunit.client.1.smithi155.stdout:4/28: dread - no filename 2024-09-13T21:44:40.608 INFO:tasks.workunit.client.1.smithi155.stdout:4/29: dwrite - no filename 2024-09-13T21:44:40.609 INFO:tasks.workunit.client.0.smithi119.stdout:2/318: creat d1/d22/d55/d31/d66/f67 x:0 0 0 2024-09-13T21:44:40.609 INFO:tasks.workunit.client.1.smithi155.stdout:0/20: write f0 [1024094,56895] 0 2024-09-13T21:44:40.609 INFO:tasks.workunit.client.0.smithi119.stdout:5/230: truncate d0/d3/d4/d9/d14/d24/f31 3337734 0 2024-09-13T21:44:40.610 INFO:tasks.workunit.client.1.smithi155.stdout:7/13: getdents . 0 2024-09-13T21:44:40.611 INFO:tasks.workunit.client.0.smithi119.stdout:2/319: stat d1/d7/f23 0 2024-09-13T21:44:40.611 INFO:tasks.workunit.client.0.smithi119.stdout:4/305: dread d4/f40 [0,4194304] 0 2024-09-13T21:44:40.615 INFO:tasks.workunit.client.1.smithi155.stdout:4/30: creat d1/f4 x:0 0 0 2024-09-13T21:44:40.615 INFO:tasks.workunit.client.1.smithi155.stdout:1/19: dread f1 [4194304,4194304] 0 2024-09-13T21:44:40.615 INFO:tasks.workunit.client.0.smithi119.stdout:9/282: dwrite d0/f7 [0,4194304] 0 2024-09-13T21:44:40.616 INFO:tasks.workunit.client.1.smithi155.stdout:0/21: symlink d1/la 0 2024-09-13T21:44:40.616 INFO:tasks.workunit.client.1.smithi155.stdout:4/31: chown d1/l3 49111604 1 2024-09-13T21:44:40.616 INFO:tasks.workunit.client.1.smithi155.stdout:4/32: stat d1/l3 0 2024-09-13T21:44:40.617 INFO:tasks.workunit.client.0.smithi119.stdout:2/320: fsync d1/d2b/f34 0 2024-09-13T21:44:40.617 INFO:tasks.workunit.client.1.smithi155.stdout:4/33: write d1/f4 [840970,128476] 0 2024-09-13T21:44:40.618 INFO:tasks.workunit.client.0.smithi119.stdout:8/389: creat d1b/d1d/d26/f81 x:0 0 0 2024-09-13T21:44:40.618 INFO:tasks.workunit.client.1.smithi155.stdout:7/14: creat f3 x:0 0 0 2024-09-13T21:44:40.618 INFO:tasks.workunit.client.1.smithi155.stdout:7/15: fdatasync f3 0 2024-09-13T21:44:40.619 INFO:tasks.workunit.client.1.smithi155.stdout:4/34: write d1/f4 [568545,30464] 0 2024-09-13T21:44:40.619 INFO:tasks.workunit.client.1.smithi155.stdout:7/16: chown f3 177473 1 2024-09-13T21:44:40.620 INFO:tasks.workunit.client.0.smithi119.stdout:9/283: fsync d0/d8/d18/d23/d42/d52/f5c 0 2024-09-13T21:44:40.620 INFO:tasks.workunit.client.0.smithi119.stdout:2/321: readlink d1/d22/d55/l4d 0 2024-09-13T21:44:40.620 INFO:tasks.workunit.client.1.smithi155.stdout:3/22: creat d3/d6/f8 x:0 0 0 2024-09-13T21:44:40.621 INFO:tasks.workunit.client.0.smithi119.stdout:8/390: read d1b/f1f [2250074,28556] 0 2024-09-13T21:44:40.622 INFO:tasks.workunit.client.1.smithi155.stdout:0/22: creat d1/d6/fb x:0 0 0 2024-09-13T21:44:40.625 INFO:tasks.workunit.client.1.smithi155.stdout:7/17: mknod c4 0 2024-09-13T21:44:40.627 INFO:tasks.workunit.client.1.smithi155.stdout:0/23: mkdir d1/d6/dc 0 2024-09-13T21:44:40.628 INFO:tasks.workunit.client.1.smithi155.stdout:7/18: mkdir d5 0 2024-09-13T21:44:40.629 INFO:tasks.workunit.client.0.smithi119.stdout:5/231: dwrite d0/d3/d1f/d21/f34 [4194304,4194304] 0 2024-09-13T21:44:40.629 INFO:tasks.workunit.client.0.smithi119.stdout:2/322: link d1/d7/l14 d1/d22/l68 0 2024-09-13T21:44:40.632 INFO:tasks.workunit.client.1.smithi155.stdout:0/24: write d1/f5 [709045,114065] 0 2024-09-13T21:44:40.632 INFO:tasks.workunit.client.1.smithi155.stdout:7/19: mknod d5/c6 0 2024-09-13T21:44:40.634 INFO:tasks.workunit.client.1.smithi155.stdout:3/23: dwrite d3/f7 [0,4194304] 0 2024-09-13T21:44:40.634 INFO:tasks.workunit.client.1.smithi155.stdout:7/20: chown f3 274509504 1 2024-09-13T21:44:40.634 INFO:tasks.workunit.client.1.smithi155.stdout:0/25: stat d1/d6/f8 0 2024-09-13T21:44:40.635 INFO:tasks.workunit.client.1.smithi155.stdout:1/20: dwrite f1 [0,4194304] 0 2024-09-13T21:44:40.635 INFO:tasks.workunit.client.0.smithi119.stdout:2/323: dread d1/d22/f42 [0,4194304] 0 2024-09-13T21:44:40.637 INFO:tasks.workunit.client.1.smithi155.stdout:3/24: fsync f2 0 2024-09-13T21:44:40.639 INFO:tasks.workunit.client.1.smithi155.stdout:3/25: rename d3 to d3/d9 22 2024-09-13T21:44:40.640 INFO:tasks.workunit.client.1.smithi155.stdout:1/21: dread f1 [4194304,4194304] 0 2024-09-13T21:44:40.640 INFO:tasks.workunit.client.1.smithi155.stdout:0/26: unlink f0 0 2024-09-13T21:44:40.640 INFO:tasks.workunit.client.0.smithi119.stdout:9/284: dwrite d0/d8/d18/d23/d42/d52/f5c [0,4194304] 0 2024-09-13T21:44:40.641 INFO:tasks.workunit.client.0.smithi119.stdout:8/391: dwrite fd [4194304,4194304] 0 2024-09-13T21:44:40.642 INFO:tasks.workunit.client.1.smithi155.stdout:7/21: rename d5/c6 to d5/c7 0 2024-09-13T21:44:40.645 INFO:tasks.workunit.client.1.smithi155.stdout:4/35: rmdir d1 39 2024-09-13T21:44:40.646 INFO:tasks.workunit.client.1.smithi155.stdout:7/22: fsync f3 0 2024-09-13T21:44:40.648 INFO:tasks.workunit.client.1.smithi155.stdout:7/23: chown d5 309 1 2024-09-13T21:44:40.648 INFO:tasks.workunit.client.1.smithi155.stdout:1/22: mkdir d6/d7 0 2024-09-13T21:44:40.649 INFO:tasks.workunit.client.1.smithi155.stdout:3/26: dwrite d3/d6/f8 [0,4194304] 0 2024-09-13T21:44:40.650 INFO:tasks.workunit.client.1.smithi155.stdout:7/24: write f3 [983718,72603] 0 2024-09-13T21:44:40.652 INFO:tasks.workunit.client.1.smithi155.stdout:0/27: symlink d1/d6/dc/ld 0 2024-09-13T21:44:40.657 INFO:tasks.workunit.client.1.smithi155.stdout:3/27: creat d3/fa x:0 0 0 2024-09-13T21:44:40.657 INFO:tasks.workunit.client.0.smithi119.stdout:8/392: readlink d1b/d4e/l7b 0 2024-09-13T21:44:40.658 INFO:tasks.workunit.client.1.smithi155.stdout:3/28: stat d3/f7 0 2024-09-13T21:44:40.658 INFO:tasks.workunit.client.1.smithi155.stdout:1/23: creat d6/d7/f8 x:0 0 0 2024-09-13T21:44:40.659 INFO:tasks.workunit.client.1.smithi155.stdout:4/36: dread d1/f4 [0,4194304] 0 2024-09-13T21:44:40.659 INFO:tasks.workunit.client.0.smithi119.stdout:4/306: truncate d4/d1e/d10/f46 4062012 0 2024-09-13T21:44:40.661 INFO:tasks.workunit.client.0.smithi119.stdout:4/307: stat d4/d1e/l11 0 2024-09-13T21:44:40.662 INFO:tasks.workunit.client.1.smithi155.stdout:4/37: truncate d1/f4 1801323 0 2024-09-13T21:44:40.663 INFO:tasks.workunit.client.1.smithi155.stdout:7/25: dwrite f3 [0,4194304] 0 2024-09-13T21:44:40.663 INFO:tasks.workunit.client.1.smithi155.stdout:1/24: rename c4 to d6/c9 0 2024-09-13T21:44:40.667 INFO:tasks.workunit.client.1.smithi155.stdout:7/26: mknod d5/c8 0 2024-09-13T21:44:40.669 INFO:tasks.workunit.client.0.smithi119.stdout:2/324: dread d1/d22/d5a/f63 [0,4194304] 0 2024-09-13T21:44:40.669 INFO:tasks.workunit.client.0.smithi119.stdout:4/308: chown d4/f21 753677270 1 2024-09-13T21:44:40.670 INFO:tasks.workunit.client.1.smithi155.stdout:1/25: creat d6/fa x:0 0 0 2024-09-13T21:44:40.671 INFO:tasks.workunit.client.0.smithi119.stdout:9/285: dread d0/d8/d18/d23/d42/d52/f5c [0,4194304] 0 2024-09-13T21:44:40.671 INFO:tasks.workunit.client.1.smithi155.stdout:7/27: symlink d5/l9 0 2024-09-13T21:44:40.672 INFO:tasks.workunit.client.1.smithi155.stdout:4/38: link d1/l3 d1/l5 0 2024-09-13T21:44:40.673 INFO:tasks.workunit.client.1.smithi155.stdout:3/29: dwrite d3/d6/f8 [0,4194304] 0 2024-09-13T21:44:40.673 INFO:tasks.workunit.client.1.smithi155.stdout:7/28: chown c2 23890173 1 2024-09-13T21:44:40.674 INFO:tasks.workunit.client.0.smithi119.stdout:5/232: dwrite d0/d3/d4/d2e/f32 [0,4194304] 0 2024-09-13T21:44:40.675 INFO:tasks.workunit.client.0.smithi119.stdout:2/325: dread - d1/d22/f5f zero size 2024-09-13T21:44:40.676 INFO:tasks.workunit.client.1.smithi155.stdout:4/39: write d1/f4 [1543181,19693] 0 2024-09-13T21:44:40.676 INFO:tasks.workunit.client.0.smithi119.stdout:9/286: fdatasync d0/d8/d18/d23/d42/d52/f5c 0 2024-09-13T21:44:40.677 INFO:tasks.workunit.client.0.smithi119.stdout:9/287: chown d0/d4f 16494905 1 2024-09-13T21:44:40.678 INFO:tasks.workunit.client.0.smithi119.stdout:2/326: creat d1/d38/f69 x:0 0 0 2024-09-13T21:44:40.678 INFO:tasks.workunit.client.1.smithi155.stdout:7/29: creat d5/fa x:0 0 0 2024-09-13T21:44:40.679 INFO:tasks.workunit.client.0.smithi119.stdout:2/327: chown d1/d2b/f34 1 1 2024-09-13T21:44:40.681 INFO:tasks.workunit.client.0.smithi119.stdout:9/288: creat d0/d8/d18/d23/d27/d2d/f5d x:0 0 0 2024-09-13T21:44:40.683 INFO:tasks.workunit.client.0.smithi119.stdout:9/289: creat d0/d8/d18/f5e x:0 0 0 2024-09-13T21:44:40.685 INFO:tasks.workunit.client.0.smithi119.stdout:9/290: mkdir d0/d8/d18/d23/d27/d2d/d5f 0 2024-09-13T21:44:40.711 INFO:tasks.workunit.client.0.smithi119.stdout:8/393: truncate fd 7919378 0 2024-09-13T21:44:40.714 INFO:tasks.workunit.client.0.smithi119.stdout:8/394: creat d1b/d1d/d48/d58/d7f/f82 x:0 0 0 2024-09-13T21:44:40.715 INFO:tasks.workunit.client.0.smithi119.stdout:8/395: readlink d1b/d1d/l45 0 2024-09-13T21:44:40.717 INFO:tasks.workunit.client.0.smithi119.stdout:9/291: rmdir d0/d8/d18 39 2024-09-13T21:44:40.718 INFO:tasks.workunit.client.0.smithi119.stdout:9/292: chown d0/lc 0 1 2024-09-13T21:44:40.724 INFO:tasks.workunit.client.0.smithi119.stdout:9/293: rename d0/d8/d18/d2f to d0/d19/d1a/d2b/d60 0 2024-09-13T21:44:40.724 INFO:tasks.workunit.client.0.smithi119.stdout:2/328: dread d1/d22/f1c [0,4194304] 0 2024-09-13T21:44:40.724 INFO:tasks.workunit.client.1.smithi155.stdout:1/26: link d6/fa d6/fb 0 2024-09-13T21:44:40.725 INFO:tasks.workunit.client.1.smithi155.stdout:4/40: fsync d1/f4 0 2024-09-13T21:44:40.726 INFO:tasks.workunit.client.0.smithi119.stdout:8/396: getdents d1b/d1d/d48/d58/d7f 0 2024-09-13T21:44:40.726 INFO:tasks.workunit.client.0.smithi119.stdout:2/329: chown d1/d7/d47/f57 28709 1 2024-09-13T21:44:40.726 INFO:tasks.workunit.client.1.smithi155.stdout:7/30: creat d5/fb x:0 0 0 2024-09-13T21:44:40.728 INFO:tasks.workunit.client.1.smithi155.stdout:1/27: mknod d6/d7/cc 0 2024-09-13T21:44:40.729 INFO:tasks.workunit.client.1.smithi155.stdout:1/28: readlink l5 0 2024-09-13T21:44:40.729 INFO:tasks.workunit.client.1.smithi155.stdout:3/30: fdatasync d3/f7 0 2024-09-13T21:44:40.730 INFO:tasks.workunit.client.0.smithi119.stdout:9/294: rename d0/d8/d18/d23/d27/f16 to d0/d8/d18/d23/d27/d2d/d5f/f61 0 2024-09-13T21:44:40.730 INFO:tasks.workunit.client.1.smithi155.stdout:4/41: creat d1/f6 x:0 0 0 2024-09-13T21:44:40.730 INFO:tasks.workunit.client.1.smithi155.stdout:3/31: chown d3/d6 13012950 1 2024-09-13T21:44:40.730 INFO:tasks.workunit.client.0.smithi119.stdout:2/330: mknod d1/d22/d55/d31/d66/c6a 0 2024-09-13T21:44:40.731 INFO:tasks.workunit.client.1.smithi155.stdout:7/31: unlink d5/c8 0 2024-09-13T21:44:40.732 INFO:tasks.workunit.client.1.smithi155.stdout:7/32: dread - d5/fb zero size 2024-09-13T21:44:40.732 INFO:tasks.workunit.client.0.smithi119.stdout:2/331: truncate d1/d22/d55/f44 679734 0 2024-09-13T21:44:40.732 INFO:tasks.workunit.client.1.smithi155.stdout:1/29: mknod d6/d7/cd 0 2024-09-13T21:44:40.736 INFO:tasks.workunit.client.1.smithi155.stdout:4/42: mkdir d1/d7 0 2024-09-13T21:44:40.736 INFO:tasks.workunit.client.1.smithi155.stdout:0/28: truncate d1/f5 319959 0 2024-09-13T21:44:40.737 INFO:tasks.workunit.client.0.smithi119.stdout:2/332: dread - d1/d38/f69 zero size 2024-09-13T21:44:40.737 INFO:tasks.workunit.client.0.smithi119.stdout:8/397: dwrite d1b/f1f [0,4194304] 0 2024-09-13T21:44:40.737 INFO:tasks.workunit.client.0.smithi119.stdout:2/333: chown d1/d22/d55/d31/d36/f65 834696364 1 2024-09-13T21:44:40.740 INFO:tasks.workunit.client.0.smithi119.stdout:2/334: rmdir d1/d22/d55/d31/d36/d62 0 2024-09-13T21:44:40.745 INFO:tasks.workunit.client.0.smithi119.stdout:9/295: truncate d0/d8/d18/d23/f29 2335218 0 2024-09-13T21:44:40.747 INFO:tasks.workunit.client.0.smithi119.stdout:2/335: dwrite d1/d38/f2e [0,4194304] 0 2024-09-13T21:44:40.747 INFO:tasks.workunit.client.0.smithi119.stdout:9/296: rmdir d0/d19/d1a/d2b 39 2024-09-13T21:44:40.750 INFO:tasks.workunit.client.0.smithi119.stdout:9/297: unlink d0/d8/ld 0 2024-09-13T21:44:40.750 INFO:tasks.workunit.client.0.smithi119.stdout:9/298: dread - d0/d8/f4b zero size 2024-09-13T21:44:40.751 INFO:tasks.workunit.client.0.smithi119.stdout:9/299: chown d0/d19/d1a/c45 264006724 1 2024-09-13T21:44:40.754 INFO:tasks.workunit.client.0.smithi119.stdout:9/300: mknod d0/d8/c62 0 2024-09-13T21:44:40.756 INFO:tasks.workunit.client.0.smithi119.stdout:9/301: mknod d0/d19/d1a/c63 0 2024-09-13T21:44:40.757 INFO:tasks.workunit.client.0.smithi119.stdout:9/302: fdatasync d0/d19/f59 0 2024-09-13T21:44:40.762 INFO:tasks.workunit.client.0.smithi119.stdout:9/303: dwrite d0/d19/f30 [0,4194304] 0 2024-09-13T21:44:40.763 INFO:tasks.workunit.client.0.smithi119.stdout:9/304: write d0/d8/d18/f5e [903794,67145] 0 2024-09-13T21:44:40.767 INFO:tasks.workunit.client.0.smithi119.stdout:9/305: link d0/d19/f46 d0/d4f/f64 0 2024-09-13T21:44:40.767 INFO:tasks.workunit.client.1.smithi155.stdout:3/32: unlink f2 0 2024-09-13T21:44:40.768 INFO:tasks.workunit.client.1.smithi155.stdout:7/33: creat d5/fc x:0 0 0 2024-09-13T21:44:40.768 INFO:tasks.workunit.client.1.smithi155.stdout:0/29: write d1/d6/fb [508275,20369] 0 2024-09-13T21:44:40.768 INFO:tasks.workunit.client.1.smithi155.stdout:4/43: truncate d1/f4 2564158 0 2024-09-13T21:44:40.769 INFO:tasks.workunit.client.1.smithi155.stdout:1/30: fdatasync d6/fb 0 2024-09-13T21:44:40.769 INFO:tasks.workunit.client.0.smithi119.stdout:9/306: fdatasync d0/d19/d1a/f4d 0 2024-09-13T21:44:40.770 INFO:tasks.workunit.client.1.smithi155.stdout:1/31: stat d6/d7/cd 0 2024-09-13T21:44:40.771 INFO:tasks.workunit.client.1.smithi155.stdout:1/32: read f1 [2106079,113506] 0 2024-09-13T21:44:40.773 INFO:tasks.workunit.client.0.smithi119.stdout:2/336: rename d1/d22/d55/d31/d36 to d1/d2b/d6b 0 2024-09-13T21:44:40.777 INFO:tasks.workunit.client.0.smithi119.stdout:9/307: link d0/d19/d1a/f40 d0/d8/d18/d23/d42/d52/f65 0 2024-09-13T21:44:40.778 INFO:tasks.workunit.client.0.smithi119.stdout:2/337: mknod d1/d22/d55/d31/d66/c6c 0 2024-09-13T21:44:40.779 INFO:tasks.workunit.client.1.smithi155.stdout:3/33: chown l1 435462 1 2024-09-13T21:44:40.779 INFO:tasks.workunit.client.0.smithi119.stdout:2/338: read - d1/f37 zero size 2024-09-13T21:44:40.780 INFO:tasks.workunit.client.1.smithi155.stdout:7/34: dwrite d5/fa [0,4194304] 0 2024-09-13T21:44:40.781 INFO:tasks.workunit.client.0.smithi119.stdout:9/308: mknod d0/d8/d18/d23/d42/d52/c66 0 2024-09-13T21:44:40.781 INFO:tasks.workunit.client.1.smithi155.stdout:1/33: mknod d6/ce 0 2024-09-13T21:44:40.781 INFO:tasks.workunit.client.1.smithi155.stdout:3/34: write d3/fa [177265,52742] 0 2024-09-13T21:44:40.781 INFO:tasks.workunit.client.0.smithi119.stdout:2/339: write d1/f32 [2082114,130883] 0 2024-09-13T21:44:40.782 INFO:tasks.workunit.client.1.smithi155.stdout:7/35: read - d5/fb zero size 2024-09-13T21:44:40.784 INFO:tasks.workunit.client.0.smithi119.stdout:9/309: write d0/d8/f10 [199412,82441] 0 2024-09-13T21:44:40.784 INFO:tasks.workunit.client.0.smithi119.stdout:2/340: symlink d1/d22/l6d 0 2024-09-13T21:44:40.784 INFO:tasks.workunit.client.1.smithi155.stdout:1/34: creat d6/ff x:0 0 0 2024-09-13T21:44:40.786 INFO:tasks.workunit.client.1.smithi155.stdout:1/35: chown d6/d7/f8 31276 1 2024-09-13T21:44:40.786 INFO:tasks.workunit.client.1.smithi155.stdout:1/36: chown d6 2 1 2024-09-13T21:44:40.786 INFO:tasks.workunit.client.1.smithi155.stdout:7/36: rmdir d5 39 2024-09-13T21:44:40.787 INFO:tasks.workunit.client.1.smithi155.stdout:3/35: creat d3/d6/fb x:0 0 0 2024-09-13T21:44:40.789 INFO:tasks.workunit.client.1.smithi155.stdout:7/37: write d5/fc [646293,56669] 0 2024-09-13T21:44:40.789 INFO:tasks.workunit.client.0.smithi119.stdout:2/341: read d1/d7/f9 [1402463,62983] 0 2024-09-13T21:44:40.790 INFO:tasks.workunit.client.1.smithi155.stdout:1/37: mkdir d6/d7/d10 0 2024-09-13T21:44:40.792 INFO:tasks.workunit.client.0.smithi119.stdout:9/310: dwrite d0/d8/d18/d23/f39 [4194304,4194304] 0 2024-09-13T21:44:40.793 INFO:tasks.workunit.client.1.smithi155.stdout:1/38: rename c3 to d6/d7/d10/c11 0 2024-09-13T21:44:40.794 INFO:tasks.workunit.client.0.smithi119.stdout:9/311: write d0/d8/d18/d23/f51 [572741,81800] 0 2024-09-13T21:44:40.794 INFO:tasks.workunit.client.1.smithi155.stdout:1/39: chown f1 1 1 2024-09-13T21:44:40.798 INFO:tasks.workunit.client.0.smithi119.stdout:9/312: symlink d0/d19/d1a/d2b/l67 0 2024-09-13T21:44:40.803 INFO:tasks.workunit.client.1.smithi155.stdout:4/44: truncate d1/f4 1591914 0 2024-09-13T21:44:40.804 INFO:tasks.workunit.client.1.smithi155.stdout:1/40: fsync d6/ff 0 2024-09-13T21:44:40.805 INFO:tasks.workunit.client.0.smithi119.stdout:9/313: dwrite d0/f14 [4194304,4194304] 0 2024-09-13T21:44:40.805 INFO:tasks.workunit.client.1.smithi155.stdout:4/45: symlink d1/l8 0 2024-09-13T21:44:40.806 INFO:tasks.workunit.client.1.smithi155.stdout:7/38: truncate d5/fa 1045329 0 2024-09-13T21:44:40.808 INFO:tasks.workunit.client.1.smithi155.stdout:7/39: creat d5/fd x:0 0 0 2024-09-13T21:44:40.809 INFO:tasks.workunit.client.1.smithi155.stdout:7/40: chown d5/fa 0 1 2024-09-13T21:44:40.809 INFO:tasks.workunit.client.0.smithi119.stdout:2/342: rmdir d1/d22 39 2024-09-13T21:44:40.812 INFO:tasks.workunit.client.0.smithi119.stdout:0/319: sync 2024-09-13T21:44:40.812 INFO:tasks.workunit.client.0.smithi119.stdout:6/284: sync 2024-09-13T21:44:40.814 INFO:tasks.workunit.client.1.smithi155.stdout:0/30: dwrite d1/f5 [0,4194304] 0 2024-09-13T21:44:40.815 INFO:tasks.workunit.client.0.smithi119.stdout:6/285: rmdir dc/d4b 39 2024-09-13T21:44:40.815 INFO:tasks.workunit.client.0.smithi119.stdout:6/286: chown dc/df 614 1 2024-09-13T21:44:40.815 INFO:tasks.workunit.client.0.smithi119.stdout:0/320: mkdir de/d49/d7d 0 2024-09-13T21:44:40.817 INFO:tasks.workunit.client.0.smithi119.stdout:6/287: symlink dc/d4b/l54 0 2024-09-13T21:44:40.818 INFO:tasks.workunit.client.0.smithi119.stdout:0/321: unlink de/d1c/d2f/d35/f38 0 2024-09-13T21:44:40.818 INFO:tasks.workunit.client.1.smithi155.stdout:0/31: creat d1/d6/dc/fe x:0 0 0 2024-09-13T21:44:40.819 INFO:tasks.workunit.client.1.smithi155.stdout:0/32: read - d1/d6/f7 zero size 2024-09-13T21:44:40.820 INFO:tasks.workunit.client.0.smithi119.stdout:6/288: unlink fa 0 2024-09-13T21:44:40.822 INFO:tasks.workunit.client.1.smithi155.stdout:0/33: rename d1/d6/dc/ld to d1/d6/lf 0 2024-09-13T21:44:40.823 INFO:tasks.workunit.client.0.smithi119.stdout:6/289: creat dc/df/f55 x:0 0 0 2024-09-13T21:44:40.826 INFO:tasks.workunit.client.0.smithi119.stdout:9/314: dread d0/d8/d18/d23/f29 [0,4194304] 0 2024-09-13T21:44:40.829 INFO:tasks.workunit.client.0.smithi119.stdout:9/315: mknod d0/d8/d18/d23/d42/d52/c68 0 2024-09-13T21:44:40.829 INFO:tasks.workunit.client.0.smithi119.stdout:2/343: dwrite d1/d7/f9 [0,4194304] 0 2024-09-13T21:44:40.830 INFO:tasks.workunit.client.0.smithi119.stdout:2/344: dread - d1/f3d zero size 2024-09-13T21:44:40.835 INFO:tasks.workunit.client.1.smithi155.stdout:4/46: dread d1/f4 [0,4194304] 0 2024-09-13T21:44:40.838 INFO:tasks.workunit.client.0.smithi119.stdout:9/316: dwrite d0/d19/f30 [0,4194304] 0 2024-09-13T21:44:40.838 INFO:tasks.workunit.client.1.smithi155.stdout:4/47: rename d1/l8 to d1/d7/l9 0 2024-09-13T21:44:40.839 INFO:tasks.workunit.client.1.smithi155.stdout:0/34: rmdir d1/d6 39 2024-09-13T21:44:40.840 INFO:tasks.workunit.client.0.smithi119.stdout:9/317: write d0/f2c [4128057,44395] 0 2024-09-13T21:44:40.840 INFO:tasks.workunit.client.0.smithi119.stdout:2/345: dwrite d1/f25 [0,4194304] 0 2024-09-13T21:44:40.842 INFO:tasks.workunit.client.1.smithi155.stdout:4/48: write d1/f4 [2509898,75388] 0 2024-09-13T21:44:40.843 INFO:tasks.workunit.client.1.smithi155.stdout:0/35: write d1/d6/fb [1545073,103846] 0 2024-09-13T21:44:40.846 INFO:tasks.workunit.client.1.smithi155.stdout:0/36: rmdir d1 39 2024-09-13T21:44:40.848 INFO:tasks.workunit.client.0.smithi119.stdout:2/346: creat d1/d22/f6e x:0 0 0 2024-09-13T21:44:40.850 INFO:tasks.workunit.client.0.smithi119.stdout:6/290: chown dc/df/f12 19731221 1 2024-09-13T21:44:40.850 INFO:tasks.workunit.client.0.smithi119.stdout:9/318: getdents d0/d19/d1a/d2b 0 2024-09-13T21:44:40.853 INFO:tasks.workunit.client.0.smithi119.stdout:0/322: dwrite de/d3c/f3d [0,4194304] 0 2024-09-13T21:44:40.854 INFO:tasks.workunit.client.0.smithi119.stdout:2/347: truncate d1/d22/f5f 831512 0 2024-09-13T21:44:40.854 INFO:tasks.workunit.client.1.smithi155.stdout:4/49: dwrite d1/f6 [0,4194304] 0 2024-09-13T21:44:40.855 INFO:tasks.workunit.client.0.smithi119.stdout:9/319: creat d0/d8/d18/d23/f69 x:0 0 0 2024-09-13T21:44:40.856 INFO:tasks.workunit.client.0.smithi119.stdout:9/320: dread - d0/d8/d18/d23/d27/f3f zero size 2024-09-13T21:44:40.857 INFO:tasks.workunit.client.0.smithi119.stdout:2/348: chown d1/d22/d55/d31/l33 3930 1 2024-09-13T21:44:40.860 INFO:tasks.workunit.client.1.smithi155.stdout:0/37: dwrite d1/d6/f7 [0,4194304] 0 2024-09-13T21:44:40.861 INFO:tasks.workunit.client.0.smithi119.stdout:6/291: rename dc/df/d32/l42 to dc/df/d41/l56 0 2024-09-13T21:44:40.861 INFO:tasks.workunit.client.0.smithi119.stdout:2/349: symlink d1/d22/l6f 0 2024-09-13T21:44:40.862 INFO:tasks.workunit.client.1.smithi155.stdout:4/50: dread d1/f4 [0,4194304] 0 2024-09-13T21:44:40.862 INFO:tasks.workunit.client.0.smithi119.stdout:9/321: write d0/d8/d18/d23/d27/d2d/d5f/f61 [1292688,111119] 0 2024-09-13T21:44:40.865 INFO:tasks.workunit.client.1.smithi155.stdout:0/38: creat d1/d6/dc/f10 x:0 0 0 2024-09-13T21:44:40.865 INFO:tasks.workunit.client.1.smithi155.stdout:0/39: readlink d1/la 0 2024-09-13T21:44:40.866 INFO:tasks.workunit.client.1.smithi155.stdout:4/51: mkdir d1/da 0 2024-09-13T21:44:40.866 INFO:tasks.workunit.client.0.smithi119.stdout:2/350: truncate d1/d7/d47/f5c 215282 0 2024-09-13T21:44:40.867 INFO:tasks.workunit.client.1.smithi155.stdout:0/40: write d1/d6/f8 [514229,38077] 0 2024-09-13T21:44:40.868 INFO:tasks.workunit.client.1.smithi155.stdout:4/52: fsync d1/f4 0 2024-09-13T21:44:40.868 INFO:tasks.workunit.client.1.smithi155.stdout:0/41: truncate d1/d6/f8 846247 0 2024-09-13T21:44:40.870 INFO:tasks.workunit.client.0.smithi119.stdout:6/292: link dc/d3d/d40/f4c dc/d3d/d4e/f57 0 2024-09-13T21:44:40.870 INFO:tasks.workunit.client.0.smithi119.stdout:6/293: chown dc 30087076 1 2024-09-13T21:44:40.871 INFO:tasks.workunit.client.0.smithi119.stdout:2/351: symlink d1/d2b/l70 0 2024-09-13T21:44:40.871 INFO:tasks.workunit.client.0.smithi119.stdout:9/322: creat d0/d19/d1a/d2b/f6a x:0 0 0 2024-09-13T21:44:40.874 INFO:tasks.workunit.client.1.smithi155.stdout:0/42: link d1/f5 d1/d6/dc/f11 0 2024-09-13T21:44:40.874 INFO:tasks.workunit.client.0.smithi119.stdout:6/294: write dc/dd/f4f [534980,28247] 0 2024-09-13T21:44:40.875 INFO:tasks.workunit.client.0.smithi119.stdout:2/352: mknod d1/d22/d5a/d5d/c71 0 2024-09-13T21:44:40.876 INFO:tasks.workunit.client.1.smithi155.stdout:0/43: creat d1/d6/f12 x:0 0 0 2024-09-13T21:44:40.877 INFO:tasks.workunit.client.0.smithi119.stdout:9/323: symlink d0/d8/d18/d23/d42/d52/l6b 0 2024-09-13T21:44:40.877 INFO:tasks.workunit.client.0.smithi119.stdout:0/323: truncate de/d1c/f5c 149003 0 2024-09-13T21:44:40.879 INFO:tasks.workunit.client.0.smithi119.stdout:2/353: mknod d1/d38/c72 0 2024-09-13T21:44:40.880 INFO:tasks.workunit.client.0.smithi119.stdout:9/324: write d0/d8/d18/d23/d42/d52/f5c [2199472,110753] 0 2024-09-13T21:44:40.881 INFO:tasks.workunit.client.1.smithi155.stdout:0/44: dread d1/f5 [0,4194304] 0 2024-09-13T21:44:40.881 INFO:tasks.workunit.client.1.smithi155.stdout:0/45: chown d1/c4 28842 1 2024-09-13T21:44:40.881 INFO:tasks.workunit.client.0.smithi119.stdout:2/354: dread - d1/d22/d55/f54 zero size 2024-09-13T21:44:40.881 INFO:tasks.workunit.client.0.smithi119.stdout:0/324: write de/d1c/f36 [1880169,250] 0 2024-09-13T21:44:40.882 INFO:tasks.workunit.client.0.smithi119.stdout:9/325: dread - d0/d19/d1a/f5a zero size 2024-09-13T21:44:40.882 INFO:tasks.workunit.client.1.smithi155.stdout:0/46: creat d1/d6/f13 x:0 0 0 2024-09-13T21:44:40.885 INFO:tasks.workunit.client.0.smithi119.stdout:9/326: rmdir d0/d8/d18/d23/d27 39 2024-09-13T21:44:40.886 INFO:tasks.workunit.client.1.smithi155.stdout:0/47: dread d1/d6/f7 [0,4194304] 0 2024-09-13T21:44:40.889 INFO:tasks.workunit.client.0.smithi119.stdout:2/355: dwrite d1/d38/f2e [0,4194304] 0 2024-09-13T21:44:40.890 INFO:tasks.workunit.client.1.smithi155.stdout:4/53: truncate d1/f6 2102278 0 2024-09-13T21:44:40.891 INFO:tasks.workunit.client.1.smithi155.stdout:4/54: creat d1/fb x:0 0 0 2024-09-13T21:44:40.893 INFO:tasks.workunit.client.1.smithi155.stdout:4/55: mkdir d1/da/dc 0 2024-09-13T21:44:40.894 INFO:tasks.workunit.client.0.smithi119.stdout:9/327: dread d0/d8/d18/d23/d27/f17 [0,4194304] 0 2024-09-13T21:44:40.896 INFO:tasks.workunit.client.0.smithi119.stdout:9/328: chown d0/d19/d1a/d2b/f3e 5209 1 2024-09-13T21:44:40.896 INFO:tasks.workunit.client.0.smithi119.stdout:2/356: link d1/d22/f1c d1/d22/d55/d31/d66/f73 0 2024-09-13T21:44:40.897 INFO:tasks.workunit.client.0.smithi119.stdout:9/329: fdatasync d0/d19/f30 0 2024-09-13T21:44:40.897 INFO:tasks.workunit.client.0.smithi119.stdout:0/325: read de/d1c/f5c [77790,17726] 0 2024-09-13T21:44:40.900 INFO:tasks.workunit.client.0.smithi119.stdout:0/326: write de/d1c/f36 [2188848,75699] 0 2024-09-13T21:44:40.902 INFO:tasks.workunit.client.1.smithi155.stdout:4/56: dwrite d1/f4 [0,4194304] 0 2024-09-13T21:44:40.902 INFO:tasks.workunit.client.1.smithi155.stdout:4/57: chown c0 221 1 2024-09-13T21:44:40.903 INFO:tasks.workunit.client.1.smithi155.stdout:4/58: chown d1/da 39299014 1 2024-09-13T21:44:40.904 INFO:tasks.workunit.client.0.smithi119.stdout:0/327: creat de/d3c/d7c/f7e x:0 0 0 2024-09-13T21:44:40.905 INFO:tasks.workunit.client.1.smithi155.stdout:4/59: readlink d1/l3 0 2024-09-13T21:44:40.905 INFO:tasks.workunit.client.0.smithi119.stdout:0/328: stat de/f22 0 2024-09-13T21:44:40.906 INFO:tasks.workunit.client.0.smithi119.stdout:2/357: dwrite d1/d2b/f34 [0,4194304] 0 2024-09-13T21:44:40.907 INFO:tasks.workunit.client.0.smithi119.stdout:2/358: fdatasync d1/d7/f20 0 2024-09-13T21:44:40.908 INFO:tasks.workunit.client.1.smithi155.stdout:4/60: symlink d1/ld 0 2024-09-13T21:44:40.910 INFO:tasks.workunit.client.0.smithi119.stdout:2/359: creat d1/d7/d47/f74 x:0 0 0 2024-09-13T21:44:40.912 INFO:tasks.workunit.client.0.smithi119.stdout:2/360: chown d1/d38/c72 244854917 1 2024-09-13T21:44:40.915 INFO:tasks.workunit.client.0.smithi119.stdout:2/361: chown d1/d22/f42 475957540 1 2024-09-13T21:44:40.916 INFO:tasks.workunit.client.0.smithi119.stdout:2/362: readlink d1/l46 0 2024-09-13T21:44:40.917 INFO:tasks.workunit.client.0.smithi119.stdout:0/329: dwrite de/d3c/f6d [0,4194304] 0 2024-09-13T21:44:40.923 INFO:tasks.workunit.client.0.smithi119.stdout:0/330: mkdir de/d4e/d7f 0 2024-09-13T21:44:40.923 INFO:tasks.workunit.client.0.smithi119.stdout:9/330: dwrite d0/d8/d18/d23/d42/d52/f65 [0,4194304] 0 2024-09-13T21:44:40.923 INFO:tasks.workunit.client.1.smithi155.stdout:4/61: rename d1/da to d1/d7/de 0 2024-09-13T21:44:40.927 INFO:tasks.workunit.client.0.smithi119.stdout:0/331: mknod de/d1c/d2b/d76/c80 0 2024-09-13T21:44:40.928 INFO:tasks.workunit.client.0.smithi119.stdout:9/331: rename d0/d8/c3c to d0/d19/d1a/d2b/d60/c6c 0 2024-09-13T21:44:40.929 INFO:tasks.workunit.client.0.smithi119.stdout:2/363: link d1/d38/l30 d1/l75 0 2024-09-13T21:44:40.930 INFO:tasks.workunit.client.0.smithi119.stdout:2/364: write d1/d22/d55/f54 [210069,82587] 0 2024-09-13T21:44:40.931 INFO:tasks.workunit.client.0.smithi119.stdout:9/332: creat d0/d19/f6d x:0 0 0 2024-09-13T21:44:40.932 INFO:tasks.workunit.client.0.smithi119.stdout:2/365: chown d1/d7/l2f 55589422 1 2024-09-13T21:44:40.935 INFO:tasks.workunit.client.0.smithi119.stdout:9/333: dread d0/d19/f46 [0,4194304] 0 2024-09-13T21:44:40.938 INFO:tasks.workunit.client.0.smithi119.stdout:0/332: read de/d1c/d2f/f41 [602211,122758] 0 2024-09-13T21:44:40.939 INFO:tasks.workunit.client.0.smithi119.stdout:0/333: dread - de/f77 zero size 2024-09-13T21:44:40.940 INFO:tasks.workunit.client.0.smithi119.stdout:0/334: chown de/d49 24 1 2024-09-13T21:44:40.941 INFO:tasks.workunit.client.0.smithi119.stdout:2/366: link d1/d22/c29 d1/d22/d55/c76 0 2024-09-13T21:44:40.941 INFO:tasks.workunit.client.0.smithi119.stdout:9/334: write d0/d19/f26 [1061491,71916] 0 2024-09-13T21:44:40.944 INFO:tasks.workunit.client.0.smithi119.stdout:0/335: creat de/d1c/d2f/d40/f81 x:0 0 0 2024-09-13T21:44:40.944 INFO:tasks.workunit.client.0.smithi119.stdout:2/367: mkdir d1/d22/d5a/d5d/d77 0 2024-09-13T21:44:40.945 INFO:tasks.workunit.client.0.smithi119.stdout:9/335: mkdir d0/d8/d18/d23/d27/d2d/d6e 0 2024-09-13T21:44:40.947 INFO:tasks.workunit.client.0.smithi119.stdout:0/336: symlink de/d1c/d2b/d34/l82 0 2024-09-13T21:44:40.948 INFO:tasks.workunit.client.0.smithi119.stdout:0/337: chown de/d1c/d2f/d35 14 1 2024-09-13T21:44:40.951 INFO:tasks.workunit.client.0.smithi119.stdout:0/338: write de/d49/f4f [1013216,59284] 0 2024-09-13T21:44:40.953 INFO:tasks.workunit.client.0.smithi119.stdout:9/336: dwrite d0/d19/f6d [0,4194304] 0 2024-09-13T21:44:40.953 INFO:tasks.workunit.client.0.smithi119.stdout:2/368: write d1/d22/f1c [4361563,109370] 0 2024-09-13T21:44:40.956 INFO:tasks.workunit.client.0.smithi119.stdout:9/337: write d0/d8/d18/d23/d42/d52/f65 [3413082,86204] 0 2024-09-13T21:44:40.956 INFO:tasks.workunit.client.0.smithi119.stdout:2/369: creat d1/d22/d5a/d5d/f78 x:0 0 0 2024-09-13T21:44:40.957 INFO:tasks.workunit.client.0.smithi119.stdout:0/339: mkdir de/d1c/d2f/d35/d50/d83 0 2024-09-13T21:44:40.958 INFO:tasks.workunit.client.0.smithi119.stdout:0/340: fsync de/d1c/f1d 0 2024-09-13T21:44:40.959 INFO:tasks.workunit.client.0.smithi119.stdout:2/370: creat d1/d22/d55/d31/d66/f79 x:0 0 0 2024-09-13T21:44:40.960 INFO:tasks.workunit.client.0.smithi119.stdout:3/327: sync 2024-09-13T21:44:40.960 INFO:tasks.workunit.client.0.smithi119.stdout:7/280: sync 2024-09-13T21:44:40.960 INFO:tasks.workunit.client.0.smithi119.stdout:1/301: sync 2024-09-13T21:44:40.962 INFO:tasks.workunit.client.0.smithi119.stdout:9/338: symlink d0/d8/d18/d23/d42/d52/d53/l6f 0 2024-09-13T21:44:40.963 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:40 smithi119 ceph-mon[27653]: [13/Sep/2024:21:44:39] ENGINE Bus STARTING 2024-09-13T21:44:40.963 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:40 smithi119 ceph-mon[27653]: [13/Sep/2024:21:44:39] ENGINE Serving on http://172.21.15.155:8765 2024-09-13T21:44:40.963 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:40 smithi119 ceph-mon[27653]: [13/Sep/2024:21:44:39] ENGINE Serving on https://172.21.15.155:7150 2024-09-13T21:44:40.963 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:40 smithi119 ceph-mon[27653]: [13/Sep/2024:21:44:39] ENGINE Bus STARTED 2024-09-13T21:44:40.963 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:40 smithi119 ceph-mon[27653]: [13/Sep/2024:21:44:39] ENGINE Error in HTTPServer.serve 2024-09-13T21:44:40.963 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Traceback (most recent call last): 2024-09-13T21:44:40.963 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:44:40.963 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._run(expiration_interval) 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s = self.context.wrap_socket( 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: return self.sslsocket_class._create( 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self.do_handshake() 2024-09-13T21:44:40.964 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:44:40.965 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._sslobj.do_handshake() 2024-09-13T21:44:40.965 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:44:40.965 INFO:tasks.workunit.client.0.smithi119.stdout:2/371: rmdir d1/d7/d47 39 2024-09-13T21:44:40.967 INFO:tasks.workunit.client.0.smithi119.stdout:7/281: creat d8/d3c/d53/d3b/f54 x:0 0 0 2024-09-13T21:44:40.967 INFO:tasks.workunit.client.0.smithi119.stdout:3/328: read d6/f16 [642234,104298] 0 2024-09-13T21:44:40.970 INFO:tasks.workunit.client.0.smithi119.stdout:2/372: symlink d1/d22/d55/d31/l7a 0 2024-09-13T21:44:40.971 INFO:tasks.workunit.client.0.smithi119.stdout:0/341: dwrite de/d1c/d2b/f2c [0,4194304] 0 2024-09-13T21:44:40.974 INFO:tasks.workunit.client.0.smithi119.stdout:3/329: rmdir d6/d15/d1a 39 2024-09-13T21:44:40.978 INFO:tasks.workunit.client.0.smithi119.stdout:3/330: write d6/f3e [722148,38637] 0 2024-09-13T21:44:40.979 INFO:tasks.workunit.client.0.smithi119.stdout:0/342: creat de/d1c/d2f/d35/d4a/d62/f84 x:0 0 0 2024-09-13T21:44:40.982 INFO:tasks.workunit.client.0.smithi119.stdout:1/302: dwrite d1/d3/dc/d24/f29 [0,4194304] 0 2024-09-13T21:44:40.982 INFO:tasks.workunit.client.0.smithi119.stdout:3/331: dread - d6/d44/d52/f58 zero size 2024-09-13T21:44:40.983 INFO:tasks.workunit.client.0.smithi119.stdout:9/339: dwrite d0/d8/d18/d23/d42/d52/f65 [0,4194304] 0 2024-09-13T21:44:40.984 INFO:tasks.workunit.client.0.smithi119.stdout:2/373: dread d1/f25 [0,4194304] 0 2024-09-13T21:44:40.988 INFO:tasks.workunit.client.0.smithi119.stdout:9/340: mkdir d0/d8/d18/d23/d27/d2d/d70 0 2024-09-13T21:44:40.992 INFO:tasks.workunit.client.0.smithi119.stdout:3/332: truncate d6/ff 382926 0 2024-09-13T21:44:40.992 INFO:tasks.workunit.client.0.smithi119.stdout:2/374: symlink d1/d22/d5a/l7b 0 2024-09-13T21:44:40.995 INFO:tasks.workunit.client.0.smithi119.stdout:2/375: mkdir d1/d22/d7c 0 2024-09-13T21:44:40.996 INFO:tasks.workunit.client.0.smithi119.stdout:9/341: link d0/c24 d0/d19/d1a/d2b/c71 0 2024-09-13T21:44:40.997 INFO:tasks.workunit.client.0.smithi119.stdout:2/376: symlink d1/d22/l7d 0 2024-09-13T21:44:40.999 INFO:tasks.workunit.client.0.smithi119.stdout:9/342: mknod d0/d8/d18/d23/d42/d52/d53/c72 0 2024-09-13T21:44:40.999 INFO:tasks.workunit.client.0.smithi119.stdout:2/377: readlink d1/d22/d5a/l7b 0 2024-09-13T21:44:41.000 INFO:tasks.workunit.client.0.smithi119.stdout:2/378: write d1/d22/d55/d31/d66/f73 [1610883,43449] 0 2024-09-13T21:44:41.009 INFO:tasks.workunit.client.0.smithi119.stdout:9/343: dread d0/d8/d18/d23/d42/d52/f5c [0,4194304] 0 2024-09-13T21:44:41.016 INFO:tasks.workunit.client.0.smithi119.stdout:2/379: dwrite d1/f32 [0,4194304] 0 2024-09-13T21:44:41.017 INFO:tasks.workunit.client.0.smithi119.stdout:3/333: dwrite d6/f29 [0,4194304] 0 2024-09-13T21:44:41.019 INFO:tasks.workunit.client.0.smithi119.stdout:1/303: dwrite d1/d3/dc/d11/d19/d2d/f51 [0,4194304] 0 2024-09-13T21:44:41.021 INFO:tasks.workunit.client.0.smithi119.stdout:1/304: mkdir d1/d3/d61 0 2024-09-13T21:44:41.023 INFO:tasks.workunit.client.0.smithi119.stdout:0/343: dwrite de/d1c/d2f/d35/d4a/d62/f75 [4194304,4194304] 0 2024-09-13T21:44:41.025 INFO:tasks.workunit.client.0.smithi119.stdout:1/305: write d1/d3/dc/d24/f29 [4386226,90756] 0 2024-09-13T21:44:41.025 INFO:tasks.workunit.client.0.smithi119.stdout:3/334: rename d6/d25/d2f/d33/d56/f5e to d6/d44/f6f 0 2024-09-13T21:44:41.027 INFO:tasks.workunit.client.0.smithi119.stdout:3/335: chown d6/d15/f30 1146562 1 2024-09-13T21:44:41.029 INFO:tasks.workunit.client.0.smithi119.stdout:3/336: fsync d6/d25/d2f/f39 0 2024-09-13T21:44:41.029 INFO:tasks.workunit.client.0.smithi119.stdout:0/344: symlink de/d1c/d2f/d35/d4a/d62/l85 0 2024-09-13T21:44:41.032 INFO:tasks.workunit.client.0.smithi119.stdout:2/380: creat d1/d7/d47/f7e x:0 0 0 2024-09-13T21:44:41.032 INFO:tasks.workunit.client.0.smithi119.stdout:1/306: write d1/f1b [9513051,102373] 0 2024-09-13T21:44:41.035 INFO:tasks.workunit.client.0.smithi119.stdout:2/381: symlink d1/d22/l7f 0 2024-09-13T21:44:41.039 INFO:tasks.workunit.client.0.smithi119.stdout:0/345: dread de/f61 [0,4194304] 0 2024-09-13T21:44:41.039 INFO:tasks.workunit.client.0.smithi119.stdout:2/382: read - d1/d38/f69 zero size 2024-09-13T21:44:41.042 INFO:tasks.workunit.client.0.smithi119.stdout:0/346: fdatasync de/f61 0 2024-09-13T21:44:41.046 INFO:tasks.workunit.client.0.smithi119.stdout:1/307: dwrite d1/d3/dc/d24/d2f/d31/d32/f3e [4194304,4194304] 0 2024-09-13T21:44:41.049 INFO:tasks.workunit.client.0.smithi119.stdout:9/344: dwrite d0/d8/d18/d23/f29 [0,4194304] 0 2024-09-13T21:44:41.056 INFO:tasks.workunit.client.0.smithi119.stdout:2/383: dwrite d1/d22/f1c [4194304,4194304] 0 2024-09-13T21:44:41.056 INFO:tasks.workunit.client.0.smithi119.stdout:1/308: readlink d1/d3/dc/d24/d2f/d31/d32/d33/l3b 0 2024-09-13T21:44:41.057 INFO:tasks.workunit.client.0.smithi119.stdout:1/309: write d1/f1b [2663976,120832] 0 2024-09-13T21:44:41.060 INFO:tasks.workunit.client.0.smithi119.stdout:2/384: mknod d1/d22/d55/c80 0 2024-09-13T21:44:41.062 INFO:tasks.workunit.client.0.smithi119.stdout:2/385: creat d1/d22/d5a/f81 x:0 0 0 2024-09-13T21:44:41.067 INFO:tasks.workunit.client.0.smithi119.stdout:2/386: rename d1/d22/d55/l4d to d1/d22/d55/d31/d66/l82 0 2024-09-13T21:44:41.068 INFO:tasks.workunit.client.0.smithi119.stdout:2/387: chown d1/l46 1283672 1 2024-09-13T21:44:41.069 INFO:tasks.workunit.client.0.smithi119.stdout:2/388: chown d1/d22/l6d 497647 1 2024-09-13T21:44:41.069 INFO:tasks.workunit.client.0.smithi119.stdout:1/310: link d1/d3/dc/d24/d2f/d31/c36 d1/d3/dc/d11/d19/d2d/c62 0 2024-09-13T21:44:41.069 INFO:tasks.workunit.client.0.smithi119.stdout:0/347: truncate de/d1c/f36 658290 0 2024-09-13T21:44:41.076 INFO:tasks.workunit.client.0.smithi119.stdout:0/348: link de/l11 de/d49/l86 0 2024-09-13T21:44:41.077 INFO:tasks.workunit.client.0.smithi119.stdout:9/345: dwrite d0/d19/d1a/f4d [0,4194304] 0 2024-09-13T21:44:41.080 INFO:tasks.workunit.client.0.smithi119.stdout:0/349: unlink de/d1c/d2b/d34/l82 0 2024-09-13T21:44:41.080 INFO:tasks.workunit.client.0.smithi119.stdout:9/346: mkdir d0/d4f/d73 0 2024-09-13T21:44:41.082 INFO:tasks.workunit.client.0.smithi119.stdout:0/350: unlink de/d1c/c2a 0 2024-09-13T21:44:41.085 INFO:tasks.workunit.client.0.smithi119.stdout:9/347: dread d0/f7 [0,4194304] 0 2024-09-13T21:44:41.087 INFO:tasks.workunit.client.0.smithi119.stdout:2/389: rename d1/d22/d55/d31/d66 to d1/d22/d5a/d5d/d83 0 2024-09-13T21:44:41.088 INFO:tasks.workunit.client.0.smithi119.stdout:0/351: readlink de/d1c/d59/l5a 0 2024-09-13T21:44:41.090 INFO:tasks.workunit.client.0.smithi119.stdout:9/348: dread d0/d19/d1a/d2b/f43 [0,4194304] 0 2024-09-13T21:44:41.091 INFO:tasks.workunit.client.0.smithi119.stdout:9/349: write d0/f2c [1075475,8673] 0 2024-09-13T21:44:41.093 INFO:tasks.workunit.client.0.smithi119.stdout:2/390: symlink d1/d22/d5a/d5d/d83/l84 0 2024-09-13T21:44:41.094 INFO:tasks.workunit.client.0.smithi119.stdout:0/352: write de/f3e [810856,41018] 0 2024-09-13T21:44:41.096 INFO:tasks.workunit.client.0.smithi119.stdout:1/311: rename d1/d3/dc/d11/d19/d2d/c62 to d1/d3/dc/d24/d2f/d31/d32/d33/d43/c63 0 2024-09-13T21:44:41.096 INFO:tasks.workunit.client.0.smithi119.stdout:0/353: fdatasync de/d1c/f27 0 2024-09-13T21:44:41.097 INFO:tasks.workunit.client.0.smithi119.stdout:9/350: mkdir d0/d8/d18/d23/d27/d2d/d5f/d74 0 2024-09-13T21:44:41.098 INFO:tasks.workunit.client.0.smithi119.stdout:2/391: mkdir d1/d22/d5a/d5d/d85 0 2024-09-13T21:44:41.099 INFO:tasks.workunit.client.0.smithi119.stdout:0/354: mknod de/d4e/c87 0 2024-09-13T21:44:41.101 INFO:tasks.workunit.client.0.smithi119.stdout:1/312: write d1/d3/dc/d11/f17 [5007349,63289] 0 2024-09-13T21:44:41.104 INFO:tasks.workunit.client.0.smithi119.stdout:1/313: write d1/d3/dc/d11/d28/f3f [1916792,32999] 0 2024-09-13T21:44:41.104 INFO:tasks.workunit.client.0.smithi119.stdout:0/355: creat de/d1c/d2f/d35/d50/d83/f88 x:0 0 0 2024-09-13T21:44:41.106 INFO:tasks.workunit.client.0.smithi119.stdout:2/392: dread d1/d22/d55/f48 [0,4194304] 0 2024-09-13T21:44:41.106 INFO:tasks.workunit.client.0.smithi119.stdout:1/314: stat d1/d3/dc/d24/d2f/d31/d32/d33/l35 0 2024-09-13T21:44:41.107 INFO:tasks.workunit.client.0.smithi119.stdout:9/351: link d0/d8/d18/d23/d42/d52/c66 d0/d8/d18/d23/c75 0 2024-09-13T21:44:41.107 INFO:tasks.workunit.client.0.smithi119.stdout:0/356: chown de/d1c/d64/f73 193905 1 2024-09-13T21:44:41.108 INFO:tasks.workunit.client.0.smithi119.stdout:9/352: readlink d0/d8/d18/l28 0 2024-09-13T21:44:41.110 INFO:tasks.workunit.client.0.smithi119.stdout:1/315: creat d1/d3/dc/d24/d2f/d31/d32/f64 x:0 0 0 2024-09-13T21:44:41.110 INFO:tasks.workunit.client.0.smithi119.stdout:9/353: mknod d0/d8/d18/d23/d42/d52/c76 0 2024-09-13T21:44:41.112 INFO:tasks.workunit.client.0.smithi119.stdout:1/316: write d1/d3/dc/f1c [2306659,71304] 0 2024-09-13T21:44:41.113 INFO:tasks.workunit.client.0.smithi119.stdout:9/354: rmdir d0/d8/d18/d23/d42 39 2024-09-13T21:44:41.115 INFO:tasks.workunit.client.0.smithi119.stdout:0/357: dwrite de/d1c/d2b/d34/f3a [0,4194304] 0 2024-09-13T21:44:41.117 INFO:tasks.workunit.client.0.smithi119.stdout:1/317: chown d1/d3/dc/d24/d2f/d31/d32/d33/l3b 8 1 2024-09-13T21:44:41.120 INFO:tasks.workunit.client.0.smithi119.stdout:0/358: rename de/d1c/f58 to de/d49/d7d/f89 0 2024-09-13T21:44:41.125 INFO:tasks.workunit.client.0.smithi119.stdout:9/355: dwrite d0/d19/d1a/f5a [0,4194304] 0 2024-09-13T21:44:41.131 INFO:tasks.workunit.client.0.smithi119.stdout:1/318: dwrite d1/d3/dc/d24/d2f/d31/d32/f64 [0,4194304] 0 2024-09-13T21:44:41.134 INFO:tasks.workunit.client.0.smithi119.stdout:9/356: mknod d0/d8/d18/d23/d42/d52/c77 0 2024-09-13T21:44:41.136 INFO:tasks.workunit.client.0.smithi119.stdout:1/319: read d1/d3/dc/d11/f17 [5329703,75874] 0 2024-09-13T21:44:41.139 INFO:tasks.workunit.client.0.smithi119.stdout:1/320: write d1/d3/dc/d11/f17 [2526373,69828] 0 2024-09-13T21:44:41.140 INFO:tasks.workunit.client.0.smithi119.stdout:9/357: rename d0/d19/d1a/c37 to d0/d19/d1a/d2b/c78 0 2024-09-13T21:44:41.142 INFO:tasks.workunit.client.0.smithi119.stdout:9/358: write d0/d8/f4b [201762,29589] 0 2024-09-13T21:44:41.149 INFO:tasks.workunit.client.0.smithi119.stdout:4/309: sync 2024-09-13T21:44:41.149 INFO:tasks.workunit.client.0.smithi119.stdout:1/321: dwrite d1/d3/f2b [0,4194304] 0 2024-09-13T21:44:41.149 INFO:tasks.workunit.client.0.smithi119.stdout:5/233: sync 2024-09-13T21:44:41.149 INFO:tasks.workunit.client.0.smithi119.stdout:8/398: sync 2024-09-13T21:44:41.150 INFO:tasks.workunit.client.0.smithi119.stdout:4/310: chown d4/d1e/d10 25620646 1 2024-09-13T21:44:41.151 INFO:tasks.workunit.client.0.smithi119.stdout:4/311: dread - d4/f38 zero size 2024-09-13T21:44:41.151 INFO:tasks.workunit.client.0.smithi119.stdout:1/322: rename d1/d3 to d1/d3/dc/d11/d28/d65 22 2024-09-13T21:44:41.151 INFO:tasks.workunit.client.0.smithi119.stdout:8/399: truncate f18 697310 0 2024-09-13T21:44:41.152 INFO:tasks.workunit.client.0.smithi119.stdout:5/234: mknod d0/c53 0 2024-09-13T21:44:41.153 INFO:tasks.workunit.client.0.smithi119.stdout:1/323: mknod d1/d3/dc/d24/d2f/d31/d32/d33/c66 0 2024-09-13T21:44:41.154 INFO:tasks.workunit.client.0.smithi119.stdout:5/235: write d0/d3/d1f/f52 [1006261,80292] 0 2024-09-13T21:44:41.155 INFO:tasks.workunit.client.0.smithi119.stdout:8/400: write d1b/d1d/d26/f3d [3157494,31822] 0 2024-09-13T21:44:41.157 INFO:tasks.workunit.client.0.smithi119.stdout:4/312: link d4/f52 d4/d1e/f5c 0 2024-09-13T21:44:41.158 INFO:tasks.workunit.client.0.smithi119.stdout:4/313: readlink d4/d1e/lc 0 2024-09-13T21:44:41.159 INFO:tasks.workunit.client.0.smithi119.stdout:1/324: write d1/d3/dc/d11/f17 [8408061,55445] 0 2024-09-13T21:44:41.159 INFO:tasks.workunit.client.0.smithi119.stdout:0/359: dread fc [0,4194304] 0 2024-09-13T21:44:41.161 INFO:tasks.workunit.client.0.smithi119.stdout:8/401: rmdir d1b/d4e/d6a 39 2024-09-13T21:44:41.161 INFO:tasks.workunit.client.0.smithi119.stdout:0/360: write de/d1c/d52/f7a [746447,62055] 0 2024-09-13T21:44:41.164 INFO:tasks.workunit.client.0.smithi119.stdout:1/325: fdatasync d1/d3/dc/d11/f3c 0 2024-09-13T21:44:41.166 INFO:tasks.workunit.client.0.smithi119.stdout:0/361: creat de/d1c/d64/f8a x:0 0 0 2024-09-13T21:44:41.166 INFO:tasks.workunit.client.0.smithi119.stdout:1/326: rmdir d1/d3/dc/d11/d19 39 2024-09-13T21:44:41.169 INFO:tasks.workunit.client.0.smithi119.stdout:0/362: symlink de/d1c/d2f/d35/d50/l8b 0 2024-09-13T21:44:41.170 INFO:tasks.workunit.client.0.smithi119.stdout:4/314: dwrite d4/d1e/d26/f32 [0,4194304] 0 2024-09-13T21:44:41.173 INFO:tasks.workunit.client.0.smithi119.stdout:1/327: creat d1/d3/dc/f67 x:0 0 0 2024-09-13T21:44:41.175 INFO:tasks.workunit.client.0.smithi119.stdout:0/363: chown de/d1c/d2b/d34/f5f 0 1 2024-09-13T21:44:41.181 INFO:tasks.workunit.client.0.smithi119.stdout:0/364: creat de/d4e/f8c x:0 0 0 2024-09-13T21:44:41.181 INFO:tasks.workunit.client.0.smithi119.stdout:5/236: truncate d0/d3/d4/d2e/f32 3748782 0 2024-09-13T21:44:41.185 INFO:tasks.workunit.client.0.smithi119.stdout:4/315: dwrite d4/f2f [0,4194304] 0 2024-09-13T21:44:41.187 INFO:tasks.workunit.client.0.smithi119.stdout:8/402: dread d1b/d4e/f53 [0,4194304] 0 2024-09-13T21:44:41.187 INFO:tasks.workunit.client.0.smithi119.stdout:1/328: rename d1/d3/dc/d11/d19/d2d/d37/c46 to d1/d3/dc/d24/d2f/d31/d32/d33/d43/c68 0 2024-09-13T21:44:41.189 INFO:tasks.workunit.client.0.smithi119.stdout:5/237: mkdir d0/d3/d4/d9/d14/d24/d25/d54 0 2024-09-13T21:44:41.190 INFO:tasks.workunit.client.0.smithi119.stdout:4/316: mkdir d4/d1e/d28/d5d 0 2024-09-13T21:44:41.193 INFO:tasks.workunit.client.0.smithi119.stdout:5/238: dread - d0/d3/d4/d9/d14/d24/d25/f36 zero size 2024-09-13T21:44:41.195 INFO:tasks.workunit.client.0.smithi119.stdout:1/329: unlink d1/d3/dc/d24/d2f/d31/d32/d33/l3b 0 2024-09-13T21:44:41.195 INFO:tasks.workunit.client.0.smithi119.stdout:0/365: dread de/d49/f4f [0,4194304] 0 2024-09-13T21:44:41.198 INFO:tasks.workunit.client.0.smithi119.stdout:8/403: dwrite d1b/d1d/d26/f3d [4194304,4194304] 0 2024-09-13T21:44:41.198 INFO:tasks.workunit.client.0.smithi119.stdout:0/366: chown de/d1c/d2b/c4d 17952 1 2024-09-13T21:44:41.200 INFO:tasks.workunit.client.0.smithi119.stdout:1/330: mknod d1/d3/dc/d11/d19/d2d/c69 0 2024-09-13T21:44:41.202 INFO:tasks.workunit.client.0.smithi119.stdout:5/239: link d0/d3/d1f/f52 d0/d3/d4/d9/d14/d24/f55 0 2024-09-13T21:44:41.204 INFO:tasks.workunit.client.0.smithi119.stdout:0/367: creat de/d1c/d52/f8d x:0 0 0 2024-09-13T21:44:41.206 INFO:tasks.workunit.client.0.smithi119.stdout:8/404: mknod d1b/d1d/d48/d54/c83 0 2024-09-13T21:44:41.209 INFO:tasks.workunit.client.0.smithi119.stdout:1/331: unlink d1/d3/dc/d11/d3d/f56 0 2024-09-13T21:44:41.210 INFO:tasks.workunit.client.0.smithi119.stdout:5/240: mknod d0/d3/d1f/c56 0 2024-09-13T21:44:41.211 INFO:tasks.workunit.client.0.smithi119.stdout:0/368: readlink de/d1c/l46 0 2024-09-13T21:44:41.212 INFO:tasks.workunit.client.0.smithi119.stdout:0/369: stat de/d1c/d2f/d35/l56 0 2024-09-13T21:44:41.214 INFO:tasks.workunit.client.0.smithi119.stdout:0/370: read de/d1c/d2f/f47 [203124,28590] 0 2024-09-13T21:44:41.215 INFO:tasks.workunit.client.0.smithi119.stdout:4/317: truncate d4/d1e/d28/f24 732129 0 2024-09-13T21:44:41.216 INFO:tasks.workunit.client.0.smithi119.stdout:1/332: mknod d1/d3/dc/d11/d19/d2d/c6a 0 2024-09-13T21:44:41.221 INFO:tasks.workunit.client.0.smithi119.stdout:8/405: dwrite d1b/f36 [0,4194304] 0 2024-09-13T21:44:41.221 INFO:tasks.workunit.client.0.smithi119.stdout:4/318: chown d4/d1e/d28/c35 79678 1 2024-09-13T21:44:41.223 INFO:tasks.workunit.client.0.smithi119.stdout:0/371: rename de/d3c/f42 to de/d1c/d64/f8e 0 2024-09-13T21:44:41.226 INFO:tasks.workunit.client.0.smithi119.stdout:4/319: write d4/d1e/d26/f2d [5138568,129593] 0 2024-09-13T21:44:41.229 INFO:tasks.workunit.client.0.smithi119.stdout:1/333: symlink d1/d3/dc/d24/l6b 0 2024-09-13T21:44:41.231 INFO:tasks.workunit.client.0.smithi119.stdout:0/372: write de/d1c/d2f/f47 [4953893,83830] 0 2024-09-13T21:44:41.235 INFO:tasks.workunit.client.0.smithi119.stdout:4/320: mkdir d4/d1e/d26/d5e 0 2024-09-13T21:44:41.236 INFO:tasks.workunit.client.0.smithi119.stdout:1/334: mkdir d1/d3/d6c 0 2024-09-13T21:44:41.237 INFO:tasks.workunit.client.0.smithi119.stdout:5/241: link d0/d3/d4/d9/d14/d24/f31 d0/d3/d4/d2e/d4a/f57 0 2024-09-13T21:44:41.237 INFO:tasks.workunit.client.0.smithi119.stdout:1/335: readlink d1/d3/dc/d11/l12 0 2024-09-13T21:44:41.238 INFO:tasks.workunit.client.0.smithi119.stdout:0/373: mknod de/d4e/d7f/c8f 0 2024-09-13T21:44:41.239 INFO:tasks.workunit.client.0.smithi119.stdout:4/321: symlink d4/d1e/d26/d5e/l5f 0 2024-09-13T21:44:41.240 INFO:tasks.workunit.client.0.smithi119.stdout:0/374: write de/d1c/d64/f8a [7772,32989] 0 2024-09-13T21:44:41.241 INFO:tasks.workunit.client.0.smithi119.stdout:5/242: creat d0/d3/d4/d9/d14/d24/d25/f58 x:0 0 0 2024-09-13T21:44:41.242 INFO:tasks.workunit.client.0.smithi119.stdout:0/375: write de/f1a [772714,44915] 0 2024-09-13T21:44:41.244 INFO:tasks.workunit.client.0.smithi119.stdout:0/376: write de/f77 [172329,82359] 0 2024-09-13T21:44:41.245 INFO:tasks.workunit.client.0.smithi119.stdout:1/336: rename d1/d3/dc/d24/d2f/d31/d32/d33/l35 to d1/d3/dc/d24/d2f/d31/d32/l6d 0 2024-09-13T21:44:41.249 INFO:tasks.workunit.client.0.smithi119.stdout:4/322: dwrite d4/f21 [0,4194304] 0 2024-09-13T21:44:41.255 INFO:tasks.workunit.client.0.smithi119.stdout:0/377: dwrite de/d1c/f27 [0,4194304] 0 2024-09-13T21:44:41.257 INFO:tasks.workunit.client.0.smithi119.stdout:1/337: getdents d1/d3/dc 0 2024-09-13T21:44:41.260 INFO:tasks.workunit.client.0.smithi119.stdout:4/323: dwrite d4/f21 [0,4194304] 0 2024-09-13T21:44:41.260 INFO:tasks.workunit.client.0.smithi119.stdout:1/338: truncate d1/d3/dc/d11/d28/f5d 311321 0 2024-09-13T21:44:41.261 INFO:tasks.workunit.client.0.smithi119.stdout:4/324: chown d4/d1e/f36 324806893 1 2024-09-13T21:44:41.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:40 smithi155 ceph-mon[34732]: [13/Sep/2024:21:44:39] ENGINE Bus STARTING 2024-09-13T21:44:41.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:40 smithi155 ceph-mon[34732]: [13/Sep/2024:21:44:39] ENGINE Serving on http://172.21.15.155:8765 2024-09-13T21:44:41.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:40 smithi155 ceph-mon[34732]: [13/Sep/2024:21:44:39] ENGINE Serving on https://172.21.15.155:7150 2024-09-13T21:44:41.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:40 smithi155 ceph-mon[34732]: [13/Sep/2024:21:44:39] ENGINE Bus STARTED 2024-09-13T21:44:41.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:40 smithi155 ceph-mon[34732]: [13/Sep/2024:21:44:39] ENGINE Error in HTTPServer.serve 2024-09-13T21:44:41.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Traceback (most recent call last): 2024-09-13T21:44:41.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:44:41.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self._run(expiration_interval) 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: s = self.context.wrap_socket( 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: return self.sslsocket_class._create( 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self.do_handshake() 2024-09-13T21:44:41.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:44:41.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self._sslobj.do_handshake() 2024-09-13T21:44:41.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:44:41.341 INFO:tasks.workunit.client.0.smithi119.stdout:0/378: mkdir de/d1c/d2f/d35/d90 0 2024-09-13T21:44:41.341 INFO:tasks.workunit.client.0.smithi119.stdout:5/243: write d0/d3/d4/d9/f47 [21167,107100] 0 2024-09-13T21:44:41.342 INFO:tasks.workunit.client.0.smithi119.stdout:0/379: dread - de/d1c/d2f/d40/f81 zero size 2024-09-13T21:44:41.343 INFO:tasks.workunit.client.0.smithi119.stdout:1/339: unlink d1/d3/dc/d11/d19/d2d/c69 0 2024-09-13T21:44:41.344 INFO:tasks.workunit.client.0.smithi119.stdout:5/244: mknod d0/d3/c59 0 2024-09-13T21:44:41.346 INFO:tasks.workunit.client.0.smithi119.stdout:0/380: creat de/d4e/d7f/f91 x:0 0 0 2024-09-13T21:44:41.346 INFO:tasks.workunit.client.0.smithi119.stdout:5/245: truncate d0/d3/d4/d9/d14/d24/d25/f58 636174 0 2024-09-13T21:44:41.357 INFO:tasks.workunit.client.0.smithi119.stdout:6/295: sync 2024-09-13T21:44:41.357 INFO:tasks.workunit.client.0.smithi119.stdout:1/340: readlink d1/d3/dc/d11/d28/l49 0 2024-09-13T21:44:41.358 INFO:tasks.workunit.client.0.smithi119.stdout:4/325: getdents d4 0 2024-09-13T21:44:41.359 INFO:tasks.workunit.client.0.smithi119.stdout:1/341: chown d1/l5c 366 1 2024-09-13T21:44:41.361 INFO:tasks.workunit.client.0.smithi119.stdout:5/246: creat d0/d3/d4/d9/d14/d24/f5a x:0 0 0 2024-09-13T21:44:41.362 INFO:tasks.workunit.client.0.smithi119.stdout:5/247: readlink d0/d3/d1f/d21/l23 0 2024-09-13T21:44:41.363 INFO:tasks.workunit.client.0.smithi119.stdout:6/296: creat dc/d3d/d40/f58 x:0 0 0 2024-09-13T21:44:41.363 INFO:tasks.workunit.client.0.smithi119.stdout:4/326: dread d4/d1e/f33 [0,4194304] 0 2024-09-13T21:44:41.364 INFO:tasks.workunit.client.0.smithi119.stdout:1/342: symlink d1/d3/dc/d11/d19/d2d/d37/l6e 0 2024-09-13T21:44:41.365 INFO:tasks.workunit.client.0.smithi119.stdout:6/297: symlink dc/d37/l59 0 2024-09-13T21:44:41.367 INFO:tasks.workunit.client.0.smithi119.stdout:4/327: fdatasync d4/d1e/d10/f3f 0 2024-09-13T21:44:41.367 INFO:tasks.workunit.client.0.smithi119.stdout:0/381: dread de/d1c/d2f/f43 [0,4194304] 0 2024-09-13T21:44:41.370 INFO:tasks.workunit.client.0.smithi119.stdout:0/382: unlink de/d1c/c39 0 2024-09-13T21:44:41.374 INFO:tasks.workunit.client.0.smithi119.stdout:5/248: rename d0/d3/d4/d9/d14/d24/d25/c41 to d0/d3/d4/c5b 0 2024-09-13T21:44:41.375 INFO:tasks.workunit.client.0.smithi119.stdout:4/328: getdents d4/d1e/d10 0 2024-09-13T21:44:41.375 INFO:tasks.workunit.client.0.smithi119.stdout:1/343: dwrite d1/d3/dc/d24/d2f/d31/d32/f4b [0,4194304] 0 2024-09-13T21:44:41.375 INFO:tasks.workunit.client.0.smithi119.stdout:0/383: symlink de/d1c/d2f/d35/d50/d83/l92 0 2024-09-13T21:44:41.379 INFO:tasks.workunit.client.0.smithi119.stdout:1/344: unlink d1/d3/c25 0 2024-09-13T21:44:41.380 INFO:tasks.workunit.client.0.smithi119.stdout:0/384: fdatasync de/d49/d7d/f89 0 2024-09-13T21:44:41.384 INFO:tasks.workunit.client.0.smithi119.stdout:4/329: dread d4/f2b [0,4194304] 0 2024-09-13T21:44:41.385 INFO:tasks.workunit.client.0.smithi119.stdout:0/385: creat de/d1c/d2b/d76/f93 x:0 0 0 2024-09-13T21:44:41.386 INFO:tasks.workunit.client.0.smithi119.stdout:1/345: mkdir d1/d3/dc/d11/d19/d2d/d59/d6f 0 2024-09-13T21:44:41.387 INFO:tasks.workunit.client.0.smithi119.stdout:6/298: dread dc/df/f1c [0,4194304] 0 2024-09-13T21:44:41.388 INFO:tasks.workunit.client.0.smithi119.stdout:5/249: dwrite d0/d3/d4/d2e/d4a/f4d [0,4194304] 0 2024-09-13T21:44:41.389 INFO:tasks.workunit.client.0.smithi119.stdout:1/346: readlink d1/d3/dc/d11/l12 0 2024-09-13T21:44:41.392 INFO:tasks.workunit.client.0.smithi119.stdout:0/386: symlink de/d1c/d2f/d35/d50/d83/l94 0 2024-09-13T21:44:41.393 INFO:tasks.workunit.client.0.smithi119.stdout:0/387: chown de/d1c/f29 61170 1 2024-09-13T21:44:41.395 INFO:tasks.workunit.client.0.smithi119.stdout:0/388: chown de/d1c/d2f/d35/d4a/c63 989615354 1 2024-09-13T21:44:41.395 INFO:tasks.workunit.client.0.smithi119.stdout:6/299: creat dc/d3a/f5a x:0 0 0 2024-09-13T21:44:41.396 INFO:tasks.workunit.client.0.smithi119.stdout:5/250: unlink d0/d3/d4/d9/d14/l4b 0 2024-09-13T21:44:41.398 INFO:tasks.workunit.client.0.smithi119.stdout:1/347: rename d1/d3/dc/d24/c60 to d1/d3/dc/d24/d2f/d31/c70 0 2024-09-13T21:44:41.399 INFO:tasks.workunit.client.0.smithi119.stdout:0/389: rmdir de/d49 39 2024-09-13T21:44:41.402 INFO:tasks.workunit.client.0.smithi119.stdout:4/330: truncate d4/f27 4766416 0 2024-09-13T21:44:41.403 INFO:tasks.workunit.client.0.smithi119.stdout:5/251: readlink d0/d3/d4/d9/l16 0 2024-09-13T21:44:41.403 INFO:tasks.workunit.client.0.smithi119.stdout:0/390: rmdir de/d1c/d59 39 2024-09-13T21:44:41.403 INFO:tasks.workunit.client.0.smithi119.stdout:4/331: readlink d4/d1e/d26/d5e/l5f 0 2024-09-13T21:44:41.404 INFO:tasks.workunit.client.0.smithi119.stdout:0/391: chown de/d1c/d2f/d35/d4a/d62 5870 1 2024-09-13T21:44:41.405 INFO:tasks.workunit.client.0.smithi119.stdout:4/332: mkdir d4/d1e/d26/d60 0 2024-09-13T21:44:41.406 INFO:tasks.workunit.client.0.smithi119.stdout:4/333: write d4/d1e/f50 [4278805,104129] 0 2024-09-13T21:44:41.409 INFO:tasks.workunit.client.0.smithi119.stdout:4/334: dread d4/f2b [0,4194304] 0 2024-09-13T21:44:41.409 INFO:tasks.workunit.client.0.smithi119.stdout:0/392: dread de/d1c/d2f/f43 [0,4194304] 0 2024-09-13T21:44:41.409 INFO:tasks.workunit.client.0.smithi119.stdout:0/393: chown de/d1c/d64/f8a 4 1 2024-09-13T21:44:41.411 INFO:tasks.workunit.client.0.smithi119.stdout:4/335: creat d4/d1e/d26/f61 x:0 0 0 2024-09-13T21:44:41.416 INFO:tasks.workunit.client.0.smithi119.stdout:0/394: dwrite de/d1c/d2f/f6c [0,4194304] 0 2024-09-13T21:44:41.422 INFO:tasks.workunit.client.0.smithi119.stdout:0/395: dwrite de/f77 [0,4194304] 0 2024-09-13T21:44:41.427 INFO:tasks.workunit.client.0.smithi119.stdout:0/396: dread de/d1c/d52/f7a [0,4194304] 0 2024-09-13T21:44:41.429 INFO:tasks.workunit.client.0.smithi119.stdout:0/397: write de/d1c/f1d [622393,126254] 0 2024-09-13T21:44:41.430 INFO:tasks.workunit.client.0.smithi119.stdout:0/398: write de/d3c/f6d [3846182,118827] 0 2024-09-13T21:44:41.432 INFO:tasks.workunit.client.0.smithi119.stdout:0/399: creat de/d1c/d2f/d35/d90/f95 x:0 0 0 2024-09-13T21:44:41.482 INFO:tasks.workunit.client.0.smithi119.stdout:5/252: truncate d0/d3/d4/d9/d14/d24/d25/f58 382198 0 2024-09-13T21:44:41.482 INFO:tasks.workunit.client.0.smithi119.stdout:4/336: write d4/d1e/d28/d34/f4c [1390225,71546] 0 2024-09-13T21:44:41.485 INFO:tasks.workunit.client.0.smithi119.stdout:5/253: write d0/d3/f12 [1888961,100007] 0 2024-09-13T21:44:41.486 INFO:tasks.workunit.client.0.smithi119.stdout:6/300: dwrite dc/dd/f20 [0,4194304] 0 2024-09-13T21:44:41.489 INFO:tasks.workunit.client.0.smithi119.stdout:6/301: stat dc/c3f 0 2024-09-13T21:44:41.489 INFO:tasks.workunit.client.0.smithi119.stdout:5/254: creat d0/d3/d4/d9/d1e/f5c x:0 0 0 2024-09-13T21:44:41.490 INFO:tasks.workunit.client.0.smithi119.stdout:4/337: mknod d4/d1e/d28/d5d/c62 0 2024-09-13T21:44:41.492 INFO:tasks.workunit.client.0.smithi119.stdout:4/338: read d4/d1e/d26/d41/f45 [2514516,3705] 0 2024-09-13T21:44:41.494 INFO:tasks.workunit.client.0.smithi119.stdout:5/255: unlink d0/d3/d4/fa 0 2024-09-13T21:44:41.497 INFO:tasks.workunit.client.0.smithi119.stdout:6/302: mknod dc/c5b 0 2024-09-13T21:44:41.497 INFO:tasks.workunit.client.0.smithi119.stdout:5/256: dread d0/d3/d4/d9/d1e/f38 [0,4194304] 0 2024-09-13T21:44:41.499 INFO:tasks.workunit.client.0.smithi119.stdout:5/257: read d0/d3/f11 [475038,4429] 0 2024-09-13T21:44:41.500 INFO:tasks.workunit.client.0.smithi119.stdout:5/258: stat d0/d3/d4/d9/d14 0 2024-09-13T21:44:41.502 INFO:tasks.workunit.client.0.smithi119.stdout:5/259: chown d0/d3/d4/d9/d14/d24/f55 63518758 1 2024-09-13T21:44:41.502 INFO:tasks.workunit.client.0.smithi119.stdout:5/260: readlink d0/d3/l1b 0 2024-09-13T21:44:41.503 INFO:tasks.workunit.client.0.smithi119.stdout:6/303: mkdir dc/df/d5c 0 2024-09-13T21:44:41.503 INFO:tasks.workunit.client.0.smithi119.stdout:5/261: readlink d0/d3/d4/l3e 0 2024-09-13T21:44:41.504 INFO:tasks.workunit.client.0.smithi119.stdout:5/262: chown d0/fd 259736521 1 2024-09-13T21:44:41.505 INFO:tasks.workunit.client.0.smithi119.stdout:6/304: truncate dc/dd/f20 4511171 0 2024-09-13T21:44:41.505 INFO:tasks.workunit.client.0.smithi119.stdout:4/339: write d4/f52 [153764,105120] 0 2024-09-13T21:44:41.506 INFO:tasks.workunit.client.0.smithi119.stdout:5/263: creat d0/d3/d1f/f5d x:0 0 0 2024-09-13T21:44:41.507 INFO:tasks.workunit.client.0.smithi119.stdout:6/305: unlink dc/l2b 0 2024-09-13T21:44:41.507 INFO:tasks.workunit.client.0.smithi119.stdout:4/340: dread - d4/d1e/d26/d41/f49 zero size 2024-09-13T21:44:41.508 INFO:tasks.workunit.client.0.smithi119.stdout:4/341: readlink d4/d1e/lc 0 2024-09-13T21:44:41.510 INFO:tasks.workunit.client.0.smithi119.stdout:4/342: mknod d4/c63 0 2024-09-13T21:44:41.514 INFO:tasks.workunit.client.0.smithi119.stdout:5/264: dwrite d0/d3/d4/d9/f10 [0,4194304] 0 2024-09-13T21:44:41.514 INFO:tasks.workunit.client.0.smithi119.stdout:6/306: dread dc/df/f1c [0,4194304] 0 2024-09-13T21:44:41.515 INFO:tasks.workunit.client.0.smithi119.stdout:6/307: stat dc/dd/c28 0 2024-09-13T21:44:41.516 INFO:tasks.workunit.client.0.smithi119.stdout:5/265: write d0/d3/d4/d9/d1e/f5c [290779,33754] 0 2024-09-13T21:44:41.520 INFO:tasks.workunit.client.0.smithi119.stdout:4/343: creat d4/d1e/d26/d60/f64 x:0 0 0 2024-09-13T21:44:41.606 INFO:tasks.workunit.client.0.smithi119.stdout:5/266: creat d0/d3/d4/f5e x:0 0 0 2024-09-13T21:44:41.621 INFO:tasks.workunit.client.0.smithi119.stdout:4/344: creat d4/d1e/d26/d60/f65 x:0 0 0 2024-09-13T21:44:41.637 INFO:tasks.workunit.client.0.smithi119.stdout:5/267: stat d0/lb 0 2024-09-13T21:44:41.637 INFO:tasks.workunit.client.0.smithi119.stdout:5/268: fsync d0/d3/f12 0 2024-09-13T21:44:41.639 INFO:tasks.workunit.client.0.smithi119.stdout:4/345: mkdir d4/d1e/d28/d34/d66 0 2024-09-13T21:44:41.640 INFO:tasks.workunit.client.0.smithi119.stdout:4/346: chown d4/d1e/d26/d60/f65 227583 1 2024-09-13T21:44:41.647 INFO:tasks.workunit.client.0.smithi119.stdout:5/269: rmdir d0/d3/d4/d9/d14/d24/d25 39 2024-09-13T21:44:41.655 INFO:tasks.workunit.client.0.smithi119.stdout:4/347: creat d4/d1e/d28/d34/f67 x:0 0 0 2024-09-13T21:44:41.659 INFO:tasks.workunit.client.0.smithi119.stdout:4/348: creat d4/d1e/d26/d41/f68 x:0 0 0 2024-09-13T21:44:41.663 INFO:tasks.workunit.client.0.smithi119.stdout:4/349: mkdir d4/d1e/d26/d60/d69 0 2024-09-13T21:44:41.664 INFO:tasks.workunit.client.0.smithi119.stdout:5/270: creat d0/d3/d4/d9/d14/d24/d25/d54/f5f x:0 0 0 2024-09-13T21:44:41.665 INFO:tasks.workunit.client.0.smithi119.stdout:5/271: write d0/d3/d4/f5 [4783436,38497] 0 2024-09-13T21:44:41.667 INFO:tasks.workunit.client.0.smithi119.stdout:5/272: chown d0/d3/d4/d2e 99080746 1 2024-09-13T21:44:41.670 INFO:tasks.workunit.client.0.smithi119.stdout:4/350: dwrite d4/d1e/d28/f5a [0,4194304] 0 2024-09-13T21:44:41.672 INFO:tasks.workunit.client.0.smithi119.stdout:5/273: symlink d0/l60 0 2024-09-13T21:44:41.673 INFO:tasks.workunit.client.0.smithi119.stdout:5/274: stat d0/d3/d4/c6 0 2024-09-13T21:44:41.681 INFO:tasks.workunit.client.0.smithi119.stdout:4/351: dwrite d4/f2f [0,4194304] 0 2024-09-13T21:44:41.686 INFO:tasks.workunit.client.0.smithi119.stdout:4/352: chown d4/f38 123 1 2024-09-13T21:44:41.691 INFO:tasks.workunit.client.0.smithi119.stdout:4/353: fdatasync d4/f27 0 2024-09-13T21:44:41.693 INFO:tasks.workunit.client.0.smithi119.stdout:4/354: truncate d4/d1e/d26/d41/f49 437779 0 2024-09-13T21:44:41.694 INFO:tasks.workunit.client.0.smithi119.stdout:4/355: chown d4/d1e/d10/c58 41880 1 2024-09-13T21:44:41.697 INFO:tasks.workunit.client.0.smithi119.stdout:4/356: fsync d4/f27 0 2024-09-13T21:44:41.702 INFO:tasks.workunit.client.0.smithi119.stdout:4/357: mkdir d4/d1e/d28/d34/d6a 0 2024-09-13T21:44:41.705 INFO:tasks.workunit.client.0.smithi119.stdout:4/358: creat d4/d1e/f6b x:0 0 0 2024-09-13T21:44:41.706 INFO:tasks.workunit.client.0.smithi119.stdout:4/359: symlink d4/d1e/d28/l6c 0 2024-09-13T21:44:41.708 INFO:tasks.workunit.client.0.smithi119.stdout:4/360: mkdir d4/d1e/d26/d6d 0 2024-09-13T21:44:41.711 INFO:tasks.workunit.client.0.smithi119.stdout:4/361: creat d4/d1e/d26/d5e/f6e x:0 0 0 2024-09-13T21:44:41.711 INFO:tasks.workunit.client.0.smithi119.stdout:5/275: dread d0/fd [0,4194304] 0 2024-09-13T21:44:41.713 INFO:tasks.workunit.client.0.smithi119.stdout:4/362: symlink d4/d1e/d26/d41/l6f 0 2024-09-13T21:44:41.715 INFO:tasks.workunit.client.0.smithi119.stdout:5/276: fsync d0/d3/d4/d2e/f32 0 2024-09-13T21:44:41.716 INFO:tasks.workunit.client.0.smithi119.stdout:4/363: symlink d4/d1e/d28/d34/l70 0 2024-09-13T21:44:41.716 INFO:tasks.workunit.client.0.smithi119.stdout:5/277: chown d0/d3/d4/d9/d14/f17 1493019392 1 2024-09-13T21:44:41.718 INFO:tasks.workunit.client.0.smithi119.stdout:4/364: write d4/d1e/d26/d5e/f6e [103017,59568] 0 2024-09-13T21:44:41.718 INFO:tasks.workunit.client.0.smithi119.stdout:5/278: fdatasync d0/d3/d1f/d21/f51 0 2024-09-13T21:44:41.723 INFO:tasks.workunit.client.0.smithi119.stdout:5/279: link d0/d3/l1b d0/d3/d4/d2e/d4a/l61 0 2024-09-13T21:44:41.723 INFO:tasks.workunit.client.0.smithi119.stdout:4/365: dread d4/d1e/f36 [0,4194304] 0 2024-09-13T21:44:41.725 INFO:tasks.workunit.client.0.smithi119.stdout:5/280: rename d0/fd to d0/d3/d1f/d21/f62 0 2024-09-13T21:44:41.726 INFO:tasks.workunit.client.0.smithi119.stdout:4/366: mkdir d4/d1e/d26/d60/d71 0 2024-09-13T21:44:41.727 INFO:tasks.workunit.client.0.smithi119.stdout:5/281: rmdir d0/d3/d4 39 2024-09-13T21:44:41.728 INFO:tasks.workunit.client.0.smithi119.stdout:5/282: read d0/d3/fc [222018,84193] 0 2024-09-13T21:44:41.728 INFO:tasks.workunit.client.0.smithi119.stdout:4/367: creat d4/d1e/d26/d6d/f72 x:0 0 0 2024-09-13T21:44:41.731 INFO:tasks.workunit.client.0.smithi119.stdout:5/283: rename d0/d3/d1f/c56 to d0/d3/d1f/d21/c63 0 2024-09-13T21:44:41.734 INFO:tasks.workunit.client.0.smithi119.stdout:4/368: dwrite d4/f38 [0,4194304] 0 2024-09-13T21:44:41.735 INFO:tasks.workunit.client.0.smithi119.stdout:5/284: creat d0/d3/d4/d9/f64 x:0 0 0 2024-09-13T21:44:41.738 INFO:tasks.workunit.client.0.smithi119.stdout:5/285: rmdir d0/d3/d1f 39 2024-09-13T21:44:41.741 INFO:tasks.workunit.client.0.smithi119.stdout:4/369: dread d4/f21 [0,4194304] 0 2024-09-13T21:44:41.747 INFO:tasks.workunit.client.0.smithi119.stdout:4/370: rename d4/d1e/d28/f55 to d4/f73 0 2024-09-13T21:44:41.751 INFO:tasks.workunit.client.0.smithi119.stdout:4/371: dread d4/f2f [4194304,4194304] 0 2024-09-13T21:44:41.756 INFO:tasks.workunit.client.0.smithi119.stdout:4/372: fsync d4/f29 0 2024-09-13T21:44:41.756 INFO:tasks.workunit.client.0.smithi119.stdout:5/286: dwrite d0/d3/fc [0,4194304] 0 2024-09-13T21:44:41.757 INFO:tasks.workunit.client.0.smithi119.stdout:4/373: truncate d4/d1e/f33 1630314 0 2024-09-13T21:44:41.757 INFO:tasks.workunit.client.0.smithi119.stdout:4/374: write d4/d1e/d26/f2d [1015811,124525] 0 2024-09-13T21:44:41.759 INFO:tasks.workunit.client.0.smithi119.stdout:5/287: mkdir d0/d3/d4/d2e/d65 0 2024-09-13T21:44:41.761 INFO:tasks.workunit.client.0.smithi119.stdout:4/375: dread d4/d1e/d26/d41/f49 [0,4194304] 0 2024-09-13T21:44:41.762 INFO:tasks.workunit.client.0.smithi119.stdout:4/376: dread - d4/d1e/d26/d6d/f72 zero size 2024-09-13T21:44:41.762 INFO:tasks.workunit.client.0.smithi119.stdout:5/288: mknod d0/d3/d4/d2e/d4a/c66 0 2024-09-13T21:44:41.765 INFO:tasks.workunit.client.0.smithi119.stdout:4/377: truncate d4/d1e/d26/d5e/f6e 532085 0 2024-09-13T21:44:41.765 INFO:tasks.workunit.client.0.smithi119.stdout:5/289: mkdir d0/d3/d4/d9/d14/d24/d25/d67 0 2024-09-13T21:44:41.767 INFO:tasks.workunit.client.0.smithi119.stdout:4/378: dread d4/d1e/d26/d41/f49 [0,4194304] 0 2024-09-13T21:44:41.768 INFO:tasks.workunit.client.0.smithi119.stdout:4/379: chown d4/d1e/d26/d41/f49 6057424 1 2024-09-13T21:44:41.769 INFO:tasks.workunit.client.0.smithi119.stdout:5/290: link d0/d3/fc d0/d3/d4/d9/d14/f68 0 2024-09-13T21:44:41.770 INFO:tasks.workunit.client.0.smithi119.stdout:5/291: truncate d0/d3/d4/d9/f46 811574 0 2024-09-13T21:44:41.774 INFO:tasks.workunit.client.0.smithi119.stdout:5/292: creat d0/d3/d4/d9/d14/d24/d25/d67/f69 x:0 0 0 2024-09-13T21:44:41.775 INFO:tasks.workunit.client.0.smithi119.stdout:5/293: stat d0/d3/d4/d9/d14/d24/d25/d54 0 2024-09-13T21:44:41.777 INFO:tasks.workunit.client.0.smithi119.stdout:4/380: truncate d4/f73 3652117 0 2024-09-13T21:44:41.779 INFO:tasks.workunit.client.0.smithi119.stdout:4/381: read d4/d1e/d10/f46 [2710747,83903] 0 2024-09-13T21:44:41.780 INFO:tasks.workunit.client.0.smithi119.stdout:5/294: getdents d0/d3/d4/d9/d14/d24 0 2024-09-13T21:44:41.781 INFO:tasks.workunit.client.0.smithi119.stdout:5/295: fdatasync d0/d3/d4/d2e/f3d 0 2024-09-13T21:44:41.781 INFO:tasks.workunit.client.0.smithi119.stdout:4/382: unlink d4/c63 0 2024-09-13T21:44:41.783 INFO:tasks.workunit.client.0.smithi119.stdout:5/296: rmdir d0/d3/d4/d2e/d4a 39 2024-09-13T21:44:41.785 INFO:tasks.workunit.client.0.smithi119.stdout:4/383: symlink d4/d1e/d26/d5e/l74 0 2024-09-13T21:44:41.785 INFO:tasks.workunit.client.0.smithi119.stdout:5/297: fdatasync d0/d3/d4/d9/d1e/f38 0 2024-09-13T21:44:41.787 INFO:tasks.workunit.client.0.smithi119.stdout:4/384: creat d4/d1e/d26/f75 x:0 0 0 2024-09-13T21:44:41.792 INFO:tasks.workunit.client.0.smithi119.stdout:4/385: truncate d4/d1e/f17 533621 0 2024-09-13T21:44:41.793 INFO:tasks.workunit.client.0.smithi119.stdout:4/386: mkdir d4/d1e/d28/d34/d66/d76 0 2024-09-13T21:44:41.804 INFO:tasks.workunit.client.0.smithi119.stdout:4/387: dwrite d4/f2b [0,4194304] 0 2024-09-13T21:44:41.806 INFO:tasks.workunit.client.0.smithi119.stdout:4/388: write d4/f4b [784432,52691] 0 2024-09-13T21:44:41.807 INFO:tasks.workunit.client.0.smithi119.stdout:4/389: chown d4/d1e/d26/c5b 40 1 2024-09-13T21:44:41.810 INFO:tasks.workunit.client.0.smithi119.stdout:4/390: creat d4/d1e/d26/f77 x:0 0 0 2024-09-13T21:44:41.812 INFO:tasks.workunit.client.0.smithi119.stdout:4/391: creat d4/d1e/f78 x:0 0 0 2024-09-13T21:44:41.812 INFO:tasks.workunit.client.0.smithi119.stdout:4/392: readlink d4/d1e/d26/d41/l6f 0 2024-09-13T21:44:41.813 INFO:tasks.workunit.client.0.smithi119.stdout:4/393: chown d4/d1e/d28/d34/d66/d76 0 1 2024-09-13T21:44:41.813 INFO:tasks.workunit.client.0.smithi119.stdout:4/394: stat d4/d1e/d26/f77 0 2024-09-13T21:44:41.814 INFO:tasks.workunit.client.0.smithi119.stdout:4/395: chown d4/d1e/d26/d60/f65 48448 1 2024-09-13T21:44:41.815 INFO:tasks.workunit.client.0.smithi119.stdout:4/396: rmdir d4/d1e/d26/d60 39 2024-09-13T21:44:41.829 INFO:tasks.workunit.client.0.smithi119.stdout:4/397: dread d4/d1e/d10/f46 [0,4194304] 0 2024-09-13T21:44:41.830 INFO:tasks.workunit.client.0.smithi119.stdout:4/398: mkdir d4/d1e/d28/d34/d6a/d79 0 2024-09-13T21:44:41.832 INFO:tasks.workunit.client.0.smithi119.stdout:4/399: write d4/d1e/f33 [1288800,21476] 0 2024-09-13T21:44:41.833 INFO:tasks.workunit.client.0.smithi119.stdout:4/400: rmdir d4/d1e/d28/d5d 39 2024-09-13T21:44:41.834 INFO:tasks.workunit.client.0.smithi119.stdout:4/401: fdatasync d4/d1e/f50 0 2024-09-13T21:44:41.834 INFO:tasks.workunit.client.0.smithi119.stdout:4/402: chown d4/d1e/d28/l4f 544779 1 2024-09-13T21:44:41.837 INFO:tasks.workunit.client.0.smithi119.stdout:4/403: creat d4/d1e/d26/d60/d71/f7a x:0 0 0 2024-09-13T21:44:41.839 INFO:tasks.workunit.client.0.smithi119.stdout:4/404: rename d4/d1e/d26/d60/d71/f7a to d4/d1e/d28/d34/d66/f7b 0 2024-09-13T21:44:41.840 INFO:tasks.workunit.client.0.smithi119.stdout:4/405: fsync d4/d1e/f33 0 2024-09-13T21:44:41.840 INFO:tasks.workunit.client.0.smithi119.stdout:4/406: stat d4/d1e/d10/c39 0 2024-09-13T21:44:41.842 INFO:tasks.workunit.client.0.smithi119.stdout:4/407: truncate d4/d1e/d26/d41/f45 3486015 0 2024-09-13T21:44:41.842 INFO:tasks.workunit.client.0.smithi119.stdout:4/408: read - d4/d1e/f56 zero size 2024-09-13T21:44:41.844 INFO:tasks.workunit.client.0.smithi119.stdout:4/409: mkdir d4/d1e/d26/d6d/d7c 0 2024-09-13T21:44:41.845 INFO:tasks.workunit.client.0.smithi119.stdout:4/410: unlink d4/d1e/d28/c35 0 2024-09-13T21:44:41.845 INFO:tasks.workunit.client.0.smithi119.stdout:4/411: stat d4/d1e/d26/d41/f68 0 2024-09-13T21:44:41.847 INFO:tasks.workunit.client.0.smithi119.stdout:4/412: symlink d4/d1e/d28/d34/d66/d76/l7d 0 2024-09-13T21:44:41.849 INFO:tasks.workunit.client.0.smithi119.stdout:4/413: link d4/d1e/d26/d41/f49 d4/d1e/d28/d34/d66/d76/f7e 0 2024-09-13T21:44:41.850 INFO:tasks.workunit.client.0.smithi119.stdout:4/414: dread - d4/d1e/d28/d34/d66/f7b zero size 2024-09-13T21:44:41.862 INFO:tasks.workunit.client.0.smithi119.stdout:4/415: dwrite d4/d1e/d26/d41/f45 [0,4194304] 0 2024-09-13T21:44:41.868 INFO:tasks.workunit.client.0.smithi119.stdout:4/416: dwrite d4/d1e/d26/f32 [0,4194304] 0 2024-09-13T21:44:41.872 INFO:tasks.workunit.client.0.smithi119.stdout:4/417: creat d4/d1e/d28/d34/d6a/d79/f7f x:0 0 0 2024-09-13T21:44:41.874 INFO:tasks.workunit.client.0.smithi119.stdout:4/418: symlink d4/d1e/d28/d34/d66/d76/l80 0 2024-09-13T21:44:41.876 INFO:tasks.workunit.client.0.smithi119.stdout:4/419: creat d4/d1e/d26/d41/f81 x:0 0 0 2024-09-13T21:44:41.887 INFO:tasks.workunit.client.0.smithi119.stdout:4/420: fsync d4/d1e/d28/d34/d6a/d79/f7f 0 2024-09-13T21:44:41.892 INFO:tasks.workunit.client.0.smithi119.stdout:4/421: dread d4/f4b [0,4194304] 0 2024-09-13T21:44:41.895 INFO:tasks.workunit.client.0.smithi119.stdout:4/422: link d4/f2b d4/d1e/d28/d34/d66/d76/f82 0 2024-09-13T21:44:41.899 INFO:tasks.workunit.client.0.smithi119.stdout:4/423: rename d4/d1e/d26/d41 to d4/d1e/d26/d60/d71/d83 0 2024-09-13T21:44:41.901 INFO:tasks.workunit.client.0.smithi119.stdout:4/424: mknod d4/d1e/d28/c84 0 2024-09-13T21:44:41.904 INFO:tasks.workunit.client.0.smithi119.stdout:4/425: creat d4/d1e/d26/d6d/d7c/f85 x:0 0 0 2024-09-13T21:44:41.904 INFO:tasks.workunit.client.0.smithi119.stdout:4/426: fsync d4/d1e/d28/f5a 0 2024-09-13T21:44:41.911 INFO:tasks.workunit.client.0.smithi119.stdout:4/427: dwrite d4/d1e/d26/f61 [0,4194304] 0 2024-09-13T21:44:41.916 INFO:tasks.workunit.client.0.smithi119.stdout:4/428: creat d4/d1e/d26/f86 x:0 0 0 2024-09-13T21:44:41.919 INFO:tasks.workunit.client.0.smithi119.stdout:4/429: creat d4/d1e/d28/d34/d66/f87 x:0 0 0 2024-09-13T21:44:41.923 INFO:tasks.workunit.client.0.smithi119.stdout:4/430: link d4/d1e/d28/d34/d66/f87 d4/d1e/d26/d60/d71/f88 0 2024-09-13T21:44:41.925 INFO:tasks.workunit.client.0.smithi119.stdout:4/431: unlink d4/d1e/d28/d34/f67 0 2024-09-13T21:44:41.926 INFO:tasks.workunit.client.0.smithi119.stdout:4/432: dread - d4/d1e/d28/d34/d66/f7b zero size 2024-09-13T21:44:41.927 INFO:tasks.workunit.client.0.smithi119.stdout:4/433: dread - d4/d1e/d28/d34/d66/f7b zero size 2024-09-13T21:44:41.933 INFO:tasks.workunit.client.0.smithi119.stdout:4/434: dwrite d4/d1e/f33 [0,4194304] 0 2024-09-13T21:44:41.935 INFO:tasks.workunit.client.0.smithi119.stdout:4/435: truncate d4/d1e/d26/d5e/f6e 989070 0 2024-09-13T21:44:41.937 INFO:tasks.workunit.client.0.smithi119.stdout:4/436: truncate d4/d1e/d26/d60/f64 688810 0 2024-09-13T21:44:41.938 INFO:tasks.workunit.client.0.smithi119.stdout:4/437: stat d4/d1e/f50 0 2024-09-13T21:44:41.940 INFO:tasks.workunit.client.0.smithi119.stdout:4/438: chown d4/d1e/ca 56303398 1 2024-09-13T21:44:41.983 INFO:tasks.workunit.client.0.smithi119.stdout:7/282: sync 2024-09-13T21:44:41.989 INFO:tasks.workunit.client.0.smithi119.stdout:7/283: dwrite d8/d4d/f52 [0,4194304] 0 2024-09-13T21:44:41.990 INFO:tasks.workunit.client.0.smithi119.stdout:7/284: write d8/d19/d2e/d34/d42/f2d [305213,88921] 0 2024-09-13T21:44:41.991 INFO:tasks.workunit.client.0.smithi119.stdout:7/285: readlink d8/d19/d2e/d34/d42/l13 0 2024-09-13T21:44:41.996 INFO:tasks.workunit.client.0.smithi119.stdout:7/286: link d8/d19/d2e/d34/d42/cd d8/d4d/c55 0 2024-09-13T21:44:41.996 INFO:tasks.workunit.client.0.smithi119.stdout:7/287: chown f3 56 1 2024-09-13T21:44:41.997 INFO:tasks.workunit.client.0.smithi119.stdout:7/288: write d8/d3c/f51 [947780,89414] 0 2024-09-13T21:44:41.998 INFO:tasks.workunit.client.0.smithi119.stdout:7/289: read d8/f17 [6815835,70929] 0 2024-09-13T21:44:42.104 INFO:tasks.workunit.client.0.smithi119.stdout:3/337: sync 2024-09-13T21:44:42.152 INFO:tasks.workunit.client.0.smithi119.stdout:3/338: link d6/d15/d1a/c5c d6/d44/c70 0 2024-09-13T21:44:42.152 INFO:tasks.workunit.client.0.smithi119.stdout:3/339: read d6/d15/f30 [2720587,23504] 0 2024-09-13T21:44:42.152 INFO:tasks.workunit.client.0.smithi119.stdout:3/340: creat d6/d25/d2f/d33/f71 x:0 0 0 2024-09-13T21:44:42.152 INFO:tasks.workunit.client.0.smithi119.stdout:3/341: rmdir d6/d15 39 2024-09-13T21:44:42.152 INFO:tasks.workunit.client.0.smithi119.stdout:3/342: write d6/d25/d2f/d33/d56/f66 [725788,118442] 0 2024-09-13T21:44:42.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:41 smithi119 ceph-mon[27653]: pgmap v5: 65 pgs: 65 active+clean; 555 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-09-13T21:44:42.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:41 smithi119 ceph-mon[27653]: mgrmap e24: smithi155.wuuxfd(active, since 4s) 2024-09-13T21:44:42.154 INFO:tasks.workunit.client.0.smithi119.stdout:6/308: sync 2024-09-13T21:44:42.154 INFO:tasks.workunit.client.0.smithi119.stdout:8/406: sync 2024-09-13T21:44:42.154 INFO:tasks.workunit.client.0.smithi119.stdout:0/400: sync 2024-09-13T21:44:42.154 INFO:tasks.workunit.client.0.smithi119.stdout:9/359: sync 2024-09-13T21:44:42.154 INFO:tasks.workunit.client.0.smithi119.stdout:5/298: sync 2024-09-13T21:44:42.154 INFO:tasks.workunit.client.0.smithi119.stdout:2/393: sync 2024-09-13T21:44:42.154 INFO:tasks.workunit.client.0.smithi119.stdout:4/439: sync 2024-09-13T21:44:42.154 INFO:tasks.workunit.client.0.smithi119.stdout:1/348: sync 2024-09-13T21:44:42.155 INFO:tasks.workunit.client.0.smithi119.stdout:8/407: stat f9 0 2024-09-13T21:44:42.155 INFO:tasks.workunit.client.0.smithi119.stdout:9/360: stat d0/lc 0 2024-09-13T21:44:42.157 INFO:tasks.workunit.client.0.smithi119.stdout:1/349: fsync d1/d3/dc/d24/d2f/d31/f50 0 2024-09-13T21:44:42.159 INFO:tasks.workunit.client.0.smithi119.stdout:0/401: creat de/d4e/d7f/f96 x:0 0 0 2024-09-13T21:44:42.160 INFO:tasks.workunit.client.0.smithi119.stdout:4/440: symlink d4/d1e/d26/d6d/d7c/l89 0 2024-09-13T21:44:42.162 INFO:tasks.workunit.client.0.smithi119.stdout:9/361: mkdir d0/d79 0 2024-09-13T21:44:42.162 INFO:tasks.workunit.client.0.smithi119.stdout:4/441: stat d4/d1e/d26/d60/f64 0 2024-09-13T21:44:42.165 INFO:tasks.workunit.client.0.smithi119.stdout:8/408: creat d1b/d4e/f84 x:0 0 0 2024-09-13T21:44:42.168 INFO:tasks.workunit.client.0.smithi119.stdout:1/350: chown d1/d3/dc/d11/d28/l49 3896 1 2024-09-13T21:44:42.170 INFO:tasks.workunit.client.0.smithi119.stdout:4/442: rmdir d4/d1e/d26/d60 39 2024-09-13T21:44:42.172 INFO:tasks.workunit.client.0.smithi119.stdout:8/409: write d1b/f20 [1082050,88649] 0 2024-09-13T21:44:42.172 INFO:tasks.workunit.client.0.smithi119.stdout:6/309: dwrite dc/d3d/d4e/f53 [4194304,4194304] 0 2024-09-13T21:44:42.174 INFO:tasks.workunit.client.0.smithi119.stdout:3/343: dread d6/d15/d1a/d45/f5f [0,4194304] 0 2024-09-13T21:44:42.175 INFO:tasks.workunit.client.0.smithi119.stdout:5/299: dwrite d0/d3/d4/f5e [0,4194304] 0 2024-09-13T21:44:42.180 INFO:tasks.workunit.client.0.smithi119.stdout:2/394: dread d1/d2b/f34 [4194304,4194304] 0 2024-09-13T21:44:42.186 INFO:tasks.workunit.client.0.smithi119.stdout:3/344: mknod d6/d44/c72 0 2024-09-13T21:44:42.187 INFO:tasks.workunit.client.0.smithi119.stdout:8/410: symlink d1b/d1d/d5e/l85 0 2024-09-13T21:44:42.187 INFO:tasks.workunit.client.0.smithi119.stdout:0/402: dwrite de/d1c/d2f/d35/d50/d83/f88 [0,4194304] 0 2024-09-13T21:44:42.190 INFO:tasks.workunit.client.0.smithi119.stdout:5/300: write d0/d3/d4/d9/d14/d24/d25/f36 [2612,93646] 0 2024-09-13T21:44:42.190 INFO:tasks.workunit.client.0.smithi119.stdout:8/411: chown d1b/f36 325185 1 2024-09-13T21:44:42.191 INFO:tasks.workunit.client.0.smithi119.stdout:8/412: readlink d1b/d1d/d48/d58/l59 0 2024-09-13T21:44:42.191 INFO:tasks.workunit.client.0.smithi119.stdout:6/310: write dc/df/f1d [2656513,64754] 0 2024-09-13T21:44:42.192 INFO:tasks.workunit.client.0.smithi119.stdout:9/362: getdents d0/d8/d18/d23/d27/d2d/d5f/d74 0 2024-09-13T21:44:42.194 INFO:tasks.workunit.client.0.smithi119.stdout:0/403: chown l9 59502 1 2024-09-13T21:44:42.195 INFO:tasks.workunit.client.0.smithi119.stdout:1/351: mknod d1/d3/dc/d24/d2f/d31/d32/d33/c71 0 2024-09-13T21:44:42.199 INFO:tasks.workunit.client.0.smithi119.stdout:9/363: mknod d0/d8/d18/c7a 0 2024-09-13T21:44:42.207 INFO:tasks.workunit.client.0.smithi119.stdout:7/290: fdatasync d8/d4d/f52 0 2024-09-13T21:44:42.207 INFO:tasks.workunit.client.0.smithi119.stdout:2/395: truncate d1/d22/d55/f48 1387483 0 2024-09-13T21:44:42.210 INFO:tasks.workunit.client.0.smithi119.stdout:0/404: creat de/d1c/d2b/d76/f97 x:0 0 0 2024-09-13T21:44:42.213 INFO:tasks.workunit.client.0.smithi119.stdout:9/364: dwrite d0/d8/d18/d23/d27/d2d/f5d [0,4194304] 0 2024-09-13T21:44:42.214 INFO:tasks.workunit.client.0.smithi119.stdout:6/311: fsync dc/df/f24 0 2024-09-13T21:44:42.217 INFO:tasks.workunit.client.0.smithi119.stdout:2/396: rmdir d1/d22/d5a/d5d 39 2024-09-13T21:44:42.218 INFO:tasks.workunit.client.0.smithi119.stdout:3/345: creat d6/d15/d1a/d45/d47/d4d/f73 x:0 0 0 2024-09-13T21:44:42.223 INFO:tasks.workunit.client.0.smithi119.stdout:9/365: dwrite d0/d19/d1a/f1f [4194304,4194304] 0 2024-09-13T21:44:42.225 INFO:tasks.workunit.client.0.smithi119.stdout:9/366: truncate d0/d8/d18/d23/d27/f32 4865860 0 2024-09-13T21:44:42.226 INFO:tasks.workunit.client.0.smithi119.stdout:8/413: truncate fd 102155 0 2024-09-13T21:44:42.228 INFO:tasks.workunit.client.0.smithi119.stdout:7/291: write d8/f24 [327985,55540] 0 2024-09-13T21:44:42.231 INFO:tasks.workunit.client.0.smithi119.stdout:5/301: rename d0/d3/d4/d9/l40 to d0/d3/l6a 0 2024-09-13T21:44:42.231 INFO:tasks.workunit.client.0.smithi119.stdout:3/346: fsync d6/d15/d1a/d45/d47/d4d/f73 0 2024-09-13T21:44:42.234 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:41 smithi155 ceph-mon[34732]: pgmap v5: 65 pgs: 65 active+clean; 555 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-09-13T21:44:42.234 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:41 smithi155 ceph-mon[34732]: mgrmap e24: smithi155.wuuxfd(active, since 4s) 2024-09-13T21:44:42.236 INFO:tasks.workunit.client.0.smithi119.stdout:6/312: creat dc/df/d41/f5d x:0 0 0 2024-09-13T21:44:42.237 INFO:tasks.workunit.client.0.smithi119.stdout:2/397: mkdir d1/d7/d86 0 2024-09-13T21:44:42.242 INFO:tasks.workunit.client.0.smithi119.stdout:2/398: chown d1/d22/l6f 638406 1 2024-09-13T21:44:42.242 INFO:tasks.workunit.client.0.smithi119.stdout:3/347: dwrite d6/d15/f3f [0,4194304] 0 2024-09-13T21:44:42.242 INFO:tasks.workunit.client.0.smithi119.stdout:6/313: chown dc/dd/c28 213 1 2024-09-13T21:44:42.242 INFO:tasks.workunit.client.0.smithi119.stdout:1/352: getdents d1/d3/dc/d24 0 2024-09-13T21:44:42.242 INFO:tasks.workunit.client.0.smithi119.stdout:6/314: readlink dc/l2a 0 2024-09-13T21:44:42.245 INFO:tasks.workunit.client.0.smithi119.stdout:7/292: stat d8/d4d/c55 0 2024-09-13T21:44:42.247 INFO:tasks.workunit.client.0.smithi119.stdout:0/405: link de/d1c/l23 de/d1c/d2f/d35/l98 0 2024-09-13T21:44:42.247 INFO:tasks.workunit.client.0.smithi119.stdout:8/414: truncate d1b/d1d/d26/d3e/f5d 189412 0 2024-09-13T21:44:42.248 INFO:tasks.workunit.client.0.smithi119.stdout:6/315: mkdir dc/dd/d5e 0 2024-09-13T21:44:42.248 INFO:tasks.workunit.client.0.smithi119.stdout:7/293: chown d8/d3c/d53/f4e 135819 1 2024-09-13T21:44:42.249 INFO:tasks.workunit.client.0.smithi119.stdout:1/353: mkdir d1/d3/dc/d24/d2f/d31/d32/d33/d72 0 2024-09-13T21:44:42.249 INFO:tasks.workunit.client.0.smithi119.stdout:2/399: creat d1/d2b/d6b/f87 x:0 0 0 2024-09-13T21:44:42.250 INFO:tasks.workunit.client.0.smithi119.stdout:5/302: mkdir d0/d3/d4/d2e/d6b 0 2024-09-13T21:44:42.250 INFO:tasks.workunit.client.0.smithi119.stdout:0/406: write de/d1c/f1d [5366128,112541] 0 2024-09-13T21:44:42.253 INFO:tasks.workunit.client.0.smithi119.stdout:7/294: write d8/d19/d2e/d34/d42/f12 [1421097,48274] 0 2024-09-13T21:44:42.254 INFO:tasks.workunit.client.0.smithi119.stdout:0/407: chown de/d1c/d2b/f32 2185 1 2024-09-13T21:44:42.254 INFO:tasks.workunit.client.0.smithi119.stdout:1/354: dread d1/d3/f4 [0,4194304] 0 2024-09-13T21:44:42.254 INFO:tasks.workunit.client.0.smithi119.stdout:8/415: mknod d1b/d1d/d26/c86 0 2024-09-13T21:44:42.257 INFO:tasks.workunit.client.0.smithi119.stdout:3/348: fsync d6/d15/d1a/d45/d47/f64 0 2024-09-13T21:44:42.258 INFO:tasks.workunit.client.0.smithi119.stdout:9/367: link d0/c24 d0/d4f/d56/c7b 0 2024-09-13T21:44:42.260 INFO:tasks.workunit.client.0.smithi119.stdout:6/316: truncate dc/df/d32/f35 571168 0 2024-09-13T21:44:42.261 INFO:tasks.workunit.client.0.smithi119.stdout:5/303: rmdir d0/d3/d4/d9/d14/d24/d25/d54 39 2024-09-13T21:44:42.264 INFO:tasks.workunit.client.0.smithi119.stdout:7/295: dwrite d8/d19/d2e/f45 [0,4194304] 0 2024-09-13T21:44:42.268 INFO:tasks.workunit.client.0.smithi119.stdout:9/368: symlink d0/d8/d18/d23/d27/d2d/l7c 0 2024-09-13T21:44:42.272 INFO:tasks.workunit.client.0.smithi119.stdout:3/349: dwrite d6/f16 [0,4194304] 0 2024-09-13T21:44:42.274 INFO:tasks.workunit.client.0.smithi119.stdout:7/296: creat d8/f56 x:0 0 0 2024-09-13T21:44:42.278 INFO:tasks.workunit.client.0.smithi119.stdout:2/400: link d1/c19 d1/d38/c88 0 2024-09-13T21:44:42.279 INFO:tasks.workunit.client.0.smithi119.stdout:6/317: creat dc/df/d5c/f5f x:0 0 0 2024-09-13T21:44:42.280 INFO:tasks.workunit.client.0.smithi119.stdout:5/304: mknod d0/d3/d1f/c6c 0 2024-09-13T21:44:42.280 INFO:tasks.workunit.client.0.smithi119.stdout:6/318: write dc/dd/f38 [5112403,84941] 0 2024-09-13T21:44:42.281 INFO:tasks.workunit.client.0.smithi119.stdout:3/350: mkdir d6/d25/d74 0 2024-09-13T21:44:42.282 INFO:tasks.workunit.client.0.smithi119.stdout:9/369: creat d0/d8/d18/d23/d27/d2d/d6e/f7d x:0 0 0 2024-09-13T21:44:42.286 INFO:tasks.workunit.client.0.smithi119.stdout:9/370: dread d0/d19/d1a/d2b/f3e [0,4194304] 0 2024-09-13T21:44:42.290 INFO:tasks.workunit.client.0.smithi119.stdout:3/351: truncate d6/d15/d1a/f42 29666 0 2024-09-13T21:44:42.290 INFO:tasks.workunit.client.0.smithi119.stdout:6/319: link dc/d3d/d40/f49 dc/dd/d5e/f60 0 2024-09-13T21:44:42.293 INFO:tasks.workunit.client.0.smithi119.stdout:7/297: getdents d8/d19/d2e/d34 0 2024-09-13T21:44:42.294 INFO:tasks.workunit.client.0.smithi119.stdout:2/401: rmdir d1/d22/d5a/d5d/d85 0 2024-09-13T21:44:42.295 INFO:tasks.workunit.client.0.smithi119.stdout:3/352: symlink d6/d15/d1a/d45/d47/d4d/l75 0 2024-09-13T21:44:42.296 INFO:tasks.workunit.client.0.smithi119.stdout:9/371: creat d0/d79/f7e x:0 0 0 2024-09-13T21:44:42.297 INFO:tasks.workunit.client.0.smithi119.stdout:9/372: chown d0/d19/d1a/f40 0 1 2024-09-13T21:44:42.299 INFO:tasks.workunit.client.0.smithi119.stdout:7/298: mkdir d8/d3c/d53/d37/d57 0 2024-09-13T21:44:42.299 INFO:tasks.workunit.client.0.smithi119.stdout:9/373: dread d0/d19/d1a/d2b/f3e [0,4194304] 0 2024-09-13T21:44:42.302 INFO:tasks.workunit.client.0.smithi119.stdout:5/305: link d0/d3/d4/d9/d14/d24/l49 d0/d3/d4/d9/d14/d24/d25/d54/l6d 0 2024-09-13T21:44:42.309 INFO:tasks.workunit.client.0.smithi119.stdout:7/299: truncate d8/d4d/f52 349986 0 2024-09-13T21:44:42.310 INFO:tasks.workunit.client.0.smithi119.stdout:5/306: rename d0/d3/d4/d2e/f48 to d0/d3/d4/d9/d14/d24/f6e 0 2024-09-13T21:44:42.311 INFO:tasks.workunit.client.0.smithi119.stdout:6/320: getdents dc/d3d/d40 0 2024-09-13T21:44:42.313 INFO:tasks.workunit.client.0.smithi119.stdout:9/374: creat d0/d8/d18/d23/d27/d2d/d5f/d74/f7f x:0 0 0 2024-09-13T21:44:42.314 INFO:tasks.workunit.client.0.smithi119.stdout:3/353: truncate d6/f1c 2247756 0 2024-09-13T21:44:42.319 INFO:tasks.workunit.client.0.smithi119.stdout:7/300: creat d8/d19/d2e/d34/d42/d3d/f58 x:0 0 0 2024-09-13T21:44:42.321 INFO:tasks.workunit.client.0.smithi119.stdout:3/354: dread d6/f46 [4194304,4194304] 0 2024-09-13T21:44:42.324 INFO:tasks.workunit.client.0.smithi119.stdout:2/402: dwrite d1/f50 [0,4194304] 0 2024-09-13T21:44:42.329 INFO:tasks.workunit.client.0.smithi119.stdout:6/321: dwrite dc/dd/f2e [0,4194304] 0 2024-09-13T21:44:42.331 INFO:tasks.workunit.client.0.smithi119.stdout:7/301: rename d8/c1d to d8/d3c/c59 0 2024-09-13T21:44:42.336 INFO:tasks.workunit.client.0.smithi119.stdout:3/355: mknod d6/c76 0 2024-09-13T21:44:42.338 INFO:tasks.workunit.client.0.smithi119.stdout:7/302: creat d8/d3c/d46/f5a x:0 0 0 2024-09-13T21:44:42.338 INFO:tasks.workunit.client.0.smithi119.stdout:2/403: dwrite d1/f4a [0,4194304] 0 2024-09-13T21:44:42.341 INFO:tasks.workunit.client.0.smithi119.stdout:5/307: creat d0/d3/d4/d9/d14/d24/d25/f6f x:0 0 0 2024-09-13T21:44:42.343 INFO:tasks.workunit.client.0.smithi119.stdout:9/375: dread d0/d8/d18/d23/d42/d52/f5c [0,4194304] 0 2024-09-13T21:44:42.345 INFO:tasks.workunit.client.0.smithi119.stdout:2/404: unlink d1/d22/d55/f54 0 2024-09-13T21:44:42.349 INFO:tasks.workunit.client.0.smithi119.stdout:5/308: symlink d0/d3/d4/d9/d14/d24/d25/l70 0 2024-09-13T21:44:42.350 INFO:tasks.workunit.client.0.smithi119.stdout:3/356: dwrite d6/d15/d1a/f5b [0,4194304] 0 2024-09-13T21:44:42.352 INFO:tasks.workunit.client.0.smithi119.stdout:7/303: getdents d8/d3c/d53/d3b/d48 0 2024-09-13T21:44:42.354 INFO:tasks.workunit.client.0.smithi119.stdout:3/357: mknod d6/d15/d1a/d45/c77 0 2024-09-13T21:44:42.355 INFO:tasks.workunit.client.0.smithi119.stdout:3/358: chown d6/d25/d74 10766251 1 2024-09-13T21:44:42.356 INFO:tasks.workunit.client.0.smithi119.stdout:7/304: symlink d8/d4d/l5b 0 2024-09-13T21:44:42.358 INFO:tasks.workunit.client.0.smithi119.stdout:5/309: creat d0/d3/d4/d2e/f71 x:0 0 0 2024-09-13T21:44:42.360 INFO:tasks.workunit.client.0.smithi119.stdout:7/305: creat d8/d3c/d53/d37/d57/f5c x:0 0 0 2024-09-13T21:44:42.361 INFO:tasks.workunit.client.0.smithi119.stdout:5/310: fsync d0/d3/d4/d9/d14/d24/d25/d67/f69 0 2024-09-13T21:44:42.365 INFO:tasks.workunit.client.0.smithi119.stdout:3/359: getdents d6/d44/d52 0 2024-09-13T21:44:42.367 INFO:tasks.workunit.client.0.smithi119.stdout:7/306: creat d8/d19/d2e/d34/f5d x:0 0 0 2024-09-13T21:44:42.372 INFO:tasks.workunit.client.0.smithi119.stdout:3/360: symlink d6/d25/d2f/d33/d56/l78 0 2024-09-13T21:44:42.372 INFO:tasks.workunit.client.0.smithi119.stdout:5/311: truncate d0/d3/f12 1159495 0 2024-09-13T21:44:42.375 INFO:tasks.workunit.client.0.smithi119.stdout:9/376: dread d0/d8/f10 [4194304,4194304] 0 2024-09-13T21:44:42.377 INFO:tasks.workunit.client.0.smithi119.stdout:5/312: creat d0/d3/d4/d9/d1e/f72 x:0 0 0 2024-09-13T21:44:42.377 INFO:tasks.workunit.client.0.smithi119.stdout:9/377: read d0/d4f/f64 [3073948,23304] 0 2024-09-13T21:44:42.377 INFO:tasks.workunit.client.0.smithi119.stdout:7/307: link d8/d19/d2e/c4a d8/d3c/d53/d3b/c5e 0 2024-09-13T21:44:42.378 INFO:tasks.workunit.client.0.smithi119.stdout:9/378: chown d0/d8/d18/d23/d42/d52/d53 92 1 2024-09-13T21:44:42.378 INFO:tasks.workunit.client.0.smithi119.stdout:3/361: creat d6/d15/d1a/f79 x:0 0 0 2024-09-13T21:44:42.379 INFO:tasks.workunit.client.0.smithi119.stdout:7/308: mkdir d8/d3c/d53/d37/d57/d5f 0 2024-09-13T21:44:42.380 INFO:tasks.workunit.client.0.smithi119.stdout:7/309: fdatasync d8/d19/d2e/d34/f3a 0 2024-09-13T21:44:42.380 INFO:tasks.workunit.client.0.smithi119.stdout:7/310: stat d8 0 2024-09-13T21:44:42.381 INFO:tasks.workunit.client.0.smithi119.stdout:5/313: rename d0/d3/d1f/d21/f51 to d0/d3/d4/d2e/d65/f73 0 2024-09-13T21:44:42.382 INFO:tasks.workunit.client.0.smithi119.stdout:3/362: creat d6/d25/d2f/d33/d56/f7a x:0 0 0 2024-09-13T21:44:42.384 INFO:tasks.workunit.client.0.smithi119.stdout:7/311: readlink d8/l43 0 2024-09-13T21:44:42.387 INFO:tasks.workunit.client.0.smithi119.stdout:7/312: rename d8/d4d/c55 to d8/d19/c60 0 2024-09-13T21:44:42.388 INFO:tasks.workunit.client.0.smithi119.stdout:7/313: dread - d8/d3c/d53/f4e zero size 2024-09-13T21:44:42.395 INFO:tasks.workunit.client.0.smithi119.stdout:5/314: truncate d0/d3/fc 1257801 0 2024-09-13T21:44:42.397 INFO:tasks.workunit.client.0.smithi119.stdout:3/363: write d6/d15/d1a/f42 [681769,111028] 0 2024-09-13T21:44:42.399 INFO:tasks.workunit.client.0.smithi119.stdout:9/379: dread d0/d8/d18/d23/f29 [0,4194304] 0 2024-09-13T21:44:42.401 INFO:tasks.workunit.client.0.smithi119.stdout:5/315: getdents d0/d3/d4/d9 0 2024-09-13T21:44:42.403 INFO:tasks.workunit.client.0.smithi119.stdout:3/364: symlink d6/d15/l7b 0 2024-09-13T21:44:42.404 INFO:tasks.workunit.client.0.smithi119.stdout:5/316: mkdir d0/d3/d4/d9/d74 0 2024-09-13T21:44:42.406 INFO:tasks.workunit.client.0.smithi119.stdout:3/365: write d6/d15/d1a/d45/f67 [122627,98269] 0 2024-09-13T21:44:42.409 INFO:tasks.workunit.client.0.smithi119.stdout:3/366: stat d6/d44/f51 0 2024-09-13T21:44:42.410 INFO:tasks.workunit.client.0.smithi119.stdout:5/317: creat d0/d3/d4/d9/d14/d24/d25/d67/f75 x:0 0 0 2024-09-13T21:44:42.411 INFO:tasks.workunit.client.0.smithi119.stdout:9/380: dwrite d0/d19/d1a/f3b [0,4194304] 0 2024-09-13T21:44:42.413 INFO:tasks.workunit.client.0.smithi119.stdout:7/314: dread d8/d19/d2e/d34/d42/fa [0,4194304] 0 2024-09-13T21:44:42.417 INFO:tasks.workunit.client.0.smithi119.stdout:3/367: symlink d6/d25/d74/l7c 0 2024-09-13T21:44:42.417 INFO:tasks.workunit.client.0.smithi119.stdout:9/381: mkdir d0/d8/d18/d23/d27/d2d/d70/d80 0 2024-09-13T21:44:42.418 INFO:tasks.workunit.client.0.smithi119.stdout:7/315: write d8/d19/d2e/d34/d42/f12 [6503055,28713] 0 2024-09-13T21:44:42.419 INFO:tasks.workunit.client.0.smithi119.stdout:3/368: mknod d6/d44/d52/c7d 0 2024-09-13T21:44:42.421 INFO:tasks.workunit.client.0.smithi119.stdout:3/369: write d6/f16 [24814,123982] 0 2024-09-13T21:44:42.422 INFO:tasks.workunit.client.0.smithi119.stdout:5/318: dwrite d0/d3/d4/d9/f46 [0,4194304] 0 2024-09-13T21:44:42.423 INFO:tasks.workunit.client.0.smithi119.stdout:7/316: write d8/d3c/d53/d3b/f54 [809290,33354] 0 2024-09-13T21:44:42.425 INFO:tasks.workunit.client.0.smithi119.stdout:9/382: mkdir d0/d8/d18/d23/d27/d2d/d70/d80/d81 0 2024-09-13T21:44:42.426 INFO:tasks.workunit.client.0.smithi119.stdout:7/317: readlink d8/d3c/d53/d37/l41 0 2024-09-13T21:44:42.434 INFO:tasks.workunit.client.0.smithi119.stdout:7/318: truncate d8/d19/d2e/d34/d42/fe 5389753 0 2024-09-13T21:44:42.435 INFO:tasks.workunit.client.0.smithi119.stdout:5/319: link d0/d3/d4/d9/d14/d24/f55 d0/d3/d4/d2e/d65/f76 0 2024-09-13T21:44:42.436 INFO:tasks.workunit.client.0.smithi119.stdout:9/383: dread d0/d8/d18/d23/f51 [0,4194304] 0 2024-09-13T21:44:42.436 INFO:tasks.workunit.client.0.smithi119.stdout:3/370: dwrite d6/f6b [0,4194304] 0 2024-09-13T21:44:42.437 INFO:tasks.workunit.client.0.smithi119.stdout:7/319: write d8/d19/f25 [3297084,101723] 0 2024-09-13T21:44:42.439 INFO:tasks.workunit.client.0.smithi119.stdout:7/320: fdatasync d8/d3c/d53/f4e 0 2024-09-13T21:44:42.439 INFO:tasks.workunit.client.0.smithi119.stdout:3/371: stat d6/fc 0 2024-09-13T21:44:42.446 INFO:tasks.workunit.client.0.smithi119.stdout:3/372: truncate d6/fc 312894 0 2024-09-13T21:44:42.447 INFO:tasks.workunit.client.0.smithi119.stdout:7/321: symlink d8/d19/d2e/d34/d42/d47/l61 0 2024-09-13T21:44:42.448 INFO:tasks.workunit.client.0.smithi119.stdout:3/373: write d6/f11 [2670083,12125] 0 2024-09-13T21:44:42.448 INFO:tasks.workunit.client.0.smithi119.stdout:7/322: write d8/d19/d2e/f45 [4089216,12666] 0 2024-09-13T21:44:42.451 INFO:tasks.workunit.client.0.smithi119.stdout:7/323: write d8/d19/d2e/d34/f5d [637592,36194] 0 2024-09-13T21:44:42.451 INFO:tasks.workunit.client.0.smithi119.stdout:3/374: creat d6/d44/f7e x:0 0 0 2024-09-13T21:44:42.454 INFO:tasks.workunit.client.0.smithi119.stdout:9/384: dread d0/d19/f26 [0,4194304] 0 2024-09-13T21:44:42.455 INFO:tasks.workunit.client.0.smithi119.stdout:7/324: write d8/f31 [5272182,113926] 0 2024-09-13T21:44:42.461 INFO:tasks.workunit.client.0.smithi119.stdout:5/320: dwrite d0/d3/d4/d9/d14/f68 [0,4194304] 0 2024-09-13T21:44:42.463 INFO:tasks.workunit.client.0.smithi119.stdout:9/385: creat d0/f82 x:0 0 0 2024-09-13T21:44:42.463 INFO:tasks.workunit.client.0.smithi119.stdout:7/325: read d8/d19/d2e/d34/d42/fe [3485489,32101] 0 2024-09-13T21:44:42.464 INFO:tasks.workunit.client.0.smithi119.stdout:7/326: read - d8/d3c/d46/f5a zero size 2024-09-13T21:44:42.464 INFO:tasks.workunit.client.0.smithi119.stdout:9/386: write d0/d19/f59 [592299,77116] 0 2024-09-13T21:44:42.466 INFO:tasks.workunit.client.0.smithi119.stdout:9/387: write d0/d8/d18/d23/d42/d52/f65 [5110540,122135] 0 2024-09-13T21:44:42.466 INFO:tasks.workunit.client.0.smithi119.stdout:3/375: rename d6/d15/d1a/d45/d47/d4d/l75 to d6/l7f 0 2024-09-13T21:44:42.467 INFO:tasks.workunit.client.0.smithi119.stdout:5/321: chown d0/d3/f12 2593312 1 2024-09-13T21:44:42.469 INFO:tasks.workunit.client.0.smithi119.stdout:3/376: creat d6/d44/f80 x:0 0 0 2024-09-13T21:44:42.470 INFO:tasks.workunit.client.0.smithi119.stdout:5/322: fdatasync d0/d3/d4/d2e/d65/f73 0 2024-09-13T21:44:42.471 INFO:tasks.workunit.client.0.smithi119.stdout:3/377: stat d6/d25/d2f/f60 0 2024-09-13T21:44:42.474 INFO:tasks.workunit.client.0.smithi119.stdout:7/327: dwrite d8/f21 [0,4194304] 0 2024-09-13T21:44:42.477 INFO:tasks.workunit.client.0.smithi119.stdout:3/378: symlink d6/d15/l81 0 2024-09-13T21:44:42.480 INFO:tasks.workunit.client.0.smithi119.stdout:9/388: dwrite d0/d8/d18/d23/f69 [0,4194304] 0 2024-09-13T21:44:42.483 INFO:tasks.workunit.client.0.smithi119.stdout:9/389: read d0/d8/d18/d23/f69 [3971278,82572] 0 2024-09-13T21:44:42.484 INFO:tasks.workunit.client.0.smithi119.stdout:7/328: dread d8/d19/d2e/f45 [0,4194304] 0 2024-09-13T21:44:42.486 INFO:tasks.workunit.client.0.smithi119.stdout:9/390: chown d0/d19/d1a/d2b/f3e 4 1 2024-09-13T21:44:42.487 INFO:tasks.workunit.client.0.smithi119.stdout:9/391: chown d0/d8/d18/f5e 8 1 2024-09-13T21:44:42.488 INFO:tasks.workunit.client.0.smithi119.stdout:3/379: truncate d6/d15/f35 215775 0 2024-09-13T21:44:42.488 INFO:tasks.workunit.client.0.smithi119.stdout:7/329: creat d8/d3c/d53/d37/d57/f62 x:0 0 0 2024-09-13T21:44:42.493 INFO:tasks.workunit.client.0.smithi119.stdout:3/380: creat d6/d15/d1a/d45/d47/d4d/f82 x:0 0 0 2024-09-13T21:44:42.494 INFO:tasks.workunit.client.0.smithi119.stdout:3/381: creat d6/d25/f83 x:0 0 0 2024-09-13T21:44:42.495 INFO:tasks.workunit.client.0.smithi119.stdout:3/382: chown d6/d44/f7e 7 1 2024-09-13T21:44:42.497 INFO:tasks.workunit.client.0.smithi119.stdout:3/383: readlink d6/d15/d1a/d45/l4c 0 2024-09-13T21:44:42.500 INFO:tasks.workunit.client.0.smithi119.stdout:5/323: dwrite d0/d3/d4/d9/d14/d24/f55 [0,4194304] 0 2024-09-13T21:44:42.502 INFO:tasks.workunit.client.0.smithi119.stdout:5/324: read d0/d3/d4/d2e/f3d [139652,111568] 0 2024-09-13T21:44:42.503 INFO:tasks.workunit.client.0.smithi119.stdout:3/384: creat d6/d15/d1a/d45/d47/f84 x:0 0 0 2024-09-13T21:44:42.504 INFO:tasks.workunit.client.0.smithi119.stdout:9/392: fsync d0/d8/d18/d23/d27/f32 0 2024-09-13T21:44:42.505 INFO:tasks.workunit.client.0.smithi119.stdout:3/385: dread - d6/d44/d52/f68 zero size 2024-09-13T21:44:42.507 INFO:tasks.workunit.client.0.smithi119.stdout:9/393: fdatasync d0/d8/d18/d23/d42/d52/f65 0 2024-09-13T21:44:42.507 INFO:tasks.workunit.client.0.smithi119.stdout:3/386: rmdir d6/d25/d74 39 2024-09-13T21:44:42.509 INFO:tasks.workunit.client.0.smithi119.stdout:3/387: read - d6/d25/f83 zero size 2024-09-13T21:44:42.509 INFO:tasks.workunit.client.0.smithi119.stdout:9/394: readlink d0/d19/d1a/d2b/d60/l54 0 2024-09-13T21:44:42.512 INFO:tasks.workunit.client.0.smithi119.stdout:3/388: write d6/d25/d2f/d33/d56/f66 [1160206,51156] 0 2024-09-13T21:44:42.512 INFO:tasks.workunit.client.0.smithi119.stdout:5/325: symlink d0/d3/d4/d9/d14/d24/d25/l77 0 2024-09-13T21:44:42.515 INFO:tasks.workunit.client.0.smithi119.stdout:7/330: dread d8/d19/f1c [0,4194304] 0 2024-09-13T21:44:42.515 INFO:tasks.workunit.client.0.smithi119.stdout:5/326: write d0/d3/f50 [342379,79424] 0 2024-09-13T21:44:42.516 INFO:tasks.workunit.client.0.smithi119.stdout:3/389: write d6/d44/f6f [615646,19675] 0 2024-09-13T21:44:42.519 INFO:tasks.workunit.client.0.smithi119.stdout:7/331: read - d8/d19/d2e/d34/d42/d3d/f58 zero size 2024-09-13T21:44:42.522 INFO:tasks.workunit.client.0.smithi119.stdout:9/395: dwrite d0/d19/f26 [0,4194304] 0 2024-09-13T21:44:42.524 INFO:tasks.workunit.client.0.smithi119.stdout:5/327: truncate d0/d3/d4/d9/d14/d24/d25/d67/f69 550660 0 2024-09-13T21:44:42.526 INFO:tasks.workunit.client.0.smithi119.stdout:5/328: write d0/d3/d4/d9/d14/f68 [4561173,15806] 0 2024-09-13T21:44:42.527 INFO:tasks.workunit.client.0.smithi119.stdout:9/396: symlink d0/d8/d18/d23/d27/d2d/d70/l83 0 2024-09-13T21:44:42.527 INFO:tasks.workunit.client.0.smithi119.stdout:7/332: link c1 d8/d19/d2e/c63 0 2024-09-13T21:44:42.531 INFO:tasks.workunit.client.0.smithi119.stdout:4/443: sync 2024-09-13T21:44:42.563 INFO:tasks.workunit.client.0.smithi119.stdout:9/397: mknod d0/d4f/c84 0 2024-09-13T21:44:42.565 INFO:tasks.workunit.client.0.smithi119.stdout:7/333: unlink d8/d19/d2e/d34/d42/d3d/f58 0 2024-09-13T21:44:42.567 INFO:tasks.workunit.client.0.smithi119.stdout:4/444: mknod d4/d1e/d28/d34/d66/c8a 0 2024-09-13T21:44:42.568 INFO:tasks.workunit.client.0.smithi119.stdout:5/329: creat d0/d3/d4/f78 x:0 0 0 2024-09-13T21:44:42.569 INFO:tasks.workunit.client.0.smithi119.stdout:7/334: creat d8/d4d/f64 x:0 0 0 2024-09-13T21:44:42.570 INFO:tasks.workunit.client.0.smithi119.stdout:9/398: dwrite d0/d8/d18/d23/d27/d2d/d6e/f7d [0,4194304] 0 2024-09-13T21:44:42.572 INFO:tasks.workunit.client.0.smithi119.stdout:5/330: truncate d0/d3/d4/f5e 5080741 0 2024-09-13T21:44:42.573 INFO:tasks.workunit.client.0.smithi119.stdout:7/335: fsync d8/d4d/f52 0 2024-09-13T21:44:42.576 INFO:tasks.workunit.client.0.smithi119.stdout:9/399: mknod d0/d8/d18/d23/d27/d2d/c85 0 2024-09-13T21:44:42.576 INFO:tasks.workunit.client.0.smithi119.stdout:7/336: read f6 [6489611,107257] 0 2024-09-13T21:44:42.579 INFO:tasks.workunit.client.0.smithi119.stdout:9/400: read d0/d8/d18/f5e [242657,117540] 0 2024-09-13T21:44:42.581 INFO:tasks.workunit.client.0.smithi119.stdout:4/445: truncate d4/d1e/d28/d34/d66/d76/f7e 755884 0 2024-09-13T21:44:42.582 INFO:tasks.workunit.client.0.smithi119.stdout:5/331: dwrite d0/d3/d1f/d21/f34 [8388608,4194304] 0 2024-09-13T21:44:42.582 INFO:tasks.workunit.client.0.smithi119.stdout:7/337: fsync d8/d4d/f52 0 2024-09-13T21:44:42.590 INFO:tasks.workunit.client.0.smithi119.stdout:5/332: symlink d0/d3/d4/d2e/d6b/l79 0 2024-09-13T21:44:42.591 INFO:tasks.workunit.client.0.smithi119.stdout:4/446: dwrite d4/d1e/d26/f77 [0,4194304] 0 2024-09-13T21:44:42.593 INFO:tasks.workunit.client.0.smithi119.stdout:4/447: fdatasync d4/d1e/f33 0 2024-09-13T21:44:42.596 INFO:tasks.workunit.client.0.smithi119.stdout:5/333: mknod d0/d3/d1f/d21/c7a 0 2024-09-13T21:44:42.596 INFO:tasks.workunit.client.0.smithi119.stdout:9/401: dread d0/d19/f59 [0,4194304] 0 2024-09-13T21:44:42.602 INFO:tasks.workunit.client.0.smithi119.stdout:9/402: creat d0/d8/d18/d23/d27/d2d/f86 x:0 0 0 2024-09-13T21:44:42.603 INFO:tasks.workunit.client.0.smithi119.stdout:9/403: chown d0/d4f/c84 2842819 1 2024-09-13T21:44:42.604 INFO:tasks.workunit.client.0.smithi119.stdout:4/448: rename d4/d1e/d26/d60/d71/d83/c47 to d4/d1e/d26/d60/d71/c8b 0 2024-09-13T21:44:42.606 INFO:tasks.workunit.client.0.smithi119.stdout:9/404: rmdir d0/d8/d18/d23/d27/d2d/d6e 39 2024-09-13T21:44:42.608 INFO:tasks.workunit.client.0.smithi119.stdout:4/449: rmdir d4/d1e/d26/d6d/d7c 39 2024-09-13T21:44:42.611 INFO:tasks.workunit.client.0.smithi119.stdout:9/405: link d0/d19/d1a/d2b/f3e d0/d4f/d56/f87 0 2024-09-13T21:44:42.612 INFO:tasks.workunit.client.0.smithi119.stdout:4/450: getdents d4/d1e/d26/d6d 0 2024-09-13T21:44:42.613 INFO:tasks.workunit.client.0.smithi119.stdout:9/406: unlink d0/d19/d1a/f40 0 2024-09-13T21:44:42.620 INFO:tasks.workunit.client.0.smithi119.stdout:7/338: dread d8/d19/f25 [0,4194304] 0 2024-09-13T21:44:42.621 INFO:tasks.workunit.client.0.smithi119.stdout:7/339: chown d8/d19/d2e 287946436 1 2024-09-13T21:44:42.621 INFO:tasks.workunit.client.0.smithi119.stdout:7/340: fsync d8/d3c/d53/d3b/d48/f49 0 2024-09-13T21:44:42.622 INFO:tasks.workunit.client.0.smithi119.stdout:7/341: stat d8/d19/d2e/d34/d42/d3d 0 2024-09-13T21:44:42.640 INFO:tasks.workunit.client.0.smithi119.stdout:9/407: stat d0/c50 0 2024-09-13T21:44:42.641 INFO:tasks.workunit.client.0.smithi119.stdout:9/408: stat d0/d8/d18/d23/d27/f32 0 2024-09-13T21:44:42.643 INFO:tasks.workunit.client.0.smithi119.stdout:7/342: creat d8/d19/d2e/d34/d42/d47/f65 x:0 0 0 2024-09-13T21:44:42.644 INFO:tasks.workunit.client.0.smithi119.stdout:4/451: write d4/f40 [969905,94300] 0 2024-09-13T21:44:42.646 INFO:tasks.workunit.client.0.smithi119.stdout:7/343: dread d8/d4d/f52 [0,4194304] 0 2024-09-13T21:44:42.653 INFO:tasks.workunit.client.0.smithi119.stdout:7/344: creat d8/d3c/d53/d37/d57/d5f/f66 x:0 0 0 2024-09-13T21:44:42.653 INFO:tasks.workunit.client.0.smithi119.stdout:4/452: link d4/d1e/d10/c1c d4/d1e/d26/d6d/d7c/c8c 0 2024-09-13T21:44:42.655 INFO:tasks.workunit.client.0.smithi119.stdout:7/345: write f6 [3074260,76192] 0 2024-09-13T21:44:42.657 INFO:tasks.workunit.client.0.smithi119.stdout:7/346: write d8/f56 [295003,63132] 0 2024-09-13T21:44:42.657 INFO:tasks.workunit.client.0.smithi119.stdout:4/453: creat d4/d1e/d28/f8d x:0 0 0 2024-09-13T21:44:42.659 INFO:tasks.workunit.client.0.smithi119.stdout:7/347: truncate d8/d19/d2e/d34/d42/d47/f65 44758 0 2024-09-13T21:44:42.662 INFO:tasks.workunit.client.0.smithi119.stdout:4/454: rename d4/d1e/d10/f3f to d4/d1e/d26/d60/d71/f8e 0 2024-09-13T21:44:42.662 INFO:tasks.workunit.client.0.smithi119.stdout:9/409: dread d0/d19/d1a/f4d [0,4194304] 0 2024-09-13T21:44:42.665 INFO:tasks.workunit.client.0.smithi119.stdout:4/455: mkdir d4/d1e/d28/d34/d66/d76/d8f 0 2024-09-13T21:44:42.666 INFO:tasks.workunit.client.0.smithi119.stdout:9/410: creat d0/d8/d18/d23/d27/d2d/d5f/f88 x:0 0 0 2024-09-13T21:44:42.666 INFO:tasks.workunit.client.0.smithi119.stdout:7/348: dwrite d8/d3c/d46/f5a [0,4194304] 0 2024-09-13T21:44:42.668 INFO:tasks.workunit.client.0.smithi119.stdout:7/349: chown d8/d19/d2e/d34/f3a 2 1 2024-09-13T21:44:42.669 INFO:tasks.workunit.client.0.smithi119.stdout:7/350: chown d8/d3c/d53/d37/d57/d5f 16026683 1 2024-09-13T21:44:42.669 INFO:tasks.workunit.client.0.smithi119.stdout:7/351: chown d8/l43 620348977 1 2024-09-13T21:44:42.669 INFO:tasks.workunit.client.0.smithi119.stdout:4/456: unlink d4/d1e/d28/f5a 0 2024-09-13T21:44:42.672 INFO:tasks.workunit.client.0.smithi119.stdout:9/411: creat d0/d19/f89 x:0 0 0 2024-09-13T21:44:42.677 INFO:tasks.workunit.client.0.smithi119.stdout:7/352: write d8/d19/d2e/d34/d42/fa [4284450,22644] 0 2024-09-13T21:44:42.678 INFO:tasks.workunit.client.0.smithi119.stdout:9/412: truncate d0/d19/f46 3804779 0 2024-09-13T21:44:42.679 INFO:tasks.workunit.client.0.smithi119.stdout:9/413: stat d0/d8/d18/d23/d27/d2d/c85 0 2024-09-13T21:44:42.679 INFO:tasks.workunit.client.0.smithi119.stdout:4/457: truncate d4/d1e/f17 101274 0 2024-09-13T21:44:42.681 INFO:tasks.workunit.client.0.smithi119.stdout:7/353: creat d8/d3c/d53/d37/d57/d5f/f67 x:0 0 0 2024-09-13T21:44:42.683 INFO:tasks.workunit.client.0.smithi119.stdout:9/414: mknod d0/d8/d18/d23/d27/d2d/d70/d80/c8a 0 2024-09-13T21:44:42.684 INFO:tasks.workunit.client.0.smithi119.stdout:7/354: read - d8/d3c/d53/f4e zero size 2024-09-13T21:44:42.685 INFO:tasks.workunit.client.0.smithi119.stdout:9/415: rmdir d0/d8 39 2024-09-13T21:44:42.685 INFO:tasks.workunit.client.0.smithi119.stdout:7/355: fdatasync d8/d3c/d53/f28 0 2024-09-13T21:44:42.688 INFO:tasks.workunit.client.0.smithi119.stdout:4/458: dwrite d4/d1e/d26/f75 [0,4194304] 0 2024-09-13T21:44:42.689 INFO:tasks.workunit.client.0.smithi119.stdout:9/416: truncate d0/d19/f26 4260572 0 2024-09-13T21:44:42.696 INFO:tasks.workunit.client.0.smithi119.stdout:4/459: rename d4/d1e/d26/d6d/d7c/l89 to d4/d1e/d26/d60/d71/d83/l90 0 2024-09-13T21:44:42.701 INFO:tasks.workunit.client.0.smithi119.stdout:7/356: link d8/d3c/d53/d37/c4c d8/d19/d2e/d34/c68 0 2024-09-13T21:44:42.704 INFO:tasks.workunit.client.0.smithi119.stdout:7/357: symlink d8/d4d/l69 0 2024-09-13T21:44:42.706 INFO:tasks.workunit.client.0.smithi119.stdout:7/358: symlink d8/d3c/d53/d37/d57/d5f/l6a 0 2024-09-13T21:44:42.708 INFO:tasks.workunit.client.0.smithi119.stdout:7/359: mkdir d8/d3c/d53/d6b 0 2024-09-13T21:44:42.711 INFO:tasks.workunit.client.0.smithi119.stdout:7/360: creat d8/d3c/d53/d37/d57/f6c x:0 0 0 2024-09-13T21:44:42.713 INFO:tasks.workunit.client.0.smithi119.stdout:9/417: dwrite d0/d8/d18/d23/d42/d52/f65 [4194304,4194304] 0 2024-09-13T21:44:42.714 INFO:tasks.workunit.client.0.smithi119.stdout:7/361: mknod d8/d3c/d53/d6b/c6d 0 2024-09-13T21:44:42.716 INFO:tasks.workunit.client.0.smithi119.stdout:7/362: mkdir d8/d19/d2e/d34/d6e 0 2024-09-13T21:44:42.718 INFO:tasks.workunit.client.0.smithi119.stdout:9/418: creat d0/d8/d18/d23/d42/d52/f8b x:0 0 0 2024-09-13T21:44:42.719 INFO:tasks.workunit.client.0.smithi119.stdout:7/363: creat d8/d3c/d53/d37/f6f x:0 0 0 2024-09-13T21:44:42.720 INFO:tasks.workunit.client.0.smithi119.stdout:9/419: dread - d0/d8/d18/d23/d27/d2d/d5f/d74/f7f zero size 2024-09-13T21:44:42.723 INFO:tasks.workunit.client.0.smithi119.stdout:9/420: symlink d0/d8/d18/d23/d27/d2d/d5f/d74/l8c 0 2024-09-13T21:44:42.724 INFO:tasks.workunit.client.0.smithi119.stdout:9/421: fsync d0/d8/f4b 0 2024-09-13T21:44:42.725 INFO:tasks.workunit.client.0.smithi119.stdout:0/408: sync 2024-09-13T21:44:42.728 INFO:tasks.workunit.client.0.smithi119.stdout:0/409: creat de/d1c/d2f/d40/f99 x:0 0 0 2024-09-13T21:44:42.731 INFO:tasks.workunit.client.0.smithi119.stdout:0/410: mkdir de/d1c/d2b/d76/d9a 0 2024-09-13T21:44:42.732 INFO:tasks.workunit.client.0.smithi119.stdout:9/422: dwrite d0/f2c [0,4194304] 0 2024-09-13T21:44:42.733 INFO:tasks.workunit.client.0.smithi119.stdout:0/411: write de/d1c/d64/f73 [631760,104643] 0 2024-09-13T21:44:42.735 INFO:tasks.workunit.client.0.smithi119.stdout:9/423: mknod d0/d19/c8d 0 2024-09-13T21:44:42.735 INFO:tasks.workunit.client.0.smithi119.stdout:0/412: fsync de/d1c/d2b/d34/f5b 0 2024-09-13T21:44:42.738 INFO:tasks.workunit.client.0.smithi119.stdout:0/413: write de/d1c/d2f/d40/f81 [321683,95868] 0 2024-09-13T21:44:42.738 INFO:tasks.workunit.client.0.smithi119.stdout:7/364: dread f6 [4194304,4194304] 0 2024-09-13T21:44:42.741 INFO:tasks.workunit.client.0.smithi119.stdout:0/414: write de/f61 [4003933,98824] 0 2024-09-13T21:44:42.743 INFO:tasks.workunit.client.0.smithi119.stdout:7/365: symlink d8/d3c/d53/d3b/l70 0 2024-09-13T21:44:42.745 INFO:tasks.workunit.client.0.smithi119.stdout:7/366: chown d8/d19/d2e/d34/d42/l13 467 1 2024-09-13T21:44:42.745 INFO:tasks.workunit.client.0.smithi119.stdout:9/424: dwrite d0/d79/f7e [0,4194304] 0 2024-09-13T21:44:42.745 INFO:tasks.workunit.client.0.smithi119.stdout:0/415: mkdir de/d1c/d2b/d76/d9b 0 2024-09-13T21:44:42.749 INFO:tasks.workunit.client.0.smithi119.stdout:0/416: mkdir de/d1c/d9c 0 2024-09-13T21:44:42.751 INFO:tasks.workunit.client.0.smithi119.stdout:7/367: rename d8/d19/d2e/d34/d42/fe to d8/d19/d2e/f71 0 2024-09-13T21:44:42.752 INFO:tasks.workunit.client.0.smithi119.stdout:9/425: symlink d0/d8/d18/d23/d27/d2d/d6e/l8e 0 2024-09-13T21:44:42.753 INFO:tasks.workunit.client.0.smithi119.stdout:0/417: symlink de/d1c/d2b/d76/l9d 0 2024-09-13T21:44:42.754 INFO:tasks.workunit.client.0.smithi119.stdout:7/368: creat d8/d3c/d53/d6b/f72 x:0 0 0 2024-09-13T21:44:42.756 INFO:tasks.workunit.client.0.smithi119.stdout:0/418: truncate de/d1c/d64/f73 937382 0 2024-09-13T21:44:42.757 INFO:tasks.workunit.client.0.smithi119.stdout:9/426: dread d0/d19/d1a/f1f [4194304,4194304] 0 2024-09-13T21:44:42.759 INFO:tasks.workunit.client.0.smithi119.stdout:7/369: mkdir d8/d19/d2e/d34/d42/d73 0 2024-09-13T21:44:42.760 INFO:tasks.workunit.client.0.smithi119.stdout:7/370: truncate d8/f20 1305851 0 2024-09-13T21:44:42.760 INFO:tasks.workunit.client.0.smithi119.stdout:0/419: symlink de/d49/l9e 0 2024-09-13T21:44:42.762 INFO:tasks.workunit.client.0.smithi119.stdout:7/371: read d8/f56 [141988,40631] 0 2024-09-13T21:44:42.765 INFO:tasks.workunit.client.0.smithi119.stdout:0/420: symlink de/d1c/d2f/l9f 0 2024-09-13T21:44:42.766 INFO:tasks.workunit.client.0.smithi119.stdout:0/421: read de/f3e [147918,13977] 0 2024-09-13T21:44:42.770 INFO:tasks.workunit.client.0.smithi119.stdout:9/427: getdents d0/d8/d18/d23/d27/d2d 0 2024-09-13T21:44:42.773 INFO:tasks.workunit.client.0.smithi119.stdout:7/372: rmdir d8/d19/d2e/d34/d42/d73 0 2024-09-13T21:44:42.775 INFO:tasks.workunit.client.0.smithi119.stdout:9/428: creat d0/d8/d18/d23/d27/d2d/d6e/f8f x:0 0 0 2024-09-13T21:44:42.780 INFO:tasks.workunit.client.0.smithi119.stdout:7/373: rmdir d8/d3c/d53/d37 39 2024-09-13T21:44:42.783 INFO:tasks.workunit.client.0.smithi119.stdout:0/422: getdents de/d49 0 2024-09-13T21:44:42.786 INFO:tasks.workunit.client.0.smithi119.stdout:0/423: write de/f5e [467661,110830] 0 2024-09-13T21:44:42.788 INFO:tasks.workunit.client.0.smithi119.stdout:7/374: dwrite d8/d19/d2e/d34/d42/d47/f65 [0,4194304] 0 2024-09-13T21:44:42.789 INFO:tasks.workunit.client.0.smithi119.stdout:9/429: dwrite d0/f14 [0,4194304] 0 2024-09-13T21:44:42.794 INFO:tasks.workunit.client.0.smithi119.stdout:0/424: write de/d1c/d2f/d35/f67 [240836,5677] 0 2024-09-13T21:44:42.794 INFO:tasks.workunit.client.0.smithi119.stdout:9/430: creat d0/d8/d18/f90 x:0 0 0 2024-09-13T21:44:42.795 INFO:tasks.workunit.client.0.smithi119.stdout:7/375: rename d8/l2a to d8/d3c/d46/l74 0 2024-09-13T21:44:42.799 INFO:tasks.workunit.client.0.smithi119.stdout:7/376: truncate d8/d3c/d53/d3b/d48/f49 400571 0 2024-09-13T21:44:42.799 INFO:tasks.workunit.client.0.smithi119.stdout:9/431: dread d0/d19/d1a/d2b/f3e [0,4194304] 0 2024-09-13T21:44:42.800 INFO:tasks.workunit.client.0.smithi119.stdout:0/425: getdents de/d1c/d2b/d34 0 2024-09-13T21:44:42.801 INFO:tasks.workunit.client.0.smithi119.stdout:9/432: chown d0/d8/f4b 1026398 1 2024-09-13T21:44:42.802 INFO:tasks.workunit.client.0.smithi119.stdout:9/433: fdatasync d0/d19/f26 0 2024-09-13T21:44:42.802 INFO:tasks.workunit.client.0.smithi119.stdout:7/377: write d8/d3c/d53/d37/d57/f62 [7162,39580] 0 2024-09-13T21:44:42.805 INFO:tasks.workunit.client.0.smithi119.stdout:7/378: write d8/d3c/d53/d37/d57/f62 [901746,84255] 0 2024-09-13T21:44:42.806 INFO:tasks.workunit.client.0.smithi119.stdout:9/434: creat d0/d19/d1a/d2b/f91 x:0 0 0 2024-09-13T21:44:42.808 INFO:tasks.workunit.client.0.smithi119.stdout:7/379: write d8/d3c/d53/d37/f6f [606345,108660] 0 2024-09-13T21:44:42.811 INFO:tasks.workunit.client.0.smithi119.stdout:9/435: mkdir d0/d19/d1a/d92 0 2024-09-13T21:44:42.812 INFO:tasks.workunit.client.0.smithi119.stdout:7/380: write d8/d19/d2e/d34/d42/d47/f65 [348072,108435] 0 2024-09-13T21:44:42.813 INFO:tasks.workunit.client.0.smithi119.stdout:7/381: chown d8/d3c/d53/f28 19366924 1 2024-09-13T21:44:42.815 INFO:tasks.workunit.client.0.smithi119.stdout:9/436: creat d0/d8/d18/d23/d27/d2d/d5f/d74/f93 x:0 0 0 2024-09-13T21:44:42.817 INFO:tasks.workunit.client.0.smithi119.stdout:9/437: fdatasync d0/d19/d1a/f4d 0 2024-09-13T21:44:42.822 INFO:tasks.workunit.client.0.smithi119.stdout:7/382: dwrite d8/d3c/d53/f28 [0,4194304] 0 2024-09-13T21:44:42.824 INFO:tasks.workunit.client.0.smithi119.stdout:7/383: mknod d8/d3c/d53/d6b/c75 0 2024-09-13T21:44:42.827 INFO:tasks.workunit.client.0.smithi119.stdout:7/384: mknod d8/d3c/d46/c76 0 2024-09-13T21:44:42.828 INFO:tasks.workunit.client.0.smithi119.stdout:9/438: rmdir d0/d19 39 2024-09-13T21:44:42.829 INFO:tasks.workunit.client.0.smithi119.stdout:7/385: rmdir d8/d3c/d53/d37/d57 39 2024-09-13T21:44:42.831 INFO:tasks.workunit.client.0.smithi119.stdout:7/386: read d8/d3c/d46/f5a [1245609,6200] 0 2024-09-13T21:44:42.832 INFO:tasks.workunit.client.0.smithi119.stdout:9/439: write d0/d19/f26 [3689483,70473] 0 2024-09-13T21:44:42.832 INFO:tasks.workunit.client.0.smithi119.stdout:7/387: chown d8/d19/d2e/d34/d6e 3088883 1 2024-09-13T21:44:42.834 INFO:tasks.workunit.client.0.smithi119.stdout:9/440: creat d0/d8/d18/f94 x:0 0 0 2024-09-13T21:44:42.835 INFO:tasks.workunit.client.0.smithi119.stdout:7/388: symlink d8/d19/l77 0 2024-09-13T21:44:42.835 INFO:tasks.workunit.client.0.smithi119.stdout:9/441: chown d0/d8/d18/l28 0 1 2024-09-13T21:44:42.838 INFO:tasks.workunit.client.0.smithi119.stdout:9/442: creat d0/d19/d1a/d2b/d60/f95 x:0 0 0 2024-09-13T21:44:42.840 INFO:tasks.workunit.client.0.smithi119.stdout:7/389: dread d8/f21 [0,4194304] 0 2024-09-13T21:44:42.841 INFO:tasks.workunit.client.0.smithi119.stdout:9/443: symlink d0/d19/d1a/d2b/d60/l96 0 2024-09-13T21:44:42.842 INFO:tasks.workunit.client.0.smithi119.stdout:9/444: readlink d0/d19/d1a/d2b/d60/l54 0 2024-09-13T21:44:42.843 INFO:tasks.workunit.client.0.smithi119.stdout:7/390: chown d8/d3c/d53/d37/c4c 370543 1 2024-09-13T21:44:42.846 INFO:tasks.workunit.client.0.smithi119.stdout:9/445: mknod d0/d19/d1a/d2b/d60/c97 0 2024-09-13T21:44:42.847 INFO:tasks.workunit.client.0.smithi119.stdout:7/391: creat d8/d3c/d53/d37/d57/d5f/f78 x:0 0 0 2024-09-13T21:44:42.850 INFO:tasks.workunit.client.0.smithi119.stdout:8/416: sync 2024-09-13T21:44:42.850 INFO:tasks.workunit.client.0.smithi119.stdout:9/446: rename d0/d19/d1a/d2b/d60/l96 to d0/d8/l98 0 2024-09-13T21:44:42.851 INFO:tasks.workunit.client.0.smithi119.stdout:7/392: dread d8/d19/f25 [0,4194304] 0 2024-09-13T21:44:42.852 INFO:tasks.workunit.client.0.smithi119.stdout:8/417: truncate d1b/d1d/d48/f72 689761 0 2024-09-13T21:44:42.853 INFO:tasks.workunit.client.0.smithi119.stdout:8/418: write d1b/d4e/f67 [854202,11518] 0 2024-09-13T21:44:42.854 INFO:tasks.workunit.client.0.smithi119.stdout:7/393: creat d8/d3c/d53/d3b/d48/f79 x:0 0 0 2024-09-13T21:44:42.855 INFO:tasks.workunit.client.0.smithi119.stdout:9/447: write d0/d8/d18/d23/d42/d52/f5c [3575990,35363] 0 2024-09-13T21:44:42.855 INFO:tasks.workunit.client.0.smithi119.stdout:7/394: chown d8/d4d/f52 3966930 1 2024-09-13T21:44:42.856 INFO:tasks.workunit.client.0.smithi119.stdout:8/419: creat d1b/d1d/d26/d6b/f87 x:0 0 0 2024-09-13T21:44:42.863 INFO:tasks.workunit.client.0.smithi119.stdout:7/395: fsync d8/d3c/d53/d3b/d48/f79 0 2024-09-13T21:44:42.865 INFO:tasks.workunit.client.0.smithi119.stdout:8/420: dwrite d1b/d1d/d48/d58/f79 [0,4194304] 0 2024-09-13T21:44:42.866 INFO:tasks.workunit.client.0.smithi119.stdout:7/396: chown d8/d3c/d46/c76 0 1 2024-09-13T21:44:42.870 INFO:tasks.workunit.client.0.smithi119.stdout:9/448: dread d0/d19/d1a/f5a [0,4194304] 0 2024-09-13T21:44:42.872 INFO:tasks.workunit.client.0.smithi119.stdout:9/449: symlink d0/d19/d1a/d2b/d60/l99 0 2024-09-13T21:44:42.872 INFO:tasks.workunit.client.0.smithi119.stdout:8/421: read f9 [3912027,113069] 0 2024-09-13T21:44:42.875 INFO:tasks.workunit.client.0.smithi119.stdout:9/450: rename d0/d8/d18/d23/d27/f17 to d0/d19/f9a 0 2024-09-13T21:44:42.876 INFO:tasks.workunit.client.0.smithi119.stdout:9/451: fdatasync d0/d19/d1a/f3b 0 2024-09-13T21:44:42.878 INFO:tasks.workunit.client.0.smithi119.stdout:9/452: readlink d0/d19/d1a/d2b/d60/l99 0 2024-09-13T21:44:42.878 INFO:tasks.workunit.client.0.smithi119.stdout:8/422: rename d1b/d1d/d26/f2f to d1b/d1d/d26/d3e/d65/f88 0 2024-09-13T21:44:42.880 INFO:tasks.workunit.client.0.smithi119.stdout:9/453: mknod d0/d19/c9b 0 2024-09-13T21:44:42.881 INFO:tasks.workunit.client.0.smithi119.stdout:8/423: creat d1b/d1d/d26/f89 x:0 0 0 2024-09-13T21:44:42.883 INFO:tasks.workunit.client.0.smithi119.stdout:9/454: write d0/d8/d18/d23/d27/d2d/d6e/f7d [2384568,123746] 0 2024-09-13T21:44:42.883 INFO:tasks.workunit.client.0.smithi119.stdout:8/424: write f5 [358916,122692] 0 2024-09-13T21:44:42.886 INFO:tasks.workunit.client.0.smithi119.stdout:9/455: symlink d0/d8/d18/d23/d27/d2d/d70/l9c 0 2024-09-13T21:44:42.891 INFO:tasks.workunit.client.0.smithi119.stdout:9/456: dwrite d0/d19/f30 [0,4194304] 0 2024-09-13T21:44:42.894 INFO:tasks.workunit.client.0.smithi119.stdout:9/457: rmdir d0/d8/d18/d23/d42/d52 39 2024-09-13T21:44:42.899 INFO:tasks.workunit.client.0.smithi119.stdout:9/458: rename d0/d19/d1a/f5a to d0/d8/d18/d23/d27/d2d/d6e/f9d 0 2024-09-13T21:44:42.903 INFO:tasks.workunit.client.0.smithi119.stdout:9/459: link d0/d19/d1a/f3b d0/d19/d1a/d2b/f9e 0 2024-09-13T21:44:42.905 INFO:tasks.workunit.client.0.smithi119.stdout:9/460: creat d0/d19/f9f x:0 0 0 2024-09-13T21:44:42.907 INFO:tasks.workunit.client.0.smithi119.stdout:9/461: rename d0/f82 to d0/d8/d18/d23/d27/d2d/d6e/fa0 0 2024-09-13T21:44:42.910 INFO:tasks.workunit.client.0.smithi119.stdout:9/462: truncate d0/d19/d1a/d2b/f3e 211338 0 2024-09-13T21:44:42.913 INFO:tasks.workunit.client.0.smithi119.stdout:9/463: dread d0/f14 [0,4194304] 0 2024-09-13T21:44:42.917 INFO:tasks.workunit.client.0.smithi119.stdout:9/464: link d0/d19/d1a/d2b/l67 d0/d19/d1a/d2b/la1 0 2024-09-13T21:44:43.125 INFO:tasks.workunit.client.0.smithi119.stdout:1/355: sync 2024-09-13T21:44:43.125 INFO:tasks.workunit.client.0.smithi119.stdout:1/356: readlink d1/d3/dc/l52 0 2024-09-13T21:44:43.134 INFO:tasks.workunit.client.0.smithi119.stdout:1/357: truncate d1/d3/f2b 3576670 0 2024-09-13T21:44:43.219 INFO:tasks.workunit.client.0.smithi119.stdout:6/322: sync 2024-09-13T21:44:43.229 INFO:tasks.workunit.client.0.smithi119.stdout:6/323: dwrite dc/dd/f47 [0,4194304] 0 2024-09-13T21:44:43.231 INFO:tasks.workunit.client.0.smithi119.stdout:6/324: creat dc/df/d41/f61 x:0 0 0 2024-09-13T21:44:43.235 INFO:tasks.workunit.client.0.smithi119.stdout:6/325: getdents dc/dd/d5e 0 2024-09-13T21:44:43.241 INFO:tasks.workunit.client.0.smithi119.stdout:6/326: dwrite dc/df/d41/f5d [0,4194304] 0 2024-09-13T21:44:43.242 INFO:tasks.workunit.client.0.smithi119.stdout:6/327: chown dc/d4b/f4a 206 1 2024-09-13T21:44:43.242 INFO:tasks.workunit.client.0.smithi119.stdout:6/328: chown dc/d4b 0 1 2024-09-13T21:44:43.244 INFO:tasks.workunit.client.0.smithi119.stdout:6/329: truncate dc/f31 199505 0 2024-09-13T21:44:43.245 INFO:tasks.workunit.client.0.smithi119.stdout:6/330: symlink dc/d3a/l62 0 2024-09-13T21:44:43.251 INFO:tasks.workunit.client.0.smithi119.stdout:6/331: dwrite dc/d3a/f5a [0,4194304] 0 2024-09-13T21:44:43.254 INFO:tasks.workunit.client.0.smithi119.stdout:6/332: unlink dc/l2a 0 2024-09-13T21:44:43.259 INFO:tasks.workunit.client.0.smithi119.stdout:6/333: dread dc/df/f27 [0,4194304] 0 2024-09-13T21:44:43.261 INFO:tasks.workunit.client.0.smithi119.stdout:6/334: rmdir dc/df/d5c 39 2024-09-13T21:44:43.262 INFO:tasks.workunit.client.0.smithi119.stdout:6/335: readlink dc/df/l15 0 2024-09-13T21:44:43.263 INFO:tasks.workunit.client.0.smithi119.stdout:6/336: rmdir dc/d37 39 2024-09-13T21:44:43.265 INFO:tasks.workunit.client.0.smithi119.stdout:6/337: rename dc/d3a/l62 to dc/d3d/d40/l63 0 2024-09-13T21:44:43.270 INFO:tasks.workunit.client.0.smithi119.stdout:6/338: dwrite dc/dd/f38 [0,4194304] 0 2024-09-13T21:44:43.277 INFO:tasks.workunit.client.0.smithi119.stdout:6/339: dwrite dc/d3a/f52 [0,4194304] 0 2024-09-13T21:44:43.280 INFO:tasks.workunit.client.0.smithi119.stdout:6/340: mkdir dc/df/d64 0 2024-09-13T21:44:43.280 INFO:tasks.workunit.client.0.smithi119.stdout:6/341: chown dc/c5b 66768 1 2024-09-13T21:44:43.283 INFO:tasks.workunit.client.0.smithi119.stdout:6/342: mkdir dc/df/d65 0 2024-09-13T21:44:43.289 INFO:tasks.workunit.client.0.smithi119.stdout:6/343: dwrite dc/f31 [0,4194304] 0 2024-09-13T21:44:43.300 INFO:tasks.workunit.client.0.smithi119.stdout:2/405: sync 2024-09-13T21:44:43.303 INFO:tasks.workunit.client.0.smithi119.stdout:2/406: rename d1/d2b to d1/d38/d89 0 2024-09-13T21:44:43.304 INFO:tasks.workunit.client.0.smithi119.stdout:6/344: dwrite dc/d37/f48 [0,4194304] 0 2024-09-13T21:44:43.305 INFO:tasks.workunit.client.0.smithi119.stdout:6/345: chown dc/d37 0 1 2024-09-13T21:44:43.314 INFO:tasks.workunit.client.0.smithi119.stdout:2/407: dwrite d1/d22/d55/f48 [0,4194304] 0 2024-09-13T21:44:43.316 INFO:tasks.workunit.client.0.smithi119.stdout:2/408: rmdir d1/d22/d5a/d5d 39 2024-09-13T21:44:43.316 INFO:tasks.workunit.client.0.smithi119.stdout:2/409: write d1/d7/d47/f74 [636053,99398] 0 2024-09-13T21:44:43.320 INFO:tasks.workunit.client.0.smithi119.stdout:2/410: rename d1/d7/d47/f74 to d1/d22/d5a/f8a 0 2024-09-13T21:44:43.321 INFO:tasks.workunit.client.0.smithi119.stdout:2/411: write d1/d7/d47/f5c [1140035,1671] 0 2024-09-13T21:44:43.324 INFO:tasks.workunit.client.0.smithi119.stdout:2/412: chown d1/d22/d55/c35 62 1 2024-09-13T21:44:43.327 INFO:tasks.workunit.client.0.smithi119.stdout:2/413: dread d1/f4a [0,4194304] 0 2024-09-13T21:44:43.329 INFO:tasks.workunit.client.0.smithi119.stdout:2/414: creat d1/d7/d47/f8b x:0 0 0 2024-09-13T21:44:43.329 INFO:tasks.workunit.client.0.smithi119.stdout:2/415: chown d1/d22/d55/f44 13 1 2024-09-13T21:44:43.332 INFO:tasks.workunit.client.0.smithi119.stdout:2/416: mkdir d1/d38/d89/d6b/d8c 0 2024-09-13T21:44:43.333 INFO:tasks.workunit.client.0.smithi119.stdout:2/417: truncate d1/d22/d55/f44 1499678 0 2024-09-13T21:44:43.334 INFO:tasks.workunit.client.0.smithi119.stdout:2/418: rename d1/d38/l58 to d1/d22/d55/l8d 0 2024-09-13T21:44:43.340 INFO:tasks.workunit.client.0.smithi119.stdout:2/419: dwrite d1/d22/d5a/d5d/f61 [0,4194304] 0 2024-09-13T21:44:43.359 INFO:tasks.workunit.client.0.smithi119.stdout:2/420: dread d1/d7/f11 [4194304,4194304] 0 2024-09-13T21:44:43.361 INFO:tasks.workunit.client.0.smithi119.stdout:2/421: creat d1/d22/d5a/d5d/f8e x:0 0 0 2024-09-13T21:44:43.362 INFO:tasks.workunit.client.0.smithi119.stdout:2/422: rename d1/d22/d55/d64 to d1/d22/d55/d64/d8f 22 2024-09-13T21:44:43.363 INFO:tasks.workunit.client.0.smithi119.stdout:2/423: creat d1/f90 x:0 0 0 2024-09-13T21:44:43.364 INFO:tasks.workunit.client.0.smithi119.stdout:2/424: readlink d1/d22/l6f 0 2024-09-13T21:44:43.379 INFO:tasks.workunit.client.0.smithi119.stdout:2/425: dread d1/d22/d5a/d5d/d83/f73 [4194304,4194304] 0 2024-09-13T21:44:43.381 INFO:tasks.workunit.client.0.smithi119.stdout:2/426: getdents d1/d38/d89 0 2024-09-13T21:44:43.383 INFO:tasks.workunit.client.0.smithi119.stdout:2/427: write d1/d22/f1c [2903986,130565] 0 2024-09-13T21:44:43.384 INFO:tasks.workunit.client.0.smithi119.stdout:2/428: write d1/d22/d55/f48 [1180891,49286] 0 2024-09-13T21:44:43.386 INFO:tasks.workunit.client.0.smithi119.stdout:2/429: rmdir d1/d22/d5a 39 2024-09-13T21:44:43.388 INFO:tasks.workunit.client.0.smithi119.stdout:2/430: symlink d1/d22/d5a/l91 0 2024-09-13T21:44:43.392 INFO:tasks.workunit.client.0.smithi119.stdout:2/431: truncate d1/d22/d5a/d5d/f61 1777089 0 2024-09-13T21:44:43.394 INFO:tasks.workunit.client.0.smithi119.stdout:2/432: rename d1/f25 to d1/d22/d5a/d5d/f92 0 2024-09-13T21:44:43.395 INFO:tasks.workunit.client.0.smithi119.stdout:2/433: chown d1/d7/c13 1341310 1 2024-09-13T21:44:43.396 INFO:tasks.workunit.client.0.smithi119.stdout:2/434: mknod d1/d22/c93 0 2024-09-13T21:44:43.397 INFO:tasks.workunit.client.0.smithi119.stdout:2/435: write d1/d22/d5a/d5d/f78 [829171,50545] 0 2024-09-13T21:44:43.398 INFO:tasks.workunit.client.0.smithi119.stdout:2/436: chown d1/d22/d5a/d5d/f78 884 1 2024-09-13T21:44:43.398 INFO:tasks.workunit.client.0.smithi119.stdout:2/437: write d1/f50 [863627,83140] 0 2024-09-13T21:44:43.456 INFO:tasks.workunit.client.0.smithi119.stdout:4/460: sync 2024-09-13T21:44:43.456 INFO:tasks.workunit.client.0.smithi119.stdout:9/465: sync 2024-09-13T21:44:43.456 INFO:tasks.workunit.client.0.smithi119.stdout:0/426: sync 2024-09-13T21:44:43.456 INFO:tasks.workunit.client.0.smithi119.stdout:3/390: sync 2024-09-13T21:44:43.456 INFO:tasks.workunit.client.0.smithi119.stdout:7/397: sync 2024-09-13T21:44:43.456 INFO:tasks.workunit.client.0.smithi119.stdout:5/334: sync 2024-09-13T21:44:43.456 INFO:tasks.workunit.client.0.smithi119.stdout:8/425: sync 2024-09-13T21:44:43.456 INFO:tasks.workunit.client.0.smithi119.stdout:1/358: sync 2024-09-13T21:44:43.457 INFO:tasks.workunit.client.0.smithi119.stdout:8/426: readlink d1b/d1d/l45 0 2024-09-13T21:44:43.458 INFO:tasks.workunit.client.0.smithi119.stdout:3/391: mkdir d6/d44/d52/d85 0 2024-09-13T21:44:43.458 INFO:tasks.workunit.client.0.smithi119.stdout:9/466: write d0/d8/d18/f94 [641542,59943] 0 2024-09-13T21:44:43.461 INFO:tasks.workunit.client.0.smithi119.stdout:5/335: write d0/d3/d4/d9/d14/d24/f55 [3570148,69710] 0 2024-09-13T21:44:43.461 INFO:tasks.workunit.client.0.smithi119.stdout:4/461: creat d4/d1e/d26/d6d/f91 x:0 0 0 2024-09-13T21:44:43.461 INFO:tasks.workunit.client.0.smithi119.stdout:7/398: mknod d8/d19/d2e/d34/d42/d3d/c7a 0 2024-09-13T21:44:43.466 INFO:tasks.workunit.client.0.smithi119.stdout:9/467: readlink d0/d8/d18/d23/d27/d2d/d70/l83 0 2024-09-13T21:44:43.467 INFO:tasks.workunit.client.0.smithi119.stdout:4/462: write d4/d1e/f5c [1024702,65471] 0 2024-09-13T21:44:43.468 INFO:tasks.workunit.client.0.smithi119.stdout:5/336: readlink d0/d3/d4/d9/d14/l43 0 2024-09-13T21:44:43.472 INFO:tasks.workunit.client.0.smithi119.stdout:7/399: rename d8/d3c/d53/f4e to d8/d3c/f7b 0 2024-09-13T21:44:43.472 INFO:tasks.workunit.client.0.smithi119.stdout:9/468: dread - d0/d19/f9f zero size 2024-09-13T21:44:43.473 INFO:tasks.workunit.client.0.smithi119.stdout:0/427: dwrite de/f1a [0,4194304] 0 2024-09-13T21:44:43.476 INFO:tasks.workunit.client.0.smithi119.stdout:4/463: write d4/d1e/f50 [3872297,47811] 0 2024-09-13T21:44:43.476 INFO:tasks.workunit.client.0.smithi119.stdout:1/359: dwrite d1/d3/dc/f67 [0,4194304] 0 2024-09-13T21:44:43.483 INFO:tasks.workunit.client.0.smithi119.stdout:5/337: symlink d0/d3/d4/d9/d74/l7b 0 2024-09-13T21:44:43.486 INFO:tasks.workunit.client.0.smithi119.stdout:8/427: dwrite d1b/d4e/f84 [0,4194304] 0 2024-09-13T21:44:43.487 INFO:tasks.workunit.client.0.smithi119.stdout:1/360: write d1/d3/dc/f41 [432117,94742] 0 2024-09-13T21:44:43.489 INFO:tasks.workunit.client.0.smithi119.stdout:5/338: chown d0/l19 441810168 1 2024-09-13T21:44:43.490 INFO:tasks.workunit.client.0.smithi119.stdout:1/361: chown d1/f1b 262789895 1 2024-09-13T21:44:43.491 INFO:tasks.workunit.client.0.smithi119.stdout:3/392: dwrite d6/d15/d1a/f3c [0,4194304] 0 2024-09-13T21:44:43.491 INFO:tasks.workunit.client.0.smithi119.stdout:8/428: stat d1b/d1d/d26 0 2024-09-13T21:44:43.494 INFO:tasks.workunit.client.0.smithi119.stdout:7/400: dwrite f6 [8388608,4194304] 0 2024-09-13T21:44:43.498 INFO:tasks.workunit.client.0.smithi119.stdout:9/469: link d0/d8/d18/d23/d27/d2d/d5f/f61 d0/d4f/d56/fa2 0 2024-09-13T21:44:43.500 INFO:tasks.workunit.client.0.smithi119.stdout:0/428: dwrite de/f68 [0,4194304] 0 2024-09-13T21:44:43.501 INFO:tasks.workunit.client.0.smithi119.stdout:8/429: mknod d1b/d1d/c8a 0 2024-09-13T21:44:43.501 INFO:tasks.workunit.client.0.smithi119.stdout:7/401: chown d8/d3c/d53/d3b/l70 2880 1 2024-09-13T21:44:43.505 INFO:tasks.workunit.client.0.smithi119.stdout:0/429: readlink de/d1c/l25 0 2024-09-13T21:44:43.507 INFO:tasks.workunit.client.0.smithi119.stdout:9/470: mknod d0/d4f/d56/ca3 0 2024-09-13T21:44:43.512 INFO:tasks.workunit.client.0.smithi119.stdout:3/393: dwrite d6/d25/d2f/d33/d56/f66 [0,4194304] 0 2024-09-13T21:44:43.516 INFO:tasks.workunit.client.0.smithi119.stdout:0/430: mknod de/d1c/d9c/ca0 0 2024-09-13T21:44:43.517 INFO:tasks.workunit.client.0.smithi119.stdout:5/339: dread d0/d3/d4/d9/d14/f68 [0,4194304] 0 2024-09-13T21:44:43.518 INFO:tasks.workunit.client.0.smithi119.stdout:7/402: fsync d8/d19/d2e/f71 0 2024-09-13T21:44:43.518 INFO:tasks.workunit.client.0.smithi119.stdout:0/431: stat de/d1c/d2b/d34/f3a 0 2024-09-13T21:44:43.521 INFO:tasks.workunit.client.0.smithi119.stdout:3/394: rename d6/d25/f83 to d6/d44/d52/f86 0 2024-09-13T21:44:43.521 INFO:tasks.workunit.client.0.smithi119.stdout:8/430: link d1b/d1d/c24 d1b/c8b 0 2024-09-13T21:44:43.525 INFO:tasks.workunit.client.0.smithi119.stdout:9/471: dwrite d0/d8/f4b [0,4194304] 0 2024-09-13T21:44:43.527 INFO:tasks.workunit.client.0.smithi119.stdout:8/431: symlink d1b/d1d/d48/d58/l8c 0 2024-09-13T21:44:43.527 INFO:tasks.workunit.client.0.smithi119.stdout:9/472: write d0/d8/d18/d23/d27/f32 [4121880,76942] 0 2024-09-13T21:44:43.530 INFO:tasks.workunit.client.0.smithi119.stdout:7/403: getdents d8/d3c/d53/d3b 0 2024-09-13T21:44:43.531 INFO:tasks.workunit.client.0.smithi119.stdout:8/432: write d1b/d1d/d26/f33 [1000041,36880] 0 2024-09-13T21:44:43.537 INFO:tasks.workunit.client.0.smithi119.stdout:3/395: dwrite d6/d15/d1a/f42 [0,4194304] 0 2024-09-13T21:44:43.543 INFO:tasks.workunit.client.0.smithi119.stdout:3/396: chown d6/d15/d1a/f41 692839 1 2024-09-13T21:44:43.544 INFO:tasks.workunit.client.0.smithi119.stdout:7/404: link d8/d19/f1c d8/d19/d2e/f7c 0 2024-09-13T21:44:43.549 INFO:tasks.workunit.client.0.smithi119.stdout:3/397: dread - d6/d25/d2f/f57 zero size 2024-09-13T21:44:43.551 INFO:tasks.workunit.client.0.smithi119.stdout:8/433: dwrite d1b/f36 [4194304,4194304] 0 2024-09-13T21:44:43.551 INFO:tasks.workunit.client.0.smithi119.stdout:6/346: sync 2024-09-13T21:44:43.551 INFO:tasks.workunit.client.0.smithi119.stdout:0/432: write fc [178157,91796] 0 2024-09-13T21:44:43.552 INFO:tasks.workunit.client.0.smithi119.stdout:9/473: dwrite d0/d8/d18/f90 [0,4194304] 0 2024-09-13T21:44:43.553 INFO:tasks.workunit.client.0.smithi119.stdout:7/405: dread f3 [4194304,4194304] 0 2024-09-13T21:44:43.553 INFO:tasks.workunit.client.0.smithi119.stdout:1/362: dread d1/d3/f2b [0,4194304] 0 2024-09-13T21:44:43.554 INFO:tasks.workunit.client.0.smithi119.stdout:4/464: dread d4/d1e/d28/d34/f3e [0,4194304] 0 2024-09-13T21:44:43.561 INFO:tasks.workunit.client.0.smithi119.stdout:6/347: mknod dc/df/c66 0 2024-09-13T21:44:43.561 INFO:tasks.workunit.client.0.smithi119.stdout:8/434: write d1b/f46 [4007993,60204] 0 2024-09-13T21:44:43.563 INFO:tasks.workunit.client.0.smithi119.stdout:3/398: rename d6/d15/d1a/f42 to d6/d15/d1a/d45/f87 0 2024-09-13T21:44:43.564 INFO:tasks.workunit.client.0.smithi119.stdout:0/433: mkdir de/d1c/d2b/d76/d9b/da1 0 2024-09-13T21:44:43.565 INFO:tasks.workunit.client.0.smithi119.stdout:6/348: stat dc/d3d/d40/f58 0 2024-09-13T21:44:43.566 INFO:tasks.workunit.client.0.smithi119.stdout:5/340: dread d0/d3/d4/d2e/f2f [0,4194304] 0 2024-09-13T21:44:43.567 INFO:tasks.workunit.client.0.smithi119.stdout:7/406: dread d8/f21 [0,4194304] 0 2024-09-13T21:44:43.570 INFO:tasks.workunit.client.0.smithi119.stdout:0/434: unlink de/d4e/f8c 0 2024-09-13T21:44:43.571 INFO:tasks.workunit.client.0.smithi119.stdout:0/435: readlink l9 0 2024-09-13T21:44:43.572 INFO:tasks.workunit.client.0.smithi119.stdout:6/349: symlink dc/d3d/d4e/l67 0 2024-09-13T21:44:43.573 INFO:tasks.workunit.client.0.smithi119.stdout:8/435: fsync d1b/f42 0 2024-09-13T21:44:43.577 INFO:tasks.workunit.client.0.smithi119.stdout:6/350: write dc/dd/f4f [1052120,81037] 0 2024-09-13T21:44:43.578 INFO:tasks.workunit.client.0.smithi119.stdout:9/474: getdents d0/d19/d1a/d2b 0 2024-09-13T21:44:43.582 INFO:tasks.workunit.client.0.smithi119.stdout:3/399: getdents d6/d25/d2f/d33 0 2024-09-13T21:44:43.584 INFO:tasks.workunit.client.0.smithi119.stdout:2/438: sync 2024-09-13T21:44:43.585 INFO:tasks.workunit.client.0.smithi119.stdout:5/341: dwrite d0/d3/d4/f78 [0,4194304] 0 2024-09-13T21:44:43.585 INFO:tasks.workunit.client.0.smithi119.stdout:7/407: dwrite d8/d3c/d53/d37/d57/d5f/f67 [0,4194304] 0 2024-09-13T21:44:43.590 INFO:tasks.workunit.client.0.smithi119.stdout:2/439: chown d1/d7/l5b 5098201 1 2024-09-13T21:44:43.590 INFO:tasks.workunit.client.0.smithi119.stdout:9/475: mkdir d0/d79/da4 0 2024-09-13T21:44:43.596 INFO:tasks.workunit.client.0.smithi119.stdout:6/351: mkdir dc/d3d/d40/d68 0 2024-09-13T21:44:43.599 INFO:tasks.workunit.client.0.smithi119.stdout:0/436: link de/c51 de/d1c/d64/ca2 0 2024-09-13T21:44:43.599 INFO:tasks.workunit.client.0.smithi119.stdout:9/476: fdatasync d0/f14 0 2024-09-13T21:44:43.600 INFO:tasks.workunit.client.0.smithi119.stdout:6/352: fdatasync dc/f14 0 2024-09-13T21:44:43.600 INFO:tasks.workunit.client.0.smithi119.stdout:5/342: write d0/d3/d4/d9/d14/d24/d25/f36 [678286,119385] 0 2024-09-13T21:44:43.605 INFO:tasks.workunit.client.0.smithi119.stdout:8/436: rmdir d1b/d1d/d39/d6c 0 2024-09-13T21:44:43.606 INFO:tasks.workunit.client.0.smithi119.stdout:4/465: dread d4/d1e/d28/d34/d66/d76/f82 [0,4194304] 0 2024-09-13T21:44:43.606 INFO:tasks.workunit.client.0.smithi119.stdout:7/408: dwrite d8/d3c/f51 [0,4194304] 0 2024-09-13T21:44:43.606 INFO:tasks.workunit.client.0.smithi119.stdout:1/363: dread d1/d3/dc/d11/f17 [4194304,4194304] 0 2024-09-13T21:44:43.606 INFO:tasks.workunit.client.0.smithi119.stdout:0/437: write de/d3c/f3d [498967,83627] 0 2024-09-13T21:44:43.642 INFO:tasks.workunit.client.0.smithi119.stdout:3/400: getdents d6 0 2024-09-13T21:44:43.642 INFO:tasks.workunit.client.0.smithi119.stdout:4/466: chown d4/d1e/d10/f46 447171 1 2024-09-13T21:44:43.643 INFO:tasks.workunit.client.0.smithi119.stdout:6/353: creat dc/d3d/d40/f69 x:0 0 0 2024-09-13T21:44:43.643 INFO:tasks.workunit.client.0.smithi119.stdout:7/409: read d8/d3c/d53/f2b [2572784,35115] 0 2024-09-13T21:44:43.643 INFO:tasks.workunit.client.0.smithi119.stdout:5/343: symlink d0/d3/d1f/d21/l7c 0 2024-09-13T21:44:43.646 INFO:tasks.workunit.client.0.smithi119.stdout:3/401: chown d6/d44/c72 4 1 2024-09-13T21:44:43.647 INFO:tasks.workunit.client.0.smithi119.stdout:7/410: dread - d8/d3c/f7b zero size 2024-09-13T21:44:43.648 INFO:tasks.workunit.client.0.smithi119.stdout:6/354: mkdir dc/d4b/d6a 0 2024-09-13T21:44:43.650 INFO:tasks.workunit.client.0.smithi119.stdout:1/364: chown d1/d3/dc/d24/d2f/d31/d32/d33/d43/c68 112 1 2024-09-13T21:44:43.650 INFO:tasks.workunit.client.0.smithi119.stdout:4/467: mknod d4/d1e/c92 0 2024-09-13T21:44:43.653 INFO:tasks.workunit.client.0.smithi119.stdout:1/365: chown d1/d3/dc/d11/d19/d47 169 1 2024-09-13T21:44:43.653 INFO:tasks.workunit.client.0.smithi119.stdout:6/355: chown dc/d3d/d40/f49 12664863 1 2024-09-13T21:44:43.653 INFO:tasks.workunit.client.0.smithi119.stdout:7/411: read - d8/d19/d2e/d34/d42/f4b zero size 2024-09-13T21:44:43.653 INFO:tasks.workunit.client.0.smithi119.stdout:3/402: unlink d6/d15/l26 0 2024-09-13T21:44:43.656 INFO:tasks.workunit.client.0.smithi119.stdout:5/344: creat d0/d3/d4/d9/d14/d24/d25/f7d x:0 0 0 2024-09-13T21:44:43.657 INFO:tasks.workunit.client.0.smithi119.stdout:2/440: dwrite d1/d22/f42 [0,4194304] 0 2024-09-13T21:44:43.657 INFO:tasks.workunit.client.0.smithi119.stdout:6/356: rmdir dc/d4b 39 2024-09-13T21:44:43.659 INFO:tasks.workunit.client.0.smithi119.stdout:1/366: symlink d1/d3/l73 0 2024-09-13T21:44:43.659 INFO:tasks.workunit.client.0.smithi119.stdout:7/412: creat d8/f7d x:0 0 0 2024-09-13T21:44:43.660 INFO:tasks.workunit.client.0.smithi119.stdout:3/403: mkdir d6/d25/d2f/d33/d88 0 2024-09-13T21:44:43.661 INFO:tasks.workunit.client.0.smithi119.stdout:4/468: creat d4/d1e/d28/d34/d66/f93 x:0 0 0 2024-09-13T21:44:43.663 INFO:tasks.workunit.client.0.smithi119.stdout:2/441: readlink d1/d22/l68 0 2024-09-13T21:44:43.663 INFO:tasks.workunit.client.0.smithi119.stdout:8/437: dread d1b/f46 [0,4194304] 0 2024-09-13T21:44:43.664 INFO:tasks.workunit.client.0.smithi119.stdout:5/345: mkdir d0/d3/d1f/d7e 0 2024-09-13T21:44:43.664 INFO:tasks.workunit.client.0.smithi119.stdout:8/438: chown d1b/d1d/d26/f61 1 1 2024-09-13T21:44:43.665 INFO:tasks.workunit.client.0.smithi119.stdout:8/439: read - d1b/d1d/d48/d58/f74 zero size 2024-09-13T21:44:43.665 INFO:tasks.workunit.client.0.smithi119.stdout:6/357: rename dc/d37 to dc/d3d/d40/d6b 0 2024-09-13T21:44:43.667 INFO:tasks.workunit.client.0.smithi119.stdout:7/413: truncate d8/d19/f1a 1394679 0 2024-09-13T21:44:43.669 INFO:tasks.workunit.client.0.smithi119.stdout:4/469: creat d4/d1e/d26/d60/d71/f94 x:0 0 0 2024-09-13T21:44:43.670 INFO:tasks.workunit.client.0.smithi119.stdout:1/367: mkdir d1/d3/dc/d24/d2f/d31/d32/d33/d43/d74 0 2024-09-13T21:44:43.672 INFO:tasks.workunit.client.0.smithi119.stdout:2/442: creat d1/d22/d55/d31/f94 x:0 0 0 2024-09-13T21:44:43.674 INFO:tasks.workunit.client.0.smithi119.stdout:3/404: mknod d6/d25/d74/c89 0 2024-09-13T21:44:43.676 INFO:tasks.workunit.client.0.smithi119.stdout:0/438: dwrite de/d1c/d59/f71 [0,4194304] 0 2024-09-13T21:44:43.676 INFO:tasks.workunit.client.0.smithi119.stdout:7/414: mkdir d8/d3c/d53/d3b/d7e 0 2024-09-13T21:44:43.677 INFO:tasks.workunit.client.0.smithi119.stdout:3/405: write d6/d25/d2f/f3b [4928402,85190] 0 2024-09-13T21:44:43.677 INFO:tasks.workunit.client.0.smithi119.stdout:1/368: mknod d1/c75 0 2024-09-13T21:44:43.682 INFO:tasks.workunit.client.0.smithi119.stdout:6/358: link dc/dd/f20 dc/df/d32/f6c 0 2024-09-13T21:44:43.683 INFO:tasks.workunit.client.0.smithi119.stdout:7/415: truncate d8/d3c/d53/d3b/d48/f49 1354033 0 2024-09-13T21:44:43.685 INFO:tasks.workunit.client.0.smithi119.stdout:6/359: chown dc/df 21923 1 2024-09-13T21:44:43.685 INFO:tasks.workunit.client.0.smithi119.stdout:4/470: dread d4/d1e/d28/f24 [0,4194304] 0 2024-09-13T21:44:43.686 INFO:tasks.workunit.client.0.smithi119.stdout:2/443: mkdir d1/d22/d7c/d95 0 2024-09-13T21:44:43.686 INFO:tasks.workunit.client.0.smithi119.stdout:0/439: creat de/d4e/d7f/fa3 x:0 0 0 2024-09-13T21:44:43.686 INFO:tasks.workunit.client.0.smithi119.stdout:8/440: link d1b/d1d/d48/l64 d1b/d1d/d26/d3e/l8d 0 2024-09-13T21:44:43.688 INFO:tasks.workunit.client.0.smithi119.stdout:5/346: link d0/d3/d4/d9/d14/d24/f6e d0/d3/d1f/d21/f7f 0 2024-09-13T21:44:43.689 INFO:tasks.workunit.client.0.smithi119.stdout:2/444: dread - d1/d38/d89/d6b/f87 zero size 2024-09-13T21:44:43.689 INFO:tasks.workunit.client.0.smithi119.stdout:0/440: chown de/d1c/d2b/d76/d9a 2123944 1 2024-09-13T21:44:43.690 INFO:tasks.workunit.client.0.smithi119.stdout:7/416: write d8/d3c/f7b [460522,123573] 0 2024-09-13T21:44:43.692 INFO:tasks.workunit.client.0.smithi119.stdout:3/406: dwrite d6/d25/d2f/d33/f71 [0,4194304] 0 2024-09-13T21:44:43.692 INFO:tasks.workunit.client.0.smithi119.stdout:2/445: stat d1/d22/d5a/f8a 0 2024-09-13T21:44:43.693 INFO:tasks.workunit.client.0.smithi119.stdout:1/369: mknod d1/d3/dc/d11/d19/d2d/d59/d6f/c76 0 2024-09-13T21:44:43.697 INFO:tasks.workunit.client.0.smithi119.stdout:7/417: write d8/d4d/f64 [576173,35876] 0 2024-09-13T21:44:43.699 INFO:tasks.workunit.client.0.smithi119.stdout:8/441: write d1b/d1d/d26/d3e/f7d [893457,82312] 0 2024-09-13T21:44:43.700 INFO:tasks.workunit.client.0.smithi119.stdout:6/360: mkdir dc/df/d6d 0 2024-09-13T21:44:43.701 INFO:tasks.workunit.client.0.smithi119.stdout:0/441: creat de/d49/fa4 x:0 0 0 2024-09-13T21:44:43.707 INFO:tasks.workunit.client.0.smithi119.stdout:5/347: dwrite d0/d3/d4/d9/d14/d24/d25/f7d [0,4194304] 0 2024-09-13T21:44:43.707 INFO:tasks.workunit.client.0.smithi119.stdout:2/446: dwrite d1/d22/d5a/d5d/d83/f73 [0,4194304] 0 2024-09-13T21:44:43.710 INFO:tasks.workunit.client.0.smithi119.stdout:5/348: write d0/d3/d1f/f5d [246196,24687] 0 2024-09-13T21:44:43.713 INFO:tasks.workunit.client.0.smithi119.stdout:0/442: mkdir de/d4e/da5 0 2024-09-13T21:44:43.722 INFO:tasks.workunit.client.0.smithi119.stdout:6/361: getdents dc/dd/d5e 0 2024-09-13T21:44:43.722 INFO:tasks.workunit.client.0.smithi119.stdout:0/443: dread de/d1c/d64/f73 [0,4194304] 0 2024-09-13T21:44:43.724 INFO:tasks.workunit.client.0.smithi119.stdout:4/471: creat d4/d1e/d26/d6d/f95 x:0 0 0 2024-09-13T21:44:43.726 INFO:tasks.workunit.client.0.smithi119.stdout:2/447: creat d1/d22/d5a/d5d/d77/f96 x:0 0 0 2024-09-13T21:44:43.727 INFO:tasks.workunit.client.0.smithi119.stdout:0/444: write de/d1c/d2f/d35/d4a/d62/f75 [8996220,96252] 0 2024-09-13T21:44:43.730 INFO:tasks.workunit.client.0.smithi119.stdout:1/370: dread d1/f1b [0,4194304] 0 2024-09-13T21:44:43.730 INFO:tasks.workunit.client.0.smithi119.stdout:6/362: rename dc/d3d/c51 to dc/df/d5c/c6e 0 2024-09-13T21:44:43.732 INFO:tasks.workunit.client.0.smithi119.stdout:8/442: dwrite f18 [0,4194304] 0 2024-09-13T21:44:43.733 INFO:tasks.workunit.client.0.smithi119.stdout:7/418: truncate d8/f31 3280665 0 2024-09-13T21:44:43.736 INFO:tasks.workunit.client.0.smithi119.stdout:4/472: rename d4/f40 to d4/f96 0 2024-09-13T21:44:43.736 INFO:tasks.workunit.client.0.smithi119.stdout:7/419: stat d8/d3c/d53/d37/d57/f5c 0 2024-09-13T21:44:43.738 INFO:tasks.workunit.client.0.smithi119.stdout:8/443: fsync d1b/d1d/f5f 0 2024-09-13T21:44:43.740 INFO:tasks.workunit.client.0.smithi119.stdout:1/371: mkdir d1/d3/d61/d77 0 2024-09-13T21:44:43.742 INFO:tasks.workunit.client.0.smithi119.stdout:6/363: creat dc/f6f x:0 0 0 2024-09-13T21:44:43.745 INFO:tasks.workunit.client.0.smithi119.stdout:5/349: dwrite d0/d3/d4/d9/d14/d24/f6e [0,4194304] 0 2024-09-13T21:44:43.746 INFO:tasks.workunit.client.0.smithi119.stdout:7/420: truncate d8/d19/d2e/d34/d42/f2d 697889 0 2024-09-13T21:44:43.746 INFO:tasks.workunit.client.0.smithi119.stdout:3/407: dwrite d6/d15/f21 [0,4194304] 0 2024-09-13T21:44:43.746 INFO:tasks.workunit.client.0.smithi119.stdout:8/444: symlink d1b/d1d/d26/d3e/l8e 0 2024-09-13T21:44:43.747 INFO:tasks.workunit.client.0.smithi119.stdout:1/372: chown d1/d3/dc/d11/f17 4239796 1 2024-09-13T21:44:43.751 INFO:tasks.workunit.client.0.smithi119.stdout:7/421: write f6 [9561317,37238] 0 2024-09-13T21:44:43.751 INFO:tasks.workunit.client.0.smithi119.stdout:3/408: chown d6/d15/d1a/d45/d47 70 1 2024-09-13T21:44:43.752 INFO:tasks.workunit.client.0.smithi119.stdout:5/350: fdatasync d0/d3/d4/d9/d14/d24/d25/d54/f5f 0 2024-09-13T21:44:43.753 INFO:tasks.workunit.client.0.smithi119.stdout:1/373: chown d1/d3/dc/d11/d19/c21 54018 1 2024-09-13T21:44:43.757 INFO:tasks.workunit.client.0.smithi119.stdout:3/409: unlink d6/d44/f6f 0 2024-09-13T21:44:43.761 INFO:tasks.workunit.client.0.smithi119.stdout:8/445: dread d1b/f36 [4194304,4194304] 0 2024-09-13T21:44:43.762 INFO:tasks.workunit.client.0.smithi119.stdout:6/364: dwrite dc/df/d41/f5d [0,4194304] 0 2024-09-13T21:44:43.762 INFO:tasks.workunit.client.0.smithi119.stdout:4/473: getdents d4 0 2024-09-13T21:44:43.762 INFO:tasks.workunit.client.0.smithi119.stdout:1/374: fdatasync d1/d3/f7 0 2024-09-13T21:44:43.766 INFO:tasks.workunit.client.0.smithi119.stdout:5/351: creat d0/d3/f80 x:0 0 0 2024-09-13T21:44:43.769 INFO:tasks.workunit.client.0.smithi119.stdout:3/410: mknod d6/d44/d52/d85/c8a 0 2024-09-13T21:44:43.770 INFO:tasks.workunit.client.0.smithi119.stdout:4/474: creat d4/d1e/d28/d34/d66/d76/f97 x:0 0 0 2024-09-13T21:44:43.771 INFO:tasks.workunit.client.0.smithi119.stdout:6/365: creat dc/d3d/d40/d6b/f70 x:0 0 0 2024-09-13T21:44:43.772 INFO:tasks.workunit.client.0.smithi119.stdout:7/422: link d8/d19/d2e/d34/d42/d47/l61 d8/d3c/l7f 0 2024-09-13T21:44:43.774 INFO:tasks.workunit.client.0.smithi119.stdout:8/446: dwrite d1b/d1d/d48/f78 [0,4194304] 0 2024-09-13T21:44:43.775 INFO:tasks.workunit.client.0.smithi119.stdout:5/352: write d0/d3/d4/d9/d14/d24/d25/f6f [649934,62329] 0 2024-09-13T21:44:43.775 INFO:tasks.workunit.client.0.smithi119.stdout:1/375: rename d1/d3/dc/d24/d2f/d31 to d1/d3/d61/d77/d78 0 2024-09-13T21:44:43.777 INFO:tasks.workunit.client.0.smithi119.stdout:7/423: chown d8/d19/d2e 1794766685 1 2024-09-13T21:44:43.781 INFO:tasks.workunit.client.0.smithi119.stdout:4/475: fsync d4/d1e/d28/d34/d66/f7b 0 2024-09-13T21:44:43.783 INFO:tasks.workunit.client.0.smithi119.stdout:3/411: dread d6/d15/d1a/d45/f67 [0,4194304] 0 2024-09-13T21:44:43.784 INFO:tasks.workunit.client.0.smithi119.stdout:4/476: stat d4/d1e/d26/d60/d69 0 2024-09-13T21:44:43.786 INFO:tasks.workunit.client.0.smithi119.stdout:5/353: link d0/d3/f15 d0/d3/d4/d2e/d65/f81 0 2024-09-13T21:44:43.787 INFO:tasks.workunit.client.0.smithi119.stdout:6/366: dwrite dc/d3d/d40/f69 [0,4194304] 0 2024-09-13T21:44:43.787 INFO:tasks.workunit.client.0.smithi119.stdout:8/447: rename d1b/d1d/d48/d58/f69 to d1b/d1d/f8f 0 2024-09-13T21:44:43.791 INFO:tasks.workunit.client.0.smithi119.stdout:5/354: creat d0/d3/d4/d9/d74/f82 x:0 0 0 2024-09-13T21:44:43.792 INFO:tasks.workunit.client.0.smithi119.stdout:3/412: dread d6/f1c [0,4194304] 0 2024-09-13T21:44:43.795 INFO:tasks.workunit.client.0.smithi119.stdout:6/367: dread dc/d3d/d40/f69 [0,4194304] 0 2024-09-13T21:44:43.796 INFO:tasks.workunit.client.0.smithi119.stdout:7/424: rename d8/d19/d2e/d34/d42/f4b to d8/d4d/f80 0 2024-09-13T21:44:43.797 INFO:tasks.workunit.client.0.smithi119.stdout:8/448: creat d1b/d1d/d48/f90 x:0 0 0 2024-09-13T21:44:43.798 INFO:tasks.workunit.client.0.smithi119.stdout:4/477: symlink d4/d1e/d26/l98 0 2024-09-13T21:44:43.801 INFO:tasks.workunit.client.0.smithi119.stdout:3/413: creat d6/d44/d52/d85/f8b x:0 0 0 2024-09-13T21:44:43.802 INFO:tasks.workunit.client.0.smithi119.stdout:1/376: write d1/d3/f2a [712886,48009] 0 2024-09-13T21:44:43.802 INFO:tasks.workunit.client.0.smithi119.stdout:3/414: chown d6/d15/d1a/d45/f5f 7432 1 2024-09-13T21:44:43.804 INFO:tasks.workunit.client.0.smithi119.stdout:7/425: rename d8/d19/d2e/f45 to d8/d19/d2e/f81 0 2024-09-13T21:44:43.808 INFO:tasks.workunit.client.0.smithi119.stdout:4/478: mkdir d4/d1e/d28/d34/d99 0 2024-09-13T21:44:43.809 INFO:tasks.workunit.client.0.smithi119.stdout:5/355: symlink d0/d3/d4/d9/d14/d24/l83 0 2024-09-13T21:44:43.809 INFO:tasks.workunit.client.0.smithi119.stdout:4/479: chown d4/d1e/d28/l4f 66554089 1 2024-09-13T21:44:43.811 INFO:tasks.workunit.client.0.smithi119.stdout:7/426: unlink d8/d19/f1f 0 2024-09-13T21:44:43.812 INFO:tasks.workunit.client.0.smithi119.stdout:8/449: mknod d1b/d1d/c91 0 2024-09-13T21:44:43.814 INFO:tasks.workunit.client.0.smithi119.stdout:8/450: chown d1b/d1d/d39/f63 361 1 2024-09-13T21:44:43.815 INFO:tasks.workunit.client.0.smithi119.stdout:7/427: fsync d8/f17 0 2024-09-13T21:44:43.816 INFO:tasks.workunit.client.0.smithi119.stdout:5/356: dread d0/d3/d4/f78 [0,4194304] 0 2024-09-13T21:44:43.816 INFO:tasks.workunit.client.0.smithi119.stdout:1/377: link d1/c75 d1/d3/d61/d77/d78/d32/d33/d72/c79 0 2024-09-13T21:44:43.818 INFO:tasks.workunit.client.0.smithi119.stdout:7/428: symlink d8/d3c/l82 0 2024-09-13T21:44:43.819 INFO:tasks.workunit.client.0.smithi119.stdout:1/378: fsync d1/f58 0 2024-09-13T21:44:43.821 INFO:tasks.workunit.client.0.smithi119.stdout:6/368: dread dc/d4b/f4a [0,4194304] 0 2024-09-13T21:44:43.822 INFO:tasks.workunit.client.0.smithi119.stdout:3/415: dread d6/f46 [0,4194304] 0 2024-09-13T21:44:43.823 INFO:tasks.workunit.client.0.smithi119.stdout:4/480: dread d4/f96 [0,4194304] 0 2024-09-13T21:44:43.824 INFO:tasks.workunit.client.0.smithi119.stdout:7/429: mkdir d8/d3c/d53/d37/d83 0 2024-09-13T21:44:43.825 INFO:tasks.workunit.client.0.smithi119.stdout:3/416: dread - d6/f6c zero size 2024-09-13T21:44:43.826 INFO:tasks.workunit.client.0.smithi119.stdout:1/379: mknod d1/d3/dc/d11/d19/c7a 0 2024-09-13T21:44:43.828 INFO:tasks.workunit.client.0.smithi119.stdout:8/451: dwrite d1b/d1d/d48/d58/f7a [0,4194304] 0 2024-09-13T21:44:43.834 INFO:tasks.workunit.client.0.smithi119.stdout:8/452: creat d1b/d1d/d26/d6b/f92 x:0 0 0 2024-09-13T21:44:43.835 INFO:tasks.workunit.client.0.smithi119.stdout:5/357: link d0/d3/l6a d0/d3/d4/d9/d1e/l84 0 2024-09-13T21:44:43.836 INFO:tasks.workunit.client.0.smithi119.stdout:6/369: link dc/df/f1c dc/d3d/d40/d68/f71 0 2024-09-13T21:44:43.838 INFO:tasks.workunit.client.0.smithi119.stdout:8/453: mknod d1b/d1d/d48/c93 0 2024-09-13T21:44:43.838 INFO:tasks.workunit.client.0.smithi119.stdout:4/481: chown d4/d1e/d26/d6d/d7c/c8c 0 1 2024-09-13T21:44:43.841 INFO:tasks.workunit.client.0.smithi119.stdout:6/370: creat dc/df/d41/f72 x:0 0 0 2024-09-13T21:44:43.842 INFO:tasks.workunit.client.0.smithi119.stdout:7/430: dwrite d8/d19/d2e/d34/d42/f32 [0,4194304] 0 2024-09-13T21:44:43.843 INFO:tasks.workunit.client.0.smithi119.stdout:7/431: chown d8/l43 20 1 2024-09-13T21:44:43.843 INFO:tasks.workunit.client.0.smithi119.stdout:4/482: creat d4/d1e/d28/d34/f9a x:0 0 0 2024-09-13T21:44:43.844 INFO:tasks.workunit.client.0.smithi119.stdout:8/454: creat d1b/d1d/d48/d54/f94 x:0 0 0 2024-09-13T21:44:43.845 INFO:tasks.workunit.client.0.smithi119.stdout:1/380: dread d1/f22 [0,4194304] 0 2024-09-13T21:44:43.845 INFO:tasks.workunit.client.0.smithi119.stdout:4/483: stat d4/d1e/d26/d6d/d7c 0 2024-09-13T21:44:43.846 INFO:tasks.workunit.client.0.smithi119.stdout:6/371: mknod dc/df/d41/c73 0 2024-09-13T21:44:43.847 INFO:tasks.workunit.client.0.smithi119.stdout:6/372: chown dc/d4b/l54 214060 1 2024-09-13T21:44:43.848 INFO:tasks.workunit.client.0.smithi119.stdout:4/484: read d4/f29 [10830,2727] 0 2024-09-13T21:44:43.851 INFO:tasks.workunit.client.0.smithi119.stdout:1/381: mknod d1/d3/d61/d77/d78/d32/d33/d43/c7b 0 2024-09-13T21:44:43.854 INFO:tasks.workunit.client.0.smithi119.stdout:6/373: creat dc/d3d/d4e/f74 x:0 0 0 2024-09-13T21:44:43.854 INFO:tasks.workunit.client.0.smithi119.stdout:5/358: dread d0/d3/d1f/f52 [0,4194304] 0 2024-09-13T21:44:43.854 INFO:tasks.workunit.client.0.smithi119.stdout:8/455: dread d1b/f36 [4194304,4194304] 0 2024-09-13T21:44:43.857 INFO:tasks.workunit.client.0.smithi119.stdout:8/456: stat d1b/d1d/d48/d58/f79 0 2024-09-13T21:44:43.857 INFO:tasks.workunit.client.0.smithi119.stdout:5/359: stat d0/d3/d4/d2e/d6b/l79 0 2024-09-13T21:44:43.858 INFO:tasks.workunit.client.0.smithi119.stdout:1/382: creat d1/d3/dc/d11/d19/d47/f7c x:0 0 0 2024-09-13T21:44:43.859 INFO:tasks.workunit.client.0.smithi119.stdout:7/432: dwrite d8/f21 [4194304,4194304] 0 2024-09-13T21:44:43.861 INFO:tasks.workunit.client.0.smithi119.stdout:1/383: fdatasync d1/d3/f2a 0 2024-09-13T21:44:43.862 INFO:tasks.workunit.client.0.smithi119.stdout:8/457: creat d1b/d1d/d48/d58/f95 x:0 0 0 2024-09-13T21:44:43.864 INFO:tasks.workunit.client.0.smithi119.stdout:5/360: creat d0/d3/d1f/d21/f85 x:0 0 0 2024-09-13T21:44:43.867 INFO:tasks.workunit.client.0.smithi119.stdout:7/433: write d8/d3c/d53/d37/d57/d5f/f66 [365162,21457] 0 2024-09-13T21:44:43.869 INFO:tasks.workunit.client.0.smithi119.stdout:4/485: dwrite d4/d1e/d26/d6d/f91 [0,4194304] 0 2024-09-13T21:44:43.869 INFO:tasks.workunit.client.0.smithi119.stdout:1/384: chown d1/d3/dc/d24/d2f/d53/c5a 99877 1 2024-09-13T21:44:43.873 INFO:tasks.workunit.client.0.smithi119.stdout:4/486: symlink d4/d1e/d10/l9b 0 2024-09-13T21:44:43.874 INFO:tasks.workunit.client.0.smithi119.stdout:1/385: creat d1/d3/dc/d11/d28/f7d x:0 0 0 2024-09-13T21:44:43.877 INFO:tasks.workunit.client.0.smithi119.stdout:7/434: getdents d8/d19/d2e/d34 0 2024-09-13T21:44:43.878 INFO:tasks.workunit.client.0.smithi119.stdout:8/458: write fd [1134589,14679] 0 2024-09-13T21:44:43.883 INFO:tasks.workunit.client.0.smithi119.stdout:8/459: creat d1b/d1d/d48/f96 x:0 0 0 2024-09-13T21:44:43.883 INFO:tasks.workunit.client.0.smithi119.stdout:4/487: dwrite d4/d1e/d26/d60/d71/d83/f68 [0,4194304] 0 2024-09-13T21:44:43.887 INFO:tasks.workunit.client.0.smithi119.stdout:7/435: dread d8/d3c/d53/d37/d57/f62 [0,4194304] 0 2024-09-13T21:44:43.890 INFO:tasks.workunit.client.0.smithi119.stdout:4/488: read d4/d1e/d28/d34/d66/d76/f7e [427563,14097] 0 2024-09-13T21:44:43.892 INFO:tasks.workunit.client.0.smithi119.stdout:5/361: dwrite d0/d3/f12 [0,4194304] 0 2024-09-13T21:44:43.895 INFO:tasks.workunit.client.0.smithi119.stdout:5/362: fdatasync d0/d3/d4/d9/f46 0 2024-09-13T21:44:43.895 INFO:tasks.workunit.client.0.smithi119.stdout:7/436: link d8/f17 d8/d19/f84 0 2024-09-13T21:44:43.901 INFO:tasks.workunit.client.0.smithi119.stdout:5/363: unlink d0/d3/d4/d2e/d65/f76 0 2024-09-13T21:44:43.902 INFO:tasks.workunit.client.0.smithi119.stdout:1/386: dread d1/d3/d61/d77/d78/d32/f3e [4194304,4194304] 0 2024-09-13T21:44:43.903 INFO:tasks.workunit.client.0.smithi119.stdout:7/437: rename d8/d19/d2e/d34/d42/l13 to d8/d19/d2e/d34/d6e/l85 0 2024-09-13T21:44:43.908 INFO:tasks.workunit.client.0.smithi119.stdout:7/438: dread d8/d19/d2e/d34/f3a [0,4194304] 0 2024-09-13T21:44:43.908 INFO:tasks.workunit.client.0.smithi119.stdout:1/387: read d1/d3/dc/d11/f17 [396227,36450] 0 2024-09-13T21:44:43.909 INFO:tasks.workunit.client.0.smithi119.stdout:1/388: readlink d1/d3/dc/d11/d19/d2d/d37/l6e 0 2024-09-13T21:44:43.910 INFO:tasks.workunit.client.0.smithi119.stdout:7/439: symlink d8/d3c/d53/d3b/d48/l86 0 2024-09-13T21:44:43.912 INFO:tasks.workunit.client.0.smithi119.stdout:7/440: truncate d8/d3c/d53/d3b/f54 1482498 0 2024-09-13T21:44:43.913 INFO:tasks.workunit.client.0.smithi119.stdout:7/441: creat d8/d3c/d46/f87 x:0 0 0 2024-09-13T21:44:43.916 INFO:tasks.workunit.client.0.smithi119.stdout:7/442: creat d8/d3c/d53/d37/d57/d5f/f88 x:0 0 0 2024-09-13T21:44:43.916 INFO:tasks.workunit.client.0.smithi119.stdout:8/460: dread d1b/f27 [0,4194304] 0 2024-09-13T21:44:43.919 INFO:tasks.workunit.client.0.smithi119.stdout:5/364: write d0/d3/d4/d2e/d65/f81 [2597282,26191] 0 2024-09-13T21:44:43.920 INFO:tasks.workunit.client.0.smithi119.stdout:1/389: write d1/d3/f2b [3521849,35737] 0 2024-09-13T21:44:43.921 INFO:tasks.workunit.client.1.smithi155.stdout:5/4: sync 2024-09-13T21:44:43.922 INFO:tasks.workunit.client.1.smithi155.stdout:5/5: chown . 1469 1 2024-09-13T21:44:43.922 INFO:tasks.workunit.client.0.smithi119.stdout:1/390: write d1/d3/d61/d77/d78/d32/f64 [299934,1324] 0 2024-09-13T21:44:43.923 INFO:tasks.workunit.client.0.smithi119.stdout:7/443: rename d8/d19/d2e/d34/d42 to d8/d3c/d53/d37/d83/d89 0 2024-09-13T21:44:43.923 INFO:tasks.workunit.client.0.smithi119.stdout:7/444: chown d8/lc 802 1 2024-09-13T21:44:43.924 INFO:tasks.workunit.client.1.smithi155.stdout:5/6: creat f0 x:0 0 0 2024-09-13T21:44:43.925 INFO:tasks.workunit.client.0.smithi119.stdout:5/365: readlink d0/d3/d4/d9/d14/d24/d25/l70 0 2024-09-13T21:44:43.925 INFO:tasks.workunit.client.1.smithi155.stdout:5/7: creat f1 x:0 0 0 2024-09-13T21:44:43.926 INFO:tasks.workunit.client.0.smithi119.stdout:7/445: mknod d8/d3c/d53/d37/d57/c8a 0 2024-09-13T21:44:43.926 INFO:tasks.workunit.client.1.smithi155.stdout:5/8: symlink l2 0 2024-09-13T21:44:43.927 INFO:tasks.workunit.client.1.smithi155.stdout:5/9: mknod c3 0 2024-09-13T21:44:43.928 INFO:tasks.workunit.client.0.smithi119.stdout:1/391: unlink d1/c75 0 2024-09-13T21:44:43.928 INFO:tasks.workunit.client.1.smithi155.stdout:5/10: unlink f1 0 2024-09-13T21:44:43.929 INFO:tasks.workunit.client.0.smithi119.stdout:5/366: rename d0/d3/d1f/d7e to d0/d3/d1f/d21/d4f/d86 0 2024-09-13T21:44:43.930 INFO:tasks.workunit.client.0.smithi119.stdout:7/446: unlink d8/f56 0 2024-09-13T21:44:43.931 INFO:tasks.workunit.client.0.smithi119.stdout:5/367: truncate d0/d3/d4/d9/d1e/f72 71992 0 2024-09-13T21:44:43.944 INFO:tasks.workunit.client.0.smithi119.stdout:1/392: dread d1/d3/d61/d77/d78/d32/f64 [0,4194304] 0 2024-09-13T21:44:43.964 INFO:tasks.workunit.client.1.smithi155.stdout:5/11: fsync f0 0 2024-09-13T21:44:43.966 INFO:tasks.workunit.client.1.smithi155.stdout:5/12: creat f4 x:0 0 0 2024-09-13T21:44:43.967 INFO:tasks.workunit.client.1.smithi155.stdout:5/13: mkdir d5 0 2024-09-13T21:44:43.973 INFO:tasks.workunit.client.1.smithi155.stdout:5/14: dwrite f0 [0,4194304] 0 2024-09-13T21:44:43.974 INFO:tasks.workunit.client.1.smithi155.stdout:5/15: write f0 [655661,23398] 0 2024-09-13T21:44:43.976 INFO:tasks.workunit.client.1.smithi155.stdout:5/16: creat d5/f6 x:0 0 0 2024-09-13T21:44:43.977 INFO:tasks.workunit.client.1.smithi155.stdout:5/17: creat d5/f7 x:0 0 0 2024-09-13T21:44:43.979 INFO:tasks.workunit.client.1.smithi155.stdout:5/18: link f0 d5/f8 0 2024-09-13T21:44:43.979 INFO:tasks.workunit.client.1.smithi155.stdout:5/19: stat c3 0 2024-09-13T21:44:43.980 INFO:tasks.workunit.client.1.smithi155.stdout:5/20: read - d5/f6 zero size 2024-09-13T21:44:43.980 INFO:tasks.workunit.client.1.smithi155.stdout:5/21: chown f0 23939 1 2024-09-13T21:44:43.987 INFO:tasks.workunit.client.1.smithi155.stdout:5/22: dwrite d5/f6 [0,4194304] 0 2024-09-13T21:44:43.989 INFO:tasks.workunit.client.1.smithi155.stdout:5/23: creat d5/f9 x:0 0 0 2024-09-13T21:44:43.990 INFO:tasks.workunit.client.1.smithi155.stdout:5/24: creat d5/fa x:0 0 0 2024-09-13T21:44:43.992 INFO:tasks.workunit.client.1.smithi155.stdout:5/25: creat d5/fb x:0 0 0 2024-09-13T21:44:43.993 INFO:tasks.workunit.client.1.smithi155.stdout:5/26: truncate d5/fa 735668 0 2024-09-13T21:44:43.995 INFO:tasks.workunit.client.1.smithi155.stdout:5/27: rename d5/fb to d5/fc 0 2024-09-13T21:44:43.996 INFO:tasks.workunit.client.1.smithi155.stdout:5/28: symlink d5/ld 0 2024-09-13T21:44:43.999 INFO:tasks.workunit.client.1.smithi155.stdout:5/29: link d5/f8 d5/fe 0 2024-09-13T21:44:44.001 INFO:tasks.workunit.client.1.smithi155.stdout:5/30: write d5/f8 [2895851,111445] 0 2024-09-13T21:44:44.003 INFO:tasks.workunit.client.1.smithi155.stdout:5/31: creat d5/ff x:0 0 0 2024-09-13T21:44:44.009 INFO:tasks.workunit.client.1.smithi155.stdout:5/32: dwrite d5/ff [0,4194304] 0 2024-09-13T21:44:44.012 INFO:tasks.workunit.client.1.smithi155.stdout:5/33: creat d5/f10 x:0 0 0 2024-09-13T21:44:44.018 INFO:tasks.workunit.client.1.smithi155.stdout:5/34: dwrite d5/f6 [4194304,4194304] 0 2024-09-13T21:44:44.019 INFO:tasks.workunit.client.1.smithi155.stdout:5/35: read - d5/f10 zero size 2024-09-13T21:44:44.020 INFO:tasks.workunit.client.1.smithi155.stdout:5/36: truncate d5/f9 838439 0 2024-09-13T21:44:44.020 INFO:tasks.workunit.client.1.smithi155.stdout:5/37: stat d5/f9 0 2024-09-13T21:44:44.021 INFO:tasks.workunit.client.1.smithi155.stdout:5/38: write d5/ff [596674,2294] 0 2024-09-13T21:44:44.022 INFO:tasks.workunit.client.1.smithi155.stdout:5/39: chown d5/f9 49690848 1 2024-09-13T21:44:44.025 INFO:tasks.workunit.client.1.smithi155.stdout:5/40: unlink d5/ld 0 2024-09-13T21:44:44.028 INFO:tasks.workunit.client.1.smithi155.stdout:5/41: rename f4 to d5/f11 0 2024-09-13T21:44:44.030 INFO:tasks.workunit.client.1.smithi155.stdout:5/42: dread d5/fa [0,4194304] 0 2024-09-13T21:44:44.031 INFO:tasks.workunit.client.1.smithi155.stdout:5/43: fsync d5/f8 0 2024-09-13T21:44:44.031 INFO:tasks.workunit.client.1.smithi155.stdout:5/44: fdatasync d5/f8 0 2024-09-13T21:44:44.036 INFO:tasks.workunit.client.1.smithi155.stdout:5/45: truncate f0 1210953 0 2024-09-13T21:44:44.041 INFO:tasks.workunit.client.1.smithi155.stdout:5/46: dwrite d5/f6 [4194304,4194304] 0 2024-09-13T21:44:44.043 INFO:tasks.workunit.client.1.smithi155.stdout:5/47: unlink l2 0 2024-09-13T21:44:44.046 INFO:tasks.workunit.client.1.smithi155.stdout:5/48: unlink d5/ff 0 2024-09-13T21:44:44.051 INFO:tasks.workunit.client.1.smithi155.stdout:5/49: rmdir d5 39 2024-09-13T21:44:44.057 INFO:tasks.workunit.client.1.smithi155.stdout:5/50: truncate d5/fe 403426 0 2024-09-13T21:44:44.067 INFO:tasks.workunit.client.1.smithi155.stdout:5/51: dwrite f0 [0,4194304] 0 2024-09-13T21:44:44.067 INFO:tasks.workunit.client.1.smithi155.stdout:5/52: chown d5/f8 590 1 2024-09-13T21:44:44.069 INFO:tasks.workunit.client.1.smithi155.stdout:5/53: mkdir d5/d12 0 2024-09-13T21:44:44.074 INFO:tasks.workunit.client.1.smithi155.stdout:5/54: dwrite f0 [0,4194304] 0 2024-09-13T21:44:44.076 INFO:tasks.workunit.client.1.smithi155.stdout:5/55: creat d5/f13 x:0 0 0 2024-09-13T21:44:44.077 INFO:tasks.workunit.client.1.smithi155.stdout:5/56: truncate d5/f13 399891 0 2024-09-13T21:44:44.079 INFO:tasks.workunit.client.1.smithi155.stdout:5/57: creat d5/d12/f14 x:0 0 0 2024-09-13T21:44:44.081 INFO:tasks.workunit.client.1.smithi155.stdout:5/58: mknod d5/d12/c15 0 2024-09-13T21:44:44.081 INFO:tasks.workunit.client.1.smithi155.stdout:5/59: dread - d5/f11 zero size 2024-09-13T21:44:44.082 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:43 smithi155 ceph-mon[34732]: pgmap v6: 65 pgs: 65 active+clean; 665 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 13 MiB/s rd, 43 MiB/s wr, 76 op/s 2024-09-13T21:44:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:43 smithi155 ceph-mon[34732]: Standby manager daemon smithi119.gwjxmq started 2024-09-13T21:44:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:43 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.119:0/19160960' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.gwjxmq/crt"}]: dispatch 2024-09-13T21:44:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:43 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.119:0/19160960' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:44:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:43 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.119:0/19160960' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.gwjxmq/key"}]: dispatch 2024-09-13T21:44:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:43 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.119:0/19160960' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:44:44.083 INFO:tasks.workunit.client.1.smithi155.stdout:5/60: mkdir d5/d16 0 2024-09-13T21:44:44.084 INFO:tasks.workunit.client.1.smithi155.stdout:5/61: write d5/f13 [1188787,8192] 0 2024-09-13T21:44:44.101 INFO:tasks.workunit.client.0.smithi119.stdout:5/368: truncate d0/d3/f1a 753480 0 2024-09-13T21:44:44.103 INFO:tasks.workunit.client.0.smithi119.stdout:5/369: creat d0/d3/d4/d9/f87 x:0 0 0 2024-09-13T21:44:44.109 INFO:tasks.workunit.client.0.smithi119.stdout:7/447: dread d8/d19/f84 [4194304,4194304] 0 2024-09-13T21:44:44.111 INFO:tasks.workunit.client.0.smithi119.stdout:7/448: rmdir d8/d4d 39 2024-09-13T21:44:44.114 INFO:tasks.workunit.client.0.smithi119.stdout:9/477: sync 2024-09-13T21:44:44.114 INFO:tasks.workunit.client.0.smithi119.stdout:5/370: dread d0/d3/d4/d2e/f32 [0,4194304] 0 2024-09-13T21:44:44.114 INFO:tasks.workunit.client.0.smithi119.stdout:7/449: symlink d8/d3c/d53/d37/d83/d89/d3d/l8b 0 2024-09-13T21:44:44.116 INFO:tasks.workunit.client.0.smithi119.stdout:7/450: chown d8/d4d/l5b 9215597 1 2024-09-13T21:44:44.117 INFO:tasks.workunit.client.0.smithi119.stdout:9/478: truncate d0/d8/d18/d23/d27/d2d/d6e/fa0 923318 0 2024-09-13T21:44:44.118 INFO:tasks.workunit.client.0.smithi119.stdout:7/451: symlink d8/d19/d2e/l8c 0 2024-09-13T21:44:44.121 INFO:tasks.workunit.client.0.smithi119.stdout:5/371: rename d0/d3/d4/d2e/f3d to d0/f88 0 2024-09-13T21:44:44.122 INFO:tasks.workunit.client.0.smithi119.stdout:5/372: truncate d0/d3/f80 853100 0 2024-09-13T21:44:44.123 INFO:tasks.workunit.client.0.smithi119.stdout:9/479: fsync d0/d4f/f64 0 2024-09-13T21:44:44.124 INFO:tasks.workunit.client.0.smithi119.stdout:9/480: readlink d0/d19/d1a/l4a 0 2024-09-13T21:44:44.129 INFO:tasks.workunit.client.0.smithi119.stdout:9/481: rename d0/d19/d1a/d2b/d60/f95 to d0/fa5 0 2024-09-13T21:44:44.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:43 smithi119 ceph-mon[27653]: pgmap v6: 65 pgs: 65 active+clean; 665 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 13 MiB/s rd, 43 MiB/s wr, 76 op/s 2024-09-13T21:44:44.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:43 smithi119 ceph-mon[27653]: Standby manager daemon smithi119.gwjxmq started 2024-09-13T21:44:44.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:43 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.119:0/19160960' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.gwjxmq/crt"}]: dispatch 2024-09-13T21:44:44.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:43 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.119:0/19160960' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:44:44.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:43 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.119:0/19160960' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.gwjxmq/key"}]: dispatch 2024-09-13T21:44:44.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:43 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.119:0/19160960' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:44:44.131 INFO:tasks.workunit.client.0.smithi119.stdout:5/373: truncate d0/d3/f12 713992 0 2024-09-13T21:44:44.132 INFO:tasks.workunit.client.0.smithi119.stdout:9/482: mknod d0/d8/d18/ca6 0 2024-09-13T21:44:44.133 INFO:tasks.workunit.client.0.smithi119.stdout:5/374: unlink d0/d3/d4/d2e/d65/f73 0 2024-09-13T21:44:44.135 INFO:tasks.workunit.client.0.smithi119.stdout:7/452: dwrite d8/d4d/f52 [0,4194304] 0 2024-09-13T21:44:44.135 INFO:tasks.workunit.client.0.smithi119.stdout:5/375: readlink d0/d3/d4/l3e 0 2024-09-13T21:44:44.137 INFO:tasks.workunit.client.0.smithi119.stdout:9/483: mknod d0/d8/d18/d23/d27/d2d/d5f/ca7 0 2024-09-13T21:44:44.137 INFO:tasks.workunit.client.0.smithi119.stdout:7/453: fdatasync d8/d3c/d53/d37/d83/d89/f2d 0 2024-09-13T21:44:44.139 INFO:tasks.workunit.client.0.smithi119.stdout:5/376: symlink d0/d3/d4/d9/d14/d24/d25/d54/l89 0 2024-09-13T21:44:44.141 INFO:tasks.workunit.client.0.smithi119.stdout:9/484: mkdir d0/d8/d18/d23/d27/d2d/d5f/da8 0 2024-09-13T21:44:44.145 INFO:tasks.workunit.client.0.smithi119.stdout:9/485: fsync d0/d8/d18/d23/d27/d2d/d6e/f9d 0 2024-09-13T21:44:44.145 INFO:tasks.workunit.client.0.smithi119.stdout:9/486: chown d0/d8/d18/d23/d27/d2d 929 1 2024-09-13T21:44:44.146 INFO:tasks.workunit.client.0.smithi119.stdout:5/377: mknod d0/d3/d4/d9/d14/d24/c8a 0 2024-09-13T21:44:44.149 INFO:tasks.workunit.client.0.smithi119.stdout:5/378: creat d0/d3/f8b x:0 0 0 2024-09-13T21:44:44.150 INFO:tasks.workunit.client.0.smithi119.stdout:7/454: truncate d8/d19/f35 151290 0 2024-09-13T21:44:44.151 INFO:tasks.workunit.client.0.smithi119.stdout:7/455: readlink d8/d19/d2e/d34/d6e/l85 0 2024-09-13T21:44:44.157 INFO:tasks.workunit.client.0.smithi119.stdout:5/379: write d0/d3/d4/d2e/f32 [3562048,10565] 0 2024-09-13T21:44:44.162 INFO:tasks.workunit.client.0.smithi119.stdout:7/456: dread d8/d19/f1a [0,4194304] 0 2024-09-13T21:44:44.164 INFO:tasks.workunit.client.0.smithi119.stdout:5/380: dwrite d0/d3/d4/d9/d74/f82 [0,4194304] 0 2024-09-13T21:44:44.167 INFO:tasks.workunit.client.0.smithi119.stdout:7/457: creat d8/d19/d2e/d34/d6e/f8d x:0 0 0 2024-09-13T21:44:44.169 INFO:tasks.workunit.client.0.smithi119.stdout:5/381: rename d0/d3/d1f/c6c to d0/d3/d4/c8c 0 2024-09-13T21:44:44.169 INFO:tasks.workunit.client.0.smithi119.stdout:7/458: mknod d8/d3c/d53/d3b/d7e/c8e 0 2024-09-13T21:44:44.170 INFO:tasks.workunit.client.0.smithi119.stdout:9/487: dread d0/d4f/f64 [0,4194304] 0 2024-09-13T21:44:44.170 INFO:tasks.workunit.client.0.smithi119.stdout:5/382: readlink d0/d3/l1b 0 2024-09-13T21:44:44.171 INFO:tasks.workunit.client.0.smithi119.stdout:7/459: mkdir d8/d3c/d53/d37/d57/d8f 0 2024-09-13T21:44:44.173 INFO:tasks.workunit.client.0.smithi119.stdout:5/383: truncate d0/d3/d4/d9/d14/d24/d25/d67/f69 1001953 0 2024-09-13T21:44:44.174 INFO:tasks.workunit.client.0.smithi119.stdout:9/488: rename d0/d8/d18/f5e to d0/d8/d18/d23/d27/d2d/d70/d80/fa9 0 2024-09-13T21:44:44.180 INFO:tasks.workunit.client.0.smithi119.stdout:5/384: getdents d0/d3/d1f/d21 0 2024-09-13T21:44:44.185 INFO:tasks.workunit.client.0.smithi119.stdout:7/460: write d8/d19/f35 [700691,126073] 0 2024-09-13T21:44:44.186 INFO:tasks.workunit.client.0.smithi119.stdout:5/385: truncate d0/d3/d4/d9/d14/d24/d25/f36 691502 0 2024-09-13T21:44:44.187 INFO:tasks.workunit.client.0.smithi119.stdout:5/386: dread d0/f88 [0,4194304] 0 2024-09-13T21:44:44.187 INFO:tasks.workunit.client.0.smithi119.stdout:7/461: mknod d8/c90 0 2024-09-13T21:44:44.189 INFO:tasks.workunit.client.0.smithi119.stdout:5/387: mknod d0/d3/d1f/d21/d4f/c8d 0 2024-09-13T21:44:44.190 INFO:tasks.workunit.client.0.smithi119.stdout:5/388: chown d0/d3/d1f/d21/d4f 82063494 1 2024-09-13T21:44:44.190 INFO:tasks.workunit.client.0.smithi119.stdout:5/389: fdatasync d0/d3/d4/d2e/f71 0 2024-09-13T21:44:44.192 INFO:tasks.workunit.client.0.smithi119.stdout:5/390: creat d0/d3/d4/d9/d74/f8e x:0 0 0 2024-09-13T21:44:44.194 INFO:tasks.workunit.client.0.smithi119.stdout:7/462: dread d8/d19/d2e/f7c [0,4194304] 0 2024-09-13T21:44:44.195 INFO:tasks.workunit.client.0.smithi119.stdout:5/391: symlink d0/d3/d4/d9/d14/d24/d25/d67/l8f 0 2024-09-13T21:44:44.196 INFO:tasks.workunit.client.0.smithi119.stdout:7/463: write d8/d3c/d53/d37/d57/d5f/f88 [222372,61449] 0 2024-09-13T21:44:44.197 INFO:tasks.workunit.client.0.smithi119.stdout:5/392: symlink d0/d3/d4/d9/l90 0 2024-09-13T21:44:44.199 INFO:tasks.workunit.client.0.smithi119.stdout:7/464: symlink d8/d3c/d46/l91 0 2024-09-13T21:44:44.199 INFO:tasks.workunit.client.0.smithi119.stdout:9/489: dread d0/d8/d18/d23/d42/d52/f65 [0,4194304] 0 2024-09-13T21:44:44.202 INFO:tasks.workunit.client.0.smithi119.stdout:7/465: rename d8/l43 to d8/d4d/l92 0 2024-09-13T21:44:44.203 INFO:tasks.workunit.client.0.smithi119.stdout:7/466: fdatasync d8/d3c/d53/d37/d57/f6c 0 2024-09-13T21:44:44.204 INFO:tasks.workunit.client.0.smithi119.stdout:5/393: dwrite d0/d3/d4/d9/d14/f29 [8388608,4194304] 0 2024-09-13T21:44:44.204 INFO:tasks.workunit.client.0.smithi119.stdout:9/490: mkdir d0/d8/d18/d23/d27/d2d/d70/d80/daa 0 2024-09-13T21:44:44.205 INFO:tasks.workunit.client.0.smithi119.stdout:7/467: chown d8/d3c/f51 52872273 1 2024-09-13T21:44:44.206 INFO:tasks.workunit.client.0.smithi119.stdout:7/468: stat d8/d3c/d53/d3b/d48/c50 0 2024-09-13T21:44:44.216 INFO:tasks.workunit.client.0.smithi119.stdout:7/469: dwrite d8/d3c/d53/d37/d83/d89/f2d [0,4194304] 0 2024-09-13T21:44:44.223 INFO:tasks.workunit.client.0.smithi119.stdout:5/394: dwrite d0/d3/f1a [0,4194304] 0 2024-09-13T21:44:44.239 INFO:tasks.workunit.client.0.smithi119.stdout:9/491: dread d0/d8/d18/d23/d27/d2d/d6e/f7d [0,4194304] 0 2024-09-13T21:44:44.239 INFO:tasks.workunit.client.0.smithi119.stdout:9/492: stat d0/d19/d1a/l4a 0 2024-09-13T21:44:44.239 INFO:tasks.workunit.client.0.smithi119.stdout:9/493: fsync d0/f7 0 2024-09-13T21:44:44.241 INFO:tasks.workunit.client.0.smithi119.stdout:9/494: creat d0/d79/da4/fab x:0 0 0 2024-09-13T21:44:44.243 INFO:tasks.workunit.client.0.smithi119.stdout:9/495: symlink d0/d8/d18/d23/d27/d2d/d70/lac 0 2024-09-13T21:44:44.244 INFO:tasks.workunit.client.0.smithi119.stdout:9/496: chown d0/d8/d18/d23/d27/d2d/d5f/d74/f93 214 1 2024-09-13T21:44:44.249 INFO:tasks.workunit.client.0.smithi119.stdout:9/497: dwrite d0/d8/d18/d23/d42/d52/f8b [0,4194304] 0 2024-09-13T21:44:44.252 INFO:tasks.workunit.client.0.smithi119.stdout:9/498: mkdir d0/d8/d18/dad 0 2024-09-13T21:44:44.254 INFO:tasks.workunit.client.0.smithi119.stdout:9/499: mknod d0/d8/d18/d23/d27/d2d/cae 0 2024-09-13T21:44:44.303 INFO:tasks.workunit.client.0.smithi119.stdout:9/500: truncate d0/d19/d1a/f1f 7214430 0 2024-09-13T21:44:44.306 INFO:tasks.workunit.client.0.smithi119.stdout:9/501: chown d0/d8/d18/d23/d27/d2d/d5f/ca7 179 1 2024-09-13T21:44:44.352 INFO:tasks.workunit.client.0.smithi119.stdout:9/502: write d0/d19/f46 [1746892,58687] 0 2024-09-13T21:44:44.354 INFO:tasks.workunit.client.0.smithi119.stdout:9/503: write d0/d8/d18/d23/d42/d52/f8b [3589203,122832] 0 2024-09-13T21:44:44.355 INFO:tasks.workunit.client.0.smithi119.stdout:9/504: write d0/d8/d18/d23/d27/f2a [4013707,97167] 0 2024-09-13T21:44:44.358 INFO:tasks.workunit.client.0.smithi119.stdout:9/505: symlink d0/d8/laf 0 2024-09-13T21:44:44.359 INFO:tasks.workunit.client.0.smithi119.stdout:9/506: write d0/d79/da4/fab [656186,92024] 0 2024-09-13T21:44:44.361 INFO:tasks.workunit.client.0.smithi119.stdout:9/507: truncate d0/d4f/d56/fa2 3805122 0 2024-09-13T21:44:44.364 INFO:tasks.workunit.client.0.smithi119.stdout:9/508: creat d0/d8/d18/d23/d27/d2d/d70/d80/d81/fb0 x:0 0 0 2024-09-13T21:44:44.369 INFO:tasks.workunit.client.0.smithi119.stdout:9/509: dwrite d0/d8/d18/d23/f29 [0,4194304] 0 2024-09-13T21:44:44.372 INFO:tasks.workunit.client.0.smithi119.stdout:9/510: mknod d0/d8/cb1 0 2024-09-13T21:44:44.378 INFO:tasks.workunit.client.0.smithi119.stdout:9/511: dwrite d0/d8/d18/d23/d27/d2d/d5f/d74/f7f [0,4194304] 0 2024-09-13T21:44:44.378 INFO:tasks.workunit.client.0.smithi119.stdout:9/512: stat d0/d4f/d73 0 2024-09-13T21:44:44.385 INFO:tasks.workunit.client.0.smithi119.stdout:9/513: link d0/d8/d18/d23/d27/d2d/c85 d0/d19/d1a/d92/cb2 0 2024-09-13T21:44:44.386 INFO:tasks.workunit.client.0.smithi119.stdout:9/514: write d0/d8/d18/d23/d27/f32 [5261295,98469] 0 2024-09-13T21:44:44.389 INFO:tasks.workunit.client.0.smithi119.stdout:9/515: mkdir d0/d8/d18/d23/d27/d2d/d70/d80/daa/db3 0 2024-09-13T21:44:44.390 INFO:tasks.workunit.client.0.smithi119.stdout:9/516: write d0/d19/d1a/d2b/f91 [694957,99380] 0 2024-09-13T21:44:44.391 INFO:tasks.workunit.client.0.smithi119.stdout:9/517: rmdir d0/d4f/d56 39 2024-09-13T21:44:44.393 INFO:tasks.workunit.client.0.smithi119.stdout:9/518: rmdir d0/d8/d18/d23/d27/d2d/d5f/d74 39 2024-09-13T21:44:44.395 INFO:tasks.workunit.client.0.smithi119.stdout:4/489: sync 2024-09-13T21:44:44.395 INFO:tasks.workunit.client.0.smithi119.stdout:6/374: sync 2024-09-13T21:44:44.395 INFO:tasks.workunit.client.0.smithi119.stdout:8/461: sync 2024-09-13T21:44:44.395 INFO:tasks.workunit.client.0.smithi119.stdout:3/417: sync 2024-09-13T21:44:44.396 INFO:tasks.workunit.client.0.smithi119.stdout:0/445: sync 2024-09-13T21:44:44.396 INFO:tasks.workunit.client.0.smithi119.stdout:1/393: sync 2024-09-13T21:44:44.396 INFO:tasks.workunit.client.0.smithi119.stdout:2/448: sync 2024-09-13T21:44:44.397 INFO:tasks.workunit.client.0.smithi119.stdout:2/449: dread - d1/d22/d5a/d5d/f8e zero size 2024-09-13T21:44:44.397 INFO:tasks.workunit.client.0.smithi119.stdout:3/418: write d6/d15/f63 [624386,108169] 0 2024-09-13T21:44:44.398 INFO:tasks.workunit.client.0.smithi119.stdout:4/490: write d4/d1e/d26/f2d [1729357,90151] 0 2024-09-13T21:44:44.398 INFO:tasks.workunit.client.0.smithi119.stdout:6/375: write dc/df/d5c/f5f [392434,26631] 0 2024-09-13T21:44:44.399 INFO:tasks.workunit.client.0.smithi119.stdout:9/519: mknod d0/d8/d18/d23/d27/d2d/d5f/d74/cb4 0 2024-09-13T21:44:44.401 INFO:tasks.workunit.client.0.smithi119.stdout:0/446: creat de/d1c/d2f/d35/d4a/d62/fa6 x:0 0 0 2024-09-13T21:44:44.401 INFO:tasks.workunit.client.0.smithi119.stdout:8/462: symlink d1b/d4e/d71/l97 0 2024-09-13T21:44:44.402 INFO:tasks.workunit.client.0.smithi119.stdout:3/419: read - d6/d25/d2f/d33/d56/f7a zero size 2024-09-13T21:44:44.403 INFO:tasks.workunit.client.0.smithi119.stdout:1/394: rename d1/d3/dc/d24/d2f to d1/d3/d61/d7e 0 2024-09-13T21:44:44.404 INFO:tasks.workunit.client.0.smithi119.stdout:4/491: truncate d4/d1e/d28/d34/d66/f7b 327110 0 2024-09-13T21:44:44.405 INFO:tasks.workunit.client.0.smithi119.stdout:9/520: unlink d0/d8/d18/l48 0 2024-09-13T21:44:44.406 INFO:tasks.workunit.client.0.smithi119.stdout:8/463: creat d1b/d4e/d71/f98 x:0 0 0 2024-09-13T21:44:44.407 INFO:tasks.workunit.client.0.smithi119.stdout:6/376: mkdir dc/d4b/d6a/d75 0 2024-09-13T21:44:44.408 INFO:tasks.workunit.client.0.smithi119.stdout:1/395: creat d1/d3/dc/d11/d19/d2d/d37/f7f x:0 0 0 2024-09-13T21:44:44.411 INFO:tasks.workunit.client.0.smithi119.stdout:6/377: write dc/dd/f47 [7840833,8302] 0 2024-09-13T21:44:44.412 INFO:tasks.workunit.client.0.smithi119.stdout:8/464: mkdir d1b/d4e/d99 0 2024-09-13T21:44:44.414 INFO:tasks.workunit.client.0.smithi119.stdout:3/420: dread d6/d15/f21 [0,4194304] 0 2024-09-13T21:44:44.414 INFO:tasks.workunit.client.0.smithi119.stdout:0/447: getdents de/d1c/d2f/d35/d4a 0 2024-09-13T21:44:44.418 INFO:tasks.workunit.client.0.smithi119.stdout:3/421: readlink d6/d15/d1a/d45/d47/l4b 0 2024-09-13T21:44:44.420 INFO:tasks.workunit.client.0.smithi119.stdout:9/521: dwrite d0/f14 [8388608,4194304] 0 2024-09-13T21:44:44.420 INFO:tasks.workunit.client.0.smithi119.stdout:6/378: creat dc/d3d/d4e/f76 x:0 0 0 2024-09-13T21:44:44.423 INFO:tasks.workunit.client.0.smithi119.stdout:2/450: dread d1/d7/f20 [0,4194304] 0 2024-09-13T21:44:44.424 INFO:tasks.workunit.client.0.smithi119.stdout:6/379: readlink dc/l39 0 2024-09-13T21:44:44.424 INFO:tasks.workunit.client.0.smithi119.stdout:3/422: symlink d6/d15/l8c 0 2024-09-13T21:44:44.426 INFO:tasks.workunit.client.0.smithi119.stdout:1/396: write d1/d3/dc/d11/d19/d2d/f44 [588630,85595] 0 2024-09-13T21:44:44.428 INFO:tasks.workunit.client.0.smithi119.stdout:6/380: chown dc/f31 55454323 1 2024-09-13T21:44:44.429 INFO:tasks.workunit.client.0.smithi119.stdout:4/492: dread d4/d1e/d28/f2a [0,4194304] 0 2024-09-13T21:44:44.430 INFO:tasks.workunit.client.0.smithi119.stdout:3/423: mkdir d6/d15/d1a/d45/d8d 0 2024-09-13T21:44:44.433 INFO:tasks.workunit.client.0.smithi119.stdout:0/448: dwrite de/d1c/d2b/d34/f3a [4194304,4194304] 0 2024-09-13T21:44:44.433 INFO:tasks.workunit.client.0.smithi119.stdout:6/381: chown dc/df/d32/f6c 232916 1 2024-09-13T21:44:44.433 INFO:tasks.workunit.client.0.smithi119.stdout:1/397: symlink d1/d3/d61/d77/d78/l80 0 2024-09-13T21:44:44.435 INFO:tasks.workunit.client.0.smithi119.stdout:3/424: mkdir d6/d25/d2f/d8e 0 2024-09-13T21:44:44.436 INFO:tasks.workunit.client.0.smithi119.stdout:9/522: dread d0/d19/f46 [0,4194304] 0 2024-09-13T21:44:44.437 INFO:tasks.workunit.client.0.smithi119.stdout:0/449: truncate de/d1c/d64/f8a 190208 0 2024-09-13T21:44:44.438 INFO:tasks.workunit.client.0.smithi119.stdout:6/382: creat dc/df/d64/f77 x:0 0 0 2024-09-13T21:44:44.439 INFO:tasks.workunit.client.0.smithi119.stdout:1/398: symlink d1/d3/dc/d11/d3d/l81 0 2024-09-13T21:44:44.441 INFO:tasks.workunit.client.0.smithi119.stdout:2/451: dread d1/d7/f23 [0,4194304] 0 2024-09-13T21:44:44.441 INFO:tasks.workunit.client.0.smithi119.stdout:6/383: stat dc/d4b/f4a 0 2024-09-13T21:44:44.441 INFO:tasks.workunit.client.0.smithi119.stdout:3/425: rmdir d6/d15/d1a/d45/d47 39 2024-09-13T21:44:44.443 INFO:tasks.workunit.client.0.smithi119.stdout:9/523: write d0/d19/f46 [217418,115183] 0 2024-09-13T21:44:44.444 INFO:tasks.workunit.client.0.smithi119.stdout:1/399: read d1/d3/dc/d11/d28/f3f [1423126,36828] 0 2024-09-13T21:44:44.449 INFO:tasks.workunit.client.0.smithi119.stdout:8/465: dread f5 [0,4194304] 0 2024-09-13T21:44:44.451 INFO:tasks.workunit.client.0.smithi119.stdout:9/524: read d0/d19/f9a [45126,121501] 0 2024-09-13T21:44:44.451 INFO:tasks.workunit.client.0.smithi119.stdout:1/400: write d1/d3/dc/d11/d19/d2d/d37/f7f [563394,76898] 0 2024-09-13T21:44:44.452 INFO:tasks.workunit.client.0.smithi119.stdout:7/470: sync 2024-09-13T21:44:44.452 INFO:tasks.workunit.client.0.smithi119.stdout:5/395: sync 2024-09-13T21:44:44.453 INFO:tasks.workunit.client.0.smithi119.stdout:2/452: getdents d1 0 2024-09-13T21:44:44.454 INFO:tasks.workunit.client.0.smithi119.stdout:3/426: getdents d6/d15/d1a/d45 0 2024-09-13T21:44:44.455 INFO:tasks.workunit.client.0.smithi119.stdout:6/384: dwrite dc/d3d/d4e/f53 [0,4194304] 0 2024-09-13T21:44:44.456 INFO:tasks.workunit.client.0.smithi119.stdout:8/466: symlink d1b/d1d/d48/d58/l9a 0 2024-09-13T21:44:44.458 INFO:tasks.workunit.client.0.smithi119.stdout:7/471: fsync d8/d19/d2e/d34/f5d 0 2024-09-13T21:44:44.459 INFO:tasks.workunit.client.0.smithi119.stdout:3/427: chown d6/d44/f51 1 1 2024-09-13T21:44:44.459 INFO:tasks.workunit.client.0.smithi119.stdout:0/450: dwrite de/d1c/d2f/f6c [0,4194304] 0 2024-09-13T21:44:44.460 INFO:tasks.workunit.client.0.smithi119.stdout:2/453: unlink d1/d22/d55/d31/f53 0 2024-09-13T21:44:44.461 INFO:tasks.workunit.client.0.smithi119.stdout:8/467: read d1b/d4e/f53 [2662308,77113] 0 2024-09-13T21:44:44.461 INFO:tasks.workunit.client.0.smithi119.stdout:5/396: creat d0/d3/d4/d9/d1e/f91 x:0 0 0 2024-09-13T21:44:44.461 INFO:tasks.workunit.client.0.smithi119.stdout:1/401: fdatasync d1/d3/dc/d11/d19/d2d/d37/f7f 0 2024-09-13T21:44:44.462 INFO:tasks.workunit.client.0.smithi119.stdout:6/385: mknod dc/dd/c78 0 2024-09-13T21:44:44.465 INFO:tasks.workunit.client.0.smithi119.stdout:2/454: mkdir d1/d97 0 2024-09-13T21:44:44.466 INFO:tasks.workunit.client.0.smithi119.stdout:7/472: mknod d8/d3c/d53/c93 0 2024-09-13T21:44:44.467 INFO:tasks.workunit.client.0.smithi119.stdout:3/428: write d6/d15/d1a/d45/f67 [6700,88465] 0 2024-09-13T21:44:44.470 INFO:tasks.workunit.client.0.smithi119.stdout:8/468: creat d1b/d1d/d26/d3e/d65/f9b x:0 0 0 2024-09-13T21:44:44.471 INFO:tasks.workunit.client.0.smithi119.stdout:5/397: symlink d0/d3/d4/d9/d74/l92 0 2024-09-13T21:44:44.472 INFO:tasks.workunit.client.1.smithi155.stdout:6/6: sync 2024-09-13T21:44:44.474 INFO:tasks.workunit.client.1.smithi155.stdout:6/7: creat f1 x:0 0 0 2024-09-13T21:44:44.475 INFO:tasks.workunit.client.0.smithi119.stdout:8/469: creat d1b/d1d/d39/f9c x:0 0 0 2024-09-13T21:44:44.475 INFO:tasks.workunit.client.0.smithi119.stdout:6/386: truncate dc/df/f1c 4023502 0 2024-09-13T21:44:44.476 INFO:tasks.workunit.client.0.smithi119.stdout:1/402: mknod d1/d3/d61/d77/d78/d32/d33/d43/d74/c82 0 2024-09-13T21:44:44.477 INFO:tasks.workunit.client.1.smithi155.stdout:8/7: sync 2024-09-13T21:44:44.477 INFO:tasks.workunit.client.0.smithi119.stdout:5/398: symlink d0/d3/d1f/d21/d4f/l93 0 2024-09-13T21:44:44.480 INFO:tasks.workunit.client.1.smithi155.stdout:8/8: creat d2/f3 x:0 0 0 2024-09-13T21:44:44.480 INFO:tasks.workunit.client.1.smithi155.stdout:6/8: dwrite f1 [0,4194304] 0 2024-09-13T21:44:44.480 INFO:tasks.workunit.client.1.smithi155.stdout:6/9: readlink - no filename 2024-09-13T21:44:44.480 INFO:tasks.workunit.client.1.smithi155.stdout:6/10: chown f0 11358913 1 2024-09-13T21:44:44.481 INFO:tasks.workunit.client.1.smithi155.stdout:8/9: truncate d2/f3 32735 0 2024-09-13T21:44:44.481 INFO:tasks.workunit.client.0.smithi119.stdout:1/403: truncate d1/d3/f2a 1039240 0 2024-09-13T21:44:44.481 INFO:tasks.workunit.client.0.smithi119.stdout:8/470: read d1b/f1f [1870840,62237] 0 2024-09-13T21:44:44.482 INFO:tasks.workunit.client.1.smithi155.stdout:8/10: chown l1 1 1 2024-09-13T21:44:44.483 INFO:tasks.workunit.client.1.smithi155.stdout:6/11: mknod c2 0 2024-09-13T21:44:44.483 INFO:tasks.workunit.client.0.smithi119.stdout:8/471: chown d1b/d1d/d48/d58/l59 15313 1 2024-09-13T21:44:44.483 INFO:tasks.workunit.client.0.smithi119.stdout:5/399: rename d0/d3/d1f/d21/c28 to d0/d3/d1f/d21/d4f/c94 0 2024-09-13T21:44:44.484 INFO:tasks.workunit.client.1.smithi155.stdout:8/11: mknod d2/c4 0 2024-09-13T21:44:44.484 INFO:tasks.workunit.client.1.smithi155.stdout:6/12: write f1 [2752732,128904] 0 2024-09-13T21:44:44.485 INFO:tasks.workunit.client.1.smithi155.stdout:6/13: fsync f0 0 2024-09-13T21:44:44.485 INFO:tasks.workunit.client.1.smithi155.stdout:8/12: truncate d2/f3 718481 0 2024-09-13T21:44:44.485 INFO:tasks.workunit.client.0.smithi119.stdout:1/404: creat d1/d3/d61/d7e/d53/f83 x:0 0 0 2024-09-13T21:44:44.486 INFO:tasks.workunit.client.1.smithi155.stdout:6/14: stat f1 0 2024-09-13T21:44:44.487 INFO:tasks.workunit.client.1.smithi155.stdout:6/15: read f1 [2412157,129170] 0 2024-09-13T21:44:44.488 INFO:tasks.workunit.client.0.smithi119.stdout:2/455: stat d1/d22/d5a/d5d/d83/f79 0 2024-09-13T21:44:44.488 INFO:tasks.workunit.client.0.smithi119.stdout:0/451: dread de/f77 [0,4194304] 0 2024-09-13T21:44:44.489 INFO:tasks.workunit.client.0.smithi119.stdout:5/400: mknod d0/d3/d4/d9/d14/d24/c95 0 2024-09-13T21:44:44.492 INFO:tasks.workunit.client.0.smithi119.stdout:2/456: write d1/d22/d5a/d5d/d77/f96 [1043952,24851] 0 2024-09-13T21:44:44.497 INFO:tasks.workunit.client.1.smithi155.stdout:8/13: dwrite d2/f3 [0,4194304] 0 2024-09-13T21:44:44.497 INFO:tasks.workunit.client.0.smithi119.stdout:5/401: truncate d0/d3/f8b 46910 0 2024-09-13T21:44:44.498 INFO:tasks.workunit.client.1.smithi155.stdout:6/16: dwrite f0 [0,4194304] 0 2024-09-13T21:44:44.501 INFO:tasks.workunit.client.0.smithi119.stdout:7/473: dwrite d8/d19/d2e/f7c [0,4194304] 0 2024-09-13T21:44:44.503 INFO:tasks.workunit.client.1.smithi155.stdout:6/17: rename f1 to f3 0 2024-09-13T21:44:44.504 INFO:tasks.workunit.client.0.smithi119.stdout:2/457: dread d1/d22/f5f [0,4194304] 0 2024-09-13T21:44:44.505 INFO:tasks.workunit.client.1.smithi155.stdout:6/18: write f0 [2892649,9593] 0 2024-09-13T21:44:44.506 INFO:tasks.workunit.client.0.smithi119.stdout:5/402: write d0/d3/d4/d2e/d65/f81 [2316533,52596] 0 2024-09-13T21:44:44.507 INFO:tasks.workunit.client.0.smithi119.stdout:6/387: dwrite dc/dd/f20 [4194304,4194304] 0 2024-09-13T21:44:44.509 INFO:tasks.workunit.client.1.smithi155.stdout:8/14: dwrite d2/f3 [0,4194304] 0 2024-09-13T21:44:44.511 INFO:tasks.workunit.client.0.smithi119.stdout:0/452: dwrite de/d1c/d2b/f2c [0,4194304] 0 2024-09-13T21:44:44.516 INFO:tasks.workunit.client.1.smithi155.stdout:8/15: creat d2/f5 x:0 0 0 2024-09-13T21:44:44.517 INFO:tasks.workunit.client.1.smithi155.stdout:2/18: sync 2024-09-13T21:44:44.517 INFO:tasks.workunit.client.1.smithi155.stdout:9/8: sync 2024-09-13T21:44:44.518 INFO:tasks.workunit.client.1.smithi155.stdout:8/16: unlink d2/f3 0 2024-09-13T21:44:44.518 INFO:tasks.workunit.client.1.smithi155.stdout:2/19: fdatasync f1 0 2024-09-13T21:44:44.519 INFO:tasks.workunit.client.0.smithi119.stdout:8/472: dread d1b/d4e/f53 [0,4194304] 0 2024-09-13T21:44:44.519 INFO:tasks.workunit.client.0.smithi119.stdout:7/474: dread d8/d3c/d53/d37/f6f [0,4194304] 0 2024-09-13T21:44:44.519 INFO:tasks.workunit.client.0.smithi119.stdout:0/453: mknod de/d4e/d7f/ca7 0 2024-09-13T21:44:44.519 INFO:tasks.workunit.client.0.smithi119.stdout:7/475: write d8/d3c/d53/d37/d57/d5f/f67 [5152598,128829] 0 2024-09-13T21:44:44.520 INFO:tasks.workunit.client.1.smithi155.stdout:8/17: fdatasync d2/f5 0 2024-09-13T21:44:44.520 INFO:tasks.workunit.client.1.smithi155.stdout:2/20: stat f1 0 2024-09-13T21:44:44.520 INFO:tasks.workunit.client.1.smithi155.stdout:8/18: stat d2 0 2024-09-13T21:44:44.522 INFO:tasks.workunit.client.1.smithi155.stdout:8/19: write d2/f5 [262784,113009] 0 2024-09-13T21:44:44.522 INFO:tasks.workunit.client.1.smithi155.stdout:9/9: chown c4 2 1 2024-09-13T21:44:44.522 INFO:tasks.workunit.client.1.smithi155.stdout:9/10: fdatasync - no filename 2024-09-13T21:44:44.525 INFO:tasks.workunit.client.1.smithi155.stdout:9/11: rename c4 to c5 0 2024-09-13T21:44:44.525 INFO:tasks.workunit.client.1.smithi155.stdout:9/12: read - no filename 2024-09-13T21:44:44.525 INFO:tasks.workunit.client.0.smithi119.stdout:3/429: dread d6/d25/f2a [0,4194304] 0 2024-09-13T21:44:44.527 INFO:tasks.workunit.client.0.smithi119.stdout:0/454: dwrite de/d1c/d2b/d76/f93 [0,4194304] 0 2024-09-13T21:44:44.527 INFO:tasks.workunit.client.0.smithi119.stdout:5/403: rename d0/lb to d0/d3/d4/d2e/d65/l96 0 2024-09-13T21:44:44.527 INFO:tasks.workunit.client.1.smithi155.stdout:8/20: mkdir d2/d6 0 2024-09-13T21:44:44.528 INFO:tasks.workunit.client.0.smithi119.stdout:8/473: unlink d1b/d1d/d48/d54/f68 0 2024-09-13T21:44:44.528 INFO:tasks.workunit.client.0.smithi119.stdout:2/458: getdents d1/d38 0 2024-09-13T21:44:44.529 INFO:tasks.workunit.client.0.smithi119.stdout:6/388: link dc/d3d/d4e/f57 dc/d4b/f79 0 2024-09-13T21:44:44.530 INFO:tasks.workunit.client.1.smithi155.stdout:9/13: mknod c6 0 2024-09-13T21:44:44.530 INFO:tasks.workunit.client.0.smithi119.stdout:8/474: dread - d1b/d1d/d48/f90 zero size 2024-09-13T21:44:44.531 INFO:tasks.workunit.client.1.smithi155.stdout:8/21: chown d2/c4 7 1 2024-09-13T21:44:44.535 INFO:tasks.workunit.client.0.smithi119.stdout:0/455: unlink de/d1c/d2f/d40/f81 0 2024-09-13T21:44:44.535 INFO:tasks.workunit.client.1.smithi155.stdout:9/14: mknod c7 0 2024-09-13T21:44:44.536 INFO:tasks.workunit.client.1.smithi155.stdout:9/15: rmdir - no directory 2024-09-13T21:44:44.537 INFO:tasks.workunit.client.0.smithi119.stdout:6/389: mkdir dc/dd/d5e/d7a 0 2024-09-13T21:44:44.537 INFO:tasks.workunit.client.0.smithi119.stdout:3/430: mkdir d6/d15/d8f 0 2024-09-13T21:44:44.538 INFO:tasks.workunit.client.1.smithi155.stdout:8/22: mknod d2/c7 0 2024-09-13T21:44:44.538 INFO:tasks.workunit.client.1.smithi155.stdout:8/23: stat d2/c7 0 2024-09-13T21:44:44.538 INFO:tasks.workunit.client.0.smithi119.stdout:5/404: mkdir d0/d3/d4/d2e/d97 0 2024-09-13T21:44:44.539 INFO:tasks.workunit.client.0.smithi119.stdout:3/431: chown d6/d25/d74 81280 1 2024-09-13T21:44:44.539 INFO:tasks.workunit.client.1.smithi155.stdout:9/16: symlink l8 0 2024-09-13T21:44:44.539 INFO:tasks.workunit.client.1.smithi155.stdout:9/17: dwrite - no filename 2024-09-13T21:44:44.539 INFO:tasks.workunit.client.1.smithi155.stdout:9/18: dread - no filename 2024-09-13T21:44:44.540 INFO:tasks.workunit.client.0.smithi119.stdout:2/459: dwrite d1/f50 [0,4194304] 0 2024-09-13T21:44:44.542 INFO:tasks.workunit.client.0.smithi119.stdout:6/390: creat dc/df/d41/f7b x:0 0 0 2024-09-13T21:44:44.545 INFO:tasks.workunit.client.1.smithi155.stdout:9/19: rename c7 to c9 0 2024-09-13T21:44:44.545 INFO:tasks.workunit.client.1.smithi155.stdout:9/20: fsync - no filename 2024-09-13T21:44:44.545 INFO:tasks.workunit.client.1.smithi155.stdout:9/21: fdatasync - no filename 2024-09-13T21:44:44.545 INFO:tasks.workunit.client.1.smithi155.stdout:9/22: write - no filename 2024-09-13T21:44:44.545 INFO:tasks.workunit.client.0.smithi119.stdout:8/475: link d1b/d4e/d71/f98 d1b/d1d/d48/d54/f9d 0 2024-09-13T21:44:44.546 INFO:tasks.workunit.client.0.smithi119.stdout:2/460: creat d1/d22/d7c/f98 x:0 0 0 2024-09-13T21:44:44.548 INFO:tasks.workunit.client.0.smithi119.stdout:2/461: chown d1/d22/l68 227546 1 2024-09-13T21:44:44.549 INFO:tasks.workunit.client.1.smithi155.stdout:9/23: creat fa x:0 0 0 2024-09-13T21:44:44.550 INFO:tasks.workunit.client.1.smithi155.stdout:8/24: dwrite d2/f5 [0,4194304] 0 2024-09-13T21:44:44.552 INFO:tasks.workunit.client.1.smithi155.stdout:8/25: write d2/f5 [3069690,88401] 0 2024-09-13T21:44:44.553 INFO:tasks.workunit.client.0.smithi119.stdout:5/405: dwrite d0/f88 [0,4194304] 0 2024-09-13T21:44:44.556 INFO:tasks.workunit.client.1.smithi155.stdout:9/24: truncate fa 96341 0 2024-09-13T21:44:44.557 INFO:tasks.workunit.client.0.smithi119.stdout:5/406: unlink d0/d3/d4/d9/d14/d24/l49 0 2024-09-13T21:44:44.559 INFO:tasks.workunit.client.1.smithi155.stdout:9/25: creat fb x:0 0 0 2024-09-13T21:44:44.565 INFO:tasks.workunit.client.0.smithi119.stdout:5/407: read d0/d3/d4/f5 [1875168,38412] 0 2024-09-13T21:44:44.567 INFO:tasks.workunit.client.0.smithi119.stdout:5/408: write d0/d3/d4/d9/d1e/f91 [502747,88708] 0 2024-09-13T21:44:44.570 INFO:tasks.workunit.client.1.smithi155.stdout:6/19: dwrite f3 [4194304,4194304] 0 2024-09-13T21:44:44.575 INFO:tasks.workunit.client.1.smithi155.stdout:6/20: mknod c4 0 2024-09-13T21:44:44.575 INFO:tasks.workunit.client.0.smithi119.stdout:7/476: truncate d8/f17 3950005 0 2024-09-13T21:44:44.576 INFO:tasks.workunit.client.0.smithi119.stdout:5/409: dwrite d0/d3/d4/d9/d14/f17 [0,4194304] 0 2024-09-13T21:44:44.579 INFO:tasks.workunit.client.1.smithi155.stdout:9/26: dwrite fb [0,4194304] 0 2024-09-13T21:44:44.580 INFO:tasks.workunit.client.0.smithi119.stdout:5/410: truncate d0/d3/d4/d9/d14/d24/d25/d67/f75 708156 0 2024-09-13T21:44:44.582 INFO:tasks.workunit.client.0.smithi119.stdout:7/477: rename d8/d3c/d53/d37/d83/d89/lf to d8/d19/d2e/d34/l94 0 2024-09-13T21:44:44.583 INFO:tasks.workunit.client.0.smithi119.stdout:7/478: dread - d8/d3c/d46/f87 zero size 2024-09-13T21:44:44.586 INFO:tasks.workunit.client.0.smithi119.stdout:6/391: write dc/d4b/f79 [207572,77240] 0 2024-09-13T21:44:44.587 INFO:tasks.workunit.client.0.smithi119.stdout:2/462: truncate d1/d38/f2e 1680068 0 2024-09-13T21:44:44.589 INFO:tasks.workunit.client.0.smithi119.stdout:5/411: rename d0/l19 to d0/d3/d4/l98 0 2024-09-13T21:44:44.590 INFO:tasks.workunit.client.0.smithi119.stdout:0/456: dread fd [0,4194304] 0 2024-09-13T21:44:44.590 INFO:tasks.workunit.client.0.smithi119.stdout:6/392: mknod dc/df/d64/c7c 0 2024-09-13T21:44:44.594 INFO:tasks.workunit.client.1.smithi155.stdout:6/21: dwrite f0 [0,4194304] 0 2024-09-13T21:44:44.595 INFO:tasks.workunit.client.0.smithi119.stdout:7/479: dwrite d8/d3c/d53/d37/d57/d5f/f67 [0,4194304] 0 2024-09-13T21:44:44.595 INFO:tasks.workunit.client.0.smithi119.stdout:7/480: stat d8 0 2024-09-13T21:44:44.596 INFO:tasks.workunit.client.1.smithi155.stdout:8/26: dwrite d2/f5 [4194304,4194304] 0 2024-09-13T21:44:44.598 INFO:tasks.workunit.client.1.smithi155.stdout:8/27: read d2/f5 [1579134,45210] 0 2024-09-13T21:44:44.598 INFO:tasks.workunit.client.1.smithi155.stdout:8/28: chown d2 11355 1 2024-09-13T21:44:44.600 INFO:tasks.workunit.client.0.smithi119.stdout:2/463: symlink d1/d38/d89/d6b/d8c/l99 0 2024-09-13T21:44:44.601 INFO:tasks.workunit.client.1.smithi155.stdout:9/27: dwrite fa [0,4194304] 0 2024-09-13T21:44:44.601 INFO:tasks.workunit.client.1.smithi155.stdout:6/22: write f3 [1048069,103319] 0 2024-09-13T21:44:44.602 INFO:tasks.workunit.client.1.smithi155.stdout:6/23: read f3 [2308616,9892] 0 2024-09-13T21:44:44.603 INFO:tasks.workunit.client.1.smithi155.stdout:9/28: write fb [1269161,74398] 0 2024-09-13T21:44:44.606 INFO:tasks.workunit.client.0.smithi119.stdout:0/457: mkdir de/d1c/d59/da8 0 2024-09-13T21:44:44.606 INFO:tasks.workunit.client.1.smithi155.stdout:8/29: write d2/f5 [2982014,54992] 0 2024-09-13T21:44:44.607 INFO:tasks.workunit.client.0.smithi119.stdout:6/393: unlink dc/df/d41/c73 0 2024-09-13T21:44:44.608 INFO:tasks.workunit.client.1.smithi155.stdout:8/30: chown l0 31 1 2024-09-13T21:44:44.609 INFO:tasks.workunit.client.0.smithi119.stdout:7/481: rmdir d8/d3c/d53/d37 39 2024-09-13T21:44:44.612 INFO:tasks.workunit.client.0.smithi119.stdout:6/394: symlink dc/d4b/d6a/l7d 0 2024-09-13T21:44:44.615 INFO:tasks.workunit.client.1.smithi155.stdout:9/29: dread fa [0,4194304] 0 2024-09-13T21:44:44.617 INFO:tasks.workunit.client.0.smithi119.stdout:2/464: dread d1/d22/d5a/d5d/f78 [0,4194304] 0 2024-09-13T21:44:44.618 INFO:tasks.workunit.client.1.smithi155.stdout:9/30: mkdir dc 0 2024-09-13T21:44:44.622 INFO:tasks.workunit.client.0.smithi119.stdout:7/482: dread d8/d19/f35 [0,4194304] 0 2024-09-13T21:44:44.624 INFO:tasks.workunit.client.1.smithi155.stdout:6/24: dwrite f3 [8388608,4194304] 0 2024-09-13T21:44:44.624 INFO:tasks.workunit.client.1.smithi155.stdout:6/25: chown f3 9 1 2024-09-13T21:44:44.625 INFO:tasks.workunit.client.1.smithi155.stdout:6/26: stat c4 0 2024-09-13T21:44:44.625 INFO:tasks.workunit.client.1.smithi155.stdout:6/27: chown f3 654116510 1 2024-09-13T21:44:44.625 INFO:tasks.workunit.client.1.smithi155.stdout:6/28: rmdir - no directory 2024-09-13T21:44:44.629 INFO:tasks.workunit.client.0.smithi119.stdout:7/483: dwrite d8/d3c/d53/d3b/d48/f79 [0,4194304] 0 2024-09-13T21:44:44.633 INFO:tasks.workunit.client.1.smithi155.stdout:6/29: dwrite f0 [0,4194304] 0 2024-09-13T21:44:44.635 INFO:tasks.workunit.client.0.smithi119.stdout:7/484: mkdir d8/d3c/d53/d37/d95 0 2024-09-13T21:44:44.638 INFO:tasks.workunit.client.1.smithi155.stdout:6/30: rename c4 to c5 0 2024-09-13T21:44:44.639 INFO:tasks.workunit.client.1.smithi155.stdout:6/31: chown f3 18307069 1 2024-09-13T21:44:44.639 INFO:tasks.workunit.client.0.smithi119.stdout:5/412: write d0/d3/d4/d9/d14/d24/d25/d54/f5f [927387,46680] 0 2024-09-13T21:44:44.641 INFO:tasks.workunit.client.1.smithi155.stdout:6/32: mkdir d6 0 2024-09-13T21:44:44.647 INFO:tasks.workunit.client.1.smithi155.stdout:9/31: truncate fa 3516918 0 2024-09-13T21:44:44.647 INFO:tasks.workunit.client.0.smithi119.stdout:5/413: write d0/d3/d4/d9/d14/d24/f55 [1705221,112340] 0 2024-09-13T21:44:44.648 INFO:tasks.workunit.client.1.smithi155.stdout:9/32: rename l8 to dc/ld 0 2024-09-13T21:44:44.650 INFO:tasks.workunit.client.1.smithi155.stdout:9/33: mkdir dc/de 0 2024-09-13T21:44:44.654 INFO:tasks.workunit.client.1.smithi155.stdout:1/41: sync 2024-09-13T21:44:44.654 INFO:tasks.workunit.client.1.smithi155.stdout:3/36: sync 2024-09-13T21:44:44.655 INFO:tasks.workunit.client.1.smithi155.stdout:8/31: fsync d2/f5 0 2024-09-13T21:44:44.655 INFO:tasks.workunit.client.0.smithi119.stdout:0/458: dwrite de/d1c/d2b/d34/f5f [0,4194304] 0 2024-09-13T21:44:44.655 INFO:tasks.workunit.client.1.smithi155.stdout:3/37: chown d3/f7 199 1 2024-09-13T21:44:44.657 INFO:tasks.workunit.client.1.smithi155.stdout:8/32: mkdir d2/d8 0 2024-09-13T21:44:44.658 INFO:tasks.workunit.client.0.smithi119.stdout:0/459: symlink de/d3c/d7c/la9 0 2024-09-13T21:44:44.660 INFO:tasks.workunit.client.1.smithi155.stdout:3/38: rename d3/d6/f8 to d3/d6/fc 0 2024-09-13T21:44:44.661 INFO:tasks.workunit.client.1.smithi155.stdout:1/42: link l5 d6/l12 0 2024-09-13T21:44:44.662 INFO:tasks.workunit.client.0.smithi119.stdout:0/460: readlink de/d49/l86 0 2024-09-13T21:44:44.664 INFO:tasks.workunit.client.0.smithi119.stdout:0/461: write de/d3c/f6d [2661474,79468] 0 2024-09-13T21:44:44.666 INFO:tasks.workunit.client.1.smithi155.stdout:3/39: symlink d3/ld 0 2024-09-13T21:44:44.667 INFO:tasks.workunit.client.1.smithi155.stdout:1/43: rename d6/d7/d10 to d6/d7/d13 0 2024-09-13T21:44:44.669 INFO:tasks.workunit.client.1.smithi155.stdout:8/33: creat d2/d6/f9 x:0 0 0 2024-09-13T21:44:44.670 INFO:tasks.workunit.client.1.smithi155.stdout:3/40: creat d3/d6/fe x:0 0 0 2024-09-13T21:44:44.670 INFO:tasks.workunit.client.1.smithi155.stdout:9/34: dread fa [0,4194304] 0 2024-09-13T21:44:44.670 INFO:tasks.workunit.client.1.smithi155.stdout:8/34: chown d2/c7 5005 1 2024-09-13T21:44:44.671 INFO:tasks.workunit.client.0.smithi119.stdout:0/462: dwrite de/d1c/d2f/d35/d90/f95 [0,4194304] 0 2024-09-13T21:44:44.674 INFO:tasks.workunit.client.0.smithi119.stdout:0/463: creat de/d1c/d2f/d35/d50/faa x:0 0 0 2024-09-13T21:44:44.675 INFO:tasks.workunit.client.0.smithi119.stdout:0/464: symlink de/d4e/d7f/lab 0 2024-09-13T21:44:44.678 INFO:tasks.workunit.client.0.smithi119.stdout:5/414: dread d0/d3/d4/d9/f46 [0,4194304] 0 2024-09-13T21:44:44.679 INFO:tasks.workunit.client.0.smithi119.stdout:0/465: rmdir de/d1c/d2f/d35/d4a/d62 39 2024-09-13T21:44:44.680 INFO:tasks.workunit.client.1.smithi155.stdout:3/41: dwrite d3/d6/fb [0,4194304] 0 2024-09-13T21:44:44.681 INFO:tasks.workunit.client.1.smithi155.stdout:1/44: dread f1 [0,4194304] 0 2024-09-13T21:44:44.682 INFO:tasks.workunit.client.0.smithi119.stdout:7/485: dread d8/f17 [0,4194304] 0 2024-09-13T21:44:44.682 INFO:tasks.workunit.client.0.smithi119.stdout:5/415: symlink d0/d3/d4/d9/d74/l99 0 2024-09-13T21:44:44.683 INFO:tasks.workunit.client.0.smithi119.stdout:0/466: mkdir de/d1c/d2f/d35/d4a/dac 0 2024-09-13T21:44:44.684 INFO:tasks.workunit.client.0.smithi119.stdout:7/486: write d8/d3c/d53/d37/d57/f6c [629639,98654] 0 2024-09-13T21:44:44.684 INFO:tasks.workunit.client.0.smithi119.stdout:0/467: stat de/d49/l9e 0 2024-09-13T21:44:44.685 INFO:tasks.workunit.client.1.smithi155.stdout:9/35: dread fb [0,4194304] 0 2024-09-13T21:44:44.687 INFO:tasks.workunit.client.0.smithi119.stdout:7/487: mkdir d8/d3c/d96 0 2024-09-13T21:44:44.688 INFO:tasks.workunit.client.1.smithi155.stdout:8/35: dread d2/f5 [4194304,4194304] 0 2024-09-13T21:44:44.689 INFO:tasks.workunit.client.0.smithi119.stdout:0/468: symlink de/d1c/d2f/d35/d4a/lad 0 2024-09-13T21:44:44.690 INFO:tasks.workunit.client.1.smithi155.stdout:1/45: creat d6/d7/d13/f14 x:0 0 0 2024-09-13T21:44:44.691 INFO:tasks.workunit.client.0.smithi119.stdout:5/416: dwrite d0/d3/d4/d9/f64 [0,4194304] 0 2024-09-13T21:44:44.691 INFO:tasks.workunit.client.0.smithi119.stdout:7/488: fdatasync d8/d3c/d53/d37/d83/d89/d47/f65 0 2024-09-13T21:44:44.691 INFO:tasks.workunit.client.1.smithi155.stdout:1/46: dread - d6/ff zero size 2024-09-13T21:44:44.692 INFO:tasks.workunit.client.0.smithi119.stdout:5/417: chown d0/d3/d4/d2e/d65 304461987 1 2024-09-13T21:44:44.692 INFO:tasks.workunit.client.1.smithi155.stdout:9/36: dread fb [0,4194304] 0 2024-09-13T21:44:44.693 INFO:tasks.workunit.client.0.smithi119.stdout:0/469: creat de/d1c/d52/fae x:0 0 0 2024-09-13T21:44:44.693 INFO:tasks.workunit.client.1.smithi155.stdout:3/42: rename d3/d6/fe to d3/ff 0 2024-09-13T21:44:44.694 INFO:tasks.workunit.client.0.smithi119.stdout:5/418: chown d0/d3/d1f/f5d 38 1 2024-09-13T21:44:44.694 INFO:tasks.workunit.client.1.smithi155.stdout:9/37: readlink dc/ld 0 2024-09-13T21:44:44.695 INFO:tasks.workunit.client.0.smithi119.stdout:5/419: write d0/d3/f8b [235250,74668] 0 2024-09-13T21:44:44.695 INFO:tasks.workunit.client.1.smithi155.stdout:8/36: dread d2/f5 [4194304,4194304] 0 2024-09-13T21:44:44.696 INFO:tasks.workunit.client.0.smithi119.stdout:7/489: unlink d8/f21 0 2024-09-13T21:44:44.696 INFO:tasks.workunit.client.1.smithi155.stdout:1/47: mkdir d6/d15 0 2024-09-13T21:44:44.696 INFO:tasks.workunit.client.1.smithi155.stdout:3/43: fsync d3/d6/fc 0 2024-09-13T21:44:44.698 INFO:tasks.workunit.client.0.smithi119.stdout:0/470: mknod de/d1c/d2b/d76/d9b/da1/caf 0 2024-09-13T21:44:44.698 INFO:tasks.workunit.client.0.smithi119.stdout:5/420: truncate d0/d3/d4/d2e/f71 149826 0 2024-09-13T21:44:44.699 INFO:tasks.workunit.client.0.smithi119.stdout:7/490: creat d8/d3c/d53/d3b/d48/f97 x:0 0 0 2024-09-13T21:44:44.699 INFO:tasks.workunit.client.1.smithi155.stdout:3/44: mkdir d3/d10 0 2024-09-13T21:44:44.700 INFO:tasks.workunit.client.0.smithi119.stdout:0/471: chown de/d1c/d2f/f41 39349694 1 2024-09-13T21:44:44.701 INFO:tasks.workunit.client.0.smithi119.stdout:0/472: write fc [5413226,42200] 0 2024-09-13T21:44:44.701 INFO:tasks.workunit.client.0.smithi119.stdout:7/491: truncate d8/d3c/d46/f87 664012 0 2024-09-13T21:44:44.702 INFO:tasks.workunit.client.1.smithi155.stdout:3/45: write d3/d6/fb [5120675,42896] 0 2024-09-13T21:44:44.703 INFO:tasks.workunit.client.0.smithi119.stdout:7/492: write d8/f7d [130863,101269] 0 2024-09-13T21:44:44.704 INFO:tasks.workunit.client.0.smithi119.stdout:0/473: write de/d1c/d2b/d76/f97 [846218,20309] 0 2024-09-13T21:44:44.704 INFO:tasks.workunit.client.0.smithi119.stdout:7/493: chown d8/f7d 1783549 1 2024-09-13T21:44:44.705 INFO:tasks.workunit.client.1.smithi155.stdout:8/37: dwrite d2/f5 [4194304,4194304] 0 2024-09-13T21:44:44.705 INFO:tasks.workunit.client.1.smithi155.stdout:3/46: creat d3/d6/f11 x:0 0 0 2024-09-13T21:44:44.706 INFO:tasks.workunit.client.1.smithi155.stdout:8/38: chown l1 946876 1 2024-09-13T21:44:44.707 INFO:tasks.workunit.client.1.smithi155.stdout:3/47: write d3/f7 [2428044,22527] 0 2024-09-13T21:44:44.707 INFO:tasks.workunit.client.0.smithi119.stdout:7/494: mknod d8/d3c/d53/d3b/d7e/c98 0 2024-09-13T21:44:44.707 INFO:tasks.workunit.client.1.smithi155.stdout:3/48: chown d3 2283 1 2024-09-13T21:44:44.708 INFO:tasks.workunit.client.1.smithi155.stdout:3/49: dread - d3/ff zero size 2024-09-13T21:44:44.709 INFO:tasks.workunit.client.1.smithi155.stdout:8/39: mknod d2/d6/ca 0 2024-09-13T21:44:44.711 INFO:tasks.workunit.client.1.smithi155.stdout:8/40: write d2/d6/f9 [321789,61636] 0 2024-09-13T21:44:44.714 INFO:tasks.workunit.client.1.smithi155.stdout:3/50: dread d3/d6/fb [0,4194304] 0 2024-09-13T21:44:44.718 INFO:tasks.workunit.client.0.smithi119.stdout:7/495: write d8/f31 [3798571,7563] 0 2024-09-13T21:44:44.720 INFO:tasks.workunit.client.1.smithi155.stdout:8/41: read d2/d6/f9 [66275,83869] 0 2024-09-13T21:44:44.720 INFO:tasks.workunit.client.1.smithi155.stdout:3/51: dread d3/fa [0,4194304] 0 2024-09-13T21:44:44.721 INFO:tasks.workunit.client.0.smithi119.stdout:7/496: symlink d8/d3c/d53/d37/d57/d5f/l99 0 2024-09-13T21:44:44.723 INFO:tasks.workunit.client.1.smithi155.stdout:8/42: mknod d2/d6/cb 0 2024-09-13T21:44:44.723 INFO:tasks.workunit.client.1.smithi155.stdout:3/52: creat d3/f12 x:0 0 0 2024-09-13T21:44:44.724 INFO:tasks.workunit.client.1.smithi155.stdout:3/53: read d3/fa [221757,38010] 0 2024-09-13T21:44:44.725 INFO:tasks.workunit.client.1.smithi155.stdout:3/54: chown d3/f7 63128532 1 2024-09-13T21:44:44.726 INFO:tasks.workunit.client.0.smithi119.stdout:7/497: dwrite d8/d3c/f7b [0,4194304] 0 2024-09-13T21:44:44.727 INFO:tasks.workunit.client.1.smithi155.stdout:8/43: getdents d2 0 2024-09-13T21:44:44.727 INFO:tasks.workunit.client.1.smithi155.stdout:3/55: dread d3/d6/fb [4194304,4194304] 0 2024-09-13T21:44:44.730 INFO:tasks.workunit.client.1.smithi155.stdout:3/56: rename d3/c5 to d3/d10/c13 0 2024-09-13T21:44:44.733 INFO:tasks.workunit.client.0.smithi119.stdout:7/498: dwrite d8/d3c/d53/d37/d83/d89/fa [4194304,4194304] 0 2024-09-13T21:44:44.734 INFO:tasks.workunit.client.1.smithi155.stdout:3/57: mknod d3/d10/c14 0 2024-09-13T21:44:44.735 INFO:tasks.workunit.client.1.smithi155.stdout:3/58: write d3/f12 [870596,103634] 0 2024-09-13T21:44:44.735 INFO:tasks.workunit.client.0.smithi119.stdout:7/499: write d8/d3c/d46/f87 [1635392,90513] 0 2024-09-13T21:44:44.736 INFO:tasks.workunit.client.1.smithi155.stdout:3/59: mknod d3/d10/c15 0 2024-09-13T21:44:44.739 INFO:tasks.workunit.client.1.smithi155.stdout:8/44: truncate d2/f5 677240 0 2024-09-13T21:44:44.741 INFO:tasks.workunit.client.0.smithi119.stdout:0/474: dread de/d3c/f3d [0,4194304] 0 2024-09-13T21:44:44.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.739+0000 7f0024919640 1 -- 172.21.15.119:0/3001948320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00200fc720 msgr2=0x7f00200fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:44.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.739+0000 7f0024919640 1 --2- 172.21.15.119:0/3001948320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00200fc720 0x7f00200fcb90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f00140048d0 tx=0x7f0014009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:44.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.739+0000 7f0024919640 1 -- 172.21.15.119:0/3001948320 shutdown_connections 2024-09-13T21:44:44.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.739+0000 7f0024919640 1 --2- 172.21.15.119:0/3001948320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00200fc720 0x7f00200fcb90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:44.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.739+0000 7f0024919640 1 --2- 172.21.15.119:0/3001948320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00200fb450 0x7f00200fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:44.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.739+0000 7f0024919640 1 -- 172.21.15.119:0/3001948320 >> 172.21.15.119:0/3001948320 conn(0x7f00200f6c10 msgr2=0x7f00200f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:44.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.740+0000 7f0024919640 1 -- 172.21.15.119:0/3001948320 shutdown_connections 2024-09-13T21:44:44.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.740+0000 7f0024919640 1 -- 172.21.15.119:0/3001948320 wait complete. 2024-09-13T21:44:44.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.740+0000 7f0024919640 1 Processor -- start 2024-09-13T21:44:44.743 INFO:tasks.workunit.client.0.smithi119.stdout:0/475: dread - de/d1c/d52/fae zero size 2024-09-13T21:44:44.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.740+0000 7f0024919640 1 -- start start 2024-09-13T21:44:44.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.741+0000 7f0024919640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00200fb450 0x7f00201136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:44.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.741+0000 7f0024919640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00200fc720 0x7f0020113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:44.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.741+0000 7f0024919640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0020114270 con 0x7f00200fb450 2024-09-13T21:44:44.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.741+0000 7f0024919640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0020114a90 con 0x7f00200fc720 2024-09-13T21:44:44.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.741+0000 7f001dd9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00200fc720 0x7f0020113c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:44.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.741+0000 7f001dd9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00200fc720 0x7f0020113c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:37928/0 (socket says 172.21.15.119:37928) 2024-09-13T21:44:44.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.741+0000 7f001dd9b640 1 -- 172.21.15.119:0/504186577 learned_addr learned my addr 172.21.15.119:0/504186577 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:44.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.741+0000 7f001e59c640 1 --2- 172.21.15.119:0/504186577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00200fb450 0x7f00201136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:44.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.742+0000 7f001dd9b640 1 -- 172.21.15.119:0/504186577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00200fb450 msgr2=0x7f00201136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:44.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.742+0000 7f001dd9b640 1 --2- 172.21.15.119:0/504186577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00200fb450 0x7f00201136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:44.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.742+0000 7f001dd9b640 1 -- 172.21.15.119:0/504186577 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0014005040 con 0x7f00200fc720 2024-09-13T21:44:44.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.742+0000 7f001dd9b640 1 --2- 172.21.15.119:0/504186577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00200fc720 0x7f0020113c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f001400b020 tx=0x7f0014009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:44.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.742+0000 7f000effd640 1 -- 172.21.15.119:0/504186577 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0014038070 con 0x7f00200fc720 2024-09-13T21:44:44.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.742+0000 7f000effd640 1 -- 172.21.15.119:0/504186577 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f001402ae90 con 0x7f00200fc720 2024-09-13T21:44:44.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.742+0000 7f0024919640 1 -- 172.21.15.119:0/504186577 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0020114cc0 con 0x7f00200fc720 2024-09-13T21:44:44.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.743+0000 7f000effd640 1 -- 172.21.15.119:0/504186577 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0014038070 con 0x7f00200fc720 2024-09-13T21:44:44.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.743+0000 7f0024919640 1 -- 172.21.15.119:0/504186577 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0020115200 con 0x7f00200fc720 2024-09-13T21:44:44.746 INFO:tasks.workunit.client.0.smithi119.stdout:0/476: creat de/d49/fb0 x:0 0 0 2024-09-13T21:44:44.746 INFO:tasks.workunit.client.0.smithi119.stdout:7/500: dwrite d8/d19/d2e/f7c [0,4194304] 0 2024-09-13T21:44:44.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.744+0000 7f0024919640 1 -- 172.21.15.119:0/504186577 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0000005240 con 0x7f00200fc720 2024-09-13T21:44:44.746 INFO:tasks.workunit.client.0.smithi119.stdout:7/501: chown d8/d19/d2e/l8c 5409686 1 2024-09-13T21:44:44.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.745+0000 7f000effd640 1 -- 172.21.15.119:0/504186577 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f0014030020 con 0x7f00200fc720 2024-09-13T21:44:44.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.745+0000 7f000effd640 1 --2- 172.21.15.119:0/504186577 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f000806e780 0x7f0008070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:44.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.746+0000 7f000effd640 1 -- 172.21.15.119:0/504186577 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f001407faa0 con 0x7f00200fc720 2024-09-13T21:44:44.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.746+0000 7f001e59c640 1 --2- 172.21.15.119:0/504186577 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f000806e780 0x7f0008070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:44.748 INFO:tasks.workunit.client.0.smithi119.stdout:0/477: mkdir de/d1c/d2f/d35/d50/db1 0 2024-09-13T21:44:44.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.748+0000 7f001e59c640 1 --2- 172.21.15.119:0/504186577 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f000806e780 0x7f0008070c30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f00100041d0 tx=0x7f0010004330 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:44.750 INFO:tasks.workunit.client.0.smithi119.stdout:0/478: creat de/d1c/d59/fb2 x:0 0 0 2024-09-13T21:44:44.753 INFO:tasks.workunit.client.0.smithi119.stdout:7/502: rename d8/d19/d2e/c63 to d8/d3c/d53/d3b/d48/c9a 0 2024-09-13T21:44:44.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:44.753+0000 7f000effd640 1 -- 172.21.15.119:0/504186577 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f00140781d0 con 0x7f00200fc720 2024-09-13T21:44:44.755 INFO:tasks.workunit.client.0.smithi119.stdout:7/503: symlink d8/d3c/l9b 0 2024-09-13T21:44:44.756 INFO:tasks.workunit.client.0.smithi119.stdout:0/479: link de/d4e/f6e de/d1c/d2b/fb3 0 2024-09-13T21:44:44.758 INFO:tasks.workunit.client.0.smithi119.stdout:0/480: chown de/d1c/d2f/f43 12 1 2024-09-13T21:44:44.758 INFO:tasks.workunit.client.0.smithi119.stdout:7/504: creat d8/f9c x:0 0 0 2024-09-13T21:44:44.763 INFO:tasks.workunit.client.0.smithi119.stdout:0/481: getdents de/d1c/d2b/d76 0 2024-09-13T21:44:44.763 INFO:tasks.workunit.client.0.smithi119.stdout:7/505: dread d8/d3c/d53/d37/d57/d5f/f67 [0,4194304] 0 2024-09-13T21:44:44.766 INFO:tasks.workunit.client.0.smithi119.stdout:7/506: mkdir d8/d9d 0 2024-09-13T21:44:44.807 INFO:tasks.workunit.client.0.smithi119.stdout:4/493: sync 2024-09-13T21:44:44.809 INFO:tasks.workunit.client.1.smithi155.stdout:8/45: write d2/f5 [1312669,1517] 0 2024-09-13T21:44:44.810 INFO:tasks.workunit.client.1.smithi155.stdout:8/46: truncate d2/d6/f9 425086 0 2024-09-13T21:44:44.813 INFO:tasks.workunit.client.1.smithi155.stdout:8/47: rename d2/d6/f9 to d2/fc 0 2024-09-13T21:44:44.816 INFO:tasks.workunit.client.0.smithi119.stdout:7/507: write d8/f17 [3950748,106080] 0 2024-09-13T21:44:44.818 INFO:tasks.workunit.client.0.smithi119.stdout:7/508: chown d8/d3c/d53/d3b/d7e 17 1 2024-09-13T21:44:44.819 INFO:tasks.workunit.client.1.smithi155.stdout:8/48: dwrite d2/fc [0,4194304] 0 2024-09-13T21:44:44.821 INFO:tasks.workunit.client.0.smithi119.stdout:7/509: dread - d8/d19/d2e/d34/d6e/f8d zero size 2024-09-13T21:44:44.821 INFO:tasks.workunit.client.0.smithi119.stdout:0/482: dwrite de/f3e [0,4194304] 0 2024-09-13T21:44:44.822 INFO:tasks.workunit.client.1.smithi155.stdout:8/49: mkdir d2/d6/dd 0 2024-09-13T21:44:44.824 INFO:tasks.workunit.client.0.smithi119.stdout:0/483: write de/f77 [5066820,108493] 0 2024-09-13T21:44:44.825 INFO:tasks.workunit.client.0.smithi119.stdout:0/484: dread - de/d1c/d59/fb2 zero size 2024-09-13T21:44:44.828 INFO:tasks.workunit.client.0.smithi119.stdout:7/510: rename d8/d3c/d53/d37/d57/d5f/f88 to d8/d3c/d53/d37/d83/d89/f9e 0 2024-09-13T21:44:44.828 INFO:tasks.workunit.client.0.smithi119.stdout:4/494: dread d4/d1e/d26/f77 [0,4194304] 0 2024-09-13T21:44:44.828 INFO:tasks.workunit.client.1.smithi155.stdout:8/50: dwrite d2/fc [0,4194304] 0 2024-09-13T21:44:44.833 INFO:tasks.workunit.client.0.smithi119.stdout:4/495: creat d4/d1e/d28/d34/d66/f9c x:0 0 0 2024-09-13T21:44:44.834 INFO:tasks.workunit.client.0.smithi119.stdout:4/496: stat d4/d1e/d26/d5e/f6e 0 2024-09-13T21:44:44.835 INFO:tasks.workunit.client.0.smithi119.stdout:0/485: dwrite de/d1c/d2f/d35/d4a/d62/f75 [4194304,4194304] 0 2024-09-13T21:44:44.838 INFO:tasks.workunit.client.0.smithi119.stdout:4/497: symlink d4/d1e/d26/d6d/d7c/l9d 0 2024-09-13T21:44:44.838 INFO:tasks.workunit.client.0.smithi119.stdout:0/486: write de/d1c/d2f/d35/d50/d83/f88 [1307861,3646] 0 2024-09-13T21:44:44.838 INFO:tasks.workunit.client.1.smithi155.stdout:8/51: dwrite d2/fc [0,4194304] 0 2024-09-13T21:44:44.839 INFO:tasks.workunit.client.0.smithi119.stdout:0/487: dread - de/d4e/d7f/fa3 zero size 2024-09-13T21:44:44.841 INFO:tasks.workunit.client.0.smithi119.stdout:7/511: dread d8/d3c/d53/d3b/f54 [0,4194304] 0 2024-09-13T21:44:44.844 INFO:tasks.workunit.client.0.smithi119.stdout:7/512: creat d8/d19/d2e/d34/d6e/f9f x:0 0 0 2024-09-13T21:44:44.846 INFO:tasks.workunit.client.0.smithi119.stdout:0/488: dwrite de/f10 [4194304,4194304] 0 2024-09-13T21:44:44.847 INFO:tasks.workunit.client.0.smithi119.stdout:7/513: dread d8/d19/d2e/d34/f3a [0,4194304] 0 2024-09-13T21:44:44.848 INFO:tasks.workunit.client.1.smithi155.stdout:8/52: dwrite d2/fc [0,4194304] 0 2024-09-13T21:44:44.848 INFO:tasks.workunit.client.0.smithi119.stdout:0/489: write de/d1c/d2f/d35/d90/f95 [2515301,77667] 0 2024-09-13T21:44:44.849 INFO:tasks.workunit.client.1.smithi155.stdout:8/53: read d2/fc [1419716,34198] 0 2024-09-13T21:44:44.849 INFO:tasks.workunit.client.0.smithi119.stdout:7/514: chown d8/d3c/d53/d37/d57/d5f/f66 2878 1 2024-09-13T21:44:44.851 INFO:tasks.workunit.client.0.smithi119.stdout:7/515: fdatasync d8/d3c/d53/d37/d83/d89/f2d 0 2024-09-13T21:44:44.852 INFO:tasks.workunit.client.0.smithi119.stdout:0/490: rename de/l6a to de/d1c/d2b/d76/lb4 0 2024-09-13T21:44:44.854 INFO:tasks.workunit.client.0.smithi119.stdout:0/491: creat de/d1c/d59/fb5 x:0 0 0 2024-09-13T21:44:44.855 INFO:tasks.workunit.client.1.smithi155.stdout:8/54: dread d2/fc [0,4194304] 0 2024-09-13T21:44:44.858 INFO:tasks.workunit.client.1.smithi155.stdout:8/55: creat d2/d6/fe x:0 0 0 2024-09-13T21:44:44.859 INFO:tasks.workunit.client.0.smithi119.stdout:4/498: dread d4/f96 [0,4194304] 0 2024-09-13T21:44:44.862 INFO:tasks.workunit.client.0.smithi119.stdout:4/499: creat d4/d1e/d26/d60/d71/f9e x:0 0 0 2024-09-13T21:44:44.864 INFO:tasks.workunit.client.0.smithi119.stdout:4/500: mkdir d4/d1e/d28/d34/d6a/d79/d9f 0 2024-09-13T21:44:44.865 INFO:tasks.workunit.client.1.smithi155.stdout:8/56: dwrite d2/d6/fe [0,4194304] 0 2024-09-13T21:44:44.868 INFO:tasks.workunit.client.1.smithi155.stdout:8/57: getdents d2/d6/dd 0 2024-09-13T21:44:44.870 INFO:tasks.workunit.client.1.smithi155.stdout:8/58: creat d2/d8/ff x:0 0 0 2024-09-13T21:44:44.874 INFO:tasks.workunit.client.1.smithi155.stdout:8/59: dread d2/d6/fe [0,4194304] 0 2024-09-13T21:44:44.880 INFO:tasks.workunit.client.1.smithi155.stdout:8/60: dwrite d2/d6/fe [0,4194304] 0 2024-09-13T21:44:44.889 INFO:tasks.workunit.client.1.smithi155.stdout:8/61: dwrite d2/fc [0,4194304] 0 2024-09-13T21:44:44.889 INFO:tasks.workunit.client.0.smithi119.stdout:0/492: write de/d1c/f20 [348959,7204] 0 2024-09-13T21:44:44.891 INFO:tasks.workunit.client.0.smithi119.stdout:0/493: truncate de/d1c/d2f/d40/f99 679763 0 2024-09-13T21:44:44.892 INFO:tasks.workunit.client.1.smithi155.stdout:8/62: creat d2/d8/f10 x:0 0 0 2024-09-13T21:44:44.895 INFO:tasks.workunit.client.1.smithi155.stdout:8/63: rename d2/fc to d2/d6/f11 0 2024-09-13T21:44:44.896 INFO:tasks.workunit.client.0.smithi119.stdout:0/494: dwrite de/d1c/d52/f55 [0,4194304] 0 2024-09-13T21:44:44.898 INFO:tasks.workunit.client.1.smithi155.stdout:8/64: mkdir d2/d6/dd/d12 0 2024-09-13T21:44:44.899 INFO:tasks.workunit.client.0.smithi119.stdout:0/495: symlink de/d1c/d2f/d40/d66/lb6 0 2024-09-13T21:44:44.900 INFO:tasks.workunit.client.0.smithi119.stdout:0/496: stat de/d1c/d2b/d76 0 2024-09-13T21:44:44.900 INFO:tasks.workunit.client.0.smithi119.stdout:0/497: readlink de/l28 0 2024-09-13T21:44:44.901 INFO:tasks.workunit.client.0.smithi119.stdout:0/498: symlink de/d3c/lb7 0 2024-09-13T21:44:44.903 INFO:tasks.workunit.client.0.smithi119.stdout:0/499: mknod de/cb8 0 2024-09-13T21:44:44.903 INFO:tasks.workunit.client.1.smithi155.stdout:8/65: dread d2/d6/fe [0,4194304] 0 2024-09-13T21:44:44.904 INFO:tasks.workunit.client.0.smithi119.stdout:0/500: chown de/d49/f4c 26792 1 2024-09-13T21:44:44.905 INFO:tasks.workunit.client.0.smithi119.stdout:0/501: rmdir de/d1c/d2b/d76/d9b 39 2024-09-13T21:44:44.906 INFO:tasks.workunit.client.1.smithi155.stdout:8/66: getdents d2/d6/dd/d12 0 2024-09-13T21:44:44.906 INFO:tasks.workunit.client.0.smithi119.stdout:0/502: symlink de/d1c/lb9 0 2024-09-13T21:44:44.906 INFO:tasks.workunit.client.0.smithi119.stdout:0/503: fsync de/d4e/d7f/f91 0 2024-09-13T21:44:44.907 INFO:tasks.workunit.client.1.smithi155.stdout:8/67: chown d2/d6/fe 3391699 1 2024-09-13T21:44:44.907 INFO:tasks.workunit.client.0.smithi119.stdout:0/504: fsync de/d1c/d2f/f41 0 2024-09-13T21:44:44.908 INFO:tasks.workunit.client.1.smithi155.stdout:8/68: write d2/d6/fe [1965699,90233] 0 2024-09-13T21:44:44.909 INFO:tasks.workunit.client.0.smithi119.stdout:0/505: fsync de/d49/f4f 0 2024-09-13T21:44:44.909 INFO:tasks.workunit.client.1.smithi155.stdout:8/69: write d2/d8/ff [680552,44742] 0 2024-09-13T21:44:44.922 INFO:tasks.workunit.client.1.smithi155.stdout:8/70: truncate d2/d6/fe 1908066 0 2024-09-13T21:44:44.925 INFO:tasks.workunit.client.1.smithi155.stdout:8/71: link l1 d2/l13 0 2024-09-13T21:44:44.937 INFO:tasks.workunit.client.1.smithi155.stdout:8/72: dwrite d2/d6/fe [0,4194304] 0 2024-09-13T21:44:44.940 INFO:tasks.workunit.client.1.smithi155.stdout:8/73: rename d2/c7 to d2/d8/c14 0 2024-09-13T21:44:44.946 INFO:tasks.workunit.client.1.smithi155.stdout:8/74: truncate d2/d6/fe 4128121 0 2024-09-13T21:44:44.948 INFO:tasks.workunit.client.1.smithi155.stdout:8/75: rename d2/d6/cb to d2/d6/dd/c15 0 2024-09-13T21:44:44.949 INFO:tasks.workunit.client.1.smithi155.stdout:8/76: read d2/d6/f11 [3182872,3756] 0 2024-09-13T21:44:44.952 INFO:tasks.workunit.client.1.smithi155.stdout:8/77: unlink l1 0 2024-09-13T21:44:44.953 INFO:tasks.workunit.client.1.smithi155.stdout:8/78: creat d2/d6/dd/d12/f16 x:0 0 0 2024-09-13T21:44:44.954 INFO:tasks.workunit.client.1.smithi155.stdout:5/62: sync 2024-09-13T21:44:44.954 INFO:tasks.workunit.client.1.smithi155.stdout:4/62: sync 2024-09-13T21:44:44.954 INFO:tasks.workunit.client.1.smithi155.stdout:7/41: sync 2024-09-13T21:44:44.954 INFO:tasks.workunit.client.1.smithi155.stdout:0/48: sync 2024-09-13T21:44:44.954 INFO:tasks.workunit.client.1.smithi155.stdout:2/21: sync 2024-09-13T21:44:44.955 INFO:tasks.workunit.client.1.smithi155.stdout:7/42: dread - d5/fd zero size 2024-09-13T21:44:44.955 INFO:tasks.workunit.client.1.smithi155.stdout:2/22: truncate f0 1234067 0 2024-09-13T21:44:44.956 INFO:tasks.workunit.client.1.smithi155.stdout:0/49: write d1/d6/fb [2234875,54382] 0 2024-09-13T21:44:44.957 INFO:tasks.workunit.client.1.smithi155.stdout:7/43: write d5/fb [808672,19602] 0 2024-09-13T21:44:44.958 INFO:tasks.workunit.client.0.smithi119.stdout:9/525: sync 2024-09-13T21:44:44.958 INFO:tasks.workunit.client.0.smithi119.stdout:1/405: sync 2024-09-13T21:44:44.959 INFO:tasks.workunit.client.1.smithi155.stdout:5/63: link d5/f8 d5/f17 0 2024-09-13T21:44:44.960 INFO:tasks.workunit.client.1.smithi155.stdout:5/64: stat d5/f17 0 2024-09-13T21:44:44.961 INFO:tasks.workunit.client.0.smithi119.stdout:9/526: dread d0/d19/d1a/d2b/f3e [0,4194304] 0 2024-09-13T21:44:44.962 INFO:tasks.workunit.client.1.smithi155.stdout:5/65: write d5/f9 [256358,21849] 0 2024-09-13T21:44:44.962 INFO:tasks.workunit.client.1.smithi155.stdout:5/66: chown d5 393507 1 2024-09-13T21:44:44.962 INFO:tasks.workunit.client.0.smithi119.stdout:9/527: read d0/d19/d1a/d2b/f3e [199228,76160] 0 2024-09-13T21:44:44.963 INFO:tasks.workunit.client.1.smithi155.stdout:4/63: creat d1/d7/de/dc/ff x:0 0 0 2024-09-13T21:44:44.964 INFO:tasks.workunit.client.1.smithi155.stdout:8/79: rmdir d2/d6/dd/d12 39 2024-09-13T21:44:44.964 INFO:tasks.workunit.client.1.smithi155.stdout:5/67: chown d5/d12/c15 83003 1 2024-09-13T21:44:44.965 INFO:tasks.workunit.client.0.smithi119.stdout:1/406: dread d1/d3/f2a [0,4194304] 0 2024-09-13T21:44:44.965 INFO:tasks.workunit.client.1.smithi155.stdout:0/50: dwrite d1/d6/f13 [0,4194304] 0 2024-09-13T21:44:44.966 INFO:tasks.workunit.client.1.smithi155.stdout:4/64: write d1/f4 [2168529,57470] 0 2024-09-13T21:44:44.966 INFO:tasks.workunit.client.1.smithi155.stdout:8/80: dread - d2/d8/f10 zero size 2024-09-13T21:44:44.967 INFO:tasks.workunit.client.1.smithi155.stdout:5/68: write d5/f7 [1043957,58880] 0 2024-09-13T21:44:44.971 INFO:tasks.workunit.client.0.smithi119.stdout:1/407: link d1/d3/d61/d7e/l48 d1/d3/d61/d77/d78/d32/d33/d72/l84 0 2024-09-13T21:44:44.972 INFO:tasks.workunit.client.1.smithi155.stdout:2/23: rmdir d2/d4 0 2024-09-13T21:44:44.974 INFO:tasks.workunit.client.0.smithi119.stdout:1/408: chown d1/d3/d61/d7e/l48 0 1 2024-09-13T21:44:44.975 INFO:tasks.workunit.client.0.smithi119.stdout:9/528: dread d0/f7 [0,4194304] 0 2024-09-13T21:44:44.976 INFO:tasks.workunit.client.0.smithi119.stdout:1/409: chown d1/d3/d61/d77/d78/d32/d33/d43/c7b 1 1 2024-09-13T21:44:44.976 INFO:tasks.workunit.client.1.smithi155.stdout:4/65: creat d1/f10 x:0 0 0 2024-09-13T21:44:44.978 INFO:tasks.workunit.client.1.smithi155.stdout:2/24: symlink d2/l5 0 2024-09-13T21:44:44.979 INFO:tasks.workunit.client.0.smithi119.stdout:1/410: rmdir d1/d3/dc/d11/d19/d47 39 2024-09-13T21:44:44.979 INFO:tasks.workunit.client.1.smithi155.stdout:7/44: getdents d5 0 2024-09-13T21:44:44.979 INFO:tasks.workunit.client.0.smithi119.stdout:1/411: stat d1/d3/d61/d77 0 2024-09-13T21:44:44.980 INFO:tasks.workunit.client.1.smithi155.stdout:4/66: symlink d1/l11 0 2024-09-13T21:44:44.980 INFO:tasks.workunit.client.0.smithi119.stdout:9/529: getdents d0 0 2024-09-13T21:44:44.980 INFO:tasks.workunit.client.1.smithi155.stdout:2/25: creat d2/f6 x:0 0 0 2024-09-13T21:44:44.982 INFO:tasks.workunit.client.0.smithi119.stdout:9/530: write d0/d8/d18/d23/d27/d2d/d5f/d74/f7f [3824366,23549] 0 2024-09-13T21:44:44.983 INFO:tasks.workunit.client.1.smithi155.stdout:0/51: creat d1/f14 x:0 0 0 2024-09-13T21:44:44.984 INFO:tasks.workunit.client.1.smithi155.stdout:6/33: sync 2024-09-13T21:44:44.986 INFO:tasks.workunit.client.1.smithi155.stdout:4/67: mkdir d1/d12 0 2024-09-13T21:44:44.986 INFO:tasks.workunit.client.0.smithi119.stdout:9/531: chown d0/d8/d18/d23/d27/d2d/d70/d80/daa/db3 17891 1 2024-09-13T21:44:44.986 INFO:tasks.workunit.client.0.smithi119.stdout:1/412: dwrite d1/d3/dc/d11/f3c [0,4194304] 0 2024-09-13T21:44:44.987 INFO:tasks.workunit.client.0.smithi119.stdout:9/532: chown d0/d19/f59 4 1 2024-09-13T21:44:44.987 INFO:tasks.workunit.client.1.smithi155.stdout:7/45: dwrite d5/fb [0,4194304] 0 2024-09-13T21:44:44.989 INFO:tasks.workunit.client.0.smithi119.stdout:1/413: creat d1/d3/d61/f85 x:0 0 0 2024-09-13T21:44:44.989 INFO:tasks.workunit.client.1.smithi155.stdout:2/26: mknod d2/c7 0 2024-09-13T21:44:44.992 INFO:tasks.workunit.client.0.smithi119.stdout:9/533: mknod d0/d8/d18/d23/d27/d2d/d6e/cb5 0 2024-09-13T21:44:44.993 INFO:tasks.workunit.client.1.smithi155.stdout:7/46: stat d5/l9 0 2024-09-13T21:44:44.993 INFO:tasks.workunit.client.1.smithi155.stdout:4/68: fsync d1/f6 0 2024-09-13T21:44:44.995 INFO:tasks.workunit.client.0.smithi119.stdout:9/534: symlink d0/d8/d18/dad/lb6 0 2024-09-13T21:44:44.996 INFO:tasks.workunit.client.1.smithi155.stdout:5/69: dwrite f0 [0,4194304] 0 2024-09-13T21:44:44.996 INFO:tasks.workunit.client.0.smithi119.stdout:1/414: dwrite d1/d3/dc/f1c [0,4194304] 0 2024-09-13T21:44:44.999 INFO:tasks.workunit.client.1.smithi155.stdout:8/81: dread d2/d6/f11 [0,4194304] 0 2024-09-13T21:44:44.999 INFO:tasks.workunit.client.0.smithi119.stdout:1/415: fsync d1/d3/d61/d7e/d53/f83 0 2024-09-13T21:44:44.999 INFO:tasks.workunit.client.1.smithi155.stdout:6/34: rmdir d6 0 2024-09-13T21:44:45.001 INFO:tasks.workunit.client.0.smithi119.stdout:9/535: write d0/d8/d18/d23/d27/f32 [2371669,60387] 0 2024-09-13T21:44:45.001 INFO:tasks.workunit.client.1.smithi155.stdout:4/69: rename d1/l3 to d1/d7/de/dc/l13 0 2024-09-13T21:44:45.003 INFO:tasks.workunit.client.0.smithi119.stdout:1/416: fsync d1/d3/dc/d11/d19/d2d/f51 0 2024-09-13T21:44:45.005 INFO:tasks.workunit.client.0.smithi119.stdout:9/536: unlink d0/d19/d1a/d2b/l35 0 2024-09-13T21:44:45.006 INFO:tasks.workunit.client.1.smithi155.stdout:4/70: dread d1/f6 [0,4194304] 0 2024-09-13T21:44:45.006 INFO:tasks.workunit.client.0.smithi119.stdout:9/537: read d0/d19/f46 [3504886,111882] 0 2024-09-13T21:44:45.007 INFO:tasks.workunit.client.1.smithi155.stdout:2/27: link d2/c7 d2/c8 0 2024-09-13T21:44:45.007 INFO:tasks.workunit.client.0.smithi119.stdout:1/417: rmdir d1/d3/d61/d77/d78 39 2024-09-13T21:44:45.008 INFO:tasks.workunit.client.1.smithi155.stdout:4/71: chown d1/d7 1003 1 2024-09-13T21:44:45.008 INFO:tasks.workunit.client.1.smithi155.stdout:5/70: creat d5/d16/f18 x:0 0 0 2024-09-13T21:44:45.009 INFO:tasks.workunit.client.1.smithi155.stdout:5/71: fsync d5/f10 0 2024-09-13T21:44:45.009 INFO:tasks.workunit.client.0.smithi119.stdout:1/418: chown d1/d3/dc/d11/d3d/l81 7 1 2024-09-13T21:44:45.009 INFO:tasks.workunit.client.0.smithi119.stdout:9/538: chown d0/d19/d1a/d2b/l67 2074562 1 2024-09-13T21:44:45.010 INFO:tasks.workunit.client.1.smithi155.stdout:2/28: mknod d2/c9 0 2024-09-13T21:44:45.011 INFO:tasks.workunit.client.1.smithi155.stdout:4/72: symlink d1/d7/de/l14 0 2024-09-13T21:44:45.011 INFO:tasks.workunit.client.1.smithi155.stdout:0/52: dwrite d1/d6/dc/f11 [0,4194304] 0 2024-09-13T21:44:45.011 INFO:tasks.workunit.client.0.smithi119.stdout:9/539: chown d0/d19/d1a/d2b/c78 9158553 1 2024-09-13T21:44:45.011 INFO:tasks.workunit.client.0.smithi119.stdout:1/419: chown d1/d3/dc/d11/d19/d2d/d37/l6e 242678938 1 2024-09-13T21:44:45.012 INFO:tasks.workunit.client.0.smithi119.stdout:9/540: fsync d0/d19/f6d 0 2024-09-13T21:44:45.012 INFO:tasks.workunit.client.0.smithi119.stdout:1/420: fsync d1/d3/f2b 0 2024-09-13T21:44:45.013 INFO:tasks.workunit.client.1.smithi155.stdout:0/53: dread - d1/f14 zero size 2024-09-13T21:44:45.013 INFO:tasks.workunit.client.1.smithi155.stdout:4/73: read - d1/d7/de/dc/ff zero size 2024-09-13T21:44:45.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.014+0000 7f0024919640 1 -- 172.21.15.119:0/504186577 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0000000bf0 con 0x7f000806e780 2024-09-13T21:44:45.015 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:44 smithi119 ceph-mon[27653]: mgrmap e25: smithi155.wuuxfd(active, since 7s), standbys: smithi119.gwjxmq 2024-09-13T21:44:45.015 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:44 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mgr metadata", "who": "smithi119.gwjxmq", "id": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:44:45.018 INFO:tasks.workunit.client.1.smithi155.stdout:7/47: fsync d5/fb 0 2024-09-13T21:44:45.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.016+0000 7f000effd640 1 -- 172.21.15.119:0/504186577 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f0000000bf0 con 0x7f000806e780 2024-09-13T21:44:45.019 INFO:tasks.workunit.client.0.smithi119.stdout:1/421: dwrite d1/d3/dc/f67 [0,4194304] 0 2024-09-13T21:44:45.020 INFO:tasks.workunit.client.1.smithi155.stdout:0/54: symlink d1/l15 0 2024-09-13T21:44:45.021 INFO:tasks.workunit.client.1.smithi155.stdout:4/74: mkdir d1/d7/de/d15 0 2024-09-13T21:44:45.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.020+0000 7f0024919640 1 -- 172.21.15.119:0/504186577 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f000806e780 msgr2=0x7f0008070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:45.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.020+0000 7f0024919640 1 --2- 172.21.15.119:0/504186577 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f000806e780 0x7f0008070c30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f00100041d0 tx=0x7f0010004330 comp rx=0 tx=0).stop 2024-09-13T21:44:45.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.020+0000 7f0024919640 1 -- 172.21.15.119:0/504186577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00200fc720 msgr2=0x7f0020113c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:45.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.020+0000 7f0024919640 1 --2- 172.21.15.119:0/504186577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00200fc720 0x7f0020113c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f001400b020 tx=0x7f0014009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.021+0000 7f0024919640 1 -- 172.21.15.119:0/504186577 shutdown_connections 2024-09-13T21:44:45.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.021+0000 7f0024919640 1 --2- 172.21.15.119:0/504186577 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f000806e780 0x7f0008070c30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.021+0000 7f0024919640 1 --2- 172.21.15.119:0/504186577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00200fc720 0x7f0020113c20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.021+0000 7f0024919640 1 --2- 172.21.15.119:0/504186577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00200fb450 0x7f00201136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.021+0000 7f0024919640 1 -- 172.21.15.119:0/504186577 >> 172.21.15.119:0/504186577 conn(0x7f00200f6c10 msgr2=0x7f00200660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:45.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.021+0000 7f0024919640 1 -- 172.21.15.119:0/504186577 shutdown_connections 2024-09-13T21:44:45.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.021+0000 7f0024919640 1 -- 172.21.15.119:0/504186577 wait complete. 2024-09-13T21:44:45.023 INFO:tasks.workunit.client.0.smithi119.stdout:1/422: symlink d1/d3/dc/d11/l86 0 2024-09-13T21:44:45.024 INFO:tasks.workunit.client.1.smithi155.stdout:2/29: dwrite d2/f6 [0,4194304] 0 2024-09-13T21:44:45.025 INFO:tasks.workunit.client.1.smithi155.stdout:7/48: write d5/fa [37830,20870] 0 2024-09-13T21:44:45.026 INFO:tasks.workunit.client.1.smithi155.stdout:2/30: write d2/f6 [1604973,93291] 0 2024-09-13T21:44:45.027 INFO:tasks.workunit.client.1.smithi155.stdout:4/75: unlink d1/fb 0 2024-09-13T21:44:45.028 INFO:tasks.workunit.client.1.smithi155.stdout:0/55: mknod d1/d6/dc/c16 0 2024-09-13T21:44:45.030 INFO:tasks.workunit.client.1.smithi155.stdout:5/72: dwrite d5/f10 [0,4194304] 0 2024-09-13T21:44:45.031 INFO:tasks.workunit.client.0.smithi119.stdout:1/423: truncate d1/d3/dc/d11/d19/d2d/f51 2906182 0 2024-09-13T21:44:45.032 INFO:tasks.workunit.client.1.smithi155.stdout:4/76: mknod d1/c16 0 2024-09-13T21:44:45.034 INFO:tasks.workunit.client.1.smithi155.stdout:0/56: symlink d1/d6/l17 0 2024-09-13T21:44:45.035 INFO:tasks.workunit.client.1.smithi155.stdout:5/73: mkdir d5/d16/d19 0 2024-09-13T21:44:45.035 INFO:tasks.workunit.client.1.smithi155.stdout:4/77: chown d1/d7/de 23724416 1 2024-09-13T21:44:45.036 INFO:tasks.workunit.client.0.smithi119.stdout:1/424: symlink d1/d3/d61/d77/d78/d32/d33/l87 0 2024-09-13T21:44:45.038 INFO:tasks.workunit.client.1.smithi155.stdout:5/74: chown d5/d12/c15 174590091 1 2024-09-13T21:44:45.038 INFO:tasks.workunit.client.1.smithi155.stdout:6/35: truncate f3 2879510 0 2024-09-13T21:44:45.039 INFO:tasks.workunit.client.1.smithi155.stdout:7/49: dwrite f3 [0,4194304] 0 2024-09-13T21:44:45.040 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:44:45.041 INFO:tasks.workunit.client.1.smithi155.stdout:4/78: mknod d1/d7/c17 0 2024-09-13T21:44:45.044 INFO:tasks.workunit.client.1.smithi155.stdout:7/50: creat d5/fe x:0 0 0 2024-09-13T21:44:45.045 INFO:tasks.workunit.client.0.smithi119.stdout:9/541: truncate d0/d8/f4b 3906544 0 2024-09-13T21:44:45.045 INFO:tasks.workunit.client.1.smithi155.stdout:7/51: dread - d5/fd zero size 2024-09-13T21:44:45.046 INFO:tasks.workunit.client.1.smithi155.stdout:0/57: link d1/d6/dc/fe d1/d6/dc/f18 0 2024-09-13T21:44:45.047 INFO:tasks.workunit.client.0.smithi119.stdout:9/542: rmdir d0/d4f/d73 0 2024-09-13T21:44:45.048 INFO:tasks.workunit.client.1.smithi155.stdout:6/36: unlink c5 0 2024-09-13T21:44:45.049 INFO:tasks.workunit.client.1.smithi155.stdout:4/79: mknod d1/d7/de/c18 0 2024-09-13T21:44:45.049 INFO:tasks.workunit.client.0.smithi119.stdout:9/543: write d0/d8/d18/d23/d27/d2d/d6e/fa0 [1302234,110467] 0 2024-09-13T21:44:45.051 INFO:tasks.workunit.client.0.smithi119.stdout:9/544: rmdir d0/d8/d18/d23/d27/d2d 39 2024-09-13T21:44:45.052 INFO:tasks.workunit.client.1.smithi155.stdout:7/52: unlink d5/fd 0 2024-09-13T21:44:45.053 INFO:tasks.workunit.client.1.smithi155.stdout:7/53: fsync d5/fc 0 2024-09-13T21:44:45.054 INFO:tasks.workunit.client.1.smithi155.stdout:7/54: write d5/fb [3871662,75719] 0 2024-09-13T21:44:45.055 INFO:tasks.workunit.client.1.smithi155.stdout:7/55: chown d5/fb 15116027 1 2024-09-13T21:44:45.057 INFO:tasks.workunit.client.1.smithi155.stdout:2/31: truncate d2/f6 3350911 0 2024-09-13T21:44:45.058 INFO:tasks.workunit.client.1.smithi155.stdout:6/37: chown f3 1232630196 1 2024-09-13T21:44:45.058 INFO:tasks.workunit.client.1.smithi155.stdout:0/58: creat d1/f19 x:0 0 0 2024-09-13T21:44:45.059 INFO:tasks.workunit.client.1.smithi155.stdout:2/32: creat d2/fa x:0 0 0 2024-09-13T21:44:45.060 INFO:tasks.workunit.client.1.smithi155.stdout:0/59: fsync d1/d6/f13 0 2024-09-13T21:44:45.062 INFO:tasks.workunit.client.1.smithi155.stdout:4/80: getdents d1/d7/de/dc 0 2024-09-13T21:44:45.065 INFO:tasks.workunit.client.1.smithi155.stdout:2/33: mkdir d2/db 0 2024-09-13T21:44:45.069 INFO:tasks.workunit.client.1.smithi155.stdout:0/60: dwrite d1/d6/fb [0,4194304] 0 2024-09-13T21:44:45.069 INFO:tasks.workunit.client.0.smithi119.stdout:9/545: write d0/d19/d1a/f3b [2541709,78148] 0 2024-09-13T21:44:45.071 INFO:tasks.workunit.client.0.smithi119.stdout:1/425: dread d1/d3/d61/d77/d78/d32/d33/d43/f5e [0,4194304] 0 2024-09-13T21:44:45.073 INFO:tasks.workunit.client.0.smithi119.stdout:9/546: creat d0/d8/d18/d23/d27/d2d/d6e/fb7 x:0 0 0 2024-09-13T21:44:45.073 INFO:tasks.workunit.client.0.smithi119.stdout:1/426: truncate d1/d3/dc/d11/d28/f7d 874935 0 2024-09-13T21:44:45.074 INFO:tasks.workunit.client.1.smithi155.stdout:6/38: getdents . 0 2024-09-13T21:44:45.076 INFO:tasks.workunit.client.1.smithi155.stdout:5/75: truncate d5/fe 199617 0 2024-09-13T21:44:45.078 INFO:tasks.workunit.client.0.smithi119.stdout:9/547: creat d0/d8/d18/d23/d27/d2d/d5f/da8/fb8 x:0 0 0 2024-09-13T21:44:45.079 INFO:tasks.workunit.client.1.smithi155.stdout:5/76: fsync d5/fc 0 2024-09-13T21:44:45.080 INFO:tasks.workunit.client.0.smithi119.stdout:9/548: readlink d0/d19/d1a/l4a 0 2024-09-13T21:44:45.080 INFO:tasks.workunit.client.1.smithi155.stdout:4/81: dwrite d1/f4 [0,4194304] 0 2024-09-13T21:44:45.082 INFO:tasks.workunit.client.0.smithi119.stdout:1/427: dwrite d1/d3/dc/d11/f3c [0,4194304] 0 2024-09-13T21:44:45.082 INFO:tasks.workunit.client.0.smithi119.stdout:9/549: mkdir d0/d19/d1a/db9 0 2024-09-13T21:44:45.086 INFO:tasks.workunit.client.0.smithi119.stdout:1/428: unlink d1/d3/dc/d11/d19/d2d/c6a 0 2024-09-13T21:44:45.086 INFO:tasks.workunit.client.1.smithi155.stdout:0/61: dread d1/f5 [0,4194304] 0 2024-09-13T21:44:45.090 INFO:tasks.workunit.client.0.smithi119.stdout:1/429: symlink d1/d3/d61/d77/d78/d32/d33/d43/d74/l88 0 2024-09-13T21:44:45.091 INFO:tasks.workunit.client.1.smithi155.stdout:2/34: dwrite d2/f6 [0,4194304] 0 2024-09-13T21:44:45.091 INFO:tasks.workunit.client.1.smithi155.stdout:6/39: dread f0 [0,4194304] 0 2024-09-13T21:44:45.091 INFO:tasks.workunit.client.1.smithi155.stdout:5/77: mknod d5/c1a 0 2024-09-13T21:44:45.093 INFO:tasks.workunit.client.1.smithi155.stdout:4/82: mknod d1/d7/c19 0 2024-09-13T21:44:45.093 INFO:tasks.workunit.client.0.smithi119.stdout:1/430: symlink d1/d3/d61/d77/d78/d32/l89 0 2024-09-13T21:44:45.094 INFO:tasks.workunit.client.1.smithi155.stdout:0/62: creat d1/d6/dc/f1a x:0 0 0 2024-09-13T21:44:45.095 INFO:tasks.workunit.client.1.smithi155.stdout:2/35: creat d2/fc x:0 0 0 2024-09-13T21:44:45.098 INFO:tasks.workunit.client.0.smithi119.stdout:1/431: rename d1/d3/d61/d7e/l48 to d1/d3/dc/d11/d19/d2d/l8a 0 2024-09-13T21:44:45.098 INFO:tasks.workunit.client.1.smithi155.stdout:6/40: creat f7 x:0 0 0 2024-09-13T21:44:45.100 INFO:tasks.workunit.client.1.smithi155.stdout:2/36: mkdir d2/dd 0 2024-09-13T21:44:45.102 INFO:tasks.workunit.client.1.smithi155.stdout:4/83: dwrite d1/d7/de/dc/ff [0,4194304] 0 2024-09-13T21:44:45.104 INFO:tasks.workunit.client.1.smithi155.stdout:0/63: symlink d1/l1b 0 2024-09-13T21:44:45.106 INFO:tasks.workunit.client.1.smithi155.stdout:6/41: fdatasync f0 0 2024-09-13T21:44:45.106 INFO:tasks.workunit.client.1.smithi155.stdout:6/42: readlink - no filename 2024-09-13T21:44:45.108 INFO:tasks.workunit.client.1.smithi155.stdout:0/64: dread - d1/d6/f12 zero size 2024-09-13T21:44:45.108 INFO:tasks.workunit.client.1.smithi155.stdout:6/43: rename c2 to c8 0 2024-09-13T21:44:45.109 INFO:tasks.workunit.client.1.smithi155.stdout:2/37: mkdir d2/dd/de 0 2024-09-13T21:44:45.109 INFO:tasks.workunit.client.1.smithi155.stdout:6/44: write f7 [41163,19966] 0 2024-09-13T21:44:45.111 INFO:tasks.workunit.client.1.smithi155.stdout:0/65: mknod d1/d6/c1c 0 2024-09-13T21:44:45.113 INFO:tasks.workunit.client.1.smithi155.stdout:4/84: rmdir d1/d12 0 2024-09-13T21:44:45.113 INFO:tasks.workunit.client.1.smithi155.stdout:4/85: fdatasync d1/f6 0 2024-09-13T21:44:45.114 INFO:tasks.workunit.client.1.smithi155.stdout:4/86: fdatasync d1/f4 0 2024-09-13T21:44:45.114 INFO:tasks.workunit.client.1.smithi155.stdout:6/45: truncate f3 1299206 0 2024-09-13T21:44:45.115 INFO:tasks.workunit.client.1.smithi155.stdout:6/46: write f0 [4527936,32658] 0 2024-09-13T21:44:45.115 INFO:tasks.workunit.client.1.smithi155.stdout:2/38: creat d2/dd/de/ff x:0 0 0 2024-09-13T21:44:45.116 INFO:tasks.workunit.client.1.smithi155.stdout:0/66: creat d1/f1d x:0 0 0 2024-09-13T21:44:45.117 INFO:tasks.workunit.client.1.smithi155.stdout:4/87: mkdir d1/d7/de/d1a 0 2024-09-13T21:44:45.117 INFO:tasks.workunit.client.0.smithi119.stdout:3/432: sync 2024-09-13T21:44:45.118 INFO:tasks.workunit.client.1.smithi155.stdout:4/88: chown c0 0 1 2024-09-13T21:44:45.118 INFO:tasks.workunit.client.0.smithi119.stdout:3/433: readlink d6/d15/d1a/l20 0 2024-09-13T21:44:45.118 INFO:tasks.workunit.client.1.smithi155.stdout:4/89: fdatasync d1/f6 0 2024-09-13T21:44:45.119 INFO:tasks.workunit.client.1.smithi155.stdout:2/39: symlink d2/db/l10 0 2024-09-13T21:44:45.119 INFO:tasks.workunit.client.0.smithi119.stdout:3/434: symlink d6/d15/d1a/d45/l90 0 2024-09-13T21:44:45.121 INFO:tasks.workunit.client.1.smithi155.stdout:0/67: truncate d1/d6/f13 3863061 0 2024-09-13T21:44:45.122 INFO:tasks.workunit.client.0.smithi119.stdout:3/435: creat d6/d25/f91 x:0 0 0 2024-09-13T21:44:45.123 INFO:tasks.workunit.client.1.smithi155.stdout:4/90: mkdir d1/d7/de/d15/d1b 0 2024-09-13T21:44:45.124 INFO:tasks.workunit.client.1.smithi155.stdout:0/68: creat d1/d6/f1e x:0 0 0 2024-09-13T21:44:45.124 INFO:tasks.workunit.client.0.smithi119.stdout:9/550: write d0/d19/d1a/f4d [880640,39986] 0 2024-09-13T21:44:45.125 INFO:tasks.workunit.client.0.smithi119.stdout:1/432: write d1/d3/f2a [484741,109908] 0 2024-09-13T21:44:45.126 INFO:tasks.workunit.client.1.smithi155.stdout:4/91: creat d1/f1c x:0 0 0 2024-09-13T21:44:45.127 INFO:tasks.workunit.client.1.smithi155.stdout:2/40: dwrite d2/f6 [0,4194304] 0 2024-09-13T21:44:45.127 INFO:tasks.workunit.client.0.smithi119.stdout:9/551: chown d0/d8/d18/d23/d27/d2d/l7c 582 1 2024-09-13T21:44:45.129 INFO:tasks.workunit.client.1.smithi155.stdout:6/47: getdents . 0 2024-09-13T21:44:45.130 INFO:tasks.workunit.client.1.smithi155.stdout:6/48: chown c8 392246 1 2024-09-13T21:44:45.130 INFO:tasks.workunit.client.0.smithi119.stdout:1/433: chown d1/d3/d61/d77/d78/d32/d33/d72/l84 1327321 1 2024-09-13T21:44:45.132 INFO:tasks.workunit.client.0.smithi119.stdout:1/434: read d1/d3/dc/d11/d28/f3f [5583065,20482] 0 2024-09-13T21:44:45.132 INFO:tasks.workunit.client.1.smithi155.stdout:2/41: dread d2/f6 [0,4194304] 0 2024-09-13T21:44:45.133 INFO:tasks.workunit.client.1.smithi155.stdout:2/42: dread - f1 zero size 2024-09-13T21:44:45.133 INFO:tasks.workunit.client.1.smithi155.stdout:6/49: mknod c9 0 2024-09-13T21:44:45.134 INFO:tasks.workunit.client.0.smithi119.stdout:9/552: dread d0/d8/d18/f94 [0,4194304] 0 2024-09-13T21:44:45.139 INFO:tasks.workunit.client.1.smithi155.stdout:0/69: getdents d1/d6/dc 0 2024-09-13T21:44:45.139 INFO:tasks.workunit.client.1.smithi155.stdout:2/43: rmdir d2 39 2024-09-13T21:44:45.139 INFO:tasks.workunit.client.0.smithi119.stdout:1/435: getdents d1/d3/dc/d11/d3d 0 2024-09-13T21:44:45.140 INFO:tasks.workunit.client.1.smithi155.stdout:0/70: dread - d1/d6/f12 zero size 2024-09-13T21:44:45.141 INFO:tasks.workunit.client.0.smithi119.stdout:3/436: dread d6/d15/f30 [0,4194304] 0 2024-09-13T21:44:45.141 INFO:tasks.workunit.client.1.smithi155.stdout:2/44: write d2/fc [33318,82377] 0 2024-09-13T21:44:45.142 INFO:tasks.workunit.client.0.smithi119.stdout:3/437: readlink d6/d15/d1a/l40 0 2024-09-13T21:44:45.142 INFO:tasks.workunit.client.1.smithi155.stdout:2/45: dread - d2/fa zero size 2024-09-13T21:44:45.143 INFO:tasks.workunit.client.0.smithi119.stdout:1/436: dread - d1/d3/dc/d11/d19/d47/f7c zero size 2024-09-13T21:44:45.144 INFO:tasks.workunit.client.1.smithi155.stdout:0/71: rename d1/d6/dc/f1a to d1/f1f 0 2024-09-13T21:44:45.145 INFO:tasks.workunit.client.1.smithi155.stdout:2/46: mknod d2/dd/c11 0 2024-09-13T21:44:45.146 INFO:tasks.workunit.client.0.smithi119.stdout:1/437: creat d1/d3/d61/d77/d78/d32/d33/d43/d74/f8b x:0 0 0 2024-09-13T21:44:45.146 INFO:tasks.workunit.client.0.smithi119.stdout:3/438: dread d6/d15/f35 [0,4194304] 0 2024-09-13T21:44:45.147 INFO:tasks.workunit.client.1.smithi155.stdout:0/72: creat d1/d6/f20 x:0 0 0 2024-09-13T21:44:45.148 INFO:tasks.workunit.client.0.smithi119.stdout:1/438: mkdir d1/d3/dc/d11/d19/d47/d8c 0 2024-09-13T21:44:45.148 INFO:tasks.workunit.client.0.smithi119.stdout:3/439: fdatasync d6/d15/d1a/f55 0 2024-09-13T21:44:45.149 INFO:tasks.workunit.client.0.smithi119.stdout:3/440: readlink d6/l7f 0 2024-09-13T21:44:45.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.150+0000 7f8d31da4640 1 -- 172.21.15.119:0/617147041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d2c0ff6e0 msgr2=0x7f8d2c101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:45.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.150+0000 7f8d31da4640 1 --2- 172.21.15.119:0/617147041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d2c0ff6e0 0x7f8d2c101ac0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8d200048d0 tx=0x7f8d20009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.150+0000 7f8d31da4640 1 -- 172.21.15.119:0/617147041 shutdown_connections 2024-09-13T21:44:45.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.150+0000 7f8d31da4640 1 --2- 172.21.15.119:0/617147041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d2c0ff6e0 0x7f8d2c101ac0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.150+0000 7f8d31da4640 1 --2- 172.21.15.119:0/617147041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d2c065be0 0x7f8d2c0ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.150+0000 7f8d31da4640 1 -- 172.21.15.119:0/617147041 >> 172.21.15.119:0/617147041 conn(0x7f8d2c0f6c10 msgr2=0x7f8d2c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:45.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.150+0000 7f8d31da4640 1 -- 172.21.15.119:0/617147041 shutdown_connections 2024-09-13T21:44:45.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.150+0000 7f8d31da4640 1 -- 172.21.15.119:0/617147041 wait complete. 2024-09-13T21:44:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.151+0000 7f8d31da4640 1 Processor -- start 2024-09-13T21:44:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.151+0000 7f8d31da4640 1 -- start start 2024-09-13T21:44:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.151+0000 7f8d31da4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d2c065be0 0x7f8d2c10f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.151+0000 7f8d31da4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d2c0ff6e0 0x7f8d2c10f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.151+0000 7f8d31da4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c10fe20 con 0x7f8d2c065be0 2024-09-13T21:44:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.151+0000 7f8d31da4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c110640 con 0x7f8d2c0ff6e0 2024-09-13T21:44:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.151+0000 7f8d2b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d2c065be0 0x7f8d2c10f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.152+0000 7f8d2b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d2c065be0 0x7f8d2c10f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53836/0 (socket says 172.21.15.119:53836) 2024-09-13T21:44:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.152+0000 7f8d2b7fe640 1 -- 172.21.15.119:0/4248774435 learned_addr learned my addr 172.21.15.119:0/4248774435 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:45.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.152+0000 7f8d2affd640 1 --2- 172.21.15.119:0/4248774435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d2c0ff6e0 0x7f8d2c10f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:45.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.152+0000 7f8d2b7fe640 1 -- 172.21.15.119:0/4248774435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d2c0ff6e0 msgr2=0x7f8d2c10f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:45.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.152+0000 7f8d2b7fe640 1 --2- 172.21.15.119:0/4248774435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d2c0ff6e0 0x7f8d2c10f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.154 INFO:tasks.workunit.client.0.smithi119.stdout:9/553: write d0/d4f/d56/fa2 [601635,38842] 0 2024-09-13T21:44:45.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.152+0000 7f8d2b7fe640 1 -- 172.21.15.119:0/4248774435 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20005040 con 0x7f8d2c065be0 2024-09-13T21:44:45.155 INFO:tasks.workunit.client.1.smithi155.stdout:5/78: dwrite f0 [0,4194304] 0 2024-09-13T21:44:45.155 INFO:tasks.workunit.client.1.smithi155.stdout:0/73: getdents d1/d6/dc 0 2024-09-13T21:44:45.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.152+0000 7f8d2b7fe640 1 --2- 172.21.15.119:0/4248774435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d2c065be0 0x7f8d2c10f290 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00eb70 tx=0x7f8d1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:45.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.152+0000 7f8d13fff640 1 -- 172.21.15.119:0/4248774435 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d1c007c30 con 0x7f8d2c065be0 2024-09-13T21:44:45.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.153+0000 7f8d13fff640 1 -- 172.21.15.119:0/4248774435 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8d1c00f040 con 0x7f8d2c065be0 2024-09-13T21:44:45.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.153+0000 7f8d13fff640 1 -- 172.21.15.119:0/4248774435 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d1c00cb80 con 0x7f8d2c065be0 2024-09-13T21:44:45.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.153+0000 7f8d31da4640 1 -- 172.21.15.119:0/4248774435 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2c1108d0 con 0x7f8d2c065be0 2024-09-13T21:44:45.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.153+0000 7f8d31da4640 1 -- 172.21.15.119:0/4248774435 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c110df0 con 0x7f8d2c065be0 2024-09-13T21:44:45.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.155+0000 7f8d11ffb640 1 -- 172.21.15.119:0/4248774435 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0c005210 con 0x7f8d2c065be0 2024-09-13T21:44:45.157 INFO:tasks.workunit.client.1.smithi155.stdout:5/79: fsync d5/d12/f14 0 2024-09-13T21:44:45.157 INFO:tasks.workunit.client.1.smithi155.stdout:6/50: chown f3 5791 1 2024-09-13T21:44:45.157 INFO:tasks.workunit.client.1.smithi155.stdout:2/47: dwrite d2/f6 [0,4194304] 0 2024-09-13T21:44:45.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.155+0000 7f8d13fff640 1 -- 172.21.15.119:0/4248774435 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f8d1c00cce0 con 0x7f8d2c065be0 2024-09-13T21:44:45.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.156+0000 7f8d13fff640 1 --2- 172.21.15.119:0/4248774435 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f8d1406e7b0 0x7f8d14070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:45.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.156+0000 7f8d13fff640 1 -- 172.21.15.119:0/4248774435 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8d1c08dfa0 con 0x7f8d2c065be0 2024-09-13T21:44:45.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.157+0000 7f8d2affd640 1 --2- 172.21.15.119:0/4248774435 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f8d1406e7b0 0x7f8d14070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:45.159 INFO:tasks.workunit.client.1.smithi155.stdout:0/74: fdatasync d1/d6/dc/f18 0 2024-09-13T21:44:45.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.158+0000 7f8d2affd640 1 --2- 172.21.15.119:0/4248774435 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f8d1406e7b0 0x7f8d14070c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8d2002ab40 tx=0x7f8d20035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:45.161 INFO:tasks.workunit.client.1.smithi155.stdout:2/48: mknod d2/db/c12 0 2024-09-13T21:44:45.162 INFO:tasks.workunit.client.1.smithi155.stdout:6/51: link c9 ca 0 2024-09-13T21:44:45.164 INFO:tasks.workunit.client.0.smithi119.stdout:1/439: dread d1/f1b [4194304,4194304] 0 2024-09-13T21:44:45.164 INFO:tasks.workunit.client.0.smithi119.stdout:6/395: sync 2024-09-13T21:44:45.165 INFO:tasks.workunit.client.0.smithi119.stdout:8/476: sync 2024-09-13T21:44:45.165 INFO:tasks.workunit.client.1.smithi155.stdout:3/60: sync 2024-09-13T21:44:45.165 INFO:tasks.workunit.client.1.smithi155.stdout:9/38: sync 2024-09-13T21:44:45.165 INFO:tasks.workunit.client.1.smithi155.stdout:1/48: sync 2024-09-13T21:44:45.166 INFO:tasks.workunit.client.0.smithi119.stdout:6/396: truncate dc/f36 4197091 0 2024-09-13T21:44:45.166 INFO:tasks.workunit.client.1.smithi155.stdout:2/49: creat d2/dd/de/f13 x:0 0 0 2024-09-13T21:44:45.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.164+0000 7f8d13fff640 1 -- 172.21.15.119:0/4248774435 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8d1c057940 con 0x7f8d2c065be0 2024-09-13T21:44:45.167 INFO:tasks.workunit.client.1.smithi155.stdout:0/75: creat d1/f21 x:0 0 0 2024-09-13T21:44:45.167 INFO:tasks.workunit.client.1.smithi155.stdout:5/80: dwrite d5/d16/f18 [0,4194304] 0 2024-09-13T21:44:45.168 INFO:tasks.workunit.client.1.smithi155.stdout:6/52: chown ca 133446370 1 2024-09-13T21:44:45.168 INFO:tasks.workunit.client.1.smithi155.stdout:1/49: truncate d6/fb 750399 0 2024-09-13T21:44:45.169 INFO:tasks.workunit.client.1.smithi155.stdout:0/76: chown d1/d6/dc 1 1 2024-09-13T21:44:45.169 INFO:tasks.workunit.client.1.smithi155.stdout:9/39: creat dc/de/ff x:0 0 0 2024-09-13T21:44:45.170 INFO:tasks.workunit.client.1.smithi155.stdout:2/50: creat d2/dd/de/f14 x:0 0 0 2024-09-13T21:44:45.172 INFO:tasks.workunit.client.0.smithi119.stdout:3/441: creat d6/d15/d1a/d45/d47/d4d/f92 x:0 0 0 2024-09-13T21:44:45.173 INFO:tasks.workunit.client.0.smithi119.stdout:3/442: fdatasync d6/d15/f63 0 2024-09-13T21:44:45.174 INFO:tasks.workunit.client.1.smithi155.stdout:9/40: read fb [3234144,16016] 0 2024-09-13T21:44:45.174 INFO:tasks.workunit.client.1.smithi155.stdout:2/51: stat d2/dd/de/f13 0 2024-09-13T21:44:45.174 INFO:tasks.workunit.client.1.smithi155.stdout:6/53: mkdir db 0 2024-09-13T21:44:45.175 INFO:tasks.workunit.client.0.smithi119.stdout:1/440: symlink d1/d3/d61/d7e/d53/l8d 0 2024-09-13T21:44:45.176 INFO:tasks.workunit.client.0.smithi119.stdout:9/554: write d0/d8/d18/d23/d27/d2d/f5d [493204,96047] 0 2024-09-13T21:44:45.176 INFO:tasks.workunit.client.1.smithi155.stdout:1/50: dread d6/fb [0,4194304] 0 2024-09-13T21:44:45.177 INFO:tasks.workunit.client.1.smithi155.stdout:2/52: write f0 [1765674,31320] 0 2024-09-13T21:44:45.177 INFO:tasks.workunit.client.0.smithi119.stdout:6/397: unlink dc/df/c66 0 2024-09-13T21:44:45.177 INFO:tasks.workunit.client.1.smithi155.stdout:9/41: chown c6 79126746 1 2024-09-13T21:44:45.180 INFO:tasks.workunit.client.1.smithi155.stdout:5/81: mkdir d5/d16/d19/d1b 0 2024-09-13T21:44:45.181 INFO:tasks.workunit.client.0.smithi119.stdout:6/398: chown dc/d3d/d40 430292 1 2024-09-13T21:44:45.181 INFO:tasks.workunit.client.0.smithi119.stdout:9/555: rename d0/c50 to d0/d4f/d56/cba 0 2024-09-13T21:44:45.181 INFO:tasks.workunit.client.1.smithi155.stdout:3/61: getdents d3/d6 0 2024-09-13T21:44:45.181 INFO:tasks.workunit.client.1.smithi155.stdout:3/62: readlink l1 0 2024-09-13T21:44:45.182 INFO:tasks.workunit.client.1.smithi155.stdout:5/82: write d5/d16/f18 [2334053,16859] 0 2024-09-13T21:44:45.182 INFO:tasks.workunit.client.1.smithi155.stdout:2/53: mkdir d2/dd/de/d15 0 2024-09-13T21:44:45.182 INFO:tasks.workunit.client.0.smithi119.stdout:3/443: dwrite d6/d15/d1a/f5b [0,4194304] 0 2024-09-13T21:44:45.184 INFO:tasks.workunit.client.0.smithi119.stdout:3/444: stat d6/d15/l7b 0 2024-09-13T21:44:45.185 INFO:tasks.workunit.client.1.smithi155.stdout:6/54: rename ca to db/cc 0 2024-09-13T21:44:45.185 INFO:tasks.workunit.client.1.smithi155.stdout:2/54: readlink d2/l5 0 2024-09-13T21:44:45.186 INFO:tasks.workunit.client.0.smithi119.stdout:6/399: mkdir dc/dd/d5e/d7a/d7e 0 2024-09-13T21:44:45.186 INFO:tasks.workunit.client.0.smithi119.stdout:3/445: creat d6/d25/d2f/d33/d56/f93 x:0 0 0 2024-09-13T21:44:45.188 INFO:tasks.workunit.client.0.smithi119.stdout:1/441: dwrite d1/d3/d61/d77/d78/d32/f4b [0,4194304] 0 2024-09-13T21:44:45.188 INFO:tasks.workunit.client.1.smithi155.stdout:9/42: dread fb [0,4194304] 0 2024-09-13T21:44:45.189 INFO:tasks.workunit.client.0.smithi119.stdout:1/442: readlink d1/d3/d61/d77/d78/d32/d33/l87 0 2024-09-13T21:44:45.190 INFO:tasks.workunit.client.0.smithi119.stdout:6/400: unlink dc/dd/c28 0 2024-09-13T21:44:45.196 INFO:tasks.workunit.client.0.smithi119.stdout:3/446: getdents d6/d15 0 2024-09-13T21:44:45.200 INFO:tasks.workunit.client.0.smithi119.stdout:3/447: creat d6/d15/d1a/d45/d47/d4d/f94 x:0 0 0 2024-09-13T21:44:45.201 INFO:tasks.workunit.client.0.smithi119.stdout:1/443: dwrite d1/d3/dc/f1c [0,4194304] 0 2024-09-13T21:44:45.202 INFO:tasks.workunit.client.0.smithi119.stdout:6/401: dwrite dc/df/d32/f6c [0,4194304] 0 2024-09-13T21:44:45.207 INFO:tasks.workunit.client.0.smithi119.stdout:1/444: write d1/d3/d61/d77/d78/d32/d33/d43/d74/f8b [438292,29045] 0 2024-09-13T21:44:45.216 INFO:tasks.workunit.client.0.smithi119.stdout:9/556: write d0/d79/f7e [764289,101565] 0 2024-09-13T21:44:45.219 INFO:tasks.workunit.client.0.smithi119.stdout:6/402: link dc/df/l25 dc/df/d6d/l7f 0 2024-09-13T21:44:45.220 INFO:tasks.workunit.client.0.smithi119.stdout:1/445: dwrite d1/d3/d61/d77/d78/d32/f64 [0,4194304] 0 2024-09-13T21:44:45.224 INFO:tasks.workunit.client.0.smithi119.stdout:9/557: mknod d0/d4f/d56/cbb 0 2024-09-13T21:44:45.225 INFO:tasks.workunit.client.0.smithi119.stdout:6/403: symlink dc/df/d32/l80 0 2024-09-13T21:44:45.226 INFO:tasks.workunit.client.0.smithi119.stdout:1/446: mknod d1/d3/d61/d77/d78/c8e 0 2024-09-13T21:44:45.230 INFO:tasks.workunit.client.0.smithi119.stdout:6/404: creat dc/dd/d5e/d7a/f81 x:0 0 0 2024-09-13T21:44:45.231 INFO:tasks.workunit.client.0.smithi119.stdout:9/558: mknod d0/d8/d18/d23/d27/d2d/d70/d80/cbc 0 2024-09-13T21:44:45.234 INFO:tasks.workunit.client.0.smithi119.stdout:9/559: readlink d0/d19/l55 0 2024-09-13T21:44:45.235 INFO:tasks.workunit.client.0.smithi119.stdout:9/560: chown d0/d19/d1a/d92 2107 1 2024-09-13T21:44:45.236 INFO:tasks.workunit.client.0.smithi119.stdout:8/477: dread d1b/f47 [0,4194304] 0 2024-09-13T21:44:45.238 INFO:tasks.workunit.client.0.smithi119.stdout:9/561: creat d0/d19/d1a/d2b/fbd x:0 0 0 2024-09-13T21:44:45.238 INFO:tasks.workunit.client.0.smithi119.stdout:1/447: link d1/d3/d61/d77/d78/c70 d1/d3/d61/d77/d78/d32/d33/d72/c8f 0 2024-09-13T21:44:45.238 INFO:tasks.workunit.client.0.smithi119.stdout:2/465: sync 2024-09-13T21:44:45.238 INFO:tasks.workunit.client.0.smithi119.stdout:5/421: sync 2024-09-13T21:44:45.239 INFO:tasks.workunit.client.0.smithi119.stdout:0/506: sync 2024-09-13T21:44:45.239 INFO:tasks.workunit.client.0.smithi119.stdout:7/516: sync 2024-09-13T21:44:45.239 INFO:tasks.workunit.client.0.smithi119.stdout:4/501: sync 2024-09-13T21:44:45.240 INFO:tasks.workunit.client.0.smithi119.stdout:1/448: rmdir d1/d3/d61/d77/d78/d32 39 2024-09-13T21:44:45.242 INFO:tasks.workunit.client.0.smithi119.stdout:7/517: fsync d8/d3c/f51 0 2024-09-13T21:44:45.243 INFO:tasks.workunit.client.0.smithi119.stdout:4/502: fsync d4/d1e/d28/f2a 0 2024-09-13T21:44:45.243 INFO:tasks.workunit.client.0.smithi119.stdout:2/466: chown d1/l17 571321 1 2024-09-13T21:44:45.244 INFO:tasks.workunit.client.1.smithi155.stdout:3/63: write d3/fa [893533,78746] 0 2024-09-13T21:44:45.244 INFO:tasks.workunit.client.0.smithi119.stdout:5/422: chown d0/d3/d4/d9/f46 9959 1 2024-09-13T21:44:45.244 INFO:tasks.workunit.client.0.smithi119.stdout:3/448: dread d6/d25/d2f/f39 [0,4194304] 0 2024-09-13T21:44:45.245 INFO:tasks.workunit.client.1.smithi155.stdout:3/64: stat d3/d6/fb 0 2024-09-13T21:44:45.246 INFO:tasks.workunit.client.1.smithi155.stdout:1/51: dwrite f1 [4194304,4194304] 0 2024-09-13T21:44:45.246 INFO:tasks.workunit.client.1.smithi155.stdout:0/77: truncate d1/d6/dc/f11 455349 0 2024-09-13T21:44:45.247 INFO:tasks.workunit.client.0.smithi119.stdout:2/467: read - d1/f90 zero size 2024-09-13T21:44:45.247 INFO:tasks.workunit.client.0.smithi119.stdout:5/423: write d0/d3/d4/d9/d14/f29 [12060103,115019] 0 2024-09-13T21:44:45.248 INFO:tasks.workunit.client.0.smithi119.stdout:1/449: symlink d1/d3/d6c/l90 0 2024-09-13T21:44:45.248 INFO:tasks.workunit.client.0.smithi119.stdout:6/405: truncate dc/d3d/d40/f4c 48768 0 2024-09-13T21:44:45.250 INFO:tasks.workunit.client.0.smithi119.stdout:9/562: mknod d0/d8/d18/d23/d27/d2d/d70/d80/daa/db3/cbe 0 2024-09-13T21:44:45.251 INFO:tasks.workunit.client.0.smithi119.stdout:5/424: read d0/d3/d4/d9/f47 [143936,38460] 0 2024-09-13T21:44:45.254 INFO:tasks.workunit.client.0.smithi119.stdout:7/518: dread d8/d3c/d53/d3b/f54 [0,4194304] 0 2024-09-13T21:44:45.256 INFO:tasks.workunit.client.0.smithi119.stdout:4/503: unlink d4/d1e/d28/d34/d6a/d79/f7f 0 2024-09-13T21:44:45.257 INFO:tasks.workunit.client.0.smithi119.stdout:2/468: creat d1/d38/f9a x:0 0 0 2024-09-13T21:44:45.262 INFO:tasks.workunit.client.0.smithi119.stdout:8/478: dwrite d1b/d1d/d48/d54/f9d [0,4194304] 0 2024-09-13T21:44:45.267 INFO:tasks.workunit.client.0.smithi119.stdout:7/519: rename d8/d3c/d53/d3b/d7e/c8e to d8/d3c/d53/d37/d57/d8f/ca0 0 2024-09-13T21:44:45.269 INFO:tasks.workunit.client.0.smithi119.stdout:4/504: dwrite d4/d1e/d28/f8d [0,4194304] 0 2024-09-13T21:44:45.271 INFO:tasks.workunit.client.0.smithi119.stdout:3/449: mkdir d6/d15/d1a/d45/d8d/d95 0 2024-09-13T21:44:45.272 INFO:tasks.workunit.client.0.smithi119.stdout:1/450: symlink d1/d3/dc/d24/l91 0 2024-09-13T21:44:45.272 INFO:tasks.workunit.client.0.smithi119.stdout:2/469: mknod d1/d22/d5a/d5d/c9b 0 2024-09-13T21:44:45.276 INFO:tasks.workunit.client.0.smithi119.stdout:3/450: write d6/d25/d2f/d33/f71 [2473213,127724] 0 2024-09-13T21:44:45.281 INFO:tasks.workunit.client.0.smithi119.stdout:9/563: creat d0/d8/d18/d23/d27/d2d/d5f/fbf x:0 0 0 2024-09-13T21:44:45.281 INFO:tasks.workunit.client.0.smithi119.stdout:2/470: stat d1/d22/d55/d31/c56 0 2024-09-13T21:44:45.283 INFO:tasks.workunit.client.0.smithi119.stdout:1/451: stat d1/d3/d61/d77/d78/l80 0 2024-09-13T21:44:45.285 INFO:tasks.workunit.client.0.smithi119.stdout:8/479: truncate d1b/d1d/d26/d3e/f60 275862 0 2024-09-13T21:44:45.285 INFO:tasks.workunit.client.0.smithi119.stdout:3/451: chown d6/d25/d74/c89 108079 1 2024-09-13T21:44:45.286 INFO:tasks.workunit.client.0.smithi119.stdout:6/406: dwrite dc/df/f12 [4194304,4194304] 0 2024-09-13T21:44:45.290 INFO:tasks.workunit.client.0.smithi119.stdout:6/407: stat dc/df/f27 0 2024-09-13T21:44:45.291 INFO:tasks.workunit.client.0.smithi119.stdout:8/480: stat d1b/f46 0 2024-09-13T21:44:45.291 INFO:tasks.workunit.client.0.smithi119.stdout:7/520: dwrite d8/d3c/d53/d3b/d48/f49 [0,4194304] 0 2024-09-13T21:44:45.293 INFO:tasks.workunit.client.0.smithi119.stdout:5/425: dread d0/d3/d4/d9/d14/f29 [4194304,4194304] 0 2024-09-13T21:44:45.298 INFO:tasks.workunit.client.0.smithi119.stdout:6/408: dread - dc/df/d41/f61 zero size 2024-09-13T21:44:45.300 INFO:tasks.workunit.client.0.smithi119.stdout:5/426: unlink d0/d3/f8b 0 2024-09-13T21:44:45.303 INFO:tasks.workunit.client.0.smithi119.stdout:2/471: unlink d1/c15 0 2024-09-13T21:44:45.304 INFO:tasks.workunit.client.0.smithi119.stdout:7/521: dread d8/d19/d2e/d34/f5d [0,4194304] 0 2024-09-13T21:44:45.304 INFO:tasks.workunit.client.0.smithi119.stdout:9/564: dwrite d0/d8/d18/d23/d27/d2d/d5f/d74/f7f [0,4194304] 0 2024-09-13T21:44:45.305 INFO:tasks.workunit.client.0.smithi119.stdout:3/452: mkdir d6/d25/d2f/d33/d88/d96 0 2024-09-13T21:44:45.309 INFO:tasks.workunit.client.0.smithi119.stdout:1/452: rename d1/d3/l73 to d1/d3/dc/d11/d19/d2d/d59/d6f/l92 0 2024-09-13T21:44:45.313 INFO:tasks.workunit.client.0.smithi119.stdout:4/505: link d4/d1e/d26/f77 d4/d1e/d28/d5d/fa0 0 2024-09-13T21:44:45.315 INFO:tasks.workunit.client.0.smithi119.stdout:9/565: unlink d0/d8/d18/d23/d42/d52/f5c 0 2024-09-13T21:44:45.319 INFO:tasks.workunit.client.0.smithi119.stdout:6/409: rename dc/d3a/f5a to dc/df/d41/f82 0 2024-09-13T21:44:45.319 INFO:tasks.workunit.client.0.smithi119.stdout:8/481: write d1b/f47 [73833,69680] 0 2024-09-13T21:44:45.319 INFO:tasks.workunit.client.0.smithi119.stdout:7/522: dwrite d8/d19/d2e/f81 [0,4194304] 0 2024-09-13T21:44:45.320 INFO:tasks.workunit.client.0.smithi119.stdout:2/472: creat d1/d97/f9c x:0 0 0 2024-09-13T21:44:45.321 INFO:tasks.workunit.client.0.smithi119.stdout:8/482: fdatasync d1b/d1d/d26/f89 0 2024-09-13T21:44:45.321 INFO:tasks.workunit.client.0.smithi119.stdout:3/453: mknod d6/d25/c97 0 2024-09-13T21:44:45.326 INFO:tasks.workunit.client.0.smithi119.stdout:1/453: mkdir d1/d3/dc/d11/d28/d93 0 2024-09-13T21:44:45.327 INFO:tasks.workunit.client.0.smithi119.stdout:4/506: write d4/d1e/d26/d60/d71/f8e [1093957,17018] 0 2024-09-13T21:44:45.330 INFO:tasks.workunit.client.0.smithi119.stdout:1/454: truncate d1/d3/dc/d11/d19/d47/f7c 352716 0 2024-09-13T21:44:45.331 INFO:tasks.workunit.client.1.smithi155.stdout:8/82: sync 2024-09-13T21:44:45.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:44 smithi155 ceph-mon[34732]: mgrmap e25: smithi155.wuuxfd(active, since 7s), standbys: smithi119.gwjxmq 2024-09-13T21:44:45.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:44 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mgr metadata", "who": "smithi119.gwjxmq", "id": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:44:45.333 INFO:tasks.workunit.client.0.smithi119.stdout:6/410: mknod dc/d3d/c83 0 2024-09-13T21:44:45.333 INFO:tasks.workunit.client.0.smithi119.stdout:2/473: mkdir d1/d9d 0 2024-09-13T21:44:45.334 INFO:tasks.workunit.client.0.smithi119.stdout:3/454: mknod d6/d25/d2f/d8e/c98 0 2024-09-13T21:44:45.335 INFO:tasks.workunit.client.0.smithi119.stdout:1/455: dread d1/d3/dc/d11/d19/d2d/f44 [0,4194304] 0 2024-09-13T21:44:45.337 INFO:tasks.workunit.client.0.smithi119.stdout:4/507: mknod d4/d1e/ca1 0 2024-09-13T21:44:45.339 INFO:tasks.workunit.client.0.smithi119.stdout:2/474: chown d1/d22/c3b 5 1 2024-09-13T21:44:45.339 INFO:tasks.workunit.client.0.smithi119.stdout:5/427: dread d0/d3/d4/d9/d14/d24/f6e [0,4194304] 0 2024-09-13T21:44:45.341 INFO:tasks.workunit.client.0.smithi119.stdout:5/428: stat d0/d3/d4/d9/d14 0 2024-09-13T21:44:45.343 INFO:tasks.workunit.client.0.smithi119.stdout:6/411: mknod dc/d3d/c84 0 2024-09-13T21:44:45.343 INFO:tasks.workunit.client.0.smithi119.stdout:6/412: chown dc/dd/d5e/d7a/d7e 1 1 2024-09-13T21:44:45.344 INFO:tasks.workunit.client.0.smithi119.stdout:6/413: fsync dc/df/d41/f7b 0 2024-09-13T21:44:45.348 INFO:tasks.workunit.client.0.smithi119.stdout:6/414: rmdir dc/df/d32 39 2024-09-13T21:44:45.350 INFO:tasks.workunit.client.0.smithi119.stdout:2/475: symlink d1/d38/d89/d6b/l9e 0 2024-09-13T21:44:45.352 INFO:tasks.workunit.client.0.smithi119.stdout:5/429: mknod d0/d3/d4/d9/d14/d24/d25/c9a 0 2024-09-13T21:44:45.352 INFO:tasks.workunit.client.0.smithi119.stdout:9/566: dread d0/d8/d18/d23/f39 [0,4194304] 0 2024-09-13T21:44:45.353 INFO:tasks.workunit.client.0.smithi119.stdout:9/567: chown d0/d8/d18/d23/d27/d2d/d5f/da8 1212 1 2024-09-13T21:44:45.353 INFO:tasks.workunit.client.0.smithi119.stdout:1/456: link d1/d3/dc/d11/d28/f3f d1/d3/d61/d77/f94 0 2024-09-13T21:44:45.355 INFO:tasks.workunit.client.0.smithi119.stdout:6/415: rename dc/d4b/f4a to dc/dd/f85 0 2024-09-13T21:44:45.356 INFO:tasks.workunit.client.0.smithi119.stdout:9/568: write d0/d8/d18/d23/d27/d2d/d5f/da8/fb8 [385276,61965] 0 2024-09-13T21:44:45.358 INFO:tasks.workunit.client.0.smithi119.stdout:8/483: write d1b/d1d/d26/d3e/f4c [1385953,5742] 0 2024-09-13T21:44:45.359 INFO:tasks.workunit.client.0.smithi119.stdout:5/430: chown d0/d3/d4/c26 66 1 2024-09-13T21:44:45.362 INFO:tasks.workunit.client.0.smithi119.stdout:6/416: mkdir dc/dd/d5e/d7a/d86 0 2024-09-13T21:44:45.362 INFO:tasks.workunit.client.0.smithi119.stdout:9/569: dread d0/d19/d1a/d2b/f3e [0,4194304] 0 2024-09-13T21:44:45.362 INFO:tasks.workunit.client.0.smithi119.stdout:2/476: fdatasync d1/d7/f51 0 2024-09-13T21:44:45.364 INFO:tasks.workunit.client.1.smithi155.stdout:5/83: write d5/fa [1113324,97623] 0 2024-09-13T21:44:45.365 INFO:tasks.workunit.client.1.smithi155.stdout:2/55: creat d2/db/f16 x:0 0 0 2024-09-13T21:44:45.365 INFO:tasks.workunit.client.1.smithi155.stdout:0/78: chown d1/f1d 51235997 1 2024-09-13T21:44:45.366 INFO:tasks.workunit.client.0.smithi119.stdout:3/455: write d6/d15/f34 [777289,105317] 0 2024-09-13T21:44:45.366 INFO:tasks.workunit.client.1.smithi155.stdout:9/43: creat dc/de/f10 x:0 0 0 2024-09-13T21:44:45.367 INFO:tasks.workunit.client.0.smithi119.stdout:2/477: fsync d1/d22/d5a/f81 0 2024-09-13T21:44:45.368 INFO:tasks.workunit.client.1.smithi155.stdout:1/52: rename f1 to d6/f16 0 2024-09-13T21:44:45.369 INFO:tasks.workunit.client.0.smithi119.stdout:6/417: symlink dc/dd/d5e/l87 0 2024-09-13T21:44:45.371 INFO:tasks.workunit.client.1.smithi155.stdout:5/84: creat d5/f1c x:0 0 0 2024-09-13T21:44:45.372 INFO:tasks.workunit.client.1.smithi155.stdout:2/56: creat d2/dd/f17 x:0 0 0 2024-09-13T21:44:45.373 INFO:tasks.workunit.client.1.smithi155.stdout:9/44: symlink dc/de/l11 0 2024-09-13T21:44:45.374 INFO:tasks.workunit.client.0.smithi119.stdout:9/570: rename d0/d8 to d0/d8/d18/d23/d27/d2d/d70/d80/dc0 22 2024-09-13T21:44:45.374 INFO:tasks.workunit.client.0.smithi119.stdout:7/523: dwrite d8/d3c/d53/d3b/f54 [0,4194304] 0 2024-09-13T21:44:45.375 INFO:tasks.workunit.client.1.smithi155.stdout:1/53: mkdir d6/d7/d13/d17 0 2024-09-13T21:44:45.376 INFO:tasks.workunit.client.0.smithi119.stdout:6/418: chown dc/df/d41/f82 779 1 2024-09-13T21:44:45.377 INFO:tasks.workunit.client.1.smithi155.stdout:8/83: mknod d2/d8/c17 0 2024-09-13T21:44:45.381 INFO:tasks.workunit.client.1.smithi155.stdout:2/57: write d2/dd/de/f13 [841542,80168] 0 2024-09-13T21:44:45.382 INFO:tasks.workunit.client.0.smithi119.stdout:2/478: creat d1/d38/d89/f9f x:0 0 0 2024-09-13T21:44:45.384 INFO:tasks.workunit.client.1.smithi155.stdout:5/85: dread d5/f7 [0,4194304] 0 2024-09-13T21:44:45.385 INFO:tasks.workunit.client.1.smithi155.stdout:3/65: dwrite d3/f7 [0,4194304] 0 2024-09-13T21:44:45.385 INFO:tasks.workunit.client.1.smithi155.stdout:1/54: write d6/d7/d13/f14 [969465,96772] 0 2024-09-13T21:44:45.385 INFO:tasks.workunit.client.0.smithi119.stdout:4/508: dwrite d4/f53 [0,4194304] 0 2024-09-13T21:44:45.385 INFO:tasks.workunit.client.0.smithi119.stdout:3/456: mknod d6/d15/d1a/d45/d8d/c99 0 2024-09-13T21:44:45.387 INFO:tasks.workunit.client.0.smithi119.stdout:8/484: dwrite d1b/d1d/d48/f90 [0,4194304] 0 2024-09-13T21:44:45.388 INFO:tasks.workunit.client.1.smithi155.stdout:8/84: mknod d2/d6/c18 0 2024-09-13T21:44:45.389 INFO:tasks.workunit.client.1.smithi155.stdout:6/55: dwrite f3 [0,4194304] 0 2024-09-13T21:44:45.391 INFO:tasks.workunit.client.0.smithi119.stdout:1/457: dread d1/d3/dc/d11/f17 [4194304,4194304] 0 2024-09-13T21:44:45.392 INFO:tasks.workunit.client.1.smithi155.stdout:2/58: unlink d2/db/l10 0 2024-09-13T21:44:45.392 INFO:tasks.workunit.client.1.smithi155.stdout:2/59: dread - d2/db/f16 zero size 2024-09-13T21:44:45.393 INFO:tasks.workunit.client.0.smithi119.stdout:7/524: unlink d8/d3c/f7b 0 2024-09-13T21:44:45.393 INFO:tasks.workunit.client.1.smithi155.stdout:5/86: truncate d5/f11 1045909 0 2024-09-13T21:44:45.394 INFO:tasks.workunit.client.1.smithi155.stdout:0/79: dwrite d1/f19 [0,4194304] 0 2024-09-13T21:44:45.395 INFO:tasks.workunit.client.1.smithi155.stdout:3/66: symlink d3/d10/l16 0 2024-09-13T21:44:45.396 INFO:tasks.workunit.client.1.smithi155.stdout:8/85: chown d2/d6/ca 203224003 1 2024-09-13T21:44:45.396 INFO:tasks.workunit.client.1.smithi155.stdout:1/55: creat d6/d15/f18 x:0 0 0 2024-09-13T21:44:45.398 INFO:tasks.workunit.client.1.smithi155.stdout:5/87: dread - d5/d12/f14 zero size 2024-09-13T21:44:45.399 INFO:tasks.workunit.client.0.smithi119.stdout:6/419: creat dc/d3d/d4e/f88 x:0 0 0 2024-09-13T21:44:45.399 INFO:tasks.workunit.client.1.smithi155.stdout:9/45: dwrite dc/de/f10 [0,4194304] 0 2024-09-13T21:44:45.400 INFO:tasks.workunit.client.0.smithi119.stdout:5/431: dread d0/d3/d4/d9/d14/d24/f55 [0,4194304] 0 2024-09-13T21:44:45.400 INFO:tasks.workunit.client.0.smithi119.stdout:3/457: dwrite d6/f3e [0,4194304] 0 2024-09-13T21:44:45.401 INFO:tasks.workunit.client.0.smithi119.stdout:2/479: write d1/f37 [103742,106611] 0 2024-09-13T21:44:45.402 INFO:tasks.workunit.client.0.smithi119.stdout:4/509: unlink d4/d1e/d26/c5b 0 2024-09-13T21:44:45.402 INFO:tasks.workunit.client.1.smithi155.stdout:2/60: truncate d2/dd/de/ff 640937 0 2024-09-13T21:44:45.403 INFO:tasks.workunit.client.0.smithi119.stdout:7/525: truncate d8/d3c/d53/d37/d57/f5c 108541 0 2024-09-13T21:44:45.404 INFO:tasks.workunit.client.0.smithi119.stdout:5/432: readlink d0/d3/d4/d2e/d6b/l79 0 2024-09-13T21:44:45.405 INFO:tasks.workunit.client.0.smithi119.stdout:9/571: mkdir d0/d8/d18/d23/d27/d2d/dc1 0 2024-09-13T21:44:45.407 INFO:tasks.workunit.client.0.smithi119.stdout:1/458: write d1/d3/f13 [1261910,10062] 0 2024-09-13T21:44:45.407 INFO:tasks.workunit.client.0.smithi119.stdout:6/420: creat dc/df/d5c/f89 x:0 0 0 2024-09-13T21:44:45.408 INFO:tasks.workunit.client.1.smithi155.stdout:3/67: mkdir d3/d6/d17 0 2024-09-13T21:44:45.408 INFO:tasks.workunit.client.1.smithi155.stdout:0/80: unlink d1/d6/f7 0 2024-09-13T21:44:45.409 INFO:tasks.workunit.client.0.smithi119.stdout:8/485: mknod d1b/d1d/d26/d3e/d65/c9e 0 2024-09-13T21:44:45.410 INFO:tasks.workunit.client.0.smithi119.stdout:3/458: creat d6/d25/d74/f9a x:0 0 0 2024-09-13T21:44:45.411 INFO:tasks.workunit.client.0.smithi119.stdout:9/572: mknod d0/d4f/d56/cc2 0 2024-09-13T21:44:45.413 INFO:tasks.workunit.client.1.smithi155.stdout:8/86: creat d2/d6/f19 x:0 0 0 2024-09-13T21:44:45.413 INFO:tasks.workunit.client.0.smithi119.stdout:2/480: dread - d1/d22/d5a/f81 zero size 2024-09-13T21:44:45.413 INFO:tasks.workunit.client.0.smithi119.stdout:6/421: mknod dc/dd/d5e/d7a/c8a 0 2024-09-13T21:44:45.415 INFO:tasks.workunit.client.1.smithi155.stdout:1/56: write d6/f16 [1827135,104701] 0 2024-09-13T21:44:45.415 INFO:tasks.workunit.client.1.smithi155.stdout:9/46: chown c9 0 1 2024-09-13T21:44:45.416 INFO:tasks.workunit.client.0.smithi119.stdout:8/486: write d1b/d4e/f67 [660128,65187] 0 2024-09-13T21:44:45.419 INFO:tasks.workunit.client.0.smithi119.stdout:9/573: creat d0/d79/da4/fc3 x:0 0 0 2024-09-13T21:44:45.421 INFO:tasks.workunit.client.1.smithi155.stdout:6/56: dwrite f7 [0,4194304] 0 2024-09-13T21:44:45.422 INFO:tasks.workunit.client.0.smithi119.stdout:6/422: truncate dc/df/f55 118855 0 2024-09-13T21:44:45.422 INFO:tasks.workunit.client.1.smithi155.stdout:9/47: mknod dc/de/c12 0 2024-09-13T21:44:45.424 INFO:tasks.workunit.client.0.smithi119.stdout:3/459: creat d6/d25/d2f/d33/d56/f9b x:0 0 0 2024-09-13T21:44:45.425 INFO:tasks.workunit.client.1.smithi155.stdout:2/61: getdents d2/dd/de 0 2024-09-13T21:44:45.426 INFO:tasks.workunit.client.1.smithi155.stdout:0/81: rename d1/d6/f12 to d1/f22 0 2024-09-13T21:44:45.426 INFO:tasks.workunit.client.0.smithi119.stdout:5/433: dwrite d0/d3/f11 [0,4194304] 0 2024-09-13T21:44:45.426 INFO:tasks.workunit.client.1.smithi155.stdout:3/68: dread d3/f7 [0,4194304] 0 2024-09-13T21:44:45.427 INFO:tasks.workunit.client.1.smithi155.stdout:6/57: rmdir db 39 2024-09-13T21:44:45.430 INFO:tasks.workunit.client.1.smithi155.stdout:8/87: truncate d2/d6/dd/d12/f16 279084 0 2024-09-13T21:44:45.430 INFO:tasks.workunit.client.0.smithi119.stdout:1/459: rename d1/d3/d61/d77/d78/d32/d33/d43/d74/c82 to d1/d3/d61/d77/c95 0 2024-09-13T21:44:45.431 INFO:tasks.workunit.client.1.smithi155.stdout:0/82: creat d1/d6/f23 x:0 0 0 2024-09-13T21:44:45.432 INFO:tasks.workunit.client.1.smithi155.stdout:5/88: dwrite d5/d16/f18 [4194304,4194304] 0 2024-09-13T21:44:45.432 INFO:tasks.workunit.client.1.smithi155.stdout:3/69: symlink d3/d6/l18 0 2024-09-13T21:44:45.433 INFO:tasks.workunit.client.0.smithi119.stdout:4/510: link d4/d1e/d28/d34/l59 d4/d1e/d26/d60/d69/la2 0 2024-09-13T21:44:45.433 INFO:tasks.workunit.client.1.smithi155.stdout:2/62: getdents d2/dd/de/d15 0 2024-09-13T21:44:45.435 INFO:tasks.workunit.client.1.smithi155.stdout:6/58: creat db/fd x:0 0 0 2024-09-13T21:44:45.435 INFO:tasks.workunit.client.0.smithi119.stdout:2/481: dwrite d1/d38/f69 [0,4194304] 0 2024-09-13T21:44:45.437 INFO:tasks.workunit.client.1.smithi155.stdout:3/70: mknod d3/d6/d17/c19 0 2024-09-13T21:44:45.439 INFO:tasks.workunit.client.0.smithi119.stdout:9/574: rmdir d0/d8/d18/d23/d27/d2d 39 2024-09-13T21:44:45.439 INFO:tasks.workunit.client.1.smithi155.stdout:2/63: write f1 [840781,120352] 0 2024-09-13T21:44:45.440 INFO:tasks.workunit.client.0.smithi119.stdout:5/434: write d0/d3/d4/d9/d1e/f91 [458077,39788] 0 2024-09-13T21:44:45.445 INFO:tasks.workunit.client.0.smithi119.stdout:7/526: dwrite d8/d3c/d53/d37/d57/d5f/f78 [0,4194304] 0 2024-09-13T21:44:45.445 INFO:tasks.workunit.client.0.smithi119.stdout:2/482: creat d1/d22/d55/d31/fa0 x:0 0 0 2024-09-13T21:44:45.445 INFO:tasks.workunit.client.0.smithi119.stdout:8/487: dwrite d1b/f46 [0,4194304] 0 2024-09-13T21:44:45.449 INFO:tasks.workunit.client.0.smithi119.stdout:4/511: dread d4/d1e/d26/d60/d71/d83/f49 [0,4194304] 0 2024-09-13T21:44:45.449 INFO:tasks.workunit.client.0.smithi119.stdout:1/460: symlink d1/d3/d61/d77/d78/d32/d33/d43/l96 0 2024-09-13T21:44:45.452 INFO:tasks.workunit.client.0.smithi119.stdout:2/483: fsync d1/d22/d5a/d5d/d77/f96 0 2024-09-13T21:44:45.452 INFO:tasks.workunit.client.1.smithi155.stdout:1/57: fsync d6/d15/f18 0 2024-09-13T21:44:45.455 INFO:tasks.workunit.client.0.smithi119.stdout:1/461: dread d1/f1b [8388608,4194304] 0 2024-09-13T21:44:45.456 INFO:tasks.workunit.client.0.smithi119.stdout:1/462: fsync d1/d3/dc/f5f 0 2024-09-13T21:44:45.458 INFO:tasks.workunit.client.0.smithi119.stdout:2/484: chown d1/d22/d5a/l60 64 1 2024-09-13T21:44:45.459 INFO:tasks.workunit.client.0.smithi119.stdout:9/575: write d0/d8/d18/d23/d27/d2d/d5f/f88 [688037,113782] 0 2024-09-13T21:44:45.462 INFO:tasks.workunit.client.1.smithi155.stdout:0/83: dwrite d1/d6/fb [0,4194304] 0 2024-09-13T21:44:45.464 INFO:tasks.workunit.client.0.smithi119.stdout:5/435: dread d0/d3/d4/d9/d14/d24/d25/d67/f69 [0,4194304] 0 2024-09-13T21:44:45.464 INFO:tasks.workunit.client.1.smithi155.stdout:8/88: dwrite d2/d8/f10 [0,4194304] 0 2024-09-13T21:44:45.465 INFO:tasks.workunit.client.1.smithi155.stdout:2/64: getdents d2/dd 0 2024-09-13T21:44:45.468 INFO:tasks.workunit.client.1.smithi155.stdout:6/59: dwrite f0 [0,4194304] 0 2024-09-13T21:44:45.470 INFO:tasks.workunit.client.0.smithi119.stdout:5/436: chown d0/d3/d4 3888 1 2024-09-13T21:44:45.470 INFO:tasks.workunit.client.1.smithi155.stdout:4/92: sync 2024-09-13T21:44:45.470 INFO:tasks.workunit.client.1.smithi155.stdout:7/56: sync 2024-09-13T21:44:45.473 INFO:tasks.workunit.client.1.smithi155.stdout:2/65: read - d2/dd/de/f14 zero size 2024-09-13T21:44:45.474 INFO:tasks.workunit.client.0.smithi119.stdout:1/463: dwrite d1/d3/dc/d11/d28/f7d [0,4194304] 0 2024-09-13T21:44:45.474 INFO:tasks.workunit.client.0.smithi119.stdout:5/437: fsync d0/d3/d4/d9/f64 0 2024-09-13T21:44:45.475 INFO:tasks.workunit.client.1.smithi155.stdout:9/48: truncate fa 2988338 0 2024-09-13T21:44:45.478 INFO:tasks.workunit.client.1.smithi155.stdout:5/89: dwrite d5/f1c [0,4194304] 0 2024-09-13T21:44:45.479 INFO:tasks.workunit.client.1.smithi155.stdout:0/84: dread - d1/d6/dc/f18 zero size 2024-09-13T21:44:45.479 INFO:tasks.workunit.client.1.smithi155.stdout:3/71: dread d3/d6/fc [0,4194304] 0 2024-09-13T21:44:45.481 INFO:tasks.workunit.client.0.smithi119.stdout:2/485: dwrite d1/d22/d5a/d5d/d77/f96 [0,4194304] 0 2024-09-13T21:44:45.484 INFO:tasks.workunit.client.1.smithi155.stdout:0/85: fdatasync d1/f1d 0 2024-09-13T21:44:45.487 INFO:tasks.workunit.client.1.smithi155.stdout:3/72: chown d3/d6 78973768 1 2024-09-13T21:44:45.489 INFO:tasks.workunit.client.1.smithi155.stdout:8/89: creat d2/d6/f1a x:0 0 0 2024-09-13T21:44:45.491 INFO:tasks.workunit.client.0.smithi119.stdout:1/464: dwrite d1/d3/d61/f85 [0,4194304] 0 2024-09-13T21:44:45.492 INFO:tasks.workunit.client.0.smithi119.stdout:5/438: creat d0/d3/d4/d9/d14/d24/d25/f9b x:0 0 0 2024-09-13T21:44:45.496 INFO:tasks.workunit.client.0.smithi119.stdout:6/423: dwrite dc/d4b/f79 [0,4194304] 0 2024-09-13T21:44:45.496 INFO:tasks.workunit.client.0.smithi119.stdout:1/465: chown d1/d3/dc/f1c 152302362 1 2024-09-13T21:44:45.496 INFO:tasks.workunit.client.1.smithi155.stdout:8/90: fsync d2/f5 0 2024-09-13T21:44:45.498 INFO:tasks.workunit.client.0.smithi119.stdout:5/439: chown d0/d3/d4/d9/f10 3851175 1 2024-09-13T21:44:45.498 INFO:tasks.workunit.client.0.smithi119.stdout:2/486: dread d1/d22/d5a/d5d/d77/f96 [0,4194304] 0 2024-09-13T21:44:45.499 INFO:tasks.workunit.client.1.smithi155.stdout:2/66: dread d2/dd/de/f13 [0,4194304] 0 2024-09-13T21:44:45.499 INFO:tasks.workunit.client.1.smithi155.stdout:3/73: rename d3/f12 to d3/d6/d17/f1a 0 2024-09-13T21:44:45.500 INFO:tasks.workunit.client.1.smithi155.stdout:1/58: dwrite d6/d7/d13/f14 [0,4194304] 0 2024-09-13T21:44:45.502 INFO:tasks.workunit.client.1.smithi155.stdout:5/90: dread d5/f7 [0,4194304] 0 2024-09-13T21:44:45.502 INFO:tasks.workunit.client.1.smithi155.stdout:8/91: chown d2/d6/fe 0 1 2024-09-13T21:44:45.502 INFO:tasks.workunit.client.1.smithi155.stdout:9/49: dread dc/de/f10 [0,4194304] 0 2024-09-13T21:44:45.504 INFO:tasks.workunit.client.0.smithi119.stdout:8/488: truncate d1b/d1d/d48/d54/f9d 661882 0 2024-09-13T21:44:45.506 INFO:tasks.workunit.client.0.smithi119.stdout:1/466: rename d1/d3/dc/d11/d28/l49 to d1/d3/d6c/l97 0 2024-09-13T21:44:45.507 INFO:tasks.workunit.client.1.smithi155.stdout:6/60: dwrite f3 [0,4194304] 0 2024-09-13T21:44:45.508 INFO:tasks.workunit.client.0.smithi119.stdout:5/440: creat d0/d3/d1f/d21/d4f/f9c x:0 0 0 2024-09-13T21:44:45.510 INFO:tasks.workunit.client.0.smithi119.stdout:4/512: dread d4/d1e/d26/d60/d71/d83/f68 [0,4194304] 0 2024-09-13T21:44:45.510 INFO:tasks.workunit.client.1.smithi155.stdout:8/92: write d2/d8/ff [538925,111183] 0 2024-09-13T21:44:45.510 INFO:tasks.workunit.client.1.smithi155.stdout:9/50: mknod dc/de/c13 0 2024-09-13T21:44:45.511 INFO:tasks.workunit.client.0.smithi119.stdout:5/441: stat d0/d3/d4/d9/d74/l92 0 2024-09-13T21:44:45.511 INFO:tasks.workunit.client.1.smithi155.stdout:2/67: creat d2/db/f18 x:0 0 0 2024-09-13T21:44:45.512 INFO:tasks.workunit.client.0.smithi119.stdout:8/489: creat d1b/d4e/d6a/f9f x:0 0 0 2024-09-13T21:44:45.513 INFO:tasks.workunit.client.0.smithi119.stdout:2/487: creat d1/d22/d55/d64/fa1 x:0 0 0 2024-09-13T21:44:45.516 INFO:tasks.workunit.client.0.smithi119.stdout:1/467: creat d1/d3/dc/d11/d3d/f98 x:0 0 0 2024-09-13T21:44:45.520 INFO:tasks.workunit.client.1.smithi155.stdout:6/61: write f0 [5276874,40554] 0 2024-09-13T21:44:45.520 INFO:tasks.workunit.client.0.smithi119.stdout:6/424: creat dc/d3d/f8b x:0 0 0 2024-09-13T21:44:45.521 INFO:tasks.workunit.client.0.smithi119.stdout:4/513: unlink d4/d1e/d10/c58 0 2024-09-13T21:44:45.521 INFO:tasks.workunit.client.1.smithi155.stdout:0/86: dwrite d1/f21 [0,4194304] 0 2024-09-13T21:44:45.522 INFO:tasks.workunit.client.0.smithi119.stdout:7/527: dread f6 [8388608,4194304] 0 2024-09-13T21:44:45.522 INFO:tasks.workunit.client.0.smithi119.stdout:8/490: rename d1b/d1d/d39/l40 to d1b/d1d/d26/d3e/d65/la0 0 2024-09-13T21:44:45.524 INFO:tasks.workunit.client.0.smithi119.stdout:6/425: unlink l5 0 2024-09-13T21:44:45.524 INFO:tasks.workunit.client.1.smithi155.stdout:2/68: chown d2/dd/de/f14 329413 1 2024-09-13T21:44:45.525 INFO:tasks.workunit.client.0.smithi119.stdout:5/442: unlink d0/d3/d4/d9/d14/d24/l44 0 2024-09-13T21:44:45.526 INFO:tasks.workunit.client.0.smithi119.stdout:6/426: dread - dc/d3d/d4e/f74 zero size 2024-09-13T21:44:45.528 INFO:tasks.workunit.client.0.smithi119.stdout:4/514: mknod d4/d1e/d28/d34/d6a/d79/ca3 0 2024-09-13T21:44:45.532 INFO:tasks.workunit.client.1.smithi155.stdout:0/87: mknod d1/d6/dc/c24 0 2024-09-13T21:44:45.532 INFO:tasks.workunit.client.0.smithi119.stdout:2/488: dwrite d1/d7/f11 [4194304,4194304] 0 2024-09-13T21:44:45.536 INFO:tasks.workunit.client.1.smithi155.stdout:3/74: dwrite d3/fa [0,4194304] 0 2024-09-13T21:44:45.536 INFO:tasks.workunit.client.0.smithi119.stdout:5/443: mknod d0/d3/d4/d9/c9d 0 2024-09-13T21:44:45.537 INFO:tasks.workunit.client.1.smithi155.stdout:2/69: dread d2/dd/de/ff [0,4194304] 0 2024-09-13T21:44:45.538 INFO:tasks.workunit.client.0.smithi119.stdout:7/528: creat d8/d3c/d53/d37/fa1 x:0 0 0 2024-09-13T21:44:45.539 INFO:tasks.workunit.client.1.smithi155.stdout:8/93: fsync d2/d8/ff 0 2024-09-13T21:44:45.539 INFO:tasks.workunit.client.0.smithi119.stdout:4/515: creat d4/d1e/d28/d34/d99/fa4 x:0 0 0 2024-09-13T21:44:45.541 INFO:tasks.workunit.client.0.smithi119.stdout:5/444: symlink d0/d3/d4/l9e 0 2024-09-13T21:44:45.544 INFO:tasks.workunit.client.1.smithi155.stdout:5/91: dwrite d5/fe [0,4194304] 0 2024-09-13T21:44:45.544 INFO:tasks.workunit.client.1.smithi155.stdout:0/88: unlink d1/d6/dc/c16 0 2024-09-13T21:44:45.545 INFO:tasks.workunit.client.1.smithi155.stdout:9/51: dread dc/de/f10 [0,4194304] 0 2024-09-13T21:44:45.545 INFO:tasks.workunit.client.0.smithi119.stdout:9/576: dread d0/d8/d18/d23/d27/d2d/d5f/f61 [0,4194304] 0 2024-09-13T21:44:45.546 INFO:tasks.workunit.client.1.smithi155.stdout:6/62: dwrite f7 [0,4194304] 0 2024-09-13T21:44:45.547 INFO:tasks.workunit.client.1.smithi155.stdout:2/70: creat d2/f19 x:0 0 0 2024-09-13T21:44:45.548 INFO:tasks.workunit.client.0.smithi119.stdout:6/427: getdents dc/d3d/d4e 0 2024-09-13T21:44:45.548 INFO:tasks.workunit.client.1.smithi155.stdout:8/94: unlink d2/d6/f11 0 2024-09-13T21:44:45.549 INFO:tasks.workunit.client.1.smithi155.stdout:1/59: dwrite d6/d7/f8 [0,4194304] 0 2024-09-13T21:44:45.549 INFO:tasks.workunit.client.1.smithi155.stdout:3/75: mkdir d3/d6/d1b 0 2024-09-13T21:44:45.550 INFO:tasks.workunit.client.1.smithi155.stdout:6/63: read f7 [112655,99094] 0 2024-09-13T21:44:45.551 INFO:tasks.workunit.client.0.smithi119.stdout:7/529: rename d8/d3c/d96 to d8/d4d/da2 0 2024-09-13T21:44:45.551 INFO:tasks.workunit.client.1.smithi155.stdout:5/92: mknod d5/c1d 0 2024-09-13T21:44:45.552 INFO:tasks.workunit.client.1.smithi155.stdout:9/52: mknod dc/de/c14 0 2024-09-13T21:44:45.553 INFO:tasks.workunit.client.0.smithi119.stdout:4/516: mkdir d4/d1e/d10/da5 0 2024-09-13T21:44:45.553 INFO:tasks.workunit.client.0.smithi119.stdout:5/445: creat d0/d3/d4/d9/d1e/f9f x:0 0 0 2024-09-13T21:44:45.553 INFO:tasks.workunit.client.0.smithi119.stdout:9/577: unlink d0/d19/d1a/d2b/f43 0 2024-09-13T21:44:45.553 INFO:tasks.workunit.client.1.smithi155.stdout:3/76: chown d3/d6/d17/c19 2108366022 1 2024-09-13T21:44:45.554 INFO:tasks.workunit.client.0.smithi119.stdout:9/578: stat d0/d19/f26 0 2024-09-13T21:44:45.557 INFO:tasks.workunit.client.0.smithi119.stdout:7/530: write d8/d19/f25 [1211785,92481] 0 2024-09-13T21:44:45.558 INFO:tasks.workunit.client.0.smithi119.stdout:4/517: fdatasync d4/d1e/d26/d60/d71/f8e 0 2024-09-13T21:44:45.558 INFO:tasks.workunit.client.0.smithi119.stdout:6/428: dwrite dc/df/f24 [0,4194304] 0 2024-09-13T21:44:45.561 INFO:tasks.workunit.client.1.smithi155.stdout:0/89: fsync d1/d6/dc/fe 0 2024-09-13T21:44:45.562 INFO:tasks.workunit.client.1.smithi155.stdout:2/71: mknod d2/dd/c1a 0 2024-09-13T21:44:45.563 INFO:tasks.workunit.client.1.smithi155.stdout:1/60: mknod d6/d15/c19 0 2024-09-13T21:44:45.564 INFO:tasks.workunit.client.1.smithi155.stdout:2/72: truncate d2/db/f18 516421 0 2024-09-13T21:44:45.565 INFO:tasks.workunit.client.1.smithi155.stdout:1/61: write d6/ff [1034858,2566] 0 2024-09-13T21:44:45.565 INFO:tasks.workunit.client.1.smithi155.stdout:2/73: dread - d2/db/f16 zero size 2024-09-13T21:44:45.565 INFO:tasks.workunit.client.1.smithi155.stdout:6/64: rmdir db 39 2024-09-13T21:44:45.568 INFO:tasks.workunit.client.1.smithi155.stdout:9/53: write fb [2250773,20753] 0 2024-09-13T21:44:45.569 INFO:tasks.workunit.client.1.smithi155.stdout:8/95: creat d2/d6/dd/d12/f1b x:0 0 0 2024-09-13T21:44:45.570 INFO:tasks.workunit.client.0.smithi119.stdout:4/518: creat d4/fa6 x:0 0 0 2024-09-13T21:44:45.570 INFO:tasks.workunit.client.1.smithi155.stdout:8/96: stat l0 0 2024-09-13T21:44:45.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.567+0000 7f8d11ffb640 1 -- 172.21.15.119:0/4248774435 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d0c000bc0 con 0x7f8d1406e7b0 2024-09-13T21:44:45.572 INFO:tasks.workunit.client.1.smithi155.stdout:0/90: rename d1/l15 to d1/d6/l25 0 2024-09-13T21:44:45.572 INFO:tasks.workunit.client.1.smithi155.stdout:6/65: dread f3 [0,4194304] 0 2024-09-13T21:44:45.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.571+0000 7f8d13fff640 1 -- 172.21.15.119:0/4248774435 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8d0c000bc0 con 0x7f8d1406e7b0 2024-09-13T21:44:45.574 INFO:tasks.workunit.client.1.smithi155.stdout:2/74: creat d2/db/f1b x:0 0 0 2024-09-13T21:44:45.575 INFO:tasks.workunit.client.1.smithi155.stdout:1/62: creat d6/d7/f1a x:0 0 0 2024-09-13T21:44:45.576 INFO:tasks.workunit.client.0.smithi119.stdout:6/429: rmdir dc/df 39 2024-09-13T21:44:45.576 INFO:tasks.workunit.client.1.smithi155.stdout:5/93: mkdir d5/d16/d19/d1b/d1e 0 2024-09-13T21:44:45.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.575+0000 7f8d11ffb640 1 -- 172.21.15.119:0/4248774435 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f8d1406e7b0 msgr2=0x7f8d14070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:45.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.575+0000 7f8d11ffb640 1 --2- 172.21.15.119:0/4248774435 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f8d1406e7b0 0x7f8d14070c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8d2002ab40 tx=0x7f8d20035040 comp rx=0 tx=0).stop 2024-09-13T21:44:45.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.575+0000 7f8d11ffb640 1 -- 172.21.15.119:0/4248774435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d2c065be0 msgr2=0x7f8d2c10f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:45.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.575+0000 7f8d11ffb640 1 --2- 172.21.15.119:0/4248774435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d2c065be0 0x7f8d2c10f290 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00eb70 tx=0x7f8d1c00b040 comp rx=0 tx=0).stop 2024-09-13T21:44:45.578 INFO:tasks.workunit.client.1.smithi155.stdout:2/75: write d2/fa [185984,3421] 0 2024-09-13T21:44:45.578 INFO:tasks.workunit.client.1.smithi155.stdout:9/54: dwrite fb [0,4194304] 0 2024-09-13T21:44:45.579 INFO:tasks.workunit.client.1.smithi155.stdout:5/94: read d5/d16/f18 [4649045,116378] 0 2024-09-13T21:44:45.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.577+0000 7f8d11ffb640 1 -- 172.21.15.119:0/4248774435 shutdown_connections 2024-09-13T21:44:45.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.577+0000 7f8d11ffb640 1 --2- 172.21.15.119:0/4248774435 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f8d1406e7b0 0x7f8d14070c60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.577+0000 7f8d11ffb640 1 --2- 172.21.15.119:0/4248774435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d2c0ff6e0 0x7f8d2c10f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.577+0000 7f8d11ffb640 1 --2- 172.21.15.119:0/4248774435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d2c065be0 0x7f8d2c10f290 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.577+0000 7f8d11ffb640 1 -- 172.21.15.119:0/4248774435 >> 172.21.15.119:0/4248774435 conn(0x7f8d2c0f6c10 msgr2=0x7f8d2c0fb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:45.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.577+0000 7f8d11ffb640 1 -- 172.21.15.119:0/4248774435 shutdown_connections 2024-09-13T21:44:45.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.577+0000 7f8d11ffb640 1 -- 172.21.15.119:0/4248774435 wait complete. 2024-09-13T21:44:45.580 INFO:tasks.workunit.client.0.smithi119.stdout:5/446: mknod d0/d3/d4/d9/d14/d24/d25/d54/ca0 0 2024-09-13T21:44:45.580 INFO:tasks.workunit.client.0.smithi119.stdout:4/519: chown d4/d1e/d28/d34/d66 10 1 2024-09-13T21:44:45.582 INFO:tasks.workunit.client.1.smithi155.stdout:0/91: rename d1/d6/l9 to d1/d6/l26 0 2024-09-13T21:44:45.582 INFO:tasks.workunit.client.0.smithi119.stdout:9/579: creat d0/d8/d18/d23/d42/fc4 x:0 0 0 2024-09-13T21:44:45.583 INFO:tasks.workunit.client.1.smithi155.stdout:3/77: link d3/ff d3/d6/f1c 0 2024-09-13T21:44:45.583 INFO:tasks.workunit.client.0.smithi119.stdout:6/430: dread dc/d4b/f79 [0,4194304] 0 2024-09-13T21:44:45.584 INFO:tasks.workunit.client.0.smithi119.stdout:4/520: rename d4/d1e to d4/d1e/d26/d60/d69/da7 22 2024-09-13T21:44:45.584 INFO:tasks.workunit.client.1.smithi155.stdout:0/92: chown d1/d6/dc/fe 1386982360 1 2024-09-13T21:44:45.585 INFO:tasks.workunit.client.1.smithi155.stdout:8/97: link d2/d6/f19 d2/d8/f1c 0 2024-09-13T21:44:45.587 INFO:tasks.workunit.client.1.smithi155.stdout:9/55: mkdir dc/de/d15 0 2024-09-13T21:44:45.587 INFO:tasks.workunit.client.1.smithi155.stdout:5/95: dread d5/f17 [0,4194304] 0 2024-09-13T21:44:45.587 INFO:tasks.workunit.client.1.smithi155.stdout:9/56: readlink dc/de/l11 0 2024-09-13T21:44:45.588 INFO:tasks.workunit.client.0.smithi119.stdout:7/531: link d8/d3c/d53/d37/d83/d89/d3d/c7a d8/d3c/d53/d37/d57/d8f/ca3 0 2024-09-13T21:44:45.589 INFO:tasks.workunit.client.1.smithi155.stdout:6/66: symlink db/le 0 2024-09-13T21:44:45.589 INFO:tasks.workunit.client.1.smithi155.stdout:3/78: dread d3/d6/fc [0,4194304] 0 2024-09-13T21:44:45.589 INFO:tasks.workunit.client.0.smithi119.stdout:7/532: fsync d8/d19/f84 0 2024-09-13T21:44:45.589 INFO:tasks.workunit.client.0.smithi119.stdout:6/431: read dc/f31 [1509847,19758] 0 2024-09-13T21:44:45.590 INFO:tasks.workunit.client.0.smithi119.stdout:9/580: symlink d0/d8/d18/d23/d27/d2d/d70/d80/daa/db3/lc5 0 2024-09-13T21:44:45.591 INFO:tasks.workunit.client.1.smithi155.stdout:8/98: dread d2/f5 [0,4194304] 0 2024-09-13T21:44:45.592 INFO:tasks.workunit.client.1.smithi155.stdout:2/76: rename d2/dd/de/ff to d2/dd/de/d15/f1c 0 2024-09-13T21:44:45.592 INFO:tasks.workunit.client.0.smithi119.stdout:4/521: symlink d4/d1e/d10/la8 0 2024-09-13T21:44:45.595 INFO:tasks.workunit.client.0.smithi119.stdout:9/581: dread - d0/d8/d18/d23/d42/fc4 zero size 2024-09-13T21:44:45.596 INFO:tasks.workunit.client.1.smithi155.stdout:6/67: rename db/le to db/lf 0 2024-09-13T21:44:45.596 INFO:tasks.workunit.client.1.smithi155.stdout:6/68: chown f7 13395936 1 2024-09-13T21:44:45.597 INFO:tasks.workunit.client.1.smithi155.stdout:8/99: readlink d2/l13 0 2024-09-13T21:44:45.598 INFO:tasks.workunit.client.0.smithi119.stdout:7/533: creat d8/d3c/d53/d37/fa4 x:0 0 0 2024-09-13T21:44:45.599 INFO:tasks.workunit.client.1.smithi155.stdout:0/93: rename d1/f21 to d1/d6/dc/f27 0 2024-09-13T21:44:45.600 INFO:tasks.workunit.client.1.smithi155.stdout:3/79: creat d3/d6/d1b/f1d x:0 0 0 2024-09-13T21:44:45.601 INFO:tasks.workunit.client.0.smithi119.stdout:9/582: mknod d0/cc6 0 2024-09-13T21:44:45.601 INFO:tasks.workunit.client.0.smithi119.stdout:5/447: dwrite d0/d3/d4/f78 [0,4194304] 0 2024-09-13T21:44:45.602 INFO:tasks.workunit.client.1.smithi155.stdout:8/100: rename d2/d6/dd/d12/f16 to d2/d6/dd/d12/f1d 0 2024-09-13T21:44:45.603 INFO:tasks.workunit.client.0.smithi119.stdout:4/522: truncate d4/d1e/d28/d34/d66/d76/f7e 278079 0 2024-09-13T21:44:45.604 INFO:tasks.workunit.client.0.smithi119.stdout:6/432: dwrite dc/d3d/d40/d6b/f70 [0,4194304] 0 2024-09-13T21:44:45.605 INFO:tasks.workunit.client.1.smithi155.stdout:8/101: write d2/f5 [1399526,58066] 0 2024-09-13T21:44:45.605 INFO:tasks.workunit.client.1.smithi155.stdout:2/77: link d2/f19 d2/db/f1d 0 2024-09-13T21:44:45.605 INFO:tasks.workunit.client.1.smithi155.stdout:3/80: write d3/d6/d17/f1a [823536,35021] 0 2024-09-13T21:44:45.606 INFO:tasks.workunit.client.1.smithi155.stdout:0/94: symlink d1/l28 0 2024-09-13T21:44:45.606 INFO:tasks.workunit.client.1.smithi155.stdout:2/78: stat d2/f19 0 2024-09-13T21:44:45.607 INFO:tasks.workunit.client.0.smithi119.stdout:2/489: dread d1/d7/f9 [0,4194304] 0 2024-09-13T21:44:45.609 INFO:tasks.workunit.client.0.smithi119.stdout:6/433: write dc/dd/f38 [316657,10706] 0 2024-09-13T21:44:45.609 INFO:tasks.workunit.client.1.smithi155.stdout:8/102: dread d2/d6/dd/d12/f1d [0,4194304] 0 2024-09-13T21:44:45.610 INFO:tasks.workunit.client.0.smithi119.stdout:4/523: fsync d4/d1e/d28/d34/f4c 0 2024-09-13T21:44:45.610 INFO:tasks.workunit.client.1.smithi155.stdout:2/79: dread d2/fa [0,4194304] 0 2024-09-13T21:44:45.611 INFO:tasks.workunit.client.0.smithi119.stdout:5/448: unlink d0/d3/d4/d9/d74/f8e 0 2024-09-13T21:44:45.612 INFO:tasks.workunit.client.1.smithi155.stdout:3/81: creat d3/d6/d17/f1e x:0 0 0 2024-09-13T21:44:45.616 INFO:tasks.workunit.client.0.smithi119.stdout:2/490: readlink d1/d38/l30 0 2024-09-13T21:44:45.620 INFO:tasks.workunit.client.1.smithi155.stdout:3/82: write d3/fa [3493638,15540] 0 2024-09-13T21:44:45.622 INFO:tasks.workunit.client.1.smithi155.stdout:8/103: link d2/d8/f1c d2/d6/dd/d12/f1e 0 2024-09-13T21:44:45.622 INFO:tasks.workunit.client.1.smithi155.stdout:8/104: readlink l0 0 2024-09-13T21:44:45.623 INFO:tasks.workunit.client.0.smithi119.stdout:9/583: getdents d0/d19/d1a/db9 0 2024-09-13T21:44:45.623 INFO:tasks.workunit.client.1.smithi155.stdout:9/57: dread fa [0,4194304] 0 2024-09-13T21:44:45.624 INFO:tasks.workunit.client.0.smithi119.stdout:4/524: truncate d4/f27 3782241 0 2024-09-13T21:44:45.624 INFO:tasks.workunit.client.0.smithi119.stdout:6/434: dwrite dc/d3d/d4e/f76 [0,4194304] 0 2024-09-13T21:44:45.625 INFO:tasks.workunit.client.1.smithi155.stdout:9/58: chown l1 28 1 2024-09-13T21:44:45.626 INFO:tasks.workunit.client.1.smithi155.stdout:3/83: fdatasync d3/d6/f1c 0 2024-09-13T21:44:45.627 INFO:tasks.workunit.client.1.smithi155.stdout:3/84: readlink d3/ld 0 2024-09-13T21:44:45.627 INFO:tasks.workunit.client.0.smithi119.stdout:5/449: rename d0/d3/d4/d2e/d4a to d0/d3/d1f/d21/da1 0 2024-09-13T21:44:45.628 INFO:tasks.workunit.client.1.smithi155.stdout:8/105: mkdir d2/d1f 0 2024-09-13T21:44:45.628 INFO:tasks.workunit.client.1.smithi155.stdout:5/96: truncate d5/f17 4849798 0 2024-09-13T21:44:45.629 INFO:tasks.workunit.client.1.smithi155.stdout:9/59: rmdir dc/de 39 2024-09-13T21:44:45.629 INFO:tasks.workunit.client.1.smithi155.stdout:9/60: chown c9 140135 1 2024-09-13T21:44:45.630 INFO:tasks.workunit.client.0.smithi119.stdout:4/525: dread - d4/d1e/d28/d34/d66/f93 zero size 2024-09-13T21:44:45.633 INFO:tasks.workunit.client.0.smithi119.stdout:2/491: dwrite d1/d22/d55/d31/fa0 [0,4194304] 0 2024-09-13T21:44:45.633 INFO:tasks.workunit.client.1.smithi155.stdout:3/85: mkdir d3/d6/d1b/d1f 0 2024-09-13T21:44:45.635 INFO:tasks.workunit.client.0.smithi119.stdout:8/491: dwrite d1b/d4e/d71/f98 [0,4194304] 0 2024-09-13T21:44:45.636 INFO:tasks.workunit.client.1.smithi155.stdout:5/97: rmdir d5 39 2024-09-13T21:44:45.638 INFO:tasks.workunit.client.1.smithi155.stdout:8/106: dwrite d2/d8/f10 [4194304,4194304] 0 2024-09-13T21:44:45.638 INFO:tasks.workunit.client.0.smithi119.stdout:7/534: write d8/d19/f1a [830186,78255] 0 2024-09-13T21:44:45.642 INFO:tasks.workunit.client.1.smithi155.stdout:6/69: chown db/lf 126 1 2024-09-13T21:44:45.642 INFO:tasks.workunit.client.1.smithi155.stdout:3/86: creat d3/d10/f20 x:0 0 0 2024-09-13T21:44:45.643 INFO:tasks.workunit.client.1.smithi155.stdout:3/87: readlink l1 0 2024-09-13T21:44:45.645 INFO:tasks.workunit.client.0.smithi119.stdout:5/450: mknod d0/d3/d4/d9/d14/d24/d25/ca2 0 2024-09-13T21:44:45.647 INFO:tasks.workunit.client.0.smithi119.stdout:5/451: rename d0/d3/d4/d9/d14 to d0/d3/d4/d9/d14/da3 22 2024-09-13T21:44:45.648 INFO:tasks.workunit.client.1.smithi155.stdout:5/98: write d5/f9 [511283,17478] 0 2024-09-13T21:44:45.649 INFO:tasks.workunit.client.1.smithi155.stdout:3/88: truncate d3/d6/d17/f1e 943572 0 2024-09-13T21:44:45.650 INFO:tasks.workunit.client.1.smithi155.stdout:5/99: chown d5/f10 126594 1 2024-09-13T21:44:45.650 INFO:tasks.workunit.client.0.smithi119.stdout:4/526: creat d4/d1e/d26/d60/d69/fa9 x:0 0 0 2024-09-13T21:44:45.651 INFO:tasks.workunit.client.1.smithi155.stdout:6/70: unlink c8 0 2024-09-13T21:44:45.653 INFO:tasks.workunit.client.1.smithi155.stdout:0/95: write d1/f5 [1490125,2812] 0 2024-09-13T21:44:45.654 INFO:tasks.workunit.client.0.smithi119.stdout:7/535: rmdir d8/d3c/d53/d37 39 2024-09-13T21:44:45.654 INFO:tasks.workunit.client.1.smithi155.stdout:6/71: chown f7 424805 1 2024-09-13T21:44:45.655 INFO:tasks.workunit.client.0.smithi119.stdout:7/536: write d8/d4d/f52 [693306,89362] 0 2024-09-13T21:44:45.656 INFO:tasks.workunit.client.0.smithi119.stdout:9/584: symlink d0/d8/d18/d23/d42/d52/d53/lc7 0 2024-09-13T21:44:45.657 INFO:tasks.workunit.client.0.smithi119.stdout:5/452: symlink d0/d3/d1f/d21/la4 0 2024-09-13T21:44:45.657 INFO:tasks.workunit.client.1.smithi155.stdout:9/61: link fb dc/de/f16 0 2024-09-13T21:44:45.657 INFO:tasks.workunit.client.0.smithi119.stdout:2/492: link d1/d22/d5a/f63 d1/d38/fa2 0 2024-09-13T21:44:45.659 INFO:tasks.workunit.client.1.smithi155.stdout:8/107: creat d2/f20 x:0 0 0 2024-09-13T21:44:45.659 INFO:tasks.workunit.client.0.smithi119.stdout:4/527: rename d4/d1e/d28/d34/d66/c8a to d4/d1e/d28/d34/d66/d76/d8f/caa 0 2024-09-13T21:44:45.661 INFO:tasks.workunit.client.1.smithi155.stdout:8/108: stat d2/d8 0 2024-09-13T21:44:45.665 INFO:tasks.workunit.client.1.smithi155.stdout:6/72: link db/fd db/f10 0 2024-09-13T21:44:45.665 INFO:tasks.workunit.client.1.smithi155.stdout:3/89: dwrite d3/d6/fc [0,4194304] 0 2024-09-13T21:44:45.665 INFO:tasks.workunit.client.0.smithi119.stdout:5/453: mkdir d0/d3/d4/d9/d1e/da5 0 2024-09-13T21:44:45.666 INFO:tasks.workunit.client.0.smithi119.stdout:4/528: chown d4/f73 325 1 2024-09-13T21:44:45.666 INFO:tasks.workunit.client.0.smithi119.stdout:7/537: rmdir d8/d3c/d53/d37/d83/d89/d47 39 2024-09-13T21:44:45.667 INFO:tasks.workunit.client.1.smithi155.stdout:5/100: dwrite d5/f10 [4194304,4194304] 0 2024-09-13T21:44:45.668 INFO:tasks.workunit.client.1.smithi155.stdout:9/62: mknod dc/de/d15/c17 0 2024-09-13T21:44:45.669 INFO:tasks.workunit.client.0.smithi119.stdout:0/507: sync 2024-09-13T21:44:45.671 INFO:tasks.workunit.client.0.smithi119.stdout:0/508: fdatasync de/d1c/d2b/d34/f3a 0 2024-09-13T21:44:45.673 INFO:tasks.workunit.client.0.smithi119.stdout:0/509: truncate de/d49/fa4 260272 0 2024-09-13T21:44:45.674 INFO:tasks.workunit.client.0.smithi119.stdout:8/492: dwrite d1b/d1d/d39/f63 [0,4194304] 0 2024-09-13T21:44:45.675 INFO:tasks.workunit.client.0.smithi119.stdout:8/493: fdatasync d1b/d1d/d48/f96 0 2024-09-13T21:44:45.676 INFO:tasks.workunit.client.1.smithi155.stdout:0/96: dread d1/d6/fb [0,4194304] 0 2024-09-13T21:44:45.677 INFO:tasks.workunit.client.0.smithi119.stdout:4/529: truncate d4/d1e/d10/f46 4270411 0 2024-09-13T21:44:45.679 INFO:tasks.workunit.client.0.smithi119.stdout:4/530: write d4/d1e/d28/f2a [3312171,9396] 0 2024-09-13T21:44:45.679 INFO:tasks.workunit.client.1.smithi155.stdout:3/90: dwrite d3/d10/f20 [0,4194304] 0 2024-09-13T21:44:45.680 INFO:tasks.workunit.client.1.smithi155.stdout:3/91: readlink l1 0 2024-09-13T21:44:45.680 INFO:tasks.workunit.client.1.smithi155.stdout:8/109: link d2/d8/f1c d2/d6/dd/d12/f21 0 2024-09-13T21:44:45.681 INFO:tasks.workunit.client.1.smithi155.stdout:3/92: read d3/d6/d17/f1a [950492,46144] 0 2024-09-13T21:44:45.681 INFO:tasks.workunit.client.1.smithi155.stdout:9/63: mkdir dc/d18 0 2024-09-13T21:44:45.682 INFO:tasks.workunit.client.1.smithi155.stdout:8/110: fsync d2/d8/f10 0 2024-09-13T21:44:45.683 INFO:tasks.workunit.client.1.smithi155.stdout:5/101: fsync f0 0 2024-09-13T21:44:45.684 INFO:tasks.workunit.client.0.smithi119.stdout:2/493: getdents d1 0 2024-09-13T21:44:45.686 INFO:tasks.workunit.client.1.smithi155.stdout:9/64: dread fa [0,4194304] 0 2024-09-13T21:44:45.687 INFO:tasks.workunit.client.1.smithi155.stdout:3/93: mkdir d3/d21 0 2024-09-13T21:44:45.687 INFO:tasks.workunit.client.0.smithi119.stdout:5/454: getdents d0/d3/d4/d2e/d65 0 2024-09-13T21:44:45.688 INFO:tasks.workunit.client.1.smithi155.stdout:8/111: write d2/d8/f1c [610956,61043] 0 2024-09-13T21:44:45.690 INFO:tasks.workunit.client.1.smithi155.stdout:0/97: creat d1/f29 x:0 0 0 2024-09-13T21:44:45.693 INFO:tasks.workunit.client.1.smithi155.stdout:5/102: mkdir d5/d16/d19/d1f 0 2024-09-13T21:44:45.694 INFO:tasks.workunit.client.0.smithi119.stdout:0/510: rename de/d1c/d2b/d34/c74 to de/d1c/d2f/d35/d4a/cba 0 2024-09-13T21:44:45.696 INFO:tasks.workunit.client.1.smithi155.stdout:6/73: write f3 [4426275,121077] 0 2024-09-13T21:44:45.696 INFO:tasks.workunit.client.0.smithi119.stdout:2/494: getdents d1/d7/d86 0 2024-09-13T21:44:45.697 INFO:tasks.workunit.client.0.smithi119.stdout:0/511: chown de/d1c/d2f/f6c 80377 1 2024-09-13T21:44:45.697 INFO:tasks.workunit.client.1.smithi155.stdout:0/98: symlink d1/d6/dc/l2a 0 2024-09-13T21:44:45.698 INFO:tasks.workunit.client.1.smithi155.stdout:9/65: mkdir dc/d19 0 2024-09-13T21:44:45.698 INFO:tasks.workunit.client.0.smithi119.stdout:5/455: dwrite d0/d3/f11 [0,4194304] 0 2024-09-13T21:44:45.698 INFO:tasks.workunit.client.0.smithi119.stdout:0/512: dread - de/d49/fb0 zero size 2024-09-13T21:44:45.699 INFO:tasks.workunit.client.1.smithi155.stdout:9/66: dread - dc/de/ff zero size 2024-09-13T21:44:45.699 INFO:tasks.workunit.client.1.smithi155.stdout:6/74: fsync f7 0 2024-09-13T21:44:45.700 INFO:tasks.workunit.client.0.smithi119.stdout:5/456: stat d0/d3/d4/d9/d1e/f38 0 2024-09-13T21:44:45.700 INFO:tasks.workunit.client.1.smithi155.stdout:5/103: creat d5/d16/d19/d1f/f20 x:0 0 0 2024-09-13T21:44:45.701 INFO:tasks.workunit.client.0.smithi119.stdout:5/457: chown d0/d3/d4/d2e/d6b/l79 0 1 2024-09-13T21:44:45.701 INFO:tasks.workunit.client.1.smithi155.stdout:0/99: creat d1/d6/dc/f2b x:0 0 0 2024-09-13T21:44:45.702 INFO:tasks.workunit.client.0.smithi119.stdout:2/495: creat d1/d7/d47/fa3 x:0 0 0 2024-09-13T21:44:45.702 INFO:tasks.workunit.client.0.smithi119.stdout:8/494: dread d1b/d1d/f5f [0,4194304] 0 2024-09-13T21:44:45.703 INFO:tasks.workunit.client.1.smithi155.stdout:5/104: mknod d5/c21 0 2024-09-13T21:44:45.703 INFO:tasks.workunit.client.0.smithi119.stdout:0/513: chown de/d1c/d2b/d76/lb4 1 1 2024-09-13T21:44:45.704 INFO:tasks.workunit.client.1.smithi155.stdout:3/94: write d3/d10/f20 [4584383,38169] 0 2024-09-13T21:44:45.705 INFO:tasks.workunit.client.0.smithi119.stdout:9/585: truncate d0/d8/d18/d23/d42/d52/f8b 2179648 0 2024-09-13T21:44:45.706 INFO:tasks.workunit.client.0.smithi119.stdout:2/496: write d1/d22/d55/d31/fa0 [3486966,108184] 0 2024-09-13T21:44:45.709 INFO:tasks.workunit.client.1.smithi155.stdout:0/100: link d1/f22 d1/d6/f2c 0 2024-09-13T21:44:45.710 INFO:tasks.workunit.client.0.smithi119.stdout:7/538: dread d8/d3c/d53/d3b/d48/f79 [0,4194304] 0 2024-09-13T21:44:45.711 INFO:tasks.workunit.client.1.smithi155.stdout:6/75: dwrite f0 [0,4194304] 0 2024-09-13T21:44:45.711 INFO:tasks.workunit.client.1.smithi155.stdout:0/101: stat d1/d6/f20 0 2024-09-13T21:44:45.711 INFO:tasks.workunit.client.0.smithi119.stdout:4/531: write d4/f2f [1017863,47412] 0 2024-09-13T21:44:45.712 INFO:tasks.workunit.client.1.smithi155.stdout:5/105: mkdir d5/d16/d19/d1b/d22 0 2024-09-13T21:44:45.712 INFO:tasks.workunit.client.1.smithi155.stdout:0/102: chown d1/l1b 223069 1 2024-09-13T21:44:45.713 INFO:tasks.workunit.client.1.smithi155.stdout:8/112: dread d2/d8/f1c [0,4194304] 0 2024-09-13T21:44:45.713 INFO:tasks.workunit.client.0.smithi119.stdout:9/586: unlink d0/d8/d18/c7a 0 2024-09-13T21:44:45.714 INFO:tasks.workunit.client.0.smithi119.stdout:5/458: dread d0/d3/f11 [0,4194304] 0 2024-09-13T21:44:45.715 INFO:tasks.workunit.client.0.smithi119.stdout:0/514: mknod de/d1c/d2f/d35/d50/d83/cbb 0 2024-09-13T21:44:45.715 INFO:tasks.workunit.client.0.smithi119.stdout:9/587: read d0/d19/f59 [419572,98358] 0 2024-09-13T21:44:45.715 INFO:tasks.workunit.client.1.smithi155.stdout:6/76: mkdir db/d11 0 2024-09-13T21:44:45.716 INFO:tasks.workunit.client.1.smithi155.stdout:3/95: getdents d3/d6/d1b/d1f 0 2024-09-13T21:44:45.717 INFO:tasks.workunit.client.1.smithi155.stdout:0/103: dread d1/f5 [0,4194304] 0 2024-09-13T21:44:45.718 INFO:tasks.workunit.client.1.smithi155.stdout:8/113: mknod d2/d8/c22 0 2024-09-13T21:44:45.719 INFO:tasks.workunit.client.1.smithi155.stdout:8/114: chown l0 0 1 2024-09-13T21:44:45.719 INFO:tasks.workunit.client.1.smithi155.stdout:6/77: mkdir db/d12 0 2024-09-13T21:44:45.721 INFO:tasks.workunit.client.1.smithi155.stdout:8/115: chown l0 1636998439 1 2024-09-13T21:44:45.721 INFO:tasks.workunit.client.0.smithi119.stdout:2/497: dread d1/d7/d47/f57 [0,4194304] 0 2024-09-13T21:44:45.721 INFO:tasks.workunit.client.1.smithi155.stdout:5/106: dread d5/f8 [0,4194304] 0 2024-09-13T21:44:45.722 INFO:tasks.workunit.client.1.smithi155.stdout:0/104: truncate d1/d6/dc/f10 240486 0 2024-09-13T21:44:45.723 INFO:tasks.workunit.client.1.smithi155.stdout:3/96: rename d3/d6/d17/f1a to d3/d6/d1b/d1f/f22 0 2024-09-13T21:44:45.723 INFO:tasks.workunit.client.1.smithi155.stdout:0/105: read d1/d6/dc/f27 [2533667,59087] 0 2024-09-13T21:44:45.724 INFO:tasks.workunit.client.1.smithi155.stdout:8/116: dread d2/d6/dd/d12/f1d [0,4194304] 0 2024-09-13T21:44:45.724 INFO:tasks.workunit.client.1.smithi155.stdout:5/107: rmdir d5/d16 39 2024-09-13T21:44:45.725 INFO:tasks.workunit.client.0.smithi119.stdout:0/515: rename de/d4e/d7f/f91 to de/d1c/d2f/d40/fbc 0 2024-09-13T21:44:45.725 INFO:tasks.workunit.client.0.smithi119.stdout:7/539: link d8/d19/d2e/d34/c68 d8/d3c/d53/d37/d83/ca5 0 2024-09-13T21:44:45.725 INFO:tasks.workunit.client.0.smithi119.stdout:2/498: dread - d1/d22/d5a/d5d/d83/f79 zero size 2024-09-13T21:44:45.725 INFO:tasks.workunit.client.0.smithi119.stdout:5/459: read d0/d3/d4/d9/d14/d24/d25/d67/f75 [658316,35014] 0 2024-09-13T21:44:45.726 INFO:tasks.workunit.client.1.smithi155.stdout:3/97: write d3/d10/f20 [4017314,65803] 0 2024-09-13T21:44:45.726 INFO:tasks.workunit.client.1.smithi155.stdout:0/106: fsync d1/d6/f23 0 2024-09-13T21:44:45.726 INFO:tasks.workunit.client.1.smithi155.stdout:6/78: rename db/cc to db/c13 0 2024-09-13T21:44:45.726 INFO:tasks.workunit.client.1.smithi155.stdout:5/108: write d5/f1c [2124116,53189] 0 2024-09-13T21:44:45.727 INFO:tasks.workunit.client.1.smithi155.stdout:3/98: truncate d3/fa 5086883 0 2024-09-13T21:44:45.728 INFO:tasks.workunit.client.0.smithi119.stdout:9/588: creat d0/d19/d1a/d92/fc8 x:0 0 0 2024-09-13T21:44:45.729 INFO:tasks.workunit.client.1.smithi155.stdout:8/117: mknod d2/d1f/c23 0 2024-09-13T21:44:45.729 INFO:tasks.workunit.client.0.smithi119.stdout:0/516: fdatasync de/d1c/d2f/d35/f67 0 2024-09-13T21:44:45.731 INFO:tasks.workunit.client.1.smithi155.stdout:0/107: creat d1/d6/f2d x:0 0 0 2024-09-13T21:44:45.731 INFO:tasks.workunit.client.0.smithi119.stdout:4/532: dwrite d4/d1e/d26/d60/d71/f8e [0,4194304] 0 2024-09-13T21:44:45.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.729+0000 7f4292d12640 1 -- 172.21.15.119:0/3815875016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0fe560 msgr2=0x7f428c0fa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:45.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.729+0000 7f4292d12640 1 --2- 172.21.15.119:0/3815875016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0fe560 0x7f428c0fa6c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f427c0048d0 tx=0x7f427c009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.730+0000 7f4292d12640 1 -- 172.21.15.119:0/3815875016 shutdown_connections 2024-09-13T21:44:45.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.730+0000 7f4292d12640 1 --2- 172.21.15.119:0/3815875016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0fe560 0x7f428c0fa6c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.730+0000 7f4292d12640 1 --2- 172.21.15.119:0/3815875016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f428c0fdc10 0x7f428c0fe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.730+0000 7f4292d12640 1 -- 172.21.15.119:0/3815875016 >> 172.21.15.119:0/3815875016 conn(0x7f428c0f6390 msgr2=0x7f428c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.730+0000 7f4292d12640 1 -- 172.21.15.119:0/3815875016 shutdown_connections 2024-09-13T21:44:45.732 INFO:tasks.workunit.client.1.smithi155.stdout:8/118: write d2/d6/f1a [975785,25923] 0 2024-09-13T21:44:45.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.730+0000 7f4292d12640 1 -- 172.21.15.119:0/3815875016 wait complete. 2024-09-13T21:44:45.733 INFO:tasks.workunit.client.0.smithi119.stdout:7/540: creat d8/d9d/fa6 x:0 0 0 2024-09-13T21:44:45.733 INFO:tasks.workunit.client.1.smithi155.stdout:6/79: link db/f10 db/d11/f14 0 2024-09-13T21:44:45.734 INFO:tasks.workunit.client.1.smithi155.stdout:0/108: chown d1/d6/f23 411927 1 2024-09-13T21:44:45.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.731+0000 7f4292d12640 1 Processor -- start 2024-09-13T21:44:45.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.731+0000 7f4292d12640 1 -- start start 2024-09-13T21:44:45.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.732+0000 7f4292d12640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0fdc10 0x7f428c1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:45.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.732+0000 7f4292d12640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f428c0fe560 0x7f428c113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:45.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.732+0000 7f4292d12640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c114a10 con 0x7f428c0fdc10 2024-09-13T21:44:45.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.732+0000 7f4292d12640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c114b80 con 0x7f428c0fe560 2024-09-13T21:44:45.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.732+0000 7f428bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f428c0fe560 0x7f428c113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:45.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.732+0000 7f428bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f428c0fe560 0x7f428c113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:37958/0 (socket says 172.21.15.119:37958) 2024-09-13T21:44:45.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.732+0000 7f428bfff640 1 -- 172.21.15.119:0/1927264036 learned_addr learned my addr 172.21.15.119:0/1927264036 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:45.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.732+0000 7f4290aae640 1 --2- 172.21.15.119:0/1927264036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0fdc10 0x7f428c1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:45.736 INFO:tasks.workunit.client.1.smithi155.stdout:6/80: chown db/lf 143 1 2024-09-13T21:44:45.736 INFO:tasks.workunit.client.0.smithi119.stdout:4/533: chown d4/d1e/ff 22 1 2024-09-13T21:44:45.736 INFO:tasks.workunit.client.0.smithi119.stdout:8/495: dwrite d1b/d4e/f5a [4194304,4194304] 0 2024-09-13T21:44:45.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.733+0000 7f4290aae640 1 -- 172.21.15.119:0/1927264036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f428c0fe560 msgr2=0x7f428c113c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:45.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.733+0000 7f4290aae640 1 --2- 172.21.15.119:0/1927264036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f428c0fe560 0x7f428c113c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:45.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.733+0000 7f4290aae640 1 -- 172.21.15.119:0/1927264036 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c005040 con 0x7f428c0fdc10 2024-09-13T21:44:45.737 INFO:tasks.workunit.client.0.smithi119.stdout:5/460: truncate d0/d3/d4/d9/f87 114232 0 2024-09-13T21:44:45.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.734+0000 7f4290aae640 1 --2- 172.21.15.119:0/1927264036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0fdc10 0x7f428c1136d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f428000b4e0 tx=0x7f4280009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:45.738 INFO:tasks.workunit.client.0.smithi119.stdout:7/541: chown d8/d3c/d46/f87 1050 1 2024-09-13T21:44:45.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.735+0000 7f42897fa640 1 -- 172.21.15.119:0/1927264036 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f428000f6f0 con 0x7f428c0fdc10 2024-09-13T21:44:45.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.735+0000 7f42897fa640 1 -- 172.21.15.119:0/1927264036 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f428000fcf0 con 0x7f428c0fdc10 2024-09-13T21:44:45.739 INFO:tasks.workunit.client.0.smithi119.stdout:5/461: stat d0/d3/d4/d9/d14/d24/d25/d67/f69 0 2024-09-13T21:44:45.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.735+0000 7f42897fa640 1 -- 172.21.15.119:0/1927264036 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4280011e70 con 0x7f428c0fdc10 2024-09-13T21:44:45.740 INFO:tasks.workunit.client.0.smithi119.stdout:0/517: fdatasync de/d1c/d2f/f43 0 2024-09-13T21:44:45.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.735+0000 7f4292d12640 1 -- 172.21.15.119:0/1927264036 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c114d20 con 0x7f428c0fdc10 2024-09-13T21:44:45.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.737+0000 7f4292d12640 1 -- 172.21.15.119:0/1927264036 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c1151c0 con 0x7f428c0fdc10 2024-09-13T21:44:45.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.738+0000 7f4292d12640 1 -- 172.21.15.119:0/1927264036 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c0fa010 con 0x7f428c0fdc10 2024-09-13T21:44:45.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.740+0000 7f42897fa640 1 -- 172.21.15.119:0/1927264036 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f4280011620 con 0x7f428c0fdc10 2024-09-13T21:44:45.742 INFO:tasks.workunit.client.1.smithi155.stdout:8/119: chown d2/d6/ca 12826574 1 2024-09-13T21:44:45.742 INFO:tasks.workunit.client.1.smithi155.stdout:6/81: mknod db/c15 0 2024-09-13T21:44:45.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.741+0000 7f42897fa640 1 --2- 172.21.15.119:0/1927264036 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f427406e7b0 0x7f4274070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:45.742 INFO:tasks.workunit.client.0.smithi119.stdout:7/542: creat d8/d3c/d53/d37/d57/d8f/fa7 x:0 0 0 2024-09-13T21:44:45.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.741+0000 7f42897fa640 1 -- 172.21.15.119:0/1927264036 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f428008db80 con 0x7f428c0fdc10 2024-09-13T21:44:45.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.741+0000 7f428bfff640 1 --2- 172.21.15.119:0/1927264036 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f427406e7b0 0x7f4274070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:45.743 INFO:tasks.workunit.client.0.smithi119.stdout:4/534: truncate d4/d1e/f36 1322318 0 2024-09-13T21:44:45.744 INFO:tasks.workunit.client.1.smithi155.stdout:8/120: fsync d2/d8/ff 0 2024-09-13T21:44:45.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.742+0000 7f428bfff640 1 --2- 172.21.15.119:0/1927264036 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f427406e7b0 0x7f4274070c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f427c036750 tx=0x7f427c009da0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:45.745 INFO:tasks.workunit.client.0.smithi119.stdout:0/518: symlink de/d1c/d2f/d35/d50/d83/lbd 0 2024-09-13T21:44:45.746 INFO:tasks.workunit.client.1.smithi155.stdout:5/109: dwrite d5/fc [0,4194304] 0 2024-09-13T21:44:45.749 INFO:tasks.workunit.client.0.smithi119.stdout:7/543: write d8/d3c/d53/d37/fa1 [285935,46764] 0 2024-09-13T21:44:45.750 INFO:tasks.workunit.client.1.smithi155.stdout:8/121: readlink d2/l13 0 2024-09-13T21:44:45.750 INFO:tasks.workunit.client.0.smithi119.stdout:9/589: dwrite d0/d8/d18/d23/f51 [0,4194304] 0 2024-09-13T21:44:45.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:45.748+0000 7f42897fa640 1 -- 172.21.15.119:0/1927264036 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f4280057650 con 0x7f428c0fdc10 2024-09-13T21:44:45.751 INFO:tasks.workunit.client.0.smithi119.stdout:5/462: truncate d0/d3/d4/d9/d14/d24/d25/d54/f5f 1853695 0 2024-09-13T21:44:45.751 INFO:tasks.workunit.client.1.smithi155.stdout:8/122: stat d2/d6/dd/d12/f1e 0 2024-09-13T21:44:45.753 INFO:tasks.workunit.client.0.smithi119.stdout:0/519: creat de/d1c/d9c/fbe x:0 0 0 2024-09-13T21:44:45.753 INFO:tasks.workunit.client.1.smithi155.stdout:0/109: rename d1/d6/l25 to d1/d6/l2e 0 2024-09-13T21:44:45.753 INFO:tasks.workunit.client.1.smithi155.stdout:8/123: fsync d2/d6/f1a 0 2024-09-13T21:44:45.754 INFO:tasks.workunit.client.1.smithi155.stdout:6/82: dread f3 [4194304,4194304] 0 2024-09-13T21:44:45.754 INFO:tasks.workunit.client.0.smithi119.stdout:9/590: symlink d0/d8/d18/d23/d42/d52/d53/lc9 0 2024-09-13T21:44:45.755 INFO:tasks.workunit.client.1.smithi155.stdout:5/110: unlink d5/f17 0 2024-09-13T21:44:45.755 INFO:tasks.workunit.client.1.smithi155.stdout:0/110: fdatasync d1/d6/dc/f2b 0 2024-09-13T21:44:45.756 INFO:tasks.workunit.client.0.smithi119.stdout:7/544: symlink d8/d9d/la8 0 2024-09-13T21:44:45.758 INFO:tasks.workunit.client.1.smithi155.stdout:5/111: chown d5/d16/d19/d1f 81 1 2024-09-13T21:44:45.758 INFO:tasks.workunit.client.1.smithi155.stdout:5/112: readlink - no filename 2024-09-13T21:44:45.759 INFO:tasks.workunit.client.0.smithi119.stdout:0/520: symlink de/d3c/d7c/lbf 0 2024-09-13T21:44:45.759 INFO:tasks.workunit.client.1.smithi155.stdout:8/124: truncate d2/d6/dd/d12/f1d 511686 0 2024-09-13T21:44:45.760 INFO:tasks.workunit.client.0.smithi119.stdout:0/521: write de/d1c/d2b/d76/f93 [1310581,100416] 0 2024-09-13T21:44:45.761 INFO:tasks.workunit.client.1.smithi155.stdout:3/99: dread d3/d6/d1b/d1f/f22 [0,4194304] 0 2024-09-13T21:44:45.762 INFO:tasks.workunit.client.1.smithi155.stdout:5/113: write d5/f13 [674358,41437] 0 2024-09-13T21:44:45.762 INFO:tasks.workunit.client.0.smithi119.stdout:9/591: creat d0/d19/d1a/d92/fca x:0 0 0 2024-09-13T21:44:45.762 INFO:tasks.workunit.client.0.smithi119.stdout:5/463: mknod d0/d3/d4/d2e/ca6 0 2024-09-13T21:44:45.763 INFO:tasks.workunit.client.1.smithi155.stdout:0/111: creat d1/f2f x:0 0 0 2024-09-13T21:44:45.763 INFO:tasks.workunit.client.1.smithi155.stdout:3/100: read d3/d6/fc [1831017,59421] 0 2024-09-13T21:44:45.765 INFO:tasks.workunit.client.1.smithi155.stdout:6/83: dread f0 [0,4194304] 0 2024-09-13T21:44:45.767 INFO:tasks.workunit.client.1.smithi155.stdout:8/125: write d2/d8/f1c [1267559,22326] 0 2024-09-13T21:44:45.767 INFO:tasks.workunit.client.1.smithi155.stdout:3/101: fdatasync d3/d6/f1c 0 2024-09-13T21:44:45.768 INFO:tasks.workunit.client.1.smithi155.stdout:5/114: symlink d5/d16/d19/d1f/l23 0 2024-09-13T21:44:45.771 INFO:tasks.workunit.client.1.smithi155.stdout:0/112: symlink d1/l30 0 2024-09-13T21:44:45.772 INFO:tasks.workunit.client.0.smithi119.stdout:4/535: rename d4/d1e/d28/d34/d66/d76/f7e to d4/d1e/d26/d6d/fab 0 2024-09-13T21:44:45.773 INFO:tasks.workunit.client.0.smithi119.stdout:5/464: dwrite d0/d3/d4/d9/d1e/f9f [0,4194304] 0 2024-09-13T21:44:45.773 INFO:tasks.workunit.client.1.smithi155.stdout:3/102: rename d3/f7 to d3/d6/d17/f23 0 2024-09-13T21:44:45.774 INFO:tasks.workunit.client.0.smithi119.stdout:9/592: unlink d0/d8/d18/d23/d42/d52/c77 0 2024-09-13T21:44:45.776 INFO:tasks.workunit.client.1.smithi155.stdout:6/84: truncate db/f10 472433 0 2024-09-13T21:44:45.777 INFO:tasks.workunit.client.0.smithi119.stdout:9/593: readlink d0/d19/d1a/d2b/d60/l3a 0 2024-09-13T21:44:45.777 INFO:tasks.workunit.client.0.smithi119.stdout:9/594: chown d0/d19/d1a/db9 73316 1 2024-09-13T21:44:45.778 INFO:tasks.workunit.client.1.smithi155.stdout:5/115: symlink d5/d16/d19/d1b/d22/l24 0 2024-09-13T21:44:45.779 INFO:tasks.workunit.client.0.smithi119.stdout:7/545: rename d8/d3c/d53/d37/d83/d89/d3d/c7a to d8/d19/d2e/ca9 0 2024-09-13T21:44:45.780 INFO:tasks.workunit.client.1.smithi155.stdout:6/85: stat f7 0 2024-09-13T21:44:45.781 INFO:tasks.workunit.client.1.smithi155.stdout:8/126: dwrite d2/f5 [0,4194304] 0 2024-09-13T21:44:45.782 INFO:tasks.workunit.client.0.smithi119.stdout:0/522: link de/d3c/c53 de/d1c/d59/da8/cc0 0 2024-09-13T21:44:45.784 INFO:tasks.workunit.client.1.smithi155.stdout:6/86: chown db/c13 96 1 2024-09-13T21:44:45.785 INFO:tasks.workunit.client.0.smithi119.stdout:8/496: dread d1b/d1d/d26/d3e/f4c [0,4194304] 0 2024-09-13T21:44:45.787 INFO:tasks.workunit.client.1.smithi155.stdout:8/127: symlink d2/d1f/l24 0 2024-09-13T21:44:45.787 INFO:tasks.workunit.client.1.smithi155.stdout:3/103: write d3/d6/f1c [417688,95887] 0 2024-09-13T21:44:45.789 INFO:tasks.workunit.client.1.smithi155.stdout:3/104: truncate d3/d6/f11 248216 0 2024-09-13T21:44:45.790 INFO:tasks.workunit.client.0.smithi119.stdout:0/523: stat de/l15 0 2024-09-13T21:44:45.790 INFO:tasks.workunit.client.0.smithi119.stdout:5/465: dwrite d0/d3/d4/d9/d14/f29 [8388608,4194304] 0 2024-09-13T21:44:45.791 INFO:tasks.workunit.client.0.smithi119.stdout:7/546: mknod d8/d3c/d53/caa 0 2024-09-13T21:44:45.792 INFO:tasks.workunit.client.1.smithi155.stdout:8/128: mkdir d2/d6/dd/d25 0 2024-09-13T21:44:45.793 INFO:tasks.workunit.client.0.smithi119.stdout:0/524: dread - de/d1c/d2f/d40/fbc zero size 2024-09-13T21:44:45.793 INFO:tasks.workunit.client.1.smithi155.stdout:5/116: getdents d5/d12 0 2024-09-13T21:44:45.794 INFO:tasks.workunit.client.0.smithi119.stdout:8/497: rename d1b/d1d/c24 to d1b/d1d/d39/ca1 0 2024-09-13T21:44:45.794 INFO:tasks.workunit.client.1.smithi155.stdout:8/129: write d2/f5 [2321620,42723] 0 2024-09-13T21:44:45.796 INFO:tasks.workunit.client.1.smithi155.stdout:3/105: getdents d3/d6/d1b/d1f 0 2024-09-13T21:44:45.796 INFO:tasks.workunit.client.0.smithi119.stdout:7/547: fsync d8/d3c/d53/d37/d57/d8f/fa7 0 2024-09-13T21:44:45.797 INFO:tasks.workunit.client.0.smithi119.stdout:5/466: write d0/d3/fc [3801157,78220] 0 2024-09-13T21:44:45.799 INFO:tasks.workunit.client.0.smithi119.stdout:0/525: fsync de/d1c/d2f/d40/fbc 0 2024-09-13T21:44:45.799 INFO:tasks.workunit.client.0.smithi119.stdout:4/536: write d4/d1e/d26/d60/d71/d83/f49 [545080,853] 0 2024-09-13T21:44:45.800 INFO:tasks.workunit.client.0.smithi119.stdout:0/526: rename de to de/d3c/dc1 22 2024-09-13T21:44:45.800 INFO:tasks.workunit.client.0.smithi119.stdout:9/595: write d0/d19/d1a/d2b/f3e [596739,67357] 0 2024-09-13T21:44:45.801 INFO:tasks.workunit.client.1.smithi155.stdout:0/113: dwrite d1/d6/f2c [0,4194304] 0 2024-09-13T21:44:45.801 INFO:tasks.workunit.client.0.smithi119.stdout:7/548: mknod d8/d3c/d53/cab 0 2024-09-13T21:44:45.803 INFO:tasks.workunit.client.0.smithi119.stdout:8/498: creat d1b/d1d/fa2 x:0 0 0 2024-09-13T21:44:45.804 INFO:tasks.workunit.client.1.smithi155.stdout:3/106: getdents d3/d6/d1b/d1f 0 2024-09-13T21:44:45.804 INFO:tasks.workunit.client.1.smithi155.stdout:5/117: rename d5/d16/d19 to d5/d12/d25 0 2024-09-13T21:44:45.805 INFO:tasks.workunit.client.0.smithi119.stdout:4/537: creat d4/d1e/d26/d5e/fac x:0 0 0 2024-09-13T21:44:45.807 INFO:tasks.workunit.client.1.smithi155.stdout:3/107: creat d3/d6/f24 x:0 0 0 2024-09-13T21:44:45.807 INFO:tasks.workunit.client.1.smithi155.stdout:8/130: rename d2/d6/dd to d2/d6/dd/d26 22 2024-09-13T21:44:45.807 INFO:tasks.workunit.client.0.smithi119.stdout:7/549: mkdir d8/d4d/da2/dac 0 2024-09-13T21:44:45.807 INFO:tasks.workunit.client.1.smithi155.stdout:5/118: stat d5/d12/d25/d1b/d1e 0 2024-09-13T21:44:45.808 INFO:tasks.workunit.client.1.smithi155.stdout:3/108: fsync d3/d6/d17/f1e 0 2024-09-13T21:44:45.809 INFO:tasks.workunit.client.0.smithi119.stdout:4/538: stat d4/f52 0 2024-09-13T21:44:45.810 INFO:tasks.workunit.client.1.smithi155.stdout:8/131: creat d2/d6/f27 x:0 0 0 2024-09-13T21:44:45.810 INFO:tasks.workunit.client.0.smithi119.stdout:9/596: rename d0/d8/d18/d23/d27/f3f to d0/d19/d1a/d2b/d60/fcb 0 2024-09-13T21:44:45.812 INFO:tasks.workunit.client.1.smithi155.stdout:6/87: write db/f10 [429598,54418] 0 2024-09-13T21:44:45.814 INFO:tasks.workunit.client.0.smithi119.stdout:7/550: symlink d8/lad 0 2024-09-13T21:44:45.814 INFO:tasks.workunit.client.1.smithi155.stdout:5/119: mkdir d5/d26 0 2024-09-13T21:44:45.814 INFO:tasks.workunit.client.1.smithi155.stdout:8/132: write d2/f20 [820649,93956] 0 2024-09-13T21:44:45.816 INFO:tasks.workunit.client.0.smithi119.stdout:8/499: dwrite d1b/f1f [0,4194304] 0 2024-09-13T21:44:45.817 INFO:tasks.workunit.client.1.smithi155.stdout:0/114: dwrite d1/d6/f8 [0,4194304] 0 2024-09-13T21:44:45.818 INFO:tasks.workunit.client.0.smithi119.stdout:8/500: dread - d1b/d1d/d48/d54/f94 zero size 2024-09-13T21:44:45.818 INFO:tasks.workunit.client.1.smithi155.stdout:6/88: rename db/c13 to db/d11/c16 0 2024-09-13T21:44:45.819 INFO:tasks.workunit.client.1.smithi155.stdout:5/120: mkdir d5/d12/d25/d1b/d27 0 2024-09-13T21:44:45.823 INFO:tasks.workunit.client.0.smithi119.stdout:8/501: mknod d1b/d1d/d26/d6b/ca3 0 2024-09-13T21:44:45.824 INFO:tasks.workunit.client.1.smithi155.stdout:3/109: rename d3/d6 to d3/d25 0 2024-09-13T21:44:45.825 INFO:tasks.workunit.client.1.smithi155.stdout:3/110: fsync d3/d25/f1c 0 2024-09-13T21:44:45.827 INFO:tasks.workunit.client.1.smithi155.stdout:0/115: dwrite d1/d6/f2c [0,4194304] 0 2024-09-13T21:44:45.828 INFO:tasks.workunit.client.1.smithi155.stdout:0/116: dread - d1/d6/f23 zero size 2024-09-13T21:44:45.828 INFO:tasks.workunit.client.0.smithi119.stdout:7/551: dwrite d8/d3c/d53/d37/d83/d89/fa [4194304,4194304] 0 2024-09-13T21:44:45.829 INFO:tasks.workunit.client.0.smithi119.stdout:9/597: link d0/d8/d18/d23/c49 d0/d4f/ccc 0 2024-09-13T21:44:45.836 INFO:tasks.workunit.client.0.smithi119.stdout:0/527: dwrite de/d49/f4c [0,4194304] 0 2024-09-13T21:44:45.836 INFO:tasks.workunit.client.0.smithi119.stdout:5/467: dwrite d0/d3/d4/d9/d14/d24/f31 [0,4194304] 0 2024-09-13T21:44:45.836 INFO:tasks.workunit.client.0.smithi119.stdout:3/460: sync 2024-09-13T21:44:45.843 INFO:tasks.workunit.client.0.smithi119.stdout:7/552: mknod d8/d3c/d53/d37/cae 0 2024-09-13T21:44:45.844 INFO:tasks.workunit.client.1.smithi155.stdout:5/121: mkdir d5/d12/d25/d1b/d28 0 2024-09-13T21:44:45.844 INFO:tasks.workunit.client.0.smithi119.stdout:7/553: fsync d8/f7d 0 2024-09-13T21:44:45.845 INFO:tasks.workunit.client.0.smithi119.stdout:0/528: rename de/d1c/d2f/d35/d4a/d62/f84 to de/d1c/d2b/d76/d9a/fc2 0 2024-09-13T21:44:45.846 INFO:tasks.workunit.client.0.smithi119.stdout:9/598: read d0/d79/f7e [2553239,42361] 0 2024-09-13T21:44:45.847 INFO:tasks.workunit.client.0.smithi119.stdout:8/502: dread d1b/d1d/d26/d3e/f4c [0,4194304] 0 2024-09-13T21:44:45.848 INFO:tasks.workunit.client.1.smithi155.stdout:6/89: link f0 db/d12/f17 0 2024-09-13T21:44:45.850 INFO:tasks.workunit.client.0.smithi119.stdout:5/468: symlink d0/d3/d4/d9/d14/d24/la7 0 2024-09-13T21:44:45.850 INFO:tasks.workunit.client.1.smithi155.stdout:5/122: dread d5/f11 [0,4194304] 0 2024-09-13T21:44:45.851 INFO:tasks.workunit.client.0.smithi119.stdout:9/599: truncate d0/d8/d18/d23/d42/fc4 139234 0 2024-09-13T21:44:45.851 INFO:tasks.workunit.client.0.smithi119.stdout:0/529: mknod de/d1c/d2f/d35/cc3 0 2024-09-13T21:44:45.851 INFO:tasks.workunit.client.1.smithi155.stdout:5/123: truncate d5/fa 1608725 0 2024-09-13T21:44:45.853 INFO:tasks.workunit.client.0.smithi119.stdout:7/554: creat d8/d3c/d53/d37/d83/d89/d47/faf x:0 0 0 2024-09-13T21:44:45.856 INFO:tasks.workunit.client.0.smithi119.stdout:0/530: chown de/d3c/f3d 917229604 1 2024-09-13T21:44:45.857 INFO:tasks.workunit.client.1.smithi155.stdout:0/117: creat d1/f31 x:0 0 0 2024-09-13T21:44:45.857 INFO:tasks.workunit.client.1.smithi155.stdout:5/124: truncate f0 501755 0 2024-09-13T21:44:45.858 INFO:tasks.workunit.client.0.smithi119.stdout:0/531: chown de/d3c/f6d 30 1 2024-09-13T21:44:45.859 INFO:tasks.workunit.client.1.smithi155.stdout:6/90: link c9 db/d11/c18 0 2024-09-13T21:44:45.859 INFO:tasks.workunit.client.0.smithi119.stdout:8/503: dwrite d1b/d1d/d26/d6b/f87 [0,4194304] 0 2024-09-13T21:44:45.860 INFO:tasks.workunit.client.1.smithi155.stdout:5/125: mkdir d5/d12/d25/d1b/d22/d29 0 2024-09-13T21:44:45.860 INFO:tasks.workunit.client.0.smithi119.stdout:0/532: readlink de/d1c/d2f/d35/d50/d83/l92 0 2024-09-13T21:44:45.860 INFO:tasks.workunit.client.1.smithi155.stdout:0/118: symlink d1/l32 0 2024-09-13T21:44:45.861 INFO:tasks.workunit.client.1.smithi155.stdout:5/126: chown d5/f6 3644039 1 2024-09-13T21:44:45.861 INFO:tasks.workunit.client.1.smithi155.stdout:6/91: fsync f3 0 2024-09-13T21:44:45.861 INFO:tasks.workunit.client.0.smithi119.stdout:9/600: link d0/d79/da4/fc3 d0/d8/d18/d23/d27/d2d/d70/d80/fcd 0 2024-09-13T21:44:45.862 INFO:tasks.workunit.client.1.smithi155.stdout:0/119: write d1/f1f [696717,99234] 0 2024-09-13T21:44:45.863 INFO:tasks.workunit.client.0.smithi119.stdout:7/555: dread d8/d19/f1a [0,4194304] 0 2024-09-13T21:44:45.865 INFO:tasks.workunit.client.0.smithi119.stdout:8/504: mkdir d1b/d1d/d26/da4 0 2024-09-13T21:44:45.865 INFO:tasks.workunit.client.0.smithi119.stdout:7/556: truncate d8/f9c 147420 0 2024-09-13T21:44:45.868 INFO:tasks.workunit.client.0.smithi119.stdout:7/557: write d8/f7d [293661,6360] 0 2024-09-13T21:44:45.871 INFO:tasks.workunit.client.1.smithi155.stdout:0/120: dwrite d1/f1d [0,4194304] 0 2024-09-13T21:44:45.874 INFO:tasks.workunit.client.0.smithi119.stdout:8/505: unlink d1b/f20 0 2024-09-13T21:44:45.875 INFO:tasks.workunit.client.1.smithi155.stdout:3/111: write d3/d25/fc [801291,87855] 0 2024-09-13T21:44:45.876 INFO:tasks.workunit.client.0.smithi119.stdout:7/558: symlink d8/d3c/d53/d37/d83/lb0 0 2024-09-13T21:44:45.877 INFO:tasks.workunit.client.1.smithi155.stdout:5/127: dread d5/fe [0,4194304] 0 2024-09-13T21:44:45.877 INFO:tasks.workunit.client.1.smithi155.stdout:5/128: readlink d5/d12/d25/d1b/d22/l24 0 2024-09-13T21:44:45.878 INFO:tasks.workunit.client.1.smithi155.stdout:3/112: symlink d3/d25/l26 0 2024-09-13T21:44:45.880 INFO:tasks.workunit.client.1.smithi155.stdout:6/92: dwrite f0 [4194304,4194304] 0 2024-09-13T21:44:45.880 INFO:tasks.workunit.client.0.smithi119.stdout:3/461: write d6/d44/f5a [514770,12503] 0 2024-09-13T21:44:45.881 INFO:tasks.workunit.client.1.smithi155.stdout:3/113: creat d3/d25/d17/f27 x:0 0 0 2024-09-13T21:44:45.882 INFO:tasks.workunit.client.0.smithi119.stdout:7/559: mkdir d8/d3c/d46/db1 0 2024-09-13T21:44:45.884 INFO:tasks.workunit.client.1.smithi155.stdout:5/129: link d5/d16/f18 d5/d16/f2a 0 2024-09-13T21:44:45.884 INFO:tasks.workunit.client.1.smithi155.stdout:6/93: symlink db/d12/l19 0 2024-09-13T21:44:45.885 INFO:tasks.workunit.client.1.smithi155.stdout:6/94: chown db/d11 2556657 1 2024-09-13T21:44:45.885 INFO:tasks.workunit.client.1.smithi155.stdout:5/130: stat d5/d12/d25 0 2024-09-13T21:44:45.885 INFO:tasks.workunit.client.0.smithi119.stdout:8/506: dwrite d1b/d1d/d48/d58/f74 [0,4194304] 0 2024-09-13T21:44:45.886 INFO:tasks.workunit.client.1.smithi155.stdout:6/95: write db/d12/f17 [6501298,84262] 0 2024-09-13T21:44:45.887 INFO:tasks.workunit.client.1.smithi155.stdout:5/131: write d5/fc [4837379,6917] 0 2024-09-13T21:44:45.888 INFO:tasks.workunit.client.1.smithi155.stdout:3/114: dread d3/fa [0,4194304] 0 2024-09-13T21:44:45.889 INFO:tasks.workunit.client.1.smithi155.stdout:5/132: stat d5/d12/d25 0 2024-09-13T21:44:45.889 INFO:tasks.workunit.client.1.smithi155.stdout:6/96: truncate db/f10 1095062 0 2024-09-13T21:44:45.890 INFO:tasks.workunit.client.1.smithi155.stdout:6/97: chown db/f10 647802 1 2024-09-13T21:44:45.891 INFO:tasks.workunit.client.0.smithi119.stdout:3/462: dwrite d6/d25/d2f/f39 [0,4194304] 0 2024-09-13T21:44:45.891 INFO:tasks.workunit.client.1.smithi155.stdout:3/115: symlink d3/d25/d1b/l28 0 2024-09-13T21:44:45.891 INFO:tasks.workunit.client.0.smithi119.stdout:8/507: read d1b/f46 [582667,41855] 0 2024-09-13T21:44:45.892 INFO:tasks.workunit.client.1.smithi155.stdout:3/116: dread - d3/d25/d1b/f1d zero size 2024-09-13T21:44:45.892 INFO:tasks.workunit.client.0.smithi119.stdout:3/463: truncate d6/f3e 4986169 0 2024-09-13T21:44:45.895 INFO:tasks.workunit.client.1.smithi155.stdout:3/117: write d3/d25/f24 [849762,29297] 0 2024-09-13T21:44:45.897 INFO:tasks.workunit.client.0.smithi119.stdout:7/560: creat d8/d3c/d53/d37/d83/fb2 x:0 0 0 2024-09-13T21:44:45.899 INFO:tasks.workunit.client.0.smithi119.stdout:3/464: creat d6/d15/d1a/d45/d47/d4d/f9c x:0 0 0 2024-09-13T21:44:45.901 INFO:tasks.workunit.client.0.smithi119.stdout:3/465: read - d6/d15/d1a/d45/d47/d4d/f73 zero size 2024-09-13T21:44:45.902 INFO:tasks.workunit.client.0.smithi119.stdout:8/508: unlink d1b/d1d/c2c 0 2024-09-13T21:44:45.902 INFO:tasks.workunit.client.0.smithi119.stdout:8/509: readlink d1b/d1d/l45 0 2024-09-13T21:44:45.903 INFO:tasks.workunit.client.1.smithi155.stdout:3/118: symlink d3/l29 0 2024-09-13T21:44:45.903 INFO:tasks.workunit.client.1.smithi155.stdout:6/98: dwrite f0 [8388608,4194304] 0 2024-09-13T21:44:45.909 INFO:tasks.workunit.client.1.smithi155.stdout:3/119: mknod d3/d10/c2a 0 2024-09-13T21:44:45.909 INFO:tasks.workunit.client.0.smithi119.stdout:3/466: rename d6/d15/c19 to d6/d15/d1a/d45/d8d/c9d 0 2024-09-13T21:44:45.910 INFO:tasks.workunit.client.1.smithi155.stdout:6/99: creat db/d12/f1a x:0 0 0 2024-09-13T21:44:45.911 INFO:tasks.workunit.client.1.smithi155.stdout:0/121: dwrite d1/d6/dc/f18 [0,4194304] 0 2024-09-13T21:44:45.911 INFO:tasks.workunit.client.0.smithi119.stdout:8/510: link d1b/d1d/d26/d3e/f7d d1b/d1d/d48/d58/d7f/fa5 0 2024-09-13T21:44:45.912 INFO:tasks.workunit.client.0.smithi119.stdout:3/467: rmdir d6/d15 39 2024-09-13T21:44:45.913 INFO:tasks.workunit.client.0.smithi119.stdout:9/601: dwrite d0/d19/d1a/f1f [4194304,4194304] 0 2024-09-13T21:44:45.913 INFO:tasks.workunit.client.0.smithi119.stdout:8/511: fdatasync f9 0 2024-09-13T21:44:45.914 INFO:tasks.workunit.client.0.smithi119.stdout:3/468: read - d6/d44/f80 zero size 2024-09-13T21:44:45.915 INFO:tasks.workunit.client.1.smithi155.stdout:3/120: dread d3/d25/f1c [0,4194304] 0 2024-09-13T21:44:45.917 INFO:tasks.workunit.client.0.smithi119.stdout:8/512: write d1b/d1d/d48/d58/f79 [1404684,50141] 0 2024-09-13T21:44:45.920 INFO:tasks.workunit.client.1.smithi155.stdout:3/121: unlink d3/d25/f24 0 2024-09-13T21:44:45.923 INFO:tasks.workunit.client.0.smithi119.stdout:9/602: mknod d0/d8/d18/d23/d27/d2d/d70/d80/daa/cce 0 2024-09-13T21:44:45.923 INFO:tasks.workunit.client.1.smithi155.stdout:3/122: stat d3/d25/l26 0 2024-09-13T21:44:45.924 INFO:tasks.workunit.client.1.smithi155.stdout:6/100: dwrite db/fd [0,4194304] 0 2024-09-13T21:44:45.924 INFO:tasks.workunit.client.0.smithi119.stdout:5/469: dread d0/d3/d4/d9/f10 [0,4194304] 0 2024-09-13T21:44:45.925 INFO:tasks.workunit.client.0.smithi119.stdout:9/603: readlink d0/d8/d18/d23/d42/d52/d53/l6f 0 2024-09-13T21:44:45.926 INFO:tasks.workunit.client.1.smithi155.stdout:6/101: read f3 [4035233,19571] 0 2024-09-13T21:44:45.926 INFO:tasks.workunit.client.1.smithi155.stdout:0/122: dwrite d1/d6/fb [0,4194304] 0 2024-09-13T21:44:45.927 INFO:tasks.workunit.client.0.smithi119.stdout:5/470: mknod d0/d3/d4/d2e/d6b/ca8 0 2024-09-13T21:44:45.927 INFO:tasks.workunit.client.0.smithi119.stdout:8/513: truncate d1b/d1d/d48/d54/f94 629572 0 2024-09-13T21:44:45.928 INFO:tasks.workunit.client.0.smithi119.stdout:5/471: fdatasync d0/d3/d4/f5e 0 2024-09-13T21:44:45.932 INFO:tasks.workunit.client.0.smithi119.stdout:3/469: link d6/d15/d1a/d45/d47/d4d/f9c d6/d15/d1a/d45/f9e 0 2024-09-13T21:44:45.933 INFO:tasks.workunit.client.0.smithi119.stdout:3/470: chown d6/d15/d1a/d45/d47/d4d/f94 241170 1 2024-09-13T21:44:45.935 INFO:tasks.workunit.client.0.smithi119.stdout:5/472: creat d0/d3/d1f/d21/fa9 x:0 0 0 2024-09-13T21:44:45.935 INFO:tasks.workunit.client.1.smithi155.stdout:3/123: creat d3/d21/f2b x:0 0 0 2024-09-13T21:44:45.935 INFO:tasks.workunit.client.0.smithi119.stdout:8/514: getdents d1b/d1d/d26/da4 0 2024-09-13T21:44:45.937 INFO:tasks.workunit.client.0.smithi119.stdout:9/604: creat d0/d8/d18/d23/d27/d2d/d5f/fcf x:0 0 0 2024-09-13T21:44:45.939 INFO:tasks.workunit.client.1.smithi155.stdout:3/124: mkdir d3/d21/d2c 0 2024-09-13T21:44:45.939 INFO:tasks.workunit.client.1.smithi155.stdout:0/123: dwrite d1/f22 [0,4194304] 0 2024-09-13T21:44:45.939 INFO:tasks.workunit.client.0.smithi119.stdout:3/471: mkdir d6/d9f 0 2024-09-13T21:44:45.940 INFO:tasks.workunit.client.1.smithi155.stdout:0/124: stat d1/d6/dc 0 2024-09-13T21:44:45.942 INFO:tasks.workunit.client.1.smithi155.stdout:6/102: dwrite f0 [4194304,4194304] 0 2024-09-13T21:44:45.944 INFO:tasks.workunit.client.1.smithi155.stdout:3/125: rename d3/d10/c13 to d3/d25/c2d 0 2024-09-13T21:44:45.945 INFO:tasks.workunit.client.1.smithi155.stdout:6/103: symlink db/d11/l1b 0 2024-09-13T21:44:45.946 INFO:tasks.workunit.client.0.smithi119.stdout:5/473: dwrite d0/d3/d1f/d21/f34 [8388608,4194304] 0 2024-09-13T21:44:45.946 INFO:tasks.workunit.client.1.smithi155.stdout:6/104: chown db/d12/l19 10376505 1 2024-09-13T21:44:45.947 INFO:tasks.workunit.client.1.smithi155.stdout:6/105: chown db/c15 23635 1 2024-09-13T21:44:45.947 INFO:tasks.workunit.client.1.smithi155.stdout:6/106: readlink db/d11/l1b 0 2024-09-13T21:44:45.950 INFO:tasks.workunit.client.1.smithi155.stdout:6/107: mkdir db/d12/d1c 0 2024-09-13T21:44:45.951 INFO:tasks.workunit.client.1.smithi155.stdout:6/108: write f3 [638831,15558] 0 2024-09-13T21:44:45.955 INFO:tasks.workunit.client.1.smithi155.stdout:6/109: mknod db/d12/c1d 0 2024-09-13T21:44:45.955 INFO:tasks.workunit.client.0.smithi119.stdout:8/515: dwrite d1b/d1d/d26/f89 [0,4194304] 0 2024-09-13T21:44:45.957 INFO:tasks.workunit.client.1.smithi155.stdout:6/110: chown db/d11/c18 2479399 1 2024-09-13T21:44:45.957 INFO:tasks.workunit.client.1.smithi155.stdout:6/111: fdatasync db/d12/f1a 0 2024-09-13T21:44:45.958 INFO:tasks.workunit.client.1.smithi155.stdout:6/112: chown db/d12/f1a 42 1 2024-09-13T21:44:45.959 INFO:tasks.workunit.client.1.smithi155.stdout:6/113: fsync db/d12/f1a 0 2024-09-13T21:44:45.961 INFO:tasks.workunit.client.0.smithi119.stdout:9/605: rename d0/d8/d18/d23/d42/d52/f8b to d0/d8/d18/d23/d27/fd0 0 2024-09-13T21:44:45.961 INFO:tasks.workunit.client.1.smithi155.stdout:6/114: mkdir db/d11/d1e 0 2024-09-13T21:44:45.965 INFO:tasks.workunit.client.0.smithi119.stdout:7/561: dwrite d8/d3c/d46/f5a [4194304,4194304] 0 2024-09-13T21:44:45.966 INFO:tasks.workunit.client.1.smithi155.stdout:6/115: dread db/d12/f17 [4194304,4194304] 0 2024-09-13T21:44:45.968 INFO:tasks.workunit.client.0.smithi119.stdout:9/606: fdatasync d0/d19/d1a/d2b/f6a 0 2024-09-13T21:44:45.968 INFO:tasks.workunit.client.0.smithi119.stdout:8/516: dwrite d1b/d1d/d26/d3e/d65/f76 [0,4194304] 0 2024-09-13T21:44:45.969 INFO:tasks.workunit.client.1.smithi155.stdout:6/116: creat db/f1f x:0 0 0 2024-09-13T21:44:45.969 INFO:tasks.workunit.client.0.smithi119.stdout:7/562: truncate d8/f9c 541805 0 2024-09-13T21:44:45.974 INFO:tasks.workunit.client.0.smithi119.stdout:9/607: dread - d0/d8/d18/d23/d27/d2d/d5f/fbf zero size 2024-09-13T21:44:45.975 INFO:tasks.workunit.client.1.smithi155.stdout:6/117: dwrite f3 [0,4194304] 0 2024-09-13T21:44:45.977 INFO:tasks.workunit.client.0.smithi119.stdout:5/474: link d0/d3/d1f/d21/c63 d0/d3/d4/d2e/caa 0 2024-09-13T21:44:45.978 INFO:tasks.workunit.client.0.smithi119.stdout:9/608: creat d0/d19/fd1 x:0 0 0 2024-09-13T21:44:45.979 INFO:tasks.workunit.client.1.smithi155.stdout:6/118: mknod db/d11/d1e/c20 0 2024-09-13T21:44:45.980 INFO:tasks.workunit.client.0.smithi119.stdout:7/563: rename d8/d3c/d53/d37/d57/d8f/ca3 to d8/d3c/d53/d37/d95/cb3 0 2024-09-13T21:44:45.981 INFO:tasks.workunit.client.1.smithi155.stdout:6/119: read db/f10 [1316589,122530] 0 2024-09-13T21:44:45.981 INFO:tasks.workunit.client.1.smithi155.stdout:3/126: getdents d3/d25 0 2024-09-13T21:44:45.983 INFO:tasks.workunit.client.0.smithi119.stdout:8/517: link d1b/d1d/d48/d54/c34 d1b/d1d/d5e/ca6 0 2024-09-13T21:44:45.983 INFO:tasks.workunit.client.1.smithi155.stdout:0/125: truncate d1/f19 2440981 0 2024-09-13T21:44:45.983 INFO:tasks.workunit.client.1.smithi155.stdout:6/120: write db/f10 [3328409,109091] 0 2024-09-13T21:44:45.984 INFO:tasks.workunit.client.0.smithi119.stdout:5/475: mkdir d0/dab 0 2024-09-13T21:44:45.985 INFO:tasks.workunit.client.1.smithi155.stdout:6/121: dread - db/f1f zero size 2024-09-13T21:44:45.986 INFO:tasks.workunit.client.1.smithi155.stdout:0/126: creat d1/d6/dc/f33 x:0 0 0 2024-09-13T21:44:45.986 INFO:tasks.workunit.client.1.smithi155.stdout:6/122: write f3 [5042951,112394] 0 2024-09-13T21:44:45.987 INFO:tasks.workunit.client.0.smithi119.stdout:5/476: write d0/d3/f11 [3151412,37794] 0 2024-09-13T21:44:45.987 INFO:tasks.workunit.client.0.smithi119.stdout:7/564: mkdir d8/d4d/da2/dac/db4 0 2024-09-13T21:44:45.988 INFO:tasks.workunit.client.1.smithi155.stdout:6/123: chown db/d12/l19 1472738279 1 2024-09-13T21:44:45.988 INFO:tasks.workunit.client.1.smithi155.stdout:3/127: dread d3/d25/d1b/d1f/f22 [0,4194304] 0 2024-09-13T21:44:45.990 INFO:tasks.workunit.client.0.smithi119.stdout:9/609: dwrite d0/d19/d1a/d2b/f6a [0,4194304] 0 2024-09-13T21:44:45.990 INFO:tasks.workunit.client.0.smithi119.stdout:8/518: creat d1b/d1d/d48/d54/fa7 x:0 0 0 2024-09-13T21:44:45.990 INFO:tasks.workunit.client.0.smithi119.stdout:5/477: fsync d0/d3/fc 0 2024-09-13T21:44:45.991 INFO:tasks.workunit.client.1.smithi155.stdout:0/127: dread d1/d6/f8 [0,4194304] 0 2024-09-13T21:44:45.991 INFO:tasks.workunit.client.1.smithi155.stdout:3/128: creat d3/d25/d1b/d1f/f2e x:0 0 0 2024-09-13T21:44:45.992 INFO:tasks.workunit.client.0.smithi119.stdout:9/610: dread - d0/d19/d1a/d92/fca zero size 2024-09-13T21:44:45.993 INFO:tasks.workunit.client.1.smithi155.stdout:3/129: fdatasync d3/d25/d17/f27 0 2024-09-13T21:44:45.993 INFO:tasks.workunit.client.1.smithi155.stdout:6/124: dread f7 [0,4194304] 0 2024-09-13T21:44:45.994 INFO:tasks.workunit.client.1.smithi155.stdout:6/125: dread - db/f1f zero size 2024-09-13T21:44:45.994 INFO:tasks.workunit.client.0.smithi119.stdout:9/611: stat d0/d19/d1a/d2b/l67 0 2024-09-13T21:44:45.994 INFO:tasks.workunit.client.0.smithi119.stdout:7/565: mknod d8/d4d/da2/dac/cb5 0 2024-09-13T21:44:45.995 INFO:tasks.workunit.client.1.smithi155.stdout:6/126: truncate db/d12/f1a 353399 0 2024-09-13T21:44:45.995 INFO:tasks.workunit.client.1.smithi155.stdout:3/130: unlink d3/d10/c2a 0 2024-09-13T21:44:45.995 INFO:tasks.workunit.client.0.smithi119.stdout:5/478: unlink d0/d3/d4/c33 0 2024-09-13T21:44:45.997 INFO:tasks.workunit.client.1.smithi155.stdout:3/131: dread d3/ff [0,4194304] 0 2024-09-13T21:44:45.998 INFO:tasks.workunit.client.0.smithi119.stdout:8/519: write d1b/d1d/d48/d58/d7f/f82 [816156,93811] 0 2024-09-13T21:44:45.998 INFO:tasks.workunit.client.1.smithi155.stdout:0/128: rename d1/d6/f2c to d1/f34 0 2024-09-13T21:44:45.998 INFO:tasks.workunit.client.0.smithi119.stdout:7/566: stat d8/d3c/c59 0 2024-09-13T21:44:46.000 INFO:tasks.workunit.client.0.smithi119.stdout:5/479: write d0/d3/d4/d9/d74/f82 [1782613,50755] 0 2024-09-13T21:44:46.000 INFO:tasks.workunit.client.1.smithi155.stdout:0/129: stat d1/f22 0 2024-09-13T21:44:46.002 INFO:tasks.workunit.client.1.smithi155.stdout:0/130: read d1/f22 [2470563,95313] 0 2024-09-13T21:44:46.002 INFO:tasks.workunit.client.0.smithi119.stdout:5/480: write d0/d3/f15 [4792251,62064] 0 2024-09-13T21:44:46.003 INFO:tasks.workunit.client.0.smithi119.stdout:7/567: mknod d8/d3c/d53/d37/d57/cb6 0 2024-09-13T21:44:46.005 INFO:tasks.workunit.client.0.smithi119.stdout:8/520: dread f18 [0,4194304] 0 2024-09-13T21:44:46.005 INFO:tasks.workunit.client.0.smithi119.stdout:9/612: rename d0/d4f/d56/f87 to d0/d8/d18/d23/d27/d2d/d6e/fd2 0 2024-09-13T21:44:46.006 INFO:tasks.workunit.client.0.smithi119.stdout:9/613: stat d0/d19/d1a/d2b/fbd 0 2024-09-13T21:44:46.007 INFO:tasks.workunit.client.1.smithi155.stdout:6/127: dwrite db/d12/f1a [0,4194304] 0 2024-09-13T21:44:46.008 INFO:tasks.workunit.client.0.smithi119.stdout:9/614: write d0/d8/d18/d23/d27/d2d/d5f/f88 [332752,95331] 0 2024-09-13T21:44:46.009 INFO:tasks.workunit.client.0.smithi119.stdout:9/615: read - d0/d19/fd1 zero size 2024-09-13T21:44:46.010 INFO:tasks.workunit.client.0.smithi119.stdout:8/521: unlink d1b/d1d/c91 0 2024-09-13T21:44:46.013 INFO:tasks.workunit.client.0.smithi119.stdout:9/616: mknod d0/d8/d18/d23/d27/d2d/d6e/cd3 0 2024-09-13T21:44:46.014 INFO:tasks.workunit.client.1.smithi155.stdout:0/131: dwrite d1/f14 [0,4194304] 0 2024-09-13T21:44:46.014 INFO:tasks.workunit.client.1.smithi155.stdout:3/132: dwrite d3/d25/fb [0,4194304] 0 2024-09-13T21:44:46.015 INFO:tasks.workunit.client.1.smithi155.stdout:0/132: fdatasync d1/d6/f2d 0 2024-09-13T21:44:46.016 INFO:tasks.workunit.client.1.smithi155.stdout:6/128: dread f0 [0,4194304] 0 2024-09-13T21:44:46.020 INFO:tasks.workunit.client.1.smithi155.stdout:3/133: rename d3/d25/d17/f23 to d3/d21/f2f 0 2024-09-13T21:44:46.020 INFO:tasks.workunit.client.0.smithi119.stdout:3/472: dread d6/d25/d2f/d33/f71 [0,4194304] 0 2024-09-13T21:44:46.021 INFO:tasks.workunit.client.0.smithi119.stdout:3/473: stat d6/d25 0 2024-09-13T21:44:46.022 INFO:tasks.workunit.client.1.smithi155.stdout:6/129: unlink db/lf 0 2024-09-13T21:44:46.022 INFO:tasks.workunit.client.0.smithi119.stdout:3/474: chown d6/d15/d1a/f79 0 1 2024-09-13T21:44:46.023 INFO:tasks.workunit.client.0.smithi119.stdout:9/617: rename d0/d8/d18/d23/d27/d2d/d5f/f61 to d0/d8/fd4 0 2024-09-13T21:44:46.024 INFO:tasks.workunit.client.1.smithi155.stdout:3/134: dread d3/d25/d1b/d1f/f22 [0,4194304] 0 2024-09-13T21:44:46.024 INFO:tasks.workunit.client.0.smithi119.stdout:9/618: fsync d0/d79/da4/fab 0 2024-09-13T21:44:46.029 INFO:tasks.workunit.client.0.smithi119.stdout:9/619: readlink d0/d8/d18/d23/d42/d52/d53/l6f 0 2024-09-13T21:44:46.029 INFO:tasks.workunit.client.0.smithi119.stdout:8/522: dwrite d1b/d1d/d39/f44 [0,4194304] 0 2024-09-13T21:44:46.030 INFO:tasks.workunit.client.1.smithi155.stdout:3/135: creat d3/d25/d1b/d1f/f30 x:0 0 0 2024-09-13T21:44:46.033 INFO:tasks.workunit.client.1.smithi155.stdout:6/130: dwrite f3 [4194304,4194304] 0 2024-09-13T21:44:46.034 INFO:tasks.workunit.client.0.smithi119.stdout:8/523: unlink d1b/d4e/l7b 0 2024-09-13T21:44:46.034 INFO:tasks.workunit.client.0.smithi119.stdout:3/475: read d6/d25/d2f/f3b [677294,78077] 0 2024-09-13T21:44:46.037 INFO:tasks.workunit.client.0.smithi119.stdout:8/524: creat d1b/d1d/d26/fa8 x:0 0 0 2024-09-13T21:44:46.039 INFO:tasks.workunit.client.0.smithi119.stdout:3/476: mkdir d6/d25/d2f/d33/d56/da0 0 2024-09-13T21:44:46.040 INFO:tasks.workunit.client.1.smithi155.stdout:3/136: link d3/d10/l16 d3/d25/d17/l31 0 2024-09-13T21:44:46.040 INFO:tasks.workunit.client.1.smithi155.stdout:6/131: dread db/d12/f1a [0,4194304] 0 2024-09-13T21:44:46.041 INFO:tasks.workunit.client.0.smithi119.stdout:8/525: symlink d1b/d1d/d26/d3e/la9 0 2024-09-13T21:44:46.041 INFO:tasks.workunit.client.1.smithi155.stdout:6/132: write f7 [4086754,8886] 0 2024-09-13T21:44:46.043 INFO:tasks.workunit.client.0.smithi119.stdout:8/526: dread - d1b/d1d/d26/f81 zero size 2024-09-13T21:44:46.044 INFO:tasks.workunit.client.0.smithi119.stdout:8/527: dread - d1b/d1d/f8f zero size 2024-09-13T21:44:46.044 INFO:tasks.workunit.client.1.smithi155.stdout:6/133: mkdir db/d11/d1e/d21 0 2024-09-13T21:44:46.045 INFO:tasks.workunit.client.0.smithi119.stdout:3/477: creat d6/d15/d8f/fa1 x:0 0 0 2024-09-13T21:44:46.047 INFO:tasks.workunit.client.0.smithi119.stdout:8/528: mkdir d1b/d1d/d26/d3e/daa 0 2024-09-13T21:44:46.047 INFO:tasks.workunit.client.0.smithi119.stdout:3/478: dread - d6/d25/d2f/d33/d56/f7a zero size 2024-09-13T21:44:46.049 INFO:tasks.workunit.client.1.smithi155.stdout:3/137: dwrite d3/ff [0,4194304] 0 2024-09-13T21:44:46.049 INFO:tasks.workunit.client.1.smithi155.stdout:3/138: chown d3/d25/d17/f27 86904 1 2024-09-13T21:44:46.051 INFO:tasks.workunit.client.0.smithi119.stdout:3/479: mknod d6/d25/d2f/d33/d56/ca2 0 2024-09-13T21:44:46.051 INFO:tasks.workunit.client.0.smithi119.stdout:5/481: dwrite d0/d3/d4/d9/d14/d24/d25/f36 [0,4194304] 0 2024-09-13T21:44:46.053 INFO:tasks.workunit.client.0.smithi119.stdout:3/480: readlink d6/d15/d1a/d45/l90 0 2024-09-13T21:44:46.054 INFO:tasks.workunit.client.0.smithi119.stdout:3/481: readlink d6/d25/l2b 0 2024-09-13T21:44:46.054 INFO:tasks.workunit.client.1.smithi155.stdout:6/134: fdatasync f3 0 2024-09-13T21:44:46.055 INFO:tasks.workunit.client.1.smithi155.stdout:6/135: stat db/d12 0 2024-09-13T21:44:46.055 INFO:tasks.workunit.client.0.smithi119.stdout:3/482: chown d6/d25/c48 1408 1 2024-09-13T21:44:46.056 INFO:tasks.workunit.client.0.smithi119.stdout:5/482: unlink d0/d3/d4/d9/l39 0 2024-09-13T21:44:46.059 INFO:tasks.workunit.client.0.smithi119.stdout:3/483: creat d6/d25/d2f/d33/d88/fa3 x:0 0 0 2024-09-13T21:44:46.061 INFO:tasks.workunit.client.0.smithi119.stdout:5/483: write d0/d3/d1f/f52 [3544910,37711] 0 2024-09-13T21:44:46.061 INFO:tasks.workunit.client.1.smithi155.stdout:3/139: truncate d3/ff 769875 0 2024-09-13T21:44:46.061 INFO:tasks.workunit.client.1.smithi155.stdout:6/136: dread db/f10 [0,4194304] 0 2024-09-13T21:44:46.062 INFO:tasks.workunit.client.0.smithi119.stdout:9/620: truncate d0/d8/d18/d23/d27/d2d/d6e/f7d 1721272 0 2024-09-13T21:44:46.062 INFO:tasks.workunit.client.0.smithi119.stdout:3/484: symlink d6/d25/d2f/d33/d88/d96/la4 0 2024-09-13T21:44:46.064 INFO:tasks.workunit.client.0.smithi119.stdout:5/484: write d0/d3/d4/d9/d14/d24/f6e [2998598,127943] 0 2024-09-13T21:44:46.068 INFO:tasks.workunit.client.0.smithi119.stdout:1/468: sync 2024-09-13T21:44:46.069 INFO:tasks.workunit.client.1.smithi155.stdout:6/137: dwrite db/d12/f17 [0,4194304] 0 2024-09-13T21:44:46.069 INFO:tasks.workunit.client.0.smithi119.stdout:5/485: rename d0/d3/d4/d9/l16 to d0/d3/d4/d2e/d97/lac 0 2024-09-13T21:44:46.071 INFO:tasks.workunit.client.1.smithi155.stdout:3/140: write d3/fa [560541,51094] 0 2024-09-13T21:44:46.074 INFO:tasks.workunit.client.1.smithi155.stdout:6/138: truncate f3 2931941 0 2024-09-13T21:44:46.074 INFO:tasks.workunit.client.1.smithi155.stdout:6/139: write db/f1f [1038352,71531] 0 2024-09-13T21:44:46.075 INFO:tasks.workunit.client.0.smithi119.stdout:9/621: link d0/d19/d1a/d2b/c71 d0/d8/d18/d23/d27/d2d/d70/d80/daa/db3/cd5 0 2024-09-13T21:44:46.076 INFO:tasks.workunit.client.1.smithi155.stdout:3/141: link d3/d10/c15 d3/d25/c32 0 2024-09-13T21:44:46.076 INFO:tasks.workunit.client.0.smithi119.stdout:3/485: write d6/d44/f51 [384292,42365] 0 2024-09-13T21:44:46.077 INFO:tasks.workunit.client.0.smithi119.stdout:1/469: symlink d1/d3/d61/d77/d78/d32/d33/d72/l99 0 2024-09-13T21:44:46.079 INFO:tasks.workunit.client.0.smithi119.stdout:5/486: mkdir d0/dad 0 2024-09-13T21:44:46.079 INFO:tasks.workunit.client.0.smithi119.stdout:1/470: stat d1/d3/d61/d77/d78/d32/d33/d72 0 2024-09-13T21:44:46.083 INFO:tasks.workunit.client.0.smithi119.stdout:9/622: creat d0/d19/d1a/d2b/fd6 x:0 0 0 2024-09-13T21:44:46.084 INFO:tasks.workunit.client.0.smithi119.stdout:9/623: chown d0/d8/cf 12591 1 2024-09-13T21:44:46.088 INFO:tasks.workunit.client.0.smithi119.stdout:3/486: rename d6/f2d to d6/d15/d1a/d45/d8d/d95/fa5 0 2024-09-13T21:44:46.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.091+0000 7f4292d12640 1 -- 172.21.15.119:0/1927264036 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f428c115530 con 0x7f427406e7b0 2024-09-13T21:44:46.093 INFO:tasks.workunit.client.0.smithi119.stdout:1/471: symlink d1/d3/d61/d77/l9a 0 2024-09-13T21:44:46.095 INFO:tasks.workunit.client.0.smithi119.stdout:9/624: write d0/d79/da4/fc3 [1001105,33792] 0 2024-09-13T21:44:46.097 INFO:tasks.workunit.client.0.smithi119.stdout:1/472: write d1/f22 [582795,108104] 0 2024-09-13T21:44:46.099 INFO:tasks.workunit.client.0.smithi119.stdout:5/487: truncate d0/d3/d4/f5 1370209 0 2024-09-13T21:44:46.099 INFO:tasks.workunit.client.0.smithi119.stdout:1/473: dread - d1/d3/dc/d11/d3d/f98 zero size 2024-09-13T21:44:46.102 INFO:tasks.workunit.client.0.smithi119.stdout:1/474: mkdir d1/d3/dc/d11/d19/d2d/d37/d9b 0 2024-09-13T21:44:46.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.102+0000 7f42897fa640 1 -- 172.21.15.119:0/1927264036 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f428c115530 con 0x7f427406e7b0 2024-09-13T21:44:46.103 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:44:46.103 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (6m) 2m ago 7m 23.4M - 0.25.0 c8568f914cd2 d48a0a37f6f5 2024-09-13T21:44:46.103 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (7m) 2m ago 7m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 c6a79bd22109 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (7m) 35s ago 7m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 1bccd1b9bda0 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (6m) 2m ago 7m 84.6M - 9.4.7 954c08fa6188 b9b173631489 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (2m) 2m ago 2m 10.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (2m) 2m ago 2m 17.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (2m) 35s ago 2m 14.5M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (2m) 35s ago 2m 17.7M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:9283,8765,8443 running (8m) 2m ago 8m 448M - 17.2.7-1629-geb16b97b ab51d1bebd12 b7b1f8308caa 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283 running (39s) 35s ago 6m 63.8M - 19.1.1-324-gecab7be5 0652ff2b5d78 3869f6b2a429 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (9m) 2m ago 9m 41.3M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 f49a62e4f3c3 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (6m) 35s ago 6m 33.1M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 66c9116315ae 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (7m) 2m ago 7m 16.4M - 1.5.0 0da6a335fe13 d6e79b36f728 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (7m) 35s ago 7m 15.5M - 1.5.0 0da6a335fe13 513bc6bacbbd 2024-09-13T21:44:46.104 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (6m) 2m ago 6m 44.6M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 6e0bbff1ac3f 2024-09-13T21:44:46.105 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (5m) 2m ago 5m 45.7M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:44:46.105 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (5m) 2m ago 5m 43.5M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:44:46.105 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (4m) 35s ago 4m 83.4M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:44:46.105 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (4m) 35s ago 4m 78.8M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:44:46.105 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (3m) 35s ago 3m 77.3M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:44:46.105 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (6m) 2m ago 7m 51.5M - 2.43.0 a07b618ecd1d 5d5878bd99c5 2024-09-13T21:44:46.106 INFO:tasks.workunit.client.0.smithi119.stdout:9/625: link d0/fa5 d0/d8/d18/d23/d27/d2d/d6e/fd7 0 2024-09-13T21:44:46.106 INFO:tasks.workunit.client.0.smithi119.stdout:5/488: rmdir d0/dad 0 2024-09-13T21:44:46.106 INFO:tasks.workunit.client.0.smithi119.stdout:3/487: dread d6/f1c [0,4194304] 0 2024-09-13T21:44:46.106 INFO:tasks.workunit.client.0.smithi119.stdout:9/626: write d0/d19/d1a/d2b/fd6 [903825,40568] 0 2024-09-13T21:44:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.105+0000 7f4292d12640 1 -- 172.21.15.119:0/1927264036 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f427406e7b0 msgr2=0x7f4274070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.105+0000 7f4292d12640 1 --2- 172.21.15.119:0/1927264036 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f427406e7b0 0x7f4274070c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f427c036750 tx=0x7f427c009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.105+0000 7f4292d12640 1 -- 172.21.15.119:0/1927264036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0fdc10 msgr2=0x7f428c1136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.105+0000 7f4292d12640 1 --2- 172.21.15.119:0/1927264036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0fdc10 0x7f428c1136d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f428000b4e0 tx=0x7f4280009120 comp rx=0 tx=0).stop 2024-09-13T21:44:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.105+0000 7f4292d12640 1 -- 172.21.15.119:0/1927264036 shutdown_connections 2024-09-13T21:44:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.105+0000 7f4292d12640 1 --2- 172.21.15.119:0/1927264036 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f427406e7b0 0x7f4274070c60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.105+0000 7f4292d12640 1 --2- 172.21.15.119:0/1927264036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f428c0fe560 0x7f428c113c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.105+0000 7f4292d12640 1 --2- 172.21.15.119:0/1927264036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0fdc10 0x7f428c1136d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.105+0000 7f4292d12640 1 -- 172.21.15.119:0/1927264036 >> 172.21.15.119:0/1927264036 conn(0x7f428c0f6390 msgr2=0x7f428c0f7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:46.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.105+0000 7f4292d12640 1 -- 172.21.15.119:0/1927264036 shutdown_connections 2024-09-13T21:44:46.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.105+0000 7f4292d12640 1 -- 172.21.15.119:0/1927264036 wait complete. 2024-09-13T21:44:46.108 INFO:tasks.workunit.client.0.smithi119.stdout:1/475: rename d1/d3/f7 to d1/d3/d61/d77/d78/f9c 0 2024-09-13T21:44:46.108 INFO:tasks.workunit.client.0.smithi119.stdout:9/627: rename d0/d8/d18/d23 to d0/d8/d18/d23/d27/d2d/dc1/dd8 22 2024-09-13T21:44:46.109 INFO:tasks.workunit.client.0.smithi119.stdout:5/489: rmdir d0/d3/d1f/d21 39 2024-09-13T21:44:46.110 INFO:tasks.workunit.client.0.smithi119.stdout:9/628: chown d0/d8/d18/d23/d27/f2a 29348 1 2024-09-13T21:44:46.111 INFO:tasks.workunit.client.0.smithi119.stdout:1/476: rmdir d1/d3/d61/d7e/d53 39 2024-09-13T21:44:46.115 INFO:tasks.workunit.client.0.smithi119.stdout:9/629: symlink d0/d8/d18/d23/d27/d2d/dc1/ld9 0 2024-09-13T21:44:46.117 INFO:tasks.workunit.client.0.smithi119.stdout:1/477: truncate d1/d3/dc/d11/d19/d2d/f44 1216180 0 2024-09-13T21:44:46.118 INFO:tasks.workunit.client.0.smithi119.stdout:5/490: rename d0/d3/d1f/d21/c7a to d0/d3/d1f/d21/da1/cae 0 2024-09-13T21:44:46.119 INFO:tasks.workunit.client.0.smithi119.stdout:5/491: read d0/d3/d4/f78 [4157795,6767] 0 2024-09-13T21:44:46.120 INFO:tasks.workunit.client.0.smithi119.stdout:9/630: mkdir d0/d8/d18/d23/d27/d2d/d70/dda 0 2024-09-13T21:44:46.121 INFO:tasks.workunit.client.0.smithi119.stdout:1/478: readlink d1/d3/d6c/l97 0 2024-09-13T21:44:46.122 INFO:tasks.workunit.client.0.smithi119.stdout:9/631: chown d0/d8/d18/d23/d27/d2d/d70/d80/d81 217 1 2024-09-13T21:44:46.123 INFO:tasks.workunit.client.0.smithi119.stdout:1/479: dread d1/d3/f4 [0,4194304] 0 2024-09-13T21:44:46.124 INFO:tasks.workunit.client.0.smithi119.stdout:1/480: fdatasync d1/d3/dc/d11/d28/f5d 0 2024-09-13T21:44:46.125 INFO:tasks.workunit.client.0.smithi119.stdout:5/492: fsync d0/d3/d4/d9/d1e/f9f 0 2024-09-13T21:44:46.127 INFO:tasks.workunit.client.0.smithi119.stdout:1/481: mkdir d1/d3/dc/d11/d19/d2d/d37/d9d 0 2024-09-13T21:44:46.132 INFO:tasks.workunit.client.0.smithi119.stdout:1/482: rename d1/d3/dc/d11/d19/c7a to d1/d3/dc/d11/d28/c9e 0 2024-09-13T21:44:46.133 INFO:tasks.workunit.client.0.smithi119.stdout:5/493: fsync d0/d3/d4/d9/d14/d24/d25/f58 0 2024-09-13T21:44:46.135 INFO:tasks.workunit.client.1.smithi155.stdout:3/142: rename d3/ld to d3/d10/l33 0 2024-09-13T21:44:46.137 INFO:tasks.workunit.client.1.smithi155.stdout:3/143: mkdir d3/d10/d34 0 2024-09-13T21:44:46.137 INFO:tasks.workunit.client.1.smithi155.stdout:3/144: chown l1 1091 1 2024-09-13T21:44:46.138 INFO:tasks.workunit.client.1.smithi155.stdout:6/140: dwrite db/d11/f14 [0,4194304] 0 2024-09-13T21:44:46.138 INFO:tasks.workunit.client.0.smithi119.stdout:1/483: creat d1/d3/d61/d77/d78/d32/d33/d72/f9f x:0 0 0 2024-09-13T21:44:46.139 INFO:tasks.workunit.client.1.smithi155.stdout:3/145: write d3/d21/f2f [1906201,3178] 0 2024-09-13T21:44:46.141 INFO:tasks.workunit.client.0.smithi119.stdout:5/494: dwrite d0/d3/d4/d2e/f71 [0,4194304] 0 2024-09-13T21:44:46.142 INFO:tasks.workunit.client.0.smithi119.stdout:9/632: truncate d0/d8/d18/d23/d42/d52/f65 567469 0 2024-09-13T21:44:46.145 INFO:tasks.workunit.client.0.smithi119.stdout:5/495: symlink d0/d3/d4/d9/d14/laf 0 2024-09-13T21:44:46.147 INFO:tasks.workunit.client.0.smithi119.stdout:1/484: dread d1/d3/d61/d77/d78/f9c [4194304,4194304] 0 2024-09-13T21:44:46.149 INFO:tasks.workunit.client.0.smithi119.stdout:9/633: getdents d0/d8/d18/dad 0 2024-09-13T21:44:46.153 INFO:tasks.workunit.client.0.smithi119.stdout:5/496: truncate d0/d3/d4/d9/f64 3965392 0 2024-09-13T21:44:46.153 INFO:tasks.workunit.client.0.smithi119.stdout:5/497: readlink d0/d3/d4/l9e 0 2024-09-13T21:44:46.154 INFO:tasks.workunit.client.0.smithi119.stdout:5/498: truncate d0/f88 4929861 0 2024-09-13T21:44:46.155 INFO:tasks.workunit.client.0.smithi119.stdout:9/634: mkdir d0/d8/d18/d23/d27/d2d/ddb 0 2024-09-13T21:44:46.156 INFO:tasks.workunit.client.0.smithi119.stdout:5/499: symlink d0/d3/d1f/d21/da1/lb0 0 2024-09-13T21:44:46.158 INFO:tasks.workunit.client.0.smithi119.stdout:9/635: symlink d0/d8/d18/d23/d27/d2d/d70/d80/d81/ldc 0 2024-09-13T21:44:46.159 INFO:tasks.workunit.client.0.smithi119.stdout:5/500: mknod d0/d3/d4/cb1 0 2024-09-13T21:44:46.159 INFO:tasks.workunit.client.0.smithi119.stdout:9/636: dread - d0/d8/d18/d23/d27/d2d/d6e/fb7 zero size 2024-09-13T21:44:46.173 INFO:tasks.workunit.client.0.smithi119.stdout:5/501: creat d0/d3/d4/d2e/d65/fb2 x:0 0 0 2024-09-13T21:44:46.174 INFO:tasks.workunit.client.0.smithi119.stdout:9/637: mknod d0/d8/d18/d23/cdd 0 2024-09-13T21:44:46.178 INFO:tasks.workunit.client.0.smithi119.stdout:1/485: dread d1/d3/dc/d11/d19/d2d/f51 [0,4194304] 0 2024-09-13T21:44:46.178 INFO:tasks.workunit.client.0.smithi119.stdout:9/638: unlink d0/d8/d18/d23/d27/d2d/cae 0 2024-09-13T21:44:46.178 INFO:tasks.workunit.client.0.smithi119.stdout:5/502: dread d0/d3/d4/d9/d14/d24/d25/f6f [0,4194304] 0 2024-09-13T21:44:46.179 INFO:tasks.workunit.client.0.smithi119.stdout:9/639: stat d0/d8/d18/d23/d27/f32 0 2024-09-13T21:44:46.181 INFO:tasks.workunit.client.0.smithi119.stdout:5/503: symlink d0/d3/lb3 0 2024-09-13T21:44:46.182 INFO:tasks.workunit.client.0.smithi119.stdout:9/640: creat d0/d8/d18/dad/fde x:0 0 0 2024-09-13T21:44:46.183 INFO:tasks.workunit.client.0.smithi119.stdout:1/486: mknod d1/d3/d61/d77/d78/d32/d33/d72/ca0 0 2024-09-13T21:44:46.184 INFO:tasks.workunit.client.0.smithi119.stdout:5/504: creat d0/d3/d1f/d21/d4f/d86/fb4 x:0 0 0 2024-09-13T21:44:46.184 INFO:tasks.workunit.client.0.smithi119.stdout:1/487: write d1/d3/d61/d77/d78/d32/f4b [4989972,30655] 0 2024-09-13T21:44:46.186 INFO:tasks.workunit.client.0.smithi119.stdout:5/505: mknod d0/dab/cb5 0 2024-09-13T21:44:46.187 INFO:tasks.workunit.client.0.smithi119.stdout:1/488: read d1/d3/d61/d77/d78/d32/f4b [1879224,55452] 0 2024-09-13T21:44:46.191 INFO:tasks.workunit.client.0.smithi119.stdout:9/641: dwrite d0/d19/f59 [0,4194304] 0 2024-09-13T21:44:46.192 INFO:tasks.workunit.client.0.smithi119.stdout:1/489: dread - d1/d3/d61/d7e/d53/f83 zero size 2024-09-13T21:44:46.199 INFO:tasks.workunit.client.0.smithi119.stdout:5/506: dread d0/d3/d4/d9/d14/d24/f6e [0,4194304] 0 2024-09-13T21:44:46.203 INFO:tasks.workunit.client.0.smithi119.stdout:9/642: dwrite d0/d8/d18/d23/d27/d2d/d5f/d74/f7f [0,4194304] 0 2024-09-13T21:44:46.205 INFO:tasks.workunit.client.0.smithi119.stdout:5/507: mkdir d0/d3/d4/d9/d14/d24/db6 0 2024-09-13T21:44:46.206 INFO:tasks.workunit.client.0.smithi119.stdout:1/490: dwrite d1/d3/d61/d77/d78/f9c [0,4194304] 0 2024-09-13T21:44:46.210 INFO:tasks.workunit.client.0.smithi119.stdout:5/508: fsync d0/d3/d4/d2e/d65/f81 0 2024-09-13T21:44:46.211 INFO:tasks.workunit.client.0.smithi119.stdout:5/509: dread - d0/d3/d4/d9/d14/d24/d25/f9b zero size 2024-09-13T21:44:46.214 INFO:tasks.workunit.client.0.smithi119.stdout:9/643: rename d0/d8/d18/d23/d27/d2d/d70/d80 to d0/d8/d18/d23/d27/d2d/dc1/ddf 0 2024-09-13T21:44:46.215 INFO:tasks.workunit.client.0.smithi119.stdout:1/491: unlink d1/d3/d61/d77/d78/c70 0 2024-09-13T21:44:46.217 INFO:tasks.workunit.client.0.smithi119.stdout:9/644: unlink d0/d19/c9b 0 2024-09-13T21:44:46.221 INFO:tasks.workunit.client.0.smithi119.stdout:1/492: link d1/d3/d61/d77/d78/c5b d1/d3/dc/d11/d19/d47/ca1 0 2024-09-13T21:44:46.224 INFO:tasks.workunit.client.0.smithi119.stdout:1/493: write d1/d3/d61/d77/d78/d32/d33/d72/f9f [984778,88128] 0 2024-09-13T21:44:46.227 INFO:tasks.workunit.client.0.smithi119.stdout:9/645: dwrite d0/d8/d18/d23/d27/d2d/d5f/d74/f7f [0,4194304] 0 2024-09-13T21:44:46.232 INFO:tasks.workunit.client.0.smithi119.stdout:5/510: dwrite d0/d3/d4/f78 [0,4194304] 0 2024-09-13T21:44:46.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.232+0000 7fd04759e640 1 -- 172.21.15.119:0/325422242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0400057b0 msgr2=0x7fd0400976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:46.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.232+0000 7fd04759e640 1 --2- 172.21.15.119:0/325422242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0400057b0 0x7fd0400976a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd0380048d0 tx=0x7fd038009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.232+0000 7fd04759e640 1 -- 172.21.15.119:0/325422242 shutdown_connections 2024-09-13T21:44:46.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.232+0000 7fd04759e640 1 --2- 172.21.15.119:0/325422242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd040097be0 0x7fd040099fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.232+0000 7fd04759e640 1 --2- 172.21.15.119:0/325422242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0400057b0 0x7fd0400976a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.232+0000 7fd04759e640 1 -- 172.21.15.119:0/325422242 >> 172.21.15.119:0/325422242 conn(0x7fd04008f130 msgr2=0x7fd040091580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:46.234 INFO:tasks.workunit.client.0.smithi119.stdout:9/646: unlink d0/d8/d18/l28 0 2024-09-13T21:44:46.235 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:45 smithi119 ceph-mon[27653]: pgmap v7: 65 pgs: 65 active+clean; 1.0 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 28 MiB/s rd, 126 MiB/s wr, 279 op/s 2024-09-13T21:44:46.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.233+0000 7fd04759e640 1 -- 172.21.15.119:0/325422242 shutdown_connections 2024-09-13T21:44:46.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.234+0000 7fd04759e640 1 -- 172.21.15.119:0/325422242 wait complete. 2024-09-13T21:44:46.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.235+0000 7fd04759e640 1 Processor -- start 2024-09-13T21:44:46.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.235+0000 7fd04759e640 1 -- start start 2024-09-13T21:44:46.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.236+0000 7fd04759e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0400057b0 0x7fd0400a3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:46.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.236+0000 7fd04759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd040097be0 0x7fd0400a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:46.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.236+0000 7fd04759e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400a3ec0 con 0x7fd040097be0 2024-09-13T21:44:46.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.236+0000 7fd04759e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400a8870 con 0x7fd0400057b0 2024-09-13T21:44:46.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.236+0000 7fd04659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0400057b0 0x7fd0400a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:46.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.236+0000 7fd04659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0400057b0 0x7fd0400a3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:37968/0 (socket says 172.21.15.119:37968) 2024-09-13T21:44:46.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.236+0000 7fd04659c640 1 -- 172.21.15.119:0/1035534108 learned_addr learned my addr 172.21.15.119:0/1035534108 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:46.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.237+0000 7fd045d9b640 1 --2- 172.21.15.119:0/1035534108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd040097be0 0x7fd0400a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:46.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.237+0000 7fd04659c640 1 -- 172.21.15.119:0/1035534108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd040097be0 msgr2=0x7fd0400a3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:46.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.237+0000 7fd04659c640 1 --2- 172.21.15.119:0/1035534108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd040097be0 0x7fd0400a3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.237+0000 7fd04659c640 1 -- 172.21.15.119:0/1035534108 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038005040 con 0x7fd0400057b0 2024-09-13T21:44:46.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.238+0000 7fd04659c640 1 --2- 172.21.15.119:0/1035534108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0400057b0 0x7fd0400a3330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd03802a600 tx=0x7fd038009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:46.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.238+0000 7fd036ffd640 1 -- 172.21.15.119:0/1035534108 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd038038070 con 0x7fd0400057b0 2024-09-13T21:44:46.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.238+0000 7fd036ffd640 1 -- 172.21.15.119:0/1035534108 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd03802ae90 con 0x7fd0400057b0 2024-09-13T21:44:46.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.238+0000 7fd036ffd640 1 -- 172.21.15.119:0/1035534108 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd03803e420 con 0x7fd0400057b0 2024-09-13T21:44:46.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.238+0000 7fd04759e640 1 -- 172.21.15.119:0/1035534108 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0400a89b0 con 0x7fd0400057b0 2024-09-13T21:44:46.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.239+0000 7fd04759e640 1 -- 172.21.15.119:0/1035534108 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0400a8e70 con 0x7fd0400057b0 2024-09-13T21:44:46.241 INFO:tasks.workunit.client.0.smithi119.stdout:9/647: dread d0/d19/d1a/d2b/f3e [0,4194304] 0 2024-09-13T21:44:46.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.241+0000 7fd04759e640 1 -- 172.21.15.119:0/1035534108 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0400043e0 con 0x7fd0400057b0 2024-09-13T21:44:46.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.241+0000 7fd036ffd640 1 -- 172.21.15.119:0/1035534108 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd03803b020 con 0x7fd0400057b0 2024-09-13T21:44:46.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.241+0000 7fd036ffd640 1 --2- 172.21.15.119:0/1035534108 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd03006e730 0x7fd030070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:46.243 INFO:tasks.workunit.client.0.smithi119.stdout:1/494: link d1/d3/dc/d11/d3d/l45 d1/d3/dc/d11/d19/d2d/d59/la2 0 2024-09-13T21:44:46.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.242+0000 7fd036ffd640 1 -- 172.21.15.119:0/1035534108 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd0380add60 con 0x7fd0400057b0 2024-09-13T21:44:46.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.242+0000 7fd045d9b640 1 --2- 172.21.15.119:0/1035534108 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd03006e730 0x7fd030070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:46.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.243+0000 7fd045d9b640 1 --2- 172.21.15.119:0/1035534108 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd03006e730 0x7fd030070be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0400a47e0 tx=0x7fd03c011040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:46.244 INFO:tasks.workunit.client.0.smithi119.stdout:5/511: creat d0/d3/d4/d9/d14/d24/d25/fb7 x:0 0 0 2024-09-13T21:44:46.245 INFO:tasks.workunit.client.0.smithi119.stdout:1/495: write d1/f22 [943843,47500] 0 2024-09-13T21:44:46.246 INFO:tasks.workunit.client.0.smithi119.stdout:5/512: chown d0/d3/d1f/d21/f62 55 1 2024-09-13T21:44:46.248 INFO:tasks.workunit.client.0.smithi119.stdout:9/648: dwrite d0/d19/d1a/f1f [0,4194304] 0 2024-09-13T21:44:46.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.246+0000 7fd036ffd640 1 -- 172.21.15.119:0/1035534108 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd0380b2070 con 0x7fd0400057b0 2024-09-13T21:44:46.248 INFO:tasks.workunit.client.1.smithi155.stdout:4/93: sync 2024-09-13T21:44:46.249 INFO:tasks.workunit.client.0.smithi119.stdout:1/496: truncate d1/d3/d61/d7e/d53/f83 313163 0 2024-09-13T21:44:46.250 INFO:tasks.workunit.client.0.smithi119.stdout:5/513: symlink d0/d3/d4/d9/d74/lb8 0 2024-09-13T21:44:46.254 INFO:tasks.workunit.client.1.smithi155.stdout:6/141: dwrite db/f1f [0,4194304] 0 2024-09-13T21:44:46.255 INFO:tasks.workunit.client.1.smithi155.stdout:3/146: dwrite d3/d10/f20 [0,4194304] 0 2024-09-13T21:44:46.258 INFO:tasks.workunit.client.0.smithi119.stdout:5/514: truncate d0/d3/d4/d9/d1e/f72 289939 0 2024-09-13T21:44:46.260 INFO:tasks.workunit.client.1.smithi155.stdout:6/142: dread db/d11/f14 [0,4194304] 0 2024-09-13T21:44:46.260 INFO:tasks.workunit.client.1.smithi155.stdout:3/147: dread d3/d25/fc [0,4194304] 0 2024-09-13T21:44:46.261 INFO:tasks.workunit.client.0.smithi119.stdout:9/649: dwrite d0/f2c [0,4194304] 0 2024-09-13T21:44:46.261 INFO:tasks.workunit.client.0.smithi119.stdout:1/497: dwrite d1/d3/d61/d77/d78/d32/d33/d43/f5e [8388608,4194304] 0 2024-09-13T21:44:46.262 INFO:tasks.workunit.client.0.smithi119.stdout:5/515: dread - d0/d3/d4/d9/d14/d24/d25/fb7 zero size 2024-09-13T21:44:46.262 INFO:tasks.workunit.client.1.smithi155.stdout:6/143: unlink db/fd 0 2024-09-13T21:44:46.263 INFO:tasks.workunit.client.1.smithi155.stdout:3/148: dread d3/d25/d1b/d1f/f22 [0,4194304] 0 2024-09-13T21:44:46.264 INFO:tasks.workunit.client.1.smithi155.stdout:6/144: creat db/f22 x:0 0 0 2024-09-13T21:44:46.267 INFO:tasks.workunit.client.1.smithi155.stdout:6/145: creat db/d12/f23 x:0 0 0 2024-09-13T21:44:46.271 INFO:tasks.workunit.client.1.smithi155.stdout:3/149: dwrite d3/d21/f2f [4194304,4194304] 0 2024-09-13T21:44:46.273 INFO:tasks.workunit.client.1.smithi155.stdout:3/150: truncate d3/d25/f11 653766 0 2024-09-13T21:44:46.275 INFO:tasks.workunit.client.1.smithi155.stdout:3/151: rmdir d3/d25/d1b 39 2024-09-13T21:44:46.286 INFO:tasks.workunit.client.1.smithi155.stdout:3/152: dwrite d3/d21/f2f [8388608,4194304] 0 2024-09-13T21:44:46.287 INFO:tasks.workunit.client.1.smithi155.stdout:3/153: rmdir d3/d25 39 2024-09-13T21:44:46.302 INFO:tasks.workunit.client.0.smithi119.stdout:9/650: rename d0/d8/d18/d23/d27/d2d/d5f/d74/f93 to d0/d8/d18/d23/d27/d2d/dc1/ddf/daa/db3/fe0 0 2024-09-13T21:44:46.304 INFO:tasks.workunit.client.0.smithi119.stdout:1/498: creat d1/d3/dc/d11/fa3 x:0 0 0 2024-09-13T21:44:46.304 INFO:tasks.workunit.client.0.smithi119.stdout:9/651: write d0/d19/d1a/d2b/f6a [17529,80] 0 2024-09-13T21:44:46.306 INFO:tasks.workunit.client.0.smithi119.stdout:5/516: mkdir d0/d3/d4/d9/d1e/da5/db9 0 2024-09-13T21:44:46.307 INFO:tasks.workunit.client.0.smithi119.stdout:5/517: dread - d0/d3/d4/d9/d14/d24/d25/f9b zero size 2024-09-13T21:44:46.316 INFO:tasks.workunit.client.0.smithi119.stdout:6/435: sync 2024-09-13T21:44:46.319 INFO:tasks.workunit.client.0.smithi119.stdout:5/518: rmdir d0/d3/d1f 39 2024-09-13T21:44:46.321 INFO:tasks.workunit.client.0.smithi119.stdout:6/436: rename dc/f6f to dc/d4b/f8c 0 2024-09-13T21:44:46.322 INFO:tasks.workunit.client.0.smithi119.stdout:9/652: mkdir d0/d8/d18/d23/d42/d52/de1 0 2024-09-13T21:44:46.324 INFO:tasks.workunit.client.0.smithi119.stdout:6/437: mkdir dc/d3d/d40/d6b/d8d 0 2024-09-13T21:44:46.326 INFO:tasks.workunit.client.0.smithi119.stdout:1/499: link d1/d3/dc/d11/f17 d1/d3/d61/d77/d78/fa4 0 2024-09-13T21:44:46.329 INFO:tasks.workunit.client.0.smithi119.stdout:6/438: rename dc/dd/c46 to dc/d4b/d6a/c8e 0 2024-09-13T21:44:46.330 INFO:tasks.workunit.client.0.smithi119.stdout:9/653: dwrite d0/f7 [0,4194304] 0 2024-09-13T21:44:46.331 INFO:tasks.workunit.client.0.smithi119.stdout:4/539: sync 2024-09-13T21:44:46.331 INFO:tasks.workunit.client.0.smithi119.stdout:2/499: sync 2024-09-13T21:44:46.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:45 smithi155 ceph-mon[34732]: pgmap v7: 65 pgs: 65 active+clean; 1.0 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 28 MiB/s rd, 126 MiB/s wr, 279 op/s 2024-09-13T21:44:46.333 INFO:tasks.workunit.client.0.smithi119.stdout:1/500: unlink d1/d3/dc/d11/d28/f7d 0 2024-09-13T21:44:46.334 INFO:tasks.workunit.client.0.smithi119.stdout:5/519: link d0/d3/d4/d2e/d6b/ca8 d0/d3/d4/d9/d14/d24/d25/cba 0 2024-09-13T21:44:46.335 INFO:tasks.workunit.client.1.smithi155.stdout:3/154: fsync d3/d10/f20 0 2024-09-13T21:44:46.340 INFO:tasks.workunit.client.1.smithi155.stdout:3/155: symlink d3/d25/d1b/d1f/l35 0 2024-09-13T21:44:46.342 INFO:tasks.workunit.client.0.smithi119.stdout:1/501: creat d1/d3/d61/d77/d78/d32/d33/d43/d74/fa5 x:0 0 0 2024-09-13T21:44:46.343 INFO:tasks.workunit.client.1.smithi155.stdout:3/156: mkdir d3/d25/d1b/d1f/d36 0 2024-09-13T21:44:46.347 INFO:tasks.workunit.client.0.smithi119.stdout:9/654: dwrite d0/d8/d18/d23/d27/d2d/dc1/ddf/d81/fb0 [0,4194304] 0 2024-09-13T21:44:46.352 INFO:tasks.workunit.client.1.smithi155.stdout:3/157: dwrite d3/d21/f2f [12582912,4194304] 0 2024-09-13T21:44:46.352 INFO:tasks.workunit.client.0.smithi119.stdout:4/540: dwrite d4/d1e/d26/f61 [0,4194304] 0 2024-09-13T21:44:46.354 INFO:tasks.workunit.client.0.smithi119.stdout:5/520: dwrite d0/d3/d4/d9/d14/f29 [4194304,4194304] 0 2024-09-13T21:44:46.355 INFO:tasks.workunit.client.1.smithi155.stdout:6/146: dwrite f3 [0,4194304] 0 2024-09-13T21:44:46.357 INFO:tasks.workunit.client.0.smithi119.stdout:5/521: dread - d0/d3/d4/d2e/d65/fb2 zero size 2024-09-13T21:44:46.358 INFO:tasks.workunit.client.0.smithi119.stdout:9/655: link d0/d8/c62 d0/d4f/d56/ce2 0 2024-09-13T21:44:46.360 INFO:tasks.workunit.client.0.smithi119.stdout:5/522: write d0/d3/d4/d2e/d65/fb2 [5889,99654] 0 2024-09-13T21:44:46.361 INFO:tasks.workunit.client.1.smithi155.stdout:3/158: dread d3/d25/fc [0,4194304] 0 2024-09-13T21:44:46.362 INFO:tasks.workunit.client.0.smithi119.stdout:4/541: rmdir d4/d1e/d28/d34/d66/d76/d8f 39 2024-09-13T21:44:46.363 INFO:tasks.workunit.client.1.smithi155.stdout:6/147: mkdir db/d12/d1c/d24 0 2024-09-13T21:44:46.368 INFO:tasks.workunit.client.1.smithi155.stdout:3/159: rename d3/ff to d3/f37 0 2024-09-13T21:44:46.369 INFO:tasks.workunit.client.0.smithi119.stdout:5/523: rename d0/d3/d4/d9/d14/d24/l3a to d0/d3/d4/d9/d1e/da5/lbb 0 2024-09-13T21:44:46.369 INFO:tasks.workunit.client.0.smithi119.stdout:4/542: read d4/f96 [3968832,51753] 0 2024-09-13T21:44:46.370 INFO:tasks.workunit.client.1.smithi155.stdout:6/148: creat db/d12/d1c/d24/f25 x:0 0 0 2024-09-13T21:44:46.370 INFO:tasks.workunit.client.0.smithi119.stdout:9/656: dread d0/d8/d18/d23/d27/d2d/d6e/f9d [0,4194304] 0 2024-09-13T21:44:46.371 INFO:tasks.workunit.client.0.smithi119.stdout:9/657: chown d0/d8/cb1 198 1 2024-09-13T21:44:46.372 INFO:tasks.workunit.client.0.smithi119.stdout:4/543: mkdir d4/d1e/d26/d60/dad 0 2024-09-13T21:44:46.374 INFO:tasks.workunit.client.0.smithi119.stdout:5/524: creat d0/d3/d4/d2e/fbc x:0 0 0 2024-09-13T21:44:46.377 INFO:tasks.workunit.client.0.smithi119.stdout:4/544: mkdir d4/d1e/d28/d34/d6a/d79/dae 0 2024-09-13T21:44:46.377 INFO:tasks.workunit.client.0.smithi119.stdout:1/502: truncate d1/d3/d61/d77/d78/d32/d33/d43/d74/f8b 9612 0 2024-09-13T21:44:46.379 INFO:tasks.workunit.client.1.smithi155.stdout:3/160: dwrite d3/d25/d1b/d1f/f30 [0,4194304] 0 2024-09-13T21:44:46.380 INFO:tasks.workunit.client.0.smithi119.stdout:5/525: creat d0/d3/d1f/d21/d4f/fbd x:0 0 0 2024-09-13T21:44:46.381 INFO:tasks.workunit.client.0.smithi119.stdout:1/503: mkdir d1/d3/d61/d77/da6 0 2024-09-13T21:44:46.381 INFO:tasks.workunit.client.1.smithi155.stdout:6/149: dwrite db/d12/f23 [0,4194304] 0 2024-09-13T21:44:46.382 INFO:tasks.workunit.client.0.smithi119.stdout:5/526: truncate d0/d3/d1f/d21/f34 12839933 0 2024-09-13T21:44:46.384 INFO:tasks.workunit.client.1.smithi155.stdout:3/161: fsync d3/d25/d1b/d1f/f22 0 2024-09-13T21:44:46.384 INFO:tasks.workunit.client.1.smithi155.stdout:6/150: mkdir db/d12/d26 0 2024-09-13T21:44:46.388 INFO:tasks.workunit.client.0.smithi119.stdout:5/527: read d0/d3/d4/d9/d74/f82 [1986431,53812] 0 2024-09-13T21:44:46.390 INFO:tasks.workunit.client.0.smithi119.stdout:1/504: dwrite d1/d3/d61/d77/d78/d32/f64 [4194304,4194304] 0 2024-09-13T21:44:46.390 INFO:tasks.workunit.client.1.smithi155.stdout:3/162: dwrite d3/d21/f2f [8388608,4194304] 0 2024-09-13T21:44:46.393 INFO:tasks.workunit.client.1.smithi155.stdout:3/163: creat d3/d25/d1b/f38 x:0 0 0 2024-09-13T21:44:46.394 INFO:tasks.workunit.client.0.smithi119.stdout:9/658: dread d0/d8/d18/d23/d27/d2d/d6e/f7d [0,4194304] 0 2024-09-13T21:44:46.395 INFO:tasks.workunit.client.1.smithi155.stdout:3/164: write d3/d10/f20 [1769458,37195] 0 2024-09-13T21:44:46.397 INFO:tasks.workunit.client.0.smithi119.stdout:5/528: truncate d0/d3/f15 4194929 0 2024-09-13T21:44:46.398 INFO:tasks.workunit.client.0.smithi119.stdout:9/659: rename d0/d19/d1a/d92 to d0/d8/d18/de3 0 2024-09-13T21:44:46.400 INFO:tasks.workunit.client.0.smithi119.stdout:5/529: fdatasync d0/d3/f12 0 2024-09-13T21:44:46.402 INFO:tasks.workunit.client.1.smithi155.stdout:3/165: rename d3/d21/f2f to d3/d25/f39 0 2024-09-13T21:44:46.402 INFO:tasks.workunit.client.1.smithi155.stdout:3/166: stat d3 0 2024-09-13T21:44:46.403 INFO:tasks.workunit.client.0.smithi119.stdout:9/660: write d0/d8/d18/d23/d27/d2d/d6e/f9d [2634678,116314] 0 2024-09-13T21:44:46.404 INFO:tasks.workunit.client.0.smithi119.stdout:9/661: fdatasync d0/d8/d18/d23/f51 0 2024-09-13T21:44:46.406 INFO:tasks.workunit.client.1.smithi155.stdout:3/167: fsync d3/d25/f1c 0 2024-09-13T21:44:46.407 INFO:tasks.workunit.client.0.smithi119.stdout:9/662: truncate d0/d8/d18/d23/d27/d2d/dc1/ddf/d81/fb0 4594575 0 2024-09-13T21:44:46.410 INFO:tasks.workunit.client.0.smithi119.stdout:9/663: getdents d0/d8/d18/d23/d27/d2d/d70/dda 0 2024-09-13T21:44:46.411 INFO:tasks.workunit.client.1.smithi155.stdout:3/168: dread d3/d25/d1b/d1f/f30 [0,4194304] 0 2024-09-13T21:44:46.414 INFO:tasks.workunit.client.1.smithi155.stdout:3/169: link d3/d25/d1b/l28 d3/d25/d1b/d1f/l3a 0 2024-09-13T21:44:46.416 INFO:tasks.workunit.client.1.smithi155.stdout:3/170: dread d3/d25/d17/f1e [0,4194304] 0 2024-09-13T21:44:46.417 INFO:tasks.workunit.client.1.smithi155.stdout:3/171: write d3/d25/f39 [17077038,403] 0 2024-09-13T21:44:46.419 INFO:tasks.workunit.client.1.smithi155.stdout:3/172: mkdir d3/d25/d17/d3b 0 2024-09-13T21:44:46.423 INFO:tasks.workunit.client.1.smithi155.stdout:3/173: rmdir d3/d10/d34 0 2024-09-13T21:44:46.428 INFO:tasks.workunit.client.1.smithi155.stdout:3/174: dwrite d3/d25/fc [0,4194304] 0 2024-09-13T21:44:46.433 INFO:tasks.workunit.client.1.smithi155.stdout:3/175: unlink d3/d25/d1b/d1f/l3a 0 2024-09-13T21:44:46.434 INFO:tasks.workunit.client.1.smithi155.stdout:3/176: write d3/d25/fb [413159,130940] 0 2024-09-13T21:44:46.435 INFO:tasks.workunit.client.1.smithi155.stdout:3/177: read d3/f37 [459666,76366] 0 2024-09-13T21:44:46.444 INFO:tasks.workunit.client.1.smithi155.stdout:3/178: truncate d3/d25/f39 2975512 0 2024-09-13T21:44:46.445 INFO:tasks.workunit.client.1.smithi155.stdout:3/179: stat d3/d25/d1b/l28 0 2024-09-13T21:44:46.447 INFO:tasks.workunit.client.1.smithi155.stdout:3/180: getdents d3 0 2024-09-13T21:44:46.448 INFO:tasks.workunit.client.1.smithi155.stdout:3/181: read d3/d25/f1c [220249,64833] 0 2024-09-13T21:44:46.449 INFO:tasks.workunit.client.1.smithi155.stdout:3/182: dread - d3/d25/d17/f27 zero size 2024-09-13T21:44:46.455 INFO:tasks.workunit.client.1.smithi155.stdout:3/183: dwrite d3/d25/d1b/d1f/f2e [0,4194304] 0 2024-09-13T21:44:46.459 INFO:tasks.workunit.client.1.smithi155.stdout:3/184: dread d3/d25/f11 [0,4194304] 0 2024-09-13T21:44:46.462 INFO:tasks.workunit.client.1.smithi155.stdout:3/185: creat d3/d25/d1b/d1f/d36/f3c x:0 0 0 2024-09-13T21:44:46.464 INFO:tasks.workunit.client.1.smithi155.stdout:3/186: rename d3/d25/fc to d3/d25/d17/f3d 0 2024-09-13T21:44:46.467 INFO:tasks.workunit.client.1.smithi155.stdout:3/187: getdents d3/d25/d1b 0 2024-09-13T21:44:46.468 INFO:tasks.workunit.client.1.smithi155.stdout:3/188: write d3/d25/d1b/d1f/d36/f3c [31447,15251] 0 2024-09-13T21:44:46.469 INFO:tasks.workunit.client.1.smithi155.stdout:3/189: write d3/d21/f2b [736954,45905] 0 2024-09-13T21:44:46.470 INFO:tasks.workunit.client.1.smithi155.stdout:3/190: fdatasync d3/fa 0 2024-09-13T21:44:46.471 INFO:tasks.workunit.client.1.smithi155.stdout:3/191: truncate d3/d25/d1b/f1d 514179 0 2024-09-13T21:44:46.472 INFO:tasks.workunit.client.1.smithi155.stdout:3/192: write d3/d25/d1b/f38 [625936,90280] 0 2024-09-13T21:44:46.475 INFO:tasks.workunit.client.1.smithi155.stdout:3/193: dread d3/d25/fb [0,4194304] 0 2024-09-13T21:44:46.476 INFO:tasks.workunit.client.1.smithi155.stdout:3/194: stat d3/d25/d1b/d1f/f30 0 2024-09-13T21:44:46.476 INFO:tasks.workunit.client.0.smithi119.stdout:0/533: sync 2024-09-13T21:44:46.477 INFO:tasks.workunit.client.0.smithi119.stdout:1/505: write d1/d3/f4 [67780,125595] 0 2024-09-13T21:44:46.478 INFO:tasks.workunit.client.0.smithi119.stdout:0/534: dread - de/d1c/d2b/d76/d9a/fc2 zero size 2024-09-13T21:44:46.479 INFO:tasks.workunit.client.0.smithi119.stdout:9/664: unlink d0/d19/f26 0 2024-09-13T21:44:46.479 INFO:tasks.workunit.client.1.smithi155.stdout:3/195: rename d3/d10/l16 to d3/d25/d17/d3b/l3e 0 2024-09-13T21:44:46.479 INFO:tasks.workunit.client.1.smithi155.stdout:3/196: read d3/d25/d17/f1e [652132,61956] 0 2024-09-13T21:44:46.480 INFO:tasks.workunit.client.1.smithi155.stdout:3/197: read d3/d10/f20 [3509579,68995] 0 2024-09-13T21:44:46.486 INFO:tasks.workunit.client.1.smithi155.stdout:3/198: dwrite d3/d25/d17/f1e [0,4194304] 0 2024-09-13T21:44:46.493 INFO:tasks.workunit.client.1.smithi155.stdout:3/199: dwrite d3/d25/d1b/d1f/d36/f3c [0,4194304] 0 2024-09-13T21:44:46.497 INFO:tasks.workunit.client.1.smithi155.stdout:3/200: dread d3/fa [0,4194304] 0 2024-09-13T21:44:46.500 INFO:tasks.workunit.client.1.smithi155.stdout:3/201: creat d3/d25/f3f x:0 0 0 2024-09-13T21:44:46.501 INFO:tasks.workunit.client.1.smithi155.stdout:3/202: mknod d3/d25/d1b/c40 0 2024-09-13T21:44:46.501 INFO:tasks.workunit.client.1.smithi155.stdout:3/203: read d3/f37 [219498,115281] 0 2024-09-13T21:44:46.503 INFO:tasks.workunit.client.0.smithi119.stdout:5/530: dread d0/d3/d4/d9/d14/d24/f31 [0,4194304] 0 2024-09-13T21:44:46.507 INFO:tasks.workunit.client.1.smithi155.stdout:3/204: dwrite d3/d25/d1b/f38 [0,4194304] 0 2024-09-13T21:44:46.508 INFO:tasks.workunit.client.0.smithi119.stdout:0/535: dwrite de/d1c/d2b/d76/d9a/fc2 [0,4194304] 0 2024-09-13T21:44:46.508 INFO:tasks.workunit.client.1.smithi155.stdout:3/205: write d3/d21/f2b [1366035,69010] 0 2024-09-13T21:44:46.509 INFO:tasks.workunit.client.0.smithi119.stdout:0/536: readlink de/d1c/d2b/d76/lb4 0 2024-09-13T21:44:46.509 INFO:tasks.workunit.client.1.smithi155.stdout:3/206: read d3/f37 [618915,24861] 0 2024-09-13T21:44:46.511 INFO:tasks.workunit.client.1.smithi155.stdout:3/207: write d3/d25/d1b/f38 [3249469,50840] 0 2024-09-13T21:44:46.520 INFO:tasks.workunit.client.1.smithi155.stdout:7/57: sync 2024-09-13T21:44:46.520 INFO:tasks.workunit.client.1.smithi155.stdout:7/58: write f3 [1495526,83972] 0 2024-09-13T21:44:46.528 INFO:tasks.workunit.client.1.smithi155.stdout:7/59: dwrite d5/fb [0,4194304] 0 2024-09-13T21:44:46.529 INFO:tasks.workunit.client.1.smithi155.stdout:7/60: dread - d5/fe zero size 2024-09-13T21:44:46.531 INFO:tasks.workunit.client.1.smithi155.stdout:3/208: truncate d3/d25/d1b/d1f/f2e 3884508 0 2024-09-13T21:44:46.532 INFO:tasks.workunit.client.1.smithi155.stdout:3/209: dread - d3/d25/d17/f27 zero size 2024-09-13T21:44:46.534 INFO:tasks.workunit.client.1.smithi155.stdout:7/61: dread d5/fa [0,4194304] 0 2024-09-13T21:44:46.535 INFO:tasks.workunit.client.1.smithi155.stdout:3/210: creat d3/d21/f41 x:0 0 0 2024-09-13T21:44:46.536 INFO:tasks.workunit.client.1.smithi155.stdout:7/62: mkdir d5/df 0 2024-09-13T21:44:46.538 INFO:tasks.workunit.client.1.smithi155.stdout:3/211: rename d3/d25/d1b/d1f/l35 to d3/d25/d1b/d1f/d36/l42 0 2024-09-13T21:44:46.539 INFO:tasks.workunit.client.1.smithi155.stdout:7/63: mkdir d5/d10 0 2024-09-13T21:44:46.540 INFO:tasks.workunit.client.1.smithi155.stdout:3/212: symlink d3/d25/d1b/l43 0 2024-09-13T21:44:46.541 INFO:tasks.workunit.client.1.smithi155.stdout:3/213: chown d3/d25/f3f 4732 1 2024-09-13T21:44:46.541 INFO:tasks.workunit.client.1.smithi155.stdout:7/64: creat d5/df/f11 x:0 0 0 2024-09-13T21:44:46.542 INFO:tasks.workunit.client.1.smithi155.stdout:3/214: write d3/d25/d1b/d1f/d36/f3c [42831,14870] 0 2024-09-13T21:44:46.543 INFO:tasks.workunit.client.1.smithi155.stdout:7/65: mknod d5/c12 0 2024-09-13T21:44:46.545 INFO:tasks.workunit.client.1.smithi155.stdout:3/215: unlink d3/l29 0 2024-09-13T21:44:46.546 INFO:tasks.workunit.client.1.smithi155.stdout:7/66: mkdir d5/d13 0 2024-09-13T21:44:46.546 INFO:tasks.workunit.client.1.smithi155.stdout:7/67: chown d5 3605 1 2024-09-13T21:44:46.553 INFO:tasks.workunit.client.1.smithi155.stdout:7/68: dwrite d5/df/f11 [0,4194304] 0 2024-09-13T21:44:46.558 INFO:tasks.workunit.client.1.smithi155.stdout:7/69: creat d5/d13/f14 x:0 0 0 2024-09-13T21:44:46.559 INFO:tasks.workunit.client.1.smithi155.stdout:7/70: dread - d5/d13/f14 zero size 2024-09-13T21:44:46.559 INFO:tasks.workunit.client.1.smithi155.stdout:3/216: mknod d3/d25/d17/d3b/c44 0 2024-09-13T21:44:46.560 INFO:tasks.workunit.client.1.smithi155.stdout:7/71: write d5/d13/f14 [84858,104368] 0 2024-09-13T21:44:46.560 INFO:tasks.workunit.client.1.smithi155.stdout:7/72: chown d5/c7 12994 1 2024-09-13T21:44:46.561 INFO:tasks.workunit.client.1.smithi155.stdout:7/73: fdatasync d5/fe 0 2024-09-13T21:44:46.561 INFO:tasks.workunit.client.1.smithi155.stdout:7/74: chown l1 13 1 2024-09-13T21:44:46.563 INFO:tasks.workunit.client.1.smithi155.stdout:7/75: mkdir d5/df/d15 0 2024-09-13T21:44:46.566 INFO:tasks.workunit.client.1.smithi155.stdout:7/76: dread d5/fb [0,4194304] 0 2024-09-13T21:44:46.568 INFO:tasks.workunit.client.1.smithi155.stdout:7/77: mknod d5/df/c16 0 2024-09-13T21:44:46.569 INFO:tasks.workunit.client.1.smithi155.stdout:7/78: mknod d5/d13/c17 0 2024-09-13T21:44:46.569 INFO:tasks.workunit.client.1.smithi155.stdout:9/67: sync 2024-09-13T21:44:46.570 INFO:tasks.workunit.client.1.smithi155.stdout:1/63: sync 2024-09-13T21:44:46.570 INFO:tasks.workunit.client.1.smithi155.stdout:6/151: sync 2024-09-13T21:44:46.570 INFO:tasks.workunit.client.1.smithi155.stdout:2/80: sync 2024-09-13T21:44:46.570 INFO:tasks.workunit.client.1.smithi155.stdout:4/94: sync 2024-09-13T21:44:46.570 INFO:tasks.workunit.client.1.smithi155.stdout:5/133: sync 2024-09-13T21:44:46.570 INFO:tasks.workunit.client.1.smithi155.stdout:8/133: sync 2024-09-13T21:44:46.570 INFO:tasks.workunit.client.1.smithi155.stdout:0/133: sync 2024-09-13T21:44:46.571 INFO:tasks.workunit.client.1.smithi155.stdout:0/134: read - d1/d6/f23 zero size 2024-09-13T21:44:46.571 INFO:tasks.workunit.client.1.smithi155.stdout:7/79: creat d5/d10/f18 x:0 0 0 2024-09-13T21:44:46.573 INFO:tasks.workunit.client.1.smithi155.stdout:2/81: creat d2/db/f1e x:0 0 0 2024-09-13T21:44:46.574 INFO:tasks.workunit.client.1.smithi155.stdout:5/134: write d5/f7 [1913789,39875] 0 2024-09-13T21:44:46.576 INFO:tasks.workunit.client.1.smithi155.stdout:8/134: dread d2/d6/f19 [0,4194304] 0 2024-09-13T21:44:46.578 INFO:tasks.workunit.client.1.smithi155.stdout:4/95: truncate d1/f6 1738830 0 2024-09-13T21:44:46.582 INFO:tasks.workunit.client.1.smithi155.stdout:8/135: chown d2/d6/dd/d12 1 1 2024-09-13T21:44:46.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.581+0000 7fd04759e640 1 -- 172.21.15.119:0/1035534108 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd0400a90c0 con 0x7fd0400057b0 2024-09-13T21:44:46.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.582+0000 7fd036ffd640 1 -- 172.21.15.119:0/1035534108 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7fd038077720 con 0x7fd0400057b0 2024-09-13T21:44:46.583 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:44:46.583 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:44:46.583 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 1, 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:44:46.584 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 13, 2024-09-13T21:44:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:44:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:44:46.585 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:44:46.585 INFO:tasks.workunit.client.1.smithi155.stdout:5/135: symlink d5/d12/d25/d1b/l2b 0 2024-09-13T21:44:46.585 INFO:tasks.workunit.client.1.smithi155.stdout:1/64: dread d6/f16 [4194304,4194304] 0 2024-09-13T21:44:46.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.584+0000 7fd04759e640 1 -- 172.21.15.119:0/1035534108 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd03006e730 msgr2=0x7fd030070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:46.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.584+0000 7fd04759e640 1 --2- 172.21.15.119:0/1035534108 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd03006e730 0x7fd030070be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0400a47e0 tx=0x7fd03c011040 comp rx=0 tx=0).stop 2024-09-13T21:44:46.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.584+0000 7fd04759e640 1 -- 172.21.15.119:0/1035534108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0400057b0 msgr2=0x7fd0400a3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:46.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.584+0000 7fd04759e640 1 --2- 172.21.15.119:0/1035534108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0400057b0 0x7fd0400a3330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd03802a600 tx=0x7fd038009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.584+0000 7fd04759e640 1 -- 172.21.15.119:0/1035534108 shutdown_connections 2024-09-13T21:44:46.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.584+0000 7fd04759e640 1 --2- 172.21.15.119:0/1035534108 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd03006e730 0x7fd030070be0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.584+0000 7fd04759e640 1 --2- 172.21.15.119:0/1035534108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd040097be0 0x7fd0400a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.584+0000 7fd04759e640 1 --2- 172.21.15.119:0/1035534108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0400057b0 0x7fd0400a3330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.584+0000 7fd04759e640 1 -- 172.21.15.119:0/1035534108 >> 172.21.15.119:0/1035534108 conn(0x7fd04008f130 msgr2=0x7fd040091510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:46.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.584+0000 7fd04759e640 1 -- 172.21.15.119:0/1035534108 shutdown_connections 2024-09-13T21:44:46.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.584+0000 7fd04759e640 1 -- 172.21.15.119:0/1035534108 wait complete. 2024-09-13T21:44:46.587 INFO:tasks.workunit.client.0.smithi119.stdout:9/665: rename d0/d8/d18/d23/d27/d2d/d5f/d74 to d0/d19/de4 0 2024-09-13T21:44:46.587 INFO:tasks.workunit.client.0.smithi119.stdout:1/506: truncate d1/d3/d61/f85 58651 0 2024-09-13T21:44:46.588 INFO:tasks.workunit.client.1.smithi155.stdout:9/68: dwrite dc/de/ff [0,4194304] 0 2024-09-13T21:44:46.589 INFO:tasks.workunit.client.1.smithi155.stdout:4/96: chown d1/d7/de/dc/l13 3428841 1 2024-09-13T21:44:46.590 INFO:tasks.workunit.client.0.smithi119.stdout:0/537: chown de/d1c/f36 400 1 2024-09-13T21:44:46.592 INFO:tasks.workunit.client.0.smithi119.stdout:0/538: write de/d1c/d2b/d76/f93 [3339524,85168] 0 2024-09-13T21:44:46.592 INFO:tasks.workunit.client.1.smithi155.stdout:8/136: write d2/d8/f1c [1422561,129716] 0 2024-09-13T21:44:46.593 INFO:tasks.workunit.client.1.smithi155.stdout:0/135: dwrite d1/f34 [4194304,4194304] 0 2024-09-13T21:44:46.593 INFO:tasks.workunit.client.1.smithi155.stdout:2/82: write d2/f19 [562982,117196] 0 2024-09-13T21:44:46.593 INFO:tasks.workunit.client.1.smithi155.stdout:9/69: rmdir dc 39 2024-09-13T21:44:46.593 INFO:tasks.workunit.client.1.smithi155.stdout:7/80: dwrite d5/fa [0,4194304] 0 2024-09-13T21:44:46.595 INFO:tasks.workunit.client.1.smithi155.stdout:1/65: mknod d6/d15/c1b 0 2024-09-13T21:44:46.600 INFO:tasks.workunit.client.1.smithi155.stdout:2/83: chown d2/dd 303 1 2024-09-13T21:44:46.601 INFO:tasks.workunit.client.1.smithi155.stdout:5/136: link d5/c1a d5/d12/d25/d1b/d22/c2c 0 2024-09-13T21:44:46.609 INFO:tasks.workunit.client.1.smithi155.stdout:1/66: mknod d6/d7/c1c 0 2024-09-13T21:44:46.610 INFO:tasks.workunit.client.1.smithi155.stdout:8/137: mkdir d2/d6/d28 0 2024-09-13T21:44:46.610 INFO:tasks.workunit.client.1.smithi155.stdout:5/137: mknod d5/d12/d25/d1b/c2d 0 2024-09-13T21:44:46.611 INFO:tasks.workunit.client.1.smithi155.stdout:2/84: symlink d2/db/l1f 0 2024-09-13T21:44:46.613 INFO:tasks.workunit.client.0.smithi119.stdout:7/568: sync 2024-09-13T21:44:46.613 INFO:tasks.workunit.client.1.smithi155.stdout:9/70: dread dc/de/f10 [0,4194304] 0 2024-09-13T21:44:46.613 INFO:tasks.workunit.client.1.smithi155.stdout:0/136: link d1/d6/fb d1/f35 0 2024-09-13T21:44:46.614 INFO:tasks.workunit.client.1.smithi155.stdout:1/67: chown d6/d7/c1c 0 1 2024-09-13T21:44:46.614 INFO:tasks.workunit.client.1.smithi155.stdout:2/85: readlink d2/l5 0 2024-09-13T21:44:46.614 INFO:tasks.workunit.client.0.smithi119.stdout:1/507: creat d1/d3/dc/d11/d19/d47/fa7 x:0 0 0 2024-09-13T21:44:46.614 INFO:tasks.workunit.client.1.smithi155.stdout:4/97: dwrite d1/f4 [0,4194304] 0 2024-09-13T21:44:46.617 INFO:tasks.workunit.client.1.smithi155.stdout:2/86: write d2/dd/f17 [1042269,78089] 0 2024-09-13T21:44:46.618 INFO:tasks.workunit.client.1.smithi155.stdout:7/81: dread f3 [0,4194304] 0 2024-09-13T21:44:46.622 INFO:tasks.workunit.client.1.smithi155.stdout:4/98: read d1/f4 [3157097,45729] 0 2024-09-13T21:44:46.626 INFO:tasks.workunit.client.1.smithi155.stdout:2/87: mknod d2/dd/c20 0 2024-09-13T21:44:46.626 INFO:tasks.workunit.client.1.smithi155.stdout:0/137: fdatasync d1/f19 0 2024-09-13T21:44:46.626 INFO:tasks.workunit.client.1.smithi155.stdout:1/68: rename d6/d15/c19 to d6/d7/c1d 0 2024-09-13T21:44:46.627 INFO:tasks.workunit.client.1.smithi155.stdout:5/138: dwrite d5/fc [4194304,4194304] 0 2024-09-13T21:44:46.628 INFO:tasks.workunit.client.1.smithi155.stdout:7/82: write d5/fb [4242537,56615] 0 2024-09-13T21:44:46.629 INFO:tasks.workunit.client.1.smithi155.stdout:1/69: chown d6/fb 0 1 2024-09-13T21:44:46.629 INFO:tasks.workunit.client.1.smithi155.stdout:0/138: write d1/d6/dc/f18 [3066305,18393] 0 2024-09-13T21:44:46.635 INFO:tasks.workunit.client.1.smithi155.stdout:5/139: creat d5/d12/d25/d1b/d22/f2e x:0 0 0 2024-09-13T21:44:46.635 INFO:tasks.workunit.client.1.smithi155.stdout:0/139: mkdir d1/d6/dc/d36 0 2024-09-13T21:44:46.636 INFO:tasks.workunit.client.1.smithi155.stdout:0/140: fdatasync d1/f14 0 2024-09-13T21:44:46.637 INFO:tasks.workunit.client.1.smithi155.stdout:5/140: chown d5/d12/d25/d1b/d22/l24 2103 1 2024-09-13T21:44:46.639 INFO:tasks.workunit.client.1.smithi155.stdout:0/141: write d1/d6/f1e [278567,49999] 0 2024-09-13T21:44:46.639 INFO:tasks.workunit.client.1.smithi155.stdout:7/83: creat d5/df/f19 x:0 0 0 2024-09-13T21:44:46.640 INFO:tasks.workunit.client.1.smithi155.stdout:4/99: getdents d1 0 2024-09-13T21:44:46.641 INFO:tasks.workunit.client.1.smithi155.stdout:2/88: getdents d2 0 2024-09-13T21:44:46.642 INFO:tasks.workunit.client.1.smithi155.stdout:7/84: readlink d5/l9 0 2024-09-13T21:44:46.642 INFO:tasks.workunit.client.1.smithi155.stdout:0/142: write d1/d6/dc/f2b [857379,43145] 0 2024-09-13T21:44:46.645 INFO:tasks.workunit.client.1.smithi155.stdout:0/143: dread - d1/d6/f20 zero size 2024-09-13T21:44:46.646 INFO:tasks.workunit.client.1.smithi155.stdout:5/141: rename d5/d12/d25/d1b/d27 to d5/d12/d25/d1b/d2f 0 2024-09-13T21:44:46.649 INFO:tasks.workunit.client.1.smithi155.stdout:2/89: dread d2/f6 [0,4194304] 0 2024-09-13T21:44:46.651 INFO:tasks.workunit.client.1.smithi155.stdout:5/142: creat d5/d12/d25/d1b/d22/d29/f30 x:0 0 0 2024-09-13T21:44:46.651 INFO:tasks.workunit.client.1.smithi155.stdout:0/144: dread d1/d6/f8 [0,4194304] 0 2024-09-13T21:44:46.653 INFO:tasks.workunit.client.0.smithi119.stdout:5/531: creat d0/d3/d4/d9/d14/d24/d25/d54/fbe x:0 0 0 2024-09-13T21:44:46.654 INFO:tasks.workunit.client.1.smithi155.stdout:0/145: mknod d1/c37 0 2024-09-13T21:44:46.654 INFO:tasks.workunit.client.1.smithi155.stdout:5/143: symlink d5/d12/d25/d1b/d28/l31 0 2024-09-13T21:44:46.657 INFO:tasks.workunit.client.1.smithi155.stdout:5/144: creat d5/d16/f32 x:0 0 0 2024-09-13T21:44:46.658 INFO:tasks.workunit.client.0.smithi119.stdout:9/666: rename d0/d19/d1a to d0/d4f/de5 0 2024-09-13T21:44:46.659 INFO:tasks.workunit.client.0.smithi119.stdout:9/667: write d0/d8/d18/d23/f29 [3143914,7909] 0 2024-09-13T21:44:46.663 INFO:tasks.workunit.client.1.smithi155.stdout:9/71: write fa [2366102,17270] 0 2024-09-13T21:44:46.663 INFO:tasks.workunit.client.1.smithi155.stdout:8/138: truncate d2/f5 680629 0 2024-09-13T21:44:46.667 INFO:tasks.workunit.client.1.smithi155.stdout:9/72: creat dc/f1a x:0 0 0 2024-09-13T21:44:46.669 INFO:tasks.workunit.client.1.smithi155.stdout:8/139: link d2/d6/dd/d12/f1e d2/d6/dd/d25/f29 0 2024-09-13T21:44:46.672 INFO:tasks.workunit.client.1.smithi155.stdout:8/140: dread - d2/d6/f27 zero size 2024-09-13T21:44:46.672 INFO:tasks.workunit.client.1.smithi155.stdout:8/141: readlink d2/d1f/l24 0 2024-09-13T21:44:46.673 INFO:tasks.workunit.client.1.smithi155.stdout:8/142: truncate d2/d6/dd/d12/f21 2395488 0 2024-09-13T21:44:46.674 INFO:tasks.workunit.client.1.smithi155.stdout:9/73: creat dc/de/f1b x:0 0 0 2024-09-13T21:44:46.678 INFO:tasks.workunit.client.1.smithi155.stdout:9/74: creat dc/de/d15/f1c x:0 0 0 2024-09-13T21:44:46.678 INFO:tasks.workunit.client.0.smithi119.stdout:0/539: rename de/d1c/d9c/fbe to de/d1c/d2f/d35/d4a/dac/fc4 0 2024-09-13T21:44:46.680 INFO:tasks.workunit.client.1.smithi155.stdout:5/145: rename d5/d12/d25 to d5/d16/d33 0 2024-09-13T21:44:46.681 INFO:tasks.workunit.client.0.smithi119.stdout:9/668: creat d0/d4f/de5/db9/fe6 x:0 0 0 2024-09-13T21:44:46.682 INFO:tasks.workunit.client.1.smithi155.stdout:0/146: truncate d1/d6/dc/f10 90569 0 2024-09-13T21:44:46.682 INFO:tasks.workunit.client.1.smithi155.stdout:9/75: chown dc/de/c13 253797 1 2024-09-13T21:44:46.684 INFO:tasks.workunit.client.0.smithi119.stdout:1/508: dwrite d1/d3/d61/d77/d78/d32/d33/d72/f9f [0,4194304] 0 2024-09-13T21:44:46.684 INFO:tasks.workunit.client.1.smithi155.stdout:1/70: dwrite d6/fa [0,4194304] 0 2024-09-13T21:44:46.684 INFO:tasks.workunit.client.1.smithi155.stdout:5/146: readlink d5/d16/d33/d1b/d28/l31 0 2024-09-13T21:44:46.685 INFO:tasks.workunit.client.0.smithi119.stdout:0/540: creat de/d1c/d2f/d40/d66/fc5 x:0 0 0 2024-09-13T21:44:46.686 INFO:tasks.workunit.client.1.smithi155.stdout:9/76: write dc/de/ff [2570384,92419] 0 2024-09-13T21:44:46.686 INFO:tasks.workunit.client.1.smithi155.stdout:8/143: rename d2/d8/f1c to d2/d6/dd/d12/f2a 0 2024-09-13T21:44:46.687 INFO:tasks.workunit.client.1.smithi155.stdout:5/147: truncate d5/f10 9294129 0 2024-09-13T21:44:46.690 INFO:tasks.workunit.client.1.smithi155.stdout:4/100: dwrite d1/f6 [0,4194304] 0 2024-09-13T21:44:46.691 INFO:tasks.workunit.client.0.smithi119.stdout:9/669: dread d0/d8/d18/f94 [0,4194304] 0 2024-09-13T21:44:46.692 INFO:tasks.workunit.client.1.smithi155.stdout:1/71: mknod d6/d7/d13/c1e 0 2024-09-13T21:44:46.693 INFO:tasks.workunit.client.0.smithi119.stdout:0/541: dwrite de/d1c/f27 [0,4194304] 0 2024-09-13T21:44:46.696 INFO:tasks.workunit.client.1.smithi155.stdout:8/144: fdatasync d2/d6/fe 0 2024-09-13T21:44:46.698 INFO:tasks.workunit.client.0.smithi119.stdout:9/670: read d0/d8/f4b [3831683,99824] 0 2024-09-13T21:44:46.698 INFO:tasks.workunit.client.1.smithi155.stdout:1/72: mkdir d6/d7/d13/d1f 0 2024-09-13T21:44:46.700 INFO:tasks.workunit.client.1.smithi155.stdout:8/145: read - d2/d6/dd/d12/f1b zero size 2024-09-13T21:44:46.700 INFO:tasks.workunit.client.1.smithi155.stdout:4/101: creat d1/d7/de/d1a/f1d x:0 0 0 2024-09-13T21:44:46.701 INFO:tasks.workunit.client.0.smithi119.stdout:0/542: mknod de/d1c/d2b/d76/d9b/cc6 0 2024-09-13T21:44:46.706 INFO:tasks.workunit.client.1.smithi155.stdout:0/147: dwrite d1/d6/dc/f27 [4194304,4194304] 0 2024-09-13T21:44:46.708 INFO:tasks.workunit.client.0.smithi119.stdout:5/532: mknod d0/d3/d4/d2e/cbf 0 2024-09-13T21:44:46.709 INFO:tasks.workunit.client.0.smithi119.stdout:5/533: chown d0/d3/d4/d2e/cbf 2827246 1 2024-09-13T21:44:46.709 INFO:tasks.workunit.client.1.smithi155.stdout:5/148: rename d5/d16/d33/d1f/l23 to d5/l34 0 2024-09-13T21:44:46.711 INFO:tasks.workunit.client.0.smithi119.stdout:5/534: stat d0/d3/d4/f5 0 2024-09-13T21:44:46.712 INFO:tasks.workunit.client.0.smithi119.stdout:5/535: read d0/d3/d4/d9/d14/d24/d25/f6f [216903,41247] 0 2024-09-13T21:44:46.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.713+0000 7f83efd5c640 1 -- 172.21.15.119:0/2417726483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83e8065c40 msgr2=0x7f83e80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:46.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.713+0000 7f83efd5c640 1 --2- 172.21.15.119:0/2417726483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83e8065c40 0x7f83e80ff140 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f83e40048d0 tx=0x7f83e4009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.713+0000 7f83efd5c640 1 -- 172.21.15.119:0/2417726483 shutdown_connections 2024-09-13T21:44:46.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.713+0000 7f83efd5c640 1 --2- 172.21.15.119:0/2417726483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e80ff680 0x7f83e8101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.713+0000 7f83efd5c640 1 --2- 172.21.15.119:0/2417726483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83e8065c40 0x7f83e80ff140 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.713+0000 7f83efd5c640 1 -- 172.21.15.119:0/2417726483 >> 172.21.15.119:0/2417726483 conn(0x7f83e80f6c10 msgr2=0x7f83e80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:46.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.713+0000 7f83efd5c640 1 -- 172.21.15.119:0/2417726483 shutdown_connections 2024-09-13T21:44:46.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.713+0000 7f83efd5c640 1 -- 172.21.15.119:0/2417726483 wait complete. 2024-09-13T21:44:46.716 INFO:tasks.workunit.client.1.smithi155.stdout:8/146: dwrite d2/d6/dd/d12/f1b [0,4194304] 0 2024-09-13T21:44:46.716 INFO:tasks.workunit.client.1.smithi155.stdout:1/73: getdents d6/d7/d13/d1f 0 2024-09-13T21:44:46.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.714+0000 7f83efd5c640 1 Processor -- start 2024-09-13T21:44:46.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.714+0000 7f83efd5c640 1 -- start start 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.714+0000 7f83efd5c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e8065c40 0x7f83e810d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.714+0000 7f83efd5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83e80ff680 0x7f83e810d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.714+0000 7f83efd5c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e810e490 con 0x7f83e80ff680 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.714+0000 7f83efd5c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e810e600 con 0x7f83e8065c40 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.714+0000 7f83ed2f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83e80ff680 0x7f83e810d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.714+0000 7f83ed2f7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83e80ff680 0x7f83e810d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53866/0 (socket says 172.21.15.119:53866) 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.714+0000 7f83ed2f7640 1 -- 172.21.15.119:0/1263160658 learned_addr learned my addr 172.21.15.119:0/1263160658 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.714+0000 7f83edaf8640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e8065c40 0x7f83e810d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.715+0000 7f83ed2f7640 1 -- 172.21.15.119:0/1263160658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e8065c40 msgr2=0x7f83e810d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.715+0000 7f83ed2f7640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e8065c40 0x7f83e810d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.715+0000 7f83ed2f7640 1 -- 172.21.15.119:0/1263160658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e4005040 con 0x7f83e80ff680 2024-09-13T21:44:46.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.715+0000 7f83edaf8640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e8065c40 0x7f83e810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:44:46.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.715+0000 7f83ed2f7640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83e80ff680 0x7f83e810d670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f83d800b790 tx=0x7f83d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:46.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.715+0000 7f83de7fc640 1 -- 172.21.15.119:0/1263160658 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d800c700 con 0x7f83e80ff680 2024-09-13T21:44:46.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.715+0000 7f83efd5c640 1 -- 172.21.15.119:0/1263160658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e810e8e0 con 0x7f83e80ff680 2024-09-13T21:44:46.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.715+0000 7f83de7fc640 1 -- 172.21.15.119:0/1263160658 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f83d800cd00 con 0x7f83e80ff680 2024-09-13T21:44:46.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.715+0000 7f83de7fc640 1 -- 172.21.15.119:0/1263160658 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d8015e70 con 0x7f83e80ff680 2024-09-13T21:44:46.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.715+0000 7f83efd5c640 1 -- 172.21.15.119:0/1263160658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e810ee00 con 0x7f83e80ff680 2024-09-13T21:44:46.720 INFO:tasks.workunit.client.1.smithi155.stdout:8/147: chown d2/d8/f10 1 1 2024-09-13T21:44:46.720 INFO:tasks.workunit.client.1.smithi155.stdout:4/102: link d1/f1c d1/d7/de/d15/d1b/f1e 0 2024-09-13T21:44:46.720 INFO:tasks.workunit.client.1.smithi155.stdout:1/74: write d6/d15/f18 [506297,33023] 0 2024-09-13T21:44:46.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.716+0000 7f83efd5c640 1 -- 172.21.15.119:0/1263160658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e80fa890 con 0x7f83e80ff680 2024-09-13T21:44:46.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.717+0000 7f83de7fc640 1 -- 172.21.15.119:0/1263160658 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f83d8012070 con 0x7f83e80ff680 2024-09-13T21:44:46.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.718+0000 7f83de7fc640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f83d406e7b0 0x7f83d4070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:46.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.718+0000 7f83de7fc640 1 -- 172.21.15.119:0/1263160658 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f83d808dc90 con 0x7f83e80ff680 2024-09-13T21:44:46.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.719+0000 7f83edaf8640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f83d406e7b0 0x7f83d4070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:46.721 INFO:tasks.workunit.client.0.smithi119.stdout:8/529: sync 2024-09-13T21:44:46.722 INFO:tasks.workunit.client.1.smithi155.stdout:0/148: link d1/d6/l17 d1/d6/dc/l38 0 2024-09-13T21:44:46.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.721+0000 7f83edaf8640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f83d406e7b0 0x7f83d4070c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f83e4007ac0 tx=0x7f83e4035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:46.723 INFO:tasks.workunit.client.0.smithi119.stdout:8/530: chown d1b/d1d/d48/d58/d7f/fa5 44742531 1 2024-09-13T21:44:46.725 INFO:tasks.workunit.client.1.smithi155.stdout:8/148: dread d2/d6/dd/d12/f2a [0,4194304] 0 2024-09-13T21:44:46.726 INFO:tasks.workunit.client.0.smithi119.stdout:8/531: creat d1b/d1d/d26/fab x:0 0 0 2024-09-13T21:44:46.727 INFO:tasks.workunit.client.1.smithi155.stdout:1/75: dwrite d6/fa [0,4194304] 0 2024-09-13T21:44:46.729 INFO:tasks.workunit.client.1.smithi155.stdout:0/149: creat d1/f39 x:0 0 0 2024-09-13T21:44:46.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:46.729+0000 7f83de7fc640 1 -- 172.21.15.119:0/1263160658 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f83d80576a0 con 0x7f83e80ff680 2024-09-13T21:44:46.730 INFO:tasks.workunit.client.0.smithi119.stdout:8/532: mkdir d1b/d4e/d71/dac 0 2024-09-13T21:44:46.733 INFO:tasks.workunit.client.1.smithi155.stdout:8/149: creat d2/d1f/f2b x:0 0 0 2024-09-13T21:44:46.736 INFO:tasks.workunit.client.1.smithi155.stdout:0/150: unlink d1/d6/fb 0 2024-09-13T21:44:46.736 INFO:tasks.workunit.client.1.smithi155.stdout:5/149: write d5/fe [1280948,47008] 0 2024-09-13T21:44:46.738 INFO:tasks.workunit.client.1.smithi155.stdout:5/150: dread - d5/d12/f14 zero size 2024-09-13T21:44:46.738 INFO:tasks.workunit.client.1.smithi155.stdout:1/76: link d6/fb d6/d15/f20 0 2024-09-13T21:44:46.739 INFO:tasks.workunit.client.0.smithi119.stdout:7/569: rename d8/lc to d8/d3c/d46/lb7 0 2024-09-13T21:44:46.739 INFO:tasks.workunit.client.1.smithi155.stdout:5/151: chown d5/d16/d33/d1b/d2f 102600 1 2024-09-13T21:44:46.742 INFO:tasks.workunit.client.0.smithi119.stdout:7/570: mkdir d8/d19/db8 0 2024-09-13T21:44:46.742 INFO:tasks.workunit.client.1.smithi155.stdout:0/151: dread d1/d6/dc/f27 [0,4194304] 0 2024-09-13T21:44:46.743 INFO:tasks.workunit.client.0.smithi119.stdout:7/571: write d8/f20 [2180309,423] 0 2024-09-13T21:44:46.744 INFO:tasks.workunit.client.1.smithi155.stdout:1/77: unlink d6/d7/d13/c1e 0 2024-09-13T21:44:46.745 INFO:tasks.workunit.client.1.smithi155.stdout:5/152: readlink d5/l34 0 2024-09-13T21:44:46.746 INFO:tasks.workunit.client.0.smithi119.stdout:1/509: dwrite d1/d3/d61/d77/f94 [4194304,4194304] 0 2024-09-13T21:44:46.746 INFO:tasks.workunit.client.1.smithi155.stdout:1/78: write d6/d15/f18 [1541527,112861] 0 2024-09-13T21:44:46.747 INFO:tasks.workunit.client.1.smithi155.stdout:5/153: chown d5/d16/f32 498925 1 2024-09-13T21:44:46.748 INFO:tasks.workunit.client.0.smithi119.stdout:9/671: dread d0/f14 [8388608,4194304] 0 2024-09-13T21:44:46.748 INFO:tasks.workunit.client.0.smithi119.stdout:1/510: write d1/d3/f13 [1440487,128453] 0 2024-09-13T21:44:46.748 INFO:tasks.workunit.client.0.smithi119.stdout:7/572: symlink d8/d3c/d53/d37/lb9 0 2024-09-13T21:44:46.748 INFO:tasks.workunit.client.1.smithi155.stdout:1/79: readlink d6/l12 0 2024-09-13T21:44:46.751 INFO:tasks.workunit.client.1.smithi155.stdout:8/150: dwrite d2/d6/dd/d25/f29 [0,4194304] 0 2024-09-13T21:44:46.752 INFO:tasks.workunit.client.0.smithi119.stdout:7/573: write d8/d3c/d53/d37/d57/d8f/fa7 [753605,12090] 0 2024-09-13T21:44:46.754 INFO:tasks.workunit.client.1.smithi155.stdout:0/152: dread d1/d6/dc/f27 [4194304,4194304] 0 2024-09-13T21:44:46.755 INFO:tasks.workunit.client.0.smithi119.stdout:9/672: rename d0/d4f/de5/d2b/d60/c97 to d0/d8/d18/d23/d27/d2d/dc1/ddf/daa/db3/ce7 0 2024-09-13T21:44:46.756 INFO:tasks.workunit.client.1.smithi155.stdout:4/103: truncate d1/d7/de/dc/ff 666359 0 2024-09-13T21:44:46.757 INFO:tasks.workunit.client.0.smithi119.stdout:7/574: read d8/d3c/d46/f87 [1571954,56096] 0 2024-09-13T21:44:46.757 INFO:tasks.workunit.client.1.smithi155.stdout:1/80: creat d6/d7/d13/d17/f21 x:0 0 0 2024-09-13T21:44:46.758 INFO:tasks.workunit.client.1.smithi155.stdout:5/154: dread d5/f1c [0,4194304] 0 2024-09-13T21:44:46.760 INFO:tasks.workunit.client.1.smithi155.stdout:5/155: chown d5/f1c 0 1 2024-09-13T21:44:46.762 INFO:tasks.workunit.client.1.smithi155.stdout:8/151: dread d2/d6/dd/d12/f1b [0,4194304] 0 2024-09-13T21:44:46.764 INFO:tasks.workunit.client.0.smithi119.stdout:9/673: dwrite d0/d19/fd1 [0,4194304] 0 2024-09-13T21:44:46.765 INFO:tasks.workunit.client.1.smithi155.stdout:4/104: unlink d1/f10 0 2024-09-13T21:44:46.765 INFO:tasks.workunit.client.0.smithi119.stdout:9/674: chown d0/d19/de4/cb4 59725 1 2024-09-13T21:44:46.765 INFO:tasks.workunit.client.1.smithi155.stdout:1/81: write d6/f16 [99812,50491] 0 2024-09-13T21:44:46.766 INFO:tasks.workunit.client.1.smithi155.stdout:4/105: fdatasync d1/d7/de/d1a/f1d 0 2024-09-13T21:44:46.766 INFO:tasks.workunit.client.1.smithi155.stdout:0/153: symlink d1/d6/dc/d36/l3a 0 2024-09-13T21:44:46.770 INFO:tasks.workunit.client.1.smithi155.stdout:5/156: creat d5/d26/f35 x:0 0 0 2024-09-13T21:44:46.772 INFO:tasks.workunit.client.0.smithi119.stdout:9/675: link d0/d79/f7e d0/d8/d18/d23/fe8 0 2024-09-13T21:44:46.777 INFO:tasks.workunit.client.0.smithi119.stdout:7/575: dread d8/d3c/d46/f87 [0,4194304] 0 2024-09-13T21:44:46.777 INFO:tasks.workunit.client.0.smithi119.stdout:8/533: dwrite d1b/d1d/d48/d58/f6d [0,4194304] 0 2024-09-13T21:44:46.777 INFO:tasks.workunit.client.0.smithi119.stdout:1/511: truncate d1/d3/f13 7938466 0 2024-09-13T21:44:46.781 INFO:tasks.workunit.client.0.smithi119.stdout:7/576: mknod d8/d3c/d53/d37/d83/d89/d47/cba 0 2024-09-13T21:44:46.783 INFO:tasks.workunit.client.0.smithi119.stdout:8/534: dread d1b/d1d/d48/d58/f6d [0,4194304] 0 2024-09-13T21:44:46.783 INFO:tasks.workunit.client.1.smithi155.stdout:5/157: dread d5/fa [0,4194304] 0 2024-09-13T21:44:46.784 INFO:tasks.workunit.client.0.smithi119.stdout:1/512: rename d1/d3/dc/d11/d19/d2d/d59/d6f to d1/d3/d6c/da8 0 2024-09-13T21:44:46.784 INFO:tasks.workunit.client.0.smithi119.stdout:7/577: fdatasync d8/d4d/f80 0 2024-09-13T21:44:46.785 INFO:tasks.workunit.client.0.smithi119.stdout:8/535: fdatasync f15 0 2024-09-13T21:44:46.786 INFO:tasks.workunit.client.0.smithi119.stdout:8/536: rename d1b/d1d to d1b/d1d/d26/d3e/dad 22 2024-09-13T21:44:46.787 INFO:tasks.workunit.client.1.smithi155.stdout:8/152: truncate d2/d6/dd/d12/f21 1306161 0 2024-09-13T21:44:46.787 INFO:tasks.workunit.client.0.smithi119.stdout:1/513: mkdir d1/d3/d61/da9 0 2024-09-13T21:44:46.789 INFO:tasks.workunit.client.1.smithi155.stdout:5/158: creat d5/d12/f36 x:0 0 0 2024-09-13T21:44:46.789 INFO:tasks.workunit.client.1.smithi155.stdout:0/154: dwrite d1/d6/dc/f18 [0,4194304] 0 2024-09-13T21:44:46.793 INFO:tasks.workunit.client.0.smithi119.stdout:7/578: mknod d8/d19/db8/cbb 0 2024-09-13T21:44:46.795 INFO:tasks.workunit.client.0.smithi119.stdout:1/514: symlink d1/d3/dc/d11/d19/d2d/laa 0 2024-09-13T21:44:46.796 INFO:tasks.workunit.client.1.smithi155.stdout:0/155: write d1/d6/dc/f2b [657980,48351] 0 2024-09-13T21:44:46.798 INFO:tasks.workunit.client.1.smithi155.stdout:5/159: dwrite d5/f7 [0,4194304] 0 2024-09-13T21:44:46.799 INFO:tasks.workunit.client.1.smithi155.stdout:0/156: creat d1/d6/f3b x:0 0 0 2024-09-13T21:44:46.801 INFO:tasks.workunit.client.0.smithi119.stdout:1/515: mknod d1/d3/d61/d77/da6/cab 0 2024-09-13T21:44:46.802 INFO:tasks.workunit.client.0.smithi119.stdout:7/579: link d8/d3c/d53/c29 d8/d3c/d46/cbc 0 2024-09-13T21:44:46.803 INFO:tasks.workunit.client.0.smithi119.stdout:1/516: chown d1/d3/dc/d11/d28/f5d 416 1 2024-09-13T21:44:46.809 INFO:tasks.workunit.client.1.smithi155.stdout:1/82: dread d6/d7/d13/f14 [0,4194304] 0 2024-09-13T21:44:46.809 INFO:tasks.workunit.client.0.smithi119.stdout:7/580: unlink d8/d19/d2e/ca9 0 2024-09-13T21:44:46.810 INFO:tasks.workunit.client.1.smithi155.stdout:1/83: mkdir d6/d7/d22 0 2024-09-13T21:44:46.811 INFO:tasks.workunit.client.1.smithi155.stdout:1/84: readlink d6/l12 0 2024-09-13T21:44:46.811 INFO:tasks.workunit.client.0.smithi119.stdout:8/537: write d1b/d1d/d48/d58/d7f/fa5 [1639862,1466] 0 2024-09-13T21:44:46.811 INFO:tasks.workunit.client.1.smithi155.stdout:1/85: chown d6/d7/d22 182802156 1 2024-09-13T21:44:46.812 INFO:tasks.workunit.client.0.smithi119.stdout:9/676: dread d0/d4f/de5/f4d [0,4194304] 0 2024-09-13T21:44:46.813 INFO:tasks.workunit.client.0.smithi119.stdout:7/581: chown d8/d3c/d53/d37/d83 12 1 2024-09-13T21:44:46.814 INFO:tasks.workunit.client.0.smithi119.stdout:1/517: dwrite d1/d3/dc/d11/f17 [4194304,4194304] 0 2024-09-13T21:44:46.815 INFO:tasks.workunit.client.0.smithi119.stdout:8/538: fsync d1b/d1d/d26/d3e/d65/f88 0 2024-09-13T21:44:46.819 INFO:tasks.workunit.client.1.smithi155.stdout:0/157: write d1/d6/f13 [866618,91339] 0 2024-09-13T21:44:46.820 INFO:tasks.workunit.client.0.smithi119.stdout:7/582: creat d8/d3c/d53/d3b/d7e/fbd x:0 0 0 2024-09-13T21:44:46.821 INFO:tasks.workunit.client.0.smithi119.stdout:8/539: dread d1b/d1d/d48/f72 [0,4194304] 0 2024-09-13T21:44:46.823 INFO:tasks.workunit.client.0.smithi119.stdout:1/518: truncate d1/d3/d61/d77/d78/d32/d33/d43/d74/fa5 377135 0 2024-09-13T21:44:46.823 INFO:tasks.workunit.client.1.smithi155.stdout:1/86: truncate d6/d7/d13/f14 2097308 0 2024-09-13T21:44:46.824 INFO:tasks.workunit.client.0.smithi119.stdout:8/540: stat d1b/d1d/d48/d58/f74 0 2024-09-13T21:44:46.824 INFO:tasks.workunit.client.1.smithi155.stdout:0/158: mknod d1/d6/dc/c3c 0 2024-09-13T21:44:46.824 INFO:tasks.workunit.client.0.smithi119.stdout:1/519: write d1/f22 [1238079,5120] 0 2024-09-13T21:44:46.826 INFO:tasks.workunit.client.0.smithi119.stdout:1/520: stat d1/d3/dc/d11/d19/c21 0 2024-09-13T21:44:46.827 INFO:tasks.workunit.client.1.smithi155.stdout:1/87: mkdir d6/d15/d23 0 2024-09-13T21:44:46.828 INFO:tasks.workunit.client.1.smithi155.stdout:0/159: rename d1 to d1/d6/dc/d36/d3d 22 2024-09-13T21:44:46.828 INFO:tasks.workunit.client.1.smithi155.stdout:8/153: dwrite d2/f5 [0,4194304] 0 2024-09-13T21:44:46.831 INFO:tasks.workunit.client.1.smithi155.stdout:0/160: write d1/d6/f13 [3939890,65705] 0 2024-09-13T21:44:46.833 INFO:tasks.workunit.client.1.smithi155.stdout:1/88: creat d6/d7/f24 x:0 0 0 2024-09-13T21:44:46.833 INFO:tasks.workunit.client.0.smithi119.stdout:7/583: truncate d8/d3c/d53/d37/f6f 606354 0 2024-09-13T21:44:46.834 INFO:tasks.workunit.client.1.smithi155.stdout:8/154: creat d2/d6/dd/d12/f2c x:0 0 0 2024-09-13T21:44:46.834 INFO:tasks.workunit.client.0.smithi119.stdout:7/584: readlink d8/d3c/d53/d37/d83/lb0 0 2024-09-13T21:44:46.836 INFO:tasks.workunit.client.1.smithi155.stdout:4/106: dwrite d1/d7/de/dc/ff [0,4194304] 0 2024-09-13T21:44:46.836 INFO:tasks.workunit.client.1.smithi155.stdout:0/161: unlink d1/d6/f20 0 2024-09-13T21:44:46.838 INFO:tasks.workunit.client.0.smithi119.stdout:1/521: truncate d1/d3/d61/d77/d78/d32/f4b 194014 0 2024-09-13T21:44:46.840 INFO:tasks.workunit.client.0.smithi119.stdout:1/522: readlink d1/d3/d61/d77/d78/d32/d33/d72/l84 0 2024-09-13T21:44:46.842 INFO:tasks.workunit.client.1.smithi155.stdout:8/155: mkdir d2/d2d 0 2024-09-13T21:44:46.843 INFO:tasks.workunit.client.1.smithi155.stdout:4/107: creat d1/d7/de/f1f x:0 0 0 2024-09-13T21:44:46.843 INFO:tasks.workunit.client.0.smithi119.stdout:1/523: creat d1/d3/d61/d77/da6/fac x:0 0 0 2024-09-13T21:44:46.844 INFO:tasks.workunit.client.1.smithi155.stdout:8/156: dread - d2/d6/dd/d12/f2c zero size 2024-09-13T21:44:46.845 INFO:tasks.workunit.client.1.smithi155.stdout:0/162: creat d1/f3e x:0 0 0 2024-09-13T21:44:46.846 INFO:tasks.workunit.client.0.smithi119.stdout:9/677: dread d0/d4f/de5/f3b [0,4194304] 0 2024-09-13T21:44:46.848 INFO:tasks.workunit.client.1.smithi155.stdout:4/108: unlink d1/d7/de/d15/d1b/f1e 0 2024-09-13T21:44:46.848 INFO:tasks.workunit.client.0.smithi119.stdout:9/678: chown d0/d8/d18/d23/d27/d2d/d70/l9c 13051 1 2024-09-13T21:44:46.849 INFO:tasks.workunit.client.0.smithi119.stdout:8/541: dread d1b/d4e/d71/f98 [0,4194304] 0 2024-09-13T21:44:46.850 INFO:tasks.workunit.client.0.smithi119.stdout:1/524: truncate d1/d3/dc/d24/f29 483998 0 2024-09-13T21:44:46.851 INFO:tasks.workunit.client.0.smithi119.stdout:8/542: write d1b/d4e/f5a [3657036,78542] 0 2024-09-13T21:44:46.851 INFO:tasks.workunit.client.1.smithi155.stdout:4/109: rename c0 to d1/d7/de/d15/c20 0 2024-09-13T21:44:46.852 INFO:tasks.workunit.client.0.smithi119.stdout:9/679: write d0/d8/d18/d23/d27/f2a [2500431,106936] 0 2024-09-13T21:44:46.852 INFO:tasks.workunit.client.1.smithi155.stdout:4/110: readlink d1/d7/de/dc/l13 0 2024-09-13T21:44:46.853 INFO:tasks.workunit.client.0.smithi119.stdout:7/585: truncate d8/d3c/d53/d37/d83/d89/f12 5026065 0 2024-09-13T21:44:46.854 INFO:tasks.workunit.client.1.smithi155.stdout:4/111: write d1/f4 [1976230,71761] 0 2024-09-13T21:44:46.858 INFO:tasks.workunit.client.0.smithi119.stdout:1/525: dread d1/d3/d61/f85 [0,4194304] 0 2024-09-13T21:44:46.859 INFO:tasks.workunit.client.1.smithi155.stdout:0/163: creat d1/d6/dc/d36/f3f x:0 0 0 2024-09-13T21:44:46.860 INFO:tasks.workunit.client.1.smithi155.stdout:8/157: truncate d2/d6/dd/d12/f21 407070 0 2024-09-13T21:44:46.861 INFO:tasks.workunit.client.1.smithi155.stdout:8/158: stat d2/f20 0 2024-09-13T21:44:46.861 INFO:tasks.workunit.client.1.smithi155.stdout:4/112: dread d1/f4 [0,4194304] 0 2024-09-13T21:44:46.862 INFO:tasks.workunit.client.1.smithi155.stdout:0/164: creat d1/d6/f40 x:0 0 0 2024-09-13T21:44:46.862 INFO:tasks.workunit.client.1.smithi155.stdout:8/159: chown d2/d8/c17 156343 1 2024-09-13T21:44:46.862 INFO:tasks.workunit.client.1.smithi155.stdout:4/113: fsync d1/d7/de/dc/ff 0 2024-09-13T21:44:46.862 INFO:tasks.workunit.client.0.smithi119.stdout:7/586: dwrite d8/d3c/d53/d37/d57/d8f/fa7 [0,4194304] 0 2024-09-13T21:44:46.864 INFO:tasks.workunit.client.1.smithi155.stdout:8/160: creat d2/d6/f2e x:0 0 0 2024-09-13T21:44:46.865 INFO:tasks.workunit.client.0.smithi119.stdout:1/526: mknod d1/d3/dc/d11/d19/d2d/d59/cad 0 2024-09-13T21:44:46.865 INFO:tasks.workunit.client.1.smithi155.stdout:4/114: write d1/d7/de/d1a/f1d [108233,78830] 0 2024-09-13T21:44:46.865 INFO:tasks.workunit.client.1.smithi155.stdout:0/165: symlink d1/d6/l41 0 2024-09-13T21:44:46.866 INFO:tasks.workunit.client.1.smithi155.stdout:8/161: write d2/d1f/f2b [496480,58458] 0 2024-09-13T21:44:46.867 INFO:tasks.workunit.client.0.smithi119.stdout:9/680: write d0/d8/d18/d23/fe8 [1717722,98606] 0 2024-09-13T21:44:46.867 INFO:tasks.workunit.client.1.smithi155.stdout:0/166: fdatasync d1/f14 0 2024-09-13T21:44:46.870 INFO:tasks.workunit.client.0.smithi119.stdout:9/681: fsync d0/d8/d18/d23/f39 0 2024-09-13T21:44:46.873 INFO:tasks.workunit.client.1.smithi155.stdout:0/167: rmdir d1/d6/dc/d36 39 2024-09-13T21:44:46.874 INFO:tasks.workunit.client.1.smithi155.stdout:4/115: dwrite d1/d7/de/d1a/f1d [0,4194304] 0 2024-09-13T21:44:46.875 INFO:tasks.workunit.client.0.smithi119.stdout:1/527: creat d1/d3/dc/d11/d19/d2d/fae x:0 0 0 2024-09-13T21:44:46.876 INFO:tasks.workunit.client.1.smithi155.stdout:4/116: stat d1/d7/de/dc/ff 0 2024-09-13T21:44:46.876 INFO:tasks.workunit.client.0.smithi119.stdout:8/543: dwrite f13 [8388608,4194304] 0 2024-09-13T21:44:46.876 INFO:tasks.workunit.client.0.smithi119.stdout:7/587: dwrite d8/d19/d2e/d34/f3a [0,4194304] 0 2024-09-13T21:44:46.878 INFO:tasks.workunit.client.0.smithi119.stdout:1/528: stat d1/d3/d61/d7e/d53/f83 0 2024-09-13T21:44:46.880 INFO:tasks.workunit.client.0.smithi119.stdout:7/588: write d8/d3c/d53/d37/fa4 [971377,62067] 0 2024-09-13T21:44:46.880 INFO:tasks.workunit.client.1.smithi155.stdout:8/162: rename d2/d1f/l24 to d2/d6/dd/l2f 0 2024-09-13T21:44:46.881 INFO:tasks.workunit.client.1.smithi155.stdout:8/163: chown d2/d6/dd 12156357 1 2024-09-13T21:44:46.881 INFO:tasks.workunit.client.1.smithi155.stdout:0/168: rmdir d1/d6/dc/d36 39 2024-09-13T21:44:46.883 INFO:tasks.workunit.client.0.smithi119.stdout:8/544: rename d1b/d1d/d39/f63 to d1b/d4e/d99/fae 0 2024-09-13T21:44:46.884 INFO:tasks.workunit.client.0.smithi119.stdout:1/529: mknod d1/d3/d61/d7e/d53/caf 0 2024-09-13T21:44:46.886 INFO:tasks.workunit.client.0.smithi119.stdout:1/530: stat d1/d3/dc/d11/d19/d2d/d59 0 2024-09-13T21:44:46.887 INFO:tasks.workunit.client.0.smithi119.stdout:8/545: dread - d1b/d1d/d26/d3e/f7c zero size 2024-09-13T21:44:46.888 INFO:tasks.workunit.client.0.smithi119.stdout:2/500: sync 2024-09-13T21:44:46.888 INFO:tasks.workunit.client.0.smithi119.stdout:3/488: sync 2024-09-13T21:44:46.888 INFO:tasks.workunit.client.0.smithi119.stdout:6/439: sync 2024-09-13T21:44:46.888 INFO:tasks.workunit.client.1.smithi155.stdout:0/169: symlink d1/d6/dc/l42 0 2024-09-13T21:44:46.889 INFO:tasks.workunit.client.0.smithi119.stdout:8/546: readlink d1b/d1d/d48/d58/l59 0 2024-09-13T21:44:46.889 INFO:tasks.workunit.client.0.smithi119.stdout:1/531: fdatasync d1/d3/dc/d11/d19/d47/f7c 0 2024-09-13T21:44:46.892 INFO:tasks.workunit.client.1.smithi155.stdout:0/170: rename d1/d6/f23 to d1/f43 0 2024-09-13T21:44:46.892 INFO:tasks.workunit.client.0.smithi119.stdout:3/489: dread - d6/d25/d2f/d33/d56/f93 zero size 2024-09-13T21:44:46.894 INFO:tasks.workunit.client.1.smithi155.stdout:8/164: fdatasync d2/d6/dd/d12/f1e 0 2024-09-13T21:44:46.896 INFO:tasks.workunit.client.1.smithi155.stdout:4/117: truncate d1/f6 3905766 0 2024-09-13T21:44:46.897 INFO:tasks.workunit.client.0.smithi119.stdout:2/501: symlink d1/d22/d5a/d5d/la4 0 2024-09-13T21:44:46.897 INFO:tasks.workunit.client.0.smithi119.stdout:6/440: mknod dc/dd/d5e/d7a/d7e/c8f 0 2024-09-13T21:44:46.898 INFO:tasks.workunit.client.0.smithi119.stdout:8/547: mknod d1b/caf 0 2024-09-13T21:44:46.899 INFO:tasks.workunit.client.1.smithi155.stdout:0/171: dwrite d1/d6/f3b [0,4194304] 0 2024-09-13T21:44:46.900 INFO:tasks.workunit.client.1.smithi155.stdout:8/165: link d2/d6/f19 d2/f30 0 2024-09-13T21:44:46.902 INFO:tasks.workunit.client.1.smithi155.stdout:8/166: fdatasync d2/f30 0 2024-09-13T21:44:46.907 INFO:tasks.workunit.client.0.smithi119.stdout:1/532: dwrite d1/d3/d61/d77/f94 [0,4194304] 0 2024-09-13T21:44:46.910 INFO:tasks.workunit.client.1.smithi155.stdout:8/167: dwrite d2/d6/fe [4194304,4194304] 0 2024-09-13T21:44:46.911 INFO:tasks.workunit.client.0.smithi119.stdout:9/682: dread d0/d8/f10 [4194304,4194304] 0 2024-09-13T21:44:46.912 INFO:tasks.workunit.client.0.smithi119.stdout:8/548: dwrite d1b/d4e/d6a/f9f [0,4194304] 0 2024-09-13T21:44:46.915 INFO:tasks.workunit.client.0.smithi119.stdout:7/589: write d8/d3c/d53/f2b [4363479,61154] 0 2024-09-13T21:44:46.918 INFO:tasks.workunit.client.1.smithi155.stdout:8/168: symlink d2/d2d/l31 0 2024-09-13T21:44:46.920 INFO:tasks.workunit.client.1.smithi155.stdout:4/118: dread d1/f6 [0,4194304] 0 2024-09-13T21:44:46.923 INFO:tasks.workunit.client.0.smithi119.stdout:9/683: creat d0/d8/d18/d23/d27/d2d/d5f/da8/fe9 x:0 0 0 2024-09-13T21:44:46.923 INFO:tasks.workunit.client.0.smithi119.stdout:8/549: getdents d1b/d4e/d99 0 2024-09-13T21:44:46.924 INFO:tasks.workunit.client.0.smithi119.stdout:1/533: dwrite d1/d3/d61/d77/d78/d32/f3e [4194304,4194304] 0 2024-09-13T21:44:46.924 INFO:tasks.workunit.client.1.smithi155.stdout:4/119: chown d1/d7 1 1 2024-09-13T21:44:46.927 INFO:tasks.workunit.client.0.smithi119.stdout:7/590: unlink d8/d3c/d53/d37/d83/d89/fa 0 2024-09-13T21:44:46.927 INFO:tasks.workunit.client.0.smithi119.stdout:8/550: readlink d1b/d1d/d5e/l85 0 2024-09-13T21:44:46.927 INFO:tasks.workunit.client.1.smithi155.stdout:0/172: dread d1/f19 [0,4194304] 0 2024-09-13T21:44:46.929 INFO:tasks.workunit.client.1.smithi155.stdout:8/169: dwrite d2/d8/ff [0,4194304] 0 2024-09-13T21:44:46.930 INFO:tasks.workunit.client.1.smithi155.stdout:8/170: write d2/d6/f19 [1008661,74253] 0 2024-09-13T21:44:46.930 INFO:tasks.workunit.client.1.smithi155.stdout:0/173: symlink d1/d6/l44 0 2024-09-13T21:44:46.931 INFO:tasks.workunit.client.1.smithi155.stdout:8/171: write d2/d6/f1a [1496210,57100] 0 2024-09-13T21:44:46.933 INFO:tasks.workunit.client.1.smithi155.stdout:0/174: write d1/d6/dc/d36/f3f [401380,108712] 0 2024-09-13T21:44:46.934 INFO:tasks.workunit.client.1.smithi155.stdout:8/172: truncate d2/d6/dd/d12/f2c 79454 0 2024-09-13T21:44:46.935 INFO:tasks.workunit.client.1.smithi155.stdout:0/175: rmdir d1/d6/dc 39 2024-09-13T21:44:46.937 INFO:tasks.workunit.client.0.smithi119.stdout:1/534: creat d1/d3/dc/d24/fb0 x:0 0 0 2024-09-13T21:44:46.939 INFO:tasks.workunit.client.0.smithi119.stdout:8/551: dwrite f9 [0,4194304] 0 2024-09-13T21:44:46.941 INFO:tasks.workunit.client.1.smithi155.stdout:0/176: rename d1/d6/f8 to d1/d6/dc/f45 0 2024-09-13T21:44:46.944 INFO:tasks.workunit.client.0.smithi119.stdout:9/684: rename d0/d8/d18/d23/d27/d2d/d6e to d0/d8/d18/d23/dea 0 2024-09-13T21:44:46.944 INFO:tasks.workunit.client.0.smithi119.stdout:3/490: dwrite d6/ff [0,4194304] 0 2024-09-13T21:44:46.944 INFO:tasks.workunit.client.0.smithi119.stdout:8/552: fdatasync d1b/d1d/d48/d58/f7a 0 2024-09-13T21:44:46.950 INFO:tasks.workunit.client.1.smithi155.stdout:0/177: dwrite d1/f39 [0,4194304] 0 2024-09-13T21:44:46.951 INFO:tasks.workunit.client.0.smithi119.stdout:8/553: mknod d1b/d4e/d6a/cb0 0 2024-09-13T21:44:46.951 INFO:tasks.workunit.client.0.smithi119.stdout:6/441: dread dc/f31 [0,4194304] 0 2024-09-13T21:44:46.951 INFO:tasks.workunit.client.1.smithi155.stdout:0/178: dread - d1/f29 zero size 2024-09-13T21:44:46.952 INFO:tasks.workunit.client.0.smithi119.stdout:9/685: write d0/d8/d18/d23/f69 [4025400,120709] 0 2024-09-13T21:44:46.952 INFO:tasks.workunit.client.1.smithi155.stdout:0/179: truncate d1/f29 469091 0 2024-09-13T21:44:46.953 INFO:tasks.workunit.client.0.smithi119.stdout:6/442: read - dc/d3d/d40/f58 zero size 2024-09-13T21:44:46.955 INFO:tasks.workunit.client.0.smithi119.stdout:9/686: write d0/d8/d18/d23/f39 [7249879,99269] 0 2024-09-13T21:44:46.958 INFO:tasks.workunit.client.0.smithi119.stdout:1/535: dwrite d1/d3/dc/d11/d19/d2d/d37/f7f [0,4194304] 0 2024-09-13T21:44:46.961 INFO:tasks.workunit.client.0.smithi119.stdout:9/687: readlink d0/d8/d18/d23/dea/l8e 0 2024-09-13T21:44:46.962 INFO:tasks.workunit.client.0.smithi119.stdout:6/443: rename dc/d3d/d40/d6b/f48 to dc/df/d41/f90 0 2024-09-13T21:44:46.962 INFO:tasks.workunit.client.0.smithi119.stdout:9/688: fsync d0/d8/d18/de3/fca 0 2024-09-13T21:44:46.963 INFO:tasks.workunit.client.0.smithi119.stdout:1/536: creat d1/d3/dc/d11/d3d/fb1 x:0 0 0 2024-09-13T21:44:46.970 INFO:tasks.workunit.client.0.smithi119.stdout:1/537: mknod d1/d3/dc/d11/d19/cb2 0 2024-09-13T21:44:46.970 INFO:tasks.workunit.client.0.smithi119.stdout:9/689: creat d0/d8/d18/d23/dea/feb x:0 0 0 2024-09-13T21:44:46.971 INFO:tasks.workunit.client.0.smithi119.stdout:6/444: write dc/df/f1d [2946676,73236] 0 2024-09-13T21:44:46.972 INFO:tasks.workunit.client.1.smithi155.stdout:8/173: write d2/d8/ff [4558874,85585] 0 2024-09-13T21:44:46.972 INFO:tasks.workunit.client.0.smithi119.stdout:1/538: chown d1/d3/dc/d11/d28/d93 94835719 1 2024-09-13T21:44:46.974 INFO:tasks.workunit.client.0.smithi119.stdout:6/445: mkdir dc/d3d/d4e/d91 0 2024-09-13T21:44:46.975 INFO:tasks.workunit.client.1.smithi155.stdout:8/174: dread d2/d6/dd/d12/f1e [0,4194304] 0 2024-09-13T21:44:46.977 INFO:tasks.workunit.client.0.smithi119.stdout:9/690: creat d0/d8/d18/d23/fec x:0 0 0 2024-09-13T21:44:46.978 INFO:tasks.workunit.client.1.smithi155.stdout:0/180: dwrite d1/f35 [0,4194304] 0 2024-09-13T21:44:46.980 INFO:tasks.workunit.client.0.smithi119.stdout:6/446: read dc/df/d5c/f5f [297064,106180] 0 2024-09-13T21:44:46.980 INFO:tasks.workunit.client.1.smithi155.stdout:0/181: symlink d1/d6/dc/d36/l46 0 2024-09-13T21:44:46.980 INFO:tasks.workunit.client.1.smithi155.stdout:0/182: chown d1/d6/dc/d36 76541149 1 2024-09-13T21:44:46.981 INFO:tasks.workunit.client.1.smithi155.stdout:8/175: getdents d2/d1f 0 2024-09-13T21:44:46.982 INFO:tasks.workunit.client.0.smithi119.stdout:6/447: mknod dc/dd/d5e/d7a/c92 0 2024-09-13T21:44:46.983 INFO:tasks.workunit.client.0.smithi119.stdout:9/691: dread d0/d79/da4/fc3 [0,4194304] 0 2024-09-13T21:44:46.983 INFO:tasks.workunit.client.0.smithi119.stdout:6/448: fdatasync f9 0 2024-09-13T21:44:46.985 INFO:tasks.workunit.client.0.smithi119.stdout:6/449: chown dc/d3d/d4e/d91 1195686 1 2024-09-13T21:44:46.985 INFO:tasks.workunit.client.0.smithi119.stdout:6/450: chown dc/dd/f47 8 1 2024-09-13T21:44:46.986 INFO:tasks.workunit.client.1.smithi155.stdout:0/183: dread d1/f1f [0,4194304] 0 2024-09-13T21:44:46.988 INFO:tasks.workunit.client.1.smithi155.stdout:0/184: mknod d1/d6/c47 0 2024-09-13T21:44:46.989 INFO:tasks.workunit.client.1.smithi155.stdout:8/176: truncate d2/f30 303569 0 2024-09-13T21:44:46.990 INFO:tasks.workunit.client.0.smithi119.stdout:6/451: rename dc/l23 to dc/df/l93 0 2024-09-13T21:44:46.990 INFO:tasks.workunit.client.1.smithi155.stdout:8/177: symlink d2/d8/l32 0 2024-09-13T21:44:46.991 INFO:tasks.workunit.client.0.smithi119.stdout:9/692: dwrite d0/d8/d18/d23/f39 [4194304,4194304] 0 2024-09-13T21:44:46.991 INFO:tasks.workunit.client.0.smithi119.stdout:6/452: write dc/d3d/f8b [34266,84011] 0 2024-09-13T21:44:46.995 INFO:tasks.workunit.client.1.smithi155.stdout:0/185: dwrite d1/d6/dc/f11 [0,4194304] 0 2024-09-13T21:44:46.997 INFO:tasks.workunit.client.0.smithi119.stdout:6/453: truncate dc/f14 2339551 0 2024-09-13T21:44:46.998 INFO:tasks.workunit.client.0.smithi119.stdout:9/693: mkdir d0/d8/d18/d23/d27/d2d/d5f/ded 0 2024-09-13T21:44:46.999 INFO:tasks.workunit.client.1.smithi155.stdout:0/186: mknod d1/d6/dc/d36/c48 0 2024-09-13T21:44:46.999 INFO:tasks.workunit.client.1.smithi155.stdout:8/178: dwrite d2/d8/f10 [8388608,4194304] 0 2024-09-13T21:44:47.000 INFO:tasks.workunit.client.0.smithi119.stdout:6/454: chown dc/d3d/d4e/f57 82767865 1 2024-09-13T21:44:47.001 INFO:tasks.workunit.client.1.smithi155.stdout:8/179: mknod d2/d8/c33 0 2024-09-13T21:44:47.002 INFO:tasks.workunit.client.0.smithi119.stdout:6/455: creat dc/dd/d5e/d7a/d7e/f94 x:0 0 0 2024-09-13T21:44:47.003 INFO:tasks.workunit.client.1.smithi155.stdout:0/187: creat d1/d6/dc/d36/f49 x:0 0 0 2024-09-13T21:44:47.004 INFO:tasks.workunit.client.0.smithi119.stdout:9/694: mkdir d0/d8/d18/d23/d27/d2d/d5f/ded/dee 0 2024-09-13T21:44:47.006 INFO:tasks.workunit.client.1.smithi155.stdout:0/188: dread d1/d6/dc/d36/f3f [0,4194304] 0 2024-09-13T21:44:47.008 INFO:tasks.workunit.client.1.smithi155.stdout:0/189: mkdir d1/d6/dc/d36/d4a 0 2024-09-13T21:44:47.010 INFO:tasks.workunit.client.1.smithi155.stdout:8/180: read d2/d6/dd/d12/f1e [66168,103504] 0 2024-09-13T21:44:47.011 INFO:tasks.workunit.client.1.smithi155.stdout:0/190: creat d1/d6/dc/d36/d4a/f4b x:0 0 0 2024-09-13T21:44:47.012 INFO:tasks.workunit.client.1.smithi155.stdout:8/181: symlink d2/d1f/l34 0 2024-09-13T21:44:47.013 INFO:tasks.workunit.client.1.smithi155.stdout:8/182: symlink d2/d1f/l35 0 2024-09-13T21:44:47.015 INFO:tasks.workunit.client.1.smithi155.stdout:8/183: rmdir d2/d8 39 2024-09-13T21:44:47.018 INFO:tasks.workunit.client.1.smithi155.stdout:8/184: truncate d2/f30 48773 0 2024-09-13T21:44:47.019 INFO:tasks.workunit.client.1.smithi155.stdout:0/191: dwrite d1/d6/f2d [0,4194304] 0 2024-09-13T21:44:47.020 INFO:tasks.workunit.client.1.smithi155.stdout:8/185: write d2/d6/fe [1093355,46615] 0 2024-09-13T21:44:47.023 INFO:tasks.workunit.client.1.smithi155.stdout:0/192: symlink d1/d6/l4c 0 2024-09-13T21:44:47.025 INFO:tasks.workunit.client.1.smithi155.stdout:8/186: rmdir d2/d6/d28 0 2024-09-13T21:44:47.029 INFO:tasks.workunit.client.1.smithi155.stdout:8/187: creat d2/d8/f36 x:0 0 0 2024-09-13T21:44:47.029 INFO:tasks.workunit.client.1.smithi155.stdout:0/193: dwrite d1/f29 [0,4194304] 0 2024-09-13T21:44:47.031 INFO:tasks.workunit.client.1.smithi155.stdout:0/194: chown d1/f5 24684 1 2024-09-13T21:44:47.038 INFO:tasks.workunit.client.1.smithi155.stdout:0/195: rename d1/d6/dc/d36 to d1/d6/dc/d4d 0 2024-09-13T21:44:47.040 INFO:tasks.workunit.client.1.smithi155.stdout:0/196: mkdir d1/d6/dc/d4d/d4a/d4e 0 2024-09-13T21:44:47.043 INFO:tasks.workunit.client.1.smithi155.stdout:0/197: dread d1/f35 [0,4194304] 0 2024-09-13T21:44:47.046 INFO:tasks.workunit.client.1.smithi155.stdout:0/198: creat d1/d6/dc/d4d/d4a/d4e/f4f x:0 0 0 2024-09-13T21:44:47.049 INFO:tasks.workunit.client.0.smithi119.stdout:4/545: sync 2024-09-13T21:44:47.049 INFO:tasks.workunit.client.1.smithi155.stdout:0/199: rename d1/f31 to d1/d6/dc/d4d/f50 0 2024-09-13T21:44:47.050 INFO:tasks.workunit.client.1.smithi155.stdout:0/200: mkdir d1/d6/dc/d51 0 2024-09-13T21:44:47.052 INFO:tasks.workunit.client.1.smithi155.stdout:0/201: mkdir d1/d6/dc/d4d/d4a/d52 0 2024-09-13T21:44:47.054 INFO:tasks.workunit.client.1.smithi155.stdout:0/202: rmdir d1/d6/dc/d51 0 2024-09-13T21:44:47.055 INFO:tasks.workunit.client.0.smithi119.stdout:4/546: dwrite d4/d1e/d26/d6d/fab [0,4194304] 0 2024-09-13T21:44:47.055 INFO:tasks.workunit.client.1.smithi155.stdout:0/203: write d1/f3e [497146,78302] 0 2024-09-13T21:44:47.057 INFO:tasks.workunit.client.1.smithi155.stdout:0/204: creat d1/d6/dc/d4d/d4a/d4e/f53 x:0 0 0 2024-09-13T21:44:47.058 INFO:tasks.workunit.client.1.smithi155.stdout:0/205: readlink d1/d6/dc/d4d/l46 0 2024-09-13T21:44:47.058 INFO:tasks.workunit.client.0.smithi119.stdout:4/547: mknod d4/d1e/d28/d34/caf 0 2024-09-13T21:44:47.058 INFO:tasks.workunit.client.1.smithi155.stdout:0/206: stat d1/d6/dc/d4d/f49 0 2024-09-13T21:44:47.060 INFO:tasks.workunit.client.1.smithi155.stdout:0/207: truncate d1/d6/dc/f33 946724 0 2024-09-13T21:44:47.066 INFO:tasks.workunit.client.1.smithi155.stdout:0/208: dread d1/f3e [0,4194304] 0 2024-09-13T21:44:47.076 INFO:tasks.workunit.client.1.smithi155.stdout:0/209: dwrite d1/f39 [0,4194304] 0 2024-09-13T21:44:47.081 INFO:tasks.workunit.client.1.smithi155.stdout:0/210: creat d1/d6/dc/d4d/d4a/f54 x:0 0 0 2024-09-13T21:44:47.083 INFO:tasks.workunit.client.1.smithi155.stdout:0/211: chown d1/d6/dc/d4d/c48 114170786 1 2024-09-13T21:44:47.089 INFO:tasks.workunit.client.1.smithi155.stdout:0/212: dread d1/f35 [0,4194304] 0 2024-09-13T21:44:47.091 INFO:tasks.workunit.client.0.smithi119.stdout:7/591: dwrite d8/d3c/d53/d37/d83/d89/f12 [4194304,4194304] 0 2024-09-13T21:44:47.092 INFO:tasks.workunit.client.1.smithi155.stdout:0/213: creat d1/d6/dc/d4d/d4a/d4e/f55 x:0 0 0 2024-09-13T21:44:47.096 INFO:tasks.workunit.client.1.smithi155.stdout:0/214: link d1/d6/dc/d4d/f49 d1/d6/dc/d4d/d4a/d52/f56 0 2024-09-13T21:44:47.096 INFO:tasks.workunit.client.0.smithi119.stdout:6/456: rmdir dc/dd 39 2024-09-13T21:44:47.097 INFO:tasks.workunit.client.0.smithi119.stdout:6/457: dread - dc/d4b/f8c zero size 2024-09-13T21:44:47.098 INFO:tasks.workunit.client.0.smithi119.stdout:9/695: truncate d0/d8/d18/d23/dea/fd2 101666 0 2024-09-13T21:44:47.099 INFO:tasks.workunit.client.1.smithi155.stdout:0/215: link d1/d6/c47 d1/d6/dc/c57 0 2024-09-13T21:44:47.100 INFO:tasks.workunit.client.0.smithi119.stdout:7/592: link d8/d19/d2e/d34/f3a d8/d3c/d53/d37/d83/d89/d3d/fbe 0 2024-09-13T21:44:47.103 INFO:tasks.workunit.client.0.smithi119.stdout:9/696: rmdir d0/d8/d18/d23/d42/d52 39 2024-09-13T21:44:47.105 INFO:tasks.workunit.client.0.smithi119.stdout:7/593: mkdir d8/d3c/d53/d3b/dbf 0 2024-09-13T21:44:47.106 INFO:tasks.workunit.client.1.smithi155.stdout:0/216: dwrite d1/f3e [0,4194304] 0 2024-09-13T21:44:47.106 INFO:tasks.workunit.client.0.smithi119.stdout:9/697: creat d0/d4f/d56/fef x:0 0 0 2024-09-13T21:44:47.110 INFO:tasks.workunit.client.1.smithi155.stdout:0/217: rename d1/d6/lf to d1/d6/dc/d4d/d4a/l58 0 2024-09-13T21:44:47.111 INFO:tasks.workunit.client.0.smithi119.stdout:7/594: rename d8/d3c/d53/d37/d83/lb0 to d8/d19/db8/lc0 0 2024-09-13T21:44:47.111 INFO:tasks.workunit.client.1.smithi155.stdout:0/218: readlink d1/l30 0 2024-09-13T21:44:47.112 INFO:tasks.workunit.client.0.smithi119.stdout:9/698: rmdir d0/d8/d18/de3 39 2024-09-13T21:44:47.113 INFO:tasks.workunit.client.0.smithi119.stdout:4/548: dwrite d4/d1e/d26/d60/d71/f88 [0,4194304] 0 2024-09-13T21:44:47.114 INFO:tasks.workunit.client.1.smithi155.stdout:0/219: creat d1/d6/dc/d4d/f59 x:0 0 0 2024-09-13T21:44:47.115 INFO:tasks.workunit.client.0.smithi119.stdout:7/595: write d8/d3c/d53/d37/d83/d89/f12 [3397175,32394] 0 2024-09-13T21:44:47.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.113+0000 7f83efd5c640 1 -- 172.21.15.119:0/1263160658 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f83e804b720 con 0x7f83e80ff680 2024-09-13T21:44:47.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.114+0000 7f83de7fc640 1 -- 172.21.15.119:0/1263160658 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1837 (secure 0 0 0) 0x7f83d805ad60 con 0x7f83e80ff680 2024-09-13T21:44:47.116 INFO:teuthology.orchestra.run.smithi119.stdout:e19 2024-09-13T21:44:47.116 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 19 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:44:07.446483+0000 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:44:47.117 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:44:47.118 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:47.119 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:44:47.120 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 19 2024-09-13T21:44:47.120 INFO:tasks.workunit.client.0.smithi119.stdout:4/549: symlink d4/lb0 0 2024-09-13T21:44:47.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.118+0000 7f83efd5c640 1 -- 172.21.15.119:0/1263160658 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f83d406e7b0 msgr2=0x7f83d4070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:47.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.118+0000 7f83efd5c640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f83d406e7b0 0x7f83d4070c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f83e4007ac0 tx=0x7f83e4035040 comp rx=0 tx=0).stop 2024-09-13T21:44:47.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.118+0000 7f83efd5c640 1 -- 172.21.15.119:0/1263160658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83e80ff680 msgr2=0x7f83e810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:47.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.118+0000 7f83efd5c640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83e80ff680 0x7f83e810d670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f83d800b790 tx=0x7f83d80091d0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.118+0000 7f83efd5c640 1 -- 172.21.15.119:0/1263160658 shutdown_connections 2024-09-13T21:44:47.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.118+0000 7f83efd5c640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f83d406e7b0 0x7f83d4070c60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.118+0000 7f83efd5c640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83e80ff680 0x7f83e810d670 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.118+0000 7f83efd5c640 1 --2- 172.21.15.119:0/1263160658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e8065c40 0x7f83e810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.118+0000 7f83efd5c640 1 -- 172.21.15.119:0/1263160658 >> 172.21.15.119:0/1263160658 conn(0x7f83e80f6c10 msgr2=0x7f83e80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:47.121 INFO:tasks.workunit.client.0.smithi119.stdout:7/596: creat d8/d3c/d46/fc1 x:0 0 0 2024-09-13T21:44:47.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.119+0000 7f83efd5c640 1 -- 172.21.15.119:0/1263160658 shutdown_connections 2024-09-13T21:44:47.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.119+0000 7f83efd5c640 1 -- 172.21.15.119:0/1263160658 wait complete. 2024-09-13T21:44:47.122 INFO:tasks.workunit.client.0.smithi119.stdout:9/699: symlink d0/d8/d18/d23/d27/d2d/d5f/lf0 0 2024-09-13T21:44:47.125 INFO:tasks.workunit.client.0.smithi119.stdout:4/550: getdents d4/d1e/d28/d34 0 2024-09-13T21:44:47.125 INFO:tasks.workunit.client.0.smithi119.stdout:9/700: readlink d0/d8/d18/d23/d42/d52/d53/lc9 0 2024-09-13T21:44:47.130 INFO:tasks.workunit.client.0.smithi119.stdout:9/701: rmdir d0/d8/d18/d23/d27/d2d/dc1/ddf/daa 39 2024-09-13T21:44:47.133 INFO:tasks.workunit.client.0.smithi119.stdout:7/597: dwrite d8/d9d/fa6 [0,4194304] 0 2024-09-13T21:44:47.135 INFO:tasks.workunit.client.0.smithi119.stdout:4/551: rename d4/d1e/d26/d5e/fac to d4/d1e/d28/d34/d6a/d79/dae/fb1 0 2024-09-13T21:44:47.138 INFO:tasks.workunit.client.0.smithi119.stdout:7/598: mkdir d8/d3c/d53/d3b/d7e/dc2 0 2024-09-13T21:44:47.142 INFO:tasks.workunit.client.0.smithi119.stdout:9/702: dwrite d0/d8/d18/d23/f39 [0,4194304] 0 2024-09-13T21:44:47.142 INFO:tasks.workunit.client.0.smithi119.stdout:3/491: dread d6/d15/f30 [0,4194304] 0 2024-09-13T21:44:47.147 INFO:tasks.workunit.client.0.smithi119.stdout:3/492: write d6/d15/d1a/d45/d47/d4d/f94 [564300,43148] 0 2024-09-13T21:44:47.148 INFO:tasks.workunit.client.0.smithi119.stdout:9/703: mkdir d0/d8/d18/d23/d27/d2d/ddb/df1 0 2024-09-13T21:44:47.151 INFO:tasks.workunit.client.0.smithi119.stdout:3/493: symlink d6/la6 0 2024-09-13T21:44:47.155 INFO:tasks.workunit.client.0.smithi119.stdout:3/494: fdatasync d6/d44/f51 0 2024-09-13T21:44:47.157 INFO:tasks.workunit.client.0.smithi119.stdout:1/539: dread d1/d3/dc/d11/f3c [0,4194304] 0 2024-09-13T21:44:47.159 INFO:tasks.workunit.client.0.smithi119.stdout:3/495: rmdir d6/d25/d2f/d33 39 2024-09-13T21:44:47.160 INFO:tasks.workunit.client.1.smithi155.stdout:0/220: getdents d1/d6/dc/d4d/d4a/d52 0 2024-09-13T21:44:47.162 INFO:tasks.workunit.client.0.smithi119.stdout:4/552: dread d4/d1e/f50 [0,4194304] 0 2024-09-13T21:44:47.164 INFO:tasks.workunit.client.0.smithi119.stdout:1/540: dread d1/d3/f13 [4194304,4194304] 0 2024-09-13T21:44:47.167 INFO:tasks.workunit.client.1.smithi155.stdout:0/221: truncate d1/d6/f13 2004956 0 2024-09-13T21:44:47.170 INFO:tasks.workunit.client.0.smithi119.stdout:9/704: creat d0/d8/d18/d23/d27/d2d/dc1/ddf/ff2 x:0 0 0 2024-09-13T21:44:47.171 INFO:tasks.workunit.client.1.smithi155.stdout:0/222: dread d1/d6/dc/f27 [0,4194304] 0 2024-09-13T21:44:47.172 INFO:tasks.workunit.client.1.smithi155.stdout:3/217: sync 2024-09-13T21:44:47.173 INFO:tasks.workunit.client.1.smithi155.stdout:3/218: chown d3/d25/d17/d3b 320 1 2024-09-13T21:44:47.173 INFO:tasks.workunit.client.0.smithi119.stdout:3/496: mkdir d6/d15/d1a/d45/d47/d4d/da7 0 2024-09-13T21:44:47.173 INFO:tasks.workunit.client.0.smithi119.stdout:6/458: dread dc/d3d/d40/f69 [0,4194304] 0 2024-09-13T21:44:47.175 INFO:tasks.workunit.client.0.smithi119.stdout:9/705: dread d0/d19/f9a [0,4194304] 0 2024-09-13T21:44:47.175 INFO:tasks.workunit.client.0.smithi119.stdout:6/459: stat dc/d3d/d40/f69 0 2024-09-13T21:44:47.176 INFO:tasks.workunit.client.0.smithi119.stdout:4/553: dread d4/d1e/f17 [0,4194304] 0 2024-09-13T21:44:47.178 INFO:tasks.workunit.client.0.smithi119.stdout:9/706: read d0/d8/f4b [15719,98546] 0 2024-09-13T21:44:47.187 INFO:tasks.workunit.client.1.smithi155.stdout:3/219: mknod d3/d10/c45 0 2024-09-13T21:44:47.191 INFO:tasks.workunit.client.0.smithi119.stdout:1/541: fsync d1/d3/d61/d77/d78/f9c 0 2024-09-13T21:44:47.192 INFO:tasks.workunit.client.0.smithi119.stdout:1/542: fdatasync d1/d3/dc/d11/fa3 0 2024-09-13T21:44:47.192 INFO:tasks.workunit.client.1.smithi155.stdout:3/220: creat d3/d10/f46 x:0 0 0 2024-09-13T21:44:47.192 INFO:tasks.workunit.client.1.smithi155.stdout:3/221: chown d3/d25/d1b 343025 1 2024-09-13T21:44:47.194 INFO:tasks.workunit.client.0.smithi119.stdout:3/497: rename d6/ff to d6/d15/d1a/d45/d8d/d95/fa8 0 2024-09-13T21:44:47.195 INFO:tasks.workunit.client.1.smithi155.stdout:3/222: getdents d3/d21/d2c 0 2024-09-13T21:44:47.197 INFO:tasks.workunit.client.0.smithi119.stdout:4/554: symlink d4/d1e/d26/d60/d69/lb2 0 2024-09-13T21:44:47.198 INFO:tasks.workunit.client.0.smithi119.stdout:9/707: symlink d0/d19/de4/lf3 0 2024-09-13T21:44:47.201 INFO:tasks.workunit.client.0.smithi119.stdout:1/543: mkdir d1/d3/d61/d77/da6/db3 0 2024-09-13T21:44:47.204 INFO:tasks.workunit.client.1.smithi155.stdout:0/223: creat d1/d6/f5a x:0 0 0 2024-09-13T21:44:47.204 INFO:tasks.workunit.client.0.smithi119.stdout:6/460: rename dc/df/d64/c7c to dc/dd/d5e/d7a/d86/c95 0 2024-09-13T21:44:47.204 INFO:tasks.workunit.client.1.smithi155.stdout:0/224: chown d1/d6/l44 823 1 2024-09-13T21:44:47.205 INFO:tasks.workunit.client.0.smithi119.stdout:3/498: dread d6/d15/d1a/f3a [0,4194304] 0 2024-09-13T21:44:47.205 INFO:tasks.workunit.client.0.smithi119.stdout:4/555: mknod d4/d1e/d28/d34/d99/cb3 0 2024-09-13T21:44:47.206 INFO:tasks.workunit.client.1.smithi155.stdout:0/225: unlink d1/d6/dc/d4d/d4a/f54 0 2024-09-13T21:44:47.206 INFO:tasks.workunit.client.0.smithi119.stdout:3/499: chown d6/d25/f91 891643352 1 2024-09-13T21:44:47.207 INFO:tasks.workunit.client.1.smithi155.stdout:0/226: mkdir d1/d6/dc/d4d/d4a/d52/d5b 0 2024-09-13T21:44:47.209 INFO:tasks.workunit.client.1.smithi155.stdout:0/227: mkdir d1/d6/dc/d4d/d4a/d52/d5c 0 2024-09-13T21:44:47.209 INFO:tasks.workunit.client.0.smithi119.stdout:4/556: creat d4/d1e/d28/d34/fb4 x:0 0 0 2024-09-13T21:44:47.210 INFO:tasks.workunit.client.0.smithi119.stdout:1/544: mkdir d1/d3/d61/d77/d78/d32/d33/d72/db4 0 2024-09-13T21:44:47.212 INFO:tasks.workunit.client.0.smithi119.stdout:1/545: truncate d1/d3/dc/d11/f3c 4231458 0 2024-09-13T21:44:47.214 INFO:tasks.workunit.client.0.smithi119.stdout:9/708: link d0/d4f/d56/cbb d0/d4f/de5/d2b/cf4 0 2024-09-13T21:44:47.214 INFO:tasks.workunit.client.0.smithi119.stdout:3/500: dread d6/d15/d1a/d45/f67 [0,4194304] 0 2024-09-13T21:44:47.214 INFO:tasks.workunit.client.0.smithi119.stdout:9/709: chown d0 102 1 2024-09-13T21:44:47.215 INFO:tasks.workunit.client.0.smithi119.stdout:0/543: sync 2024-09-13T21:44:47.215 INFO:tasks.workunit.client.0.smithi119.stdout:5/536: sync 2024-09-13T21:44:47.217 INFO:tasks.workunit.client.0.smithi119.stdout:5/537: stat d0/d3/d4/d9/d14/d24/d25/f36 0 2024-09-13T21:44:47.217 INFO:tasks.workunit.client.0.smithi119.stdout:1/546: truncate d1/d3/d61/f85 138938 0 2024-09-13T21:44:47.219 INFO:tasks.workunit.client.0.smithi119.stdout:3/501: read d6/fa [81169,108047] 0 2024-09-13T21:44:47.222 INFO:tasks.workunit.client.0.smithi119.stdout:1/547: creat d1/d3/d61/fb5 x:0 0 0 2024-09-13T21:44:47.227 INFO:tasks.workunit.client.0.smithi119.stdout:9/710: mknod d0/d8/d18/d23/d27/d2d/d5f/cf5 0 2024-09-13T21:44:47.229 INFO:tasks.workunit.client.0.smithi119.stdout:4/557: link d4/f2b d4/fb5 0 2024-09-13T21:44:47.229 INFO:tasks.workunit.client.0.smithi119.stdout:0/544: dread fd [0,4194304] 0 2024-09-13T21:44:47.232 INFO:tasks.workunit.client.0.smithi119.stdout:3/502: rename d6/d25/d74 to d6/d15/da9 0 2024-09-13T21:44:47.233 INFO:tasks.workunit.client.0.smithi119.stdout:1/548: symlink d1/d3/dc/d11/d19/d2d/d59/lb6 0 2024-09-13T21:44:47.234 INFO:tasks.workunit.client.0.smithi119.stdout:1/549: chown d1/f22 53701 1 2024-09-13T21:44:47.235 INFO:tasks.workunit.client.0.smithi119.stdout:9/711: symlink d0/d79/lf6 0 2024-09-13T21:44:47.236 INFO:tasks.workunit.client.0.smithi119.stdout:1/550: dread d1/d3/d61/d7e/d53/f83 [0,4194304] 0 2024-09-13T21:44:47.237 INFO:tasks.workunit.client.0.smithi119.stdout:4/558: write d4/f53 [242892,111456] 0 2024-09-13T21:44:47.238 INFO:tasks.workunit.client.0.smithi119.stdout:6/461: truncate dc/df/f1d 1059384 0 2024-09-13T21:44:47.239 INFO:tasks.workunit.client.0.smithi119.stdout:5/538: symlink d0/d3/d4/d9/d14/d24/d25/d54/lc0 0 2024-09-13T21:44:47.240 INFO:tasks.workunit.client.0.smithi119.stdout:6/462: chown dc/dd/d5e/d7a/f81 1333562 1 2024-09-13T21:44:47.244 INFO:tasks.workunit.client.0.smithi119.stdout:4/559: symlink d4/d1e/d28/d34/d6a/lb6 0 2024-09-13T21:44:47.247 INFO:tasks.workunit.client.0.smithi119.stdout:4/560: fsync d4/d1e/d28/f2a 0 2024-09-13T21:44:47.249 INFO:tasks.workunit.client.0.smithi119.stdout:9/712: dwrite d0/d4f/de5/d2b/d60/fcb [0,4194304] 0 2024-09-13T21:44:47.251 INFO:tasks.workunit.client.0.smithi119.stdout:0/545: rename de/d1c/l1f to de/d1c/d2b/lc7 0 2024-09-13T21:44:47.256 INFO:tasks.workunit.client.0.smithi119.stdout:5/539: unlink d0/d3/d1f/d21/d4f/c94 0 2024-09-13T21:44:47.258 INFO:tasks.workunit.client.0.smithi119.stdout:4/561: mknod d4/d1e/d26/d5e/cb7 0 2024-09-13T21:44:47.259 INFO:tasks.workunit.client.0.smithi119.stdout:1/551: creat d1/d3/dc/d11/d19/fb7 x:0 0 0 2024-09-13T21:44:47.263 INFO:tasks.workunit.client.0.smithi119.stdout:1/552: fsync d1/d3/d61/d77/d78/fa4 0 2024-09-13T21:44:47.263 INFO:tasks.workunit.client.0.smithi119.stdout:4/562: truncate d4/fa6 874457 0 2024-09-13T21:44:47.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.263+0000 7efcdb6f0640 1 -- 172.21.15.119:0/3364596808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd406e420 msgr2=0x7efcd4108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:47.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.263+0000 7efcdb6f0640 1 --2- 172.21.15.119:0/3364596808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd406e420 0x7efcd4108730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efcd0004810 tx=0x7efcd0009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.263+0000 7efcdb6f0640 1 -- 172.21.15.119:0/3364596808 shutdown_connections 2024-09-13T21:44:47.265 INFO:tasks.workunit.client.0.smithi119.stdout:9/713: dwrite d0/d8/d18/dad/fde [0,4194304] 0 2024-09-13T21:44:47.265 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:46 smithi119 ceph-mon[27653]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:47.266 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:46 smithi119 ceph-mon[27653]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:47.266 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:46 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1035534108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.263+0000 7efcdb6f0640 1 --2- 172.21.15.119:0/3364596808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd406e420 0x7efcd4108730 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.263+0000 7efcdb6f0640 1 --2- 172.21.15.119:0/3364596808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd406da40 0x7efcd406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.263+0000 7efcdb6f0640 1 -- 172.21.15.119:0/3364596808 >> 172.21.15.119:0/3364596808 conn(0x7efcd4069560 msgr2=0x7efcd406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.264+0000 7efcdb6f0640 1 -- 172.21.15.119:0/3364596808 shutdown_connections 2024-09-13T21:44:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.264+0000 7efcdb6f0640 1 -- 172.21.15.119:0/3364596808 wait complete. 2024-09-13T21:44:47.267 INFO:tasks.workunit.client.0.smithi119.stdout:0/546: dwrite de/d1c/d59/fb5 [0,4194304] 0 2024-09-13T21:44:47.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.265+0000 7efcdb6f0640 1 Processor -- start 2024-09-13T21:44:47.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.265+0000 7efcdb6f0640 1 -- start start 2024-09-13T21:44:47.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.265+0000 7efcdb6f0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd406da40 0x7efcd4113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:47.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.265+0000 7efcdb6f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd406e420 0x7efcd4113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:47.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.265+0000 7efcdb6f0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd41141a0 con 0x7efcd406e420 2024-09-13T21:44:47.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.265+0000 7efcdb6f0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd4114a60 con 0x7efcd406da40 2024-09-13T21:44:47.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.266+0000 7efcd948c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd406da40 0x7efcd4113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:47.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.266+0000 7efcd948c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd406da40 0x7efcd4113660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:38012/0 (socket says 172.21.15.119:38012) 2024-09-13T21:44:47.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.266+0000 7efcd948c640 1 -- 172.21.15.119:0/1833010025 learned_addr learned my addr 172.21.15.119:0/1833010025 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.266+0000 7efcd948c640 1 -- 172.21.15.119:0/1833010025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd406e420 msgr2=0x7efcd4113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.266+0000 7efcd948c640 1 --2- 172.21.15.119:0/1833010025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd406e420 0x7efcd4113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.266+0000 7efcd948c640 1 -- 172.21.15.119:0/1833010025 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd0005040 con 0x7efcd406da40 2024-09-13T21:44:47.269 INFO:tasks.workunit.client.0.smithi119.stdout:1/553: fsync d1/d3/dc/d11/d3d/fb1 0 2024-09-13T21:44:47.269 INFO:tasks.workunit.client.1.smithi155.stdout:6/152: sync 2024-09-13T21:44:47.270 INFO:tasks.workunit.client.1.smithi155.stdout:6/153: readlink db/d11/l1b 0 2024-09-13T21:44:47.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.267+0000 7efcd948c640 1 --2- 172.21.15.119:0/1833010025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd406da40 0x7efcd4113660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efcc800a6f0 tx=0x7efcc800c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:47.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.268+0000 7efcc5ffb640 1 -- 172.21.15.119:0/1833010025 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcc8007d00 con 0x7efcd406da40 2024-09-13T21:44:47.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.269+0000 7efcc5ffb640 1 -- 172.21.15.119:0/1833010025 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efcc8010040 con 0x7efcd406da40 2024-09-13T21:44:47.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.269+0000 7efcc5ffb640 1 -- 172.21.15.119:0/1833010025 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcc800ec10 con 0x7efcd406da40 2024-09-13T21:44:47.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.269+0000 7efcdb6f0640 1 -- 172.21.15.119:0/1833010025 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd4114ce0 con 0x7efcd406da40 2024-09-13T21:44:47.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.270+0000 7efcdb6f0640 1 -- 172.21.15.119:0/1833010025 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd4115280 con 0x7efcd406da40 2024-09-13T21:44:47.273 INFO:tasks.workunit.client.1.smithi155.stdout:6/154: creat db/d12/d1c/d24/f27 x:0 0 0 2024-09-13T21:44:47.273 INFO:tasks.workunit.client.0.smithi119.stdout:6/463: write dc/d3d/d40/d68/f71 [3256946,28851] 0 2024-09-13T21:44:47.273 INFO:tasks.workunit.client.0.smithi119.stdout:5/540: dwrite d0/d3/d4/d9/d1e/f9f [0,4194304] 0 2024-09-13T21:44:47.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.271+0000 7efcdb6f0640 1 -- 172.21.15.119:0/1833010025 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd406d1b0 con 0x7efcd406da40 2024-09-13T21:44:47.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.273+0000 7efcc5ffb640 1 -- 172.21.15.119:0/1833010025 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7efcc800ed70 con 0x7efcd406da40 2024-09-13T21:44:47.275 INFO:tasks.workunit.client.1.smithi155.stdout:6/155: mkdir db/d11/d1e/d21/d28 0 2024-09-13T21:44:47.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.274+0000 7efcc5ffb640 1 --2- 172.21.15.119:0/1833010025 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7efcc006e880 0x7efcc0070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:47.275 INFO:tasks.workunit.client.0.smithi119.stdout:0/547: read - de/d1c/d52/f8d zero size 2024-09-13T21:44:47.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.274+0000 7efcc5ffb640 1 -- 172.21.15.119:0/1833010025 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7efcc808d850 con 0x7efcd406da40 2024-09-13T21:44:47.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.275+0000 7efcd8c8b640 1 --2- 172.21.15.119:0/1833010025 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7efcc006e880 0x7efcc0070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:47.277 INFO:tasks.workunit.client.0.smithi119.stdout:9/714: write d0/d8/f10 [8696419,9536] 0 2024-09-13T21:44:47.277 INFO:tasks.workunit.client.1.smithi155.stdout:6/156: creat db/d12/d1c/d24/f29 x:0 0 0 2024-09-13T21:44:47.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.276+0000 7efcd8c8b640 1 --2- 172.21.15.119:0/1833010025 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7efcc006e880 0x7efcc0070d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efcd0003080 tx=0x7efcd0009da0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:47.278 INFO:tasks.workunit.client.0.smithi119.stdout:1/554: stat d1/d3/d61/d77/d78/d32/d33/d43 0 2024-09-13T21:44:47.279 INFO:tasks.workunit.client.0.smithi119.stdout:6/464: unlink dc/dd/d5e/d7a/c92 0 2024-09-13T21:44:47.279 INFO:tasks.workunit.client.1.smithi155.stdout:6/157: truncate db/d12/d1c/d24/f25 640935 0 2024-09-13T21:44:47.280 INFO:tasks.workunit.client.0.smithi119.stdout:4/563: creat d4/d1e/d28/d34/d6a/d79/d9f/fb8 x:0 0 0 2024-09-13T21:44:47.281 INFO:tasks.workunit.client.1.smithi155.stdout:6/158: read - db/f22 zero size 2024-09-13T21:44:47.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.281+0000 7efcc5ffb640 1 -- 172.21.15.119:0/1833010025 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7efcc8050670 con 0x7efcd406da40 2024-09-13T21:44:47.283 INFO:tasks.workunit.client.1.smithi155.stdout:6/159: mkdir db/d12/d1c/d2a 0 2024-09-13T21:44:47.283 INFO:tasks.workunit.client.1.smithi155.stdout:6/160: stat f7 0 2024-09-13T21:44:47.284 INFO:tasks.workunit.client.0.smithi119.stdout:1/555: stat d1/d3/d61/d77/d78/d32/d33/d43/f5e 0 2024-09-13T21:44:47.284 INFO:tasks.workunit.client.0.smithi119.stdout:6/465: write dc/d3d/d40/f69 [4914948,59306] 0 2024-09-13T21:44:47.285 INFO:tasks.workunit.client.0.smithi119.stdout:5/541: link d0/d3/d4/d9/d14/d24/d25/d54/fbe d0/d3/d1f/d21/d4f/d86/fc1 0 2024-09-13T21:44:47.285 INFO:tasks.workunit.client.1.smithi155.stdout:6/161: mkdir db/d11/d2b 0 2024-09-13T21:44:47.288 INFO:tasks.workunit.client.0.smithi119.stdout:0/548: read de/d1c/d2b/f2c [397683,84863] 0 2024-09-13T21:44:47.288 INFO:tasks.workunit.client.0.smithi119.stdout:9/715: dwrite d0/d8/d18/d23/f29 [0,4194304] 0 2024-09-13T21:44:47.289 INFO:tasks.workunit.client.1.smithi155.stdout:6/162: dwrite f7 [0,4194304] 0 2024-09-13T21:44:47.290 INFO:tasks.workunit.client.1.smithi155.stdout:6/163: truncate db/f22 922128 0 2024-09-13T21:44:47.291 INFO:tasks.workunit.client.0.smithi119.stdout:1/556: mkdir d1/d3/d61/d77/d78/db8 0 2024-09-13T21:44:47.291 INFO:tasks.workunit.client.0.smithi119.stdout:0/549: readlink de/d1c/lb9 0 2024-09-13T21:44:47.292 INFO:tasks.workunit.client.1.smithi155.stdout:6/164: stat db/f1f 0 2024-09-13T21:44:47.293 INFO:tasks.workunit.client.0.smithi119.stdout:6/466: mknod dc/d3d/c96 0 2024-09-13T21:44:47.298 INFO:tasks.workunit.client.1.smithi155.stdout:6/165: dread db/f10 [0,4194304] 0 2024-09-13T21:44:47.299 INFO:tasks.workunit.client.0.smithi119.stdout:6/467: write dc/f31 [718077,35208] 0 2024-09-13T21:44:47.300 INFO:tasks.workunit.client.0.smithi119.stdout:5/542: truncate d0/d3/d4/d9/f64 3792784 0 2024-09-13T21:44:47.300 INFO:tasks.workunit.client.0.smithi119.stdout:4/564: dwrite d4/d1e/d28/d34/d99/fa4 [0,4194304] 0 2024-09-13T21:44:47.300 INFO:tasks.workunit.client.0.smithi119.stdout:9/716: readlink d0/d8/d18/d23/d27/d2d/dc1/ddf/daa/db3/lc5 0 2024-09-13T21:44:47.306 INFO:tasks.workunit.client.0.smithi119.stdout:4/565: creat d4/d1e/d10/fb9 x:0 0 0 2024-09-13T21:44:47.307 INFO:tasks.workunit.client.0.smithi119.stdout:5/543: creat d0/d3/d1f/d21/d4f/d86/fc2 x:0 0 0 2024-09-13T21:44:47.312 INFO:tasks.workunit.client.0.smithi119.stdout:9/717: chown d0/d8/d18/d23/d42/d52/c66 1538483455 1 2024-09-13T21:44:47.312 INFO:tasks.workunit.client.0.smithi119.stdout:1/557: dwrite d1/d3/dc/d11/d28/f3f [4194304,4194304] 0 2024-09-13T21:44:47.313 INFO:tasks.workunit.client.0.smithi119.stdout:4/566: mkdir d4/d1e/d28/d34/d6a/d79/d9f/dba 0 2024-09-13T21:44:47.314 INFO:tasks.workunit.client.0.smithi119.stdout:0/550: dwrite de/d1c/d2f/f43 [0,4194304] 0 2024-09-13T21:44:47.315 INFO:tasks.workunit.client.0.smithi119.stdout:0/551: stat de/d1c/d2f/d35/d50 0 2024-09-13T21:44:47.316 INFO:tasks.workunit.client.0.smithi119.stdout:9/718: chown d0/d19/f46 53836 1 2024-09-13T21:44:47.316 INFO:tasks.workunit.client.0.smithi119.stdout:0/552: dread - de/f17 zero size 2024-09-13T21:44:47.319 INFO:tasks.workunit.client.0.smithi119.stdout:4/567: unlink d4/d1e/ca 0 2024-09-13T21:44:47.321 INFO:tasks.workunit.client.0.smithi119.stdout:1/558: creat d1/d3/d61/d77/d78/d32/fb9 x:0 0 0 2024-09-13T21:44:47.322 INFO:tasks.workunit.client.1.smithi155.stdout:6/166: truncate db/d12/f1a 4139337 0 2024-09-13T21:44:47.325 INFO:tasks.workunit.client.1.smithi155.stdout:6/167: getdents db/d11/d1e/d21/d28 0 2024-09-13T21:44:47.325 INFO:tasks.workunit.client.0.smithi119.stdout:0/553: symlink de/lc8 0 2024-09-13T21:44:47.325 INFO:tasks.workunit.client.0.smithi119.stdout:9/719: creat d0/d8/d18/d23/d42/d52/d53/ff7 x:0 0 0 2024-09-13T21:44:47.326 INFO:tasks.workunit.client.0.smithi119.stdout:5/544: link d0/d3/c22 d0/d3/d4/d9/d1e/da5/cc3 0 2024-09-13T21:44:47.326 INFO:tasks.workunit.client.0.smithi119.stdout:9/720: fsync d0/d79/da4/fab 0 2024-09-13T21:44:47.327 INFO:tasks.workunit.client.1.smithi155.stdout:6/168: mkdir db/d2c 0 2024-09-13T21:44:47.328 INFO:tasks.workunit.client.0.smithi119.stdout:5/545: chown d0/d3/d4/f5 527702 1 2024-09-13T21:44:47.329 INFO:tasks.workunit.client.0.smithi119.stdout:9/721: write d0/d4f/de5/d2b/f91 [938702,110129] 0 2024-09-13T21:44:47.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:46 smithi155 ceph-mon[34732]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:47.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:46 smithi155 ceph-mon[34732]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:47.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:46 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1035534108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:44:47.333 INFO:tasks.workunit.client.0.smithi119.stdout:4/568: getdents d4/d1e/d26/d60 0 2024-09-13T21:44:47.334 INFO:tasks.workunit.client.0.smithi119.stdout:4/569: readlink d4/d1e/d26/d6d/d7c/l9d 0 2024-09-13T21:44:47.337 INFO:tasks.workunit.client.0.smithi119.stdout:4/570: write d4/d1e/d26/d60/d71/f8e [5137505,43850] 0 2024-09-13T21:44:47.338 INFO:tasks.workunit.client.0.smithi119.stdout:1/559: dread d1/d3/dc/f41 [0,4194304] 0 2024-09-13T21:44:47.340 INFO:tasks.workunit.client.0.smithi119.stdout:6/468: write dc/f14 [561359,47850] 0 2024-09-13T21:44:47.340 INFO:tasks.workunit.client.1.smithi155.stdout:6/169: truncate f7 1442461 0 2024-09-13T21:44:47.343 INFO:tasks.workunit.client.0.smithi119.stdout:5/546: dread d0/d3/d4/d9/f46 [0,4194304] 0 2024-09-13T21:44:47.343 INFO:tasks.workunit.client.0.smithi119.stdout:6/469: mkdir dc/d4b/d97 0 2024-09-13T21:44:47.346 INFO:tasks.workunit.client.0.smithi119.stdout:9/722: dwrite d0/d4f/de5/f4d [0,4194304] 0 2024-09-13T21:44:47.346 INFO:tasks.workunit.client.0.smithi119.stdout:1/560: mknod d1/d3/dc/d11/d28/cba 0 2024-09-13T21:44:47.349 INFO:tasks.workunit.client.0.smithi119.stdout:6/470: mkdir dc/df/d5c/d98 0 2024-09-13T21:44:47.350 INFO:tasks.workunit.client.0.smithi119.stdout:9/723: dread d0/d8/d18/d23/dea/f7d [0,4194304] 0 2024-09-13T21:44:47.353 INFO:tasks.workunit.client.0.smithi119.stdout:4/571: write d4/d1e/d26/d60/f65 [934159,91499] 0 2024-09-13T21:44:47.354 INFO:tasks.workunit.client.0.smithi119.stdout:6/471: symlink dc/dd/d5e/d7a/d86/l99 0 2024-09-13T21:44:47.355 INFO:tasks.workunit.client.1.smithi155.stdout:6/170: dwrite f7 [0,4194304] 0 2024-09-13T21:44:47.355 INFO:tasks.workunit.client.0.smithi119.stdout:9/724: chown d0/d19/c41 22 1 2024-09-13T21:44:47.358 INFO:tasks.workunit.client.0.smithi119.stdout:1/561: getdents d1/d3/dc/d11/d19/d2d 0 2024-09-13T21:44:47.358 INFO:tasks.workunit.client.0.smithi119.stdout:0/554: dwrite de/d1c/d2f/d35/d4a/f60 [0,4194304] 0 2024-09-13T21:44:47.359 INFO:tasks.workunit.client.1.smithi155.stdout:6/171: creat db/d11/d1e/d21/f2d x:0 0 0 2024-09-13T21:44:47.360 INFO:tasks.workunit.client.1.smithi155.stdout:6/172: chown db/d12/d1c/d24/f25 1 1 2024-09-13T21:44:47.360 INFO:tasks.workunit.client.1.smithi155.stdout:6/173: dread - db/d12/d1c/d24/f29 zero size 2024-09-13T21:44:47.362 INFO:tasks.workunit.client.0.smithi119.stdout:1/562: chown d1/d3/d61/d77/d78/d32/d33/c55 1564 1 2024-09-13T21:44:47.363 INFO:tasks.workunit.client.0.smithi119.stdout:4/572: unlink d4/d1e/d10/la8 0 2024-09-13T21:44:47.364 INFO:tasks.workunit.client.1.smithi155.stdout:6/174: dread db/f22 [0,4194304] 0 2024-09-13T21:44:47.364 INFO:tasks.workunit.client.0.smithi119.stdout:5/547: link d0/d3/d4/c8c d0/d3/d4/d2e/d97/cc4 0 2024-09-13T21:44:47.364 INFO:tasks.workunit.client.0.smithi119.stdout:5/548: chown d0 190720 1 2024-09-13T21:44:47.368 INFO:tasks.workunit.client.0.smithi119.stdout:9/725: creat d0/d8/d18/d23/d27/d2d/d5f/da8/ff8 x:0 0 0 2024-09-13T21:44:47.368 INFO:tasks.workunit.client.0.smithi119.stdout:6/472: link dc/df/f1c dc/d3d/d4e/d91/f9a 0 2024-09-13T21:44:47.369 INFO:tasks.workunit.client.0.smithi119.stdout:5/549: unlink d0/d3/d4/d9/d74/l7b 0 2024-09-13T21:44:47.370 INFO:tasks.workunit.client.1.smithi155.stdout:6/175: dwrite f7 [0,4194304] 0 2024-09-13T21:44:47.371 INFO:tasks.workunit.client.0.smithi119.stdout:5/550: chown d0/d3/d1f/f52 101352 1 2024-09-13T21:44:47.371 INFO:tasks.workunit.client.0.smithi119.stdout:1/563: mknod d1/d3/dc/d11/d28/d93/cbb 0 2024-09-13T21:44:47.371 INFO:tasks.workunit.client.1.smithi155.stdout:6/176: write db/d12/d1c/d24/f27 [419033,8360] 0 2024-09-13T21:44:47.373 INFO:tasks.workunit.client.0.smithi119.stdout:6/473: creat dc/d3d/d4e/f9b x:0 0 0 2024-09-13T21:44:47.374 INFO:tasks.workunit.client.0.smithi119.stdout:1/564: write d1/d3/d61/d77/d78/d32/d33/d43/f5e [12566987,35882] 0 2024-09-13T21:44:47.375 INFO:tasks.workunit.client.1.smithi155.stdout:6/177: creat db/d11/d1e/f2e x:0 0 0 2024-09-13T21:44:47.377 INFO:tasks.workunit.client.0.smithi119.stdout:5/551: dread d0/d3/f15 [0,4194304] 0 2024-09-13T21:44:47.377 INFO:tasks.workunit.client.0.smithi119.stdout:4/573: read d4/f21 [3483247,3557] 0 2024-09-13T21:44:47.378 INFO:tasks.workunit.client.0.smithi119.stdout:1/565: readlink d1/d3/dc/d11/d19/d2d/l8a 0 2024-09-13T21:44:47.378 INFO:tasks.workunit.client.0.smithi119.stdout:6/474: creat dc/d3a/f9c x:0 0 0 2024-09-13T21:44:47.381 INFO:tasks.workunit.client.0.smithi119.stdout:0/555: write de/d1c/f36 [916365,63211] 0 2024-09-13T21:44:47.381 INFO:tasks.workunit.client.1.smithi155.stdout:6/178: dwrite f7 [0,4194304] 0 2024-09-13T21:44:47.381 INFO:tasks.workunit.client.1.smithi155.stdout:6/179: stat db/d12/d26 0 2024-09-13T21:44:47.385 INFO:tasks.workunit.client.1.smithi155.stdout:6/180: creat db/f2f x:0 0 0 2024-09-13T21:44:47.386 INFO:tasks.workunit.client.0.smithi119.stdout:1/566: mknod d1/d3/d6c/da8/cbc 0 2024-09-13T21:44:47.386 INFO:tasks.workunit.client.1.smithi155.stdout:6/181: truncate db/d12/d1c/d24/f25 900143 0 2024-09-13T21:44:47.387 INFO:tasks.workunit.client.1.smithi155.stdout:6/182: chown db/d12/d1c 20081117 1 2024-09-13T21:44:47.389 INFO:tasks.workunit.client.1.smithi155.stdout:6/183: unlink db/d11/l1b 0 2024-09-13T21:44:47.391 INFO:tasks.workunit.client.1.smithi155.stdout:6/184: fdatasync db/d12/f1a 0 2024-09-13T21:44:47.393 INFO:tasks.workunit.client.1.smithi155.stdout:6/185: symlink db/d2c/l30 0 2024-09-13T21:44:47.393 INFO:tasks.workunit.client.1.smithi155.stdout:6/186: fsync db/d12/f17 0 2024-09-13T21:44:47.394 INFO:tasks.workunit.client.0.smithi119.stdout:0/556: dwrite de/d1c/d2f/f41 [0,4194304] 0 2024-09-13T21:44:47.397 INFO:tasks.workunit.client.1.smithi155.stdout:6/187: rmdir db/d11/d1e/d21/d28 0 2024-09-13T21:44:47.397 INFO:tasks.workunit.client.1.smithi155.stdout:6/188: chown db/d12/d1c/d24/f25 39016 1 2024-09-13T21:44:47.398 INFO:tasks.workunit.client.0.smithi119.stdout:5/552: dwrite d0/d3/d4/d9/d14/d24/d25/f9b [0,4194304] 0 2024-09-13T21:44:47.398 INFO:tasks.workunit.client.1.smithi155.stdout:6/189: symlink db/d11/l31 0 2024-09-13T21:44:47.402 INFO:tasks.workunit.client.0.smithi119.stdout:4/574: write d4/f4b [38768,111105] 0 2024-09-13T21:44:47.405 INFO:tasks.workunit.client.0.smithi119.stdout:1/567: dwrite d1/d3/dc/d11/d3d/f98 [0,4194304] 0 2024-09-13T21:44:47.405 INFO:tasks.workunit.client.0.smithi119.stdout:5/553: symlink d0/d3/d4/d2e/d97/lc5 0 2024-09-13T21:44:47.407 INFO:tasks.workunit.client.1.smithi155.stdout:6/190: dwrite db/f10 [0,4194304] 0 2024-09-13T21:44:47.408 INFO:tasks.workunit.client.0.smithi119.stdout:5/554: write d0/d3/d4/d2e/f71 [308867,97735] 0 2024-09-13T21:44:47.411 INFO:tasks.workunit.client.0.smithi119.stdout:0/557: dwrite fc [0,4194304] 0 2024-09-13T21:44:47.411 INFO:tasks.workunit.client.0.smithi119.stdout:5/555: readlink d0/d3/lb3 0 2024-09-13T21:44:47.413 INFO:tasks.workunit.client.0.smithi119.stdout:1/568: truncate d1/d3/dc/d11/f17 8747310 0 2024-09-13T21:44:47.414 INFO:tasks.workunit.client.1.smithi155.stdout:6/191: rename db/c15 to db/d2c/c32 0 2024-09-13T21:44:47.420 INFO:tasks.workunit.client.1.smithi155.stdout:6/192: dread db/f1f [0,4194304] 0 2024-09-13T21:44:47.421 INFO:tasks.workunit.client.1.smithi155.stdout:6/193: readlink db/d11/l31 0 2024-09-13T21:44:47.425 INFO:tasks.workunit.client.0.smithi119.stdout:5/556: dwrite d0/d3/d1f/d21/da1/f57 [0,4194304] 0 2024-09-13T21:44:47.425 INFO:tasks.workunit.client.0.smithi119.stdout:6/475: dread dc/dd/f47 [4194304,4194304] 0 2024-09-13T21:44:47.428 INFO:tasks.workunit.client.1.smithi155.stdout:6/194: dwrite db/f10 [0,4194304] 0 2024-09-13T21:44:47.432 INFO:tasks.workunit.client.0.smithi119.stdout:6/476: mknod dc/d4b/d6a/c9d 0 2024-09-13T21:44:47.433 INFO:tasks.workunit.client.0.smithi119.stdout:5/557: unlink d0/d3/d1f/d21/f85 0 2024-09-13T21:44:47.439 INFO:tasks.workunit.client.0.smithi119.stdout:5/558: symlink d0/d3/d1f/lc6 0 2024-09-13T21:44:47.440 INFO:tasks.workunit.client.0.smithi119.stdout:6/477: getdents dc/dd/d5e/d7a/d86 0 2024-09-13T21:44:47.445 INFO:tasks.workunit.client.0.smithi119.stdout:4/575: dread d4/d1e/ff [0,4194304] 0 2024-09-13T21:44:47.445 INFO:tasks.workunit.client.0.smithi119.stdout:6/478: rename dc/df/c21 to dc/d4b/d97/c9e 0 2024-09-13T21:44:47.446 INFO:tasks.workunit.client.0.smithi119.stdout:4/576: chown d4/d1e/f33 433 1 2024-09-13T21:44:47.446 INFO:tasks.workunit.client.0.smithi119.stdout:6/479: readlink dc/df/l19 0 2024-09-13T21:44:47.447 INFO:tasks.workunit.client.0.smithi119.stdout:6/480: chown dc/d3d/d4e 102453 1 2024-09-13T21:44:47.448 INFO:tasks.workunit.client.0.smithi119.stdout:4/577: creat d4/d1e/d26/d60/dad/fbb x:0 0 0 2024-09-13T21:44:47.453 INFO:tasks.workunit.client.0.smithi119.stdout:6/481: dwrite dc/dd/f47 [0,4194304] 0 2024-09-13T21:44:47.457 INFO:tasks.workunit.client.0.smithi119.stdout:6/482: rename dc/c5b to dc/d4b/d97/c9f 0 2024-09-13T21:44:47.458 INFO:tasks.workunit.client.0.smithi119.stdout:6/483: write dc/df/d64/f77 [431331,30405] 0 2024-09-13T21:44:47.462 INFO:tasks.workunit.client.0.smithi119.stdout:6/484: creat dc/d3d/fa0 x:0 0 0 2024-09-13T21:44:47.463 INFO:tasks.workunit.client.0.smithi119.stdout:1/569: truncate d1/d3/d61/d77/f94 8272699 0 2024-09-13T21:44:47.466 INFO:tasks.workunit.client.0.smithi119.stdout:0/558: dread de/d1c/d2b/d34/f5f [0,4194304] 0 2024-09-13T21:44:47.466 INFO:tasks.workunit.client.0.smithi119.stdout:1/570: chown d1/d3/d61/d77/d78/f50 21 1 2024-09-13T21:44:47.466 INFO:tasks.workunit.client.1.smithi155.stdout:6/195: fdatasync db/d11/f14 0 2024-09-13T21:44:47.466 INFO:tasks.workunit.client.1.smithi155.stdout:6/196: fdatasync db/d12/f23 0 2024-09-13T21:44:47.468 INFO:tasks.workunit.client.0.smithi119.stdout:1/571: readlink d1/d3/d61/d77/d78/d32/d33/d43/d74/l88 0 2024-09-13T21:44:47.468 INFO:tasks.workunit.client.0.smithi119.stdout:0/559: mknod de/d4e/da5/cc9 0 2024-09-13T21:44:47.468 INFO:tasks.workunit.client.1.smithi155.stdout:6/197: rename db/d2c/l30 to db/d11/d2b/l33 0 2024-09-13T21:44:47.470 INFO:tasks.workunit.client.1.smithi155.stdout:6/198: symlink db/l34 0 2024-09-13T21:44:47.470 INFO:tasks.workunit.client.0.smithi119.stdout:1/572: mknod d1/d3/dc/d11/d19/d47/cbd 0 2024-09-13T21:44:47.471 INFO:tasks.workunit.client.0.smithi119.stdout:5/559: dwrite d0/d3/d4/d9/d14/d24/d25/d54/fbe [0,4194304] 0 2024-09-13T21:44:47.472 INFO:tasks.workunit.client.1.smithi155.stdout:6/199: rename db/d12/d1c/d24 to db/d11/d2b/d35 0 2024-09-13T21:44:47.474 INFO:tasks.workunit.client.0.smithi119.stdout:6/485: read dc/df/f44 [1643272,27519] 0 2024-09-13T21:44:47.474 INFO:tasks.workunit.client.1.smithi155.stdout:6/200: mkdir db/d12/d1c/d36 0 2024-09-13T21:44:47.475 INFO:tasks.workunit.client.0.smithi119.stdout:1/573: symlink d1/d3/d61/d77/da6/lbe 0 2024-09-13T21:44:47.476 INFO:tasks.workunit.client.0.smithi119.stdout:5/560: mknod d0/d3/d4/d2e/cc7 0 2024-09-13T21:44:47.477 INFO:tasks.workunit.client.1.smithi155.stdout:6/201: mkdir db/d12/d1c/d36/d37 0 2024-09-13T21:44:47.478 INFO:tasks.workunit.client.0.smithi119.stdout:6/486: symlink dc/d3d/d40/d68/la1 0 2024-09-13T21:44:47.479 INFO:tasks.workunit.client.0.smithi119.stdout:6/487: chown dc/dd/f47 0 1 2024-09-13T21:44:47.480 INFO:tasks.workunit.client.1.smithi155.stdout:6/202: creat db/d11/f38 x:0 0 0 2024-09-13T21:44:47.481 INFO:tasks.workunit.client.0.smithi119.stdout:1/574: rename d1/d3/dc/l52 to d1/d3/dc/d11/d19/d47/lbf 0 2024-09-13T21:44:47.481 INFO:tasks.workunit.client.1.smithi155.stdout:6/203: creat db/d11/f39 x:0 0 0 2024-09-13T21:44:47.482 INFO:tasks.workunit.client.0.smithi119.stdout:1/575: chown d1/d3/d61/d77/d78/c4f 34028222 1 2024-09-13T21:44:47.483 INFO:tasks.workunit.client.1.smithi155.stdout:6/204: symlink db/l3a 0 2024-09-13T21:44:47.484 INFO:tasks.workunit.client.0.smithi119.stdout:1/576: write d1/d3/dc/d11/d3d/f98 [537514,118130] 0 2024-09-13T21:44:47.484 INFO:tasks.workunit.client.1.smithi155.stdout:6/205: creat db/d2c/f3b x:0 0 0 2024-09-13T21:44:47.487 INFO:tasks.workunit.client.1.smithi155.stdout:6/206: rmdir db/d12/d26 0 2024-09-13T21:44:47.490 INFO:tasks.workunit.client.1.smithi155.stdout:6/207: dread db/d11/d2b/d35/f25 [0,4194304] 0 2024-09-13T21:44:47.490 INFO:tasks.workunit.client.0.smithi119.stdout:6/488: link dc/d3d/d40/d6b/f70 dc/df/d32/fa2 0 2024-09-13T21:44:47.492 INFO:tasks.workunit.client.0.smithi119.stdout:6/489: mkdir dc/da3 0 2024-09-13T21:44:47.494 INFO:tasks.workunit.client.1.smithi155.stdout:6/208: dwrite f7 [0,4194304] 0 2024-09-13T21:44:47.494 INFO:tasks.workunit.client.0.smithi119.stdout:6/490: write dc/dd/f85 [5120806,116378] 0 2024-09-13T21:44:47.496 INFO:tasks.workunit.client.0.smithi119.stdout:6/491: rmdir dc/df/d5c 39 2024-09-13T21:44:47.498 INFO:tasks.workunit.client.0.smithi119.stdout:6/492: creat dc/d3d/d40/d6b/fa4 x:0 0 0 2024-09-13T21:44:47.499 INFO:tasks.workunit.client.0.smithi119.stdout:6/493: chown dc/f1e 1272344507 1 2024-09-13T21:44:47.499 INFO:tasks.workunit.client.0.smithi119.stdout:6/494: fsync dc/d3d/d4e/f88 0 2024-09-13T21:44:47.506 INFO:tasks.workunit.client.0.smithi119.stdout:1/577: dread d1/d3/d61/d77/d78/d32/d33/d72/f9f [0,4194304] 0 2024-09-13T21:44:47.508 INFO:tasks.workunit.client.0.smithi119.stdout:5/561: dread d0/d3/d4/d9/d14/f17 [0,4194304] 0 2024-09-13T21:44:47.510 INFO:tasks.workunit.client.0.smithi119.stdout:5/562: fdatasync d0/d3/d4/d9/f10 0 2024-09-13T21:44:47.511 INFO:tasks.workunit.client.0.smithi119.stdout:1/578: creat d1/d3/d61/da9/fc0 x:0 0 0 2024-09-13T21:44:47.512 INFO:tasks.workunit.client.1.smithi155.stdout:6/209: dread f0 [8388608,4194304] 0 2024-09-13T21:44:47.512 INFO:tasks.workunit.client.0.smithi119.stdout:6/495: write dc/dd/d5e/f60 [912786,103707] 0 2024-09-13T21:44:47.513 INFO:tasks.workunit.client.0.smithi119.stdout:1/579: readlink d1/d3/d61/d7e/d53/l8d 0 2024-09-13T21:44:47.513 INFO:tasks.workunit.client.0.smithi119.stdout:6/496: fsync dc/f31 0 2024-09-13T21:44:47.514 INFO:tasks.workunit.client.0.smithi119.stdout:1/580: dread - d1/f58 zero size 2024-09-13T21:44:47.515 INFO:tasks.workunit.client.1.smithi155.stdout:6/210: dread db/d12/f23 [0,4194304] 0 2024-09-13T21:44:47.516 INFO:tasks.workunit.client.0.smithi119.stdout:5/563: rename d0/d3/d4/d9/d14/d24/d25/f36 to d0/d3/d4/d9/d1e/da5/fc8 0 2024-09-13T21:44:47.518 INFO:tasks.workunit.client.1.smithi155.stdout:6/211: rename db/d11/d1e/d21/f2d to db/d12/d1c/d36/f3c 0 2024-09-13T21:44:47.523 INFO:tasks.workunit.client.0.smithi119.stdout:6/497: dwrite dc/dd/d5e/f60 [0,4194304] 0 2024-09-13T21:44:47.526 INFO:tasks.workunit.client.1.smithi155.stdout:6/212: dwrite db/d12/d1c/d36/f3c [0,4194304] 0 2024-09-13T21:44:47.531 INFO:tasks.workunit.client.1.smithi155.stdout:6/213: mkdir db/d3d 0 2024-09-13T21:44:47.531 INFO:tasks.workunit.client.0.smithi119.stdout:6/498: getdents dc/d3d/d40/d6b/d8d 0 2024-09-13T21:44:47.532 INFO:tasks.workunit.client.0.smithi119.stdout:6/499: dread dc/d3d/f8b [0,4194304] 0 2024-09-13T21:44:47.533 INFO:tasks.workunit.client.1.smithi155.stdout:7/85: sync 2024-09-13T21:44:47.533 INFO:tasks.workunit.client.1.smithi155.stdout:2/90: sync 2024-09-13T21:44:47.533 INFO:tasks.workunit.client.0.smithi119.stdout:6/500: chown dc/dd/f20 6472 1 2024-09-13T21:44:47.534 INFO:tasks.workunit.client.0.smithi119.stdout:1/581: write d1/d3/dc/d11/f17 [6027371,56327] 0 2024-09-13T21:44:47.535 INFO:tasks.workunit.client.0.smithi119.stdout:6/501: chown dc/d3d/c83 26002 1 2024-09-13T21:44:47.535 INFO:tasks.workunit.client.1.smithi155.stdout:2/91: fsync d2/db/f16 0 2024-09-13T21:44:47.537 INFO:tasks.workunit.client.0.smithi119.stdout:6/502: chown dc/d3d/d40/f49 219717 1 2024-09-13T21:44:47.538 INFO:tasks.workunit.client.0.smithi119.stdout:6/503: fsync dc/f31 0 2024-09-13T21:44:47.538 INFO:tasks.workunit.client.1.smithi155.stdout:7/86: creat d5/df/f1a x:0 0 0 2024-09-13T21:44:47.539 INFO:tasks.workunit.client.1.smithi155.stdout:2/92: mkdir d2/dd/d21 0 2024-09-13T21:44:47.539 INFO:tasks.workunit.client.0.smithi119.stdout:5/564: dwrite d0/d3/d4/d9/f64 [0,4194304] 0 2024-09-13T21:44:47.540 INFO:tasks.workunit.client.1.smithi155.stdout:6/214: dwrite db/d2c/f3b [0,4194304] 0 2024-09-13T21:44:47.543 INFO:tasks.workunit.client.0.smithi119.stdout:1/582: dread d1/d3/f4 [0,4194304] 0 2024-09-13T21:44:47.543 INFO:tasks.workunit.client.1.smithi155.stdout:2/93: unlink d2/dd/c20 0 2024-09-13T21:44:47.544 INFO:tasks.workunit.client.0.smithi119.stdout:6/504: dread dc/f31 [0,4194304] 0 2024-09-13T21:44:47.548 INFO:tasks.workunit.client.0.smithi119.stdout:5/565: dwrite d0/d3/d4/d9/d1e/f9f [0,4194304] 0 2024-09-13T21:44:47.548 INFO:tasks.workunit.client.1.smithi155.stdout:6/215: getdents db/d12/d1c/d36 0 2024-09-13T21:44:47.549 INFO:tasks.workunit.client.1.smithi155.stdout:2/94: write d2/dd/de/f13 [1612796,112346] 0 2024-09-13T21:44:47.549 INFO:tasks.workunit.client.1.smithi155.stdout:7/87: dwrite d5/d10/f18 [0,4194304] 0 2024-09-13T21:44:47.553 INFO:tasks.workunit.client.1.smithi155.stdout:7/88: rmdir d5/d10 39 2024-09-13T21:44:47.555 INFO:tasks.workunit.client.0.smithi119.stdout:5/566: creat d0/d3/d4/d9/d1e/da5/db9/fc9 x:0 0 0 2024-09-13T21:44:47.555 INFO:tasks.workunit.client.1.smithi155.stdout:7/89: symlink d5/d13/l1b 0 2024-09-13T21:44:47.559 INFO:tasks.workunit.client.0.smithi119.stdout:5/567: creat d0/d3/d4/d2e/d65/fca x:0 0 0 2024-09-13T21:44:47.560 INFO:tasks.workunit.client.1.smithi155.stdout:2/95: rmdir d2/dd 39 2024-09-13T21:44:47.560 INFO:tasks.workunit.client.0.smithi119.stdout:1/583: truncate d1/d3/d61/d77/d78/f9c 5254717 0 2024-09-13T21:44:47.562 INFO:tasks.workunit.client.1.smithi155.stdout:7/90: mknod d5/d10/c1c 0 2024-09-13T21:44:47.562 INFO:tasks.workunit.client.1.smithi155.stdout:2/96: read d2/f19 [90218,8711] 0 2024-09-13T21:44:47.564 INFO:tasks.workunit.client.1.smithi155.stdout:7/91: creat d5/d13/f1d x:0 0 0 2024-09-13T21:44:47.564 INFO:tasks.workunit.client.1.smithi155.stdout:7/92: fsync d5/fe 0 2024-09-13T21:44:47.567 INFO:tasks.workunit.client.1.smithi155.stdout:2/97: dread d2/f6 [0,4194304] 0 2024-09-13T21:44:47.567 INFO:tasks.workunit.client.0.smithi119.stdout:6/505: dread dc/d3d/d4e/d91/f9a [0,4194304] 0 2024-09-13T21:44:47.571 INFO:tasks.workunit.client.0.smithi119.stdout:1/584: dwrite d1/f22 [0,4194304] 0 2024-09-13T21:44:47.572 INFO:tasks.workunit.client.0.smithi119.stdout:5/568: dwrite d0/d3/d4/d9/f87 [0,4194304] 0 2024-09-13T21:44:47.574 INFO:tasks.workunit.client.0.smithi119.stdout:5/569: write d0/d3/d4/d2e/f71 [3312035,25183] 0 2024-09-13T21:44:47.574 INFO:tasks.workunit.client.0.smithi119.stdout:6/506: creat dc/df/d41/fa5 x:0 0 0 2024-09-13T21:44:47.578 INFO:tasks.workunit.client.1.smithi155.stdout:7/93: rmdir d5/d13 39 2024-09-13T21:44:47.579 INFO:tasks.workunit.client.0.smithi119.stdout:6/507: unlink dc/d3d/d4e/f88 0 2024-09-13T21:44:47.579 INFO:tasks.workunit.client.0.smithi119.stdout:1/585: dread d1/d3/d61/f85 [0,4194304] 0 2024-09-13T21:44:47.579 INFO:tasks.workunit.client.1.smithi155.stdout:7/94: write d5/df/f1a [837117,95104] 0 2024-09-13T21:44:47.579 INFO:tasks.workunit.client.0.smithi119.stdout:6/508: fsync dc/dd/f20 0 2024-09-13T21:44:47.580 INFO:tasks.workunit.client.0.smithi119.stdout:5/570: truncate d0/d3/d4/f5 992710 0 2024-09-13T21:44:47.580 INFO:tasks.workunit.client.1.smithi155.stdout:2/98: truncate d2/db/f1d 1508885 0 2024-09-13T21:44:47.581 INFO:tasks.workunit.client.1.smithi155.stdout:7/95: truncate d5/fc 1210813 0 2024-09-13T21:44:47.582 INFO:tasks.workunit.client.1.smithi155.stdout:2/99: dread d2/db/f18 [0,4194304] 0 2024-09-13T21:44:47.583 INFO:tasks.workunit.client.0.smithi119.stdout:6/509: read dc/df/f12 [785659,37514] 0 2024-09-13T21:44:47.583 INFO:tasks.workunit.client.0.smithi119.stdout:1/586: creat d1/d3/dc/d24/fc1 x:0 0 0 2024-09-13T21:44:47.587 INFO:tasks.workunit.client.1.smithi155.stdout:2/100: creat d2/f22 x:0 0 0 2024-09-13T21:44:47.588 INFO:tasks.workunit.client.0.smithi119.stdout:1/587: creat d1/d3/dc/d11/d3d/fc2 x:0 0 0 2024-09-13T21:44:47.589 INFO:tasks.workunit.client.0.smithi119.stdout:1/588: stat d1/d3/dc/d11/fa3 0 2024-09-13T21:44:47.590 INFO:tasks.workunit.client.0.smithi119.stdout:1/589: fsync d1/d3/f2a 0 2024-09-13T21:44:47.590 INFO:tasks.workunit.client.1.smithi155.stdout:7/96: dwrite f3 [0,4194304] 0 2024-09-13T21:44:47.591 INFO:tasks.workunit.client.1.smithi155.stdout:6/216: dread db/d12/f17 [0,4194304] 0 2024-09-13T21:44:47.591 INFO:tasks.workunit.client.0.smithi119.stdout:1/590: readlink d1/d3/d61/d77/l9a 0 2024-09-13T21:44:47.592 INFO:tasks.workunit.client.1.smithi155.stdout:7/97: truncate d5/fb 4911652 0 2024-09-13T21:44:47.593 INFO:tasks.workunit.client.0.smithi119.stdout:5/571: getdents d0/d3/d4/d2e 0 2024-09-13T21:44:47.598 INFO:tasks.workunit.client.1.smithi155.stdout:2/101: dwrite d2/db/f16 [0,4194304] 0 2024-09-13T21:44:47.600 INFO:tasks.workunit.client.1.smithi155.stdout:0/228: sync 2024-09-13T21:44:47.600 INFO:tasks.workunit.client.1.smithi155.stdout:5/160: sync 2024-09-13T21:44:47.600 INFO:tasks.workunit.client.1.smithi155.stdout:9/77: sync 2024-09-13T21:44:47.600 INFO:tasks.workunit.client.1.smithi155.stdout:1/89: sync 2024-09-13T21:44:47.600 INFO:tasks.workunit.client.1.smithi155.stdout:8/188: sync 2024-09-13T21:44:47.600 INFO:tasks.workunit.client.1.smithi155.stdout:3/223: sync 2024-09-13T21:44:47.600 INFO:tasks.workunit.client.1.smithi155.stdout:4/120: sync 2024-09-13T21:44:47.601 INFO:tasks.workunit.client.0.smithi119.stdout:1/591: dwrite d1/d3/d61/d77/d78/d32/fb9 [0,4194304] 0 2024-09-13T21:44:47.606 INFO:tasks.workunit.client.1.smithi155.stdout:3/224: chown d3/d25/d1b/c40 1257737 1 2024-09-13T21:44:47.611 INFO:tasks.workunit.client.1.smithi155.stdout:5/161: rmdir d5/d16/d33/d1f 39 2024-09-13T21:44:47.611 INFO:tasks.workunit.client.1.smithi155.stdout:1/90: creat d6/f25 x:0 0 0 2024-09-13T21:44:47.612 INFO:tasks.workunit.client.1.smithi155.stdout:7/98: dread d5/fc [0,4194304] 0 2024-09-13T21:44:47.613 INFO:tasks.workunit.client.1.smithi155.stdout:4/121: mkdir d1/d7/d21 0 2024-09-13T21:44:47.613 INFO:tasks.workunit.client.1.smithi155.stdout:2/102: chown d2/dd/de/f13 158 1 2024-09-13T21:44:47.613 INFO:tasks.workunit.client.0.smithi119.stdout:5/572: dread d0/d3/d4/d9/d14/d24/f6e [0,4194304] 0 2024-09-13T21:44:47.615 INFO:tasks.workunit.client.1.smithi155.stdout:0/229: write d1/f14 [4447038,122327] 0 2024-09-13T21:44:47.615 INFO:tasks.workunit.client.1.smithi155.stdout:6/217: dwrite db/f1f [0,4194304] 0 2024-09-13T21:44:47.618 INFO:tasks.workunit.client.1.smithi155.stdout:5/162: chown d5/d16/d33/d1b/d22/l24 410063 1 2024-09-13T21:44:47.618 INFO:tasks.workunit.client.0.smithi119.stdout:5/573: truncate d0/d3/d4/d9/f10 1100079 0 2024-09-13T21:44:47.619 INFO:tasks.workunit.client.1.smithi155.stdout:9/78: creat dc/d18/f1d x:0 0 0 2024-09-13T21:44:47.620 INFO:tasks.workunit.client.0.smithi119.stdout:5/574: read - d0/d3/d1f/d21/d4f/fbd zero size 2024-09-13T21:44:47.620 INFO:tasks.workunit.client.1.smithi155.stdout:8/189: getdents d2/d6/dd/d25 0 2024-09-13T21:44:47.624 INFO:tasks.workunit.client.0.smithi119.stdout:5/575: write d0/d3/d4/d2e/f2f [2729734,52673] 0 2024-09-13T21:44:47.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.622+0000 7efcdb6f0640 1 -- 172.21.15.119:0/1833010025 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efcd4115670 con 0x7efcc006e880 2024-09-13T21:44:47.625 INFO:tasks.workunit.client.1.smithi155.stdout:2/103: chown d2/c7 17 1 2024-09-13T21:44:47.625 INFO:tasks.workunit.client.0.smithi119.stdout:6/510: dwrite dc/dd/d5e/f60 [4194304,4194304] 0 2024-09-13T21:44:47.626 INFO:tasks.workunit.client.1.smithi155.stdout:4/122: truncate d1/d7/de/f1f 1007344 0 2024-09-13T21:44:47.627 INFO:tasks.workunit.client.1.smithi155.stdout:5/163: chown d5/fa 2892 1 2024-09-13T21:44:47.627 INFO:tasks.workunit.client.0.smithi119.stdout:5/576: rmdir d0/d3/d4/d2e 39 2024-09-13T21:44:47.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.626+0000 7efcc5ffb640 1 -- 172.21.15.119:0/1833010025 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7efcd4115670 con 0x7efcc006e880 2024-09-13T21:44:47.628 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:44:47.628 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:44:47.628 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:44:47.628 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:44:47.628 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [], 2024-09-13T21:44:47.628 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T21:44:47.628 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "", 2024-09-13T21:44:47.628 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:44:47.628 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:44:47.629 INFO:tasks.workunit.client.1.smithi155.stdout:3/225: dread d3/d21/f2b [0,4194304] 0 2024-09-13T21:44:47.629 INFO:tasks.workunit.client.1.smithi155.stdout:6/218: getdents db/d3d 0 2024-09-13T21:44:47.630 INFO:tasks.workunit.client.1.smithi155.stdout:0/230: read d1/d6/dc/fe [1554907,128025] 0 2024-09-13T21:44:47.631 INFO:tasks.workunit.client.1.smithi155.stdout:5/164: fdatasync d5/f10 0 2024-09-13T21:44:47.632 INFO:tasks.workunit.client.1.smithi155.stdout:9/79: fdatasync dc/de/f10 0 2024-09-13T21:44:47.632 INFO:tasks.workunit.client.0.smithi119.stdout:5/577: dread d0/d3/f80 [0,4194304] 0 2024-09-13T21:44:47.632 INFO:tasks.workunit.client.0.smithi119.stdout:6/511: rmdir dc/d3d/d40/d6b/d8d 0 2024-09-13T21:44:47.633 INFO:tasks.workunit.client.1.smithi155.stdout:3/226: chown d3/d25/d1b 3296591 1 2024-09-13T21:44:47.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.631+0000 7efcdb6f0640 1 -- 172.21.15.119:0/1833010025 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7efcc006e880 msgr2=0x7efcc0070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:47.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.631+0000 7efcdb6f0640 1 --2- 172.21.15.119:0/1833010025 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7efcc006e880 0x7efcc0070d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efcd0003080 tx=0x7efcd0009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.631+0000 7efcdb6f0640 1 -- 172.21.15.119:0/1833010025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd406da40 msgr2=0x7efcd4113660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:47.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.631+0000 7efcdb6f0640 1 --2- 172.21.15.119:0/1833010025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd406da40 0x7efcd4113660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efcc800a6f0 tx=0x7efcc800c040 comp rx=0 tx=0).stop 2024-09-13T21:44:47.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.631+0000 7efcdb6f0640 1 -- 172.21.15.119:0/1833010025 shutdown_connections 2024-09-13T21:44:47.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.631+0000 7efcdb6f0640 1 --2- 172.21.15.119:0/1833010025 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7efcc006e880 0x7efcc0070d30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.631+0000 7efcdb6f0640 1 --2- 172.21.15.119:0/1833010025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd406e420 0x7efcd4113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.631+0000 7efcdb6f0640 1 --2- 172.21.15.119:0/1833010025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd406da40 0x7efcd4113660 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.631+0000 7efcdb6f0640 1 -- 172.21.15.119:0/1833010025 >> 172.21.15.119:0/1833010025 conn(0x7efcd4069560 msgr2=0x7efcd4106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:47.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.632+0000 7efcdb6f0640 1 -- 172.21.15.119:0/1833010025 shutdown_connections 2024-09-13T21:44:47.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.632+0000 7efcdb6f0640 1 -- 172.21.15.119:0/1833010025 wait complete. 2024-09-13T21:44:47.634 INFO:tasks.workunit.client.1.smithi155.stdout:6/219: unlink c9 0 2024-09-13T21:44:47.636 INFO:tasks.workunit.client.1.smithi155.stdout:5/165: chown d5/d16/d33/d1b/c2d 1781 1 2024-09-13T21:44:47.636 INFO:tasks.workunit.client.0.smithi119.stdout:5/578: mknod d0/d3/d4/d9/d14/ccb 0 2024-09-13T21:44:47.636 INFO:tasks.workunit.client.1.smithi155.stdout:8/190: truncate d2/d6/dd/d12/f1d 915661 0 2024-09-13T21:44:47.637 INFO:tasks.workunit.client.1.smithi155.stdout:1/91: truncate d6/d7/d13/f14 969618 0 2024-09-13T21:44:47.638 INFO:tasks.workunit.client.0.smithi119.stdout:5/579: mkdir d0/d3/d4/d2e/d6b/dcc 0 2024-09-13T21:44:47.639 INFO:tasks.workunit.client.1.smithi155.stdout:9/80: mkdir dc/d18/d1e 0 2024-09-13T21:44:47.639 INFO:tasks.workunit.client.0.smithi119.stdout:5/580: symlink d0/d3/d1f/d21/d4f/lcd 0 2024-09-13T21:44:47.641 INFO:tasks.workunit.client.0.smithi119.stdout:5/581: rmdir d0/d3/d4/d9/d14/d24/d25/d54 39 2024-09-13T21:44:47.642 INFO:tasks.workunit.client.1.smithi155.stdout:4/123: symlink d1/d7/d21/l22 0 2024-09-13T21:44:47.647 INFO:tasks.workunit.client.1.smithi155.stdout:8/191: unlink d2/d8/c33 0 2024-09-13T21:44:47.647 INFO:tasks.workunit.client.1.smithi155.stdout:7/99: dwrite d5/df/f11 [0,4194304] 0 2024-09-13T21:44:47.651 INFO:tasks.workunit.client.1.smithi155.stdout:2/104: dwrite d2/dd/de/f14 [0,4194304] 0 2024-09-13T21:44:47.655 INFO:tasks.workunit.client.1.smithi155.stdout:0/231: dread d1/f35 [0,4194304] 0 2024-09-13T21:44:47.661 INFO:tasks.workunit.client.1.smithi155.stdout:3/227: rename d3/d25/d17/c19 to d3/d25/c47 0 2024-09-13T21:44:47.661 INFO:tasks.workunit.client.1.smithi155.stdout:8/192: unlink d2/d1f/l34 0 2024-09-13T21:44:47.666 INFO:tasks.workunit.client.1.smithi155.stdout:3/228: fdatasync d3/d25/f11 0 2024-09-13T21:44:47.671 INFO:tasks.workunit.client.1.smithi155.stdout:9/81: dwrite dc/de/ff [0,4194304] 0 2024-09-13T21:44:47.676 INFO:tasks.workunit.client.1.smithi155.stdout:6/220: dwrite db/d11/d2b/d35/f27 [0,4194304] 0 2024-09-13T21:44:47.685 INFO:tasks.workunit.client.1.smithi155.stdout:5/166: dwrite d5/d16/d33/d1f/f20 [0,4194304] 0 2024-09-13T21:44:47.685 INFO:tasks.workunit.client.1.smithi155.stdout:8/193: dread d2/d6/dd/d12/f1d [0,4194304] 0 2024-09-13T21:44:47.685 INFO:tasks.workunit.client.1.smithi155.stdout:1/92: dread d6/f16 [4194304,4194304] 0 2024-09-13T21:44:47.690 INFO:tasks.workunit.client.0.smithi119.stdout:3/503: sync 2024-09-13T21:44:47.690 INFO:tasks.workunit.client.0.smithi119.stdout:8/554: sync 2024-09-13T21:44:47.691 INFO:tasks.workunit.client.0.smithi119.stdout:2/502: sync 2024-09-13T21:44:47.691 INFO:tasks.workunit.client.0.smithi119.stdout:7/599: sync 2024-09-13T21:44:47.693 INFO:tasks.workunit.client.1.smithi155.stdout:1/93: chown d6/d7/d13 27775939 1 2024-09-13T21:44:47.697 INFO:tasks.workunit.client.1.smithi155.stdout:7/100: dwrite d5/d10/f18 [0,4194304] 0 2024-09-13T21:44:47.697 INFO:tasks.workunit.client.1.smithi155.stdout:8/194: mknod d2/d2d/c37 0 2024-09-13T21:44:47.697 INFO:tasks.workunit.client.1.smithi155.stdout:3/229: link d3/d25/d1b/f1d d3/d21/d2c/f48 0 2024-09-13T21:44:47.698 INFO:tasks.workunit.client.1.smithi155.stdout:1/94: chown d6/d15/f18 86483 1 2024-09-13T21:44:47.699 INFO:tasks.workunit.client.0.smithi119.stdout:6/512: write dc/f1b [2676383,108457] 0 2024-09-13T21:44:47.699 INFO:tasks.workunit.client.1.smithi155.stdout:6/221: creat db/d11/d1e/f3e x:0 0 0 2024-09-13T21:44:47.700 INFO:tasks.workunit.client.1.smithi155.stdout:2/105: dwrite d2/dd/de/f13 [0,4194304] 0 2024-09-13T21:44:47.700 INFO:tasks.workunit.client.0.smithi119.stdout:7/600: chown d8/d3c/d53/d37/d57/d8f 13 1 2024-09-13T21:44:47.701 INFO:tasks.workunit.client.0.smithi119.stdout:2/503: rmdir d1/d7 39 2024-09-13T21:44:47.701 INFO:tasks.workunit.client.0.smithi119.stdout:3/504: chown d6/d25/d2f/d33/c53 323 1 2024-09-13T21:44:47.701 INFO:tasks.workunit.client.0.smithi119.stdout:8/555: fsync d1b/d1d/d48/d54/f9d 0 2024-09-13T21:44:47.702 INFO:tasks.workunit.client.1.smithi155.stdout:5/167: creat d5/d16/d33/d1b/d28/f37 x:0 0 0 2024-09-13T21:44:47.703 INFO:tasks.workunit.client.0.smithi119.stdout:6/513: unlink dc/d3d/d40/f4c 0 2024-09-13T21:44:47.706 INFO:tasks.workunit.client.0.smithi119.stdout:3/505: creat d6/d25/d2f/d33/d88/d96/faa x:0 0 0 2024-09-13T21:44:47.708 INFO:tasks.workunit.client.0.smithi119.stdout:2/504: chown d1/d22/d5a/d5d/f78 392 1 2024-09-13T21:44:47.709 INFO:tasks.workunit.client.0.smithi119.stdout:7/601: mkdir d8/d3c/d53/d37/d83/d89/dc3 0 2024-09-13T21:44:47.709 INFO:tasks.workunit.client.1.smithi155.stdout:9/82: dread dc/de/f10 [0,4194304] 0 2024-09-13T21:44:47.709 INFO:tasks.workunit.client.1.smithi155.stdout:0/232: dwrite d1/d6/dc/f10 [0,4194304] 0 2024-09-13T21:44:47.710 INFO:tasks.workunit.client.1.smithi155.stdout:8/195: dread d2/d6/dd/d12/f21 [0,4194304] 0 2024-09-13T21:44:47.710 INFO:tasks.workunit.client.0.smithi119.stdout:3/506: mkdir d6/d25/d2f/d33/d56/dab 0 2024-09-13T21:44:47.712 INFO:tasks.workunit.client.0.smithi119.stdout:6/514: dread dc/df/d64/f77 [0,4194304] 0 2024-09-13T21:44:47.713 INFO:tasks.workunit.client.1.smithi155.stdout:6/222: write db/d11/d1e/f2e [145432,45024] 0 2024-09-13T21:44:47.713 INFO:tasks.workunit.client.1.smithi155.stdout:2/106: truncate d2/db/f18 432883 0 2024-09-13T21:44:47.713 INFO:tasks.workunit.client.0.smithi119.stdout:8/556: rename d1b/d1d/d26/d3e/l8d to d1b/d1d/d26/d3e/d65/lb1 0 2024-09-13T21:44:47.714 INFO:tasks.workunit.client.1.smithi155.stdout:1/95: mknod d6/d15/d23/c26 0 2024-09-13T21:44:47.715 INFO:tasks.workunit.client.1.smithi155.stdout:7/101: link d5/df/f11 d5/f1e 0 2024-09-13T21:44:47.716 INFO:tasks.workunit.client.1.smithi155.stdout:1/96: chown d6/ce 196540 1 2024-09-13T21:44:47.718 INFO:tasks.workunit.client.1.smithi155.stdout:5/168: creat d5/d16/d33/f38 x:0 0 0 2024-09-13T21:44:47.718 INFO:tasks.workunit.client.1.smithi155.stdout:2/107: truncate d2/fc 636111 0 2024-09-13T21:44:47.719 INFO:tasks.workunit.client.0.smithi119.stdout:8/557: write d1b/d1d/d48/d54/f9d [2122503,51608] 0 2024-09-13T21:44:47.719 INFO:tasks.workunit.client.1.smithi155.stdout:9/83: write fa [3627404,68571] 0 2024-09-13T21:44:47.719 INFO:tasks.workunit.client.0.smithi119.stdout:2/505: write d1/d22/d5a/d5d/f78 [192388,91126] 0 2024-09-13T21:44:47.720 INFO:tasks.workunit.client.0.smithi119.stdout:6/515: fdatasync dc/df/d64/f77 0 2024-09-13T21:44:47.722 INFO:tasks.workunit.client.1.smithi155.stdout:7/102: chown d5/c12 34596 1 2024-09-13T21:44:47.723 INFO:tasks.workunit.client.1.smithi155.stdout:0/233: rename d1/f14 to d1/d6/dc/d4d/d4a/d52/d5c/f5d 0 2024-09-13T21:44:47.723 INFO:tasks.workunit.client.1.smithi155.stdout:2/108: write d2/dd/de/f14 [1173438,94764] 0 2024-09-13T21:44:47.724 INFO:tasks.workunit.client.0.smithi119.stdout:7/602: dwrite d8/d3c/d53/d37/d83/d89/f12 [0,4194304] 0 2024-09-13T21:44:47.726 INFO:tasks.workunit.client.1.smithi155.stdout:9/84: mknod dc/d18/c1f 0 2024-09-13T21:44:47.727 INFO:tasks.workunit.client.1.smithi155.stdout:3/230: dwrite d3/f37 [0,4194304] 0 2024-09-13T21:44:47.729 INFO:tasks.workunit.client.1.smithi155.stdout:6/223: mknod db/d11/c3f 0 2024-09-13T21:44:47.731 INFO:tasks.workunit.client.1.smithi155.stdout:6/224: chown db 0 1 2024-09-13T21:44:47.731 INFO:tasks.workunit.client.1.smithi155.stdout:8/196: dread d2/f20 [0,4194304] 0 2024-09-13T21:44:47.732 INFO:tasks.workunit.client.0.smithi119.stdout:7/603: write d8/d3c/d53/d37/d83/d89/d47/faf [808604,56047] 0 2024-09-13T21:44:47.734 INFO:tasks.workunit.client.0.smithi119.stdout:3/507: dwrite d6/d25/d2f/d33/d88/d96/faa [0,4194304] 0 2024-09-13T21:44:47.736 INFO:tasks.workunit.client.1.smithi155.stdout:3/231: creat d3/d25/d1b/d1f/f49 x:0 0 0 2024-09-13T21:44:47.739 INFO:tasks.workunit.client.0.smithi119.stdout:3/508: chown d6/f46 1 1 2024-09-13T21:44:47.740 INFO:tasks.workunit.client.0.smithi119.stdout:5/582: dread d0/d3/d4/d9/d14/f29 [8388608,4194304] 0 2024-09-13T21:44:47.741 INFO:tasks.workunit.client.0.smithi119.stdout:6/516: dwrite dc/f1b [4194304,4194304] 0 2024-09-13T21:44:47.741 INFO:tasks.workunit.client.0.smithi119.stdout:7/604: dread - d8/d3c/d53/d3b/d7e/fbd zero size 2024-09-13T21:44:47.742 INFO:tasks.workunit.client.1.smithi155.stdout:6/225: write db/d11/d1e/f2e [638162,9046] 0 2024-09-13T21:44:47.742 INFO:tasks.workunit.client.1.smithi155.stdout:0/234: mknod d1/d6/dc/d4d/d4a/d52/d5b/c5e 0 2024-09-13T21:44:47.742 INFO:tasks.workunit.client.1.smithi155.stdout:7/103: dread d5/fa [0,4194304] 0 2024-09-13T21:44:47.743 INFO:tasks.workunit.client.0.smithi119.stdout:8/558: dwrite d1b/d1d/d48/d58/f74 [4194304,4194304] 0 2024-09-13T21:44:47.745 INFO:tasks.workunit.client.1.smithi155.stdout:6/226: stat db/d12/f1a 0 2024-09-13T21:44:47.746 INFO:tasks.workunit.client.1.smithi155.stdout:2/109: mkdir d2/dd/d21/d23 0 2024-09-13T21:44:47.746 INFO:tasks.workunit.client.0.smithi119.stdout:7/605: readlink d8/d19/d2e/l8c 0 2024-09-13T21:44:47.746 INFO:tasks.workunit.client.1.smithi155.stdout:3/232: mkdir d3/d21/d4a 0 2024-09-13T21:44:47.747 INFO:tasks.workunit.client.1.smithi155.stdout:8/197: symlink d2/l38 0 2024-09-13T21:44:47.747 INFO:tasks.workunit.client.0.smithi119.stdout:8/559: chown d1b/d4e/d99/fae 41434 1 2024-09-13T21:44:47.748 INFO:tasks.workunit.client.1.smithi155.stdout:1/97: dwrite d6/f16 [0,4194304] 0 2024-09-13T21:44:47.748 INFO:tasks.workunit.client.1.smithi155.stdout:0/235: chown d1/d6/dc/f2b 2323 1 2024-09-13T21:44:47.749 INFO:tasks.workunit.client.0.smithi119.stdout:2/506: dwrite d1/d22/d5a/d5d/d83/f73 [8388608,4194304] 0 2024-09-13T21:44:47.753 INFO:tasks.workunit.client.1.smithi155.stdout:7/104: rmdir d5 39 2024-09-13T21:44:47.754 INFO:tasks.workunit.client.1.smithi155.stdout:6/227: dread f7 [0,4194304] 0 2024-09-13T21:44:47.755 INFO:tasks.workunit.client.1.smithi155.stdout:3/233: stat d3/d25/c2d 0 2024-09-13T21:44:47.757 INFO:tasks.workunit.client.1.smithi155.stdout:3/234: write d3/d25/d1b/d1f/f49 [454151,107554] 0 2024-09-13T21:44:47.757 INFO:tasks.workunit.client.1.smithi155.stdout:8/198: mkdir d2/d1f/d39 0 2024-09-13T21:44:47.758 INFO:tasks.workunit.client.0.smithi119.stdout:3/509: symlink d6/d15/d1a/d45/lac 0 2024-09-13T21:44:47.758 INFO:tasks.workunit.client.0.smithi119.stdout:6/517: read dc/df/d5c/f5f [179295,98598] 0 2024-09-13T21:44:47.758 INFO:tasks.workunit.client.0.smithi119.stdout:7/606: truncate d8/d19/d2e/d34/f3a 4082509 0 2024-09-13T21:44:47.759 INFO:tasks.workunit.client.0.smithi119.stdout:7/607: fdatasync d8/f7d 0 2024-09-13T21:44:47.760 INFO:tasks.workunit.client.0.smithi119.stdout:9/726: sync 2024-09-13T21:44:47.760 INFO:tasks.workunit.client.0.smithi119.stdout:3/510: chown d6/d15/d1a/c6d 89679 1 2024-09-13T21:44:47.762 INFO:tasks.workunit.client.1.smithi155.stdout:7/105: stat d5/df 0 2024-09-13T21:44:47.763 INFO:tasks.workunit.client.0.smithi119.stdout:3/511: stat d6/d25/l2b 0 2024-09-13T21:44:47.763 INFO:tasks.workunit.client.1.smithi155.stdout:8/199: creat d2/d6/dd/d12/f3a x:0 0 0 2024-09-13T21:44:47.763 INFO:tasks.workunit.client.0.smithi119.stdout:7/608: read d8/d3c/d46/f87 [794326,23914] 0 2024-09-13T21:44:47.766 INFO:tasks.workunit.client.1.smithi155.stdout:6/228: mknod db/d11/d2b/c40 0 2024-09-13T21:44:47.767 INFO:tasks.workunit.client.0.smithi119.stdout:3/512: read d6/d15/f30 [3431236,62712] 0 2024-09-13T21:44:47.767 INFO:tasks.workunit.client.1.smithi155.stdout:0/236: creat d1/d6/f5f x:0 0 0 2024-09-13T21:44:47.767 INFO:tasks.workunit.client.1.smithi155.stdout:7/106: rmdir d5/df 39 2024-09-13T21:44:47.768 INFO:tasks.workunit.client.1.smithi155.stdout:6/229: truncate db/f2f 114131 0 2024-09-13T21:44:47.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.766+0000 7fb94785b640 1 -- 172.21.15.119:0/1524210623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9400fc520 msgr2=0x7fb9400fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:47.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.766+0000 7fb94785b640 1 --2- 172.21.15.119:0/1524210623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9400fc520 0x7fb9400fc930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb9380048d0 tx=0x7fb938009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.769 INFO:tasks.workunit.client.1.smithi155.stdout:8/200: rename d2/d2d/c37 to d2/d1f/c3b 0 2024-09-13T21:44:47.769 INFO:tasks.workunit.client.0.smithi119.stdout:9/727: rmdir d0/d8/d18/d23/d27/d2d/d5f/da8 39 2024-09-13T21:44:47.770 INFO:tasks.workunit.client.1.smithi155.stdout:0/237: read - d1/d6/dc/d4d/d4a/d4e/f53 zero size 2024-09-13T21:44:47.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.768+0000 7fb94785b640 1 -- 172.21.15.119:0/1524210623 shutdown_connections 2024-09-13T21:44:47.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.768+0000 7fb94785b640 1 --2- 172.21.15.119:0/1524210623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9400fd7f0 0x7fb9400fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.768+0000 7fb94785b640 1 --2- 172.21.15.119:0/1524210623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9400fc520 0x7fb9400fc930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.769+0000 7fb94785b640 1 -- 172.21.15.119:0/1524210623 >> 172.21.15.119:0/1524210623 conn(0x7fb9400f7ce0 msgr2=0x7fb9400fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:47.771 INFO:tasks.workunit.client.0.smithi119.stdout:8/560: dread d1b/d1d/d26/d3e/f5d [0,4194304] 0 2024-09-13T21:44:47.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.769+0000 7fb94785b640 1 -- 172.21.15.119:0/1524210623 shutdown_connections 2024-09-13T21:44:47.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.769+0000 7fb94785b640 1 -- 172.21.15.119:0/1524210623 wait complete. 2024-09-13T21:44:47.771 INFO:tasks.workunit.client.0.smithi119.stdout:3/513: dread - d6/d15/da9/f9a zero size 2024-09-13T21:44:47.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.770+0000 7fb94785b640 1 Processor -- start 2024-09-13T21:44:47.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.770+0000 7fb94785b640 1 -- start start 2024-09-13T21:44:47.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.770+0000 7fb94785b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9400fc520 0x7fb9401136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:47.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.770+0000 7fb94785b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9400fd7f0 0x7fb940113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:47.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.770+0000 7fb94785b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb940114a50 con 0x7fb9400fd7f0 2024-09-13T21:44:47.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.770+0000 7fb94785b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb940114bc0 con 0x7fb9400fc520 2024-09-13T21:44:47.773 INFO:tasks.workunit.client.0.smithi119.stdout:9/728: dread - d0/d8/d18/d23/dea/fd7 zero size 2024-09-13T21:44:47.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.771+0000 7fb944df6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9400fd7f0 0x7fb940113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:47.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.771+0000 7fb944df6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9400fd7f0 0x7fb940113be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53882/0 (socket says 172.21.15.119:53882) 2024-09-13T21:44:47.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.771+0000 7fb944df6640 1 -- 172.21.15.119:0/1183107781 learned_addr learned my addr 172.21.15.119:0/1183107781 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:44:47.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.771+0000 7fb9455f7640 1 --2- 172.21.15.119:0/1183107781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9400fc520 0x7fb9401136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:47.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.772+0000 7fb944df6640 1 -- 172.21.15.119:0/1183107781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9400fc520 msgr2=0x7fb9401136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:47.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.772+0000 7fb944df6640 1 --2- 172.21.15.119:0/1183107781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9400fc520 0x7fb9401136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:47.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.772+0000 7fb944df6640 1 -- 172.21.15.119:0/1183107781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb938005040 con 0x7fb9400fd7f0 2024-09-13T21:44:47.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.772+0000 7fb944df6640 1 --2- 172.21.15.119:0/1183107781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9400fd7f0 0x7fb940113be0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb93400bbb0 tx=0x7fb934009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:47.774 INFO:tasks.workunit.client.0.smithi119.stdout:6/518: dread dc/d3d/d40/f49 [0,4194304] 0 2024-09-13T21:44:47.775 INFO:tasks.workunit.client.1.smithi155.stdout:6/230: mknod db/d11/c41 0 2024-09-13T21:44:47.775 INFO:tasks.workunit.client.1.smithi155.stdout:6/231: readlink db/d12/l19 0 2024-09-13T21:44:47.775 INFO:tasks.workunit.client.1.smithi155.stdout:8/201: dread d2/d6/dd/d12/f2c [0,4194304] 0 2024-09-13T21:44:47.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.772+0000 7fb931ffb640 1 -- 172.21.15.119:0/1183107781 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93400c9c0 con 0x7fb9400fd7f0 2024-09-13T21:44:47.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.772+0000 7fb94785b640 1 -- 172.21.15.119:0/1183107781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb940114ea0 con 0x7fb9400fd7f0 2024-09-13T21:44:47.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.773+0000 7fb94785b640 1 -- 172.21.15.119:0/1183107781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9401153c0 con 0x7fb9400fd7f0 2024-09-13T21:44:47.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.773+0000 7fb931ffb640 1 -- 172.21.15.119:0/1183107781 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb9340092e0 con 0x7fb9400fd7f0 2024-09-13T21:44:47.776 INFO:tasks.workunit.client.0.smithi119.stdout:2/507: link d1/d38/fa2 d1/d7/d86/fa5 0 2024-09-13T21:44:47.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.774+0000 7fb931ffb640 1 -- 172.21.15.119:0/1183107781 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93401e3f0 con 0x7fb9400fd7f0 2024-09-13T21:44:47.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.775+0000 7fb94785b640 1 -- 172.21.15.119:0/1183107781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb924005240 con 0x7fb9400fd7f0 2024-09-13T21:44:47.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.775+0000 7fb931ffb640 1 -- 172.21.15.119:0/1183107781 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fb934012070 con 0x7fb9400fd7f0 2024-09-13T21:44:47.777 INFO:tasks.workunit.client.1.smithi155.stdout:7/107: dread d5/d10/f18 [0,4194304] 0 2024-09-13T21:44:47.777 INFO:tasks.workunit.client.1.smithi155.stdout:6/232: chown db/d11/f14 477 1 2024-09-13T21:44:47.777 INFO:tasks.workunit.client.1.smithi155.stdout:0/238: creat d1/d6/dc/d4d/d4a/d52/d5c/f60 x:0 0 0 2024-09-13T21:44:47.777 INFO:tasks.workunit.client.0.smithi119.stdout:2/508: dread - d1/d22/d5a/f81 zero size 2024-09-13T21:44:47.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.776+0000 7fb931ffb640 1 --2- 172.21.15.119:0/1183107781 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fb92c06e4d0 0x7fb92c070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:44:47.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.776+0000 7fb931ffb640 1 -- 172.21.15.119:0/1183107781 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb93408dfc0 con 0x7fb9400fd7f0 2024-09-13T21:44:47.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.776+0000 7fb9455f7640 1 --2- 172.21.15.119:0/1183107781 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fb92c06e4d0 0x7fb92c070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:44:47.778 INFO:tasks.workunit.client.0.smithi119.stdout:6/519: write dc/df/d41/f5d [2926941,90038] 0 2024-09-13T21:44:47.778 INFO:tasks.workunit.client.0.smithi119.stdout:2/509: chown d1/d22/d55/c35 72 1 2024-09-13T21:44:47.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.777+0000 7fb9455f7640 1 --2- 172.21.15.119:0/1183107781 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fb92c06e4d0 0x7fb92c070980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb938009ac0 tx=0x7fb938009da0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:44:47.779 INFO:tasks.workunit.client.1.smithi155.stdout:6/233: fdatasync db/d12/f23 0 2024-09-13T21:44:47.780 INFO:tasks.workunit.client.1.smithi155.stdout:7/108: stat d5/d10/c1c 0 2024-09-13T21:44:47.781 INFO:tasks.workunit.client.0.smithi119.stdout:7/609: creat d8/d3c/d53/d37/d83/d89/fc4 x:0 0 0 2024-09-13T21:44:47.782 INFO:tasks.workunit.client.1.smithi155.stdout:0/239: rmdir d1/d6/dc/d4d/d4a/d52 39 2024-09-13T21:44:47.782 INFO:tasks.workunit.client.0.smithi119.stdout:7/610: chown d8/d19/d2e/d34/d6e 5054890 1 2024-09-13T21:44:47.784 INFO:tasks.workunit.client.0.smithi119.stdout:3/514: rename d6/c76 to d6/d25/d2f/d8e/cad 0 2024-09-13T21:44:47.785 INFO:tasks.workunit.client.1.smithi155.stdout:0/240: fdatasync d1/d6/f5a 0 2024-09-13T21:44:47.785 INFO:tasks.workunit.client.1.smithi155.stdout:3/235: write d3/d25/d1b/d1f/f22 [482418,128089] 0 2024-09-13T21:44:47.785 INFO:tasks.workunit.client.0.smithi119.stdout:9/729: dwrite d0/d8/d18/d23/f39 [4194304,4194304] 0 2024-09-13T21:44:47.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:47.785+0000 7fb931ffb640 1 -- 172.21.15.119:0/1183107781 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb934057950 con 0x7fb9400fd7f0 2024-09-13T21:44:47.787 INFO:tasks.workunit.client.0.smithi119.stdout:3/515: write d6/d25/d2f/f57 [1022905,40252] 0 2024-09-13T21:44:47.791 INFO:tasks.workunit.client.0.smithi119.stdout:6/520: symlink dc/df/d41/la6 0 2024-09-13T21:44:47.791 INFO:tasks.workunit.client.0.smithi119.stdout:5/583: dread d0/d3/f1a [0,4194304] 0 2024-09-13T21:44:47.791 INFO:tasks.workunit.client.1.smithi155.stdout:9/85: dwrite dc/de/f16 [4194304,4194304] 0 2024-09-13T21:44:47.791 INFO:tasks.workunit.client.1.smithi155.stdout:7/109: dread d5/fc [0,4194304] 0 2024-09-13T21:44:47.796 INFO:tasks.workunit.client.0.smithi119.stdout:9/730: symlink d0/d8/d18/d23/d27/d2d/dc1/ddf/lf9 0 2024-09-13T21:44:47.798 INFO:tasks.workunit.client.1.smithi155.stdout:3/236: symlink d3/d21/l4b 0 2024-09-13T21:44:47.798 INFO:tasks.workunit.client.0.smithi119.stdout:8/561: dread d1b/d1d/d48/d58/d7f/fa5 [0,4194304] 0 2024-09-13T21:44:47.798 INFO:tasks.workunit.client.0.smithi119.stdout:7/611: rename d8/d3c/d53/d37/c4c to d8/d4d/da2/cc5 0 2024-09-13T21:44:47.799 INFO:tasks.workunit.client.1.smithi155.stdout:9/86: dread - dc/d18/f1d zero size 2024-09-13T21:44:47.800 INFO:tasks.workunit.client.1.smithi155.stdout:0/241: mkdir d1/d6/dc/d4d/d4a/d4e/d61 0 2024-09-13T21:44:47.801 INFO:tasks.workunit.client.1.smithi155.stdout:2/110: dread d2/db/f18 [0,4194304] 0 2024-09-13T21:44:47.801 INFO:tasks.workunit.client.0.smithi119.stdout:8/562: mkdir d1b/d1d/d48/db2 0 2024-09-13T21:44:47.803 INFO:tasks.workunit.client.0.smithi119.stdout:8/563: chown d1b/f46 4150 1 2024-09-13T21:44:47.804 INFO:tasks.workunit.client.0.smithi119.stdout:9/731: rename d0/d8/d18/d23/d42/d52/d53/l6f to d0/d8/d18/d23/d27/d2d/dc1/ddf/daa/lfa 0 2024-09-13T21:44:47.805 INFO:tasks.workunit.client.1.smithi155.stdout:6/234: dwrite db/d11/d2b/d35/f29 [0,4194304] 0 2024-09-13T21:44:47.808 INFO:tasks.workunit.client.0.smithi119.stdout:8/564: rmdir d1b/d1d/d48 39 2024-09-13T21:44:47.809 INFO:tasks.workunit.client.1.smithi155.stdout:9/87: creat dc/d18/f20 x:0 0 0 2024-09-13T21:44:47.810 INFO:tasks.workunit.client.1.smithi155.stdout:1/98: dwrite d6/d7/d13/f14 [0,4194304] 0 2024-09-13T21:44:47.810 INFO:tasks.workunit.client.0.smithi119.stdout:9/732: mknod d0/cfb 0 2024-09-13T21:44:47.811 INFO:tasks.workunit.client.1.smithi155.stdout:7/110: creat d5/df/d15/f1f x:0 0 0 2024-09-13T21:44:47.811 INFO:tasks.workunit.client.1.smithi155.stdout:3/237: mknod d3/d21/d4a/c4c 0 2024-09-13T21:44:47.815 INFO:tasks.workunit.client.0.smithi119.stdout:8/565: write d1b/d1d/d26/d3e/f4c [3579100,30434] 0 2024-09-13T21:44:47.815 INFO:tasks.workunit.client.1.smithi155.stdout:8/202: dwrite d2/d6/dd/d12/f21 [0,4194304] 0 2024-09-13T21:44:47.816 INFO:tasks.workunit.client.0.smithi119.stdout:9/733: stat d0/d4f/d56/ce2 0 2024-09-13T21:44:47.816 INFO:tasks.workunit.client.1.smithi155.stdout:0/242: symlink d1/d6/dc/d4d/d4a/d4e/d61/l62 0 2024-09-13T21:44:47.822 INFO:tasks.workunit.client.1.smithi155.stdout:7/111: write d5/fa [2131657,28165] 0 2024-09-13T21:44:47.823 INFO:tasks.workunit.client.0.smithi119.stdout:3/516: dwrite d6/d15/d1a/d45/f67 [0,4194304] 0 2024-09-13T21:44:47.824 INFO:tasks.workunit.client.1.smithi155.stdout:1/99: symlink d6/d7/l27 0 2024-09-13T21:44:47.825 INFO:tasks.workunit.client.1.smithi155.stdout:2/111: dread d2/dd/de/f13 [0,4194304] 0 2024-09-13T21:44:47.825 INFO:tasks.workunit.client.1.smithi155.stdout:3/238: write d3/d21/f2b [19147,28166] 0 2024-09-13T21:44:47.825 INFO:tasks.workunit.client.1.smithi155.stdout:0/243: rmdir d1/d6/dc/d4d/d4a/d4e 39 2024-09-13T21:44:47.826 INFO:tasks.workunit.client.0.smithi119.stdout:7/612: dread d8/d3c/d53/d37/d57/f6c [0,4194304] 0 2024-09-13T21:44:47.827 INFO:tasks.workunit.client.1.smithi155.stdout:8/203: mknod d2/d6/dd/c3c 0 2024-09-13T21:44:47.828 INFO:tasks.workunit.client.0.smithi119.stdout:6/521: dwrite dc/f1e [4194304,4194304] 0 2024-09-13T21:44:47.830 INFO:tasks.workunit.client.0.smithi119.stdout:7/613: readlink d8/d3c/d46/l91 0 2024-09-13T21:44:47.830 INFO:tasks.workunit.client.1.smithi155.stdout:9/88: dwrite dc/de/f16 [8388608,4194304] 0 2024-09-13T21:44:47.832 INFO:tasks.workunit.client.1.smithi155.stdout:2/112: creat d2/dd/f24 x:0 0 0 2024-09-13T21:44:47.832 INFO:tasks.workunit.client.0.smithi119.stdout:9/734: creat d0/d8/d18/d23/d27/d2d/d5f/ded/dee/ffc x:0 0 0 2024-09-13T21:44:47.833 INFO:tasks.workunit.client.0.smithi119.stdout:8/566: rename d1b/d1d/d26/f30 to d1b/d1d/d26/d6b/fb3 0 2024-09-13T21:44:47.836 INFO:tasks.workunit.client.1.smithi155.stdout:2/113: truncate d2/dd/f17 2055476 0 2024-09-13T21:44:47.836 INFO:tasks.workunit.client.0.smithi119.stdout:7/614: creat d8/d3c/d46/db1/fc6 x:0 0 0 2024-09-13T21:44:47.837 INFO:tasks.workunit.client.0.smithi119.stdout:3/517: creat d6/fae x:0 0 0 2024-09-13T21:44:47.838 INFO:tasks.workunit.client.1.smithi155.stdout:6/235: dwrite db/d11/d1e/f3e [0,4194304] 0 2024-09-13T21:44:47.839 INFO:tasks.workunit.client.1.smithi155.stdout:6/236: chown db/d12 1 1 2024-09-13T21:44:47.840 INFO:tasks.workunit.client.1.smithi155.stdout:9/89: mkdir dc/d19/d21 0 2024-09-13T21:44:47.841 INFO:tasks.workunit.client.0.smithi119.stdout:7/615: truncate d8/f7d 1226008 0 2024-09-13T21:44:47.841 INFO:tasks.workunit.client.0.smithi119.stdout:2/510: dread d1/f32 [0,4194304] 0 2024-09-13T21:44:47.841 INFO:tasks.workunit.client.0.smithi119.stdout:6/522: dwrite dc/d3d/d4e/f53 [0,4194304] 0 2024-09-13T21:44:47.843 INFO:tasks.workunit.client.1.smithi155.stdout:9/90: chown dc/de/d15 3457 1 2024-09-13T21:44:47.845 INFO:tasks.workunit.client.0.smithi119.stdout:2/511: chown d1/d22/d5a/d5d/f78 37 1 2024-09-13T21:44:47.846 INFO:tasks.workunit.client.1.smithi155.stdout:3/239: dwrite d3/d21/f2b [0,4194304] 0 2024-09-13T21:44:47.846 INFO:tasks.workunit.client.1.smithi155.stdout:6/237: fsync db/d11/f38 0 2024-09-13T21:44:47.847 INFO:tasks.workunit.client.1.smithi155.stdout:2/114: unlink d2/f19 0 2024-09-13T21:44:47.849 INFO:tasks.workunit.client.0.smithi119.stdout:6/523: unlink dc/dd/f20 0 2024-09-13T21:44:47.849 INFO:tasks.workunit.client.0.smithi119.stdout:9/735: dread d0/d4f/de5/f1f [0,4194304] 0 2024-09-13T21:44:47.849 INFO:tasks.workunit.client.1.smithi155.stdout:9/91: chown c5 1420 1 2024-09-13T21:44:47.854 INFO:tasks.workunit.client.0.smithi119.stdout:9/736: chown d0/d19/f6d 0 1 2024-09-13T21:44:47.855 INFO:tasks.workunit.client.1.smithi155.stdout:6/238: truncate db/d12/f1a 524895 0 2024-09-13T21:44:47.857 INFO:tasks.workunit.client.0.smithi119.stdout:7/616: rename d8/d3c/d53/c29 to d8/d3c/d53/d3b/d7e/dc2/cc7 0 2024-09-13T21:44:47.858 INFO:tasks.workunit.client.0.smithi119.stdout:2/512: dwrite d1/d22/d55/d64/fa1 [0,4194304] 0 2024-09-13T21:44:47.858 INFO:tasks.workunit.client.0.smithi119.stdout:9/737: fsync d0/d8/d18/de3/fc8 0 2024-09-13T21:44:47.861 INFO:tasks.workunit.client.1.smithi155.stdout:7/112: write d5/fc [642313,46339] 0 2024-09-13T21:44:47.862 INFO:tasks.workunit.client.0.smithi119.stdout:6/524: mkdir dc/d4b/d6a/da7 0 2024-09-13T21:44:47.865 INFO:tasks.workunit.client.1.smithi155.stdout:9/92: dread dc/de/f10 [0,4194304] 0 2024-09-13T21:44:47.865 INFO:tasks.workunit.client.1.smithi155.stdout:3/240: truncate d3/d25/f39 3426345 0 2024-09-13T21:44:47.865 INFO:tasks.workunit.client.1.smithi155.stdout:6/239: rename db/d11/d2b/d35/f27 to db/d11/d1e/d21/f42 0 2024-09-13T21:44:47.866 INFO:tasks.workunit.client.0.smithi119.stdout:9/738: chown d0/d8/d18/d23/d27/d2d/d5f/da8/ff8 919 1 2024-09-13T21:44:47.867 INFO:tasks.workunit.client.0.smithi119.stdout:9/739: write d0/d8/d18/d23/d27/d2d/d5f/f88 [286490,73671] 0 2024-09-13T21:44:47.867 INFO:tasks.workunit.client.1.smithi155.stdout:6/240: write f0 [13329886,71302] 0 2024-09-13T21:44:47.868 INFO:tasks.workunit.client.1.smithi155.stdout:0/244: dread d1/d6/dc/f2b [0,4194304] 0 2024-09-13T21:44:47.870 INFO:tasks.workunit.client.0.smithi119.stdout:7/617: rmdir d8/d4d/da2/dac/db4 0 2024-09-13T21:44:47.870 INFO:tasks.workunit.client.1.smithi155.stdout:3/241: rename l1 to d3/d21/d4a/l4d 0 2024-09-13T21:44:47.871 INFO:tasks.workunit.client.1.smithi155.stdout:7/113: write d5/d13/f1d [62585,76469] 0 2024-09-13T21:44:47.871 INFO:tasks.workunit.client.0.smithi119.stdout:7/618: fdatasync d8/d3c/d53/d3b/d48/f97 0 2024-09-13T21:44:47.872 INFO:tasks.workunit.client.1.smithi155.stdout:9/93: dread dc/de/f10 [0,4194304] 0 2024-09-13T21:44:47.873 INFO:tasks.workunit.client.0.smithi119.stdout:7/619: write d8/d3c/d53/f28 [889306,46750] 0 2024-09-13T21:44:47.873 INFO:tasks.workunit.client.1.smithi155.stdout:7/114: rmdir d5/d10 39 2024-09-13T21:44:47.874 INFO:tasks.workunit.client.0.smithi119.stdout:6/525: mkdir dc/d3d/da8 0 2024-09-13T21:44:47.874 INFO:tasks.workunit.client.1.smithi155.stdout:3/242: chown d3/d25/f39 1674665 1 2024-09-13T21:44:47.875 INFO:tasks.workunit.client.0.smithi119.stdout:7/620: chown d8/d3c/c59 564 1 2024-09-13T21:44:47.876 INFO:tasks.workunit.client.1.smithi155.stdout:7/115: write d5/fb [2337568,31666] 0 2024-09-13T21:44:47.877 INFO:tasks.workunit.client.0.smithi119.stdout:9/740: link d0/d8/d18/f90 d0/d8/d18/d23/dea/ffd 0 2024-09-13T21:44:47.878 INFO:tasks.workunit.client.1.smithi155.stdout:7/116: chown d5/fa 0 1 2024-09-13T21:44:47.878 INFO:tasks.workunit.client.0.smithi119.stdout:9/741: readlink d0/d79/lf6 0 2024-09-13T21:44:47.878 INFO:tasks.workunit.client.0.smithi119.stdout:2/513: getdents d1/d38/d89 0 2024-09-13T21:44:47.879 INFO:tasks.workunit.client.1.smithi155.stdout:9/94: getdents dc 0 2024-09-13T21:44:47.879 INFO:tasks.workunit.client.1.smithi155.stdout:0/245: dwrite d1/f39 [0,4194304] 0 2024-09-13T21:44:47.880 INFO:tasks.workunit.client.0.smithi119.stdout:7/621: mkdir d8/d3c/d46/db1/dc8 0 2024-09-13T21:44:47.880 INFO:tasks.workunit.client.1.smithi155.stdout:9/95: read - dc/d18/f20 zero size 2024-09-13T21:44:47.880 INFO:tasks.workunit.client.0.smithi119.stdout:8/567: write d1b/f46 [1116130,57317] 0 2024-09-13T21:44:47.881 INFO:tasks.workunit.client.0.smithi119.stdout:9/742: readlink d0/d8/d18/d23/d27/l36 0 2024-09-13T21:44:47.881 INFO:tasks.workunit.client.1.smithi155.stdout:3/243: rename d3/d21/f2b to d3/d25/d1b/f4e 0 2024-09-13T21:44:47.882 INFO:tasks.workunit.client.1.smithi155.stdout:7/117: rmdir d5 39 2024-09-13T21:44:47.883 INFO:tasks.workunit.client.1.smithi155.stdout:3/244: fdatasync d3/d25/f3f 0 2024-09-13T21:44:47.884 INFO:tasks.workunit.client.0.smithi119.stdout:2/514: rename d1/c52 to d1/d22/d5a/d5d/d77/ca6 0 2024-09-13T21:44:47.885 INFO:tasks.workunit.client.0.smithi119.stdout:8/568: dread - d1b/d1d/d48/d54/f37 zero size 2024-09-13T21:44:47.887 INFO:tasks.workunit.client.0.smithi119.stdout:8/569: write d1b/d1d/d48/f96 [372772,101860] 0 2024-09-13T21:44:47.887 INFO:tasks.workunit.client.1.smithi155.stdout:3/245: rename d3 to d3/d21/d2c/d4f 22 2024-09-13T21:44:47.888 INFO:tasks.workunit.client.1.smithi155.stdout:7/118: chown d5/c12 22514474 1 2024-09-13T21:44:47.889 INFO:tasks.workunit.client.0.smithi119.stdout:3/518: write d6/d15/d1a/d45/f5f [291840,83765] 0 2024-09-13T21:44:47.889 INFO:tasks.workunit.client.0.smithi119.stdout:9/743: symlink d0/d4f/de5/lfe 0 2024-09-13T21:44:47.890 INFO:tasks.workunit.client.0.smithi119.stdout:9/744: write d0/d19/f30 [3422505,100648] 0 2024-09-13T21:44:47.891 INFO:tasks.workunit.client.1.smithi155.stdout:3/246: write d3/d25/fb [3889097,130518] 0 2024-09-13T21:44:47.892 INFO:tasks.workunit.client.1.smithi155.stdout:9/96: dwrite dc/de/f16 [0,4194304] 0 2024-09-13T21:44:47.892 INFO:tasks.workunit.client.1.smithi155.stdout:1/100: truncate d6/d15/f18 655714 0 2024-09-13T21:44:47.892 INFO:tasks.workunit.client.0.smithi119.stdout:7/622: rename d8/d3c/d53/d37/d57/d8f/ca0 to d8/d19/d2e/cc9 0 2024-09-13T21:44:47.896 INFO:tasks.workunit.client.1.smithi155.stdout:2/115: truncate f1 409821 0 2024-09-13T21:44:47.897 INFO:tasks.workunit.client.1.smithi155.stdout:7/119: dread d5/d10/f18 [0,4194304] 0 2024-09-13T21:44:47.903 INFO:tasks.workunit.client.1.smithi155.stdout:3/247: fsync d3/d25/d1b/f1d 0 2024-09-13T21:44:47.903 INFO:tasks.workunit.client.1.smithi155.stdout:9/97: rename dc/de/f1b to dc/d18/d1e/f22 0 2024-09-13T21:44:47.903 INFO:tasks.workunit.client.1.smithi155.stdout:1/101: mknod d6/d7/d13/d17/c28 0 2024-09-13T21:44:47.903 INFO:tasks.workunit.client.0.smithi119.stdout:7/623: symlink d8/d4d/da2/lca 0 2024-09-13T21:44:47.903 INFO:tasks.workunit.client.0.smithi119.stdout:8/570: mkdir d1b/d1d/db4 0 2024-09-13T21:44:47.903 INFO:tasks.workunit.client.0.smithi119.stdout:7/624: write d8/d4d/f80 [177125,32299] 0 2024-09-13T21:44:47.904 INFO:tasks.workunit.client.0.smithi119.stdout:2/515: symlink d1/d9d/la7 0 2024-09-13T21:44:47.904 INFO:tasks.workunit.client.0.smithi119.stdout:7/625: read f6 [5955297,39442] 0 2024-09-13T21:44:47.905 INFO:tasks.workunit.client.0.smithi119.stdout:3/519: rename d6/f46 to d6/d15/d1a/faf 0 2024-09-13T21:44:47.906 INFO:tasks.workunit.client.1.smithi155.stdout:9/98: truncate dc/d18/f20 855947 0 2024-09-13T21:44:47.906 INFO:tasks.workunit.client.1.smithi155.stdout:7/120: dwrite d5/fb [0,4194304] 0 2024-09-13T21:44:47.908 INFO:tasks.workunit.client.0.smithi119.stdout:7/626: symlink d8/d3c/d46/db1/dc8/lcb 0 2024-09-13T21:44:47.909 INFO:tasks.workunit.client.1.smithi155.stdout:7/121: write d5/df/f19 [524678,24932] 0 2024-09-13T21:44:47.910 INFO:tasks.workunit.client.1.smithi155.stdout:7/122: write d5/d13/f1d [742646,117346] 0 2024-09-13T21:44:47.911 INFO:tasks.workunit.client.1.smithi155.stdout:0/246: truncate d1/d6/dc/f45 3913444 0 2024-09-13T21:44:47.912 INFO:tasks.workunit.client.0.smithi119.stdout:9/745: rename d0/d4f/de5/d2b/f9e to d0/d8/d18/d23/d27/d2d/fff 0 2024-09-13T21:44:47.913 INFO:tasks.workunit.client.1.smithi155.stdout:3/248: creat d3/d25/d17/d3b/f50 x:0 0 0 2024-09-13T21:44:47.914 INFO:tasks.workunit.client.1.smithi155.stdout:9/99: mkdir dc/d19/d23 0 2024-09-13T21:44:47.915 INFO:tasks.workunit.client.1.smithi155.stdout:9/100: chown dc/de 13578 1 2024-09-13T21:44:47.915 INFO:tasks.workunit.client.1.smithi155.stdout:9/101: readlink dc/ld 0 2024-09-13T21:44:47.916 INFO:tasks.workunit.client.1.smithi155.stdout:9/102: write dc/de/f10 [2672331,15685] 0 2024-09-13T21:44:47.917 INFO:tasks.workunit.client.0.smithi119.stdout:7/627: dwrite d8/d3c/d53/f2b [0,4194304] 0 2024-09-13T21:44:47.918 INFO:tasks.workunit.client.0.smithi119.stdout:3/520: truncate d6/d15/d1a/f55 346007 0 2024-09-13T21:44:47.918 INFO:tasks.workunit.client.1.smithi155.stdout:9/103: chown dc/d19 22555 1 2024-09-13T21:44:47.918 INFO:tasks.workunit.client.1.smithi155.stdout:1/102: rename d6/f25 to d6/d7/d13/d17/f29 0 2024-09-13T21:44:47.921 INFO:tasks.workunit.client.0.smithi119.stdout:8/571: rename d1b/d1d/d26/f33 to d1b/d1d/d26/d3e/fb5 0 2024-09-13T21:44:47.921 INFO:tasks.workunit.client.1.smithi155.stdout:7/123: unlink d5/c12 0 2024-09-13T21:44:47.924 INFO:tasks.workunit.client.1.smithi155.stdout:7/124: write d5/df/d15/f1f [489468,65086] 0 2024-09-13T21:44:47.926 INFO:tasks.workunit.client.0.smithi119.stdout:4/578: sync 2024-09-13T21:44:47.928 INFO:tasks.workunit.client.1.smithi155.stdout:1/103: dwrite d6/d7/f24 [0,4194304] 0 2024-09-13T21:44:47.929 INFO:tasks.workunit.client.0.smithi119.stdout:9/746: symlink d0/d8/d18/d23/d42/l100 0 2024-09-13T21:44:47.929 INFO:tasks.workunit.client.1.smithi155.stdout:9/104: creat dc/de/d15/f24 x:0 0 0 2024-09-13T21:44:47.930 INFO:tasks.workunit.client.0.smithi119.stdout:8/572: dwrite f13 [0,4194304] 0 2024-09-13T21:44:47.930 INFO:tasks.workunit.client.0.smithi119.stdout:9/747: dread - d0/d4f/de5/db9/fe6 zero size 2024-09-13T21:44:47.931 INFO:tasks.workunit.client.1.smithi155.stdout:0/247: rename d1/d6/dc/d4d/l46 to d1/d6/dc/d4d/d4a/d4e/l63 0 2024-09-13T21:44:47.932 INFO:tasks.workunit.client.1.smithi155.stdout:3/249: symlink d3/d25/l51 0 2024-09-13T21:44:47.932 INFO:tasks.workunit.client.0.smithi119.stdout:4/579: truncate d4/f73 2565886 0 2024-09-13T21:44:47.939 INFO:tasks.workunit.client.1.smithi155.stdout:7/125: creat d5/d13/f20 x:0 0 0 2024-09-13T21:44:47.939 INFO:tasks.workunit.client.0.smithi119.stdout:3/521: read d6/d15/d1a/d45/d47/f64 [181645,110573] 0 2024-09-13T21:44:47.939 INFO:tasks.workunit.client.0.smithi119.stdout:4/580: readlink d4/d1e/d28/d34/l70 0 2024-09-13T21:44:47.940 INFO:tasks.workunit.client.0.smithi119.stdout:2/516: dread d1/d22/d5a/d5d/f61 [0,4194304] 0 2024-09-13T21:44:47.942 INFO:tasks.workunit.client.0.smithi119.stdout:8/573: dwrite d1b/d1d/d48/d58/f74 [0,4194304] 0 2024-09-13T21:44:47.945 INFO:tasks.workunit.client.1.smithi155.stdout:7/126: fdatasync d5/fe 0 2024-09-13T21:44:47.946 INFO:tasks.workunit.client.0.smithi119.stdout:9/748: dwrite d0/d8/d18/d23/f29 [0,4194304] 0 2024-09-13T21:44:47.949 INFO:tasks.workunit.client.1.smithi155.stdout:1/104: rmdir d6/d7/d22 0 2024-09-13T21:44:47.951 INFO:tasks.workunit.client.0.smithi119.stdout:8/574: mknod d1b/d1d/d26/d3e/cb6 0 2024-09-13T21:44:47.951 INFO:tasks.workunit.client.0.smithi119.stdout:2/517: creat d1/d38/d89/d6b/d8c/fa8 x:0 0 0 2024-09-13T21:44:47.951 INFO:tasks.workunit.client.1.smithi155.stdout:9/105: dwrite fb [12582912,4194304] 0 2024-09-13T21:44:47.952 INFO:tasks.workunit.client.0.smithi119.stdout:9/749: dread - d0/d8/d18/d23/d27/d2d/d5f/da8/ff8 zero size 2024-09-13T21:44:47.953 INFO:tasks.workunit.client.1.smithi155.stdout:0/248: dwrite d1/d6/f5a [0,4194304] 0 2024-09-13T21:44:47.954 INFO:tasks.workunit.client.1.smithi155.stdout:7/127: fsync d5/df/f11 0 2024-09-13T21:44:47.955 INFO:tasks.workunit.client.0.smithi119.stdout:9/750: stat d0/d8/d18/d23/d27/d2d/d70/lac 0 2024-09-13T21:44:47.956 INFO:tasks.workunit.client.1.smithi155.stdout:2/116: dread d2/db/f1d [0,4194304] 0 2024-09-13T21:44:47.957 INFO:tasks.workunit.client.0.smithi119.stdout:4/581: getdents d4/d1e/d28/d34 0 2024-09-13T21:44:47.957 INFO:tasks.workunit.client.1.smithi155.stdout:9/106: write dc/f1a [226630,43159] 0 2024-09-13T21:44:47.958 INFO:tasks.workunit.client.0.smithi119.stdout:2/518: mkdir d1/d22/d5a/da9 0 2024-09-13T21:44:47.960 INFO:tasks.workunit.client.1.smithi155.stdout:3/250: dwrite d3/d25/d1b/d1f/f49 [0,4194304] 0 2024-09-13T21:44:47.964 INFO:tasks.workunit.client.0.smithi119.stdout:9/751: dread d0/d4f/de5/d2b/d60/fcb [0,4194304] 0 2024-09-13T21:44:47.964 INFO:tasks.workunit.client.0.smithi119.stdout:7/628: dread d8/d3c/f51 [0,4194304] 0 2024-09-13T21:44:47.965 INFO:tasks.workunit.client.1.smithi155.stdout:9/107: dread dc/d18/f20 [0,4194304] 0 2024-09-13T21:44:47.966 INFO:tasks.workunit.client.0.smithi119.stdout:4/582: creat d4/d1e/d28/d34/fbc x:0 0 0 2024-09-13T21:44:47.967 INFO:tasks.workunit.client.1.smithi155.stdout:9/108: stat dc/de/c12 0 2024-09-13T21:44:47.967 INFO:tasks.workunit.client.0.smithi119.stdout:2/519: mkdir d1/d22/d5a/d5d/d77/daa 0 2024-09-13T21:44:47.969 INFO:tasks.workunit.client.0.smithi119.stdout:9/752: mknod d0/d8/d18/d23/d27/d2d/d5f/ded/c101 0 2024-09-13T21:44:47.969 INFO:tasks.workunit.client.1.smithi155.stdout:9/109: truncate dc/d18/d1e/f22 37047 0 2024-09-13T21:44:47.970 INFO:tasks.workunit.client.1.smithi155.stdout:7/128: link d5/d10/f18 d5/d13/f21 0 2024-09-13T21:44:47.971 INFO:tasks.workunit.client.0.smithi119.stdout:7/629: symlink d8/d3c/d53/d37/d83/lcc 0 2024-09-13T21:44:47.972 INFO:tasks.workunit.client.1.smithi155.stdout:9/110: read fb [4936683,6755] 0 2024-09-13T21:44:47.973 INFO:tasks.workunit.client.0.smithi119.stdout:9/753: write d0/d4f/de5/f3b [5179630,80221] 0 2024-09-13T21:44:47.974 INFO:tasks.workunit.client.1.smithi155.stdout:7/129: mknod d5/df/d15/c22 0 2024-09-13T21:44:47.977 INFO:tasks.workunit.client.1.smithi155.stdout:7/130: unlink d5/d13/f1d 0 2024-09-13T21:44:47.980 INFO:tasks.workunit.client.1.smithi155.stdout:7/131: rename d5/l9 to d5/df/d15/l23 0 2024-09-13T21:44:47.984 INFO:tasks.workunit.client.0.smithi119.stdout:7/630: getdents d8/d3c/d53/d37/d57 0 2024-09-13T21:44:47.986 INFO:tasks.workunit.client.0.smithi119.stdout:9/754: dwrite d0/d8/d18/de3/fca [0,4194304] 0 2024-09-13T21:44:47.988 INFO:tasks.workunit.client.0.smithi119.stdout:7/631: truncate d8/d3c/d53/d3b/d7e/fbd 594808 0 2024-09-13T21:44:47.988 INFO:tasks.workunit.client.1.smithi155.stdout:7/132: dwrite f3 [0,4194304] 0 2024-09-13T21:44:47.989 INFO:tasks.workunit.client.0.smithi119.stdout:9/755: write d0/d8/d18/d23/fec [755001,18918] 0 2024-09-13T21:44:47.989 INFO:tasks.workunit.client.0.smithi119.stdout:3/522: dread d6/f18 [0,4194304] 0 2024-09-13T21:44:47.990 INFO:tasks.workunit.client.0.smithi119.stdout:7/632: readlink d8/d4d/l92 0 2024-09-13T21:44:47.990 INFO:tasks.workunit.client.1.smithi155.stdout:1/105: truncate d6/d7/f8 3689579 0 2024-09-13T21:44:47.992 INFO:tasks.workunit.client.0.smithi119.stdout:7/633: truncate d8/d19/d2e/d34/d6e/f8d 394822 0 2024-09-13T21:44:47.993 INFO:tasks.workunit.client.0.smithi119.stdout:7/634: fdatasync d8/d3c/d46/fc1 0 2024-09-13T21:44:47.994 INFO:tasks.workunit.client.1.smithi155.stdout:2/117: truncate d2/f6 2728217 0 2024-09-13T21:44:47.995 INFO:tasks.workunit.client.0.smithi119.stdout:3/523: dread d6/d15/f30 [0,4194304] 0 2024-09-13T21:44:47.996 INFO:tasks.workunit.client.1.smithi155.stdout:9/111: truncate dc/de/f16 3011811 0 2024-09-13T21:44:47.999 INFO:tasks.workunit.client.0.smithi119.stdout:7/635: chown d8/d3c/d53/d37/d95/cb3 91 1 2024-09-13T21:44:47.999 INFO:tasks.workunit.client.1.smithi155.stdout:3/251: dread d3/d25/d1b/d1f/f30 [0,4194304] 0 2024-09-13T21:44:48.000 INFO:tasks.workunit.client.1.smithi155.stdout:1/106: write d6/d15/f20 [4299507,86337] 0 2024-09-13T21:44:48.001 INFO:tasks.workunit.client.0.smithi119.stdout:8/575: write d1b/d1d/f80 [435215,123234] 0 2024-09-13T21:44:48.002 INFO:tasks.workunit.client.0.smithi119.stdout:8/576: stat d1b/d1d/d48/d54/f37 0 2024-09-13T21:44:48.003 INFO:tasks.workunit.client.1.smithi155.stdout:9/112: mknod dc/c25 0 2024-09-13T21:44:48.003 INFO:tasks.workunit.client.0.smithi119.stdout:9/756: rmdir d0/d8/d18 39 2024-09-13T21:44:48.004 INFO:tasks.workunit.client.1.smithi155.stdout:3/252: mkdir d3/d25/d17/d52 0 2024-09-13T21:44:48.006 INFO:tasks.workunit.client.1.smithi155.stdout:3/253: truncate d3/d25/f1c 4591068 0 2024-09-13T21:44:48.006 INFO:tasks.workunit.client.0.smithi119.stdout:7/636: write d8/d3c/d53/d3b/d48/f79 [1568888,26127] 0 2024-09-13T21:44:48.006 INFO:tasks.workunit.client.1.smithi155.stdout:2/118: dread d2/dd/f17 [0,4194304] 0 2024-09-13T21:44:48.007 INFO:tasks.workunit.client.0.smithi119.stdout:9/757: write d0/d79/f7e [1122078,123857] 0 2024-09-13T21:44:48.007 INFO:tasks.workunit.client.1.smithi155.stdout:1/107: dread d6/d7/f24 [0,4194304] 0 2024-09-13T21:44:48.008 INFO:tasks.workunit.client.0.smithi119.stdout:7/637: chown d8/d19/f25 2763097 1 2024-09-13T21:44:48.008 INFO:tasks.workunit.client.1.smithi155.stdout:1/108: write d6/d7/f1a [228466,76811] 0 2024-09-13T21:44:48.009 INFO:tasks.workunit.client.0.smithi119.stdout:9/758: mkdir d0/d19/de4/d102 0 2024-09-13T21:44:48.010 INFO:tasks.workunit.client.1.smithi155.stdout:3/254: link d3/d25/d1b/d1f/d36/f3c d3/d21/f53 0 2024-09-13T21:44:48.011 INFO:tasks.workunit.client.1.smithi155.stdout:3/255: fdatasync d3/d25/d1b/f4e 0 2024-09-13T21:44:48.012 INFO:tasks.workunit.client.0.smithi119.stdout:2/520: dwrite d1/f3d [0,4194304] 0 2024-09-13T21:44:48.013 INFO:tasks.workunit.client.1.smithi155.stdout:1/109: rmdir d6/d7/d13/d1f 0 2024-09-13T21:44:48.014 INFO:tasks.workunit.client.1.smithi155.stdout:1/110: write d6/d15/f20 [4722957,117623] 0 2024-09-13T21:44:48.015 INFO:tasks.workunit.client.1.smithi155.stdout:3/256: dread d3/d25/d1b/f1d [0,4194304] 0 2024-09-13T21:44:48.016 INFO:tasks.workunit.client.0.smithi119.stdout:9/759: creat d0/d4f/de5/d2b/f103 x:0 0 0 2024-09-13T21:44:48.018 INFO:tasks.workunit.client.0.smithi119.stdout:9/760: stat d0/d8/laf 0 2024-09-13T21:44:48.018 INFO:tasks.workunit.client.1.smithi155.stdout:3/257: symlink d3/d25/l54 0 2024-09-13T21:44:48.018 INFO:tasks.workunit.client.1.smithi155.stdout:1/111: fdatasync d6/d15/f20 0 2024-09-13T21:44:48.019 INFO:tasks.workunit.client.0.smithi119.stdout:2/521: fsync d1/f4a 0 2024-09-13T21:44:48.019 INFO:tasks.workunit.client.0.smithi119.stdout:4/583: dread d4/f27 [0,4194304] 0 2024-09-13T21:44:48.020 INFO:tasks.workunit.client.0.smithi119.stdout:7/638: truncate d8/d4d/f52 339798 0 2024-09-13T21:44:48.022 INFO:tasks.workunit.client.1.smithi155.stdout:3/258: symlink d3/d25/d1b/l55 0 2024-09-13T21:44:48.023 INFO:tasks.workunit.client.0.smithi119.stdout:4/584: dread d4/d1e/d28/d34/d66/f7b [0,4194304] 0 2024-09-13T21:44:48.024 INFO:tasks.workunit.client.0.smithi119.stdout:7/639: chown d8/d3c/d53/d37/d57/f62 49794 1 2024-09-13T21:44:48.024 INFO:tasks.workunit.client.1.smithi155.stdout:1/112: unlink d6/d7/c1d 0 2024-09-13T21:44:48.025 INFO:tasks.workunit.client.0.smithi119.stdout:2/522: fdatasync d1/d22/d55/d31/fa0 0 2024-09-13T21:44:48.027 INFO:tasks.workunit.client.1.smithi155.stdout:1/113: creat d6/d7/d13/d17/f2a x:0 0 0 2024-09-13T21:44:48.030 INFO:tasks.workunit.client.0.smithi119.stdout:7/640: chown d8/d3c/d53/d3b/d7e/dc2/cc7 25347 1 2024-09-13T21:44:48.031 INFO:tasks.workunit.client.1.smithi155.stdout:1/114: creat d6/d7/f2b x:0 0 0 2024-09-13T21:44:48.031 INFO:tasks.workunit.client.0.smithi119.stdout:9/761: truncate d0/d8/d18/d23/d42/d52/f65 1119638 0 2024-09-13T21:44:48.031 INFO:tasks.workunit.client.0.smithi119.stdout:2/523: read d1/d38/d89/f4e [2210010,47304] 0 2024-09-13T21:44:48.031 INFO:tasks.workunit.client.1.smithi155.stdout:9/113: mknod dc/d18/d1e/c26 0 2024-09-13T21:44:48.032 INFO:tasks.workunit.client.1.smithi155.stdout:1/115: write d6/d7/d13/d17/f2a [177798,116786] 0 2024-09-13T21:44:48.033 INFO:tasks.workunit.client.1.smithi155.stdout:3/259: rmdir d3/d21 39 2024-09-13T21:44:48.033 INFO:tasks.workunit.client.0.smithi119.stdout:9/762: truncate d0/d8/d18/d23/fec 1207658 0 2024-09-13T21:44:48.036 INFO:tasks.workunit.client.0.smithi119.stdout:2/524: symlink d1/lab 0 2024-09-13T21:44:48.037 INFO:tasks.workunit.client.0.smithi119.stdout:2/525: dread - d1/d38/d89/f9f zero size 2024-09-13T21:44:48.038 INFO:tasks.workunit.client.0.smithi119.stdout:7/641: write d8/d3c/d53/d37/f6f [868705,121719] 0 2024-09-13T21:44:48.040 INFO:tasks.workunit.client.1.smithi155.stdout:1/116: dwrite d6/fb [4194304,4194304] 0 2024-09-13T21:44:48.040 INFO:tasks.workunit.client.0.smithi119.stdout:7/642: dread - d8/d3c/d53/d3b/d48/f97 zero size 2024-09-13T21:44:48.042 INFO:tasks.workunit.client.1.smithi155.stdout:3/260: creat d3/d25/d1b/d1f/f56 x:0 0 0 2024-09-13T21:44:48.042 INFO:tasks.workunit.client.0.smithi119.stdout:2/526: creat d1/d7/d86/fac x:0 0 0 2024-09-13T21:44:48.044 INFO:tasks.workunit.client.0.smithi119.stdout:9/763: rename d0/d4f/de5/d2b/f91 to d0/d8/d18/d23/d27/d2d/d5f/f104 0 2024-09-13T21:44:48.045 INFO:tasks.workunit.client.1.smithi155.stdout:1/117: rename d6/d15/d23/c26 to d6/d15/d23/c2c 0 2024-09-13T21:44:48.046 INFO:tasks.workunit.client.0.smithi119.stdout:7/643: creat d8/d4d/fcd x:0 0 0 2024-09-13T21:44:48.046 INFO:tasks.workunit.client.1.smithi155.stdout:3/261: symlink d3/d21/d4a/l57 0 2024-09-13T21:44:48.047 INFO:tasks.workunit.client.1.smithi155.stdout:1/118: symlink d6/d7/d13/d17/l2d 0 2024-09-13T21:44:48.048 INFO:tasks.workunit.client.0.smithi119.stdout:7/644: write d8/d3c/d53/d6b/f72 [760377,22406] 0 2024-09-13T21:44:48.048 INFO:tasks.workunit.client.0.smithi119.stdout:2/527: mknod d1/d7/d47/cad 0 2024-09-13T21:44:48.049 INFO:tasks.workunit.client.0.smithi119.stdout:9/764: mknod d0/d4f/de5/d2b/c105 0 2024-09-13T21:44:48.051 INFO:tasks.workunit.client.0.smithi119.stdout:7/645: write d8/d3c/d46/f5a [381102,52319] 0 2024-09-13T21:44:48.053 INFO:tasks.workunit.client.1.smithi155.stdout:1/119: link d6/d7/cc d6/d7/d13/d17/c2e 0 2024-09-13T21:44:48.053 INFO:tasks.workunit.client.0.smithi119.stdout:8/577: dread d1b/d4e/d99/fae [0,4194304] 0 2024-09-13T21:44:48.054 INFO:tasks.workunit.client.0.smithi119.stdout:9/765: mkdir d0/d8/d18/d23/d27/d106 0 2024-09-13T21:44:48.055 INFO:tasks.workunit.client.1.smithi155.stdout:9/114: truncate dc/de/ff 2274612 0 2024-09-13T21:44:48.055 INFO:tasks.workunit.client.1.smithi155.stdout:1/120: write d6/d7/d13/d17/f2a [815210,114429] 0 2024-09-13T21:44:48.056 INFO:tasks.workunit.client.0.smithi119.stdout:7/646: mknod d8/d3c/d53/d3b/d48/cce 0 2024-09-13T21:44:48.058 INFO:tasks.workunit.client.0.smithi119.stdout:2/528: getdents d1/d22/d55/d64 0 2024-09-13T21:44:48.058 INFO:tasks.workunit.client.1.smithi155.stdout:1/121: chown d6/d15/f18 550341104 1 2024-09-13T21:44:48.059 INFO:tasks.workunit.client.0.smithi119.stdout:4/585: dread d4/d1e/d28/f8d [0,4194304] 0 2024-09-13T21:44:48.060 INFO:tasks.workunit.client.0.smithi119.stdout:7/647: symlink d8/d4d/lcf 0 2024-09-13T21:44:48.062 INFO:tasks.workunit.client.0.smithi119.stdout:2/529: chown d1/d22/d5a/d5d/d83/l82 5 1 2024-09-13T21:44:48.063 INFO:tasks.workunit.client.1.smithi155.stdout:9/115: dwrite fa [0,4194304] 0 2024-09-13T21:44:48.066 INFO:tasks.workunit.client.1.smithi155.stdout:3/262: dwrite d3/d25/d1b/f1d [0,4194304] 0 2024-09-13T21:44:48.071 INFO:tasks.workunit.client.1.smithi155.stdout:3/263: write d3/d25/fb [4359033,12699] 0 2024-09-13T21:44:48.071 INFO:tasks.workunit.client.1.smithi155.stdout:1/122: dread d6/d7/d13/f14 [0,4194304] 0 2024-09-13T21:44:48.071 INFO:tasks.workunit.client.0.smithi119.stdout:8/578: truncate d1b/d1d/d26/d3e/fb5 71004 0 2024-09-13T21:44:48.072 INFO:tasks.workunit.client.0.smithi119.stdout:2/530: write d1/d22/f2d [3977602,122859] 0 2024-09-13T21:44:48.074 INFO:tasks.workunit.client.1.smithi155.stdout:3/264: write d3/d25/d1b/d1f/f49 [606990,51534] 0 2024-09-13T21:44:48.075 INFO:tasks.workunit.client.1.smithi155.stdout:1/123: fdatasync d6/d7/d13/d17/f29 0 2024-09-13T21:44:48.076 INFO:tasks.workunit.client.0.smithi119.stdout:2/531: stat d1/d38/d89/d6b/f87 0 2024-09-13T21:44:48.077 INFO:tasks.workunit.client.1.smithi155.stdout:3/265: fsync d3/d25/d1b/d1f/f30 0 2024-09-13T21:44:48.078 INFO:tasks.workunit.client.1.smithi155.stdout:9/116: dwrite dc/de/f16 [0,4194304] 0 2024-09-13T21:44:48.079 INFO:tasks.workunit.client.1.smithi155.stdout:9/117: dread - dc/d18/f1d zero size 2024-09-13T21:44:48.081 INFO:tasks.workunit.client.0.smithi119.stdout:8/579: chown d1b/l22 148986 1 2024-09-13T21:44:48.081 INFO:tasks.workunit.client.1.smithi155.stdout:9/118: symlink dc/de/l27 0 2024-09-13T21:44:48.084 INFO:tasks.workunit.client.0.smithi119.stdout:9/766: dwrite d0/d4f/f64 [0,4194304] 0 2024-09-13T21:44:48.085 INFO:tasks.workunit.client.1.smithi155.stdout:9/119: getdents dc/d18 0 2024-09-13T21:44:48.085 INFO:tasks.workunit.client.0.smithi119.stdout:2/532: getdents d1/d22 0 2024-09-13T21:44:48.086 INFO:tasks.workunit.client.1.smithi155.stdout:9/120: dread dc/d18/d1e/f22 [0,4194304] 0 2024-09-13T21:44:48.087 INFO:tasks.workunit.client.0.smithi119.stdout:4/586: dread d4/d1e/d10/f46 [0,4194304] 0 2024-09-13T21:44:48.088 INFO:tasks.workunit.client.0.smithi119.stdout:8/580: readlink d1b/d4e/d71/l97 0 2024-09-13T21:44:48.088 INFO:tasks.workunit.client.0.smithi119.stdout:7/648: dwrite d8/d19/d2e/d34/f3a [0,4194304] 0 2024-09-13T21:44:48.091 INFO:tasks.workunit.client.1.smithi155.stdout:9/121: link dc/de/l27 dc/d19/d21/l28 0 2024-09-13T21:44:48.091 INFO:tasks.workunit.client.0.smithi119.stdout:7/649: stat d8/d3c/d53/d37/d83/d89/dc3 0 2024-09-13T21:44:48.093 INFO:tasks.workunit.client.1.smithi155.stdout:9/122: symlink dc/l29 0 2024-09-13T21:44:48.093 INFO:tasks.workunit.client.0.smithi119.stdout:2/533: write d1/f90 [210610,87133] 0 2024-09-13T21:44:48.095 INFO:tasks.workunit.client.0.smithi119.stdout:9/767: rename d0/d19/l55 to d0/d8/d18/d23/d27/d2d/d5f/ded/dee/l107 0 2024-09-13T21:44:48.097 INFO:tasks.workunit.client.0.smithi119.stdout:9/768: read d0/d19/f46 [2743624,31110] 0 2024-09-13T21:44:48.098 INFO:tasks.workunit.client.0.smithi119.stdout:8/581: creat d1b/d1d/d26/d3e/fb7 x:0 0 0 2024-09-13T21:44:48.099 INFO:tasks.workunit.client.0.smithi119.stdout:7/650: creat d8/d3c/d53/d3b/d7e/fd0 x:0 0 0 2024-09-13T21:44:48.105 INFO:tasks.workunit.client.1.smithi155.stdout:1/124: truncate d6/ff 341745 0 2024-09-13T21:44:48.105 INFO:tasks.workunit.client.0.smithi119.stdout:2/534: dwrite d1/d7/f11 [4194304,4194304] 0 2024-09-13T21:44:48.106 INFO:tasks.workunit.client.0.smithi119.stdout:8/582: symlink d1b/d4e/lb8 0 2024-09-13T21:44:48.106 INFO:tasks.workunit.client.1.smithi155.stdout:9/123: rmdir dc/de 39 2024-09-13T21:44:48.107 INFO:tasks.workunit.client.0.smithi119.stdout:9/769: mknod d0/d8/d18/d23/d27/d2d/d70/dda/c108 0 2024-09-13T21:44:48.110 INFO:tasks.workunit.client.0.smithi119.stdout:7/651: creat d8/d3c/d53/d37/d57/d5f/fd1 x:0 0 0 2024-09-13T21:44:48.113 INFO:tasks.workunit.client.0.smithi119.stdout:8/583: rmdir d1b/d1d/d48/d54 39 2024-09-13T21:44:48.114 INFO:tasks.workunit.client.1.smithi155.stdout:1/125: dwrite d6/d7/f2b [0,4194304] 0 2024-09-13T21:44:48.115 INFO:tasks.workunit.client.1.smithi155.stdout:9/124: link dc/d19/d21/l28 dc/d19/d23/l2a 0 2024-09-13T21:44:48.117 INFO:tasks.workunit.client.1.smithi155.stdout:1/126: creat d6/d7/f2f x:0 0 0 2024-09-13T21:44:48.118 INFO:tasks.workunit.client.0.smithi119.stdout:8/584: rmdir d1b/d1d/d26/d6b 39 2024-09-13T21:44:48.120 INFO:tasks.workunit.client.0.smithi119.stdout:2/535: getdents d1/d38 0 2024-09-13T21:44:48.121 INFO:tasks.workunit.client.0.smithi119.stdout:4/587: dread d4/d1e/f5c [0,4194304] 0 2024-09-13T21:44:48.121 INFO:tasks.workunit.client.0.smithi119.stdout:9/770: dwrite d0/d8/d18/d23/d27/d2d/d5f/da8/ff8 [0,4194304] 0 2024-09-13T21:44:48.122 INFO:tasks.workunit.client.1.smithi155.stdout:9/125: link dc/f1a dc/d19/d23/f2b 0 2024-09-13T21:44:48.124 INFO:tasks.workunit.client.1.smithi155.stdout:9/126: symlink dc/de/d15/l2c 0 2024-09-13T21:44:48.125 INFO:tasks.workunit.client.0.smithi119.stdout:2/536: symlink d1/d22/d5a/d5d/d83/lae 0 2024-09-13T21:44:48.126 INFO:tasks.workunit.client.1.smithi155.stdout:9/127: mkdir dc/de/d2d 0 2024-09-13T21:44:48.126 INFO:tasks.workunit.client.0.smithi119.stdout:4/588: creat d4/d1e/d26/d60/fbd x:0 0 0 2024-09-13T21:44:48.126 INFO:tasks.workunit.client.1.smithi155.stdout:9/128: chown dc/de 255430 1 2024-09-13T21:44:48.127 INFO:tasks.workunit.client.0.smithi119.stdout:9/771: mknod d0/d8/d18/d23/dea/c109 0 2024-09-13T21:44:48.128 INFO:tasks.workunit.client.0.smithi119.stdout:9/772: stat d0 0 2024-09-13T21:44:48.130 INFO:tasks.workunit.client.0.smithi119.stdout:2/537: rmdir d1/d97 39 2024-09-13T21:44:48.131 INFO:tasks.workunit.client.1.smithi155.stdout:9/129: creat dc/d19/d23/f2e x:0 0 0 2024-09-13T21:44:48.133 INFO:tasks.workunit.client.1.smithi155.stdout:1/127: dread d6/d15/f18 [0,4194304] 0 2024-09-13T21:44:48.133 INFO:tasks.workunit.client.0.smithi119.stdout:7/652: dread d8/d19/f84 [0,4194304] 0 2024-09-13T21:44:48.134 INFO:tasks.workunit.client.1.smithi155.stdout:9/130: fdatasync dc/de/ff 0 2024-09-13T21:44:48.135 INFO:tasks.workunit.client.0.smithi119.stdout:4/589: symlink d4/d1e/d26/d60/d71/d83/lbe 0 2024-09-13T21:44:48.136 INFO:tasks.workunit.client.0.smithi119.stdout:8/585: link d1b/d1d/d26/d3e/cb6 d1b/d1d/d48/d54/cb9 0 2024-09-13T21:44:48.137 INFO:tasks.workunit.client.1.smithi155.stdout:9/131: fsync dc/d18/d1e/f22 0 2024-09-13T21:44:48.138 INFO:tasks.workunit.client.0.smithi119.stdout:2/538: dread d1/d38/d89/d6b/f65 [0,4194304] 0 2024-09-13T21:44:48.139 INFO:tasks.workunit.client.1.smithi155.stdout:9/132: mkdir dc/d19/d23/d2f 0 2024-09-13T21:44:48.139 INFO:tasks.workunit.client.0.smithi119.stdout:4/590: write d4/d1e/d26/f61 [4071810,72931] 0 2024-09-13T21:44:48.139 INFO:tasks.workunit.client.1.smithi155.stdout:1/128: dwrite d6/fa [4194304,4194304] 0 2024-09-13T21:44:48.140 INFO:tasks.workunit.client.0.smithi119.stdout:8/586: symlink d1b/d1d/d26/d3e/lba 0 2024-09-13T21:44:48.140 INFO:tasks.workunit.client.1.smithi155.stdout:4/124: sync 2024-09-13T21:44:48.143 INFO:tasks.workunit.client.0.smithi119.stdout:8/587: chown d1b/d1d/d48/d54/f37 6464840 1 2024-09-13T21:44:48.145 INFO:tasks.workunit.client.1.smithi155.stdout:4/125: getdents d1 0 2024-09-13T21:44:48.146 INFO:tasks.workunit.client.1.smithi155.stdout:9/133: dwrite dc/de/f16 [0,4194304] 0 2024-09-13T21:44:48.146 INFO:tasks.workunit.client.0.smithi119.stdout:7/653: dwrite d8/d19/f1c [0,4194304] 0 2024-09-13T21:44:48.146 INFO:tasks.workunit.client.0.smithi119.stdout:8/588: chown d1b/d1d/d48/d54/f9d 9 1 2024-09-13T21:44:48.148 INFO:tasks.workunit.client.0.smithi119.stdout:8/589: chown d1b/d1d/d26/d3e/lba 1634160 1 2024-09-13T21:44:48.149 INFO:tasks.workunit.client.0.smithi119.stdout:2/539: dread d1/d22/d55/d64/fa1 [0,4194304] 0 2024-09-13T21:44:48.149 INFO:tasks.workunit.client.0.smithi119.stdout:7/654: dread - d8/d3c/d53/d3b/d7e/fd0 zero size 2024-09-13T21:44:48.153 INFO:tasks.workunit.client.0.smithi119.stdout:8/590: chown d1b/c8b 17714 1 2024-09-13T21:44:48.156 INFO:tasks.workunit.client.0.smithi119.stdout:0/560: sync 2024-09-13T21:44:48.156 INFO:tasks.workunit.client.0.smithi119.stdout:2/540: unlink d1/d22/c29 0 2024-09-13T21:44:48.160 INFO:tasks.workunit.client.0.smithi119.stdout:4/591: creat d4/d1e/d28/d34/d6a/d79/dae/fbf x:0 0 0 2024-09-13T21:44:48.160 INFO:tasks.workunit.client.0.smithi119.stdout:4/592: fsync d4/f53 0 2024-09-13T21:44:48.162 INFO:tasks.workunit.client.0.smithi119.stdout:7/655: mknod d8/d3c/d53/d37/d57/cd2 0 2024-09-13T21:44:48.162 INFO:tasks.workunit.client.0.smithi119.stdout:2/541: mkdir d1/daf 0 2024-09-13T21:44:48.167 INFO:tasks.workunit.client.0.smithi119.stdout:9/773: dread d0/d4f/de5/f4d [0,4194304] 0 2024-09-13T21:44:48.167 INFO:tasks.workunit.client.0.smithi119.stdout:8/591: dwrite d1b/d4e/f67 [0,4194304] 0 2024-09-13T21:44:48.168 INFO:tasks.workunit.client.0.smithi119.stdout:4/593: creat d4/d1e/d28/d34/d66/d76/d8f/fc0 x:0 0 0 2024-09-13T21:44:48.169 INFO:tasks.workunit.client.0.smithi119.stdout:9/774: chown d0/d19/f6d 0 1 2024-09-13T21:44:48.170 INFO:tasks.workunit.client.1.smithi155.stdout:9/134: rmdir dc/de 39 2024-09-13T21:44:48.172 INFO:tasks.workunit.client.1.smithi155.stdout:9/135: dread dc/d18/f20 [0,4194304] 0 2024-09-13T21:44:48.176 INFO:tasks.workunit.client.0.smithi119.stdout:8/592: rmdir d1b/d1d/d26 39 2024-09-13T21:44:48.177 INFO:tasks.workunit.client.1.smithi155.stdout:9/136: getdents dc 0 2024-09-13T21:44:48.177 INFO:tasks.workunit.client.0.smithi119.stdout:0/561: dwrite de/d1c/d2f/d35/d4a/d62/f75 [0,4194304] 0 2024-09-13T21:44:48.178 INFO:tasks.workunit.client.1.smithi155.stdout:9/137: creat dc/d19/d23/f30 x:0 0 0 2024-09-13T21:44:48.185 INFO:tasks.workunit.client.1.smithi155.stdout:1/129: fdatasync d6/fa 0 2024-09-13T21:44:48.185 INFO:tasks.workunit.client.1.smithi155.stdout:9/138: dwrite dc/de/f16 [0,4194304] 0 2024-09-13T21:44:48.191 INFO:tasks.workunit.client.1.smithi155.stdout:1/130: mkdir d6/d7/d13/d17/d30 0 2024-09-13T21:44:48.193 INFO:tasks.workunit.client.1.smithi155.stdout:9/139: dwrite dc/d18/f1d [0,4194304] 0 2024-09-13T21:44:48.195 INFO:tasks.workunit.client.1.smithi155.stdout:4/126: write d1/f1c [849287,95916] 0 2024-09-13T21:44:48.195 INFO:tasks.workunit.client.0.smithi119.stdout:0/562: dread de/d1c/d2b/d76/d9a/fc2 [0,4194304] 0 2024-09-13T21:44:48.197 INFO:tasks.workunit.client.1.smithi155.stdout:1/131: link d6/d7/f24 d6/d7/d13/f31 0 2024-09-13T21:44:48.204 INFO:tasks.workunit.client.1.smithi155.stdout:9/140: dwrite dc/d18/d1e/f22 [0,4194304] 0 2024-09-13T21:44:48.209 INFO:tasks.workunit.client.1.smithi155.stdout:1/132: dwrite d6/d7/d13/d17/f2a [0,4194304] 0 2024-09-13T21:44:48.212 INFO:tasks.workunit.client.1.smithi155.stdout:1/133: link d6/d7/f2f d6/f32 0 2024-09-13T21:44:48.213 INFO:tasks.workunit.client.1.smithi155.stdout:1/134: creat d6/f33 x:0 0 0 2024-09-13T21:44:48.214 INFO:tasks.workunit.client.1.smithi155.stdout:1/135: creat d6/d15/f34 x:0 0 0 2024-09-13T21:44:48.215 INFO:tasks.workunit.client.1.smithi155.stdout:1/136: write d6/f16 [6410484,17161] 0 2024-09-13T21:44:48.223 INFO:tasks.workunit.client.1.smithi155.stdout:1/137: dwrite d6/d7/d13/f14 [0,4194304] 0 2024-09-13T21:44:48.226 INFO:tasks.workunit.client.1.smithi155.stdout:4/127: truncate d1/d7/de/d1a/f1d 3504692 0 2024-09-13T21:44:48.227 INFO:tasks.workunit.client.1.smithi155.stdout:1/138: rename d6/d7/d13/f31 to d6/d7/d13/d17/d30/f35 0 2024-09-13T21:44:48.228 INFO:tasks.workunit.client.1.smithi155.stdout:9/141: write dc/f1a [409217,92064] 0 2024-09-13T21:44:48.229 INFO:tasks.workunit.client.1.smithi155.stdout:4/128: mkdir d1/d7/de/d23 0 2024-09-13T21:44:48.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.229+0000 7fb94785b640 1 -- 172.21.15.119:0/1183107781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb9240057c0 con 0x7fb9400fd7f0 2024-09-13T21:44:48.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.229+0000 7fb931ffb640 1 -- 172.21.15.119:0/1183107781 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb93400cb20 con 0x7fb9400fd7f0 2024-09-13T21:44:48.231 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:44:48.231 INFO:tasks.workunit.client.1.smithi155.stdout:1/139: rename d6/fb to d6/f36 0 2024-09-13T21:44:48.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.232+0000 7fb94785b640 1 -- 172.21.15.119:0/1183107781 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fb92c06e4d0 msgr2=0x7fb92c070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:48.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.232+0000 7fb94785b640 1 --2- 172.21.15.119:0/1183107781 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fb92c06e4d0 0x7fb92c070980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb938009ac0 tx=0x7fb938009da0 comp rx=0 tx=0).stop 2024-09-13T21:44:48.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.232+0000 7fb94785b640 1 -- 172.21.15.119:0/1183107781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9400fd7f0 msgr2=0x7fb940113be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:44:48.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.232+0000 7fb94785b640 1 --2- 172.21.15.119:0/1183107781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9400fd7f0 0x7fb940113be0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb93400bbb0 tx=0x7fb934009840 comp rx=0 tx=0).stop 2024-09-13T21:44:48.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.232+0000 7fb94785b640 1 -- 172.21.15.119:0/1183107781 shutdown_connections 2024-09-13T21:44:48.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.232+0000 7fb94785b640 1 --2- 172.21.15.119:0/1183107781 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fb92c06e4d0 0x7fb92c070980 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:48.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.232+0000 7fb94785b640 1 --2- 172.21.15.119:0/1183107781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9400fd7f0 0x7fb940113be0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:48.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.232+0000 7fb94785b640 1 --2- 172.21.15.119:0/1183107781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9400fc520 0x7fb9401136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:44:48.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.232+0000 7fb94785b640 1 -- 172.21.15.119:0/1183107781 >> 172.21.15.119:0/1183107781 conn(0x7fb9400f7ce0 msgr2=0x7fb9400f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:44:48.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.232+0000 7fb94785b640 1 -- 172.21.15.119:0/1183107781 shutdown_connections 2024-09-13T21:44:48.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:44:48.232+0000 7fb94785b640 1 -- 172.21.15.119:0/1183107781 wait complete. 2024-09-13T21:44:48.235 INFO:tasks.workunit.client.1.smithi155.stdout:1/140: truncate d6/d15/f20 8998277 0 2024-09-13T21:44:48.236 INFO:tasks.workunit.client.1.smithi155.stdout:1/141: creat d6/d15/f37 x:0 0 0 2024-09-13T21:44:48.237 INFO:tasks.workunit.client.1.smithi155.stdout:9/142: dwrite dc/f1a [0,4194304] 0 2024-09-13T21:44:48.238 INFO:tasks.workunit.client.1.smithi155.stdout:9/143: fdatasync dc/d18/d1e/f22 0 2024-09-13T21:44:48.244 INFO:tasks.workunit.client.1.smithi155.stdout:9/144: link c9 dc/de/d15/c31 0 2024-09-13T21:44:48.248 INFO:tasks.workunit.client.1.smithi155.stdout:9/145: mknod dc/de/d2d/c32 0 2024-09-13T21:44:48.250 INFO:tasks.workunit.client.1.smithi155.stdout:9/146: symlink dc/d18/l33 0 2024-09-13T21:44:48.250 INFO:tasks.workunit.client.1.smithi155.stdout:9/147: read dc/de/ff [1470637,12226] 0 2024-09-13T21:44:48.251 INFO:tasks.workunit.client.1.smithi155.stdout:1/142: truncate d6/d15/f20 6340929 0 2024-09-13T21:44:48.252 INFO:tasks.workunit.client.1.smithi155.stdout:1/143: read - d6/f32 zero size 2024-09-13T21:44:48.253 INFO:tasks.workunit.client.1.smithi155.stdout:9/148: creat dc/d18/d1e/f34 x:0 0 0 2024-09-13T21:44:48.260 INFO:tasks.workunit.client.1.smithi155.stdout:9/149: link dc/d18/c1f dc/de/d15/c35 0 2024-09-13T21:44:48.261 INFO:tasks.workunit.client.1.smithi155.stdout:4/129: dwrite d1/d7/de/d1a/f1d [0,4194304] 0 2024-09-13T21:44:48.262 INFO:tasks.workunit.client.1.smithi155.stdout:1/144: dwrite d6/d7/d13/d17/f29 [0,4194304] 0 2024-09-13T21:44:48.268 INFO:tasks.workunit.client.1.smithi155.stdout:9/150: creat dc/d19/f36 x:0 0 0 2024-09-13T21:44:48.271 INFO:tasks.workunit.client.0.smithi119.stdout:5/584: sync 2024-09-13T21:44:48.272 INFO:tasks.workunit.client.0.smithi119.stdout:3/524: sync 2024-09-13T21:44:48.272 INFO:tasks.workunit.client.0.smithi119.stdout:1/592: sync 2024-09-13T21:44:48.272 INFO:tasks.workunit.client.0.smithi119.stdout:6/526: sync 2024-09-13T21:44:48.273 INFO:tasks.workunit.client.0.smithi119.stdout:6/527: fdatasync dc/d3d/fa0 0 2024-09-13T21:44:48.273 INFO:tasks.workunit.client.1.smithi155.stdout:1/145: rename d6/ce to d6/d15/c38 0 2024-09-13T21:44:48.273 INFO:tasks.workunit.client.0.smithi119.stdout:3/525: chown d6/d15/d1a/d45/d47/c5d 1 1 2024-09-13T21:44:48.274 INFO:tasks.workunit.client.0.smithi119.stdout:6/528: stat dc/d4b/d6a/l7d 0 2024-09-13T21:44:48.274 INFO:tasks.workunit.client.1.smithi155.stdout:9/151: getdents dc/d19/d23/d2f 0 2024-09-13T21:44:48.275 INFO:tasks.workunit.client.1.smithi155.stdout:4/130: dwrite d1/d7/de/f1f [0,4194304] 0 2024-09-13T21:44:48.275 INFO:tasks.workunit.client.0.smithi119.stdout:1/593: truncate d1/d3/dc/d11/d19/d47/f7c 408385 0 2024-09-13T21:44:48.278 INFO:tasks.workunit.client.1.smithi155.stdout:1/146: rename d6/d7/cd to d6/c39 0 2024-09-13T21:44:48.280 INFO:tasks.workunit.client.1.smithi155.stdout:1/147: read - d6/d15/f37 zero size 2024-09-13T21:44:48.280 INFO:tasks.workunit.client.1.smithi155.stdout:4/131: creat d1/f24 x:0 0 0 2024-09-13T21:44:48.283 INFO:tasks.workunit.client.1.smithi155.stdout:9/152: dwrite fb [0,4194304] 0 2024-09-13T21:44:48.284 INFO:tasks.workunit.client.1.smithi155.stdout:1/148: symlink d6/d7/d13/d17/d30/l3a 0 2024-09-13T21:44:48.285 INFO:tasks.workunit.client.1.smithi155.stdout:9/153: read fb [633798,43325] 0 2024-09-13T21:44:48.290 INFO:tasks.workunit.client.1.smithi155.stdout:1/149: creat d6/d7/d13/d17/d30/f3b x:0 0 0 2024-09-13T21:44:48.292 INFO:tasks.workunit.client.1.smithi155.stdout:9/154: getdents dc/d19/d21 0 2024-09-13T21:44:48.293 INFO:tasks.workunit.client.1.smithi155.stdout:1/150: fsync d6/fa 0 2024-09-13T21:44:48.294 INFO:tasks.workunit.client.1.smithi155.stdout:1/151: dread - d6/f32 zero size 2024-09-13T21:44:48.294 INFO:tasks.workunit.client.1.smithi155.stdout:9/155: truncate dc/d18/f20 948642 0 2024-09-13T21:44:48.296 INFO:tasks.workunit.client.1.smithi155.stdout:9/156: mkdir dc/de/d15/d37 0 2024-09-13T21:44:48.297 INFO:tasks.workunit.client.1.smithi155.stdout:1/152: unlink d6/d7/d13/d17/d30/f35 0 2024-09-13T21:44:48.298 INFO:tasks.workunit.client.1.smithi155.stdout:1/153: write d6/f33 [908229,5370] 0 2024-09-13T21:44:48.299 INFO:tasks.workunit.client.1.smithi155.stdout:9/157: rename dc/de/d15/d37 to dc/d19/d23/d38 0 2024-09-13T21:44:48.300 INFO:tasks.workunit.client.0.smithi119.stdout:9/775: chown d0/d8/c31 329767 1 2024-09-13T21:44:48.301 INFO:tasks.workunit.client.0.smithi119.stdout:8/593: creat d1b/d1d/d39/fbb x:0 0 0 2024-09-13T21:44:48.301 INFO:tasks.workunit.client.1.smithi155.stdout:9/158: mknod dc/de/d15/c39 0 2024-09-13T21:44:48.302 INFO:tasks.workunit.client.0.smithi119.stdout:0/563: rmdir de/d1c/d2f/d35/d4a 39 2024-09-13T21:44:48.302 INFO:tasks.workunit.client.1.smithi155.stdout:1/154: link d6/fa d6/d15/d23/f3c 0 2024-09-13T21:44:48.303 INFO:tasks.workunit.client.0.smithi119.stdout:8/594: chown d1b/d1d/d48/d54/c32 594 1 2024-09-13T21:44:48.303 INFO:tasks.workunit.client.1.smithi155.stdout:9/159: creat dc/de/f3a x:0 0 0 2024-09-13T21:44:48.304 INFO:tasks.workunit.client.1.smithi155.stdout:9/160: chown dc/de/d15 1 1 2024-09-13T21:44:48.304 INFO:tasks.workunit.client.1.smithi155.stdout:1/155: creat d6/d15/f3d x:0 0 0 2024-09-13T21:44:48.304 INFO:tasks.workunit.client.1.smithi155.stdout:9/161: chown dc/d19/d23 93039 1 2024-09-13T21:44:48.305 INFO:tasks.workunit.client.0.smithi119.stdout:9/776: write d0/d8/d18/d23/d27/d2d/d5f/da8/fb8 [726327,118029] 0 2024-09-13T21:44:48.308 INFO:tasks.workunit.client.0.smithi119.stdout:8/595: write d1b/d1d/d48/f96 [166021,35732] 0 2024-09-13T21:44:48.309 INFO:tasks.workunit.client.0.smithi119.stdout:1/594: mkdir d1/d3/d61/d77/d78/d32/dc3 0 2024-09-13T21:44:48.309 INFO:tasks.workunit.client.1.smithi155.stdout:1/156: write d6/d7/d13/d17/d30/f3b [77058,19945] 0 2024-09-13T21:44:48.309 INFO:tasks.workunit.client.1.smithi155.stdout:9/162: symlink dc/d19/d23/l3b 0 2024-09-13T21:44:48.312 INFO:tasks.workunit.client.0.smithi119.stdout:3/526: dread d6/d15/d1a/f5b [0,4194304] 0 2024-09-13T21:44:48.313 INFO:tasks.workunit.client.0.smithi119.stdout:0/564: symlink de/d1c/d2f/lca 0 2024-09-13T21:44:48.314 INFO:tasks.workunit.client.0.smithi119.stdout:9/777: dwrite d0/d8/d18/d23/dea/f9d [0,4194304] 0 2024-09-13T21:44:48.314 INFO:tasks.workunit.client.0.smithi119.stdout:2/542: symlink d1/d22/d5a/da9/lb0 0 2024-09-13T21:44:48.314 INFO:tasks.workunit.client.0.smithi119.stdout:0/565: chown de/f77 91530 1 2024-09-13T21:44:48.315 INFO:tasks.workunit.client.1.smithi155.stdout:1/157: chown d6/c39 0 1 2024-09-13T21:44:48.316 INFO:tasks.workunit.client.0.smithi119.stdout:9/778: chown d0/d4f/de5/c63 70 1 2024-09-13T21:44:48.316 INFO:tasks.workunit.client.1.smithi155.stdout:4/132: dread d1/f4 [0,4194304] 0 2024-09-13T21:44:48.316 INFO:tasks.workunit.client.1.smithi155.stdout:9/163: dwrite dc/de/d15/f24 [0,4194304] 0 2024-09-13T21:44:48.317 INFO:tasks.workunit.client.1.smithi155.stdout:1/158: chown d6/d7/f2b 799 1 2024-09-13T21:44:48.318 INFO:tasks.workunit.client.0.smithi119.stdout:6/529: rmdir dc/d4b/d6a/da7 0 2024-09-13T21:44:48.320 INFO:tasks.workunit.client.1.smithi155.stdout:4/133: rename d1/d7/de/dc/ff to d1/f25 0 2024-09-13T21:44:48.321 INFO:tasks.workunit.client.0.smithi119.stdout:3/527: rmdir d6/d25/d2f/d33/d88/d96 39 2024-09-13T21:44:48.321 INFO:tasks.workunit.client.0.smithi119.stdout:3/528: chown d6/d15 156669090 1 2024-09-13T21:44:48.325 INFO:tasks.workunit.client.0.smithi119.stdout:5/585: getdents d0/d3/d4/d9/d1e/da5 0 2024-09-13T21:44:48.325 INFO:tasks.workunit.client.1.smithi155.stdout:1/159: rename d6/d7/d13 to d6/d15/d3e 0 2024-09-13T21:44:48.328 INFO:tasks.workunit.client.1.smithi155.stdout:4/134: dwrite d1/f1c [0,4194304] 0 2024-09-13T21:44:48.329 INFO:tasks.workunit.client.0.smithi119.stdout:5/586: write d0/d3/d4/d9/f87 [4153769,44422] 0 2024-09-13T21:44:48.332 INFO:tasks.workunit.client.1.smithi155.stdout:4/135: mkdir d1/d7/de/d15/d1b/d26 0 2024-09-13T21:44:48.332 INFO:tasks.workunit.client.0.smithi119.stdout:3/529: dwrite d6/d25/d2f/d33/d88/fa3 [0,4194304] 0 2024-09-13T21:44:48.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:47 smithi155 ceph-mon[34732]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:48.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:47 smithi155 ceph-mon[34732]: pgmap v8: 65 pgs: 65 active+clean; 1.0 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 22 MiB/s rd, 98 MiB/s wr, 217 op/s 2024-09-13T21:44:48.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:47 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1263160658' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:44:48.335 INFO:tasks.workunit.client.0.smithi119.stdout:2/543: unlink d1/l45 0 2024-09-13T21:44:48.335 INFO:tasks.workunit.client.0.smithi119.stdout:3/530: chown d6/d15/l81 6999 1 2024-09-13T21:44:48.336 INFO:tasks.workunit.client.1.smithi155.stdout:1/160: dwrite d6/d15/f34 [0,4194304] 0 2024-09-13T21:44:48.337 INFO:tasks.workunit.client.0.smithi119.stdout:9/779: mknod d0/d8/d18/d23/d42/d52/de1/c10a 0 2024-09-13T21:44:48.338 INFO:tasks.workunit.client.0.smithi119.stdout:4/594: dwrite d4/f21 [0,4194304] 0 2024-09-13T21:44:48.339 INFO:tasks.workunit.client.0.smithi119.stdout:6/530: readlink dc/df/d32/l43 0 2024-09-13T21:44:48.340 INFO:tasks.workunit.client.1.smithi155.stdout:4/136: dread d1/d7/de/f1f [0,4194304] 0 2024-09-13T21:44:48.340 INFO:tasks.workunit.client.1.smithi155.stdout:1/161: unlink d6/d7/f2b 0 2024-09-13T21:44:48.340 INFO:tasks.workunit.client.0.smithi119.stdout:1/595: getdents d1/d3/d61/d7e/d53 0 2024-09-13T21:44:48.341 INFO:tasks.workunit.client.1.smithi155.stdout:4/137: readlink d1/d7/d21/l22 0 2024-09-13T21:44:48.343 INFO:tasks.workunit.client.1.smithi155.stdout:1/162: creat d6/d15/d23/f3f x:0 0 0 2024-09-13T21:44:48.344 INFO:tasks.workunit.client.1.smithi155.stdout:1/163: read d6/d15/d3e/d17/f2a [2488150,112698] 0 2024-09-13T21:44:48.345 INFO:tasks.workunit.client.1.smithi155.stdout:1/164: readlink l5 0 2024-09-13T21:44:48.345 INFO:tasks.workunit.client.0.smithi119.stdout:9/780: fdatasync d0/d19/f9a 0 2024-09-13T21:44:48.346 INFO:tasks.workunit.client.1.smithi155.stdout:1/165: chown d6/d15/f37 471 1 2024-09-13T21:44:48.348 INFO:tasks.workunit.client.1.smithi155.stdout:1/166: creat d6/d7/f40 x:0 0 0 2024-09-13T21:44:48.351 INFO:tasks.workunit.client.1.smithi155.stdout:1/167: symlink d6/d15/l41 0 2024-09-13T21:44:48.351 INFO:tasks.workunit.client.1.smithi155.stdout:1/168: chown d6/d15/d3e/d17/l2d 3806 1 2024-09-13T21:44:48.357 INFO:tasks.workunit.client.1.smithi155.stdout:1/169: dread d6/d15/d3e/d17/f2a [0,4194304] 0 2024-09-13T21:44:48.358 INFO:tasks.workunit.client.1.smithi155.stdout:1/170: chown d6/d7/f40 1655 1 2024-09-13T21:44:48.358 INFO:tasks.workunit.client.1.smithi155.stdout:1/171: readlink l5 0 2024-09-13T21:44:48.358 INFO:tasks.workunit.client.1.smithi155.stdout:1/172: chown d6/fa 286 1 2024-09-13T21:44:48.360 INFO:tasks.workunit.client.0.smithi119.stdout:1/596: read - d1/d3/d61/d77/da6/fac zero size 2024-09-13T21:44:48.361 INFO:tasks.workunit.client.0.smithi119.stdout:9/781: fsync d0/f14 0 2024-09-13T21:44:48.361 INFO:tasks.workunit.client.0.smithi119.stdout:8/596: truncate d1b/d1d/d48/d58/f74 7770739 0 2024-09-13T21:44:48.362 INFO:tasks.workunit.client.1.smithi155.stdout:1/173: getdents d6/d15/d3e 0 2024-09-13T21:44:48.363 INFO:tasks.workunit.client.0.smithi119.stdout:9/782: stat d0/d4f/c84 0 2024-09-13T21:44:48.363 INFO:tasks.workunit.client.0.smithi119.stdout:5/587: getdents d0/d3/d1f 0 2024-09-13T21:44:48.364 INFO:tasks.workunit.client.1.smithi155.stdout:1/174: symlink d6/d7/l42 0 2024-09-13T21:44:48.365 INFO:tasks.workunit.client.1.smithi155.stdout:4/138: dread d1/f25 [0,4194304] 0 2024-09-13T21:44:48.366 INFO:tasks.workunit.client.0.smithi119.stdout:4/595: dwrite d4/d1e/d10/fb9 [0,4194304] 0 2024-09-13T21:44:48.366 INFO:tasks.workunit.client.0.smithi119.stdout:6/531: rename dc/dd/d5e/d7a/c8a to dc/d4b/ca9 0 2024-09-13T21:44:48.366 INFO:tasks.workunit.client.0.smithi119.stdout:1/597: read - d1/d3/dc/d11/d19/d47/fa7 zero size 2024-09-13T21:44:48.366 INFO:tasks.workunit.client.1.smithi155.stdout:1/175: dread d6/d15/f18 [0,4194304] 0 2024-09-13T21:44:48.367 INFO:tasks.workunit.client.0.smithi119.stdout:9/783: chown d0/d8/d18/d23/d27/d2d/d5f 23 1 2024-09-13T21:44:48.369 INFO:tasks.workunit.client.0.smithi119.stdout:3/531: write d6/d44/d52/f58 [510704,73749] 0 2024-09-13T21:44:48.370 INFO:tasks.workunit.client.1.smithi155.stdout:4/139: dread d1/f25 [0,4194304] 0 2024-09-13T21:44:48.370 INFO:tasks.workunit.client.1.smithi155.stdout:4/140: readlink d1/ld 0 2024-09-13T21:44:48.371 INFO:tasks.workunit.client.1.smithi155.stdout:1/176: truncate d6/d7/f24 1073676 0 2024-09-13T21:44:48.372 INFO:tasks.workunit.client.0.smithi119.stdout:5/588: unlink d0/d3/d1f/d21/f34 0 2024-09-13T21:44:48.373 INFO:tasks.workunit.client.0.smithi119.stdout:9/784: write d0/d4f/de5/db9/fe6 [1033697,77975] 0 2024-09-13T21:44:48.374 INFO:tasks.workunit.client.1.smithi155.stdout:4/141: rename d1/d7/de/d1a/f1d to d1/f27 0 2024-09-13T21:44:48.375 INFO:tasks.workunit.client.0.smithi119.stdout:0/566: dwrite de/d49/d7d/f89 [0,4194304] 0 2024-09-13T21:44:48.377 INFO:tasks.workunit.client.0.smithi119.stdout:6/532: symlink dc/dd/laa 0 2024-09-13T21:44:48.377 INFO:tasks.workunit.client.1.smithi155.stdout:4/142: mknod d1/d7/d21/c28 0 2024-09-13T21:44:48.378 INFO:tasks.workunit.client.0.smithi119.stdout:4/596: mknod d4/d1e/d28/d34/d66/cc1 0 2024-09-13T21:44:48.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:47 smithi119 ceph-mon[27653]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:48.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:47 smithi119 ceph-mon[27653]: pgmap v8: 65 pgs: 65 active+clean; 1.0 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 22 MiB/s rd, 98 MiB/s wr, 217 op/s 2024-09-13T21:44:48.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:47 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1263160658' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:44:48.381 INFO:tasks.workunit.client.1.smithi155.stdout:4/143: rmdir d1/d7/de/d23 0 2024-09-13T21:44:48.381 INFO:tasks.workunit.client.0.smithi119.stdout:8/597: link d1b/f27 d1b/d1d/d26/fbc 0 2024-09-13T21:44:48.383 INFO:tasks.workunit.client.1.smithi155.stdout:4/144: mknod d1/d7/de/d1a/c29 0 2024-09-13T21:44:48.384 INFO:tasks.workunit.client.1.smithi155.stdout:4/145: dread - d1/f24 zero size 2024-09-13T21:44:48.384 INFO:tasks.workunit.client.0.smithi119.stdout:8/598: read d1b/d1d/d48/d58/f6d [2928890,38497] 0 2024-09-13T21:44:48.385 INFO:tasks.workunit.client.0.smithi119.stdout:5/589: rename d0/d3/d1f/d21/d4f/lcd to d0/d3/d4/d9/d1e/da5/lce 0 2024-09-13T21:44:48.385 INFO:tasks.workunit.client.0.smithi119.stdout:0/567: mkdir de/d1c/d2f/d40/d66/dcb 0 2024-09-13T21:44:48.387 INFO:tasks.workunit.client.1.smithi155.stdout:4/146: creat d1/d7/d21/f2a x:0 0 0 2024-09-13T21:44:48.388 INFO:tasks.workunit.client.0.smithi119.stdout:1/598: symlink d1/d3/dc/d11/d19/d2d/d37/d9b/lc4 0 2024-09-13T21:44:48.388 INFO:tasks.workunit.client.1.smithi155.stdout:4/147: fsync d1/f6 0 2024-09-13T21:44:48.389 INFO:tasks.workunit.client.0.smithi119.stdout:3/532: creat d6/d25/d2f/d33/d56/da0/fb0 x:0 0 0 2024-09-13T21:44:48.390 INFO:tasks.workunit.client.1.smithi155.stdout:1/177: truncate d6/d15/f34 3539571 0 2024-09-13T21:44:48.390 INFO:tasks.workunit.client.0.smithi119.stdout:9/785: symlink d0/d8/d18/d23/d27/d2d/ddb/df1/l10b 0 2024-09-13T21:44:48.392 INFO:tasks.workunit.client.1.smithi155.stdout:4/148: getdents d1/d7/de/d15/d1b 0 2024-09-13T21:44:48.395 INFO:tasks.workunit.client.0.smithi119.stdout:3/533: creat d6/d15/d1a/d45/d47/d4d/da7/fb1 x:0 0 0 2024-09-13T21:44:48.397 INFO:tasks.workunit.client.0.smithi119.stdout:3/534: chown d6/d15/f21 6075960 1 2024-09-13T21:44:48.397 INFO:tasks.workunit.client.0.smithi119.stdout:1/599: dwrite d1/d3/dc/d11/d19/d47/fa7 [0,4194304] 0 2024-09-13T21:44:48.398 INFO:tasks.workunit.client.0.smithi119.stdout:0/568: rmdir de/d1c/d2f/d35/d4a/d62 39 2024-09-13T21:44:48.398 INFO:tasks.workunit.client.1.smithi155.stdout:4/149: truncate d1/d7/de/f1f 2262665 0 2024-09-13T21:44:48.400 INFO:tasks.workunit.client.0.smithi119.stdout:5/590: link d0/d3/d4/d9/f87 d0/d3/d4/d9/d14/d24/d25/fcf 0 2024-09-13T21:44:48.402 INFO:tasks.workunit.client.0.smithi119.stdout:9/786: rmdir d0/d8/d18/d23/d27/d2d/dc1 39 2024-09-13T21:44:48.404 INFO:tasks.workunit.client.0.smithi119.stdout:9/787: write d0/d8/d18/d23/d27/f32 [2037321,116172] 0 2024-09-13T21:44:48.408 INFO:tasks.workunit.client.0.smithi119.stdout:5/591: unlink d0/dab/cb5 0 2024-09-13T21:44:48.410 INFO:tasks.workunit.client.0.smithi119.stdout:3/535: mknod d6/cb2 0 2024-09-13T21:44:48.411 INFO:tasks.workunit.client.0.smithi119.stdout:9/788: creat d0/d4f/de5/d2b/f10c x:0 0 0 2024-09-13T21:44:48.412 INFO:tasks.workunit.client.0.smithi119.stdout:1/600: mknod d1/d3/d61/d77/d78/d32/d33/d72/db4/cc5 0 2024-09-13T21:44:48.413 INFO:tasks.workunit.client.0.smithi119.stdout:5/592: truncate d0/d3/d1f/f5d 601854 0 2024-09-13T21:44:48.413 INFO:tasks.workunit.client.0.smithi119.stdout:4/597: dwrite d4/d1e/d26/d6d/f72 [0,4194304] 0 2024-09-13T21:44:48.413 INFO:tasks.workunit.client.0.smithi119.stdout:8/599: link d1b/d1d/d48/d54/c34 d1b/d1d/d26/da4/cbd 0 2024-09-13T21:44:48.414 INFO:tasks.workunit.client.0.smithi119.stdout:1/601: write d1/d3/dc/f1c [3389719,15621] 0 2024-09-13T21:44:48.417 INFO:tasks.workunit.client.0.smithi119.stdout:0/569: link de/d1c/d64/ca2 de/d1c/d2f/d40/ccc 0 2024-09-13T21:44:48.418 INFO:tasks.workunit.client.0.smithi119.stdout:5/593: read d0/d3/d1f/f52 [2715941,96096] 0 2024-09-13T21:44:48.419 INFO:tasks.workunit.client.0.smithi119.stdout:1/602: chown d1/d3/dc/d11/d19/d47/cbd 108 1 2024-09-13T21:44:48.421 INFO:tasks.workunit.client.0.smithi119.stdout:4/598: write d4/f2f [708999,117816] 0 2024-09-13T21:44:48.421 INFO:tasks.workunit.client.0.smithi119.stdout:3/536: truncate d6/d15/d1a/d45/f87 5083107 0 2024-09-13T21:44:48.422 INFO:tasks.workunit.client.0.smithi119.stdout:3/537: readlink d6/d15/l7b 0 2024-09-13T21:44:48.423 INFO:tasks.workunit.client.0.smithi119.stdout:9/789: symlink d0/d19/de4/d102/l10d 0 2024-09-13T21:44:48.424 INFO:tasks.workunit.client.0.smithi119.stdout:3/538: write d6/d44/f51 [295118,25562] 0 2024-09-13T21:44:48.425 INFO:tasks.workunit.client.0.smithi119.stdout:0/570: symlink de/d1c/d64/lcd 0 2024-09-13T21:44:48.426 INFO:tasks.workunit.client.0.smithi119.stdout:0/571: dread - de/d1c/d59/fb2 zero size 2024-09-13T21:44:48.427 INFO:tasks.workunit.client.0.smithi119.stdout:1/603: truncate d1/d3/d61/f85 950164 0 2024-09-13T21:44:48.429 INFO:tasks.workunit.client.1.smithi155.stdout:4/150: dread d1/f6 [0,4194304] 0 2024-09-13T21:44:48.430 INFO:tasks.workunit.client.0.smithi119.stdout:5/594: mknod d0/d3/d4/cd0 0 2024-09-13T21:44:48.432 INFO:tasks.workunit.client.0.smithi119.stdout:4/599: fsync d4/d1e/d26/d6d/f72 0 2024-09-13T21:44:48.432 INFO:tasks.workunit.client.1.smithi155.stdout:4/151: dread d1/f4 [0,4194304] 0 2024-09-13T21:44:48.433 INFO:tasks.workunit.client.0.smithi119.stdout:1/604: mknod d1/d3/dc/d11/d19/d2d/d37/d9d/cc6 0 2024-09-13T21:44:48.433 INFO:tasks.workunit.client.0.smithi119.stdout:0/572: dwrite de/d49/f4f [0,4194304] 0 2024-09-13T21:44:48.434 INFO:tasks.workunit.client.1.smithi155.stdout:4/152: creat d1/d7/d21/f2b x:0 0 0 2024-09-13T21:44:48.435 INFO:tasks.workunit.client.0.smithi119.stdout:5/595: mknod d0/d3/d1f/cd1 0 2024-09-13T21:44:48.435 INFO:tasks.workunit.client.0.smithi119.stdout:8/600: link d1b/d1d/d48/c93 d1b/cbe 0 2024-09-13T21:44:48.437 INFO:tasks.workunit.client.0.smithi119.stdout:5/596: write d0/d3/d4/d9/f47 [2764048,98463] 0 2024-09-13T21:44:48.439 INFO:tasks.workunit.client.1.smithi155.stdout:4/153: fsync d1/d7/de/f1f 0 2024-09-13T21:44:48.440 INFO:tasks.workunit.client.0.smithi119.stdout:9/790: rename d0/d4f to d0/d8/d18/d23/d27/d2d/d5f/d10e 0 2024-09-13T21:44:48.441 INFO:tasks.workunit.client.0.smithi119.stdout:4/600: mknod d4/d1e/d28/d34/d66/cc2 0 2024-09-13T21:44:48.441 INFO:tasks.workunit.client.0.smithi119.stdout:1/605: symlink d1/d3/d61/d77/d78/d32/d33/d72/db4/lc7 0 2024-09-13T21:44:48.443 INFO:tasks.workunit.client.1.smithi155.stdout:4/154: creat d1/d7/de/d15/f2c x:0 0 0 2024-09-13T21:44:48.445 INFO:tasks.workunit.client.1.smithi155.stdout:4/155: mkdir d1/d7/d21/d2d 0 2024-09-13T21:44:48.445 INFO:tasks.workunit.client.1.smithi155.stdout:4/156: fdatasync d1/d7/d21/f2a 0 2024-09-13T21:44:48.446 INFO:tasks.workunit.client.0.smithi119.stdout:1/606: unlink d1/d3/d6c/l97 0 2024-09-13T21:44:48.447 INFO:tasks.workunit.client.1.smithi155.stdout:4/157: getdents d1/d7/de/d15/d1b/d26 0 2024-09-13T21:44:48.448 INFO:tasks.workunit.client.1.smithi155.stdout:4/158: read - d1/d7/de/d15/f2c zero size 2024-09-13T21:44:48.449 INFO:tasks.workunit.client.0.smithi119.stdout:5/597: dread d0/d3/d4/d9/d1e/f91 [0,4194304] 0 2024-09-13T21:44:48.449 INFO:tasks.workunit.client.1.smithi155.stdout:4/159: getdents d1/d7/de/d15/d1b/d26 0 2024-09-13T21:44:48.452 INFO:tasks.workunit.client.0.smithi119.stdout:5/598: write d0/d3/d4/d9/d14/d24/d25/f9b [2626761,89109] 0 2024-09-13T21:44:48.452 INFO:tasks.workunit.client.1.smithi155.stdout:4/160: rename d1/d7/de/d15/d1b to d1/d7/de/dc/d2e 0 2024-09-13T21:44:48.453 INFO:tasks.workunit.client.0.smithi119.stdout:1/607: rmdir d1/d3/dc/d11/d19/d47 39 2024-09-13T21:44:48.455 INFO:tasks.workunit.client.1.smithi155.stdout:4/161: link d1/f6 d1/d7/de/f2f 0 2024-09-13T21:44:48.456 INFO:tasks.workunit.client.0.smithi119.stdout:5/599: unlink d0/d3/d4/d9/d1e/da5/lbb 0 2024-09-13T21:44:48.456 INFO:tasks.workunit.client.1.smithi155.stdout:4/162: write d1/d7/de/d15/f2c [474035,119663] 0 2024-09-13T21:44:48.457 INFO:tasks.workunit.client.0.smithi119.stdout:4/601: write d4/fb5 [604834,46973] 0 2024-09-13T21:44:48.459 INFO:tasks.workunit.client.1.smithi155.stdout:4/163: link d1/d7/de/d15/f2c d1/d7/f30 0 2024-09-13T21:44:48.460 INFO:tasks.workunit.client.0.smithi119.stdout:5/600: unlink d0/d3/d4/cd0 0 2024-09-13T21:44:48.461 INFO:tasks.workunit.client.1.smithi155.stdout:4/164: mknod d1/d7/de/d1a/c31 0 2024-09-13T21:44:48.461 INFO:tasks.workunit.client.0.smithi119.stdout:8/601: dread d1b/d1d/d48/f49 [0,4194304] 0 2024-09-13T21:44:48.461 INFO:tasks.workunit.client.0.smithi119.stdout:9/791: truncate d0/d8/d18/dad/fde 2246431 0 2024-09-13T21:44:48.462 INFO:tasks.workunit.client.1.smithi155.stdout:4/165: chown d1/d7/c17 13 1 2024-09-13T21:44:48.463 INFO:tasks.workunit.client.1.smithi155.stdout:4/166: mkdir d1/d7/de/d15/d32 0 2024-09-13T21:44:48.463 INFO:tasks.workunit.client.1.smithi155.stdout:4/167: dread - d1/f24 zero size 2024-09-13T21:44:48.464 INFO:tasks.workunit.client.0.smithi119.stdout:4/602: truncate d4/d1e/d28/f2a 1214256 0 2024-09-13T21:44:48.465 INFO:tasks.workunit.client.1.smithi155.stdout:4/168: write d1/d7/de/f1f [2323170,103554] 0 2024-09-13T21:44:48.466 INFO:tasks.workunit.client.1.smithi155.stdout:4/169: chown d1/d7/de/dc/d2e 451 1 2024-09-13T21:44:48.468 INFO:tasks.workunit.client.1.smithi155.stdout:4/170: symlink d1/d7/de/d1a/l33 0 2024-09-13T21:44:48.469 INFO:tasks.workunit.client.1.smithi155.stdout:4/171: stat d1/d7/d21/f2b 0 2024-09-13T21:44:48.470 INFO:tasks.workunit.client.1.smithi155.stdout:4/172: write d1/d7/d21/f2a [401429,106742] 0 2024-09-13T21:44:48.471 INFO:tasks.workunit.client.1.smithi155.stdout:4/173: write d1/f1c [2722116,118821] 0 2024-09-13T21:44:48.472 INFO:tasks.workunit.client.0.smithi119.stdout:4/603: unlink d4/d1e/d26/d60/d71/f94 0 2024-09-13T21:44:48.473 INFO:tasks.workunit.client.1.smithi155.stdout:4/174: write d1/f25 [3921557,14547] 0 2024-09-13T21:44:48.474 INFO:tasks.workunit.client.1.smithi155.stdout:4/175: chown d1/d7 15333 1 2024-09-13T21:44:48.475 INFO:tasks.workunit.client.0.smithi119.stdout:9/792: dwrite d0/d8/d18/d23/d27/d2d/d5f/fcf [0,4194304] 0 2024-09-13T21:44:48.475 INFO:tasks.workunit.client.1.smithi155.stdout:4/176: read d1/f27 [760935,96996] 0 2024-09-13T21:44:48.477 INFO:tasks.workunit.client.0.smithi119.stdout:1/608: dread d1/d3/d61/d77/d78/d32/fb9 [0,4194304] 0 2024-09-13T21:44:48.477 INFO:tasks.workunit.client.1.smithi155.stdout:4/177: creat d1/d7/de/dc/d2e/f34 x:0 0 0 2024-09-13T21:44:48.477 INFO:tasks.workunit.client.0.smithi119.stdout:9/793: read d0/f14 [9869678,34567] 0 2024-09-13T21:44:48.477 INFO:tasks.workunit.client.0.smithi119.stdout:1/609: fsync d1/d3/dc/d11/d19/fb7 0 2024-09-13T21:44:48.478 INFO:tasks.workunit.client.0.smithi119.stdout:4/604: fdatasync d4/d1e/d28/f8d 0 2024-09-13T21:44:48.479 INFO:tasks.workunit.client.1.smithi155.stdout:4/178: symlink d1/d7/de/dc/d2e/d26/l35 0 2024-09-13T21:44:48.479 INFO:tasks.workunit.client.0.smithi119.stdout:9/794: fdatasync d0/d8/d18/d23/d27/f2a 0 2024-09-13T21:44:48.480 INFO:tasks.workunit.client.1.smithi155.stdout:4/179: mkdir d1/d7/d21/d2d/d36 0 2024-09-13T21:44:48.482 INFO:tasks.workunit.client.0.smithi119.stdout:9/795: write d0/d8/d18/d23/d27/d2d/d5f/fbf [824844,10581] 0 2024-09-13T21:44:48.483 INFO:tasks.workunit.client.0.smithi119.stdout:1/610: creat d1/d3/dc/d11/d19/d2d/d37/d9b/fc8 x:0 0 0 2024-09-13T21:44:48.483 INFO:tasks.workunit.client.0.smithi119.stdout:4/605: read - d4/d1e/d26/d6d/d7c/f85 zero size 2024-09-13T21:44:48.485 INFO:tasks.workunit.client.0.smithi119.stdout:8/602: dread d1b/d1d/d26/f89 [0,4194304] 0 2024-09-13T21:44:48.486 INFO:tasks.workunit.client.0.smithi119.stdout:1/611: mkdir d1/d3/d61/d77/d78/d32/d33/d72/db4/dc9 0 2024-09-13T21:44:48.487 INFO:tasks.workunit.client.0.smithi119.stdout:4/606: mkdir d4/d1e/d26/d60/d71/d83/dc3 0 2024-09-13T21:44:48.489 INFO:tasks.workunit.client.0.smithi119.stdout:4/607: readlink d4/d1e/d28/l6c 0 2024-09-13T21:44:48.489 INFO:tasks.workunit.client.0.smithi119.stdout:9/796: symlink d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/d60/l10f 0 2024-09-13T21:44:48.491 INFO:tasks.workunit.client.0.smithi119.stdout:9/797: fsync d0/f7 0 2024-09-13T21:44:48.491 INFO:tasks.workunit.client.1.smithi155.stdout:4/180: truncate d1/f4 2813615 0 2024-09-13T21:44:48.491 INFO:tasks.workunit.client.1.smithi155.stdout:4/181: chown d1/d7/de/l14 144828 1 2024-09-13T21:44:48.492 INFO:tasks.workunit.client.0.smithi119.stdout:4/608: creat d4/d1e/d28/d34/fc4 x:0 0 0 2024-09-13T21:44:48.493 INFO:tasks.workunit.client.1.smithi155.stdout:4/182: creat d1/d7/de/d15/f37 x:0 0 0 2024-09-13T21:44:48.494 INFO:tasks.workunit.client.1.smithi155.stdout:5/169: sync 2024-09-13T21:44:48.494 INFO:tasks.workunit.client.1.smithi155.stdout:6/241: sync 2024-09-13T21:44:48.494 INFO:tasks.workunit.client.1.smithi155.stdout:0/249: sync 2024-09-13T21:44:48.494 INFO:tasks.workunit.client.1.smithi155.stdout:8/204: sync 2024-09-13T21:44:48.494 INFO:tasks.workunit.client.0.smithi119.stdout:9/798: creat d0/d8/d18/d23/d42/d52/de1/f110 x:0 0 0 2024-09-13T21:44:48.495 INFO:tasks.workunit.client.1.smithi155.stdout:4/183: unlink d1/c16 0 2024-09-13T21:44:48.496 INFO:tasks.workunit.client.0.smithi119.stdout:8/603: dread d1b/d4e/d71/f98 [0,4194304] 0 2024-09-13T21:44:48.497 INFO:tasks.workunit.client.1.smithi155.stdout:0/250: fsync d1/d6/dc/f2b 0 2024-09-13T21:44:48.497 INFO:tasks.workunit.client.0.smithi119.stdout:4/609: rename d4/d1e/d26/d60/d71/d83/l90 to d4/d1e/d26/d60/dad/lc5 0 2024-09-13T21:44:48.498 INFO:tasks.workunit.client.0.smithi119.stdout:8/604: dread d1b/d1d/d26/d3e/f5d [0,4194304] 0 2024-09-13T21:44:48.499 INFO:tasks.workunit.client.1.smithi155.stdout:6/242: rename db/d11/f38 to db/d12/d1c/d2a/f43 0 2024-09-13T21:44:48.501 INFO:tasks.workunit.client.0.smithi119.stdout:5/601: dread d0/d3/d1f/d21/da1/f57 [0,4194304] 0 2024-09-13T21:44:48.501 INFO:tasks.workunit.client.0.smithi119.stdout:9/799: mkdir d0/d8/d18/d23/d27/d2d/dc1/ddf/d81/d111 0 2024-09-13T21:44:48.505 INFO:tasks.workunit.client.1.smithi155.stdout:6/243: dread db/d11/d2b/d35/f25 [0,4194304] 0 2024-09-13T21:44:48.507 INFO:tasks.workunit.client.0.smithi119.stdout:5/602: rename d0/d3/d4/d2e/d97/lc5 to d0/d3/d1f/d21/ld2 0 2024-09-13T21:44:48.509 INFO:tasks.workunit.client.1.smithi155.stdout:6/244: read db/d11/f14 [79710,75350] 0 2024-09-13T21:44:48.509 INFO:tasks.workunit.client.1.smithi155.stdout:0/251: creat d1/d6/f64 x:0 0 0 2024-09-13T21:44:48.510 INFO:tasks.workunit.client.0.smithi119.stdout:4/610: dwrite d4/d1e/f5c [0,4194304] 0 2024-09-13T21:44:48.510 INFO:tasks.workunit.client.0.smithi119.stdout:1/612: dread d1/d3/d61/d77/d78/f9c [0,4194304] 0 2024-09-13T21:44:48.511 INFO:tasks.workunit.client.1.smithi155.stdout:6/245: chown db/d12/d1c/d36 28167751 1 2024-09-13T21:44:48.511 INFO:tasks.workunit.client.0.smithi119.stdout:1/613: stat d1/d3/f13 0 2024-09-13T21:44:48.511 INFO:tasks.workunit.client.1.smithi155.stdout:5/170: dread d5/fe [0,4194304] 0 2024-09-13T21:44:48.516 INFO:tasks.workunit.client.0.smithi119.stdout:5/603: write d0/d3/f1a [3492592,111970] 0 2024-09-13T21:44:48.516 INFO:tasks.workunit.client.0.smithi119.stdout:4/611: creat d4/d1e/d26/d60/d71/fc6 x:0 0 0 2024-09-13T21:44:48.516 INFO:tasks.workunit.client.0.smithi119.stdout:5/604: write d0/d3/f1a [2731916,11753] 0 2024-09-13T21:44:48.517 INFO:tasks.workunit.client.1.smithi155.stdout:0/252: read d1/d6/dc/f33 [107787,25157] 0 2024-09-13T21:44:48.517 INFO:tasks.workunit.client.1.smithi155.stdout:6/246: mkdir db/d11/d1e/d21/d44 0 2024-09-13T21:44:48.517 INFO:tasks.workunit.client.1.smithi155.stdout:4/184: dwrite d1/f4 [0,4194304] 0 2024-09-13T21:44:48.517 INFO:tasks.workunit.client.1.smithi155.stdout:5/171: symlink d5/l39 0 2024-09-13T21:44:48.519 INFO:tasks.workunit.client.1.smithi155.stdout:4/185: readlink d1/d7/de/l14 0 2024-09-13T21:44:48.519 INFO:tasks.workunit.client.1.smithi155.stdout:5/172: chown d5/l34 6246425 1 2024-09-13T21:44:48.519 INFO:tasks.workunit.client.0.smithi119.stdout:1/614: creat d1/d3/dc/d11/d19/d2d/d37/d9d/fca x:0 0 0 2024-09-13T21:44:48.520 INFO:tasks.workunit.client.0.smithi119.stdout:5/605: symlink d0/d3/ld3 0 2024-09-13T21:44:48.522 INFO:tasks.workunit.client.1.smithi155.stdout:6/247: mknod db/d12/d1c/c45 0 2024-09-13T21:44:48.522 INFO:tasks.workunit.client.0.smithi119.stdout:5/606: write d0/d3/f15 [2909825,21541] 0 2024-09-13T21:44:48.523 INFO:tasks.workunit.client.1.smithi155.stdout:0/253: symlink d1/d6/dc/d4d/d4a/d52/d5b/l65 0 2024-09-13T21:44:48.526 INFO:tasks.workunit.client.1.smithi155.stdout:6/248: mkdir db/d12/d1c/d36/d46 0 2024-09-13T21:44:48.528 INFO:tasks.workunit.client.0.smithi119.stdout:9/800: dread d0/d8/d18/d23/dea/ffd [0,4194304] 0 2024-09-13T21:44:48.530 INFO:tasks.workunit.client.0.smithi119.stdout:5/607: rename d0/d3/d1f/d21/f7f to d0/d3/d4/d9/d1e/da5/fd4 0 2024-09-13T21:44:48.531 INFO:tasks.workunit.client.0.smithi119.stdout:9/801: chown d0/d8/d18/d23/d27/d2d/dc1/ddf/daa/db3/cbe 254548 1 2024-09-13T21:44:48.531 INFO:tasks.workunit.client.1.smithi155.stdout:8/205: dread d2/d8/f10 [8388608,4194304] 0 2024-09-13T21:44:48.531 INFO:tasks.workunit.client.1.smithi155.stdout:0/254: symlink d1/d6/dc/d4d/d4a/d52/d5c/l66 0 2024-09-13T21:44:48.531 INFO:tasks.workunit.client.1.smithi155.stdout:6/249: symlink db/d12/d1c/d36/d37/l47 0 2024-09-13T21:44:48.532 INFO:tasks.workunit.client.0.smithi119.stdout:8/605: dread d1b/d1d/d48/d58/f79 [0,4194304] 0 2024-09-13T21:44:48.534 INFO:tasks.workunit.client.0.smithi119.stdout:5/608: mknod d0/d3/d4/d2e/d97/cd5 0 2024-09-13T21:44:48.534 INFO:tasks.workunit.client.1.smithi155.stdout:4/186: dwrite d1/d7/de/d15/f37 [0,4194304] 0 2024-09-13T21:44:48.536 INFO:tasks.workunit.client.1.smithi155.stdout:5/173: dread d5/fa [0,4194304] 0 2024-09-13T21:44:48.539 INFO:tasks.workunit.client.0.smithi119.stdout:8/606: unlink d1b/d1d/d26/d3e/d65/la0 0 2024-09-13T21:44:48.541 INFO:tasks.workunit.client.1.smithi155.stdout:8/206: link l0 d2/d2d/l3d 0 2024-09-13T21:44:48.542 INFO:tasks.workunit.client.1.smithi155.stdout:0/255: dwrite d1/f34 [0,4194304] 0 2024-09-13T21:44:48.542 INFO:tasks.workunit.client.0.smithi119.stdout:9/802: dwrite d0/d8/d18/d23/d27/d2d/d5f/fbf [0,4194304] 0 2024-09-13T21:44:48.544 INFO:tasks.workunit.client.0.smithi119.stdout:9/803: write d0/d8/d18/d23/f69 [598042,53156] 0 2024-09-13T21:44:48.548 INFO:tasks.workunit.client.0.smithi119.stdout:5/609: mkdir d0/d3/d4/d9/d14/d24/d25/d54/dd6 0 2024-09-13T21:44:48.548 INFO:tasks.workunit.client.1.smithi155.stdout:4/187: getdents d1/d7/d21 0 2024-09-13T21:44:48.549 INFO:tasks.workunit.client.0.smithi119.stdout:5/610: chown d0/d3/c27 55 1 2024-09-13T21:44:48.551 INFO:tasks.workunit.client.0.smithi119.stdout:9/804: mkdir d0/d8/d18/d23/d112 0 2024-09-13T21:44:48.552 INFO:tasks.workunit.client.0.smithi119.stdout:9/805: fsync d0/d19/f6d 0 2024-09-13T21:44:48.552 INFO:tasks.workunit.client.1.smithi155.stdout:0/256: getdents d1/d6/dc/d4d/d4a/d52 0 2024-09-13T21:44:48.553 INFO:tasks.workunit.client.0.smithi119.stdout:1/615: dread d1/d3/dc/d11/d19/d2d/d37/f7f [0,4194304] 0 2024-09-13T21:44:48.554 INFO:tasks.workunit.client.0.smithi119.stdout:5/611: creat d0/d3/d4/d9/d1e/da5/db9/fd7 x:0 0 0 2024-09-13T21:44:48.554 INFO:tasks.workunit.client.1.smithi155.stdout:4/188: link d1/f1c d1/d7/de/d15/d32/f38 0 2024-09-13T21:44:48.555 INFO:tasks.workunit.client.1.smithi155.stdout:0/257: symlink d1/d6/dc/d4d/l67 0 2024-09-13T21:44:48.555 INFO:tasks.workunit.client.0.smithi119.stdout:9/806: fdatasync d0/d8/d18/d23/d27/d2d/d5f/d10e/f64 0 2024-09-13T21:44:48.557 INFO:tasks.workunit.client.1.smithi155.stdout:0/258: write d1/d6/f5f [435705,5016] 0 2024-09-13T21:44:48.561 INFO:tasks.workunit.client.0.smithi119.stdout:9/807: rmdir d0/d8/d18/d23/d112 0 2024-09-13T21:44:48.561 INFO:tasks.workunit.client.0.smithi119.stdout:4/612: dread d4/d1e/d26/f75 [0,4194304] 0 2024-09-13T21:44:48.561 INFO:tasks.workunit.client.1.smithi155.stdout:4/189: rename d1/d7/de/f2f to d1/d7/de/dc/d2e/d26/f39 0 2024-09-13T21:44:48.561 INFO:tasks.workunit.client.0.smithi119.stdout:5/612: dwrite d0/f88 [0,4194304] 0 2024-09-13T21:44:48.563 INFO:tasks.workunit.client.1.smithi155.stdout:5/174: dread d5/f7 [0,4194304] 0 2024-09-13T21:44:48.566 INFO:tasks.workunit.client.1.smithi155.stdout:6/250: dwrite db/f22 [0,4194304] 0 2024-09-13T21:44:48.568 INFO:tasks.workunit.client.1.smithi155.stdout:0/259: dread d1/f39 [0,4194304] 0 2024-09-13T21:44:48.574 INFO:tasks.workunit.client.0.smithi119.stdout:7/656: sync 2024-09-13T21:44:48.575 INFO:tasks.workunit.client.0.smithi119.stdout:4/613: rmdir d4/d1e/d28 39 2024-09-13T21:44:48.576 INFO:tasks.workunit.client.1.smithi155.stdout:6/251: dwrite db/f1f [0,4194304] 0 2024-09-13T21:44:48.580 INFO:tasks.workunit.client.1.smithi155.stdout:4/190: fsync d1/d7/de/d15/d32/f38 0 2024-09-13T21:44:48.581 INFO:tasks.workunit.client.1.smithi155.stdout:4/191: dread - d1/d7/d21/f2b zero size 2024-09-13T21:44:48.581 INFO:tasks.workunit.client.0.smithi119.stdout:9/808: symlink d0/d8/d18/d23/d27/d2d/d70/dda/l113 0 2024-09-13T21:44:48.582 INFO:tasks.workunit.client.1.smithi155.stdout:6/252: rename db/d12/d1c/d2a/f43 to db/d12/d1c/d36/d46/f48 0 2024-09-13T21:44:48.583 INFO:tasks.workunit.client.0.smithi119.stdout:5/613: truncate d0/d3/d4/d9/d14/d24/d25/fcf 1620475 0 2024-09-13T21:44:48.584 INFO:tasks.workunit.client.1.smithi155.stdout:4/192: creat d1/d7/d21/f3a x:0 0 0 2024-09-13T21:44:48.585 INFO:tasks.workunit.client.1.smithi155.stdout:6/253: write db/d12/d1c/d36/d46/f48 [213172,94330] 0 2024-09-13T21:44:48.586 INFO:tasks.workunit.client.0.smithi119.stdout:9/809: creat d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/db9/f114 x:0 0 0 2024-09-13T21:44:48.586 INFO:tasks.workunit.client.0.smithi119.stdout:7/657: dwrite d8/d19/d2e/d34/f3a [4194304,4194304] 0 2024-09-13T21:44:48.586 INFO:tasks.workunit.client.1.smithi155.stdout:4/193: creat d1/f3b x:0 0 0 2024-09-13T21:44:48.587 INFO:tasks.workunit.client.1.smithi155.stdout:7/133: sync 2024-09-13T21:44:48.588 INFO:tasks.workunit.client.0.smithi119.stdout:9/810: truncate d0/d19/f9f 935021 0 2024-09-13T21:44:48.588 INFO:tasks.workunit.client.0.smithi119.stdout:7/658: rmdir d8/d3c/d53/d37 39 2024-09-13T21:44:48.589 INFO:tasks.workunit.client.1.smithi155.stdout:6/254: rename db/d11/c41 to db/d11/d1e/d21/d44/c49 0 2024-09-13T21:44:48.589 INFO:tasks.workunit.client.1.smithi155.stdout:7/134: chown d5/df/f19 9274719 1 2024-09-13T21:44:48.590 INFO:tasks.workunit.client.1.smithi155.stdout:4/194: rmdir d1/d7/de/dc/d2e/d26 39 2024-09-13T21:44:48.590 INFO:tasks.workunit.client.1.smithi155.stdout:7/135: chown d5/fc 5552180 1 2024-09-13T21:44:48.590 INFO:tasks.workunit.client.1.smithi155.stdout:5/175: dread d5/f9 [0,4194304] 0 2024-09-13T21:44:48.591 INFO:tasks.workunit.client.0.smithi119.stdout:9/811: dread - d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/db9/f114 zero size 2024-09-13T21:44:48.591 INFO:tasks.workunit.client.0.smithi119.stdout:7/659: write d8/d3c/d53/f28 [4129865,5598] 0 2024-09-13T21:44:48.591 INFO:tasks.workunit.client.1.smithi155.stdout:6/255: write db/d12/f23 [4659705,127146] 0 2024-09-13T21:44:48.591 INFO:tasks.workunit.client.1.smithi155.stdout:0/260: truncate d1/d6/f2d 1066640 0 2024-09-13T21:44:48.593 INFO:tasks.workunit.client.1.smithi155.stdout:7/136: creat d5/d13/f24 x:0 0 0 2024-09-13T21:44:48.594 INFO:tasks.workunit.client.0.smithi119.stdout:5/614: dwrite d0/d3/d1f/d21/fa9 [0,4194304] 0 2024-09-13T21:44:48.596 INFO:tasks.workunit.client.0.smithi119.stdout:7/660: dread d8/f24 [0,4194304] 0 2024-09-13T21:44:48.596 INFO:tasks.workunit.client.1.smithi155.stdout:6/256: truncate db/d11/f39 573798 0 2024-09-13T21:44:48.597 INFO:tasks.workunit.client.1.smithi155.stdout:5/176: mkdir d5/d16/d33/d1b/d2f/d3a 0 2024-09-13T21:44:48.597 INFO:tasks.workunit.client.1.smithi155.stdout:4/195: rename d1/l11 to d1/d7/de/dc/l3c 0 2024-09-13T21:44:48.598 INFO:tasks.workunit.client.1.smithi155.stdout:4/196: dread - d1/d7/de/dc/d2e/f34 zero size 2024-09-13T21:44:48.599 INFO:tasks.workunit.client.0.smithi119.stdout:5/615: read d0/d3/d4/d2e/f2f [2468153,111356] 0 2024-09-13T21:44:48.599 INFO:tasks.workunit.client.1.smithi155.stdout:7/137: symlink d5/df/d15/l25 0 2024-09-13T21:44:48.599 INFO:tasks.workunit.client.1.smithi155.stdout:6/257: symlink db/d11/d2b/l4a 0 2024-09-13T21:44:48.600 INFO:tasks.workunit.client.1.smithi155.stdout:7/138: chown d5/df/d15/l25 1 1 2024-09-13T21:44:48.600 INFO:tasks.workunit.client.1.smithi155.stdout:5/177: fsync d5/f8 0 2024-09-13T21:44:48.601 INFO:tasks.workunit.client.0.smithi119.stdout:7/661: unlink d8/d3c/d53/d37/d83/ca5 0 2024-09-13T21:44:48.601 INFO:tasks.workunit.client.0.smithi119.stdout:9/812: dwrite d0/d8/d18/d23/d27/d2d/f5d [0,4194304] 0 2024-09-13T21:44:48.605 INFO:tasks.workunit.client.0.smithi119.stdout:7/662: write d8/d3c/d53/d37/d57/f6c [1033961,115484] 0 2024-09-13T21:44:48.607 INFO:tasks.workunit.client.0.smithi119.stdout:5/616: dwrite d0/d3/f1a [4194304,4194304] 0 2024-09-13T21:44:48.607 INFO:tasks.workunit.client.1.smithi155.stdout:0/261: rename d1/f39 to d1/d6/f68 0 2024-09-13T21:44:48.611 INFO:tasks.workunit.client.1.smithi155.stdout:4/197: fsync d1/f3b 0 2024-09-13T21:44:48.612 INFO:tasks.workunit.client.0.smithi119.stdout:9/813: dread d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/d60/fcb [0,4194304] 0 2024-09-13T21:44:48.615 INFO:tasks.workunit.client.0.smithi119.stdout:5/617: dwrite d0/d3/f15 [0,4194304] 0 2024-09-13T21:44:48.616 INFO:tasks.workunit.client.0.smithi119.stdout:9/814: mknod d0/d8/d18/d23/c115 0 2024-09-13T21:44:48.618 INFO:tasks.workunit.client.1.smithi155.stdout:6/258: dwrite f7 [0,4194304] 0 2024-09-13T21:44:48.618 INFO:tasks.workunit.client.1.smithi155.stdout:7/139: dwrite d5/df/f1a [0,4194304] 0 2024-09-13T21:44:48.618 INFO:tasks.workunit.client.0.smithi119.stdout:5/618: symlink d0/d3/d4/d9/d14/ld8 0 2024-09-13T21:44:48.622 INFO:tasks.workunit.client.1.smithi155.stdout:6/259: readlink db/d11/d2b/l4a 0 2024-09-13T21:44:48.625 INFO:tasks.workunit.client.0.smithi119.stdout:9/815: dwrite d0/d8/d18/d23/d27/d2d/d5f/fcf [0,4194304] 0 2024-09-13T21:44:48.625 INFO:tasks.workunit.client.0.smithi119.stdout:5/619: dread d0/d3/d1f/d21/fa9 [0,4194304] 0 2024-09-13T21:44:48.625 INFO:tasks.workunit.client.1.smithi155.stdout:5/178: dwrite d5/d16/f32 [0,4194304] 0 2024-09-13T21:44:48.627 INFO:tasks.workunit.client.0.smithi119.stdout:5/620: creat d0/d3/d1f/d21/da1/fd9 x:0 0 0 2024-09-13T21:44:48.628 INFO:tasks.workunit.client.1.smithi155.stdout:6/260: write db/d12/d1c/d36/d46/f48 [892699,48191] 0 2024-09-13T21:44:48.628 INFO:tasks.workunit.client.1.smithi155.stdout:7/140: write d5/fe [852376,65331] 0 2024-09-13T21:44:48.629 INFO:tasks.workunit.client.0.smithi119.stdout:9/816: creat d0/d8/f116 x:0 0 0 2024-09-13T21:44:48.630 INFO:tasks.workunit.client.1.smithi155.stdout:6/261: write db/d12/f23 [3598929,11473] 0 2024-09-13T21:44:48.631 INFO:tasks.workunit.client.0.smithi119.stdout:5/621: creat d0/d3/d4/d9/d14/d24/d25/d67/fda x:0 0 0 2024-09-13T21:44:48.632 INFO:tasks.workunit.client.0.smithi119.stdout:9/817: rmdir d0/d79/da4 39 2024-09-13T21:44:48.633 INFO:tasks.workunit.client.0.smithi119.stdout:5/622: fdatasync d0/d3/d1f/f5d 0 2024-09-13T21:44:48.634 INFO:tasks.workunit.client.1.smithi155.stdout:6/262: chown db/f22 715541 1 2024-09-13T21:44:48.634 INFO:tasks.workunit.client.1.smithi155.stdout:0/262: dwrite d1/d6/dc/d4d/d4a/d4e/f55 [0,4194304] 0 2024-09-13T21:44:48.636 INFO:tasks.workunit.client.0.smithi119.stdout:9/818: mkdir d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/d117 0 2024-09-13T21:44:48.637 INFO:tasks.workunit.client.0.smithi119.stdout:5/623: stat d0/d3/d4/d9/d14/d24/f5a 0 2024-09-13T21:44:48.638 INFO:tasks.workunit.client.0.smithi119.stdout:9/819: stat d0/d8/d18/d23/d27/d2d/dc1/ddf/d81/d111 0 2024-09-13T21:44:48.639 INFO:tasks.workunit.client.1.smithi155.stdout:6/263: creat db/d11/d1e/d21/d44/f4b x:0 0 0 2024-09-13T21:44:48.639 INFO:tasks.workunit.client.0.smithi119.stdout:9/820: chown d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/d117 18342240 1 2024-09-13T21:44:48.640 INFO:tasks.workunit.client.0.smithi119.stdout:5/624: mknod d0/d3/d4/d9/d14/d24/cdb 0 2024-09-13T21:44:48.643 INFO:tasks.workunit.client.1.smithi155.stdout:6/264: mkdir db/d11/d4c 0 2024-09-13T21:44:48.643 INFO:tasks.workunit.client.0.smithi119.stdout:9/821: creat d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/f118 x:0 0 0 2024-09-13T21:44:48.645 INFO:tasks.workunit.client.1.smithi155.stdout:0/263: read d1/d6/dc/f45 [1153745,74199] 0 2024-09-13T21:44:48.645 INFO:tasks.workunit.client.1.smithi155.stdout:4/198: dwrite d1/f1c [0,4194304] 0 2024-09-13T21:44:48.646 INFO:tasks.workunit.client.0.smithi119.stdout:9/822: stat d0/c11 0 2024-09-13T21:44:48.647 INFO:tasks.workunit.client.1.smithi155.stdout:6/265: creat db/d11/d1e/d21/f4d x:0 0 0 2024-09-13T21:44:48.647 INFO:tasks.workunit.client.1.smithi155.stdout:5/179: dread d5/f13 [0,4194304] 0 2024-09-13T21:44:48.648 INFO:tasks.workunit.client.1.smithi155.stdout:6/266: stat f0 0 2024-09-13T21:44:48.649 INFO:tasks.workunit.client.1.smithi155.stdout:4/199: readlink d1/d7/de/dc/l3c 0 2024-09-13T21:44:48.649 INFO:tasks.workunit.client.1.smithi155.stdout:6/267: dread - db/d11/d1e/d21/d44/f4b zero size 2024-09-13T21:44:48.650 INFO:tasks.workunit.client.1.smithi155.stdout:0/264: rename d1/d6/f3b to d1/d6/dc/d4d/f69 0 2024-09-13T21:44:48.651 INFO:tasks.workunit.client.1.smithi155.stdout:6/268: dread - db/d11/d1e/d21/f4d zero size 2024-09-13T21:44:48.651 INFO:tasks.workunit.client.1.smithi155.stdout:6/269: stat db/d2c/f3b 0 2024-09-13T21:44:48.652 INFO:tasks.workunit.client.0.smithi119.stdout:9/823: fdatasync d0/d19/fd1 0 2024-09-13T21:44:48.658 INFO:tasks.workunit.client.0.smithi119.stdout:9/824: mknod d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/db9/c119 0 2024-09-13T21:44:48.659 INFO:tasks.workunit.client.1.smithi155.stdout:5/180: truncate d5/f8 897006 0 2024-09-13T21:44:48.660 INFO:tasks.workunit.client.0.smithi119.stdout:9/825: write d0/d8/d18/de3/fc8 [324980,45398] 0 2024-09-13T21:44:48.660 INFO:tasks.workunit.client.1.smithi155.stdout:6/270: dread db/d11/d1e/f3e [0,4194304] 0 2024-09-13T21:44:48.660 INFO:tasks.workunit.client.1.smithi155.stdout:0/265: dread d1/d6/f68 [0,4194304] 0 2024-09-13T21:44:48.661 INFO:tasks.workunit.client.1.smithi155.stdout:5/181: chown d5/d16/f2a 3554828 1 2024-09-13T21:44:48.664 INFO:tasks.workunit.client.1.smithi155.stdout:4/200: unlink d1/d7/l9 0 2024-09-13T21:44:48.666 INFO:tasks.workunit.client.1.smithi155.stdout:6/271: symlink db/d2c/l4e 0 2024-09-13T21:44:48.666 INFO:tasks.workunit.client.1.smithi155.stdout:5/182: creat d5/d16/d33/d1b/d22/f3b x:0 0 0 2024-09-13T21:44:48.666 INFO:tasks.workunit.client.1.smithi155.stdout:6/272: fdatasync db/f2f 0 2024-09-13T21:44:48.667 INFO:tasks.workunit.client.1.smithi155.stdout:0/266: chown d1/d6/l2e 16405872 1 2024-09-13T21:44:48.667 INFO:tasks.workunit.client.1.smithi155.stdout:6/273: stat db/l34 0 2024-09-13T21:44:48.668 INFO:tasks.workunit.client.1.smithi155.stdout:0/267: truncate d1/f43 257566 0 2024-09-13T21:44:48.668 INFO:tasks.workunit.client.1.smithi155.stdout:5/183: dread d5/f13 [0,4194304] 0 2024-09-13T21:44:48.669 INFO:tasks.workunit.client.1.smithi155.stdout:4/201: rename d1/d7/de/dc/l3c to d1/d7/l3d 0 2024-09-13T21:44:48.670 INFO:tasks.workunit.client.0.smithi119.stdout:9/826: rename d0/d8/d18/d23/dea/f7d to d0/d79/f11a 0 2024-09-13T21:44:48.670 INFO:tasks.workunit.client.1.smithi155.stdout:6/274: write db/d11/d1e/f3e [2286195,14372] 0 2024-09-13T21:44:48.673 INFO:tasks.workunit.client.0.smithi119.stdout:4/614: dwrite d4/d1e/f78 [0,4194304] 0 2024-09-13T21:44:48.674 INFO:tasks.workunit.client.0.smithi119.stdout:9/827: truncate d0/d8/d18/d23/d27/d2d/d5f/fbf 4871093 0 2024-09-13T21:44:48.675 INFO:tasks.workunit.client.0.smithi119.stdout:4/615: write d4/d1e/d26/d60/f65 [29849,103580] 0 2024-09-13T21:44:48.675 INFO:tasks.workunit.client.1.smithi155.stdout:5/184: rename d5/d16/d33/d1b/d2f/d3a to d5/d16/d33/d1b/d2f/d3c 0 2024-09-13T21:44:48.676 INFO:tasks.workunit.client.1.smithi155.stdout:2/119: sync 2024-09-13T21:44:48.676 INFO:tasks.workunit.client.1.smithi155.stdout:3/266: sync 2024-09-13T21:44:48.679 INFO:tasks.workunit.client.1.smithi155.stdout:0/268: dwrite d1/f29 [4194304,4194304] 0 2024-09-13T21:44:48.679 INFO:tasks.workunit.client.0.smithi119.stdout:9/828: dread d0/d8/d18/d23/d27/d2d/d5f/fbf [0,4194304] 0 2024-09-13T21:44:48.684 INFO:tasks.workunit.client.0.smithi119.stdout:4/616: dread d4/d1e/ff [0,4194304] 0 2024-09-13T21:44:48.684 INFO:tasks.workunit.client.0.smithi119.stdout:9/829: symlink d0/d8/d18/d23/d27/d2d/l11b 0 2024-09-13T21:44:48.686 INFO:tasks.workunit.client.1.smithi155.stdout:0/269: chown d1/f1f 7914 1 2024-09-13T21:44:48.687 INFO:tasks.workunit.client.1.smithi155.stdout:4/202: dwrite d1/d7/d21/f2a [0,4194304] 0 2024-09-13T21:44:48.687 INFO:tasks.workunit.client.1.smithi155.stdout:5/185: truncate d5/d16/d33/d1b/d22/f3b 441711 0 2024-09-13T21:44:48.687 INFO:tasks.workunit.client.0.smithi119.stdout:9/830: rmdir d0/d8/d18/d23/d27/d2d/d5f/da8 39 2024-09-13T21:44:48.689 INFO:tasks.workunit.client.0.smithi119.stdout:9/831: rmdir d0/d8/d18/d23/d27/d2d/dc1/ddf/d81 39 2024-09-13T21:44:48.690 INFO:tasks.workunit.client.1.smithi155.stdout:2/120: creat d2/db/f25 x:0 0 0 2024-09-13T21:44:48.691 INFO:tasks.workunit.client.0.smithi119.stdout:9/832: mknod d0/d19/de4/c11c 0 2024-09-13T21:44:48.692 INFO:tasks.workunit.client.1.smithi155.stdout:3/267: creat d3/d25/f58 x:0 0 0 2024-09-13T21:44:48.694 INFO:tasks.workunit.client.0.smithi119.stdout:9/833: mkdir d0/d8/d18/d23/d42/d11d 0 2024-09-13T21:44:48.695 INFO:tasks.workunit.client.0.smithi119.stdout:9/834: truncate d0/d8/d18/d23/fec 2022992 0 2024-09-13T21:44:48.696 INFO:tasks.workunit.client.1.smithi155.stdout:4/203: symlink d1/l3e 0 2024-09-13T21:44:48.700 INFO:tasks.workunit.client.1.smithi155.stdout:0/270: dread d1/d6/dc/d4d/f3f [0,4194304] 0 2024-09-13T21:44:48.701 INFO:tasks.workunit.client.1.smithi155.stdout:5/186: getdents d5/d26 0 2024-09-13T21:44:48.703 INFO:tasks.workunit.client.1.smithi155.stdout:4/204: truncate d1/d7/de/dc/d2e/d26/f39 3505585 0 2024-09-13T21:44:48.705 INFO:tasks.workunit.client.1.smithi155.stdout:5/187: write d5/f7 [1788196,122068] 0 2024-09-13T21:44:48.709 INFO:tasks.workunit.client.1.smithi155.stdout:4/205: fdatasync d1/d7/f30 0 2024-09-13T21:44:48.711 INFO:tasks.workunit.client.1.smithi155.stdout:7/141: dwrite d5/df/f11 [0,4194304] 0 2024-09-13T21:44:48.712 INFO:tasks.workunit.client.1.smithi155.stdout:0/271: dwrite d1/f22 [0,4194304] 0 2024-09-13T21:44:48.715 INFO:tasks.workunit.client.1.smithi155.stdout:4/206: dread d1/d7/de/f1f [0,4194304] 0 2024-09-13T21:44:48.715 INFO:tasks.workunit.client.1.smithi155.stdout:5/188: rename d5/fc to d5/d16/d33/d1b/d2f/d3c/f3d 0 2024-09-13T21:44:48.720 INFO:tasks.workunit.client.0.smithi119.stdout:5/625: truncate d0/d3/d4/d2e/d65/f81 3127687 0 2024-09-13T21:44:48.724 INFO:tasks.workunit.client.1.smithi155.stdout:6/275: dread db/d12/f1a [0,4194304] 0 2024-09-13T21:44:48.724 INFO:tasks.workunit.client.1.smithi155.stdout:0/272: mkdir d1/d6/dc/d4d/d4a/d52/d5c/d6a 0 2024-09-13T21:44:48.725 INFO:tasks.workunit.client.1.smithi155.stdout:8/207: dread d2/d6/dd/d12/f1b [0,4194304] 0 2024-09-13T21:44:48.726 INFO:tasks.workunit.client.1.smithi155.stdout:1/178: sync 2024-09-13T21:44:48.726 INFO:tasks.workunit.client.1.smithi155.stdout:9/164: sync 2024-09-13T21:44:48.728 INFO:tasks.workunit.client.1.smithi155.stdout:4/207: rename d1/d7/de/c18 to d1/d7/d21/d2d/c3f 0 2024-09-13T21:44:48.729 INFO:tasks.workunit.client.0.smithi119.stdout:8/607: dread d1b/d1d/d48/d58/f74 [4194304,4194304] 0 2024-09-13T21:44:48.733 INFO:tasks.workunit.client.0.smithi119.stdout:4/617: dwrite d4/d1e/f36 [0,4194304] 0 2024-09-13T21:44:48.733 INFO:tasks.workunit.client.1.smithi155.stdout:6/276: dread db/d12/f23 [4194304,4194304] 0 2024-09-13T21:44:48.735 INFO:tasks.workunit.client.1.smithi155.stdout:7/142: symlink d5/l26 0 2024-09-13T21:44:48.736 INFO:tasks.workunit.client.1.smithi155.stdout:1/179: dwrite d6/d15/d3e/d17/f29 [0,4194304] 0 2024-09-13T21:44:48.737 INFO:tasks.workunit.client.1.smithi155.stdout:5/189: mkdir d5/d16/d33/d1b/d1e/d3e 0 2024-09-13T21:44:48.739 INFO:tasks.workunit.client.0.smithi119.stdout:4/618: symlink d4/d1e/d28/lc7 0 2024-09-13T21:44:48.739 INFO:tasks.workunit.client.1.smithi155.stdout:9/165: symlink dc/d19/d23/l3c 0 2024-09-13T21:44:48.742 INFO:tasks.workunit.client.1.smithi155.stdout:6/277: mkdir db/d12/d1c/d36/d37/d4f 0 2024-09-13T21:44:48.746 INFO:tasks.workunit.client.0.smithi119.stdout:2/544: sync 2024-09-13T21:44:48.748 INFO:tasks.workunit.client.0.smithi119.stdout:2/545: symlink d1/d97/lb1 0 2024-09-13T21:44:48.750 INFO:tasks.workunit.client.0.smithi119.stdout:2/546: dread - d1/d22/d55/f5e zero size 2024-09-13T21:44:48.752 INFO:tasks.workunit.client.1.smithi155.stdout:8/208: creat d2/d1f/d39/f3e x:0 0 0 2024-09-13T21:44:48.753 INFO:tasks.workunit.client.1.smithi155.stdout:0/273: dread d1/f19 [0,4194304] 0 2024-09-13T21:44:48.754 INFO:tasks.workunit.client.0.smithi119.stdout:5/626: truncate d0/d3/f11 3594138 0 2024-09-13T21:44:48.755 INFO:tasks.workunit.client.1.smithi155.stdout:1/180: symlink d6/l43 0 2024-09-13T21:44:48.755 INFO:tasks.workunit.client.1.smithi155.stdout:6/278: dwrite db/d2c/f3b [0,4194304] 0 2024-09-13T21:44:48.756 INFO:tasks.workunit.client.1.smithi155.stdout:8/209: write d2/d6/dd/d12/f1e [2354963,3997] 0 2024-09-13T21:44:48.758 INFO:tasks.workunit.client.0.smithi119.stdout:9/835: dwrite d0/d79/f11a [0,4194304] 0 2024-09-13T21:44:48.758 INFO:tasks.workunit.client.0.smithi119.stdout:5/627: creat d0/d3/d4/d9/d1e/da5/db9/fdc x:0 0 0 2024-09-13T21:44:48.760 INFO:tasks.workunit.client.0.smithi119.stdout:9/836: chown d0/d8/d18/d23/d42/d52/d53/c72 697484385 1 2024-09-13T21:44:48.764 INFO:tasks.workunit.client.1.smithi155.stdout:1/181: symlink d6/d15/d3e/l44 0 2024-09-13T21:44:48.766 INFO:tasks.workunit.client.0.smithi119.stdout:9/837: mkdir d0/d8/d18/d23/d42/d52/d53/d11e 0 2024-09-13T21:44:48.768 INFO:tasks.workunit.client.0.smithi119.stdout:5/628: dwrite d0/d3/d4/d9/d1e/da5/db9/fd7 [0,4194304] 0 2024-09-13T21:44:48.770 INFO:tasks.workunit.client.0.smithi119.stdout:5/629: rmdir d0 39 2024-09-13T21:44:48.771 INFO:tasks.workunit.client.1.smithi155.stdout:5/190: getdents d5/d16/d33/d1b/d2f 0 2024-09-13T21:44:48.771 INFO:tasks.workunit.client.1.smithi155.stdout:2/121: dwrite d2/db/f1d [0,4194304] 0 2024-09-13T21:44:48.774 INFO:tasks.workunit.client.0.smithi119.stdout:9/838: creat d0/d8/d18/d23/d27/d2d/d5f/f11f x:0 0 0 2024-09-13T21:44:48.774 INFO:tasks.workunit.client.0.smithi119.stdout:4/619: dread d4/d1e/d26/f2d [0,4194304] 0 2024-09-13T21:44:48.777 INFO:tasks.workunit.client.0.smithi119.stdout:5/630: creat d0/d3/d4/fdd x:0 0 0 2024-09-13T21:44:48.778 INFO:tasks.workunit.client.1.smithi155.stdout:2/122: symlink d2/dd/d21/l26 0 2024-09-13T21:44:48.780 INFO:tasks.workunit.client.0.smithi119.stdout:9/839: symlink d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/d117/l120 0 2024-09-13T21:44:48.780 INFO:tasks.workunit.client.1.smithi155.stdout:3/268: dwrite d3/d25/d1b/d1f/f2e [4194304,4194304] 0 2024-09-13T21:44:48.781 INFO:tasks.workunit.client.0.smithi119.stdout:4/620: link d4/d1e/d26/d6d/f95 d4/d1e/d28/fc8 0 2024-09-13T21:44:48.782 INFO:tasks.workunit.client.1.smithi155.stdout:2/123: stat d2/dd/c11 0 2024-09-13T21:44:48.784 INFO:tasks.workunit.client.1.smithi155.stdout:9/166: dwrite fb [0,4194304] 0 2024-09-13T21:44:48.785 INFO:tasks.workunit.client.1.smithi155.stdout:5/191: write d5/d16/d33/f38 [209972,16166] 0 2024-09-13T21:44:48.788 INFO:tasks.workunit.client.0.smithi119.stdout:2/547: write d1/d22/f4c [292728,92812] 0 2024-09-13T21:44:48.789 INFO:tasks.workunit.client.0.smithi119.stdout:5/631: getdents d0/d3/d1f/d21/d4f/d86 0 2024-09-13T21:44:48.791 INFO:tasks.workunit.client.1.smithi155.stdout:9/167: fsync dc/de/d15/f24 0 2024-09-13T21:44:48.791 INFO:tasks.workunit.client.0.smithi119.stdout:4/621: mkdir d4/d1e/d28/d34/d6a/d79/d9f/dba/dc9 0 2024-09-13T21:44:48.792 INFO:tasks.workunit.client.0.smithi119.stdout:8/608: dwrite d1b/d1d/d26/f3d [0,4194304] 0 2024-09-13T21:44:48.794 INFO:tasks.workunit.client.0.smithi119.stdout:9/840: dwrite d0/d8/fd4 [0,4194304] 0 2024-09-13T21:44:48.794 INFO:tasks.workunit.client.1.smithi155.stdout:0/274: dwrite d1/f35 [0,4194304] 0 2024-09-13T21:44:48.795 INFO:tasks.workunit.client.1.smithi155.stdout:3/269: mkdir d3/d25/d59 0 2024-09-13T21:44:48.795 INFO:tasks.workunit.client.1.smithi155.stdout:2/124: rmdir d2/dd/d21/d23 0 2024-09-13T21:44:48.798 INFO:tasks.workunit.client.0.smithi119.stdout:4/622: mknod d4/d1e/d10/cca 0 2024-09-13T21:44:48.799 INFO:tasks.workunit.client.0.smithi119.stdout:8/609: dread - d1b/d4e/d71/f75 zero size 2024-09-13T21:44:48.802 INFO:tasks.workunit.client.1.smithi155.stdout:4/208: dwrite d1/d7/de/dc/d2e/d26/f39 [0,4194304] 0 2024-09-13T21:44:48.802 INFO:tasks.workunit.client.1.smithi155.stdout:0/275: write d1/f34 [7271501,2925] 0 2024-09-13T21:44:48.806 INFO:tasks.workunit.client.0.smithi119.stdout:2/548: dwrite d1/d22/d7c/f98 [0,4194304] 0 2024-09-13T21:44:48.808 INFO:tasks.workunit.client.1.smithi155.stdout:5/192: dread d5/d16/d33/d1b/d22/f3b [0,4194304] 0 2024-09-13T21:44:48.809 INFO:tasks.workunit.client.1.smithi155.stdout:5/193: fdatasync d5/d16/f32 0 2024-09-13T21:44:48.817 INFO:tasks.workunit.client.1.smithi155.stdout:3/270: mknod d3/d25/d1b/d1f/d36/c5a 0 2024-09-13T21:44:48.820 INFO:tasks.workunit.client.1.smithi155.stdout:5/194: stat d5/d16/d33/d1b/l2b 0 2024-09-13T21:44:48.824 INFO:tasks.workunit.client.1.smithi155.stdout:9/168: dwrite dc/d18/d1e/f34 [0,4194304] 0 2024-09-13T21:44:48.827 INFO:tasks.workunit.client.1.smithi155.stdout:1/182: write d6/d7/f2f [1002709,63185] 0 2024-09-13T21:44:48.827 INFO:tasks.workunit.client.1.smithi155.stdout:4/209: dwrite d1/d7/d21/f2b [0,4194304] 0 2024-09-13T21:44:48.827 INFO:tasks.workunit.client.1.smithi155.stdout:2/125: creat d2/db/f27 x:0 0 0 2024-09-13T21:44:48.829 INFO:tasks.workunit.client.1.smithi155.stdout:9/169: dread - dc/de/d15/f1c zero size 2024-09-13T21:44:48.830 INFO:tasks.workunit.client.1.smithi155.stdout:3/271: rmdir d3/d25/d59 0 2024-09-13T21:44:48.831 INFO:tasks.workunit.client.1.smithi155.stdout:9/170: readlink dc/d18/l33 0 2024-09-13T21:44:48.833 INFO:tasks.workunit.client.1.smithi155.stdout:1/183: rmdir d6/d15/d3e/d17 39 2024-09-13T21:44:48.834 INFO:tasks.workunit.client.1.smithi155.stdout:6/279: dwrite db/d11/d2b/d35/f25 [0,4194304] 0 2024-09-13T21:44:48.834 INFO:tasks.workunit.client.1.smithi155.stdout:5/195: rmdir d5/d16/d33/d1b/d1e/d3e 0 2024-09-13T21:44:48.834 INFO:tasks.workunit.client.1.smithi155.stdout:4/210: chown d1/d7/d21/f2a 55 1 2024-09-13T21:44:48.837 INFO:tasks.workunit.client.1.smithi155.stdout:3/272: creat d3/d25/d17/f5b x:0 0 0 2024-09-13T21:44:48.838 INFO:tasks.workunit.client.1.smithi155.stdout:1/184: creat d6/d15/f45 x:0 0 0 2024-09-13T21:44:48.839 INFO:tasks.workunit.client.1.smithi155.stdout:6/280: fsync db/d12/d1c/d36/f3c 0 2024-09-13T21:44:48.840 INFO:tasks.workunit.client.1.smithi155.stdout:3/273: stat d3/d25/d1b/l43 0 2024-09-13T21:44:48.844 INFO:tasks.workunit.client.1.smithi155.stdout:3/274: dread - d3/d25/d17/d3b/f50 zero size 2024-09-13T21:44:48.847 INFO:tasks.workunit.client.1.smithi155.stdout:1/185: creat d6/d15/d3e/d17/d30/f46 x:0 0 0 2024-09-13T21:44:48.848 INFO:tasks.workunit.client.1.smithi155.stdout:9/171: dread dc/d18/d1e/f34 [0,4194304] 0 2024-09-13T21:44:48.849 INFO:tasks.workunit.client.1.smithi155.stdout:3/275: fsync d3/d25/d1b/d1f/f49 0 2024-09-13T21:44:48.851 INFO:tasks.workunit.client.1.smithi155.stdout:1/186: chown d6/d15/c38 32692 1 2024-09-13T21:44:48.852 INFO:tasks.workunit.client.1.smithi155.stdout:9/172: creat dc/d18/f3d x:0 0 0 2024-09-13T21:44:48.853 INFO:tasks.workunit.client.1.smithi155.stdout:3/276: rmdir d3 39 2024-09-13T21:44:48.856 INFO:tasks.workunit.client.1.smithi155.stdout:1/187: mknod d6/d15/d3e/c47 0 2024-09-13T21:44:48.857 INFO:tasks.workunit.client.1.smithi155.stdout:9/173: rename dc/ld to dc/d19/d23/l3e 0 2024-09-13T21:44:48.858 INFO:tasks.workunit.client.1.smithi155.stdout:3/277: mkdir d3/d25/d1b/d1f/d36/d5c 0 2024-09-13T21:44:48.858 INFO:tasks.workunit.client.1.smithi155.stdout:1/188: mkdir d6/d7/d48 0 2024-09-13T21:44:48.863 INFO:tasks.workunit.client.1.smithi155.stdout:3/278: dread d3/d21/d2c/f48 [0,4194304] 0 2024-09-13T21:44:48.869 INFO:tasks.workunit.client.1.smithi155.stdout:2/126: dread d2/db/f16 [0,4194304] 0 2024-09-13T21:44:48.870 INFO:tasks.workunit.client.1.smithi155.stdout:6/281: dread db/d12/d1c/d36/f3c [0,4194304] 0 2024-09-13T21:44:48.871 INFO:tasks.workunit.client.1.smithi155.stdout:6/282: fsync db/d12/d1c/d36/f3c 0 2024-09-13T21:44:48.875 INFO:tasks.workunit.client.1.smithi155.stdout:6/283: dwrite db/d12/f17 [0,4194304] 0 2024-09-13T21:44:48.887 INFO:tasks.workunit.client.1.smithi155.stdout:0/276: dread d1/d6/dc/fe [0,4194304] 0 2024-09-13T21:44:48.888 INFO:tasks.workunit.client.1.smithi155.stdout:0/277: fsync d1/d6/dc/d4d/d4a/d4e/f55 0 2024-09-13T21:44:48.891 INFO:tasks.workunit.client.0.smithi119.stdout:9/841: creat d0/d8/d18/d23/d27/d2d/dc1/ddf/daa/f121 x:0 0 0 2024-09-13T21:44:48.893 INFO:tasks.workunit.client.0.smithi119.stdout:9/842: write d0/d8/d18/d23/d27/d2d/dc1/ddf/ff2 [926038,36072] 0 2024-09-13T21:44:48.894 INFO:tasks.workunit.client.1.smithi155.stdout:1/189: rename d6/d15/d3e/d17/d30/f3b to d6/f49 0 2024-09-13T21:44:48.895 INFO:tasks.workunit.client.0.smithi119.stdout:8/610: creat d1b/d1d/d48/fbf x:0 0 0 2024-09-13T21:44:48.895 INFO:tasks.workunit.client.1.smithi155.stdout:3/279: dread - d3/d10/f46 zero size 2024-09-13T21:44:48.896 INFO:tasks.workunit.client.1.smithi155.stdout:1/190: truncate d6/d15/d3e/d17/f21 862585 0 2024-09-13T21:44:48.896 INFO:tasks.workunit.client.1.smithi155.stdout:2/127: rmdir d2/dd/de 39 2024-09-13T21:44:48.896 INFO:tasks.workunit.client.0.smithi119.stdout:8/611: chown d1b/d4e/d71/dac 11281 1 2024-09-13T21:44:48.897 INFO:tasks.workunit.client.1.smithi155.stdout:1/191: fsync d6/d15/d3e/d17/f29 0 2024-09-13T21:44:48.897 INFO:tasks.workunit.client.0.smithi119.stdout:2/549: rmdir d1/daf 0 2024-09-13T21:44:48.897 INFO:tasks.workunit.client.0.smithi119.stdout:8/612: read - d1b/d1d/d26/fab zero size 2024-09-13T21:44:48.897 INFO:tasks.workunit.client.1.smithi155.stdout:1/192: chown d6/fa 225 1 2024-09-13T21:44:48.898 INFO:tasks.workunit.client.0.smithi119.stdout:8/613: truncate d1b/d1d/f80 1429758 0 2024-09-13T21:44:48.900 INFO:tasks.workunit.client.0.smithi119.stdout:9/843: link d0/d8/d18/d23/d27/d2d/d70/l83 d0/d8/d18/d23/d27/d2d/d5f/ded/dee/l122 0 2024-09-13T21:44:48.900 INFO:tasks.workunit.client.0.smithi119.stdout:2/550: dread d1/d22/d7c/f98 [0,4194304] 0 2024-09-13T21:44:48.902 INFO:tasks.workunit.client.0.smithi119.stdout:8/614: creat d1b/d1d/d26/d3e/fc0 x:0 0 0 2024-09-13T21:44:48.902 INFO:tasks.workunit.client.0.smithi119.stdout:4/623: write d4/d1e/d10/f46 [2129987,55661] 0 2024-09-13T21:44:48.903 INFO:tasks.workunit.client.0.smithi119.stdout:2/551: mknod d1/d22/d5a/d5d/cb2 0 2024-09-13T21:44:48.904 INFO:tasks.workunit.client.0.smithi119.stdout:4/624: chown d4/d1e/d28/d34/d6a/d79/ca3 48617 1 2024-09-13T21:44:48.904 INFO:tasks.workunit.client.0.smithi119.stdout:9/844: mkdir d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/db9/d123 0 2024-09-13T21:44:48.906 INFO:tasks.workunit.client.1.smithi155.stdout:0/278: creat d1/d6/dc/d4d/d4a/d4e/d61/f6b x:0 0 0 2024-09-13T21:44:48.906 INFO:tasks.workunit.client.0.smithi119.stdout:8/615: write d1b/d1d/d26/d6b/f87 [1535210,113866] 0 2024-09-13T21:44:48.906 INFO:tasks.workunit.client.0.smithi119.stdout:2/552: fdatasync d1/d22/d5a/d5d/f92 0 2024-09-13T21:44:48.908 INFO:tasks.workunit.client.0.smithi119.stdout:9/845: chown d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/f103 728 1 2024-09-13T21:44:48.909 INFO:tasks.workunit.client.1.smithi155.stdout:3/280: creat d3/d25/d1b/d1f/d36/f5d x:0 0 0 2024-09-13T21:44:48.910 INFO:tasks.workunit.client.1.smithi155.stdout:0/279: dread d1/d6/f68 [0,4194304] 0 2024-09-13T21:44:48.914 INFO:tasks.workunit.client.0.smithi119.stdout:2/553: creat d1/d22/d5a/d5d/d77/daa/fb3 x:0 0 0 2024-09-13T21:44:48.914 INFO:tasks.workunit.client.0.smithi119.stdout:8/616: dwrite d1b/d1d/d48/fbf [0,4194304] 0 2024-09-13T21:44:48.916 INFO:tasks.workunit.client.0.smithi119.stdout:9/846: mkdir d0/d8/d18/d124 0 2024-09-13T21:44:48.917 INFO:tasks.workunit.client.0.smithi119.stdout:2/554: write d1/d7/d47/fa3 [204812,60548] 0 2024-09-13T21:44:48.918 INFO:tasks.workunit.client.0.smithi119.stdout:8/617: symlink d1b/d4e/d71/lc1 0 2024-09-13T21:44:48.918 INFO:tasks.workunit.client.0.smithi119.stdout:9/847: write d0/d8/d18/de3/fca [1172189,90597] 0 2024-09-13T21:44:48.920 INFO:tasks.workunit.client.0.smithi119.stdout:2/555: mknod d1/d9d/cb4 0 2024-09-13T21:44:48.922 INFO:tasks.workunit.client.0.smithi119.stdout:4/625: dread d4/d1e/d26/d6d/fab [0,4194304] 0 2024-09-13T21:44:48.924 INFO:tasks.workunit.client.0.smithi119.stdout:4/626: chown d4/d1e/d10 9356059 1 2024-09-13T21:44:48.926 INFO:tasks.workunit.client.0.smithi119.stdout:2/556: fsync d1/d22/d55/d64/fa1 0 2024-09-13T21:44:48.928 INFO:tasks.workunit.client.0.smithi119.stdout:9/848: dread d0/d8/d18/d23/dea/ffd [0,4194304] 0 2024-09-13T21:44:48.928 INFO:tasks.workunit.client.0.smithi119.stdout:8/618: dwrite d1b/d1d/d26/f81 [0,4194304] 0 2024-09-13T21:44:48.930 INFO:tasks.workunit.client.0.smithi119.stdout:9/849: stat d0/d8/d18/d23/dea 0 2024-09-13T21:44:48.931 INFO:tasks.workunit.client.0.smithi119.stdout:4/627: rename d4/d1e/lc to d4/d1e/d28/d34/d6a/d79/dae/lcb 0 2024-09-13T21:44:48.933 INFO:tasks.workunit.client.0.smithi119.stdout:8/619: creat d1b/d1d/d5e/fc2 x:0 0 0 2024-09-13T21:44:48.935 INFO:tasks.workunit.client.0.smithi119.stdout:2/557: dwrite d1/d22/d5a/f81 [0,4194304] 0 2024-09-13T21:44:48.940 INFO:tasks.workunit.client.0.smithi119.stdout:9/850: dwrite d0/d8/d18/f90 [0,4194304] 0 2024-09-13T21:44:48.943 INFO:tasks.workunit.client.0.smithi119.stdout:8/620: rename d1b/d4e/d99 to d1b/d1d/dc3 0 2024-09-13T21:44:48.945 INFO:tasks.workunit.client.0.smithi119.stdout:8/621: chown d1b/d1d/d48 609 1 2024-09-13T21:44:48.946 INFO:tasks.workunit.client.0.smithi119.stdout:2/558: rmdir d1/d22/d7c/d95 0 2024-09-13T21:44:48.947 INFO:tasks.workunit.client.0.smithi119.stdout:8/622: write f13 [8899849,125552] 0 2024-09-13T21:44:48.949 INFO:tasks.workunit.client.0.smithi119.stdout:2/559: stat d1/d7/d47/fa3 0 2024-09-13T21:44:48.951 INFO:tasks.workunit.client.0.smithi119.stdout:4/628: dread d4/d1e/d26/d6d/f91 [0,4194304] 0 2024-09-13T21:44:48.952 INFO:tasks.workunit.client.0.smithi119.stdout:9/851: truncate d0/d8/d18/dad/fde 1311762 0 2024-09-13T21:44:48.953 INFO:tasks.workunit.client.0.smithi119.stdout:4/629: stat d4/d1e/d28/f24 0 2024-09-13T21:44:48.955 INFO:tasks.workunit.client.0.smithi119.stdout:8/623: getdents d1b/d1d/d5e 0 2024-09-13T21:44:48.957 INFO:tasks.workunit.client.0.smithi119.stdout:2/560: dwrite d1/f3d [0,4194304] 0 2024-09-13T21:44:48.957 INFO:tasks.workunit.client.0.smithi119.stdout:8/624: unlink d1b/d4e/f67 0 2024-09-13T21:44:48.959 INFO:tasks.workunit.client.0.smithi119.stdout:8/625: write d1b/d1d/d39/f44 [4557265,80989] 0 2024-09-13T21:44:48.962 INFO:tasks.workunit.client.0.smithi119.stdout:9/852: rename d0/d8/d18/d23/f51 to d0/d8/d18/d23/d42/d52/de1/f125 0 2024-09-13T21:44:48.963 INFO:tasks.workunit.client.0.smithi119.stdout:8/626: write d1b/d1d/d48/d58/d7f/f82 [261298,105385] 0 2024-09-13T21:44:48.969 INFO:tasks.workunit.client.0.smithi119.stdout:9/853: mkdir d0/d8/d18/d23/dea/d126 0 2024-09-13T21:44:48.969 INFO:tasks.workunit.client.0.smithi119.stdout:0/573: sync 2024-09-13T21:44:48.970 INFO:tasks.workunit.client.0.smithi119.stdout:3/539: sync 2024-09-13T21:44:48.970 INFO:tasks.workunit.client.0.smithi119.stdout:6/533: sync 2024-09-13T21:44:48.970 INFO:tasks.workunit.client.0.smithi119.stdout:1/616: sync 2024-09-13T21:44:48.972 INFO:tasks.workunit.client.0.smithi119.stdout:4/630: dwrite d4/d1e/d26/d60/f64 [0,4194304] 0 2024-09-13T21:44:48.973 INFO:tasks.workunit.client.0.smithi119.stdout:2/561: rename d1/f50 to d1/d22/d5a/d5d/d77/fb5 0 2024-09-13T21:44:48.974 INFO:tasks.workunit.client.0.smithi119.stdout:8/627: symlink d1b/d1d/d48/lc4 0 2024-09-13T21:44:48.977 INFO:tasks.workunit.client.0.smithi119.stdout:6/534: write dc/f36 [2689881,123134] 0 2024-09-13T21:44:48.979 INFO:tasks.workunit.client.0.smithi119.stdout:6/535: write dc/f1e [7425670,77142] 0 2024-09-13T21:44:48.979 INFO:tasks.workunit.client.0.smithi119.stdout:3/540: creat d6/d25/d2f/d8e/fb3 x:0 0 0 2024-09-13T21:44:48.980 INFO:tasks.workunit.client.0.smithi119.stdout:0/574: dwrite de/d49/f4f [0,4194304] 0 2024-09-13T21:44:48.982 INFO:tasks.workunit.client.0.smithi119.stdout:2/562: fdatasync d1/d22/d5a/f63 0 2024-09-13T21:44:48.983 INFO:tasks.workunit.client.0.smithi119.stdout:0/575: truncate de/d1c/d2f/d40/f99 1613301 0 2024-09-13T21:44:48.989 INFO:tasks.workunit.client.0.smithi119.stdout:9/854: creat d0/d8/d18/f127 x:0 0 0 2024-09-13T21:44:48.989 INFO:tasks.workunit.client.0.smithi119.stdout:2/563: dwrite d1/d7/f11 [0,4194304] 0 2024-09-13T21:44:48.992 INFO:tasks.workunit.client.0.smithi119.stdout:8/628: write d1b/d1d/d48/f72 [101246,130473] 0 2024-09-13T21:44:48.994 INFO:tasks.workunit.client.0.smithi119.stdout:4/631: unlink d4/d1e/d26/d60/f64 0 2024-09-13T21:44:48.995 INFO:tasks.workunit.client.0.smithi119.stdout:2/564: read d1/d38/d89/f4e [2451812,34792] 0 2024-09-13T21:44:48.998 INFO:tasks.workunit.client.0.smithi119.stdout:0/576: mkdir de/d1c/d2f/d35/dce 0 2024-09-13T21:44:48.998 INFO:tasks.workunit.client.0.smithi119.stdout:9/855: truncate d0/d8/d18/d23/dea/f8f 351040 0 2024-09-13T21:44:48.999 INFO:tasks.workunit.client.0.smithi119.stdout:6/536: creat dc/d4b/fab x:0 0 0 2024-09-13T21:44:49.000 INFO:tasks.workunit.client.0.smithi119.stdout:6/537: chown dc/l3b 1035 1 2024-09-13T21:44:49.001 INFO:tasks.workunit.client.0.smithi119.stdout:3/541: getdents d6/d15/d8f 0 2024-09-13T21:44:49.005 INFO:tasks.workunit.client.0.smithi119.stdout:9/856: fdatasync d0/d8/d18/d23/d27/d2d/d5f/fbf 0 2024-09-13T21:44:49.006 INFO:tasks.workunit.client.0.smithi119.stdout:3/542: write d6/d25/d2f/f39 [3410270,121902] 0 2024-09-13T21:44:49.006 INFO:tasks.workunit.client.0.smithi119.stdout:2/565: mkdir d1/d22/db6 0 2024-09-13T21:44:49.012 INFO:tasks.workunit.client.0.smithi119.stdout:4/632: dwrite d4/d1e/f50 [0,4194304] 0 2024-09-13T21:44:49.014 INFO:tasks.workunit.client.1.smithi155.stdout:6/284: rename db/d12/l19 to db/l50 0 2024-09-13T21:44:49.015 INFO:tasks.workunit.client.1.smithi155.stdout:5/196: truncate d5/f1c 118349 0 2024-09-13T21:44:49.015 INFO:tasks.workunit.client.1.smithi155.stdout:6/285: stat db/f2f 0 2024-09-13T21:44:49.016 INFO:tasks.workunit.client.0.smithi119.stdout:6/538: dwrite dc/d3d/d40/f58 [0,4194304] 0 2024-09-13T21:44:49.016 INFO:tasks.workunit.client.1.smithi155.stdout:4/211: truncate d1/d7/d21/f2a 1147765 0 2024-09-13T21:44:49.017 INFO:tasks.workunit.client.0.smithi119.stdout:3/543: symlink d6/d25/d2f/d33/d56/da0/lb4 0 2024-09-13T21:44:49.018 INFO:tasks.workunit.client.0.smithi119.stdout:8/629: dread d1b/d4e/f53 [0,4194304] 0 2024-09-13T21:44:49.019 INFO:tasks.workunit.client.1.smithi155.stdout:6/286: chown db/d2c/l4e 7246 1 2024-09-13T21:44:49.019 INFO:tasks.workunit.client.1.smithi155.stdout:4/212: chown d1/f25 104 1 2024-09-13T21:44:49.019 INFO:tasks.workunit.client.1.smithi155.stdout:0/280: dwrite d1/d6/dc/d4d/d4a/f4b [0,4194304] 0 2024-09-13T21:44:49.020 INFO:tasks.workunit.client.1.smithi155.stdout:3/281: creat d3/d25/f5e x:0 0 0 2024-09-13T21:44:49.020 INFO:tasks.workunit.client.0.smithi119.stdout:2/566: truncate d1/d38/fa2 1781273 0 2024-09-13T21:44:49.021 INFO:tasks.workunit.client.1.smithi155.stdout:6/287: chown db/d12/d1c/c45 202979413 1 2024-09-13T21:44:49.023 INFO:tasks.workunit.client.1.smithi155.stdout:5/197: mknod d5/d16/d33/d1b/d1e/c3f 0 2024-09-13T21:44:49.023 INFO:tasks.workunit.client.0.smithi119.stdout:8/630: read d1b/d4e/f53 [2946737,61432] 0 2024-09-13T21:44:49.024 INFO:tasks.workunit.client.1.smithi155.stdout:1/193: link d6/d7/f8 d6/d15/d3e/f4a 0 2024-09-13T21:44:49.025 INFO:tasks.workunit.client.1.smithi155.stdout:4/213: write d1/d7/de/dc/d2e/f34 [519319,99096] 0 2024-09-13T21:44:49.025 INFO:tasks.workunit.client.0.smithi119.stdout:2/567: read - d1/d97/f9c zero size 2024-09-13T21:44:49.027 INFO:tasks.workunit.client.0.smithi119.stdout:0/577: dwrite de/d4e/f6e [0,4194304] 0 2024-09-13T21:44:49.029 INFO:tasks.workunit.client.1.smithi155.stdout:0/281: creat d1/d6/dc/f6c x:0 0 0 2024-09-13T21:44:49.030 INFO:tasks.workunit.client.0.smithi119.stdout:8/631: chown d1b/d1d/d48/fbf 405 1 2024-09-13T21:44:49.031 INFO:tasks.workunit.client.1.smithi155.stdout:9/174: dread dc/d18/d1e/f22 [0,4194304] 0 2024-09-13T21:44:49.031 INFO:tasks.workunit.client.0.smithi119.stdout:4/633: rename d4/d1e/d26/d60/d71/d83/f49 to d4/d1e/d28/d5d/fcc 0 2024-09-13T21:44:49.034 INFO:tasks.workunit.client.1.smithi155.stdout:0/282: truncate d1/d6/dc/d4d/f59 406248 0 2024-09-13T21:44:49.035 INFO:tasks.workunit.client.0.smithi119.stdout:9/857: dwrite d0/d8/d18/d23/dea/fb7 [0,4194304] 0 2024-09-13T21:44:49.035 INFO:tasks.workunit.client.1.smithi155.stdout:5/198: truncate d5/d16/f18 433197 0 2024-09-13T21:44:49.036 INFO:tasks.workunit.client.1.smithi155.stdout:3/282: dwrite d3/d25/f58 [0,4194304] 0 2024-09-13T21:44:49.037 INFO:tasks.workunit.client.1.smithi155.stdout:1/194: write d6/f49 [465011,70290] 0 2024-09-13T21:44:49.037 INFO:tasks.workunit.client.1.smithi155.stdout:6/288: creat db/d11/d4c/f51 x:0 0 0 2024-09-13T21:44:49.040 INFO:tasks.workunit.client.0.smithi119.stdout:6/539: dwrite dc/df/d41/fa5 [0,4194304] 0 2024-09-13T21:44:49.040 INFO:tasks.workunit.client.0.smithi119.stdout:2/568: read d1/d38/f69 [150179,3921] 0 2024-09-13T21:44:49.044 INFO:tasks.workunit.client.1.smithi155.stdout:9/175: mknod dc/d18/c3f 0 2024-09-13T21:44:49.044 INFO:tasks.workunit.client.0.smithi119.stdout:0/578: dwrite de/d1c/d2f/f43 [0,4194304] 0 2024-09-13T21:44:49.044 INFO:tasks.workunit.client.1.smithi155.stdout:1/195: dread d6/f36 [4194304,4194304] 0 2024-09-13T21:44:49.045 INFO:tasks.workunit.client.1.smithi155.stdout:4/214: fdatasync d1/d7/de/dc/d2e/f34 0 2024-09-13T21:44:49.046 INFO:tasks.workunit.client.0.smithi119.stdout:9/858: mkdir d0/d8/d18/d23/d27/d2d/dc1/ddf/d81/d128 0 2024-09-13T21:44:49.046 INFO:tasks.workunit.client.1.smithi155.stdout:6/289: rmdir db/d11/d2b 39 2024-09-13T21:44:49.048 INFO:tasks.workunit.client.0.smithi119.stdout:0/579: chown de/d1c/d9c/ca0 1158051 1 2024-09-13T21:44:49.049 INFO:tasks.workunit.client.1.smithi155.stdout:0/283: creat d1/d6/dc/d4d/d4a/d52/f6d x:0 0 0 2024-09-13T21:44:49.050 INFO:tasks.workunit.client.0.smithi119.stdout:8/632: dwrite d1b/d4e/d71/f98 [0,4194304] 0 2024-09-13T21:44:49.051 INFO:tasks.workunit.client.0.smithi119.stdout:2/569: mkdir d1/d22/d5a/d5d/db7 0 2024-09-13T21:44:49.052 INFO:tasks.workunit.client.0.smithi119.stdout:0/580: creat de/d3c/fcf x:0 0 0 2024-09-13T21:44:49.055 INFO:tasks.workunit.client.0.smithi119.stdout:0/581: rmdir de/d3c/d7c 39 2024-09-13T21:44:49.056 INFO:tasks.workunit.client.1.smithi155.stdout:3/283: dwrite d3/d25/d1b/f4e [4194304,4194304] 0 2024-09-13T21:44:49.056 INFO:tasks.workunit.client.1.smithi155.stdout:1/196: mkdir d6/d15/d3e/d17/d30/d4b 0 2024-09-13T21:44:49.057 INFO:tasks.workunit.client.0.smithi119.stdout:6/540: link dc/d3d/d40/d6b/f70 dc/df/fac 0 2024-09-13T21:44:49.057 INFO:tasks.workunit.client.1.smithi155.stdout:9/176: readlink dc/d19/d23/l2a 0 2024-09-13T21:44:49.058 INFO:tasks.workunit.client.0.smithi119.stdout:8/633: symlink d1b/d1d/d48/db2/lc5 0 2024-09-13T21:44:49.060 INFO:tasks.workunit.client.0.smithi119.stdout:2/570: creat d1/d22/fb8 x:0 0 0 2024-09-13T21:44:49.063 INFO:tasks.workunit.client.0.smithi119.stdout:0/582: getdents de/d1c/d64 0 2024-09-13T21:44:49.063 INFO:tasks.workunit.client.1.smithi155.stdout:0/284: read d1/d6/dc/f2b [487321,24865] 0 2024-09-13T21:44:49.064 INFO:tasks.workunit.client.1.smithi155.stdout:1/197: creat d6/d15/f4c x:0 0 0 2024-09-13T21:44:49.064 INFO:tasks.workunit.client.0.smithi119.stdout:0/583: creat de/d4e/fd0 x:0 0 0 2024-09-13T21:44:49.066 INFO:tasks.workunit.client.1.smithi155.stdout:1/198: chown d6/d7/f1a 8193275 1 2024-09-13T21:44:49.067 INFO:tasks.workunit.client.1.smithi155.stdout:3/284: mknod d3/d25/c5f 0 2024-09-13T21:44:49.068 INFO:tasks.workunit.client.1.smithi155.stdout:4/215: rmdir d1/d7/d21/d2d/d36 0 2024-09-13T21:44:49.068 INFO:tasks.workunit.client.0.smithi119.stdout:0/584: rename de/d1c/d2b/d76/d9b/da1/caf to de/d4e/cd1 0 2024-09-13T21:44:49.071 INFO:tasks.workunit.client.1.smithi155.stdout:9/177: link dc/d18/d1e/f34 dc/de/d2d/f40 0 2024-09-13T21:44:49.074 INFO:tasks.workunit.client.0.smithi119.stdout:0/585: dread de/d1c/d2f/d35/f67 [0,4194304] 0 2024-09-13T21:44:49.075 INFO:tasks.workunit.client.1.smithi155.stdout:0/285: creat d1/f6e x:0 0 0 2024-09-13T21:44:49.075 INFO:tasks.workunit.client.1.smithi155.stdout:9/178: truncate dc/de/d15/f1c 540579 0 2024-09-13T21:44:49.077 INFO:tasks.workunit.client.0.smithi119.stdout:0/586: link de/f22 de/d1c/d52/fd2 0 2024-09-13T21:44:49.077 INFO:tasks.workunit.client.1.smithi155.stdout:9/179: readlink dc/de/l27 0 2024-09-13T21:44:49.078 INFO:tasks.workunit.client.0.smithi119.stdout:0/587: mknod de/d1c/d2b/d34/cd3 0 2024-09-13T21:44:49.079 INFO:tasks.workunit.client.1.smithi155.stdout:1/199: dwrite d6/f32 [0,4194304] 0 2024-09-13T21:44:49.081 INFO:tasks.workunit.client.1.smithi155.stdout:3/285: dwrite d3/d25/d1b/d1f/f30 [4194304,4194304] 0 2024-09-13T21:44:49.081 INFO:tasks.workunit.client.1.smithi155.stdout:0/286: unlink d1/d6/dc/d4d/f69 0 2024-09-13T21:44:49.081 INFO:tasks.workunit.client.0.smithi119.stdout:0/588: creat de/fd4 x:0 0 0 2024-09-13T21:44:49.082 INFO:tasks.workunit.client.1.smithi155.stdout:3/286: stat d3/d25/d1b/d1f/f49 0 2024-09-13T21:44:49.082 INFO:tasks.workunit.client.0.smithi119.stdout:0/589: mknod de/d1c/d2b/d34/cd5 0 2024-09-13T21:44:49.083 INFO:tasks.workunit.client.1.smithi155.stdout:3/287: chown d3/d25/c5f 5869093 1 2024-09-13T21:44:49.083 INFO:tasks.workunit.client.1.smithi155.stdout:3/288: stat d3/d21/d2c 0 2024-09-13T21:44:49.086 INFO:tasks.workunit.client.1.smithi155.stdout:1/200: creat d6/d15/d3e/d17/f4d x:0 0 0 2024-09-13T21:44:49.087 INFO:tasks.workunit.client.0.smithi119.stdout:0/590: rename de/d1c/d2f/d35/d50 to de/d1c/d2f/d40/d66/dcb/dd6 0 2024-09-13T21:44:49.093 INFO:tasks.workunit.client.1.smithi155.stdout:1/201: rename d6/d7/f1a to d6/d15/f4e 0 2024-09-13T21:44:49.094 INFO:tasks.workunit.client.0.smithi119.stdout:0/591: dwrite de/d1c/d2b/d76/f93 [0,4194304] 0 2024-09-13T21:44:49.095 INFO:tasks.workunit.client.1.smithi155.stdout:9/180: link dc/de/ff dc/d19/d23/d2f/f41 0 2024-09-13T21:44:49.099 INFO:tasks.workunit.client.1.smithi155.stdout:8/210: sync 2024-09-13T21:44:49.099 INFO:tasks.workunit.client.1.smithi155.stdout:7/143: sync 2024-09-13T21:44:49.099 INFO:tasks.workunit.client.1.smithi155.stdout:2/128: sync 2024-09-13T21:44:49.102 INFO:tasks.workunit.client.0.smithi119.stdout:2/571: write d1/d38/d89/f4e [5165725,30032] 0 2024-09-13T21:44:49.104 INFO:tasks.workunit.client.0.smithi119.stdout:6/541: dread dc/df/d41/f82 [0,4194304] 0 2024-09-13T21:44:49.105 INFO:tasks.workunit.client.0.smithi119.stdout:4/634: dwrite d4/d1e/d26/d60/d71/d83/f45 [0,4194304] 0 2024-09-13T21:44:49.105 INFO:tasks.workunit.client.1.smithi155.stdout:4/216: dread d1/d7/d21/f2a [0,4194304] 0 2024-09-13T21:44:49.107 INFO:tasks.workunit.client.0.smithi119.stdout:4/635: write d4/f2b [4204139,95838] 0 2024-09-13T21:44:49.109 INFO:tasks.workunit.client.1.smithi155.stdout:2/129: chown d2/f6 63 1 2024-09-13T21:44:49.109 INFO:tasks.workunit.client.1.smithi155.stdout:6/290: dwrite db/d12/f1a [0,4194304] 0 2024-09-13T21:44:49.110 INFO:tasks.workunit.client.0.smithi119.stdout:4/636: fsync d4/d1e/f17 0 2024-09-13T21:44:49.110 INFO:tasks.workunit.client.0.smithi119.stdout:2/572: read - d1/d22/d5a/d5d/d83/f67 zero size 2024-09-13T21:44:49.110 INFO:tasks.workunit.client.1.smithi155.stdout:7/144: unlink d5/d13/l1b 0 2024-09-13T21:44:49.110 INFO:tasks.workunit.client.1.smithi155.stdout:6/291: write f7 [3049501,63838] 0 2024-09-13T21:44:49.114 INFO:tasks.workunit.client.0.smithi119.stdout:2/573: write d1/f4a [5213903,33176] 0 2024-09-13T21:44:49.114 INFO:tasks.workunit.client.0.smithi119.stdout:8/634: dwrite d1b/d1d/d48/f49 [0,4194304] 0 2024-09-13T21:44:49.115 INFO:tasks.workunit.client.1.smithi155.stdout:8/211: rename d2/d6/dd/c3c to d2/d6/dd/d25/c3f 0 2024-09-13T21:44:49.117 INFO:tasks.workunit.client.1.smithi155.stdout:0/287: getdents d1/d6/dc 0 2024-09-13T21:44:49.118 INFO:tasks.workunit.client.0.smithi119.stdout:4/637: rmdir d4/d1e/d28/d34 39 2024-09-13T21:44:49.118 INFO:tasks.workunit.client.1.smithi155.stdout:7/145: dwrite f3 [0,4194304] 0 2024-09-13T21:44:49.119 INFO:tasks.workunit.client.0.smithi119.stdout:0/592: dwrite de/d1c/d2b/d34/f5b [0,4194304] 0 2024-09-13T21:44:49.121 INFO:tasks.workunit.client.1.smithi155.stdout:9/181: rename dc/d18/c1f to dc/d18/c42 0 2024-09-13T21:44:49.122 INFO:tasks.workunit.client.1.smithi155.stdout:9/182: read - dc/d18/f3d zero size 2024-09-13T21:44:49.123 INFO:tasks.workunit.client.1.smithi155.stdout:9/183: chown dc/d18/d1e/f34 3220 1 2024-09-13T21:44:49.126 INFO:tasks.workunit.client.1.smithi155.stdout:2/130: unlink d2/l5 0 2024-09-13T21:44:49.127 INFO:tasks.workunit.client.0.smithi119.stdout:4/638: unlink d4/d1e/d26/d60/dad/fbb 0 2024-09-13T21:44:49.129 INFO:tasks.workunit.client.0.smithi119.stdout:5/632: sync 2024-09-13T21:44:49.129 INFO:tasks.workunit.client.0.smithi119.stdout:0/593: mkdir de/d1c/d2b/dd7 0 2024-09-13T21:44:49.130 INFO:tasks.workunit.client.0.smithi119.stdout:7/663: sync 2024-09-13T21:44:49.132 INFO:tasks.workunit.client.0.smithi119.stdout:6/542: write dc/df/f27 [139949,92079] 0 2024-09-13T21:44:49.132 INFO:tasks.workunit.client.0.smithi119.stdout:7/664: fsync d8/d3c/d53/d37/d83/d89/d47/f65 0 2024-09-13T21:44:49.134 INFO:tasks.workunit.client.1.smithi155.stdout:9/184: dwrite dc/d19/d23/f30 [0,4194304] 0 2024-09-13T21:44:49.135 INFO:tasks.workunit.client.1.smithi155.stdout:9/185: readlink l1 0 2024-09-13T21:44:49.136 INFO:tasks.workunit.client.0.smithi119.stdout:6/543: creat dc/d3d/d40/d68/fad x:0 0 0 2024-09-13T21:44:49.136 INFO:tasks.workunit.client.0.smithi119.stdout:4/639: symlink d4/d1e/d28/d34/d66/d76/lcd 0 2024-09-13T21:44:49.138 INFO:tasks.workunit.client.0.smithi119.stdout:7/665: mknod d8/d3c/d46/db1/cd3 0 2024-09-13T21:44:49.141 INFO:tasks.workunit.client.0.smithi119.stdout:6/544: truncate dc/df/d41/f7b 311879 0 2024-09-13T21:44:49.141 INFO:tasks.workunit.client.0.smithi119.stdout:5/633: rename d0/d3/ld3 to d0/d3/lde 0 2024-09-13T21:44:49.141 INFO:tasks.workunit.client.1.smithi155.stdout:6/292: creat db/d11/d4c/f52 x:0 0 0 2024-09-13T21:44:49.142 INFO:tasks.workunit.client.1.smithi155.stdout:1/202: creat d6/d15/d3e/f4f x:0 0 0 2024-09-13T21:44:49.142 INFO:tasks.workunit.client.1.smithi155.stdout:8/212: symlink d2/d6/dd/d12/l40 0 2024-09-13T21:44:49.144 INFO:tasks.workunit.client.1.smithi155.stdout:7/146: rmdir d5/df/d15 39 2024-09-13T21:44:49.144 INFO:tasks.workunit.client.1.smithi155.stdout:9/186: dwrite fa [0,4194304] 0 2024-09-13T21:44:49.145 INFO:tasks.workunit.client.1.smithi155.stdout:6/293: chown f0 744813465 1 2024-09-13T21:44:49.146 INFO:tasks.workunit.client.0.smithi119.stdout:8/635: truncate f5 2552876 0 2024-09-13T21:44:49.147 INFO:tasks.workunit.client.1.smithi155.stdout:3/289: dread d3/d25/f39 [0,4194304] 0 2024-09-13T21:44:49.147 INFO:tasks.workunit.client.0.smithi119.stdout:7/666: getdents d8/d19/d2e/d34 0 2024-09-13T21:44:49.149 INFO:tasks.workunit.client.1.smithi155.stdout:7/147: write d5/df/f19 [424961,48928] 0 2024-09-13T21:44:49.149 INFO:tasks.workunit.client.0.smithi119.stdout:7/667: write d8/d9d/fa6 [3945729,18487] 0 2024-09-13T21:44:49.149 INFO:tasks.workunit.client.1.smithi155.stdout:1/203: truncate d6/f36 6103447 0 2024-09-13T21:44:49.150 INFO:tasks.workunit.client.1.smithi155.stdout:3/290: fsync d3/d25/d1b/d1f/f49 0 2024-09-13T21:44:49.151 INFO:tasks.workunit.client.0.smithi119.stdout:5/634: rename d0/d3/l6a to d0/d3/ldf 0 2024-09-13T21:44:49.152 INFO:tasks.workunit.client.0.smithi119.stdout:0/594: dread de/d1c/f20 [0,4194304] 0 2024-09-13T21:44:49.152 INFO:tasks.workunit.client.1.smithi155.stdout:1/204: write d6/d15/d3e/f4f [169844,91013] 0 2024-09-13T21:44:49.153 INFO:tasks.workunit.client.1.smithi155.stdout:4/217: link d1/d7/d21/c28 d1/d7/de/d15/c40 0 2024-09-13T21:44:49.154 INFO:tasks.workunit.client.1.smithi155.stdout:6/294: mknod db/d12/d1c/d36/c53 0 2024-09-13T21:44:49.155 INFO:tasks.workunit.client.1.smithi155.stdout:9/187: mkdir dc/d19/d23/d2f/d43 0 2024-09-13T21:44:49.156 INFO:tasks.workunit.client.1.smithi155.stdout:3/291: fdatasync d3/f37 0 2024-09-13T21:44:49.156 INFO:tasks.workunit.client.1.smithi155.stdout:2/131: mknod d2/dd/de/d15/c28 0 2024-09-13T21:44:49.156 INFO:tasks.workunit.client.0.smithi119.stdout:8/636: dread d1b/d1d/d26/f3d [0,4194304] 0 2024-09-13T21:44:49.157 INFO:tasks.workunit.client.1.smithi155.stdout:4/218: rmdir d1/d7/d21/d2d 39 2024-09-13T21:44:49.158 INFO:tasks.workunit.client.1.smithi155.stdout:6/295: creat db/d11/d4c/f54 x:0 0 0 2024-09-13T21:44:49.160 INFO:tasks.workunit.client.1.smithi155.stdout:4/219: write d1/f3b [530890,77902] 0 2024-09-13T21:44:49.160 INFO:tasks.workunit.client.0.smithi119.stdout:6/545: dread dc/dd/f47 [4194304,4194304] 0 2024-09-13T21:44:49.161 INFO:tasks.workunit.client.1.smithi155.stdout:7/148: truncate d5/d13/f21 194940 0 2024-09-13T21:44:49.161 INFO:tasks.workunit.client.1.smithi155.stdout:1/205: dread d6/f49 [0,4194304] 0 2024-09-13T21:44:49.161 INFO:tasks.workunit.client.0.smithi119.stdout:7/668: dwrite d8/f9c [0,4194304] 0 2024-09-13T21:44:49.162 INFO:tasks.workunit.client.1.smithi155.stdout:9/188: symlink dc/de/l44 0 2024-09-13T21:44:49.162 INFO:tasks.workunit.client.1.smithi155.stdout:7/149: stat d5/fa 0 2024-09-13T21:44:49.162 INFO:tasks.workunit.client.1.smithi155.stdout:7/150: read f3 [2423619,25550] 0 2024-09-13T21:44:49.163 INFO:tasks.workunit.client.0.smithi119.stdout:5/635: dread d0/d3/d4/d9/d14/d24/d25/f6f [0,4194304] 0 2024-09-13T21:44:49.164 INFO:tasks.workunit.client.0.smithi119.stdout:7/669: chown d8/d3c/d53/d37/d83/d89/f12 471 1 2024-09-13T21:44:49.165 INFO:tasks.workunit.client.1.smithi155.stdout:2/132: symlink d2/dd/de/d15/l29 0 2024-09-13T21:44:49.165 INFO:tasks.workunit.client.1.smithi155.stdout:3/292: stat d3/d10/c15 0 2024-09-13T21:44:49.165 INFO:tasks.workunit.client.0.smithi119.stdout:0/595: rename de/d1c/f36 to de/d3c/d7c/fd8 0 2024-09-13T21:44:49.165 INFO:tasks.workunit.client.1.smithi155.stdout:6/296: mkdir db/d12/d1c/d55 0 2024-09-13T21:44:49.166 INFO:tasks.workunit.client.1.smithi155.stdout:2/133: read - d2/dd/f24 zero size 2024-09-13T21:44:49.166 INFO:tasks.workunit.client.1.smithi155.stdout:9/189: creat dc/de/f45 x:0 0 0 2024-09-13T21:44:49.168 INFO:tasks.workunit.client.1.smithi155.stdout:4/220: creat d1/d7/de/dc/d2e/d26/f41 x:0 0 0 2024-09-13T21:44:49.170 INFO:tasks.workunit.client.1.smithi155.stdout:1/206: creat d6/d15/d3e/d17/d30/f50 x:0 0 0 2024-09-13T21:44:49.171 INFO:tasks.workunit.client.0.smithi119.stdout:6/546: dwrite dc/df/f12 [0,4194304] 0 2024-09-13T21:44:49.172 INFO:tasks.workunit.client.0.smithi119.stdout:7/670: creat d8/d3c/d53/d37/fd4 x:0 0 0 2024-09-13T21:44:49.172 INFO:tasks.workunit.client.1.smithi155.stdout:1/207: fdatasync d6/d15/d3e/d17/d30/f50 0 2024-09-13T21:44:49.174 INFO:tasks.workunit.client.0.smithi119.stdout:0/596: truncate de/d1c/d2f/f47 379487 0 2024-09-13T21:44:49.174 INFO:tasks.workunit.client.0.smithi119.stdout:5/636: dread d0/d3/d4/d9/d14/d24/d25/d67/f69 [0,4194304] 0 2024-09-13T21:44:49.176 INFO:tasks.workunit.client.1.smithi155.stdout:1/208: dread d6/d15/d3e/d17/f21 [0,4194304] 0 2024-09-13T21:44:49.176 INFO:tasks.workunit.client.1.smithi155.stdout:9/190: mknod dc/d19/d23/d2f/c46 0 2024-09-13T21:44:49.178 INFO:tasks.workunit.client.1.smithi155.stdout:2/134: symlink d2/l2a 0 2024-09-13T21:44:49.181 INFO:tasks.workunit.client.1.smithi155.stdout:4/221: mkdir d1/d7/d21/d2d/d42 0 2024-09-13T21:44:49.182 INFO:tasks.workunit.client.1.smithi155.stdout:9/191: fsync fa 0 2024-09-13T21:44:49.183 INFO:tasks.workunit.client.1.smithi155.stdout:1/209: symlink d6/d15/d3e/d17/l51 0 2024-09-13T21:44:49.184 INFO:tasks.workunit.client.0.smithi119.stdout:5/637: write d0/d3/d4/f78 [3052890,102066] 0 2024-09-13T21:44:49.184 INFO:tasks.workunit.client.1.smithi155.stdout:9/192: write fa [2080553,70078] 0 2024-09-13T21:44:49.185 INFO:tasks.workunit.client.1.smithi155.stdout:6/297: dread db/d11/d1e/f2e [0,4194304] 0 2024-09-13T21:44:49.185 INFO:tasks.workunit.client.0.smithi119.stdout:7/671: write d8/d3c/d53/d3b/d48/f97 [968872,99038] 0 2024-09-13T21:44:49.186 INFO:tasks.workunit.client.0.smithi119.stdout:4/640: rmdir d4/d1e/d26/d60 39 2024-09-13T21:44:49.187 INFO:tasks.workunit.client.0.smithi119.stdout:2/574: write d1/d22/f6e [701737,74989] 0 2024-09-13T21:44:49.188 INFO:tasks.workunit.client.1.smithi155.stdout:1/210: fsync d6/d15/d23/f3f 0 2024-09-13T21:44:49.195 INFO:tasks.workunit.client.0.smithi119.stdout:0/597: dwrite de/d1c/d64/f8e [0,4194304] 0 2024-09-13T21:44:49.195 INFO:tasks.workunit.client.1.smithi155.stdout:5/199: dwrite d5/f1c [0,4194304] 0 2024-09-13T21:44:49.196 INFO:tasks.workunit.client.1.smithi155.stdout:2/135: link d2/db/f16 d2/dd/de/d15/f2b 0 2024-09-13T21:44:49.198 INFO:tasks.workunit.client.1.smithi155.stdout:0/288: dwrite d1/d6/dc/d4d/d4a/d52/f56 [0,4194304] 0 2024-09-13T21:44:49.199 INFO:tasks.workunit.client.0.smithi119.stdout:7/672: dwrite d8/f9c [0,4194304] 0 2024-09-13T21:44:49.200 INFO:tasks.workunit.client.1.smithi155.stdout:0/289: chown d1/d6/dc/l2a 600 1 2024-09-13T21:44:49.200 INFO:tasks.workunit.client.1.smithi155.stdout:1/211: dread d6/d15/d3e/d17/f29 [0,4194304] 0 2024-09-13T21:44:49.201 INFO:tasks.workunit.client.1.smithi155.stdout:3/293: link d3/d10/c14 d3/d25/c60 0 2024-09-13T21:44:49.201 INFO:tasks.workunit.client.1.smithi155.stdout:3/294: fdatasync d3/d25/f5e 0 2024-09-13T21:44:49.204 INFO:tasks.workunit.client.1.smithi155.stdout:3/295: stat d3/d25/f1c 0 2024-09-13T21:44:49.206 INFO:tasks.workunit.client.1.smithi155.stdout:3/296: fdatasync d3/d25/d17/f5b 0 2024-09-13T21:44:49.206 INFO:tasks.workunit.client.1.smithi155.stdout:9/193: fdatasync dc/de/ff 0 2024-09-13T21:44:49.209 INFO:tasks.workunit.client.1.smithi155.stdout:3/297: dread - d3/d25/f3f zero size 2024-09-13T21:44:49.210 INFO:tasks.workunit.client.0.smithi119.stdout:4/641: fsync d4/f96 0 2024-09-13T21:44:49.210 INFO:tasks.workunit.client.0.smithi119.stdout:5/638: chown d0/d3/d4/d2e/d97/lac 1 1 2024-09-13T21:44:49.212 INFO:tasks.workunit.client.0.smithi119.stdout:2/575: truncate d1/d22/d5a/d5d/f61 84217 0 2024-09-13T21:44:49.212 INFO:tasks.workunit.client.0.smithi119.stdout:4/642: fdatasync d4/d1e/d26/f2d 0 2024-09-13T21:44:49.214 INFO:tasks.workunit.client.1.smithi155.stdout:6/298: dwrite db/d11/d1e/d21/f42 [0,4194304] 0 2024-09-13T21:44:49.214 INFO:tasks.workunit.client.1.smithi155.stdout:2/136: fdatasync d2/db/f1b 0 2024-09-13T21:44:49.215 INFO:tasks.workunit.client.0.smithi119.stdout:5/639: dread d0/d3/d4/d9/d1e/f72 [0,4194304] 0 2024-09-13T21:44:49.215 INFO:tasks.workunit.client.0.smithi119.stdout:6/547: dread dc/d3a/f52 [0,4194304] 0 2024-09-13T21:44:49.215 INFO:tasks.workunit.client.0.smithi119.stdout:0/598: dread fd [4194304,4194304] 0 2024-09-13T21:44:49.216 INFO:tasks.workunit.client.0.smithi119.stdout:6/548: chown dc/l18 0 1 2024-09-13T21:44:49.218 INFO:tasks.workunit.client.0.smithi119.stdout:0/599: mknod de/d1c/d52/cd9 0 2024-09-13T21:44:49.222 INFO:tasks.workunit.client.0.smithi119.stdout:5/640: truncate d0/d3/d4/d9/d1e/f38 1521770 0 2024-09-13T21:44:49.224 INFO:tasks.workunit.client.0.smithi119.stdout:8/637: dread d1b/f42 [0,4194304] 0 2024-09-13T21:44:49.225 INFO:tasks.workunit.client.1.smithi155.stdout:6/299: dwrite f7 [0,4194304] 0 2024-09-13T21:44:49.226 INFO:tasks.workunit.client.1.smithi155.stdout:7/151: truncate d5/df/f1a 1424555 0 2024-09-13T21:44:49.227 INFO:tasks.workunit.client.0.smithi119.stdout:5/641: creat d0/d3/d1f/d21/d4f/d86/fe0 x:0 0 0 2024-09-13T21:44:49.229 INFO:tasks.workunit.client.1.smithi155.stdout:3/298: dwrite d3/d25/d17/f27 [0,4194304] 0 2024-09-13T21:44:49.229 INFO:tasks.workunit.client.0.smithi119.stdout:8/638: dread - d1b/d1d/d26/d3e/fc0 zero size 2024-09-13T21:44:49.229 INFO:tasks.workunit.client.0.smithi119.stdout:6/549: dwrite dc/df/f24 [4194304,4194304] 0 2024-09-13T21:44:49.231 INFO:tasks.workunit.client.0.smithi119.stdout:5/642: chown d0/d3/d4/d9/d1e/l84 0 1 2024-09-13T21:44:49.232 INFO:tasks.workunit.client.1.smithi155.stdout:0/290: symlink d1/l6f 0 2024-09-13T21:44:49.233 INFO:tasks.workunit.client.1.smithi155.stdout:1/212: mknod d6/d7/d48/c52 0 2024-09-13T21:44:49.234 INFO:tasks.workunit.client.1.smithi155.stdout:0/291: write d1/f35 [1385117,94878] 0 2024-09-13T21:44:49.234 INFO:tasks.workunit.client.0.smithi119.stdout:5/643: fsync d0/d3/d4/d9/d14/d24/f5a 0 2024-09-13T21:44:49.234 INFO:tasks.workunit.client.1.smithi155.stdout:1/213: chown d6/d7/d48/c52 3585228 1 2024-09-13T21:44:49.234 INFO:tasks.workunit.client.1.smithi155.stdout:0/292: chown d1/f19 584 1 2024-09-13T21:44:49.236 INFO:tasks.workunit.client.1.smithi155.stdout:4/222: rename d1/d7/de/d15/c40 to d1/d7/d21/c43 0 2024-09-13T21:44:49.236 INFO:tasks.workunit.client.0.smithi119.stdout:0/600: dread de/f22 [0,4194304] 0 2024-09-13T21:44:49.237 INFO:tasks.workunit.client.0.smithi119.stdout:5/644: mkdir d0/d3/d4/d9/d1e/da5/db9/de1 0 2024-09-13T21:44:49.240 INFO:tasks.workunit.client.1.smithi155.stdout:9/194: truncate dc/de/d15/f24 3904167 0 2024-09-13T21:44:49.240 INFO:tasks.workunit.client.0.smithi119.stdout:0/601: write de/d1c/f20 [1168629,3726] 0 2024-09-13T21:44:49.240 INFO:tasks.workunit.client.0.smithi119.stdout:5/645: mknod d0/d3/d4/d9/d1e/da5/ce2 0 2024-09-13T21:44:49.241 INFO:tasks.workunit.client.1.smithi155.stdout:0/293: unlink d1/d6/dc/f45 0 2024-09-13T21:44:49.242 INFO:tasks.workunit.client.1.smithi155.stdout:9/195: chown dc/d19/d23/d2f/d43 28607683 1 2024-09-13T21:44:49.242 INFO:tasks.workunit.client.1.smithi155.stdout:7/152: mkdir d5/df/d27 0 2024-09-13T21:44:49.244 INFO:tasks.workunit.client.0.smithi119.stdout:5/646: dread - d0/d3/d1f/d21/d4f/d86/fe0 zero size 2024-09-13T21:44:49.246 INFO:tasks.workunit.client.1.smithi155.stdout:2/137: creat d2/dd/f2c x:0 0 0 2024-09-13T21:44:49.247 INFO:tasks.workunit.client.0.smithi119.stdout:5/647: read d0/d3/d4/d9/d1e/f91 [138342,75078] 0 2024-09-13T21:44:49.249 INFO:tasks.workunit.client.0.smithi119.stdout:0/602: dwrite de/d1c/d2f/d40/f99 [0,4194304] 0 2024-09-13T21:44:49.250 INFO:tasks.workunit.client.1.smithi155.stdout:4/223: mknod d1/d7/d21/c44 0 2024-09-13T21:44:49.251 INFO:tasks.workunit.client.0.smithi119.stdout:7/673: dread d8/d3c/d53/d37/d83/d89/f2d [0,4194304] 0 2024-09-13T21:44:49.253 INFO:tasks.workunit.client.1.smithi155.stdout:0/294: dwrite d1/f34 [0,4194304] 0 2024-09-13T21:44:49.253 INFO:tasks.workunit.client.0.smithi119.stdout:0/603: rmdir de/d1c/d2b/d76 39 2024-09-13T21:44:49.253 INFO:tasks.workunit.client.1.smithi155.stdout:4/224: truncate d1/f24 82733 0 2024-09-13T21:44:49.254 INFO:tasks.workunit.client.0.smithi119.stdout:0/604: fsync de/fd4 0 2024-09-13T21:44:49.255 INFO:tasks.workunit.client.1.smithi155.stdout:4/225: write d1/d7/de/d15/d32/f38 [4474940,2071] 0 2024-09-13T21:44:49.256 INFO:tasks.workunit.client.0.smithi119.stdout:7/674: creat d8/d3c/d53/d3b/d7e/fd5 x:0 0 0 2024-09-13T21:44:49.257 INFO:tasks.workunit.client.1.smithi155.stdout:9/196: creat dc/d19/d23/f47 x:0 0 0 2024-09-13T21:44:49.259 INFO:tasks.workunit.client.0.smithi119.stdout:2/576: rmdir d1/d22 39 2024-09-13T21:44:49.259 INFO:tasks.workunit.client.1.smithi155.stdout:3/299: rename d3/d25/d1b/f1d to d3/d25/f61 0 2024-09-13T21:44:49.261 INFO:tasks.workunit.client.0.smithi119.stdout:5/648: dwrite d0/d3/d4/d9/f46 [0,4194304] 0 2024-09-13T21:44:49.262 INFO:tasks.workunit.client.0.smithi119.stdout:1/617: sync 2024-09-13T21:44:49.263 INFO:tasks.workunit.client.1.smithi155.stdout:2/138: creat d2/dd/de/d15/f2d x:0 0 0 2024-09-13T21:44:49.265 INFO:tasks.workunit.client.1.smithi155.stdout:6/300: getdents db/d12 0 2024-09-13T21:44:49.268 INFO:tasks.workunit.client.0.smithi119.stdout:2/577: mkdir d1/d22/d5a/da9/db9 0 2024-09-13T21:44:49.268 INFO:tasks.workunit.client.1.smithi155.stdout:5/200: dwrite f0 [0,4194304] 0 2024-09-13T21:44:49.270 INFO:tasks.workunit.client.0.smithi119.stdout:6/550: write dc/df/d32/f35 [1463946,7156] 0 2024-09-13T21:44:49.271 INFO:tasks.workunit.client.0.smithi119.stdout:7/675: getdents d8/d3c/d46/db1 0 2024-09-13T21:44:49.271 INFO:tasks.workunit.client.1.smithi155.stdout:6/301: chown db/d11/f14 730 1 2024-09-13T21:44:49.271 INFO:tasks.workunit.client.0.smithi119.stdout:6/551: chown dc/df/d5c/f89 98606594 1 2024-09-13T21:44:49.273 INFO:tasks.workunit.client.1.smithi155.stdout:4/226: creat d1/d7/de/dc/f45 x:0 0 0 2024-09-13T21:44:49.273 INFO:tasks.workunit.client.0.smithi119.stdout:7/676: rmdir d8/d3c/d46 39 2024-09-13T21:44:49.275 INFO:tasks.workunit.client.0.smithi119.stdout:6/552: mkdir dc/df/d41/dae 0 2024-09-13T21:44:49.276 INFO:tasks.workunit.client.0.smithi119.stdout:2/578: creat d1/d7/fba x:0 0 0 2024-09-13T21:44:49.278 INFO:tasks.workunit.client.1.smithi155.stdout:9/197: creat dc/d19/f48 x:0 0 0 2024-09-13T21:44:49.280 INFO:tasks.workunit.client.0.smithi119.stdout:7/677: rmdir d8/d9d 39 2024-09-13T21:44:49.281 INFO:tasks.workunit.client.1.smithi155.stdout:3/300: chown d3/d10/l33 12732 1 2024-09-13T21:44:49.281 INFO:tasks.workunit.client.1.smithi155.stdout:2/139: unlink d2/fa 0 2024-09-13T21:44:49.281 INFO:tasks.workunit.client.0.smithi119.stdout:8/639: truncate d1b/d1d/dc3/fae 368438 0 2024-09-13T21:44:49.282 INFO:tasks.workunit.client.1.smithi155.stdout:9/198: dread - dc/d19/d23/f2e zero size 2024-09-13T21:44:49.283 INFO:tasks.workunit.client.0.smithi119.stdout:5/649: dread d0/d3/d4/d9/d14/d24/f55 [0,4194304] 0 2024-09-13T21:44:49.283 INFO:tasks.workunit.client.0.smithi119.stdout:6/553: mknod dc/d4b/d6a/d75/caf 0 2024-09-13T21:44:49.284 INFO:tasks.workunit.client.1.smithi155.stdout:4/227: mknod d1/d7/de/dc/c46 0 2024-09-13T21:44:49.284 INFO:tasks.workunit.client.1.smithi155.stdout:1/214: dread d6/d7/f8 [0,4194304] 0 2024-09-13T21:44:49.284 INFO:tasks.workunit.client.0.smithi119.stdout:7/678: write d8/d3c/d53/f2b [1003134,77252] 0 2024-09-13T21:44:49.284 INFO:tasks.workunit.client.1.smithi155.stdout:9/199: chown dc/d19/d21 325692 1 2024-09-13T21:44:49.286 INFO:tasks.workunit.client.0.smithi119.stdout:4/643: dread d4/d1e/d26/d60/d71/f8e [0,4194304] 0 2024-09-13T21:44:49.287 INFO:tasks.workunit.client.1.smithi155.stdout:6/302: dread db/d12/d1c/d36/f3c [0,4194304] 0 2024-09-13T21:44:49.287 INFO:tasks.workunit.client.0.smithi119.stdout:5/650: mknod d0/d3/ce3 0 2024-09-13T21:44:49.287 INFO:tasks.workunit.client.1.smithi155.stdout:1/215: mknod d6/d7/d48/c53 0 2024-09-13T21:44:49.288 INFO:tasks.workunit.client.0.smithi119.stdout:8/640: dread d1b/d4e/f53 [0,4194304] 0 2024-09-13T21:44:49.289 INFO:tasks.workunit.client.0.smithi119.stdout:7/679: mkdir d8/d3c/d53/d37/dd6 0 2024-09-13T21:44:49.290 INFO:tasks.workunit.client.0.smithi119.stdout:7/680: fdatasync d8/d3c/d53/f28 0 2024-09-13T21:44:49.292 INFO:tasks.workunit.client.1.smithi155.stdout:3/301: mknod d3/d25/d17/d52/c62 0 2024-09-13T21:44:49.294 INFO:tasks.workunit.client.0.smithi119.stdout:7/681: dread - d8/d3c/d53/d37/d83/fb2 zero size 2024-09-13T21:44:49.294 INFO:tasks.workunit.client.1.smithi155.stdout:6/303: chown db/d11/d2b/d35/f25 62 1 2024-09-13T21:44:49.295 INFO:tasks.workunit.client.1.smithi155.stdout:1/216: mknod d6/d7/d48/c54 0 2024-09-13T21:44:49.296 INFO:tasks.workunit.client.0.smithi119.stdout:6/554: link dc/d3d/d40/l63 dc/d3d/da8/lb0 0 2024-09-13T21:44:49.297 INFO:tasks.workunit.client.0.smithi119.stdout:8/641: dwrite d1b/d1d/d26/f81 [0,4194304] 0 2024-09-13T21:44:49.298 INFO:tasks.workunit.client.1.smithi155.stdout:1/217: stat d6/d7/c1c 0 2024-09-13T21:44:49.299 INFO:tasks.workunit.client.1.smithi155.stdout:9/200: truncate dc/d18/d1e/f34 4132078 0 2024-09-13T21:44:49.300 INFO:tasks.workunit.client.0.smithi119.stdout:8/642: write d1b/d1d/d26/d3e/d65/f88 [3324279,64675] 0 2024-09-13T21:44:49.300 INFO:tasks.workunit.client.0.smithi119.stdout:7/682: write d8/d19/f35 [424282,59418] 0 2024-09-13T21:44:49.300 INFO:tasks.workunit.client.1.smithi155.stdout:4/228: dwrite d1/d7/de/dc/f45 [0,4194304] 0 2024-09-13T21:44:49.302 INFO:tasks.workunit.client.0.smithi119.stdout:6/555: creat dc/dd/d5e/d7a/d7e/fb1 x:0 0 0 2024-09-13T21:44:49.302 INFO:tasks.workunit.client.0.smithi119.stdout:0/605: truncate de/d1c/d2f/d35/d90/f95 4183304 0 2024-09-13T21:44:49.304 INFO:tasks.workunit.client.1.smithi155.stdout:3/302: dwrite d3/d25/d17/f5b [0,4194304] 0 2024-09-13T21:44:49.307 INFO:tasks.workunit.client.1.smithi155.stdout:6/304: creat db/d11/d1e/f56 x:0 0 0 2024-09-13T21:44:49.308 INFO:tasks.workunit.client.0.smithi119.stdout:1/618: dwrite d1/d3/f2b [0,4194304] 0 2024-09-13T21:44:49.309 INFO:tasks.workunit.client.0.smithi119.stdout:2/579: dread d1/d38/d89/f34 [4194304,4194304] 0 2024-09-13T21:44:49.312 INFO:tasks.workunit.client.1.smithi155.stdout:3/303: rmdir d3/d10 39 2024-09-13T21:44:49.313 INFO:tasks.workunit.client.0.smithi119.stdout:0/606: creat de/d1c/d2b/dd7/fda x:0 0 0 2024-09-13T21:44:49.314 INFO:tasks.workunit.client.1.smithi155.stdout:2/140: write d2/dd/de/d15/f1c [717180,21240] 0 2024-09-13T21:44:49.316 INFO:tasks.workunit.client.0.smithi119.stdout:2/580: unlink d1/d7/l14 0 2024-09-13T21:44:49.319 INFO:tasks.workunit.client.0.smithi119.stdout:1/619: rename d1/d3/dc/d11/d19/c21 to d1/d3/dc/ccb 0 2024-09-13T21:44:49.319 INFO:tasks.workunit.client.0.smithi119.stdout:4/644: dwrite d4/d1e/d26/f86 [0,4194304] 0 2024-09-13T21:44:49.319 INFO:tasks.workunit.client.1.smithi155.stdout:1/218: dwrite d6/d15/f45 [0,4194304] 0 2024-09-13T21:44:49.319 INFO:tasks.workunit.client.1.smithi155.stdout:6/305: symlink db/d12/d1c/d36/l57 0 2024-09-13T21:44:49.321 INFO:tasks.workunit.client.0.smithi119.stdout:9/859: sync 2024-09-13T21:44:49.321 INFO:tasks.workunit.client.0.smithi119.stdout:3/544: sync 2024-09-13T21:44:49.321 INFO:tasks.workunit.client.0.smithi119.stdout:6/556: rmdir dc/da3 0 2024-09-13T21:44:49.326 INFO:tasks.workunit.client.0.smithi119.stdout:0/607: creat de/d49/fdb x:0 0 0 2024-09-13T21:44:49.327 INFO:tasks.workunit.client.1.smithi155.stdout:9/201: getdents dc/d19/d21 0 2024-09-13T21:44:49.327 INFO:tasks.workunit.client.1.smithi155.stdout:1/219: fsync d6/d7/f40 0 2024-09-13T21:44:49.327 INFO:tasks.workunit.client.1.smithi155.stdout:3/304: unlink d3/d25/d17/l31 0 2024-09-13T21:44:49.328 INFO:tasks.workunit.client.0.smithi119.stdout:6/557: unlink dc/dd/l45 0 2024-09-13T21:44:49.329 INFO:tasks.workunit.client.0.smithi119.stdout:4/645: mkdir d4/dce 0 2024-09-13T21:44:49.329 INFO:tasks.workunit.client.0.smithi119.stdout:3/545: chown d6/d15/d1a/f41 28181 1 2024-09-13T21:44:49.330 INFO:tasks.workunit.client.1.smithi155.stdout:5/201: dwrite d5/d16/f2a [0,4194304] 0 2024-09-13T21:44:49.330 INFO:tasks.workunit.client.0.smithi119.stdout:5/651: dwrite d0/d3/d4/d9/d1e/f5c [0,4194304] 0 2024-09-13T21:44:49.331 INFO:tasks.workunit.client.0.smithi119.stdout:2/581: symlink d1/lbb 0 2024-09-13T21:44:49.332 INFO:tasks.workunit.client.0.smithi119.stdout:9/860: mknod d0/d79/da4/c129 0 2024-09-13T21:44:49.334 INFO:tasks.workunit.client.1.smithi155.stdout:4/229: dread d1/d7/de/d15/d32/f38 [0,4194304] 0 2024-09-13T21:44:49.336 INFO:tasks.workunit.client.0.smithi119.stdout:2/582: write d1/d7/d47/fa3 [365131,99426] 0 2024-09-13T21:44:49.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:49 smithi155 ceph-mon[34732]: from='client.24429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:49.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:49 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1183107781' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:44:49.338 INFO:tasks.workunit.client.0.smithi119.stdout:1/620: link d1/d3/d61/da9/fc0 d1/d3/d61/d77/d78/d32/d33/d72/fcc 0 2024-09-13T21:44:49.339 INFO:tasks.workunit.client.0.smithi119.stdout:4/646: mkdir d4/d1e/d28/d34/d6a/d79/d9f/dcf 0 2024-09-13T21:44:49.339 INFO:tasks.workunit.client.0.smithi119.stdout:6/558: dread dc/f36 [0,4194304] 0 2024-09-13T21:44:49.342 INFO:tasks.workunit.client.0.smithi119.stdout:3/546: rename d6/d15/f34 to d6/d25/d2f/d33/d56/da0/fb5 0 2024-09-13T21:44:49.342 INFO:tasks.workunit.client.0.smithi119.stdout:9/861: read d0/f2c [3387305,61211] 0 2024-09-13T21:44:49.344 INFO:tasks.workunit.client.0.smithi119.stdout:6/559: write dc/d3a/f9c [887252,41499] 0 2024-09-13T21:44:49.345 INFO:tasks.workunit.client.1.smithi155.stdout:6/306: dwrite db/d11/d1e/f2e [0,4194304] 0 2024-09-13T21:44:49.345 INFO:tasks.workunit.client.0.smithi119.stdout:3/547: dread - d6/d15/da9/f9a zero size 2024-09-13T21:44:49.348 INFO:tasks.workunit.client.0.smithi119.stdout:1/621: rmdir d1/d3/dc/d11/d19/d2d/d59 39 2024-09-13T21:44:49.348 INFO:tasks.workunit.client.0.smithi119.stdout:4/647: mknod d4/d1e/d28/d34/d6a/d79/dae/cd0 0 2024-09-13T21:44:49.349 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:49 smithi119 ceph-mon[27653]: from='client.24429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:44:49.349 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:49 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1183107781' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:44:49.350 INFO:tasks.workunit.client.1.smithi155.stdout:5/202: creat d5/d16/d33/d1b/d2f/f40 x:0 0 0 2024-09-13T21:44:49.350 INFO:tasks.workunit.client.1.smithi155.stdout:5/203: chown d5/d12 72 1 2024-09-13T21:44:49.351 INFO:tasks.workunit.client.0.smithi119.stdout:5/652: getdents d0/d3/d1f 0 2024-09-13T21:44:49.351 INFO:tasks.workunit.client.0.smithi119.stdout:6/560: write dc/df/f12 [5673016,25022] 0 2024-09-13T21:44:49.351 INFO:tasks.workunit.client.1.smithi155.stdout:5/204: read d5/d16/d33/f38 [26303,97810] 0 2024-09-13T21:44:49.354 INFO:tasks.workunit.client.0.smithi119.stdout:4/648: creat d4/d1e/d28/d34/d66/fd1 x:0 0 0 2024-09-13T21:44:49.354 INFO:tasks.workunit.client.1.smithi155.stdout:3/305: creat d3/d25/d1b/d1f/d36/d5c/f63 x:0 0 0 2024-09-13T21:44:49.355 INFO:tasks.workunit.client.1.smithi155.stdout:1/220: mkdir d6/d15/d23/d55 0 2024-09-13T21:44:49.357 INFO:tasks.workunit.client.1.smithi155.stdout:4/230: symlink d1/d7/d21/l47 0 2024-09-13T21:44:49.359 INFO:tasks.workunit.client.0.smithi119.stdout:8/643: dread f13 [0,4194304] 0 2024-09-13T21:44:49.359 INFO:tasks.workunit.client.0.smithi119.stdout:9/862: rmdir d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/db9/d123 0 2024-09-13T21:44:49.359 INFO:tasks.workunit.client.1.smithi155.stdout:4/231: fsync d1/d7/de/dc/d2e/f34 0 2024-09-13T21:44:49.360 INFO:tasks.workunit.client.1.smithi155.stdout:5/205: creat d5/d16/d33/d1b/d2f/d3c/f41 x:0 0 0 2024-09-13T21:44:49.360 INFO:tasks.workunit.client.0.smithi119.stdout:5/653: mkdir d0/d3/d4/d9/d14/d24/d25/d54/dd6/de4 0 2024-09-13T21:44:49.361 INFO:tasks.workunit.client.1.smithi155.stdout:7/153: write d5/d10/f18 [1231154,22474] 0 2024-09-13T21:44:49.362 INFO:tasks.workunit.client.0.smithi119.stdout:5/654: chown d0/d3/d4/d9/d14/d24/d25/d54 1 1 2024-09-13T21:44:49.364 INFO:tasks.workunit.client.0.smithi119.stdout:6/561: dwrite dc/f14 [0,4194304] 0 2024-09-13T21:44:49.364 INFO:tasks.workunit.client.1.smithi155.stdout:3/306: dwrite d3/d25/d1b/f38 [0,4194304] 0 2024-09-13T21:44:49.365 INFO:tasks.workunit.client.0.smithi119.stdout:8/644: mknod d1b/d1d/d26/d3e/cc6 0 2024-09-13T21:44:49.365 INFO:tasks.workunit.client.0.smithi119.stdout:4/649: link d4/d1e/d26/d5e/l5f d4/d1e/d28/d34/d99/ld2 0 2024-09-13T21:44:49.366 INFO:tasks.workunit.client.1.smithi155.stdout:7/154: dread - d5/d13/f20 zero size 2024-09-13T21:44:49.366 INFO:tasks.workunit.client.1.smithi155.stdout:5/206: chown d5/d16/d33/d1b/d2f/f40 233047224 1 2024-09-13T21:44:49.367 INFO:tasks.workunit.client.1.smithi155.stdout:7/155: chown l1 2 1 2024-09-13T21:44:49.369 INFO:tasks.workunit.client.1.smithi155.stdout:1/221: truncate d6/d15/f34 4280851 0 2024-09-13T21:44:49.371 INFO:tasks.workunit.client.1.smithi155.stdout:1/222: readlink l5 0 2024-09-13T21:44:49.371 INFO:tasks.workunit.client.1.smithi155.stdout:3/307: creat d3/d25/d1b/d1f/f64 x:0 0 0 2024-09-13T21:44:49.372 INFO:tasks.workunit.client.1.smithi155.stdout:7/156: creat d5/df/d15/f28 x:0 0 0 2024-09-13T21:44:49.374 INFO:tasks.workunit.client.0.smithi119.stdout:8/645: unlink d1b/d1d/d48/d54/f94 0 2024-09-13T21:44:49.374 INFO:tasks.workunit.client.0.smithi119.stdout:5/655: dwrite d0/d3/d1f/d21/d4f/f9c [0,4194304] 0 2024-09-13T21:44:49.375 INFO:tasks.workunit.client.1.smithi155.stdout:3/308: creat d3/d21/f65 x:0 0 0 2024-09-13T21:44:49.375 INFO:tasks.workunit.client.1.smithi155.stdout:7/157: creat d5/d13/f29 x:0 0 0 2024-09-13T21:44:49.378 INFO:tasks.workunit.client.0.smithi119.stdout:4/650: creat d4/d1e/d26/d60/d71/fd3 x:0 0 0 2024-09-13T21:44:49.378 INFO:tasks.workunit.client.0.smithi119.stdout:1/622: dread d1/d3/dc/d24/f29 [0,4194304] 0 2024-09-13T21:44:49.379 INFO:tasks.workunit.client.1.smithi155.stdout:5/207: dwrite d5/d16/d33/d1b/d28/f37 [0,4194304] 0 2024-09-13T21:44:49.380 INFO:tasks.workunit.client.1.smithi155.stdout:3/309: unlink d3/d25/d1b/c40 0 2024-09-13T21:44:49.381 INFO:tasks.workunit.client.0.smithi119.stdout:9/863: getdents d0/d8/d18/d23/d27/d2d 0 2024-09-13T21:44:49.381 INFO:tasks.workunit.client.1.smithi155.stdout:3/310: chown d3/d25/fb 873 1 2024-09-13T21:44:49.382 INFO:tasks.workunit.client.1.smithi155.stdout:3/311: chown d3/d25/d1b/d1f/f2e 1 1 2024-09-13T21:44:49.382 INFO:tasks.workunit.client.0.smithi119.stdout:5/656: mkdir d0/d3/d4/d9/d14/d24/db6/de5 0 2024-09-13T21:44:49.383 INFO:tasks.workunit.client.0.smithi119.stdout:4/651: fsync d4/d1e/d26/d6d/d7c/f85 0 2024-09-13T21:44:49.384 INFO:tasks.workunit.client.1.smithi155.stdout:7/158: rmdir d5/df/d27 0 2024-09-13T21:44:49.385 INFO:tasks.workunit.client.1.smithi155.stdout:7/159: chown f3 221 1 2024-09-13T21:44:49.385 INFO:tasks.workunit.client.0.smithi119.stdout:9/864: creat d0/d8/d18/d23/d42/d52/d53/f12a x:0 0 0 2024-09-13T21:44:49.386 INFO:tasks.workunit.client.1.smithi155.stdout:7/160: write d5/df/f19 [173899,60315] 0 2024-09-13T21:44:49.386 INFO:tasks.workunit.client.1.smithi155.stdout:3/312: unlink d3/d25/f39 0 2024-09-13T21:44:49.387 INFO:tasks.workunit.client.1.smithi155.stdout:7/161: chown d5/d13/f29 0 1 2024-09-13T21:44:49.389 INFO:tasks.workunit.client.0.smithi119.stdout:8/646: dread d1b/d1d/d48/f96 [0,4194304] 0 2024-09-13T21:44:49.390 INFO:tasks.workunit.client.0.smithi119.stdout:1/623: mknod d1/d3/d61/d77/d78/ccd 0 2024-09-13T21:44:49.390 INFO:tasks.workunit.client.1.smithi155.stdout:5/208: link d5/d16/d33/d1b/d22/f2e d5/d16/d33/d1b/d22/f42 0 2024-09-13T21:44:49.390 INFO:tasks.workunit.client.1.smithi155.stdout:1/223: fdatasync d6/d15/f45 0 2024-09-13T21:44:49.390 INFO:tasks.workunit.client.0.smithi119.stdout:7/683: truncate d8/d4d/f80 41227 0 2024-09-13T21:44:49.393 INFO:tasks.workunit.client.1.smithi155.stdout:3/313: mkdir d3/d25/d1b/d1f/d36/d5c/d66 0 2024-09-13T21:44:49.394 INFO:tasks.workunit.client.0.smithi119.stdout:9/865: creat d0/d8/d18/d23/d27/d2d/d70/dda/f12b x:0 0 0 2024-09-13T21:44:49.395 INFO:tasks.workunit.client.0.smithi119.stdout:7/684: mkdir d8/d19/dd7 0 2024-09-13T21:44:49.396 INFO:tasks.workunit.client.1.smithi155.stdout:3/314: readlink d3/d25/d1b/l43 0 2024-09-13T21:44:49.397 INFO:tasks.workunit.client.0.smithi119.stdout:4/652: stat d4/d1e/d28/d34/d99/ld2 0 2024-09-13T21:44:49.399 INFO:tasks.workunit.client.0.smithi119.stdout:8/647: link d1b/d1d/d5e/fc2 d1b/d1d/dc3/fc7 0 2024-09-13T21:44:49.401 INFO:tasks.workunit.client.1.smithi155.stdout:7/162: dwrite d5/df/f19 [0,4194304] 0 2024-09-13T21:44:49.401 INFO:tasks.workunit.client.0.smithi119.stdout:9/866: write d0/f2c [563871,124892] 0 2024-09-13T21:44:49.401 INFO:tasks.workunit.client.1.smithi155.stdout:5/209: link d5/f1c d5/d16/d33/f43 0 2024-09-13T21:44:49.402 INFO:tasks.workunit.client.0.smithi119.stdout:1/624: dwrite d1/d3/dc/d11/f17 [0,4194304] 0 2024-09-13T21:44:49.403 INFO:tasks.workunit.client.1.smithi155.stdout:7/163: stat c2 0 2024-09-13T21:44:49.403 INFO:tasks.workunit.client.1.smithi155.stdout:2/141: dwrite d2/dd/f17 [0,4194304] 0 2024-09-13T21:44:49.403 INFO:tasks.workunit.client.1.smithi155.stdout:3/315: rmdir d3/d21/d4a 39 2024-09-13T21:44:49.404 INFO:tasks.workunit.client.0.smithi119.stdout:4/653: symlink d4/d1e/d28/d34/d66/d76/d8f/ld4 0 2024-09-13T21:44:49.405 INFO:tasks.workunit.client.0.smithi119.stdout:1/625: truncate d1/d3/dc/f41 840459 0 2024-09-13T21:44:49.405 INFO:tasks.workunit.client.1.smithi155.stdout:5/210: dread - d5/d26/f35 zero size 2024-09-13T21:44:49.406 INFO:tasks.workunit.client.0.smithi119.stdout:8/648: creat d1b/d1d/d26/d6b/fc8 x:0 0 0 2024-09-13T21:44:49.407 INFO:tasks.workunit.client.1.smithi155.stdout:2/142: write f0 [1638842,28232] 0 2024-09-13T21:44:49.408 INFO:tasks.workunit.client.1.smithi155.stdout:6/307: dread f3 [0,4194304] 0 2024-09-13T21:44:49.409 INFO:tasks.workunit.client.0.smithi119.stdout:7/685: link d8/d3c/d53/d6b/f72 d8/d3c/d53/d37/d57/fd8 0 2024-09-13T21:44:49.410 INFO:tasks.workunit.client.0.smithi119.stdout:9/867: rmdir d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/d60 39 2024-09-13T21:44:49.413 INFO:tasks.workunit.client.1.smithi155.stdout:2/143: write d2/db/f27 [207000,94941] 0 2024-09-13T21:44:49.413 INFO:tasks.workunit.client.1.smithi155.stdout:4/232: write d1/d7/f30 [136959,113853] 0 2024-09-13T21:44:49.414 INFO:tasks.workunit.client.1.smithi155.stdout:1/224: rmdir d6/d15 39 2024-09-13T21:44:49.414 INFO:tasks.workunit.client.0.smithi119.stdout:4/654: mkdir d4/d1e/d26/d60/dad/dd5 0 2024-09-13T21:44:49.416 INFO:tasks.workunit.client.1.smithi155.stdout:7/164: creat d5/d10/f2a x:0 0 0 2024-09-13T21:44:49.417 INFO:tasks.workunit.client.0.smithi119.stdout:8/649: symlink d1b/d4e/d71/lc9 0 2024-09-13T21:44:49.417 INFO:tasks.workunit.client.0.smithi119.stdout:8/650: truncate d1b/d1d/f8f 1029879 0 2024-09-13T21:44:49.417 INFO:tasks.workunit.client.0.smithi119.stdout:7/686: rename d8/f24 to d8/d19/d2e/d34/d6e/fd9 0 2024-09-13T21:44:49.417 INFO:tasks.workunit.client.1.smithi155.stdout:3/316: rmdir d3/d10 39 2024-09-13T21:44:49.418 INFO:tasks.workunit.client.0.smithi119.stdout:1/626: dread d1/d3/f2a [0,4194304] 0 2024-09-13T21:44:49.418 INFO:tasks.workunit.client.1.smithi155.stdout:9/202: dwrite dc/de/ff [0,4194304] 0 2024-09-13T21:44:49.419 INFO:tasks.workunit.client.1.smithi155.stdout:3/317: dread - d3/d25/f5e zero size 2024-09-13T21:44:49.420 INFO:tasks.workunit.client.0.smithi119.stdout:4/655: fdatasync d4/d1e/f6b 0 2024-09-13T21:44:49.422 INFO:tasks.workunit.client.1.smithi155.stdout:6/308: creat db/d12/d1c/f58 x:0 0 0 2024-09-13T21:44:49.422 INFO:tasks.workunit.client.0.smithi119.stdout:8/651: write f18 [3878539,83395] 0 2024-09-13T21:44:49.424 INFO:tasks.workunit.client.0.smithi119.stdout:9/868: mknod d0/d8/d18/d23/d27/d2d/d5f/da8/c12c 0 2024-09-13T21:44:49.424 INFO:tasks.workunit.client.0.smithi119.stdout:2/583: write d1/d22/d5a/d5d/d83/f67 [215512,88465] 0 2024-09-13T21:44:49.425 INFO:tasks.workunit.client.1.smithi155.stdout:5/211: rename d5/d16/d33/d1b/d22 to d5/d16/d33/d1b/d2f/d3c/d44 0 2024-09-13T21:44:49.427 INFO:tasks.workunit.client.0.smithi119.stdout:7/687: creat d8/d3c/d53/d3b/d7e/fda x:0 0 0 2024-09-13T21:44:49.427 INFO:tasks.workunit.client.1.smithi155.stdout:4/233: unlink d1/f25 0 2024-09-13T21:44:49.427 INFO:tasks.workunit.client.0.smithi119.stdout:7/688: write d8/d19/d2e/d34/f5d [479364,30158] 0 2024-09-13T21:44:49.428 INFO:tasks.workunit.client.1.smithi155.stdout:7/165: write f3 [902931,121965] 0 2024-09-13T21:44:49.429 INFO:tasks.workunit.client.0.smithi119.stdout:1/627: creat d1/d3/dc/d11/d19/d2d/d37/d9d/fce x:0 0 0 2024-09-13T21:44:49.429 INFO:tasks.workunit.client.1.smithi155.stdout:2/144: mkdir d2/dd/de/d15/d2e 0 2024-09-13T21:44:49.430 INFO:tasks.workunit.client.0.smithi119.stdout:4/656: readlink d4/d1e/d26/d5e/l5f 0 2024-09-13T21:44:49.433 INFO:tasks.workunit.client.1.smithi155.stdout:7/166: dread d5/f1e [0,4194304] 0 2024-09-13T21:44:49.434 INFO:tasks.workunit.client.1.smithi155.stdout:1/225: mknod d6/d15/d23/c56 0 2024-09-13T21:44:49.434 INFO:tasks.workunit.client.0.smithi119.stdout:1/628: read d1/d3/dc/d11/f3c [2862522,28853] 0 2024-09-13T21:44:49.435 INFO:tasks.workunit.client.1.smithi155.stdout:1/226: chown d6/d7/l42 26 1 2024-09-13T21:44:49.436 INFO:tasks.workunit.client.0.smithi119.stdout:3/548: dwrite d6/f6c [0,4194304] 0 2024-09-13T21:44:49.436 INFO:tasks.workunit.client.1.smithi155.stdout:4/234: mkdir d1/d48 0 2024-09-13T21:44:49.437 INFO:tasks.workunit.client.0.smithi119.stdout:2/584: symlink d1/lbc 0 2024-09-13T21:44:49.438 INFO:tasks.workunit.client.1.smithi155.stdout:1/227: truncate d6/d7/f40 796163 0 2024-09-13T21:44:49.438 INFO:tasks.workunit.client.0.smithi119.stdout:6/562: write dc/d3d/d4e/f57 [2593164,75061] 0 2024-09-13T21:44:49.439 INFO:tasks.workunit.client.1.smithi155.stdout:3/318: mknod d3/d25/c67 0 2024-09-13T21:44:49.439 INFO:tasks.workunit.client.0.smithi119.stdout:7/689: creat d8/d3c/d46/fdb x:0 0 0 2024-09-13T21:44:49.441 INFO:tasks.workunit.client.0.smithi119.stdout:4/657: rename d4/d1e/d28/d34/d6a/lb6 to d4/d1e/d28/d34/d6a/d79/ld6 0 2024-09-13T21:44:49.441 INFO:tasks.workunit.client.1.smithi155.stdout:1/228: chown d6/d15/d3e/c11 941 1 2024-09-13T21:44:49.444 INFO:tasks.workunit.client.1.smithi155.stdout:4/235: symlink d1/l49 0 2024-09-13T21:44:49.447 INFO:tasks.workunit.client.1.smithi155.stdout:9/203: rename dc/de/f16 to dc/f49 0 2024-09-13T21:44:49.447 INFO:tasks.workunit.client.1.smithi155.stdout:7/167: dwrite d5/fe [0,4194304] 0 2024-09-13T21:44:49.448 INFO:tasks.workunit.client.0.smithi119.stdout:6/563: creat dc/df/d65/fb2 x:0 0 0 2024-09-13T21:44:49.449 INFO:tasks.workunit.client.1.smithi155.stdout:5/212: getdents d5/d16 0 2024-09-13T21:44:49.452 INFO:tasks.workunit.client.1.smithi155.stdout:1/229: mkdir d6/d15/d57 0 2024-09-13T21:44:49.452 INFO:tasks.workunit.client.1.smithi155.stdout:3/319: symlink d3/d10/l68 0 2024-09-13T21:44:49.454 INFO:tasks.workunit.client.0.smithi119.stdout:4/658: creat d4/d1e/fd7 x:0 0 0 2024-09-13T21:44:49.455 INFO:tasks.workunit.client.1.smithi155.stdout:5/213: dread f0 [0,4194304] 0 2024-09-13T21:44:49.455 INFO:tasks.workunit.client.1.smithi155.stdout:4/236: unlink d1/d7/de/dc/d2e/d26/f39 0 2024-09-13T21:44:49.456 INFO:tasks.workunit.client.0.smithi119.stdout:3/549: getdents d6/d44/d52/d85 0 2024-09-13T21:44:49.458 INFO:tasks.workunit.client.1.smithi155.stdout:9/204: creat dc/d19/d23/f4a x:0 0 0 2024-09-13T21:44:49.458 INFO:tasks.workunit.client.1.smithi155.stdout:2/145: link f1 d2/dd/f2f 0 2024-09-13T21:44:49.460 INFO:tasks.workunit.client.0.smithi119.stdout:1/629: rename d1/d3/dc/d11/d19/d47/f7c to d1/d3/dc/d11/d19/d2d/fcf 0 2024-09-13T21:44:49.464 INFO:tasks.workunit.client.0.smithi119.stdout:6/564: mknod dc/d3d/d4e/d91/cb3 0 2024-09-13T21:44:49.464 INFO:tasks.workunit.client.1.smithi155.stdout:7/168: dread d5/d13/f21 [0,4194304] 0 2024-09-13T21:44:49.465 INFO:tasks.workunit.client.1.smithi155.stdout:2/146: dread d2/dd/de/d15/f2b [0,4194304] 0 2024-09-13T21:44:49.465 INFO:tasks.workunit.client.0.smithi119.stdout:9/869: dread d0/d8/d18/d23/d27/d2d/dc1/ddf/d81/fb0 [0,4194304] 0 2024-09-13T21:44:49.466 INFO:tasks.workunit.client.1.smithi155.stdout:4/237: chown d1/d7/d21/c28 131257894 1 2024-09-13T21:44:49.467 INFO:tasks.workunit.client.1.smithi155.stdout:9/205: fsync dc/f1a 0 2024-09-13T21:44:49.467 INFO:tasks.workunit.client.1.smithi155.stdout:4/238: read d1/f24 [34283,22554] 0 2024-09-13T21:44:49.468 INFO:tasks.workunit.client.0.smithi119.stdout:3/550: symlink d6/d15/d8f/lb6 0 2024-09-13T21:44:49.469 INFO:tasks.workunit.client.1.smithi155.stdout:3/320: mknod d3/d21/d4a/c69 0 2024-09-13T21:44:49.470 INFO:tasks.workunit.client.0.smithi119.stdout:2/585: write d1/d22/d5a/f8a [10325,36979] 0 2024-09-13T21:44:49.470 INFO:tasks.workunit.client.1.smithi155.stdout:3/321: fdatasync d3/d25/d17/f5b 0 2024-09-13T21:44:49.471 INFO:tasks.workunit.client.0.smithi119.stdout:3/551: write d6/d44/f80 [328695,5949] 0 2024-09-13T21:44:49.472 INFO:tasks.workunit.client.0.smithi119.stdout:1/630: unlink d1/d3/d61/d77/d78/d32/d33/d43/d74/fa5 0 2024-09-13T21:44:49.474 INFO:tasks.workunit.client.0.smithi119.stdout:6/565: creat dc/d4b/d6a/d75/fb4 x:0 0 0 2024-09-13T21:44:49.474 INFO:tasks.workunit.client.0.smithi119.stdout:9/870: dwrite d0/d8/d18/d23/fec [0,4194304] 0 2024-09-13T21:44:49.476 INFO:tasks.workunit.client.0.smithi119.stdout:4/659: getdents d4/d1e/d26/d60/d71/d83/dc3 0 2024-09-13T21:44:49.477 INFO:tasks.workunit.client.0.smithi119.stdout:6/566: dread - dc/df/d41/f61 zero size 2024-09-13T21:44:49.477 INFO:tasks.workunit.client.1.smithi155.stdout:9/206: write dc/de/ff [1227741,114442] 0 2024-09-13T21:44:49.478 INFO:tasks.workunit.client.0.smithi119.stdout:4/660: stat d4/f2b 0 2024-09-13T21:44:49.480 INFO:tasks.workunit.client.0.smithi119.stdout:3/552: symlink d6/d15/d1a/d45/d47/d4d/da7/lb7 0 2024-09-13T21:44:49.481 INFO:tasks.workunit.client.1.smithi155.stdout:4/239: rename d1/d7/de/d15/d32 to d1/d7/de/dc/d4a 0 2024-09-13T21:44:49.483 INFO:tasks.workunit.client.0.smithi119.stdout:8/652: dwrite d1b/d1d/d48/d58/f95 [0,4194304] 0 2024-09-13T21:44:49.484 INFO:tasks.workunit.client.1.smithi155.stdout:6/309: dread db/f1f [0,4194304] 0 2024-09-13T21:44:49.484 INFO:tasks.workunit.client.1.smithi155.stdout:5/214: getdents d5/d16 0 2024-09-13T21:44:49.485 INFO:tasks.workunit.client.1.smithi155.stdout:3/322: creat d3/d25/d1b/f6a x:0 0 0 2024-09-13T21:44:49.486 INFO:tasks.workunit.client.0.smithi119.stdout:1/631: mkdir d1/d3/d61/d77/d78/d32/d33/dd0 0 2024-09-13T21:44:49.487 INFO:tasks.workunit.client.0.smithi119.stdout:6/567: mknod dc/dd/d5e/d7a/d7e/cb5 0 2024-09-13T21:44:49.487 INFO:tasks.workunit.client.1.smithi155.stdout:7/169: truncate d5/df/f1a 1558875 0 2024-09-13T21:44:49.487 INFO:tasks.workunit.client.1.smithi155.stdout:7/170: read f3 [1600000,64903] 0 2024-09-13T21:44:49.488 INFO:tasks.workunit.client.1.smithi155.stdout:2/147: symlink d2/db/l30 0 2024-09-13T21:44:49.490 INFO:tasks.workunit.client.0.smithi119.stdout:3/553: truncate d6/d15/d1a/f41 1304696 0 2024-09-13T21:44:49.492 INFO:tasks.workunit.client.0.smithi119.stdout:8/653: dwrite d1b/d4e/f5a [8388608,4194304] 0 2024-09-13T21:44:49.492 INFO:tasks.workunit.client.1.smithi155.stdout:1/230: getdents d6/d15/d3e/d17/d30 0 2024-09-13T21:44:49.493 INFO:tasks.workunit.client.0.smithi119.stdout:4/661: rename d4/d1e/d28/d34/d66/f87 to d4/d1e/d28/d34/d99/fd8 0 2024-09-13T21:44:49.494 INFO:tasks.workunit.client.1.smithi155.stdout:9/207: chown dc/d19/d23/l3e 2094399 1 2024-09-13T21:44:49.495 INFO:tasks.workunit.client.1.smithi155.stdout:4/240: creat d1/d7/de/d15/f4b x:0 0 0 2024-09-13T21:44:49.496 INFO:tasks.workunit.client.1.smithi155.stdout:5/215: truncate f0 2749305 0 2024-09-13T21:44:49.497 INFO:tasks.workunit.client.0.smithi119.stdout:2/586: creat d1/d7/fbd x:0 0 0 2024-09-13T21:44:49.499 INFO:tasks.workunit.client.1.smithi155.stdout:3/323: rename d3/d21/l4b to d3/d10/l6b 0 2024-09-13T21:44:49.501 INFO:tasks.workunit.client.0.smithi119.stdout:9/871: creat d0/d79/f12d x:0 0 0 2024-09-13T21:44:49.501 INFO:tasks.workunit.client.1.smithi155.stdout:2/148: write d2/dd/de/f13 [486045,97056] 0 2024-09-13T21:44:49.501 INFO:tasks.workunit.client.1.smithi155.stdout:1/231: truncate d6/d15/d3e/f4a 1302483 0 2024-09-13T21:44:49.503 INFO:tasks.workunit.client.1.smithi155.stdout:9/208: mknod dc/d19/d23/d38/c4b 0 2024-09-13T21:44:49.503 INFO:tasks.workunit.client.1.smithi155.stdout:8/213: sync 2024-09-13T21:44:49.503 INFO:tasks.workunit.client.1.smithi155.stdout:3/324: fsync d3/d25/d1b/d1f/d36/d5c/f63 0 2024-09-13T21:44:49.503 INFO:tasks.workunit.client.0.smithi119.stdout:1/632: rename d1/f58 to d1/d3/d61/d77/d78/d32/d33/dd0/fd1 0 2024-09-13T21:44:49.504 INFO:tasks.workunit.client.0.smithi119.stdout:2/587: fdatasync d1/d38/d89/d6b/f87 0 2024-09-13T21:44:49.508 INFO:tasks.workunit.client.0.smithi119.stdout:1/633: chown d1/l5c 173786744 1 2024-09-13T21:44:49.510 INFO:tasks.workunit.client.1.smithi155.stdout:2/149: rmdir d2/dd 39 2024-09-13T21:44:49.511 INFO:tasks.workunit.client.0.smithi119.stdout:7/690: dwrite d8/d19/d2e/d34/d6e/fd9 [0,4194304] 0 2024-09-13T21:44:49.511 INFO:tasks.workunit.client.0.smithi119.stdout:4/662: dwrite d4/d1e/d28/d34/d66/fd1 [0,4194304] 0 2024-09-13T21:44:49.512 INFO:tasks.workunit.client.1.smithi155.stdout:1/232: creat d6/d15/f58 x:0 0 0 2024-09-13T21:44:49.512 INFO:tasks.workunit.client.1.smithi155.stdout:8/214: read d2/d6/dd/d25/f29 [3276614,56348] 0 2024-09-13T21:44:49.512 INFO:tasks.workunit.client.1.smithi155.stdout:4/241: dread d1/d7/de/dc/d2e/f34 [0,4194304] 0 2024-09-13T21:44:49.513 INFO:tasks.workunit.client.1.smithi155.stdout:3/325: unlink d3/d25/c5f 0 2024-09-13T21:44:49.514 INFO:tasks.workunit.client.1.smithi155.stdout:8/215: dread - d2/d8/f36 zero size 2024-09-13T21:44:49.514 INFO:tasks.workunit.client.1.smithi155.stdout:9/209: creat dc/d19/d23/d2f/f4c x:0 0 0 2024-09-13T21:44:49.515 INFO:tasks.workunit.client.1.smithi155.stdout:3/326: chown d3/d10/f46 649268721 1 2024-09-13T21:44:49.516 INFO:tasks.workunit.client.0.smithi119.stdout:6/568: dwrite dc/d4b/f79 [4194304,4194304] 0 2024-09-13T21:44:49.518 INFO:tasks.workunit.client.1.smithi155.stdout:6/310: dwrite db/d12/f23 [4194304,4194304] 0 2024-09-13T21:44:49.520 INFO:tasks.workunit.client.1.smithi155.stdout:6/311: dread - db/d11/d1e/d21/f4d zero size 2024-09-13T21:44:49.521 INFO:tasks.workunit.client.0.smithi119.stdout:4/663: dread - d4/d1e/d28/fc8 zero size 2024-09-13T21:44:49.522 INFO:tasks.workunit.client.0.smithi119.stdout:7/691: chown d8/d3c/d53/d3b/d7e/dc2 1 1 2024-09-13T21:44:49.522 INFO:tasks.workunit.client.1.smithi155.stdout:8/216: chown l0 2 1 2024-09-13T21:44:49.523 INFO:tasks.workunit.client.0.smithi119.stdout:3/554: getdents d6/d25/d2f/d33/d88 0 2024-09-13T21:44:49.525 INFO:tasks.workunit.client.0.smithi119.stdout:7/692: write d8/f17 [1539082,113287] 0 2024-09-13T21:44:49.526 INFO:tasks.workunit.client.1.smithi155.stdout:8/217: truncate d2/d1f/f2b 1337795 0 2024-09-13T21:44:49.526 INFO:tasks.workunit.client.1.smithi155.stdout:6/312: creat db/d2c/f59 x:0 0 0 2024-09-13T21:44:49.526 INFO:tasks.workunit.client.0.smithi119.stdout:1/634: chown d1/d3/d61/d77/d78/c36 10 1 2024-09-13T21:44:49.528 INFO:tasks.workunit.client.1.smithi155.stdout:7/171: rename d5/df/d15/l23 to d5/df/l2b 0 2024-09-13T21:44:49.528 INFO:tasks.workunit.client.1.smithi155.stdout:8/218: truncate d2/d6/f27 695986 0 2024-09-13T21:44:49.529 INFO:tasks.workunit.client.1.smithi155.stdout:5/216: dwrite d5/fe [0,4194304] 0 2024-09-13T21:44:49.530 INFO:tasks.workunit.client.0.smithi119.stdout:7/693: write d8/d3c/d53/d3b/d7e/fd5 [889511,128294] 0 2024-09-13T21:44:49.532 INFO:tasks.workunit.client.1.smithi155.stdout:3/327: link d3/d25/f1c d3/d25/d1b/d1f/d36/f6c 0 2024-09-13T21:44:49.534 INFO:tasks.workunit.client.0.smithi119.stdout:9/872: creat d0/d8/d18/f12e x:0 0 0 2024-09-13T21:44:49.536 INFO:tasks.workunit.client.1.smithi155.stdout:8/219: creat d2/d1f/d39/f41 x:0 0 0 2024-09-13T21:44:49.537 INFO:tasks.workunit.client.1.smithi155.stdout:5/217: mkdir d5/d26/d45 0 2024-09-13T21:44:49.537 INFO:tasks.workunit.client.1.smithi155.stdout:6/313: dwrite db/d12/d1c/f58 [0,4194304] 0 2024-09-13T21:44:49.538 INFO:tasks.workunit.client.1.smithi155.stdout:5/218: stat d5/d26/d45 0 2024-09-13T21:44:49.539 INFO:tasks.workunit.client.0.smithi119.stdout:4/664: truncate d4/d1e/d26/d6d/f72 3738515 0 2024-09-13T21:44:49.539 INFO:tasks.workunit.client.0.smithi119.stdout:9/873: write d0/d19/f46 [2217240,121816] 0 2024-09-13T21:44:49.540 INFO:tasks.workunit.client.1.smithi155.stdout:4/242: getdents d1/d7/de/dc/d4a 0 2024-09-13T21:44:49.540 INFO:tasks.workunit.client.1.smithi155.stdout:7/172: mknod d5/df/c2c 0 2024-09-13T21:44:49.541 INFO:tasks.workunit.client.0.smithi119.stdout:2/588: creat d1/d22/d55/d31/fbe x:0 0 0 2024-09-13T21:44:49.541 INFO:tasks.workunit.client.0.smithi119.stdout:3/555: link d6/d25/c97 d6/d15/da9/cb8 0 2024-09-13T21:44:49.541 INFO:tasks.workunit.client.1.smithi155.stdout:5/219: write d5/d26/f35 [672817,68826] 0 2024-09-13T21:44:49.542 INFO:tasks.workunit.client.1.smithi155.stdout:7/173: truncate d5/df/d15/f28 122982 0 2024-09-13T21:44:49.543 INFO:tasks.workunit.client.1.smithi155.stdout:3/328: unlink d3/d25/d1b/d1f/d36/l42 0 2024-09-13T21:44:49.544 INFO:tasks.workunit.client.0.smithi119.stdout:6/569: dwrite dc/d3d/d40/f49 [8388608,4194304] 0 2024-09-13T21:44:49.544 INFO:tasks.workunit.client.1.smithi155.stdout:4/243: symlink d1/l4c 0 2024-09-13T21:44:49.546 INFO:tasks.workunit.client.1.smithi155.stdout:6/314: rename db/d11/d2b/l4a to db/d12/d1c/d36/d37/l5a 0 2024-09-13T21:44:49.547 INFO:tasks.workunit.client.1.smithi155.stdout:6/315: chown db/d11/d1e/d21 0 1 2024-09-13T21:44:49.547 INFO:tasks.workunit.client.1.smithi155.stdout:5/220: creat d5/d26/f46 x:0 0 0 2024-09-13T21:44:49.548 INFO:tasks.workunit.client.0.smithi119.stdout:4/665: rmdir d4/d1e/d28/d34 39 2024-09-13T21:44:49.548 INFO:tasks.workunit.client.1.smithi155.stdout:7/174: truncate d5/df/f11 3408089 0 2024-09-13T21:44:49.548 INFO:tasks.workunit.client.1.smithi155.stdout:5/221: fdatasync d5/d12/f14 0 2024-09-13T21:44:49.549 INFO:tasks.workunit.client.1.smithi155.stdout:6/316: write db/d11/d1e/f3e [1296681,51789] 0 2024-09-13T21:44:49.550 INFO:tasks.workunit.client.1.smithi155.stdout:3/329: symlink d3/d21/l6d 0 2024-09-13T21:44:49.550 INFO:tasks.workunit.client.0.smithi119.stdout:6/570: write dc/dd/d5e/d7a/d7e/fb1 [325750,115008] 0 2024-09-13T21:44:49.550 INFO:tasks.workunit.client.1.smithi155.stdout:4/244: write d1/d7/de/dc/d4a/f38 [5077882,77407] 0 2024-09-13T21:44:49.552 INFO:tasks.workunit.client.0.smithi119.stdout:1/635: dwrite d1/d3/d61/d77/d78/d32/fb9 [0,4194304] 0 2024-09-13T21:44:49.556 INFO:tasks.workunit.client.1.smithi155.stdout:7/175: creat d5/f2d x:0 0 0 2024-09-13T21:44:49.556 INFO:tasks.workunit.client.1.smithi155.stdout:6/317: mkdir db/d11/d5b 0 2024-09-13T21:44:49.557 INFO:tasks.workunit.client.0.smithi119.stdout:2/589: creat d1/d22/d5a/da9/fbf x:0 0 0 2024-09-13T21:44:49.558 INFO:tasks.workunit.client.0.smithi119.stdout:9/874: mkdir d0/d8/d18/d23/d42/d12f 0 2024-09-13T21:44:49.559 INFO:tasks.workunit.client.1.smithi155.stdout:5/222: creat d5/f47 x:0 0 0 2024-09-13T21:44:49.559 INFO:tasks.workunit.client.0.smithi119.stdout:7/694: dwrite d8/d19/f1a [0,4194304] 0 2024-09-13T21:44:49.560 INFO:tasks.workunit.client.1.smithi155.stdout:7/176: symlink d5/d13/l2e 0 2024-09-13T21:44:49.560 INFO:tasks.workunit.client.1.smithi155.stdout:7/177: fsync d5/fc 0 2024-09-13T21:44:49.561 INFO:tasks.workunit.client.1.smithi155.stdout:7/178: chown d5/d13/f14 981 1 2024-09-13T21:44:49.562 INFO:tasks.workunit.client.1.smithi155.stdout:3/330: creat d3/d21/f6e x:0 0 0 2024-09-13T21:44:49.564 INFO:tasks.workunit.client.1.smithi155.stdout:6/318: rename db/d11/d2b/c40 to db/d11/d2b/d35/c5c 0 2024-09-13T21:44:49.564 INFO:tasks.workunit.client.0.smithi119.stdout:1/636: mknod d1/d3/d61/d77/d78/d32/d33/d43/d74/cd2 0 2024-09-13T21:44:49.566 INFO:tasks.workunit.client.0.smithi119.stdout:8/654: dread d1b/d1d/d48/f90 [0,4194304] 0 2024-09-13T21:44:49.566 INFO:tasks.workunit.client.0.smithi119.stdout:9/875: fsync d0/d19/f89 0 2024-09-13T21:44:49.567 INFO:tasks.workunit.client.0.smithi119.stdout:4/666: truncate d4/d1e/d28/d34/d66/d76/d8f/fc0 240851 0 2024-09-13T21:44:49.567 INFO:tasks.workunit.client.0.smithi119.stdout:7/695: symlink d8/d3c/d53/d6b/ldc 0 2024-09-13T21:44:49.569 INFO:tasks.workunit.client.0.smithi119.stdout:2/590: creat d1/d22/fc0 x:0 0 0 2024-09-13T21:44:49.570 INFO:tasks.workunit.client.0.smithi119.stdout:7/696: dread - d8/d4d/fcd zero size 2024-09-13T21:44:49.570 INFO:tasks.workunit.client.1.smithi155.stdout:8/220: truncate d2/f30 728269 0 2024-09-13T21:44:49.570 INFO:tasks.workunit.client.1.smithi155.stdout:3/331: fdatasync d3/fa 0 2024-09-13T21:44:49.570 INFO:tasks.workunit.client.0.smithi119.stdout:1/637: fdatasync d1/d3/d61/d77/d78/d32/d33/d43/f5e 0 2024-09-13T21:44:49.571 INFO:tasks.workunit.client.0.smithi119.stdout:3/556: truncate d6/d25/d2f/f39 622979 0 2024-09-13T21:44:49.573 INFO:tasks.workunit.client.0.smithi119.stdout:4/667: chown d4/d1e/d26/d60/d71/fc6 23648 1 2024-09-13T21:44:49.574 INFO:tasks.workunit.client.0.smithi119.stdout:8/655: truncate d1b/d1d/d26/f3d 9053563 0 2024-09-13T21:44:49.575 INFO:tasks.workunit.client.1.smithi155.stdout:5/223: link d5/f7 d5/d12/f48 0 2024-09-13T21:44:49.575 INFO:tasks.workunit.client.0.smithi119.stdout:9/876: symlink d0/d8/d18/d23/d27/d2d/d5f/ded/dee/l130 0 2024-09-13T21:44:49.576 INFO:tasks.workunit.client.1.smithi155.stdout:6/319: rename db/d12/d1c/d36/l57 to db/d12/d1c/d55/l5d 0 2024-09-13T21:44:49.576 INFO:tasks.workunit.client.0.smithi119.stdout:2/591: creat d1/d38/d89/d6b/d8c/fc1 x:0 0 0 2024-09-13T21:44:49.576 INFO:tasks.workunit.client.0.smithi119.stdout:1/638: stat d1/d3/dc/d11/d19/d47/lbf 0 2024-09-13T21:44:49.577 INFO:tasks.workunit.client.1.smithi155.stdout:7/179: symlink d5/l2f 0 2024-09-13T21:44:49.577 INFO:tasks.workunit.client.0.smithi119.stdout:3/557: mkdir d6/d25/d2f/d33/d88/db9 0 2024-09-13T21:44:49.578 INFO:tasks.workunit.client.0.smithi119.stdout:8/656: mknod d1b/d4e/d71/cca 0 2024-09-13T21:44:49.579 INFO:tasks.workunit.client.1.smithi155.stdout:9/210: truncate dc/d19/d23/f30 982126 0 2024-09-13T21:44:49.579 INFO:tasks.workunit.client.1.smithi155.stdout:8/221: dwrite d2/d1f/d39/f41 [0,4194304] 0 2024-09-13T21:44:49.580 INFO:tasks.workunit.client.0.smithi119.stdout:4/668: mknod d4/d1e/d26/d6d/cd9 0 2024-09-13T21:44:49.580 INFO:tasks.workunit.client.0.smithi119.stdout:9/877: write d0/d8/d18/d23/d42/d52/d53/f12a [356524,39900] 0 2024-09-13T21:44:49.580 INFO:tasks.workunit.client.1.smithi155.stdout:2/150: truncate d2/dd/de/f14 3105511 0 2024-09-13T21:44:49.582 INFO:tasks.workunit.client.0.smithi119.stdout:2/592: rename d1/d22/d5a/d5d/d83/f79 to d1/d22/d55/d64/fc2 0 2024-09-13T21:44:49.582 INFO:tasks.workunit.client.1.smithi155.stdout:9/211: write dc/d19/d23/d2f/f4c [811428,75161] 0 2024-09-13T21:44:49.582 INFO:tasks.workunit.client.1.smithi155.stdout:8/222: chown d2/d6/dd/d12/f3a 454 1 2024-09-13T21:44:49.584 INFO:tasks.workunit.client.1.smithi155.stdout:6/320: mkdir db/d12/d1c/d2a/d5e 0 2024-09-13T21:44:49.585 INFO:tasks.workunit.client.0.smithi119.stdout:7/697: truncate d8/d3c/d53/d37/d83/d89/d47/f65 1479496 0 2024-09-13T21:44:49.587 INFO:tasks.workunit.client.0.smithi119.stdout:3/558: truncate d6/d15/d1a/d45/f69 96574 0 2024-09-13T21:44:49.589 INFO:tasks.workunit.client.1.smithi155.stdout:7/180: rmdir d5/d10 39 2024-09-13T21:44:49.589 INFO:tasks.workunit.client.0.smithi119.stdout:1/639: dwrite d1/d3/dc/f41 [0,4194304] 0 2024-09-13T21:44:49.589 INFO:tasks.workunit.client.0.smithi119.stdout:9/878: creat d0/d8/d18/d23/d27/d2d/dc1/ddf/d81/d128/f131 x:0 0 0 2024-09-13T21:44:49.592 INFO:tasks.workunit.client.0.smithi119.stdout:9/879: chown d0/d8/d18/d23/d27/d2d/d70/lac 777819889 1 2024-09-13T21:44:49.592 INFO:tasks.workunit.client.0.smithi119.stdout:6/571: write dc/df/fac [644345,125867] 0 2024-09-13T21:44:49.594 INFO:tasks.workunit.client.0.smithi119.stdout:6/572: chown dc/df/d65/fb2 5111415 1 2024-09-13T21:44:49.595 INFO:tasks.workunit.client.1.smithi155.stdout:8/223: mknod d2/d6/c42 0 2024-09-13T21:44:49.595 INFO:tasks.workunit.client.0.smithi119.stdout:9/880: write d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/fd6 [1035418,3560] 0 2024-09-13T21:44:49.595 INFO:tasks.workunit.client.1.smithi155.stdout:7/181: dread d5/fe [0,4194304] 0 2024-09-13T21:44:49.597 INFO:tasks.workunit.client.0.smithi119.stdout:9/881: readlink d0/d8/d18/dad/lb6 0 2024-09-13T21:44:49.600 INFO:tasks.workunit.client.1.smithi155.stdout:3/332: link d3/d25/d17/f3d d3/d25/d1b/d1f/d36/d5c/d66/f6f 0 2024-09-13T21:44:49.600 INFO:tasks.workunit.client.0.smithi119.stdout:9/882: chown d0/d8/d18/d23/d27/d2d 9 1 2024-09-13T21:44:49.600 INFO:tasks.workunit.client.0.smithi119.stdout:6/573: creat dc/df/fb6 x:0 0 0 2024-09-13T21:44:49.601 INFO:tasks.workunit.client.1.smithi155.stdout:5/224: creat d5/f49 x:0 0 0 2024-09-13T21:44:49.601 INFO:tasks.workunit.client.0.smithi119.stdout:1/640: dwrite d1/d3/d61/d77/d78/d32/fb9 [0,4194304] 0 2024-09-13T21:44:49.601 INFO:tasks.workunit.client.0.smithi119.stdout:6/574: stat dc/d4b/d6a/d75/caf 0 2024-09-13T21:44:49.601 INFO:tasks.workunit.client.1.smithi155.stdout:2/151: mkdir d2/dd/de/d15/d2e/d31 0 2024-09-13T21:44:49.602 INFO:tasks.workunit.client.1.smithi155.stdout:5/225: write d5/fe [4066265,116722] 0 2024-09-13T21:44:49.605 INFO:tasks.workunit.client.1.smithi155.stdout:9/212: creat dc/d19/d23/d2f/d43/f4d x:0 0 0 2024-09-13T21:44:49.606 INFO:tasks.workunit.client.0.smithi119.stdout:6/575: creat dc/d3a/fb7 x:0 0 0 2024-09-13T21:44:49.606 INFO:tasks.workunit.client.1.smithi155.stdout:8/224: write d2/f20 [44017,22909] 0 2024-09-13T21:44:49.607 INFO:tasks.workunit.client.0.smithi119.stdout:1/641: mkdir d1/d3/dc/d11/d3d/dd3 0 2024-09-13T21:44:49.609 INFO:tasks.workunit.client.0.smithi119.stdout:6/576: read - dc/dd/d5e/d7a/d7e/f94 zero size 2024-09-13T21:44:49.612 INFO:tasks.workunit.client.0.smithi119.stdout:4/669: write d4/d1e/d28/d5d/fa0 [2106772,61034] 0 2024-09-13T21:44:49.614 INFO:tasks.workunit.client.1.smithi155.stdout:3/333: symlink d3/d21/d4a/l70 0 2024-09-13T21:44:49.615 INFO:tasks.workunit.client.0.smithi119.stdout:2/593: write d1/d7/d47/f8b [848968,32162] 0 2024-09-13T21:44:49.615 INFO:tasks.workunit.client.1.smithi155.stdout:2/152: creat d2/dd/d21/f32 x:0 0 0 2024-09-13T21:44:49.615 INFO:tasks.workunit.client.1.smithi155.stdout:3/334: write d3/d25/d1b/f4e [5252392,90163] 0 2024-09-13T21:44:49.616 INFO:tasks.workunit.client.1.smithi155.stdout:5/226: creat d5/d16/d33/d1b/d28/f4a x:0 0 0 2024-09-13T21:44:49.617 INFO:tasks.workunit.client.1.smithi155.stdout:5/227: chown d5/f49 2 1 2024-09-13T21:44:49.619 INFO:tasks.workunit.client.1.smithi155.stdout:3/335: write d3/d25/d17/f5b [23949,120644] 0 2024-09-13T21:44:49.620 INFO:tasks.workunit.client.1.smithi155.stdout:9/213: symlink dc/d19/d23/l4e 0 2024-09-13T21:44:49.620 INFO:tasks.workunit.client.0.smithi119.stdout:7/698: write d8/d3c/d53/d37/d57/d8f/fa7 [4667356,13422] 0 2024-09-13T21:44:49.620 INFO:tasks.workunit.client.0.smithi119.stdout:1/642: dwrite d1/d3/d61/d77/d78/fa4 [4194304,4194304] 0 2024-09-13T21:44:49.620 INFO:tasks.workunit.client.0.smithi119.stdout:2/594: write d1/f4a [859066,79634] 0 2024-09-13T21:44:49.621 INFO:tasks.workunit.client.0.smithi119.stdout:4/670: creat d4/d1e/fda x:0 0 0 2024-09-13T21:44:49.623 INFO:tasks.workunit.client.1.smithi155.stdout:5/228: write d5/f9 [557242,12364] 0 2024-09-13T21:44:49.625 INFO:tasks.workunit.client.1.smithi155.stdout:2/153: symlink d2/dd/de/d15/d2e/l33 0 2024-09-13T21:44:49.626 INFO:tasks.workunit.client.0.smithi119.stdout:9/883: dread d0/d8/d18/d23/d27/d2d/d5f/da8/fb8 [0,4194304] 0 2024-09-13T21:44:49.626 INFO:tasks.workunit.client.1.smithi155.stdout:7/182: creat d5/f30 x:0 0 0 2024-09-13T21:44:49.627 INFO:tasks.workunit.client.1.smithi155.stdout:9/214: write fb [4465517,33157] 0 2024-09-13T21:44:49.628 INFO:tasks.workunit.client.0.smithi119.stdout:4/671: dread - d4/d1e/d28/d34/d66/d76/f97 zero size 2024-09-13T21:44:49.630 INFO:tasks.workunit.client.1.smithi155.stdout:9/215: write fb [3493137,15412] 0 2024-09-13T21:44:49.630 INFO:tasks.workunit.client.0.smithi119.stdout:3/559: dwrite d6/d15/f35 [0,4194304] 0 2024-09-13T21:44:49.633 INFO:tasks.workunit.client.1.smithi155.stdout:5/229: unlink d5/d16/d33/d1b/d2f/d3c/f3d 0 2024-09-13T21:44:49.634 INFO:tasks.workunit.client.1.smithi155.stdout:7/183: mkdir d5/d13/d31 0 2024-09-13T21:44:49.635 INFO:tasks.workunit.client.0.smithi119.stdout:3/560: stat d6/d15/d1a/d45/d47/d4d/da7/fb1 0 2024-09-13T21:44:49.635 INFO:tasks.workunit.client.0.smithi119.stdout:9/884: mkdir d0/d79/d132 0 2024-09-13T21:44:49.635 INFO:tasks.workunit.client.1.smithi155.stdout:5/230: truncate d5/d26/f35 1413304 0 2024-09-13T21:44:49.637 INFO:tasks.workunit.client.0.smithi119.stdout:7/699: rename d8/d3c/d53/d37/d83/d89/f12 to d8/d19/d2e/fdd 0 2024-09-13T21:44:49.638 INFO:tasks.workunit.client.0.smithi119.stdout:2/595: dread d1/d38/d89/f34 [4194304,4194304] 0 2024-09-13T21:44:49.640 INFO:tasks.workunit.client.0.smithi119.stdout:3/561: mknod d6/d15/d8f/cba 0 2024-09-13T21:44:49.641 INFO:tasks.workunit.client.1.smithi155.stdout:7/184: symlink d5/df/d15/l32 0 2024-09-13T21:44:49.642 INFO:tasks.workunit.client.0.smithi119.stdout:4/672: dwrite d4/f52 [0,4194304] 0 2024-09-13T21:44:49.643 INFO:tasks.workunit.client.0.smithi119.stdout:9/885: readlink d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/d117/l120 0 2024-09-13T21:44:49.643 INFO:tasks.workunit.client.0.smithi119.stdout:7/700: dread - d8/d3c/d53/d37/d57/d5f/fd1 zero size 2024-09-13T21:44:49.644 INFO:tasks.workunit.client.1.smithi155.stdout:7/185: mkdir d5/df/d15/d33 0 2024-09-13T21:44:49.644 INFO:tasks.workunit.client.0.smithi119.stdout:1/643: rename d1/d3/d61/d77/d78/d32/d33/d72/f9f to d1/d3/d61/d77/d78/db8/fd4 0 2024-09-13T21:44:49.647 INFO:tasks.workunit.client.0.smithi119.stdout:3/562: mkdir d6/d15/d8f/dbb 0 2024-09-13T21:44:49.647 INFO:tasks.workunit.client.0.smithi119.stdout:1/644: stat d1/d3/d6c/da8 0 2024-09-13T21:44:49.648 INFO:tasks.workunit.client.0.smithi119.stdout:6/577: dwrite dc/df/d32/f6c [4194304,4194304] 0 2024-09-13T21:44:49.649 INFO:tasks.workunit.client.0.smithi119.stdout:7/701: symlink d8/d19/d2e/d34/lde 0 2024-09-13T21:44:49.649 INFO:tasks.workunit.client.0.smithi119.stdout:4/673: read d4/d1e/d26/f2d [868354,74977] 0 2024-09-13T21:44:49.649 INFO:tasks.workunit.client.1.smithi155.stdout:6/321: truncate db/f1f 398703 0 2024-09-13T21:44:49.652 INFO:tasks.workunit.client.1.smithi155.stdout:7/186: write d5/df/f11 [3927659,57758] 0 2024-09-13T21:44:49.652 INFO:tasks.workunit.client.0.smithi119.stdout:1/645: creat d1/fd5 x:0 0 0 2024-09-13T21:44:49.653 INFO:tasks.workunit.client.1.smithi155.stdout:6/322: write f3 [4792949,72436] 0 2024-09-13T21:44:49.654 INFO:tasks.workunit.client.1.smithi155.stdout:6/323: stat db/d12/d1c/f58 0 2024-09-13T21:44:49.654 INFO:tasks.workunit.client.0.smithi119.stdout:3/563: mkdir d6/d15/d1a/d45/d8d/dbc 0 2024-09-13T21:44:49.655 INFO:tasks.workunit.client.0.smithi119.stdout:3/564: chown d6/d15/d1a/d45/d8d/dbc 223923 1 2024-09-13T21:44:49.660 INFO:tasks.workunit.client.0.smithi119.stdout:4/674: unlink d4/d1e/d28/d34/d6a/d79/dae/fb1 0 2024-09-13T21:44:49.661 INFO:tasks.workunit.client.1.smithi155.stdout:6/324: unlink db/d11/d4c/f52 0 2024-09-13T21:44:49.661 INFO:tasks.workunit.client.1.smithi155.stdout:3/336: write d3/d25/f1c [4217821,70526] 0 2024-09-13T21:44:49.661 INFO:tasks.workunit.client.1.smithi155.stdout:6/325: fdatasync db/f10 0 2024-09-13T21:44:49.663 INFO:tasks.workunit.client.0.smithi119.stdout:7/702: rename d8/d3c/d53/d6b/ldc to d8/d3c/d53/d3b/ldf 0 2024-09-13T21:44:49.664 INFO:tasks.workunit.client.0.smithi119.stdout:1/646: creat d1/d3/fd6 x:0 0 0 2024-09-13T21:44:49.666 INFO:tasks.workunit.client.1.smithi155.stdout:7/187: dread d5/df/d15/f1f [0,4194304] 0 2024-09-13T21:44:49.666 INFO:tasks.workunit.client.0.smithi119.stdout:6/578: symlink dc/d4b/d97/lb8 0 2024-09-13T21:44:49.667 INFO:tasks.workunit.client.1.smithi155.stdout:8/225: dwrite d2/d6/f19 [0,4194304] 0 2024-09-13T21:44:49.668 INFO:tasks.workunit.client.0.smithi119.stdout:9/886: rmdir d0/d8/d18/d23/dea/d126 0 2024-09-13T21:44:49.668 INFO:tasks.workunit.client.0.smithi119.stdout:7/703: chown d8/d3c/d53/d37/d57/cb6 221528 1 2024-09-13T21:44:49.670 INFO:tasks.workunit.client.1.smithi155.stdout:3/337: mknod d3/d25/d1b/c71 0 2024-09-13T21:44:49.671 INFO:tasks.workunit.client.0.smithi119.stdout:2/596: dwrite d1/d22/d5a/d5d/f61 [0,4194304] 0 2024-09-13T21:44:49.671 INFO:tasks.workunit.client.0.smithi119.stdout:1/647: write d1/d3/dc/d11/d19/d47/fa7 [422313,117413] 0 2024-09-13T21:44:49.673 INFO:tasks.workunit.client.1.smithi155.stdout:0/295: sync 2024-09-13T21:44:49.673 INFO:tasks.workunit.client.1.smithi155.stdout:6/326: dwrite f3 [4194304,4194304] 0 2024-09-13T21:44:49.674 INFO:tasks.workunit.client.0.smithi119.stdout:4/675: unlink d4/d1e/d28/d34/d99/ld2 0 2024-09-13T21:44:49.675 INFO:tasks.workunit.client.0.smithi119.stdout:1/648: dread d1/d3/dc/d11/d28/f5d [0,4194304] 0 2024-09-13T21:44:49.677 INFO:tasks.workunit.client.1.smithi155.stdout:9/216: dread dc/de/d15/f24 [0,4194304] 0 2024-09-13T21:44:49.678 INFO:tasks.workunit.client.1.smithi155.stdout:7/188: chown d5/d10/f2a 7321 1 2024-09-13T21:44:49.679 INFO:tasks.workunit.client.0.smithi119.stdout:6/579: creat dc/dd/d5e/d7a/d86/fb9 x:0 0 0 2024-09-13T21:44:49.679 INFO:tasks.workunit.client.0.smithi119.stdout:6/580: chown dc/df/d5c/d98 8433 1 2024-09-13T21:44:49.680 INFO:tasks.workunit.client.0.smithi119.stdout:9/887: symlink d0/d8/d18/d23/d27/d2d/dc1/l133 0 2024-09-13T21:44:49.681 INFO:tasks.workunit.client.0.smithi119.stdout:7/704: creat d8/d19/dd7/fe0 x:0 0 0 2024-09-13T21:44:49.685 INFO:tasks.workunit.client.0.smithi119.stdout:6/581: mkdir dc/d3d/d4e/dba 0 2024-09-13T21:44:49.685 INFO:tasks.workunit.client.0.smithi119.stdout:3/565: write d6/d15/d1a/f79 [520505,64956] 0 2024-09-13T21:44:49.686 INFO:tasks.workunit.client.0.smithi119.stdout:9/888: mknod d0/d8/d18/de3/c134 0 2024-09-13T21:44:49.693 INFO:tasks.workunit.client.1.smithi155.stdout:2/154: dwrite d2/dd/f2f [0,4194304] 0 2024-09-13T21:44:49.698 INFO:tasks.workunit.client.1.smithi155.stdout:8/226: dwrite d2/f5 [0,4194304] 0 2024-09-13T21:44:49.700 INFO:tasks.workunit.client.1.smithi155.stdout:0/296: creat d1/d6/dc/f70 x:0 0 0 2024-09-13T21:44:49.701 INFO:tasks.workunit.client.1.smithi155.stdout:5/231: dwrite d5/d16/d33/d1b/d2f/d3c/d44/f3b [0,4194304] 0 2024-09-13T21:44:49.703 INFO:tasks.workunit.client.1.smithi155.stdout:9/217: dwrite dc/de/d15/f1c [0,4194304] 0 2024-09-13T21:44:49.703 INFO:tasks.workunit.client.1.smithi155.stdout:8/227: dread - d2/d1f/d39/f3e zero size 2024-09-13T21:44:49.707 INFO:tasks.workunit.client.1.smithi155.stdout:2/155: rename d2/dd/f2f to d2/dd/f34 0 2024-09-13T21:44:49.712 INFO:tasks.workunit.client.1.smithi155.stdout:9/218: symlink dc/d19/l4f 0 2024-09-13T21:44:49.714 INFO:tasks.workunit.client.1.smithi155.stdout:2/156: write d2/dd/f17 [4724009,91471] 0 2024-09-13T21:44:49.722 INFO:tasks.workunit.client.1.smithi155.stdout:3/338: dwrite d3/d10/f20 [0,4194304] 0 2024-09-13T21:44:49.722 INFO:tasks.workunit.client.1.smithi155.stdout:9/219: write dc/d18/d1e/f22 [2268517,6025] 0 2024-09-13T21:44:49.726 INFO:tasks.workunit.client.1.smithi155.stdout:5/232: dwrite d5/d16/d33/d1b/d28/f4a [0,4194304] 0 2024-09-13T21:44:49.726 INFO:tasks.workunit.client.1.smithi155.stdout:8/228: dread d2/d1f/f2b [0,4194304] 0 2024-09-13T21:44:49.727 INFO:tasks.workunit.client.0.smithi119.stdout:2/597: rmdir d1/d22/d5a/da9/db9 0 2024-09-13T21:44:49.727 INFO:tasks.workunit.client.0.smithi119.stdout:9/889: chown d0/d8/d18/d23/d27/d2d/dc1/ddf/cbc 34 1 2024-09-13T21:44:49.727 INFO:tasks.workunit.client.0.smithi119.stdout:4/676: rename d4/d1e/d26/f61 to d4/d1e/d26/fdb 0 2024-09-13T21:44:49.728 INFO:tasks.workunit.client.1.smithi155.stdout:5/233: write d5/d26/f35 [621887,98069] 0 2024-09-13T21:44:49.730 INFO:tasks.workunit.client.1.smithi155.stdout:8/229: write d2/d1f/d39/f41 [2161069,81130] 0 2024-09-13T21:44:49.732 INFO:tasks.workunit.client.0.smithi119.stdout:7/705: rename d8/d3c/d53/d6b/c75 to d8/d3c/ce1 0 2024-09-13T21:44:49.733 INFO:tasks.workunit.client.0.smithi119.stdout:3/566: getdents d6/d25/d2f/d33/d88/db9 0 2024-09-13T21:44:49.733 INFO:tasks.workunit.client.1.smithi155.stdout:5/234: chown d5/d12 4321 1 2024-09-13T21:44:49.737 INFO:tasks.workunit.client.0.smithi119.stdout:4/677: dwrite d4/d1e/d28/d34/d66/f93 [0,4194304] 0 2024-09-13T21:44:49.738 INFO:tasks.workunit.client.0.smithi119.stdout:7/706: mknod d8/d3c/d53/d37/d83/d89/ce2 0 2024-09-13T21:44:49.741 INFO:tasks.workunit.client.1.smithi155.stdout:6/327: truncate db/f1f 599213 0 2024-09-13T21:44:49.745 INFO:tasks.workunit.client.0.smithi119.stdout:7/707: link d8/d3c/d53/d37/d83/d89/f11 d8/d3c/fe3 0 2024-09-13T21:44:49.746 INFO:tasks.workunit.client.1.smithi155.stdout:9/220: truncate dc/d18/d1e/f22 3180163 0 2024-09-13T21:44:49.746 INFO:tasks.workunit.client.1.smithi155.stdout:5/235: dwrite d5/d16/d33/d1f/f20 [0,4194304] 0 2024-09-13T21:44:49.746 INFO:tasks.workunit.client.0.smithi119.stdout:6/582: rename dc/dd/d5e to dc/d3a/dbb 0 2024-09-13T21:44:49.749 INFO:tasks.workunit.client.1.smithi155.stdout:6/328: rename db/d12/d1c/d55 to db/d3d/d5f 0 2024-09-13T21:44:49.749 INFO:tasks.workunit.client.0.smithi119.stdout:3/567: rename d6/d15/d1a/f28 to d6/d15/d1a/d45/d8d/dbc/fbd 0 2024-09-13T21:44:49.751 INFO:tasks.workunit.client.1.smithi155.stdout:9/221: dread - dc/de/f3a zero size 2024-09-13T21:44:49.756 INFO:tasks.workunit.client.0.smithi119.stdout:6/583: rename dc/df/l25 to dc/d4b/lbc 0 2024-09-13T21:44:49.756 INFO:tasks.workunit.client.1.smithi155.stdout:5/236: dwrite d5/d16/f2a [0,4194304] 0 2024-09-13T21:44:49.759 INFO:tasks.workunit.client.0.smithi119.stdout:4/678: write d4/d1e/d28/d34/d66/f7b [270596,48454] 0 2024-09-13T21:44:49.759 INFO:tasks.workunit.client.0.smithi119.stdout:2/598: dwrite d1/f32 [0,4194304] 0 2024-09-13T21:44:49.760 INFO:tasks.workunit.client.1.smithi155.stdout:0/297: dread d1/d6/dc/f27 [0,4194304] 0 2024-09-13T21:44:49.760 INFO:tasks.workunit.client.0.smithi119.stdout:2/599: dread - d1/d38/d89/f9f zero size 2024-09-13T21:44:49.764 INFO:tasks.workunit.client.0.smithi119.stdout:4/679: unlink d4/d1e/d26/f77 0 2024-09-13T21:44:49.765 INFO:tasks.workunit.client.1.smithi155.stdout:6/329: dwrite db/d12/f17 [8388608,4194304] 0 2024-09-13T21:44:49.765 INFO:tasks.workunit.client.1.smithi155.stdout:5/237: rename d5/f13 to d5/d12/f4b 0 2024-09-13T21:44:49.766 INFO:tasks.workunit.client.0.smithi119.stdout:2/600: symlink d1/d38/d89/lc3 0 2024-09-13T21:44:49.766 INFO:tasks.workunit.client.0.smithi119.stdout:3/568: dread d6/f14 [0,4194304] 0 2024-09-13T21:44:49.766 INFO:tasks.workunit.client.1.smithi155.stdout:2/157: dread d2/db/f1d [0,4194304] 0 2024-09-13T21:44:49.766 INFO:tasks.workunit.client.1.smithi155.stdout:6/330: chown db/d11/d4c 28 1 2024-09-13T21:44:49.767 INFO:tasks.workunit.client.0.smithi119.stdout:3/569: write d6/d44/f80 [1250639,94690] 0 2024-09-13T21:44:49.767 INFO:tasks.workunit.client.0.smithi119.stdout:4/680: mkdir d4/ddc 0 2024-09-13T21:44:49.770 INFO:tasks.workunit.client.1.smithi155.stdout:3/339: dread d3/d25/d17/f3d [0,4194304] 0 2024-09-13T21:44:49.773 INFO:tasks.workunit.client.1.smithi155.stdout:3/340: stat d3/d25/d1b/f6a 0 2024-09-13T21:44:49.774 INFO:tasks.workunit.client.1.smithi155.stdout:6/331: symlink db/d11/d4c/l60 0 2024-09-13T21:44:49.774 INFO:tasks.workunit.client.0.smithi119.stdout:2/601: link d1/d22/f1c d1/d22/db6/fc4 0 2024-09-13T21:44:49.775 INFO:tasks.workunit.client.1.smithi155.stdout:9/222: dread dc/de/d15/f24 [0,4194304] 0 2024-09-13T21:44:49.777 INFO:tasks.workunit.client.0.smithi119.stdout:2/602: creat d1/d22/d5a/d5d/fc5 x:0 0 0 2024-09-13T21:44:49.778 INFO:tasks.workunit.client.1.smithi155.stdout:9/223: write dc/de/f10 [1831148,61582] 0 2024-09-13T21:44:49.778 INFO:tasks.workunit.client.1.smithi155.stdout:6/332: dread - db/d11/d1e/d21/d44/f4b zero size 2024-09-13T21:44:49.780 INFO:tasks.workunit.client.1.smithi155.stdout:2/158: symlink d2/dd/de/d15/d2e/l35 0 2024-09-13T21:44:49.780 INFO:tasks.workunit.client.0.smithi119.stdout:4/681: read d4/d1e/f36 [3574927,82366] 0 2024-09-13T21:44:49.780 INFO:tasks.workunit.client.0.smithi119.stdout:7/708: dwrite d8/d19/d2e/f71 [0,4194304] 0 2024-09-13T21:44:49.781 INFO:tasks.workunit.client.1.smithi155.stdout:5/238: rename d5/d16/f18 to d5/d16/d33/d1b/d1e/f4c 0 2024-09-13T21:44:49.782 INFO:tasks.workunit.client.0.smithi119.stdout:2/603: symlink d1/d22/d5a/d5d/d77/daa/lc6 0 2024-09-13T21:44:49.784 INFO:tasks.workunit.client.0.smithi119.stdout:6/584: write f9 [3691480,111271] 0 2024-09-13T21:44:49.785 INFO:tasks.workunit.client.1.smithi155.stdout:9/224: write dc/d19/d23/f4a [53339,58542] 0 2024-09-13T21:44:49.786 INFO:tasks.workunit.client.1.smithi155.stdout:0/298: dwrite d1/d6/dc/d4d/d4a/d4e/d61/f6b [0,4194304] 0 2024-09-13T21:44:49.786 INFO:tasks.workunit.client.1.smithi155.stdout:2/159: creat d2/dd/de/d15/d2e/f36 x:0 0 0 2024-09-13T21:44:49.788 INFO:tasks.workunit.client.0.smithi119.stdout:2/604: fdatasync d1/d22/fb8 0 2024-09-13T21:44:49.788 INFO:tasks.workunit.client.1.smithi155.stdout:0/299: read - d1/d6/dc/d4d/d4a/d4e/f4f zero size 2024-09-13T21:44:49.789 INFO:tasks.workunit.client.1.smithi155.stdout:3/341: creat d3/f72 x:0 0 0 2024-09-13T21:44:49.791 INFO:tasks.workunit.client.0.smithi119.stdout:7/709: dwrite d8/d3c/d53/d3b/d48/f49 [0,4194304] 0 2024-09-13T21:44:49.792 INFO:tasks.workunit.client.1.smithi155.stdout:6/333: rename db/d2c/c32 to db/d3d/d5f/c61 0 2024-09-13T21:44:49.794 INFO:tasks.workunit.client.0.smithi119.stdout:2/605: fdatasync d1/d22/db6/fc4 0 2024-09-13T21:44:49.795 INFO:tasks.workunit.client.1.smithi155.stdout:3/342: creat d3/d21/d4a/f73 x:0 0 0 2024-09-13T21:44:49.796 INFO:tasks.workunit.client.0.smithi119.stdout:4/682: dread d4/d1e/d26/d5e/f6e [0,4194304] 0 2024-09-13T21:44:49.797 INFO:tasks.workunit.client.1.smithi155.stdout:6/334: symlink db/d12/d1c/d2a/l62 0 2024-09-13T21:44:49.799 INFO:tasks.workunit.client.0.smithi119.stdout:6/585: getdents dc/d4b/d97 0 2024-09-13T21:44:49.801 INFO:tasks.workunit.client.1.smithi155.stdout:9/225: truncate dc/d18/f20 1360762 0 2024-09-13T21:44:49.801 INFO:tasks.workunit.client.0.smithi119.stdout:7/710: dread d8/d3c/d53/d37/f6f [0,4194304] 0 2024-09-13T21:44:49.801 INFO:tasks.workunit.client.0.smithi119.stdout:3/570: dwrite d6/d44/d52/d85/f8b [0,4194304] 0 2024-09-13T21:44:49.801 INFO:tasks.workunit.client.0.smithi119.stdout:4/683: mkdir d4/d1e/d28/d34/ddd 0 2024-09-13T21:44:49.802 INFO:tasks.workunit.client.1.smithi155.stdout:2/160: mkdir d2/dd/d37 0 2024-09-13T21:44:49.803 INFO:tasks.workunit.client.1.smithi155.stdout:2/161: stat d2/l2a 0 2024-09-13T21:44:49.806 INFO:tasks.workunit.client.0.smithi119.stdout:3/571: fdatasync d6/d15/d1a/d45/d8d/d95/fa5 0 2024-09-13T21:44:49.807 INFO:tasks.workunit.client.0.smithi119.stdout:3/572: chown d6/d15/d1a/d45/d8d/c99 7 1 2024-09-13T21:44:49.808 INFO:tasks.workunit.client.1.smithi155.stdout:0/300: link d1/d6/dc/d4d/d4a/d4e/f53 d1/d6/dc/d4d/f71 0 2024-09-13T21:44:49.808 INFO:tasks.workunit.client.0.smithi119.stdout:3/573: fdatasync d6/d15/d1a/d45/d47/d4d/f73 0 2024-09-13T21:44:49.809 INFO:tasks.workunit.client.0.smithi119.stdout:4/684: rename d4/d1e/d28/d34/d66/d76 to d4/d1e/d26/d6d/d7c/dde 0 2024-09-13T21:44:49.810 INFO:tasks.workunit.client.0.smithi119.stdout:2/606: link d1/d22/d5a/d5d/c9b d1/d97/cc7 0 2024-09-13T21:44:49.810 INFO:tasks.workunit.client.1.smithi155.stdout:3/343: creat d3/d25/d17/f74 x:0 0 0 2024-09-13T21:44:49.810 INFO:tasks.workunit.client.0.smithi119.stdout:2/607: write d1/d7/f23 [2422086,40906] 0 2024-09-13T21:44:49.811 INFO:tasks.workunit.client.0.smithi119.stdout:2/608: read - d1/d22/d5a/d5d/f8e zero size 2024-09-13T21:44:49.812 INFO:tasks.workunit.client.1.smithi155.stdout:9/226: fsync dc/de/d15/f24 0 2024-09-13T21:44:49.812 INFO:tasks.workunit.client.0.smithi119.stdout:4/685: stat d4/d1e/d26/d5e/l5f 0 2024-09-13T21:44:49.813 INFO:tasks.workunit.client.0.smithi119.stdout:2/609: fdatasync d1/d22/db6/fc4 0 2024-09-13T21:44:49.814 INFO:tasks.workunit.client.1.smithi155.stdout:2/162: mkdir d2/dd/de/d15/d38 0 2024-09-13T21:44:49.814 INFO:tasks.workunit.client.0.smithi119.stdout:2/610: readlink d1/d22/d55/d31/l33 0 2024-09-13T21:44:49.814 INFO:tasks.workunit.client.1.smithi155.stdout:5/239: getdents d5/d16/d33 0 2024-09-13T21:44:49.815 INFO:tasks.workunit.client.0.smithi119.stdout:3/574: link d6/d44/f7e d6/fbe 0 2024-09-13T21:44:49.816 INFO:tasks.workunit.client.1.smithi155.stdout:6/335: symlink db/l63 0 2024-09-13T21:44:49.817 INFO:tasks.workunit.client.0.smithi119.stdout:2/611: mknod d1/d7/cc8 0 2024-09-13T21:44:49.818 INFO:tasks.workunit.client.1.smithi155.stdout:3/344: link d3/d10/c15 d3/d25/d17/d3b/c75 0 2024-09-13T21:44:49.819 INFO:tasks.workunit.client.0.smithi119.stdout:3/575: rename d6/d44/d52/d85/c8a to d6/d15/d1a/cbf 0 2024-09-13T21:44:49.821 INFO:tasks.workunit.client.1.smithi155.stdout:3/345: write d3/d25/fb [4022054,8415] 0 2024-09-13T21:44:49.821 INFO:tasks.workunit.client.0.smithi119.stdout:2/612: creat d1/d22/d5a/fc9 x:0 0 0 2024-09-13T21:44:49.823 INFO:tasks.workunit.client.0.smithi119.stdout:4/686: dread d4/d1e/d26/d6d/fab [0,4194304] 0 2024-09-13T21:44:49.823 INFO:tasks.workunit.client.1.smithi155.stdout:5/240: dwrite d5/d26/f46 [0,4194304] 0 2024-09-13T21:44:49.824 INFO:tasks.workunit.client.0.smithi119.stdout:2/613: creat d1/d97/fca x:0 0 0 2024-09-13T21:44:49.824 INFO:tasks.workunit.client.0.smithi119.stdout:2/614: dread - d1/d7/fbd zero size 2024-09-13T21:44:49.824 INFO:tasks.workunit.client.0.smithi119.stdout:4/687: stat d4/d1e/d28/d34/d99/cb3 0 2024-09-13T21:44:49.827 INFO:tasks.workunit.client.1.smithi155.stdout:3/346: creat d3/d25/d17/f76 x:0 0 0 2024-09-13T21:44:49.827 INFO:tasks.workunit.client.0.smithi119.stdout:4/688: creat d4/d1e/d28/d34/ddd/fdf x:0 0 0 2024-09-13T21:44:49.829 INFO:tasks.workunit.client.0.smithi119.stdout:2/615: getdents d1/d7/d47 0 2024-09-13T21:44:49.830 INFO:tasks.workunit.client.0.smithi119.stdout:4/689: creat d4/d1e/d26/d6d/d7c/fe0 x:0 0 0 2024-09-13T21:44:49.830 INFO:tasks.workunit.client.0.smithi119.stdout:6/586: write dc/d3d/f8b [77668,947] 0 2024-09-13T21:44:49.832 INFO:tasks.workunit.client.0.smithi119.stdout:6/587: write dc/d3d/d40/d6b/fa4 [394686,17128] 0 2024-09-13T21:44:49.833 INFO:tasks.workunit.client.0.smithi119.stdout:4/690: symlink d4/d1e/d26/d60/dad/dd5/le1 0 2024-09-13T21:44:49.834 INFO:tasks.workunit.client.0.smithi119.stdout:6/588: mkdir dc/d4b/d6a/dbd 0 2024-09-13T21:44:49.835 INFO:tasks.workunit.client.1.smithi155.stdout:5/241: dwrite d5/d26/f35 [0,4194304] 0 2024-09-13T21:44:49.836 INFO:tasks.workunit.client.0.smithi119.stdout:6/589: mkdir dc/d4b/d6a/d75/dbe 0 2024-09-13T21:44:49.836 INFO:tasks.workunit.client.0.smithi119.stdout:6/590: readlink dc/l3b 0 2024-09-13T21:44:49.837 INFO:tasks.workunit.client.1.smithi155.stdout:0/301: truncate d1/f35 2037893 0 2024-09-13T21:44:49.837 INFO:tasks.workunit.client.0.smithi119.stdout:6/591: dread - dc/d4b/fab zero size 2024-09-13T21:44:49.837 INFO:tasks.workunit.client.1.smithi155.stdout:5/242: stat d5/d16/d33/d1b/c2d 0 2024-09-13T21:44:49.837 INFO:tasks.workunit.client.0.smithi119.stdout:6/592: readlink dc/df/d32/l43 0 2024-09-13T21:44:49.840 INFO:tasks.workunit.client.1.smithi155.stdout:5/243: truncate d5/d26/f46 4724829 0 2024-09-13T21:44:49.841 INFO:tasks.workunit.client.1.smithi155.stdout:6/336: truncate db/d11/d2b/d35/f25 1685200 0 2024-09-13T21:44:49.842 INFO:tasks.workunit.client.1.smithi155.stdout:3/347: dwrite d3/d25/d1b/d1f/d36/f5d [0,4194304] 0 2024-09-13T21:44:49.844 INFO:tasks.workunit.client.1.smithi155.stdout:5/244: creat d5/d12/f4d x:0 0 0 2024-09-13T21:44:49.846 INFO:tasks.workunit.client.1.smithi155.stdout:0/302: link d1/d6/dc/d4d/f59 d1/d6/dc/f72 0 2024-09-13T21:44:49.846 INFO:tasks.workunit.client.1.smithi155.stdout:5/245: readlink d5/l34 0 2024-09-13T21:44:49.847 INFO:tasks.workunit.client.1.smithi155.stdout:3/348: creat d3/d25/d17/d3b/f77 x:0 0 0 2024-09-13T21:44:49.848 INFO:tasks.workunit.client.1.smithi155.stdout:5/246: chown d5/d12/f14 183812 1 2024-09-13T21:44:49.850 INFO:tasks.workunit.client.1.smithi155.stdout:6/337: rename db/d12/d1c/d2a to db/d11/d4c/d64 0 2024-09-13T21:44:49.850 INFO:tasks.workunit.client.1.smithi155.stdout:3/349: readlink d3/d25/d17/d3b/l3e 0 2024-09-13T21:44:49.852 INFO:tasks.workunit.client.1.smithi155.stdout:9/227: dread dc/f1a [0,4194304] 0 2024-09-13T21:44:49.853 INFO:tasks.workunit.client.1.smithi155.stdout:9/228: read - dc/de/f3a zero size 2024-09-13T21:44:49.855 INFO:tasks.workunit.client.1.smithi155.stdout:6/338: mknod db/d12/d1c/c65 0 2024-09-13T21:44:49.856 INFO:tasks.workunit.client.1.smithi155.stdout:3/350: mknod d3/d21/d2c/c78 0 2024-09-13T21:44:49.860 INFO:tasks.workunit.client.1.smithi155.stdout:3/351: symlink d3/d21/d4a/l79 0 2024-09-13T21:44:49.860 INFO:tasks.workunit.client.0.smithi119.stdout:3/576: dwrite d6/d15/d1a/f3a [0,4194304] 0 2024-09-13T21:44:49.863 INFO:tasks.workunit.client.1.smithi155.stdout:3/352: write d3/d25/d1b/d1f/f64 [554175,64782] 0 2024-09-13T21:44:49.863 INFO:tasks.workunit.client.0.smithi119.stdout:4/691: dwrite d4/d1e/d26/d60/d71/d83/f81 [0,4194304] 0 2024-09-13T21:44:49.863 INFO:tasks.workunit.client.0.smithi119.stdout:3/577: rmdir d6/d15/d8f 39 2024-09-13T21:44:49.863 INFO:tasks.workunit.client.0.smithi119.stdout:4/692: readlink d4/d1e/l11 0 2024-09-13T21:44:49.863 INFO:tasks.workunit.client.1.smithi155.stdout:9/229: getdents dc/de 0 2024-09-13T21:44:49.865 INFO:tasks.workunit.client.1.smithi155.stdout:3/353: dread - d3/d25/d1b/d1f/f56 zero size 2024-09-13T21:44:49.868 INFO:tasks.workunit.client.0.smithi119.stdout:3/578: mknod d6/d25/d2f/d33/d88/cc0 0 2024-09-13T21:44:49.869 INFO:tasks.workunit.client.1.smithi155.stdout:9/230: truncate dc/d18/d1e/f34 1220440 0 2024-09-13T21:44:49.871 INFO:tasks.workunit.client.0.smithi119.stdout:3/579: symlink d6/d15/d8f/lc1 0 2024-09-13T21:44:49.874 INFO:tasks.workunit.client.1.smithi155.stdout:9/231: rmdir dc/d19 39 2024-09-13T21:44:49.874 INFO:tasks.workunit.client.1.smithi155.stdout:5/247: dwrite d5/d16/d33/f43 [0,4194304] 0 2024-09-13T21:44:49.874 INFO:tasks.workunit.client.0.smithi119.stdout:3/580: unlink d6/d25/d2f/d33/d56/f66 0 2024-09-13T21:44:49.876 INFO:tasks.workunit.client.0.smithi119.stdout:2/616: dread d1/d7/f2a [0,4194304] 0 2024-09-13T21:44:49.878 INFO:tasks.workunit.client.0.smithi119.stdout:2/617: rmdir d1/d7 39 2024-09-13T21:44:49.879 INFO:tasks.workunit.client.1.smithi155.stdout:9/232: mkdir dc/d18/d50 0 2024-09-13T21:44:49.879 INFO:tasks.workunit.client.0.smithi119.stdout:3/581: mkdir d6/d25/d2f/d33/d56/dab/dc2 0 2024-09-13T21:44:49.880 INFO:tasks.workunit.client.1.smithi155.stdout:5/248: mkdir d5/d16/d4e 0 2024-09-13T21:44:49.881 INFO:tasks.workunit.client.0.smithi119.stdout:3/582: dread - d6/d44/d52/f68 zero size 2024-09-13T21:44:49.881 INFO:tasks.workunit.client.0.smithi119.stdout:2/618: read d1/d22/d5a/f81 [876057,26978] 0 2024-09-13T21:44:49.882 INFO:tasks.workunit.client.0.smithi119.stdout:2/619: chown d1/d38/d89/f9f 2347 1 2024-09-13T21:44:49.883 INFO:tasks.workunit.client.1.smithi155.stdout:9/233: symlink dc/d18/l51 0 2024-09-13T21:44:49.884 INFO:tasks.workunit.client.0.smithi119.stdout:2/620: chown d1/d22/d5a/d5d/c9b 241 1 2024-09-13T21:44:49.885 INFO:tasks.workunit.client.1.smithi155.stdout:5/249: write d5/d16/f2a [4305275,39743] 0 2024-09-13T21:44:49.888 INFO:tasks.workunit.client.1.smithi155.stdout:9/234: rename dc/f49 to dc/d19/d21/f52 0 2024-09-13T21:44:49.889 INFO:tasks.workunit.client.1.smithi155.stdout:5/250: creat d5/d16/d33/d1f/f4f x:0 0 0 2024-09-13T21:44:49.891 INFO:tasks.workunit.client.1.smithi155.stdout:9/235: link dc/d19/d21/l28 dc/de/d15/l53 0 2024-09-13T21:44:49.893 INFO:tasks.workunit.client.1.smithi155.stdout:5/251: getdents d5/d16/d33/d1b/d2f/d3c 0 2024-09-13T21:44:49.902 INFO:tasks.workunit.client.1.smithi155.stdout:9/236: rename dc/d19/d21/f52 to dc/f54 0 2024-09-13T21:44:49.902 INFO:tasks.workunit.client.1.smithi155.stdout:5/252: getdents d5/d16/d33/d1f 0 2024-09-13T21:44:49.905 INFO:tasks.workunit.client.1.smithi155.stdout:9/237: creat dc/d19/d21/f55 x:0 0 0 2024-09-13T21:44:49.906 INFO:tasks.workunit.client.1.smithi155.stdout:5/253: link d5/f8 d5/d16/d33/d1b/d1e/f50 0 2024-09-13T21:44:49.908 INFO:tasks.workunit.client.1.smithi155.stdout:5/254: creat d5/d16/d4e/f51 x:0 0 0 2024-09-13T21:44:49.910 INFO:tasks.workunit.client.1.smithi155.stdout:9/238: dwrite dc/d19/d23/f2b [0,4194304] 0 2024-09-13T21:44:49.911 INFO:tasks.workunit.client.1.smithi155.stdout:5/255: unlink d5/l39 0 2024-09-13T21:44:49.913 INFO:tasks.workunit.client.1.smithi155.stdout:9/239: symlink dc/d19/d23/l56 0 2024-09-13T21:44:49.917 INFO:tasks.workunit.client.1.smithi155.stdout:5/256: dread d5/d16/f2a [0,4194304] 0 2024-09-13T21:44:49.918 INFO:tasks.workunit.client.1.smithi155.stdout:5/257: chown d5/c21 5817262 1 2024-09-13T21:44:49.920 INFO:tasks.workunit.client.1.smithi155.stdout:5/258: write d5/d16/d33/d1f/f20 [1960054,76949] 0 2024-09-13T21:44:49.920 INFO:tasks.workunit.client.1.smithi155.stdout:9/240: dwrite dc/d19/d23/f2b [0,4194304] 0 2024-09-13T21:44:49.921 INFO:tasks.workunit.client.1.smithi155.stdout:5/259: read d5/f11 [1033261,29630] 0 2024-09-13T21:44:49.923 INFO:tasks.workunit.client.1.smithi155.stdout:9/241: dread dc/d19/d23/f4a [0,4194304] 0 2024-09-13T21:44:49.925 INFO:tasks.workunit.client.1.smithi155.stdout:5/260: mkdir d5/d16/d33/d1b/d28/d52 0 2024-09-13T21:44:49.927 INFO:tasks.workunit.client.1.smithi155.stdout:9/242: mknod dc/de/d2d/c57 0 2024-09-13T21:44:49.927 INFO:tasks.workunit.client.1.smithi155.stdout:5/261: creat d5/d16/d33/f53 x:0 0 0 2024-09-13T21:44:49.928 INFO:tasks.workunit.client.1.smithi155.stdout:9/243: chown dc/de/c14 6742196 1 2024-09-13T21:44:49.930 INFO:tasks.workunit.client.1.smithi155.stdout:9/244: mknod dc/d18/d1e/c58 0 2024-09-13T21:44:49.932 INFO:tasks.workunit.client.1.smithi155.stdout:5/262: getdents d5/d16/d33/d1b/d2f 0 2024-09-13T21:44:49.934 INFO:tasks.workunit.client.1.smithi155.stdout:9/245: dread dc/d19/d23/d2f/f4c [0,4194304] 0 2024-09-13T21:44:49.934 INFO:tasks.workunit.client.1.smithi155.stdout:5/263: write d5/d16/f2a [1150315,126220] 0 2024-09-13T21:44:49.934 INFO:tasks.workunit.client.1.smithi155.stdout:5/264: stat d5/f6 0 2024-09-13T21:44:49.935 INFO:tasks.workunit.client.1.smithi155.stdout:5/265: stat d5/d16/d4e/f51 0 2024-09-13T21:44:49.936 INFO:tasks.workunit.client.1.smithi155.stdout:5/266: write d5/f1c [3726291,60460] 0 2024-09-13T21:44:49.937 INFO:tasks.workunit.client.1.smithi155.stdout:9/246: creat dc/d18/d50/f59 x:0 0 0 2024-09-13T21:44:49.939 INFO:tasks.workunit.client.1.smithi155.stdout:5/267: creat d5/d26/d45/f54 x:0 0 0 2024-09-13T21:44:49.941 INFO:tasks.workunit.client.1.smithi155.stdout:9/247: symlink dc/d19/d23/d38/l5a 0 2024-09-13T21:44:49.941 INFO:tasks.workunit.client.1.smithi155.stdout:9/248: dread - dc/de/f45 zero size 2024-09-13T21:44:49.942 INFO:tasks.workunit.client.1.smithi155.stdout:5/268: creat d5/d16/d4e/f55 x:0 0 0 2024-09-13T21:44:49.943 INFO:tasks.workunit.client.1.smithi155.stdout:5/269: read d5/d16/d33/d1b/d28/f37 [1714101,107316] 0 2024-09-13T21:44:49.944 INFO:tasks.workunit.client.1.smithi155.stdout:5/270: fdatasync d5/d16/d33/d1b/d2f/d3c/f41 0 2024-09-13T21:44:49.947 INFO:tasks.workunit.client.1.smithi155.stdout:9/249: link dc/d19/d23/f4a dc/d19/d23/d38/f5b 0 2024-09-13T21:44:49.949 INFO:tasks.workunit.client.1.smithi155.stdout:9/250: chown dc/de/d15/f1c 143232130 1 2024-09-13T21:44:49.951 INFO:tasks.workunit.client.1.smithi155.stdout:5/271: dwrite d5/d26/d45/f54 [0,4194304] 0 2024-09-13T21:44:49.953 INFO:tasks.workunit.client.1.smithi155.stdout:9/251: mkdir dc/de/d5c 0 2024-09-13T21:44:49.954 INFO:tasks.workunit.client.1.smithi155.stdout:9/252: stat dc/de/f10 0 2024-09-13T21:44:49.955 INFO:tasks.workunit.client.1.smithi155.stdout:5/272: unlink d5/f11 0 2024-09-13T21:44:49.955 INFO:tasks.workunit.client.1.smithi155.stdout:9/253: write dc/de/ff [393989,52418] 0 2024-09-13T21:44:49.958 INFO:tasks.workunit.client.1.smithi155.stdout:5/273: mknod d5/d16/d33/d1b/d28/c56 0 2024-09-13T21:44:49.962 INFO:tasks.workunit.client.1.smithi155.stdout:5/274: dread d5/d16/d33/d1f/f20 [0,4194304] 0 2024-09-13T21:44:49.964 INFO:tasks.workunit.client.1.smithi155.stdout:5/275: creat d5/d16/d33/d1b/f57 x:0 0 0 2024-09-13T21:44:49.965 INFO:tasks.workunit.client.1.smithi155.stdout:5/276: creat d5/d16/d4e/f58 x:0 0 0 2024-09-13T21:44:49.966 INFO:tasks.workunit.client.1.smithi155.stdout:5/277: chown d5/d16/d33/d1f/f20 668285 1 2024-09-13T21:44:49.968 INFO:tasks.workunit.client.1.smithi155.stdout:5/278: write d5/d12/f14 [563623,79837] 0 2024-09-13T21:44:49.968 INFO:tasks.workunit.client.1.smithi155.stdout:9/254: dread dc/d19/d23/f30 [0,4194304] 0 2024-09-13T21:44:49.978 INFO:tasks.workunit.client.1.smithi155.stdout:9/255: dwrite dc/de/d15/f24 [4194304,4194304] 0 2024-09-13T21:44:49.979 INFO:tasks.workunit.client.1.smithi155.stdout:9/256: chown dc/d18/d1e/f34 4183245 1 2024-09-13T21:44:49.986 INFO:tasks.workunit.client.1.smithi155.stdout:9/257: dwrite dc/de/d15/f1c [0,4194304] 0 2024-09-13T21:44:49.990 INFO:tasks.workunit.client.0.smithi119.stdout:2/621: creat d1/d22/d55/fcb x:0 0 0 2024-09-13T21:44:49.992 INFO:tasks.workunit.client.0.smithi119.stdout:6/593: dread dc/df/d32/fa2 [0,4194304] 0 2024-09-13T21:44:49.995 INFO:tasks.workunit.client.0.smithi119.stdout:6/594: unlink dc/d3d/d40/d6b/l59 0 2024-09-13T21:44:49.995 INFO:tasks.workunit.client.0.smithi119.stdout:2/622: write d1/d38/f2e [1507940,53632] 0 2024-09-13T21:44:49.997 INFO:tasks.workunit.client.0.smithi119.stdout:6/595: mkdir dc/df/d41/dbf 0 2024-09-13T21:44:49.997 INFO:tasks.workunit.client.0.smithi119.stdout:2/623: write d1/d22/d55/d31/fbe [472996,65338] 0 2024-09-13T21:44:50.002 INFO:tasks.workunit.client.0.smithi119.stdout:2/624: rename d1/d38/l30 to d1/d7/d47/lcc 0 2024-09-13T21:44:50.002 INFO:tasks.workunit.client.0.smithi119.stdout:6/596: dwrite dc/f31 [0,4194304] 0 2024-09-13T21:44:50.005 INFO:tasks.workunit.client.0.smithi119.stdout:2/625: symlink d1/d22/d5a/d5d/d77/daa/lcd 0 2024-09-13T21:44:50.007 INFO:tasks.workunit.client.0.smithi119.stdout:6/597: unlink dc/d3a/fb7 0 2024-09-13T21:44:50.010 INFO:tasks.workunit.client.0.smithi119.stdout:6/598: rename dc/d3d/da8 to dc/df/d64/dc0 0 2024-09-13T21:44:50.011 INFO:tasks.workunit.client.0.smithi119.stdout:6/599: stat dc/d3d/f8b 0 2024-09-13T21:44:50.012 INFO:tasks.workunit.client.0.smithi119.stdout:2/626: dwrite d1/d22/d5a/f8a [0,4194304] 0 2024-09-13T21:44:50.014 INFO:tasks.workunit.client.1.smithi155.stdout:9/258: dread dc/f54 [0,4194304] 0 2024-09-13T21:44:50.014 INFO:tasks.workunit.client.0.smithi119.stdout:2/627: readlink d1/d22/l6d 0 2024-09-13T21:44:50.015 INFO:tasks.workunit.client.0.smithi119.stdout:6/600: creat dc/d4b/fc1 x:0 0 0 2024-09-13T21:44:50.015 INFO:tasks.workunit.client.0.smithi119.stdout:2/628: chown d1/d22/d5a/d5d/db7 33243064 1 2024-09-13T21:44:50.016 INFO:tasks.workunit.client.0.smithi119.stdout:6/601: fsync dc/d3d/fa0 0 2024-09-13T21:44:50.016 INFO:tasks.workunit.client.1.smithi155.stdout:9/259: creat dc/d19/d23/d2f/d43/f5d x:0 0 0 2024-09-13T21:44:50.018 INFO:tasks.workunit.client.0.smithi119.stdout:6/602: write dc/dd/f85 [6852840,46561] 0 2024-09-13T21:44:50.018 INFO:tasks.workunit.client.1.smithi155.stdout:9/260: unlink dc/de/d2d/c32 0 2024-09-13T21:44:50.018 INFO:tasks.workunit.client.0.smithi119.stdout:2/629: mkdir d1/d22/d5a/d5d/d83/dce 0 2024-09-13T21:44:50.020 INFO:tasks.workunit.client.0.smithi119.stdout:2/630: write d1/d97/fca [33267,74224] 0 2024-09-13T21:44:50.021 INFO:tasks.workunit.client.0.smithi119.stdout:2/631: chown d1/d97/fca 164700332 1 2024-09-13T21:44:50.030 INFO:tasks.workunit.client.1.smithi155.stdout:9/261: getdents dc/de/d2d 0 2024-09-13T21:44:50.032 INFO:tasks.workunit.client.1.smithi155.stdout:9/262: creat dc/de/d5c/f5e x:0 0 0 2024-09-13T21:44:50.033 INFO:tasks.workunit.client.0.smithi119.stdout:6/603: dwrite dc/dd/f4f [0,4194304] 0 2024-09-13T21:44:50.036 INFO:tasks.workunit.client.1.smithi155.stdout:9/263: rename dc/de/d15/c35 to dc/d18/d50/c5f 0 2024-09-13T21:44:50.040 INFO:tasks.workunit.client.0.smithi119.stdout:6/604: dwrite dc/dd/f2e [0,4194304] 0 2024-09-13T21:44:50.042 INFO:tasks.workunit.client.0.smithi119.stdout:6/605: mkdir dc/d4b/d6a/dc2 0 2024-09-13T21:44:50.044 INFO:tasks.workunit.client.1.smithi155.stdout:9/264: dwrite dc/d19/d21/f55 [0,4194304] 0 2024-09-13T21:44:50.044 INFO:tasks.workunit.client.0.smithi119.stdout:6/606: creat dc/df/d41/fc3 x:0 0 0 2024-09-13T21:44:50.046 INFO:tasks.workunit.client.0.smithi119.stdout:6/607: rename dc/d3a/f9c to dc/d3a/dbb/d7a/d7e/fc4 0 2024-09-13T21:44:50.047 INFO:tasks.workunit.client.0.smithi119.stdout:6/608: chown dc/d3d/d4e/f57 9 1 2024-09-13T21:44:50.051 INFO:tasks.workunit.client.1.smithi155.stdout:9/265: getdents dc/de/d5c 0 2024-09-13T21:44:50.052 INFO:tasks.workunit.client.1.smithi155.stdout:9/266: creat dc/d18/f60 x:0 0 0 2024-09-13T21:44:50.054 INFO:tasks.workunit.client.1.smithi155.stdout:9/267: symlink dc/de/d5c/l61 0 2024-09-13T21:44:50.054 INFO:tasks.workunit.client.1.smithi155.stdout:9/268: fsync dc/de/d5c/f5e 0 2024-09-13T21:44:50.055 INFO:tasks.workunit.client.0.smithi119.stdout:6/609: dwrite dc/d3d/d40/d6b/f70 [0,4194304] 0 2024-09-13T21:44:50.057 INFO:tasks.workunit.client.1.smithi155.stdout:9/269: rename dc/d18/f1d to dc/d19/d23/d2f/f62 0 2024-09-13T21:44:50.058 INFO:tasks.workunit.client.1.smithi155.stdout:9/270: chown dc/d19/f48 1481831 1 2024-09-13T21:44:50.058 INFO:tasks.workunit.client.1.smithi155.stdout:9/271: readlink dc/de/l11 0 2024-09-13T21:44:50.059 INFO:tasks.workunit.client.0.smithi119.stdout:6/610: rename dc/l18 to dc/d3d/d40/d6b/lc5 0 2024-09-13T21:44:50.061 INFO:tasks.workunit.client.0.smithi119.stdout:6/611: creat dc/d3a/dbb/d7a/fc6 x:0 0 0 2024-09-13T21:44:50.062 INFO:tasks.workunit.client.0.smithi119.stdout:6/612: fsync dc/d3a/dbb/d7a/d86/fb9 0 2024-09-13T21:44:50.063 INFO:tasks.workunit.client.1.smithi155.stdout:9/272: dread dc/f1a [0,4194304] 0 2024-09-13T21:44:50.064 INFO:tasks.workunit.client.0.smithi119.stdout:6/613: mkdir dc/d3a/dbb/d7a/dc7 0 2024-09-13T21:44:50.064 INFO:tasks.workunit.client.1.smithi155.stdout:9/273: write dc/d19/f48 [699889,93494] 0 2024-09-13T21:44:50.065 INFO:tasks.workunit.client.0.smithi119.stdout:6/614: write dc/df/d5c/f5f [218576,71188] 0 2024-09-13T21:44:50.066 INFO:tasks.workunit.client.1.smithi155.stdout:9/274: creat dc/d19/d23/d2f/f63 x:0 0 0 2024-09-13T21:44:50.068 INFO:tasks.workunit.client.1.smithi155.stdout:9/275: creat dc/d18/d1e/f64 x:0 0 0 2024-09-13T21:44:50.073 INFO:tasks.workunit.client.1.smithi155.stdout:9/276: dwrite dc/de/f3a [0,4194304] 0 2024-09-13T21:44:50.074 INFO:tasks.workunit.client.0.smithi119.stdout:6/615: rmdir dc/df/d41 39 2024-09-13T21:44:50.075 INFO:tasks.workunit.client.1.smithi155.stdout:9/277: truncate dc/d18/d1e/f22 3763592 0 2024-09-13T21:44:50.094 INFO:tasks.workunit.client.0.smithi119.stdout:6/616: dread f9 [0,4194304] 0 2024-09-13T21:44:50.095 INFO:tasks.workunit.client.0.smithi119.stdout:6/617: fdatasync dc/df/d41/fc3 0 2024-09-13T21:44:50.096 INFO:tasks.workunit.client.0.smithi119.stdout:6/618: fdatasync dc/df/d41/f90 0 2024-09-13T21:44:50.097 INFO:tasks.workunit.client.0.smithi119.stdout:6/619: chown dc/df/f1d 0 1 2024-09-13T21:44:50.098 INFO:tasks.workunit.client.0.smithi119.stdout:6/620: write dc/df/d41/f61 [914581,53585] 0 2024-09-13T21:44:50.103 INFO:tasks.workunit.client.1.smithi155.stdout:9/278: read dc/f54 [3794784,102067] 0 2024-09-13T21:44:50.105 INFO:tasks.workunit.client.1.smithi155.stdout:9/279: symlink dc/d18/d50/l65 0 2024-09-13T21:44:50.106 INFO:tasks.workunit.client.1.smithi155.stdout:9/280: write dc/d19/d23/d2f/d43/f5d [995305,9204] 0 2024-09-13T21:44:50.108 INFO:tasks.workunit.client.1.smithi155.stdout:9/281: creat dc/d19/d23/f66 x:0 0 0 2024-09-13T21:44:50.108 INFO:tasks.workunit.client.1.smithi155.stdout:9/282: stat dc/de/d2d 0 2024-09-13T21:44:50.109 INFO:tasks.workunit.client.1.smithi155.stdout:9/283: mkdir dc/d19/d21/d67 0 2024-09-13T21:44:50.111 INFO:tasks.workunit.client.1.smithi155.stdout:9/284: link c6 dc/d19/d23/d2f/d43/c68 0 2024-09-13T21:44:50.112 INFO:tasks.workunit.client.0.smithi119.stdout:6/621: dread dc/d3d/d4e/f76 [0,4194304] 0 2024-09-13T21:44:50.116 INFO:tasks.workunit.client.0.smithi119.stdout:6/622: dread dc/dd/f38 [4194304,4194304] 0 2024-09-13T21:44:50.118 INFO:tasks.workunit.client.0.smithi119.stdout:6/623: rename dc/d4b/d6a/c8e to dc/df/d65/cc8 0 2024-09-13T21:44:50.123 INFO:tasks.workunit.client.0.smithi119.stdout:6/624: truncate dc/dd/f4f 2695093 0 2024-09-13T21:44:50.125 INFO:tasks.workunit.client.0.smithi119.stdout:6/625: dread f9 [0,4194304] 0 2024-09-13T21:44:50.127 INFO:tasks.workunit.client.0.smithi119.stdout:6/626: rmdir dc/d3d/d40/d6b 39 2024-09-13T21:44:50.128 INFO:tasks.workunit.client.0.smithi119.stdout:6/627: write dc/d3d/d40/f69 [555706,19930] 0 2024-09-13T21:44:50.186 INFO:tasks.workunit.client.1.smithi155.stdout:1/233: sync 2024-09-13T21:44:50.188 INFO:tasks.workunit.client.1.smithi155.stdout:1/234: dread d6/d7/f8 [0,4194304] 0 2024-09-13T21:44:50.188 INFO:tasks.workunit.client.1.smithi155.stdout:1/235: stat d6/f33 0 2024-09-13T21:44:50.189 INFO:tasks.workunit.client.1.smithi155.stdout:1/236: mknod d6/d15/c59 0 2024-09-13T21:44:50.190 INFO:tasks.workunit.client.1.smithi155.stdout:1/237: chown d6/d15/d3e/c11 24 1 2024-09-13T21:44:50.191 INFO:tasks.workunit.client.1.smithi155.stdout:1/238: write d6/d15/f4e [465242,52681] 0 2024-09-13T21:44:50.194 INFO:tasks.workunit.client.1.smithi155.stdout:1/239: dread d6/ff [0,4194304] 0 2024-09-13T21:44:50.200 INFO:tasks.workunit.client.1.smithi155.stdout:1/240: dwrite d6/f33 [0,4194304] 0 2024-09-13T21:44:50.200 INFO:tasks.workunit.client.1.smithi155.stdout:1/241: read - d6/d15/f58 zero size 2024-09-13T21:44:50.208 INFO:tasks.workunit.client.1.smithi155.stdout:1/242: dwrite d6/d15/f4c [0,4194304] 0 2024-09-13T21:44:50.216 INFO:tasks.workunit.client.1.smithi155.stdout:1/243: dwrite d6/d15/d3e/d17/f4d [0,4194304] 0 2024-09-13T21:44:50.218 INFO:tasks.workunit.client.1.smithi155.stdout:1/244: symlink d6/d15/d3e/d17/d30/d4b/l5a 0 2024-09-13T21:44:50.220 INFO:tasks.workunit.client.1.smithi155.stdout:1/245: creat d6/d15/d3e/d17/d30/f5b x:0 0 0 2024-09-13T21:44:50.221 INFO:tasks.workunit.client.1.smithi155.stdout:1/246: symlink d6/d7/l5c 0 2024-09-13T21:44:50.222 INFO:tasks.workunit.client.1.smithi155.stdout:1/247: write d6/d7/f2f [2321911,15527] 0 2024-09-13T21:44:50.236 INFO:tasks.workunit.client.1.smithi155.stdout:1/248: dwrite d6/ff [0,4194304] 0 2024-09-13T21:44:50.238 INFO:tasks.workunit.client.1.smithi155.stdout:1/249: mkdir d6/d15/d57/d5d 0 2024-09-13T21:44:50.247 INFO:tasks.workunit.client.1.smithi155.stdout:1/250: dwrite d6/d15/d3e/f4a [0,4194304] 0 2024-09-13T21:44:50.248 INFO:tasks.workunit.client.1.smithi155.stdout:1/251: write d6/ff [3143705,24012] 0 2024-09-13T21:44:50.253 INFO:tasks.workunit.client.1.smithi155.stdout:1/252: getdents d6 0 2024-09-13T21:44:50.262 INFO:tasks.workunit.client.1.smithi155.stdout:1/253: truncate d6/d15/d3e/f4a 579470 0 2024-09-13T21:44:50.266 INFO:tasks.workunit.client.1.smithi155.stdout:1/254: dwrite d6/d15/d3e/f4f [0,4194304] 0 2024-09-13T21:44:50.269 INFO:tasks.workunit.client.1.smithi155.stdout:1/255: unlink d6/d15/d3e/d17/f4d 0 2024-09-13T21:44:50.316 INFO:tasks.workunit.client.1.smithi155.stdout:4/245: sync 2024-09-13T21:44:50.317 INFO:tasks.workunit.client.1.smithi155.stdout:4/246: write d1/d7/de/d15/f37 [1143656,61297] 0 2024-09-13T21:44:50.317 INFO:tasks.workunit.client.1.smithi155.stdout:4/247: chown d1/d7/f30 467 1 2024-09-13T21:44:50.326 INFO:tasks.workunit.client.1.smithi155.stdout:4/248: dread d1/d7/d21/f2a [0,4194304] 0 2024-09-13T21:44:50.328 INFO:tasks.workunit.client.1.smithi155.stdout:4/249: creat d1/d7/d21/d2d/d42/f4d x:0 0 0 2024-09-13T21:44:50.331 INFO:tasks.workunit.client.0.smithi119.stdout:0/608: sync 2024-09-13T21:44:50.331 INFO:tasks.workunit.client.1.smithi155.stdout:4/250: getdents d1 0 2024-09-13T21:44:50.332 INFO:tasks.workunit.client.1.smithi155.stdout:4/251: read d1/f1c [315009,28583] 0 2024-09-13T21:44:50.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:50 smithi155 ceph-mon[34732]: pgmap v9: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 53 MiB/s rd, 204 MiB/s wr, 392 op/s 2024-09-13T21:44:50.333 INFO:tasks.workunit.client.0.smithi119.stdout:0/609: getdents de/d3c/d7c 0 2024-09-13T21:44:50.334 INFO:tasks.workunit.client.0.smithi119.stdout:0/610: write de/d1c/d2b/fb3 [2876797,88908] 0 2024-09-13T21:44:50.334 INFO:tasks.workunit.client.1.smithi155.stdout:4/252: unlink d1/d7/de/d1a/l33 0 2024-09-13T21:44:50.336 INFO:tasks.workunit.client.1.smithi155.stdout:4/253: read d1/d7/de/d15/f37 [470265,109082] 0 2024-09-13T21:44:50.337 INFO:tasks.workunit.client.1.smithi155.stdout:4/254: truncate d1/d7/d21/f3a 728980 0 2024-09-13T21:44:50.338 INFO:tasks.workunit.client.1.smithi155.stdout:4/255: readlink d1/d7/d21/l22 0 2024-09-13T21:44:50.338 INFO:tasks.workunit.client.1.smithi155.stdout:4/256: stat d1/d7/f30 0 2024-09-13T21:44:50.343 INFO:tasks.workunit.client.0.smithi119.stdout:0/611: dwrite de/d4e/d7f/fa3 [0,4194304] 0 2024-09-13T21:44:50.343 INFO:tasks.workunit.client.1.smithi155.stdout:4/257: dwrite d1/f3b [0,4194304] 0 2024-09-13T21:44:50.353 INFO:tasks.workunit.client.0.smithi119.stdout:0/612: dwrite de/f77 [0,4194304] 0 2024-09-13T21:44:50.355 INFO:tasks.workunit.client.0.smithi119.stdout:0/613: chown de/d1c/d2f/f47 244516 1 2024-09-13T21:44:50.357 INFO:tasks.workunit.client.0.smithi119.stdout:0/614: readlink de/d1c/d2b/d76/lb4 0 2024-09-13T21:44:50.357 INFO:tasks.workunit.client.0.smithi119.stdout:0/615: fsync fd 0 2024-09-13T21:44:50.357 INFO:tasks.workunit.client.1.smithi155.stdout:4/258: dread d1/f27 [0,4194304] 0 2024-09-13T21:44:50.359 INFO:tasks.workunit.client.0.smithi119.stdout:0/616: creat de/d1c/d59/fdc x:0 0 0 2024-09-13T21:44:50.359 INFO:tasks.workunit.client.1.smithi155.stdout:4/259: mknod d1/d7/de/d1a/c4e 0 2024-09-13T21:44:50.359 INFO:tasks.workunit.client.0.smithi119.stdout:0/617: dread - de/d1c/d2b/dd7/fda zero size 2024-09-13T21:44:50.360 INFO:tasks.workunit.client.0.smithi119.stdout:0/618: stat de/d1c/d2f/l57 0 2024-09-13T21:44:50.363 INFO:tasks.workunit.client.0.smithi119.stdout:0/619: getdents de/d1c/d52 0 2024-09-13T21:44:50.363 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:50 smithi119 ceph-mon[27653]: pgmap v9: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 53 MiB/s rd, 204 MiB/s wr, 392 op/s 2024-09-13T21:44:50.364 INFO:tasks.workunit.client.1.smithi155.stdout:4/260: dwrite d1/f4 [0,4194304] 0 2024-09-13T21:44:50.365 INFO:tasks.workunit.client.1.smithi155.stdout:4/261: chown d1/d7/d21/f2a 303 1 2024-09-13T21:44:50.366 INFO:tasks.workunit.client.0.smithi119.stdout:0/620: unlink de/d1c/d2f/d40/f99 0 2024-09-13T21:44:50.366 INFO:tasks.workunit.client.1.smithi155.stdout:4/262: chown d1/d7/f30 136 1 2024-09-13T21:44:50.368 INFO:tasks.workunit.client.0.smithi119.stdout:0/621: creat de/d1c/d2f/d35/fdd x:0 0 0 2024-09-13T21:44:50.369 INFO:tasks.workunit.client.1.smithi155.stdout:4/263: mknod d1/d7/de/c4f 0 2024-09-13T21:44:50.369 INFO:tasks.workunit.client.1.smithi155.stdout:4/264: stat d1/l3e 0 2024-09-13T21:44:50.372 INFO:tasks.workunit.client.1.smithi155.stdout:4/265: creat d1/d7/de/dc/d2e/f50 x:0 0 0 2024-09-13T21:44:50.374 INFO:tasks.workunit.client.1.smithi155.stdout:4/266: chown d1/d7/de/dc/d2e/d26/l35 713042021 1 2024-09-13T21:44:50.375 INFO:tasks.workunit.client.1.smithi155.stdout:4/267: creat d1/d48/f51 x:0 0 0 2024-09-13T21:44:50.376 INFO:tasks.workunit.client.1.smithi155.stdout:4/268: stat d1/d7/de/d1a/c31 0 2024-09-13T21:44:50.380 INFO:tasks.workunit.client.1.smithi155.stdout:4/269: link d1/d7/d21/d2d/c3f d1/d7/de/dc/d4a/c52 0 2024-09-13T21:44:50.380 INFO:tasks.workunit.client.1.smithi155.stdout:4/270: readlink d1/d7/de/dc/d2e/d26/l35 0 2024-09-13T21:44:50.386 INFO:tasks.workunit.client.1.smithi155.stdout:4/271: dwrite d1/d7/d21/f2a [0,4194304] 0 2024-09-13T21:44:50.387 INFO:tasks.workunit.client.1.smithi155.stdout:4/272: fsync d1/d7/de/d15/f4b 0 2024-09-13T21:44:50.390 INFO:tasks.workunit.client.1.smithi155.stdout:4/273: creat d1/d7/d21/d2d/f53 x:0 0 0 2024-09-13T21:44:50.390 INFO:tasks.workunit.client.0.smithi119.stdout:0/622: dread de/d1c/d2b/d76/f93 [0,4194304] 0 2024-09-13T21:44:50.393 INFO:tasks.workunit.client.0.smithi119.stdout:0/623: creat de/d1c/d2f/d40/d66/dcb/fde x:0 0 0 2024-09-13T21:44:50.393 INFO:tasks.workunit.client.1.smithi155.stdout:4/274: getdents d1/d7/d21/d2d/d42 0 2024-09-13T21:44:50.397 INFO:tasks.workunit.client.1.smithi155.stdout:4/275: dread d1/d7/d21/f2a [0,4194304] 0 2024-09-13T21:44:50.399 INFO:tasks.workunit.client.1.smithi155.stdout:4/276: unlink d1/d7/c17 0 2024-09-13T21:44:50.401 INFO:tasks.workunit.client.1.smithi155.stdout:4/277: link d1/d7/c19 d1/d7/c54 0 2024-09-13T21:44:50.402 INFO:tasks.workunit.client.0.smithi119.stdout:0/624: dwrite de/d1c/f1d [4194304,4194304] 0 2024-09-13T21:44:50.402 INFO:tasks.workunit.client.1.smithi155.stdout:4/278: write d1/f1c [3717949,35941] 0 2024-09-13T21:44:50.405 INFO:tasks.workunit.client.1.smithi155.stdout:4/279: mkdir d1/d7/de/d15/d55 0 2024-09-13T21:44:50.406 INFO:tasks.workunit.client.1.smithi155.stdout:4/280: truncate d1/d7/de/d15/f4b 60880 0 2024-09-13T21:44:50.406 INFO:tasks.workunit.client.0.smithi119.stdout:0/625: symlink de/d1c/d2f/d35/d4a/dac/ldf 0 2024-09-13T21:44:50.410 INFO:tasks.workunit.client.0.smithi119.stdout:0/626: creat de/d4e/fe0 x:0 0 0 2024-09-13T21:44:50.410 INFO:tasks.workunit.client.1.smithi155.stdout:4/281: creat d1/d7/de/dc/d4a/f56 x:0 0 0 2024-09-13T21:44:50.412 INFO:tasks.workunit.client.0.smithi119.stdout:0/627: symlink de/d49/le1 0 2024-09-13T21:44:50.415 INFO:tasks.workunit.client.1.smithi155.stdout:4/282: creat d1/d7/d21/f57 x:0 0 0 2024-09-13T21:44:50.416 INFO:tasks.workunit.client.1.smithi155.stdout:4/283: write d1/d7/d21/d2d/f53 [1038665,31869] 0 2024-09-13T21:44:50.416 INFO:tasks.workunit.client.1.smithi155.stdout:4/284: readlink d1/l4c 0 2024-09-13T21:44:50.417 INFO:tasks.workunit.client.0.smithi119.stdout:0/628: rename de/d1c/d2f/d40/d66/dcb/fde to de/d1c/d2b/fe2 0 2024-09-13T21:44:50.418 INFO:tasks.workunit.client.0.smithi119.stdout:0/629: fdatasync de/d3c/d7c/f7e 0 2024-09-13T21:44:50.420 INFO:tasks.workunit.client.1.smithi155.stdout:4/285: rename d1/d7/d21/f2a to d1/d7/f58 0 2024-09-13T21:44:50.420 INFO:tasks.workunit.client.0.smithi119.stdout:0/630: creat de/d1c/d2f/d40/d66/dcb/fe3 x:0 0 0 2024-09-13T21:44:50.421 INFO:tasks.workunit.client.0.smithi119.stdout:0/631: dread - de/d4e/fe0 zero size 2024-09-13T21:44:50.421 INFO:tasks.workunit.client.1.smithi155.stdout:4/286: creat d1/f59 x:0 0 0 2024-09-13T21:44:50.422 INFO:tasks.workunit.client.1.smithi155.stdout:4/287: fdatasync d1/d7/de/dc/f45 0 2024-09-13T21:44:50.422 INFO:tasks.workunit.client.0.smithi119.stdout:0/632: write de/d1c/d2b/d34/f5f [2936156,584] 0 2024-09-13T21:44:50.423 INFO:tasks.workunit.client.1.smithi155.stdout:7/189: sync 2024-09-13T21:44:50.423 INFO:tasks.workunit.client.1.smithi155.stdout:8/230: sync 2024-09-13T21:44:50.424 INFO:tasks.workunit.client.0.smithi119.stdout:0/633: mkdir de/d1c/d52/de4 0 2024-09-13T21:44:50.425 INFO:tasks.workunit.client.1.smithi155.stdout:7/190: mknod d5/d10/c34 0 2024-09-13T21:44:50.426 INFO:tasks.workunit.client.1.smithi155.stdout:8/231: creat d2/d6/f43 x:0 0 0 2024-09-13T21:44:50.427 INFO:tasks.workunit.client.1.smithi155.stdout:7/191: read d5/df/d15/f28 [84064,46604] 0 2024-09-13T21:44:50.427 INFO:tasks.workunit.client.1.smithi155.stdout:4/288: read d1/d7/de/f1f [855056,7810] 0 2024-09-13T21:44:50.429 INFO:tasks.workunit.client.0.smithi119.stdout:0/634: link lb de/d1c/d2b/dd7/le5 0 2024-09-13T21:44:50.432 INFO:tasks.workunit.client.1.smithi155.stdout:7/192: link d5/df/d15/l32 d5/df/d15/l35 0 2024-09-13T21:44:50.433 INFO:tasks.workunit.client.1.smithi155.stdout:8/232: getdents d2/d1f 0 2024-09-13T21:44:50.434 INFO:tasks.workunit.client.0.smithi119.stdout:0/635: write de/d1c/d2f/f47 [1203209,38174] 0 2024-09-13T21:44:50.436 INFO:tasks.workunit.client.1.smithi155.stdout:7/193: dread d5/df/f11 [0,4194304] 0 2024-09-13T21:44:50.436 INFO:tasks.workunit.client.0.smithi119.stdout:0/636: write de/d4e/fe0 [948064,103495] 0 2024-09-13T21:44:50.436 INFO:tasks.workunit.client.1.smithi155.stdout:8/233: symlink d2/d6/dd/l44 0 2024-09-13T21:44:50.437 INFO:tasks.workunit.client.0.smithi119.stdout:0/637: chown de/d1c/d2b/d34/f5f 37007297 1 2024-09-13T21:44:50.438 INFO:tasks.workunit.client.0.smithi119.stdout:5/657: sync 2024-09-13T21:44:50.441 INFO:tasks.workunit.client.0.smithi119.stdout:5/658: mkdir d0/d3/d1f/d21/d4f/de6 0 2024-09-13T21:44:50.444 INFO:tasks.workunit.client.0.smithi119.stdout:5/659: dread d0/d3/f50 [0,4194304] 0 2024-09-13T21:44:50.446 INFO:tasks.workunit.client.0.smithi119.stdout:5/660: mknod d0/d3/d4/ce7 0 2024-09-13T21:44:50.448 INFO:tasks.workunit.client.0.smithi119.stdout:5/661: symlink d0/d3/d4/d9/d74/le8 0 2024-09-13T21:44:50.451 INFO:tasks.workunit.client.0.smithi119.stdout:0/638: dread de/d1c/d2f/d35/d4a/f60 [0,4194304] 0 2024-09-13T21:44:50.452 INFO:tasks.workunit.client.0.smithi119.stdout:0/639: fdatasync de/d1c/d64/f8e 0 2024-09-13T21:44:50.454 INFO:tasks.workunit.client.0.smithi119.stdout:0/640: mkdir de/d3c/de6 0 2024-09-13T21:44:50.458 INFO:tasks.workunit.client.0.smithi119.stdout:0/641: rename de/d1c/d2b/c4d to de/ce7 0 2024-09-13T21:44:50.467 INFO:tasks.workunit.client.1.smithi155.stdout:7/194: link d5/df/d15/l32 d5/l36 0 2024-09-13T21:44:50.467 INFO:tasks.workunit.client.1.smithi155.stdout:7/195: truncate d5/d13/f24 677289 0 2024-09-13T21:44:50.469 INFO:tasks.workunit.client.0.smithi119.stdout:0/642: dread de/d49/f4f [0,4194304] 0 2024-09-13T21:44:50.470 INFO:tasks.workunit.client.1.smithi155.stdout:7/196: rename d5/df/d15/l35 to d5/df/d15/l37 0 2024-09-13T21:44:50.472 INFO:tasks.workunit.client.1.smithi155.stdout:7/197: rename c4 to d5/d13/d31/c38 0 2024-09-13T21:44:50.473 INFO:tasks.workunit.client.1.smithi155.stdout:7/198: chown d5/df/d15/l32 24602 1 2024-09-13T21:44:50.474 INFO:tasks.workunit.client.0.smithi119.stdout:0/643: rename de/d1c/d2b/lc7 to de/d1c/d2f/d40/d66/dcb/dd6/le8 0 2024-09-13T21:44:50.475 INFO:tasks.workunit.client.1.smithi155.stdout:7/199: mknod d5/df/d15/d33/c39 0 2024-09-13T21:44:50.476 INFO:tasks.workunit.client.0.smithi119.stdout:0/644: symlink de/d1c/d2b/d76/d9b/da1/le9 0 2024-09-13T21:44:50.477 INFO:tasks.workunit.client.0.smithi119.stdout:0/645: write de/d4e/fe0 [644811,109947] 0 2024-09-13T21:44:50.477 INFO:tasks.workunit.client.1.smithi155.stdout:7/200: creat d5/f3a x:0 0 0 2024-09-13T21:44:50.477 INFO:tasks.workunit.client.0.smithi119.stdout:0/646: fdatasync de/d1c/d2f/f41 0 2024-09-13T21:44:50.478 INFO:tasks.workunit.client.0.smithi119.stdout:0/647: fsync de/d1c/d2f/d35/f45 0 2024-09-13T21:44:50.478 INFO:tasks.workunit.client.1.smithi155.stdout:7/201: mkdir d5/d3b 0 2024-09-13T21:44:50.479 INFO:tasks.workunit.client.1.smithi155.stdout:7/202: read - d5/d10/f2a zero size 2024-09-13T21:44:50.479 INFO:tasks.workunit.client.1.smithi155.stdout:7/203: chown d5/l2f 326724 1 2024-09-13T21:44:50.480 INFO:tasks.workunit.client.0.smithi119.stdout:0/648: creat de/d1c/fea x:0 0 0 2024-09-13T21:44:50.481 INFO:tasks.workunit.client.0.smithi119.stdout:0/649: chown de/d1c/d2b/d34/f5b 2212339 1 2024-09-13T21:44:50.481 INFO:tasks.workunit.client.1.smithi155.stdout:7/204: symlink d5/d13/d31/l3c 0 2024-09-13T21:44:50.481 INFO:tasks.workunit.client.0.smithi119.stdout:0/650: read - de/d49/fdb zero size 2024-09-13T21:44:50.482 INFO:tasks.workunit.client.0.smithi119.stdout:0/651: chown de/d1c/d64/c78 734943020 1 2024-09-13T21:44:50.486 INFO:tasks.workunit.client.0.smithi119.stdout:0/652: truncate de/d49/f4f 1744308 0 2024-09-13T21:44:50.494 INFO:tasks.workunit.client.0.smithi119.stdout:0/653: dwrite de/d1c/d2b/d76/d9a/fc2 [0,4194304] 0 2024-09-13T21:44:50.499 INFO:tasks.workunit.client.0.smithi119.stdout:0/654: write de/d1c/d2f/d40/d66/dcb/dd6/d83/f88 [1890795,39189] 0 2024-09-13T21:44:50.501 INFO:tasks.workunit.client.0.smithi119.stdout:0/655: truncate de/f22 3148069 0 2024-09-13T21:44:50.503 INFO:tasks.workunit.client.0.smithi119.stdout:0/656: symlink de/d49/leb 0 2024-09-13T21:44:50.504 INFO:tasks.workunit.client.0.smithi119.stdout:0/657: mkdir de/d4e/da5/dec 0 2024-09-13T21:44:50.506 INFO:tasks.workunit.client.0.smithi119.stdout:0/658: mkdir de/d4e/d7f/ded 0 2024-09-13T21:44:50.509 INFO:tasks.workunit.client.0.smithi119.stdout:0/659: getdents de/d1c/d2f/d35/d4a/d62 0 2024-09-13T21:44:50.510 INFO:tasks.workunit.client.0.smithi119.stdout:0/660: fdatasync de/d4e/fe0 0 2024-09-13T21:44:50.511 INFO:tasks.workunit.client.0.smithi119.stdout:0/661: mknod de/d1c/d2f/d40/d66/cee 0 2024-09-13T21:44:50.513 INFO:tasks.workunit.client.0.smithi119.stdout:0/662: write de/d1c/d2b/fe2 [790745,105579] 0 2024-09-13T21:44:50.514 INFO:tasks.workunit.client.0.smithi119.stdout:0/663: readlink l2 0 2024-09-13T21:44:50.514 INFO:tasks.workunit.client.0.smithi119.stdout:0/664: stat de/d1c/d64/c78 0 2024-09-13T21:44:50.532 INFO:tasks.workunit.client.0.smithi119.stdout:0/665: dread de/f61 [0,4194304] 0 2024-09-13T21:44:50.537 INFO:tasks.workunit.client.0.smithi119.stdout:0/666: dwrite de/d1c/d2f/d40/d66/fc5 [0,4194304] 0 2024-09-13T21:44:50.541 INFO:tasks.workunit.client.0.smithi119.stdout:0/667: fsync de/d1c/d2b/d76/f97 0 2024-09-13T21:44:50.550 INFO:tasks.workunit.client.0.smithi119.stdout:0/668: truncate de/f22 30909 0 2024-09-13T21:44:50.551 INFO:tasks.workunit.client.0.smithi119.stdout:0/669: fsync de/d4e/d7f/fa3 0 2024-09-13T21:44:50.553 INFO:tasks.workunit.client.0.smithi119.stdout:0/670: mkdir de/d1c/d2f/d35/dce/def 0 2024-09-13T21:44:50.566 INFO:tasks.workunit.client.1.smithi155.stdout:3/354: sync 2024-09-13T21:44:50.566 INFO:tasks.workunit.client.1.smithi155.stdout:0/303: sync 2024-09-13T21:44:50.566 INFO:tasks.workunit.client.1.smithi155.stdout:6/339: sync 2024-09-13T21:44:50.566 INFO:tasks.workunit.client.1.smithi155.stdout:1/256: sync 2024-09-13T21:44:50.566 INFO:tasks.workunit.client.1.smithi155.stdout:5/279: sync 2024-09-13T21:44:50.566 INFO:tasks.workunit.client.1.smithi155.stdout:2/163: sync 2024-09-13T21:44:50.566 INFO:tasks.workunit.client.1.smithi155.stdout:9/285: sync 2024-09-13T21:44:50.568 INFO:tasks.workunit.client.1.smithi155.stdout:1/257: chown d6/d15/c1b 492 1 2024-09-13T21:44:50.568 INFO:tasks.workunit.client.1.smithi155.stdout:5/280: write d5/d12/f4d [511080,67617] 0 2024-09-13T21:44:50.569 INFO:tasks.workunit.client.1.smithi155.stdout:2/164: mkdir d2/dd/d21/d39 0 2024-09-13T21:44:50.570 INFO:tasks.workunit.client.1.smithi155.stdout:0/304: mknod d1/d6/c73 0 2024-09-13T21:44:50.571 INFO:tasks.workunit.client.1.smithi155.stdout:3/355: mknod d3/d25/d1b/d1f/c7a 0 2024-09-13T21:44:50.572 INFO:tasks.workunit.client.1.smithi155.stdout:3/356: write d3/d25/f1c [2651453,3898] 0 2024-09-13T21:44:50.575 INFO:tasks.workunit.client.1.smithi155.stdout:9/286: creat dc/d19/d21/d67/f69 x:0 0 0 2024-09-13T21:44:50.575 INFO:tasks.workunit.client.1.smithi155.stdout:1/258: rmdir d6/d15/d3e/d17/d30/d4b 39 2024-09-13T21:44:50.576 INFO:tasks.workunit.client.1.smithi155.stdout:3/357: mknod d3/d25/d17/d52/c7b 0 2024-09-13T21:44:50.578 INFO:tasks.workunit.client.1.smithi155.stdout:0/305: mkdir d1/d6/d74 0 2024-09-13T21:44:50.580 INFO:tasks.workunit.client.0.smithi119.stdout:9/890: sync 2024-09-13T21:44:50.580 INFO:tasks.workunit.client.0.smithi119.stdout:1/649: sync 2024-09-13T21:44:50.580 INFO:tasks.workunit.client.0.smithi119.stdout:8/657: sync 2024-09-13T21:44:50.581 INFO:tasks.workunit.client.1.smithi155.stdout:3/358: mkdir d3/d25/d1b/d1f/d36/d7c 0 2024-09-13T21:44:50.582 INFO:tasks.workunit.client.0.smithi119.stdout:8/658: unlink d1b/d1d/d48/f72 0 2024-09-13T21:44:50.583 INFO:tasks.workunit.client.0.smithi119.stdout:9/891: mknod d0/d79/c135 0 2024-09-13T21:44:50.583 INFO:tasks.workunit.client.1.smithi155.stdout:0/306: creat d1/d6/dc/d4d/d4a/d4e/f75 x:0 0 0 2024-09-13T21:44:50.585 INFO:tasks.workunit.client.0.smithi119.stdout:1/650: truncate d1/d3/d61/d77/d78/d32/d33/d43/f5e 273893 0 2024-09-13T21:44:50.585 INFO:tasks.workunit.client.1.smithi155.stdout:3/359: dread d3/d25/d1b/d1f/d36/d5c/d66/f6f [0,4194304] 0 2024-09-13T21:44:50.586 INFO:tasks.workunit.client.0.smithi119.stdout:9/892: mkdir d0/d8/d18/d124/d136 0 2024-09-13T21:44:50.588 INFO:tasks.workunit.client.1.smithi155.stdout:0/307: write d1/d6/dc/d4d/f50 [557369,65824] 0 2024-09-13T21:44:50.588 INFO:tasks.workunit.client.1.smithi155.stdout:1/259: creat d6/d15/d3e/d17/d30/f5e x:0 0 0 2024-09-13T21:44:50.589 INFO:tasks.workunit.client.1.smithi155.stdout:9/287: link dc/d19/d23/l2a dc/d18/d1e/l6a 0 2024-09-13T21:44:50.591 INFO:tasks.workunit.client.1.smithi155.stdout:6/340: write db/d11/d2b/d35/f25 [540508,19263] 0 2024-09-13T21:44:50.593 INFO:tasks.workunit.client.1.smithi155.stdout:9/288: creat dc/d19/d21/f6b x:0 0 0 2024-09-13T21:44:50.593 INFO:tasks.workunit.client.1.smithi155.stdout:5/281: write d5/d26/f35 [4860342,80883] 0 2024-09-13T21:44:50.594 INFO:tasks.workunit.client.0.smithi119.stdout:1/651: dwrite d1/d3/dc/d11/f3c [0,4194304] 0 2024-09-13T21:44:50.596 INFO:tasks.workunit.client.0.smithi119.stdout:8/659: dread d1b/d1d/d26/f89 [0,4194304] 0 2024-09-13T21:44:50.596 INFO:tasks.workunit.client.0.smithi119.stdout:9/893: dwrite d0/d8/f4b [0,4194304] 0 2024-09-13T21:44:50.597 INFO:tasks.workunit.client.1.smithi155.stdout:9/289: fsync dc/de/d5c/f5e 0 2024-09-13T21:44:50.598 INFO:tasks.workunit.client.1.smithi155.stdout:3/360: dwrite d3/d25/f3f [0,4194304] 0 2024-09-13T21:44:50.599 INFO:tasks.workunit.client.1.smithi155.stdout:5/282: read d5/d16/d33/d1b/d28/f4a [4106953,88500] 0 2024-09-13T21:44:50.600 INFO:tasks.workunit.client.1.smithi155.stdout:1/260: dread d6/ff [0,4194304] 0 2024-09-13T21:44:50.600 INFO:tasks.workunit.client.0.smithi119.stdout:8/660: mkdir d1b/d1d/d48/d58/d7f/dcb 0 2024-09-13T21:44:50.602 INFO:tasks.workunit.client.0.smithi119.stdout:8/661: chown d1b/d4e/d71/lc9 66715202 1 2024-09-13T21:44:50.603 INFO:tasks.workunit.client.1.smithi155.stdout:1/261: readlink d6/d7/l5c 0 2024-09-13T21:44:50.603 INFO:tasks.workunit.client.1.smithi155.stdout:5/283: read - d5/d16/d33/d1b/d2f/d3c/d44/f2e zero size 2024-09-13T21:44:50.603 INFO:tasks.workunit.client.1.smithi155.stdout:9/290: read - dc/d19/d23/d2f/d43/f4d zero size 2024-09-13T21:44:50.604 INFO:tasks.workunit.client.1.smithi155.stdout:3/361: truncate d3/d25/d17/d3b/f50 734283 0 2024-09-13T21:44:50.604 INFO:tasks.workunit.client.0.smithi119.stdout:9/894: dwrite d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/f3b [0,4194304] 0 2024-09-13T21:44:50.609 INFO:tasks.workunit.client.1.smithi155.stdout:9/291: write dc/d19/d23/f66 [930368,130238] 0 2024-09-13T21:44:50.610 INFO:tasks.workunit.client.1.smithi155.stdout:1/262: chown d6/l12 1270667544 1 2024-09-13T21:44:50.610 INFO:tasks.workunit.client.0.smithi119.stdout:9/895: link d0/d8/d18/d23/d27/d2d/d5f/da8/c12c d0/d8/d18/d23/d27/d2d/dc1/c137 0 2024-09-13T21:44:50.616 INFO:tasks.workunit.client.1.smithi155.stdout:5/284: read d5/d12/f14 [400639,94856] 0 2024-09-13T21:44:50.618 INFO:tasks.workunit.client.1.smithi155.stdout:1/263: dwrite d6/d15/f45 [0,4194304] 0 2024-09-13T21:44:50.621 INFO:tasks.workunit.client.0.smithi119.stdout:8/662: dread d1b/f1f [0,4194304] 0 2024-09-13T21:44:50.621 INFO:tasks.workunit.client.1.smithi155.stdout:1/264: fdatasync d6/f16 0 2024-09-13T21:44:50.622 INFO:tasks.workunit.client.0.smithi119.stdout:8/663: write f18 [417363,112079] 0 2024-09-13T21:44:50.623 INFO:tasks.workunit.client.0.smithi119.stdout:8/664: stat d1b/d1d/d48/d54/f9d 0 2024-09-13T21:44:50.623 INFO:tasks.workunit.client.1.smithi155.stdout:1/265: write d6/d15/d3e/d17/d30/f46 [277581,114044] 0 2024-09-13T21:44:50.628 INFO:tasks.workunit.client.0.smithi119.stdout:8/665: link f15 d1b/d1d/d48/d54/fcc 0 2024-09-13T21:44:50.628 INFO:tasks.workunit.client.0.smithi119.stdout:8/666: fdatasync d1b/d4e/d71/f98 0 2024-09-13T21:44:50.629 INFO:tasks.workunit.client.0.smithi119.stdout:8/667: readlink d1b/d4e/l52 0 2024-09-13T21:44:50.630 INFO:tasks.workunit.client.0.smithi119.stdout:8/668: mknod d1b/d4e/d71/ccd 0 2024-09-13T21:44:50.649 INFO:tasks.workunit.client.0.smithi119.stdout:8/669: dread d1b/d1d/d48/f78 [0,4194304] 0 2024-09-13T21:44:50.653 INFO:tasks.workunit.client.0.smithi119.stdout:8/670: fdatasync d1b/d1d/d26/d3e/d65/f76 0 2024-09-13T21:44:50.658 INFO:tasks.workunit.client.0.smithi119.stdout:1/652: dread d1/d3/dc/d11/d19/d2d/f51 [0,4194304] 0 2024-09-13T21:44:50.660 INFO:tasks.workunit.client.0.smithi119.stdout:1/653: fsync d1/d3/dc/d11/d3d/fb1 0 2024-09-13T21:44:50.662 INFO:tasks.workunit.client.0.smithi119.stdout:9/896: dwrite d0/d8/d18/d23/dea/f8f [0,4194304] 0 2024-09-13T21:44:50.662 INFO:tasks.workunit.client.0.smithi119.stdout:8/671: truncate d1b/d1d/d48/d54/f9d 1655820 0 2024-09-13T21:44:50.665 INFO:tasks.workunit.client.0.smithi119.stdout:9/897: read d0/d8/d18/dad/fde [1123516,22047] 0 2024-09-13T21:44:50.666 INFO:tasks.workunit.client.0.smithi119.stdout:8/672: unlink d1b/d1d/d48/d58/d7f/f82 0 2024-09-13T21:44:50.667 INFO:tasks.workunit.client.0.smithi119.stdout:9/898: truncate d0/d8/d18/f127 354000 0 2024-09-13T21:44:50.667 INFO:tasks.workunit.client.0.smithi119.stdout:1/654: symlink d1/d3/dc/d11/d19/d2d/d59/ld7 0 2024-09-13T21:44:50.670 INFO:tasks.workunit.client.0.smithi119.stdout:9/899: mkdir d0/d8/d18/d23/d27/d2d/d138 0 2024-09-13T21:44:50.673 INFO:tasks.workunit.client.0.smithi119.stdout:1/655: rename d1/d3/dc/d11/d19/d47 to d1/d3/dc/d11/d19/d2d/d37/d9b/dd8 0 2024-09-13T21:44:50.675 INFO:tasks.workunit.client.0.smithi119.stdout:8/673: creat d1b/fce x:0 0 0 2024-09-13T21:44:50.675 INFO:tasks.workunit.client.0.smithi119.stdout:1/656: symlink d1/ld9 0 2024-09-13T21:44:50.683 INFO:tasks.workunit.client.1.smithi155.stdout:9/292: mknod dc/d19/d23/c6c 0 2024-09-13T21:44:50.685 INFO:tasks.workunit.client.1.smithi155.stdout:5/285: mkdir d5/d16/d33/d1b/d59 0 2024-09-13T21:44:50.687 INFO:tasks.workunit.client.0.smithi119.stdout:3/583: sync 2024-09-13T21:44:50.687 INFO:tasks.workunit.client.0.smithi119.stdout:5/662: sync 2024-09-13T21:44:50.687 INFO:tasks.workunit.client.0.smithi119.stdout:7/711: sync 2024-09-13T21:44:50.687 INFO:tasks.workunit.client.0.smithi119.stdout:2/632: sync 2024-09-13T21:44:50.688 INFO:tasks.workunit.client.0.smithi119.stdout:6/628: sync 2024-09-13T21:44:50.688 INFO:tasks.workunit.client.0.smithi119.stdout:4/693: sync 2024-09-13T21:44:50.689 INFO:tasks.workunit.client.1.smithi155.stdout:6/341: getdents db/d11/d1e 0 2024-09-13T21:44:50.691 INFO:tasks.workunit.client.0.smithi119.stdout:1/657: rename d1/d3/dc/d11 to d1/d3/d61/d77/d78/d32/dda 0 2024-09-13T21:44:50.692 INFO:tasks.workunit.client.1.smithi155.stdout:9/293: dwrite dc/de/f10 [0,4194304] 0 2024-09-13T21:44:50.692 INFO:tasks.workunit.client.0.smithi119.stdout:6/629: read dc/f1b [4233736,22463] 0 2024-09-13T21:44:50.694 INFO:tasks.workunit.client.1.smithi155.stdout:5/286: dread d5/d16/d33/d1b/d1e/f4c [0,4194304] 0 2024-09-13T21:44:50.694 INFO:tasks.workunit.client.1.smithi155.stdout:6/342: symlink db/d12/d1c/l66 0 2024-09-13T21:44:50.697 INFO:tasks.workunit.client.1.smithi155.stdout:6/343: write db/d12/d1c/d36/d46/f48 [1514500,122971] 0 2024-09-13T21:44:50.698 INFO:tasks.workunit.client.1.smithi155.stdout:9/294: unlink dc/de/f3a 0 2024-09-13T21:44:50.699 INFO:tasks.workunit.client.1.smithi155.stdout:1/266: link d6/d15/d23/f3c d6/d15/d57/d5d/f5f 0 2024-09-13T21:44:50.700 INFO:tasks.workunit.client.1.smithi155.stdout:5/287: creat d5/d16/d33/d1f/f5a x:0 0 0 2024-09-13T21:44:50.705 INFO:tasks.workunit.client.0.smithi119.stdout:5/663: creat d0/d3/d4/d9/d14/d24/d25/d54/dd6/fe9 x:0 0 0 2024-09-13T21:44:50.706 INFO:tasks.workunit.client.1.smithi155.stdout:9/295: link dc/d18/c3f dc/d18/d50/c6d 0 2024-09-13T21:44:50.706 INFO:tasks.workunit.client.0.smithi119.stdout:1/658: symlink d1/d3/d61/d7e/ldb 0 2024-09-13T21:44:50.706 INFO:tasks.workunit.client.0.smithi119.stdout:8/674: dread d1b/d1d/d26/d6b/fb3 [0,4194304] 0 2024-09-13T21:44:50.707 INFO:tasks.workunit.client.0.smithi119.stdout:7/712: rename d8/d19/d2e/d34/c68 to d8/d3c/d53/d37/d83/d89/dc3/ce4 0 2024-09-13T21:44:50.707 INFO:tasks.workunit.client.0.smithi119.stdout:6/630: dwrite dc/d3d/d4e/f57 [4194304,4194304] 0 2024-09-13T21:44:50.708 INFO:tasks.workunit.client.0.smithi119.stdout:4/694: dwrite d4/d1e/d28/d34/d99/fa4 [0,4194304] 0 2024-09-13T21:44:50.709 INFO:tasks.workunit.client.1.smithi155.stdout:9/296: write dc/d19/d23/f2e [705627,105167] 0 2024-09-13T21:44:50.709 INFO:tasks.workunit.client.0.smithi119.stdout:1/659: read d1/d3/f2b [3763003,43598] 0 2024-09-13T21:44:50.710 INFO:tasks.workunit.client.0.smithi119.stdout:8/675: read d1b/d1d/d26/f89 [2735885,107952] 0 2024-09-13T21:44:50.713 INFO:tasks.workunit.client.0.smithi119.stdout:6/631: write dc/df/d64/f77 [185383,69954] 0 2024-09-13T21:44:50.714 INFO:tasks.workunit.client.1.smithi155.stdout:6/344: dwrite db/d11/d2b/d35/f25 [0,4194304] 0 2024-09-13T21:44:50.714 INFO:tasks.workunit.client.1.smithi155.stdout:1/267: dwrite d6/f16 [0,4194304] 0 2024-09-13T21:44:50.715 INFO:tasks.workunit.client.1.smithi155.stdout:9/297: chown dc/d19/d23/d2f/f62 41276 1 2024-09-13T21:44:50.717 INFO:tasks.workunit.client.1.smithi155.stdout:5/288: dwrite d5/d16/d33/d1b/f57 [0,4194304] 0 2024-09-13T21:44:50.718 INFO:tasks.workunit.client.0.smithi119.stdout:9/900: link d0/d8/d18/de3/fca d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/f139 0 2024-09-13T21:44:50.718 INFO:tasks.workunit.client.0.smithi119.stdout:7/713: mknod d8/d3c/d53/d37/d57/d5f/ce5 0 2024-09-13T21:44:50.718 INFO:tasks.workunit.client.1.smithi155.stdout:6/345: readlink db/d12/d1c/l66 0 2024-09-13T21:44:50.723 INFO:tasks.workunit.client.1.smithi155.stdout:6/346: mkdir db/d3d/d5f/d67 0 2024-09-13T21:44:50.725 INFO:tasks.workunit.client.1.smithi155.stdout:1/268: creat d6/d15/d23/d55/f60 x:0 0 0 2024-09-13T21:44:50.728 INFO:tasks.workunit.client.0.smithi119.stdout:8/676: chown d1b/d1d/d5e/ca6 329297719 1 2024-09-13T21:44:50.730 INFO:tasks.workunit.client.0.smithi119.stdout:6/632: symlink dc/d3a/dbb/lc9 0 2024-09-13T21:44:50.731 INFO:tasks.workunit.client.1.smithi155.stdout:5/289: dwrite d5/d16/d33/f53 [0,4194304] 0 2024-09-13T21:44:50.734 INFO:tasks.workunit.client.0.smithi119.stdout:3/584: dwrite d6/d15/d1a/d45/d47/d4d/f92 [0,4194304] 0 2024-09-13T21:44:50.736 INFO:tasks.workunit.client.1.smithi155.stdout:9/298: getdents dc/de 0 2024-09-13T21:44:50.736 INFO:tasks.workunit.client.1.smithi155.stdout:6/347: dwrite db/d11/d2b/d35/f25 [0,4194304] 0 2024-09-13T21:44:50.739 INFO:tasks.workunit.client.0.smithi119.stdout:3/585: readlink d6/d25/l2b 0 2024-09-13T21:44:50.741 INFO:tasks.workunit.client.0.smithi119.stdout:0/671: sync 2024-09-13T21:44:50.741 INFO:tasks.workunit.client.0.smithi119.stdout:5/664: dwrite d0/d3/d4/d2e/fbc [0,4194304] 0 2024-09-13T21:44:50.742 INFO:tasks.workunit.client.1.smithi155.stdout:6/348: dread - db/d11/d4c/f51 zero size 2024-09-13T21:44:50.742 INFO:tasks.workunit.client.1.smithi155.stdout:5/290: mkdir d5/d16/d33/d1b/d2f/d3c/d5b 0 2024-09-13T21:44:50.742 INFO:tasks.workunit.client.0.smithi119.stdout:5/665: chown d0/dab 25018 1 2024-09-13T21:44:50.743 INFO:tasks.workunit.client.1.smithi155.stdout:1/269: getdents d6/d15/d57/d5d 0 2024-09-13T21:44:50.744 INFO:tasks.workunit.client.0.smithi119.stdout:9/901: symlink d0/d8/d18/d124/d136/l13a 0 2024-09-13T21:44:50.744 INFO:tasks.workunit.client.1.smithi155.stdout:5/291: symlink d5/d16/d33/d1b/d2f/l5c 0 2024-09-13T21:44:50.745 INFO:tasks.workunit.client.0.smithi119.stdout:0/672: fdatasync de/d4e/fe0 0 2024-09-13T21:44:50.749 INFO:tasks.workunit.client.0.smithi119.stdout:4/695: link d4/d1e/d26/d5e/l74 d4/d1e/le2 0 2024-09-13T21:44:50.749 INFO:tasks.workunit.client.1.smithi155.stdout:1/270: rename d6/l43 to d6/d15/l61 0 2024-09-13T21:44:50.752 INFO:tasks.workunit.client.0.smithi119.stdout:3/586: mknod d6/d15/d1a/d45/d47/d4d/cc3 0 2024-09-13T21:44:50.753 INFO:tasks.workunit.client.0.smithi119.stdout:4/696: fdatasync d4/d1e/d28/d34/d66/fd1 0 2024-09-13T21:44:50.755 INFO:tasks.workunit.client.0.smithi119.stdout:7/714: dwrite d8/d3c/d53/d3b/d48/f97 [0,4194304] 0 2024-09-13T21:44:50.755 INFO:tasks.workunit.client.1.smithi155.stdout:5/292: dwrite d5/d26/d45/f54 [0,4194304] 0 2024-09-13T21:44:50.756 INFO:tasks.workunit.client.0.smithi119.stdout:8/677: rename d1b/d1d/d26/d3e/fb5 to d1b/d1d/d48/d54/fcf 0 2024-09-13T21:44:50.756 INFO:tasks.workunit.client.0.smithi119.stdout:3/587: readlink d6/d25/l2b 0 2024-09-13T21:44:50.756 INFO:tasks.workunit.client.0.smithi119.stdout:4/697: write d4/f2b [58650,30438] 0 2024-09-13T21:44:50.759 INFO:tasks.workunit.client.1.smithi155.stdout:5/293: write d5/f49 [621905,92525] 0 2024-09-13T21:44:50.762 INFO:tasks.workunit.client.0.smithi119.stdout:4/698: chown d4/d1e/d26/d60/d71/d83/f68 7212 1 2024-09-13T21:44:50.773 INFO:tasks.workunit.client.1.smithi155.stdout:5/294: dwrite d5/d16/d33/f43 [0,4194304] 0 2024-09-13T21:44:50.775 INFO:tasks.workunit.client.0.smithi119.stdout:5/666: dwrite d0/d3/d4/d2e/d65/f81 [0,4194304] 0 2024-09-13T21:44:50.776 INFO:tasks.workunit.client.0.smithi119.stdout:0/673: dwrite fd [0,4194304] 0 2024-09-13T21:44:50.777 INFO:tasks.workunit.client.1.smithi155.stdout:9/299: write dc/d19/d23/d38/f5b [952610,63042] 0 2024-09-13T21:44:50.779 INFO:tasks.workunit.client.0.smithi119.stdout:8/678: creat d1b/d1d/d26/d6b/fd0 x:0 0 0 2024-09-13T21:44:50.780 INFO:tasks.workunit.client.1.smithi155.stdout:6/349: truncate db/d12/f23 2848470 0 2024-09-13T21:44:50.780 INFO:tasks.workunit.client.1.smithi155.stdout:9/300: fsync dc/de/d15/f24 0 2024-09-13T21:44:50.785 INFO:tasks.workunit.client.0.smithi119.stdout:6/633: dread dc/df/d41/f82 [0,4194304] 0 2024-09-13T21:44:50.785 INFO:tasks.workunit.client.0.smithi119.stdout:2/633: dread d1/d22/d55/f48 [0,4194304] 0 2024-09-13T21:44:50.785 INFO:tasks.workunit.client.0.smithi119.stdout:0/674: fsync de/f1a 0 2024-09-13T21:44:50.786 INFO:tasks.workunit.client.1.smithi155.stdout:5/295: creat d5/d16/d33/d1b/d1e/f5d x:0 0 0 2024-09-13T21:44:50.786 INFO:tasks.workunit.client.0.smithi119.stdout:7/715: read d8/d3c/d53/d37/d57/fd8 [778348,32513] 0 2024-09-13T21:44:50.787 INFO:tasks.workunit.client.0.smithi119.stdout:5/667: chown d0/d3/d4/d9/d14/d24/c8a 12097 1 2024-09-13T21:44:50.788 INFO:tasks.workunit.client.1.smithi155.stdout:1/271: rmdir d6/d15/d3e/d17 39 2024-09-13T21:44:50.790 INFO:tasks.workunit.client.0.smithi119.stdout:4/699: dwrite d4/d1e/d26/d60/d71/fd3 [0,4194304] 0 2024-09-13T21:44:50.790 INFO:tasks.workunit.client.1.smithi155.stdout:6/350: creat db/d11/d4c/d64/d5e/f68 x:0 0 0 2024-09-13T21:44:50.790 INFO:tasks.workunit.client.1.smithi155.stdout:9/301: link dc/d19/d23/c6c dc/de/c6e 0 2024-09-13T21:44:50.791 INFO:tasks.workunit.client.0.smithi119.stdout:8/679: mknod d1b/d4e/d71/cd1 0 2024-09-13T21:44:50.793 INFO:tasks.workunit.client.1.smithi155.stdout:1/272: link d6/d15/f4e d6/d15/d57/d5d/f62 0 2024-09-13T21:44:50.794 INFO:tasks.workunit.client.1.smithi155.stdout:9/302: mkdir dc/de/d6f 0 2024-09-13T21:44:50.796 INFO:tasks.workunit.client.1.smithi155.stdout:1/273: mknod d6/c63 0 2024-09-13T21:44:50.797 INFO:tasks.workunit.client.1.smithi155.stdout:9/303: mkdir dc/d19/d23/d70 0 2024-09-13T21:44:50.798 INFO:tasks.workunit.client.0.smithi119.stdout:9/902: dwrite d0/d8/d18/f94 [0,4194304] 0 2024-09-13T21:44:50.798 INFO:tasks.workunit.client.1.smithi155.stdout:6/351: dwrite db/d2c/f3b [0,4194304] 0 2024-09-13T21:44:50.799 INFO:tasks.workunit.client.0.smithi119.stdout:0/675: fdatasync de/d1c/d2b/d76/f93 0 2024-09-13T21:44:50.801 INFO:tasks.workunit.client.0.smithi119.stdout:6/634: mknod dc/d3d/d40/d68/cca 0 2024-09-13T21:44:50.801 INFO:tasks.workunit.client.1.smithi155.stdout:1/274: mkdir d6/d7/d64 0 2024-09-13T21:44:50.803 INFO:tasks.workunit.client.1.smithi155.stdout:1/275: chown d6/d7/l5c 91914 1 2024-09-13T21:44:50.803 INFO:tasks.workunit.client.0.smithi119.stdout:3/588: dwrite d6/d15/d1a/f5b [0,4194304] 0 2024-09-13T21:44:50.805 INFO:tasks.workunit.client.1.smithi155.stdout:6/352: rename db/d11/d4c/f51 to db/d11/d1e/d21/f69 0 2024-09-13T21:44:50.806 INFO:tasks.workunit.client.0.smithi119.stdout:1/660: dwrite d1/d3/d61/d77/d78/d32/dda/d19/d2d/f44 [0,4194304] 0 2024-09-13T21:44:50.806 INFO:tasks.workunit.client.0.smithi119.stdout:4/700: rmdir d4/d1e/d28/d34/d99 39 2024-09-13T21:44:50.809 INFO:tasks.workunit.client.1.smithi155.stdout:9/304: dwrite dc/d19/d23/f66 [0,4194304] 0 2024-09-13T21:44:50.809 INFO:tasks.workunit.client.1.smithi155.stdout:1/276: creat d6/d15/d57/d5d/f65 x:0 0 0 2024-09-13T21:44:50.810 INFO:tasks.workunit.client.1.smithi155.stdout:9/305: chown dc/de/d5c 38707086 1 2024-09-13T21:44:50.810 INFO:tasks.workunit.client.1.smithi155.stdout:9/306: read fb [2207298,56218] 0 2024-09-13T21:44:50.811 INFO:tasks.workunit.client.1.smithi155.stdout:6/353: rename db/d11/d4c/l60 to db/d3d/d5f/l6a 0 2024-09-13T21:44:50.814 INFO:tasks.workunit.client.0.smithi119.stdout:9/903: creat d0/d8/d18/d124/f13b x:0 0 0 2024-09-13T21:44:50.814 INFO:tasks.workunit.client.1.smithi155.stdout:1/277: creat d6/d15/d23/d55/f66 x:0 0 0 2024-09-13T21:44:50.815 INFO:tasks.workunit.client.0.smithi119.stdout:1/661: write d1/d3/d61/d77/d78/d32/dda/d3d/f98 [245313,107859] 0 2024-09-13T21:44:50.817 INFO:tasks.workunit.client.0.smithi119.stdout:7/716: symlink d8/d3c/d53/d37/d95/le6 0 2024-09-13T21:44:50.818 INFO:tasks.workunit.client.1.smithi155.stdout:9/307: rmdir dc/d18 39 2024-09-13T21:44:50.818 INFO:tasks.workunit.client.1.smithi155.stdout:6/354: rmdir db/d11/d2b/d35 39 2024-09-13T21:44:50.821 INFO:tasks.workunit.client.0.smithi119.stdout:8/680: mknod d1b/d1d/d26/d3e/daa/cd2 0 2024-09-13T21:44:50.821 INFO:tasks.workunit.client.1.smithi155.stdout:1/278: dread d6/d15/d57/d5d/f62 [0,4194304] 0 2024-09-13T21:44:50.824 INFO:tasks.workunit.client.1.smithi155.stdout:6/355: chown db/d11/l31 78 1 2024-09-13T21:44:50.824 INFO:tasks.workunit.client.0.smithi119.stdout:4/701: rename d4/f96 to d4/d1e/d28/d34/d6a/d79/d9f/dba/fe3 0 2024-09-13T21:44:50.825 INFO:tasks.workunit.client.0.smithi119.stdout:3/589: rmdir d6/d25/d2f/d33/d56/dab 39 2024-09-13T21:44:50.826 INFO:tasks.workunit.client.0.smithi119.stdout:9/904: creat d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/d117/f13c x:0 0 0 2024-09-13T21:44:50.828 INFO:tasks.workunit.client.0.smithi119.stdout:1/662: rename d1/ld9 to d1/d3/d61/d77/d78/d32/dc3/ldc 0 2024-09-13T21:44:50.828 INFO:tasks.workunit.client.0.smithi119.stdout:3/590: chown d6/d15/c62 31 1 2024-09-13T21:44:50.832 INFO:tasks.workunit.client.0.smithi119.stdout:4/702: getdents d4/d1e/d10/da5 0 2024-09-13T21:44:50.833 INFO:tasks.workunit.client.1.smithi155.stdout:1/279: dwrite d6/d15/d23/d55/f66 [0,4194304] 0 2024-09-13T21:44:50.836 INFO:tasks.workunit.client.1.smithi155.stdout:1/280: write d6/d15/f45 [957771,130640] 0 2024-09-13T21:44:50.837 INFO:tasks.workunit.client.1.smithi155.stdout:9/308: dwrite dc/d18/d1e/f64 [0,4194304] 0 2024-09-13T21:44:50.837 INFO:tasks.workunit.client.0.smithi119.stdout:7/717: dwrite d8/d3c/d53/d3b/d7e/fda [0,4194304] 0 2024-09-13T21:44:50.839 INFO:tasks.workunit.client.0.smithi119.stdout:1/663: link d1/d3/d61/d77/d78/d32/d33/c40 d1/d3/d61/d7e/cdd 0 2024-09-13T21:44:50.839 INFO:tasks.workunit.client.1.smithi155.stdout:6/356: dread f3 [0,4194304] 0 2024-09-13T21:44:50.840 INFO:tasks.workunit.client.1.smithi155.stdout:1/281: chown d6/c39 3823851 1 2024-09-13T21:44:50.841 INFO:tasks.workunit.client.1.smithi155.stdout:9/309: stat dc/d18/c3f 0 2024-09-13T21:44:50.841 INFO:tasks.workunit.client.0.smithi119.stdout:1/664: dread - d1/d3/d61/d77/d78/d32/dda/d19/fb7 zero size 2024-09-13T21:44:50.842 INFO:tasks.workunit.client.0.smithi119.stdout:4/703: creat d4/d1e/d28/d34/d6a/d79/d9f/fe4 x:0 0 0 2024-09-13T21:44:50.844 INFO:tasks.workunit.client.1.smithi155.stdout:6/357: unlink db/d12/d1c/l66 0 2024-09-13T21:44:50.844 INFO:tasks.workunit.client.0.smithi119.stdout:1/665: write d1/d3/d61/d77/d78/d32/dda/d3d/fc2 [332323,79976] 0 2024-09-13T21:44:50.844 INFO:tasks.workunit.client.0.smithi119.stdout:7/718: rmdir d8/d3c/d53/d37/d83/d89/dc3 39 2024-09-13T21:44:50.846 INFO:tasks.workunit.client.0.smithi119.stdout:7/719: write d8/d19/f1a [3522067,12385] 0 2024-09-13T21:44:50.847 INFO:tasks.workunit.client.1.smithi155.stdout:1/282: symlink d6/d15/d3e/d17/d30/l67 0 2024-09-13T21:44:50.849 INFO:tasks.workunit.client.1.smithi155.stdout:9/310: dread dc/d19/d21/f55 [0,4194304] 0 2024-09-13T21:44:50.849 INFO:tasks.workunit.client.1.smithi155.stdout:1/283: fdatasync d6/d15/d3e/d17/d30/f5e 0 2024-09-13T21:44:50.850 INFO:tasks.workunit.client.0.smithi119.stdout:1/666: mkdir d1/d3/d61/d77/d78/db8/dde 0 2024-09-13T21:44:50.850 INFO:tasks.workunit.client.0.smithi119.stdout:4/704: write d4/d1e/d26/d6d/d7c/dde/d8f/fc0 [102617,35014] 0 2024-09-13T21:44:50.851 INFO:tasks.workunit.client.1.smithi155.stdout:9/311: dread - dc/d19/d23/d2f/d43/f4d zero size 2024-09-13T21:44:50.855 INFO:tasks.workunit.client.0.smithi119.stdout:1/667: mkdir d1/d3/d61/d7e/d53/ddf 0 2024-09-13T21:44:50.856 INFO:tasks.workunit.client.1.smithi155.stdout:2/165: sync 2024-09-13T21:44:50.858 INFO:tasks.workunit.client.0.smithi119.stdout:2/634: write d1/d22/d55/f44 [2411191,126140] 0 2024-09-13T21:44:50.858 INFO:tasks.workunit.client.1.smithi155.stdout:9/312: mkdir dc/de/d6f/d71 0 2024-09-13T21:44:50.858 INFO:tasks.workunit.client.1.smithi155.stdout:1/284: dwrite d6/d15/f45 [0,4194304] 0 2024-09-13T21:44:50.858 INFO:tasks.workunit.client.0.smithi119.stdout:7/720: mkdir d8/d3c/d53/d37/d83/d89/de7 0 2024-09-13T21:44:50.859 INFO:tasks.workunit.client.1.smithi155.stdout:5/296: truncate d5/d16/f2a 2769672 0 2024-09-13T21:44:50.860 INFO:tasks.workunit.client.1.smithi155.stdout:9/313: chown dc/l29 104 1 2024-09-13T21:44:50.860 INFO:tasks.workunit.client.0.smithi119.stdout:7/721: readlink d8/d4d/l92 0 2024-09-13T21:44:50.862 INFO:tasks.workunit.client.1.smithi155.stdout:2/166: rename d2/db/f1b to d2/dd/d37/f3a 0 2024-09-13T21:44:50.863 INFO:tasks.workunit.client.0.smithi119.stdout:4/705: dwrite d4/d1e/d28/d34/d66/fd1 [0,4194304] 0 2024-09-13T21:44:50.863 INFO:tasks.workunit.client.0.smithi119.stdout:2/635: dread - d1/d22/d5a/da9/fbf zero size 2024-09-13T21:44:50.863 INFO:tasks.workunit.client.1.smithi155.stdout:5/297: creat d5/d16/d33/d1b/f5e x:0 0 0 2024-09-13T21:44:50.864 INFO:tasks.workunit.client.1.smithi155.stdout:9/314: symlink dc/d18/d1e/l72 0 2024-09-13T21:44:50.864 INFO:tasks.workunit.client.1.smithi155.stdout:7/205: sync 2024-09-13T21:44:50.864 INFO:tasks.workunit.client.1.smithi155.stdout:4/289: sync 2024-09-13T21:44:50.865 INFO:tasks.workunit.client.1.smithi155.stdout:4/290: stat d1/l4c 0 2024-09-13T21:44:50.865 INFO:tasks.workunit.client.1.smithi155.stdout:7/206: readlink d5/d13/d31/l3c 0 2024-09-13T21:44:50.866 INFO:tasks.workunit.client.1.smithi155.stdout:1/285: rename d6/d7/c1c to d6/d7/d48/c68 0 2024-09-13T21:44:50.867 INFO:tasks.workunit.client.0.smithi119.stdout:5/668: dwrite d0/d3/d4/d9/d14/d24/f5a [0,4194304] 0 2024-09-13T21:44:50.868 INFO:tasks.workunit.client.1.smithi155.stdout:2/167: creat d2/dd/d37/f3b x:0 0 0 2024-09-13T21:44:50.868 INFO:tasks.workunit.client.1.smithi155.stdout:5/298: fdatasync d5/fa 0 2024-09-13T21:44:50.869 INFO:tasks.workunit.client.1.smithi155.stdout:5/299: chown f0 1044472760 1 2024-09-13T21:44:50.871 INFO:tasks.workunit.client.1.smithi155.stdout:1/286: fsync d6/d15/f4e 0 2024-09-13T21:44:50.872 INFO:tasks.workunit.client.0.smithi119.stdout:7/722: symlink d8/d3c/d53/d37/d83/le8 0 2024-09-13T21:44:50.873 INFO:tasks.workunit.client.0.smithi119.stdout:2/636: symlink d1/d7/d86/lcf 0 2024-09-13T21:44:50.874 INFO:tasks.workunit.client.1.smithi155.stdout:2/168: creat d2/dd/de/d15/d2e/f3c x:0 0 0 2024-09-13T21:44:50.874 INFO:tasks.workunit.client.0.smithi119.stdout:1/668: truncate d1/d3/d61/d77/d78/f50 501046 0 2024-09-13T21:44:50.875 INFO:tasks.workunit.client.1.smithi155.stdout:6/358: dread db/f1f [0,4194304] 0 2024-09-13T21:44:50.876 INFO:tasks.workunit.client.0.smithi119.stdout:8/681: dread f9 [0,4194304] 0 2024-09-13T21:44:50.877 INFO:tasks.workunit.client.0.smithi119.stdout:2/637: fsync d1/d38/f59 0 2024-09-13T21:44:50.878 INFO:tasks.workunit.client.0.smithi119.stdout:7/723: rmdir d8/d3c/d53/d3b/d7e/dc2 39 2024-09-13T21:44:50.878 INFO:tasks.workunit.client.1.smithi155.stdout:8/234: sync 2024-09-13T21:44:50.878 INFO:tasks.workunit.client.1.smithi155.stdout:3/362: sync 2024-09-13T21:44:50.878 INFO:tasks.workunit.client.1.smithi155.stdout:0/308: sync 2024-09-13T21:44:50.881 INFO:tasks.workunit.client.0.smithi119.stdout:1/669: rename d1/d3/d6c/da8/c76 to d1/d3/d61/d7e/d53/ce0 0 2024-09-13T21:44:50.884 INFO:tasks.workunit.client.1.smithi155.stdout:1/287: dwrite d6/d15/f58 [0,4194304] 0 2024-09-13T21:44:50.884 INFO:tasks.workunit.client.1.smithi155.stdout:8/235: read d2/d8/f10 [4855981,114809] 0 2024-09-13T21:44:50.884 INFO:tasks.workunit.client.0.smithi119.stdout:5/669: creat d0/d3/d4/fea x:0 0 0 2024-09-13T21:44:50.886 INFO:tasks.workunit.client.1.smithi155.stdout:8/236: chown d2/d8/l32 162425578 1 2024-09-13T21:44:50.886 INFO:tasks.workunit.client.0.smithi119.stdout:7/724: rmdir d8/d4d 39 2024-09-13T21:44:50.890 INFO:tasks.workunit.client.0.smithi119.stdout:0/676: dwrite de/d1c/d64/f8a [0,4194304] 0 2024-09-13T21:44:50.891 INFO:tasks.workunit.client.0.smithi119.stdout:1/670: mknod d1/d3/d61/d77/d78/d32/d33/dd0/ce1 0 2024-09-13T21:44:50.891 INFO:tasks.workunit.client.1.smithi155.stdout:0/309: mknod d1/d6/dc/d4d/d4a/d52/d5b/c76 0 2024-09-13T21:44:50.893 INFO:tasks.workunit.client.1.smithi155.stdout:8/237: dread d2/f5 [0,4194304] 0 2024-09-13T21:44:50.893 INFO:tasks.workunit.client.1.smithi155.stdout:0/310: truncate d1/d6/f40 852726 0 2024-09-13T21:44:50.893 INFO:tasks.workunit.client.0.smithi119.stdout:1/671: chown d1/d3/d6c/da8 61176 1 2024-09-13T21:44:50.894 INFO:tasks.workunit.client.0.smithi119.stdout:1/672: dread - d1/fd5 zero size 2024-09-13T21:44:50.896 INFO:tasks.workunit.client.1.smithi155.stdout:5/300: mkdir d5/d16/d33/d1b/d2f/d3c/d5b/d5f 0 2024-09-13T21:44:50.896 INFO:tasks.workunit.client.0.smithi119.stdout:2/638: creat d1/fd0 x:0 0 0 2024-09-13T21:44:50.896 INFO:tasks.workunit.client.0.smithi119.stdout:5/670: dread d0/d3/d4/d9/d14/d24/f31 [0,4194304] 0 2024-09-13T21:44:50.896 INFO:tasks.workunit.client.0.smithi119.stdout:6/635: truncate dc/f36 6993265 0 2024-09-13T21:44:50.897 INFO:tasks.workunit.client.1.smithi155.stdout:2/169: mkdir d2/dd/d3d 0 2024-09-13T21:44:50.899 INFO:tasks.workunit.client.0.smithi119.stdout:9/905: truncate d0/d19/de4/f7f 4128198 0 2024-09-13T21:44:50.900 INFO:tasks.workunit.client.0.smithi119.stdout:7/725: truncate d8/d3c/d53/d37/d57/f62 185701 0 2024-09-13T21:44:50.900 INFO:tasks.workunit.client.1.smithi155.stdout:4/291: getdents d1/d7/de/dc/d2e/d26 0 2024-09-13T21:44:50.900 INFO:tasks.workunit.client.0.smithi119.stdout:3/591: dread d6/d15/d1a/d45/f67 [0,4194304] 0 2024-09-13T21:44:50.901 INFO:tasks.workunit.client.0.smithi119.stdout:6/636: truncate dc/d3d/f8b 746238 0 2024-09-13T21:44:50.901 INFO:tasks.workunit.client.1.smithi155.stdout:6/359: chown db/d11/d2b/d35/c5c 2996159 1 2024-09-13T21:44:50.902 INFO:tasks.workunit.client.0.smithi119.stdout:7/726: chown d8/d3c 175 1 2024-09-13T21:44:50.904 INFO:tasks.workunit.client.1.smithi155.stdout:5/301: creat d5/d16/d33/d1b/d28/f60 x:0 0 0 2024-09-13T21:44:50.904 INFO:tasks.workunit.client.0.smithi119.stdout:0/677: dread de/d1c/d2b/d76/f97 [0,4194304] 0 2024-09-13T21:44:50.906 INFO:tasks.workunit.client.0.smithi119.stdout:5/671: symlink d0/d3/d1f/d21/d4f/leb 0 2024-09-13T21:44:50.907 INFO:tasks.workunit.client.0.smithi119.stdout:6/637: dread dc/df/d41/f7b [0,4194304] 0 2024-09-13T21:44:50.908 INFO:tasks.workunit.client.1.smithi155.stdout:4/292: write d1/d48/f51 [689383,25268] 0 2024-09-13T21:44:50.908 INFO:tasks.workunit.client.1.smithi155.stdout:5/302: fdatasync d5/d16/d33/d1b/d28/f60 0 2024-09-13T21:44:50.908 INFO:tasks.workunit.client.0.smithi119.stdout:6/638: write dc/f1e [483399,66228] 0 2024-09-13T21:44:50.909 INFO:tasks.workunit.client.0.smithi119.stdout:6/639: readlink dc/d3d/d4e/l67 0 2024-09-13T21:44:50.910 INFO:tasks.workunit.client.0.smithi119.stdout:6/640: chown dc/df/f1c 0 1 2024-09-13T21:44:50.910 INFO:tasks.workunit.client.0.smithi119.stdout:3/592: mknod d6/d15/d1a/d45/d8d/cc4 0 2024-09-13T21:44:50.911 INFO:tasks.workunit.client.1.smithi155.stdout:2/170: dwrite d2/dd/f17 [0,4194304] 0 2024-09-13T21:44:50.915 INFO:tasks.workunit.client.1.smithi155.stdout:6/360: symlink db/d12/d1c/l6b 0 2024-09-13T21:44:50.917 INFO:tasks.workunit.client.1.smithi155.stdout:4/293: mkdir d1/d7/d5a 0 2024-09-13T21:44:50.918 INFO:tasks.workunit.client.0.smithi119.stdout:0/678: creat de/d1c/d59/ff0 x:0 0 0 2024-09-13T21:44:50.920 INFO:tasks.workunit.client.1.smithi155.stdout:3/363: dread d3/d25/d1b/f4e [4194304,4194304] 0 2024-09-13T21:44:50.921 INFO:tasks.workunit.client.1.smithi155.stdout:5/303: mknod d5/d16/d33/d1b/d2f/d3c/d44/c61 0 2024-09-13T21:44:50.922 INFO:tasks.workunit.client.1.smithi155.stdout:9/315: dwrite dc/d18/f20 [0,4194304] 0 2024-09-13T21:44:50.924 INFO:tasks.workunit.client.1.smithi155.stdout:9/316: read dc/d18/f20 [3115894,71764] 0 2024-09-13T21:44:50.925 INFO:tasks.workunit.client.0.smithi119.stdout:7/727: dread d8/f20 [0,4194304] 0 2024-09-13T21:44:50.925 INFO:tasks.workunit.client.1.smithi155.stdout:6/361: creat db/d11/d4c/f6c x:0 0 0 2024-09-13T21:44:50.926 INFO:tasks.workunit.client.0.smithi119.stdout:3/593: creat d6/d44/d52/d85/fc5 x:0 0 0 2024-09-13T21:44:50.926 INFO:tasks.workunit.client.0.smithi119.stdout:6/641: dwrite dc/d3d/d4e/f53 [0,4194304] 0 2024-09-13T21:44:50.926 INFO:tasks.workunit.client.0.smithi119.stdout:1/673: rmdir d1/d3/d61/d77/d78 39 2024-09-13T21:44:50.926 INFO:tasks.workunit.client.0.smithi119.stdout:4/706: dwrite d4/d1e/d26/d5e/f6e [0,4194304] 0 2024-09-13T21:44:50.927 INFO:tasks.workunit.client.1.smithi155.stdout:6/362: chown db/d12/d1c/d36/f3c 946 1 2024-09-13T21:44:50.928 INFO:tasks.workunit.client.1.smithi155.stdout:8/238: getdents d2/d6/dd/d12 0 2024-09-13T21:44:50.929 INFO:tasks.workunit.client.0.smithi119.stdout:9/906: symlink d0/d8/d18/d23/d27/d2d/d138/l13d 0 2024-09-13T21:44:50.929 INFO:tasks.workunit.client.1.smithi155.stdout:8/239: readlink d2/d6/dd/d12/l40 0 2024-09-13T21:44:50.930 INFO:tasks.workunit.client.1.smithi155.stdout:4/294: rename d1/f27 to d1/d7/de/d15/f5b 0 2024-09-13T21:44:50.933 INFO:tasks.workunit.client.1.smithi155.stdout:8/240: write d2/f20 [1246755,27812] 0 2024-09-13T21:44:50.934 INFO:tasks.workunit.client.0.smithi119.stdout:7/728: chown d8/d3c/d53/d3b/d48/l86 218447630 1 2024-09-13T21:44:50.934 INFO:tasks.workunit.client.1.smithi155.stdout:3/364: symlink d3/d21/d2c/l7d 0 2024-09-13T21:44:50.935 INFO:tasks.workunit.client.0.smithi119.stdout:6/642: fdatasync dc/d4b/f79 0 2024-09-13T21:44:50.935 INFO:tasks.workunit.client.0.smithi119.stdout:3/594: stat d6/d44/c72 0 2024-09-13T21:44:50.935 INFO:tasks.workunit.client.0.smithi119.stdout:2/639: dread d1/d22/db6/fc4 [0,4194304] 0 2024-09-13T21:44:50.936 INFO:tasks.workunit.client.1.smithi155.stdout:5/304: creat d5/d16/d33/d1b/d2f/d3c/f62 x:0 0 0 2024-09-13T21:44:50.937 INFO:tasks.workunit.client.0.smithi119.stdout:8/682: dwrite d1b/d1d/d26/d6b/fb3 [4194304,4194304] 0 2024-09-13T21:44:50.937 INFO:tasks.workunit.client.1.smithi155.stdout:0/311: link d1/d6/dc/fe d1/d6/dc/f77 0 2024-09-13T21:44:50.939 INFO:tasks.workunit.client.1.smithi155.stdout:1/288: dwrite d6/d15/f34 [0,4194304] 0 2024-09-13T21:44:50.940 INFO:tasks.workunit.client.1.smithi155.stdout:0/312: chown d1/d6/dc/d4d/f59 15 1 2024-09-13T21:44:50.941 INFO:tasks.workunit.client.0.smithi119.stdout:0/679: truncate de/d4e/d7f/fa3 3850833 0 2024-09-13T21:44:50.941 INFO:tasks.workunit.client.0.smithi119.stdout:6/643: write dc/d3a/dbb/d7a/f81 [865985,34957] 0 2024-09-13T21:44:50.945 INFO:tasks.workunit.client.1.smithi155.stdout:8/241: dread d2/d6/dd/d12/f1d [0,4194304] 0 2024-09-13T21:44:50.945 INFO:tasks.workunit.client.0.smithi119.stdout:1/674: read d1/d3/d61/d77/d78/d32/dda/d19/d2d/fcf [208491,8801] 0 2024-09-13T21:44:50.946 INFO:tasks.workunit.client.1.smithi155.stdout:6/363: getdents db/d3d/d5f/d67 0 2024-09-13T21:44:50.946 INFO:tasks.workunit.client.1.smithi155.stdout:3/365: rmdir d3/d21/d4a 39 2024-09-13T21:44:50.949 INFO:tasks.workunit.client.0.smithi119.stdout:8/683: chown d1b/d1d/c25 432 1 2024-09-13T21:44:50.950 INFO:tasks.workunit.client.1.smithi155.stdout:0/313: fdatasync d1/f2f 0 2024-09-13T21:44:50.950 INFO:tasks.workunit.client.1.smithi155.stdout:1/289: creat d6/d7/d48/f69 x:0 0 0 2024-09-13T21:44:50.950 INFO:tasks.workunit.client.1.smithi155.stdout:4/295: read d1/d7/de/d15/f4b [20778,94850] 0 2024-09-13T21:44:50.952 INFO:tasks.workunit.client.0.smithi119.stdout:3/595: rename d6/d15/da9/c89 to d6/d15/d8f/dbb/cc6 0 2024-09-13T21:44:50.952 INFO:tasks.workunit.client.0.smithi119.stdout:9/907: dwrite d0/d8/d18/d23/dea/fb7 [4194304,4194304] 0 2024-09-13T21:44:50.952 INFO:tasks.workunit.client.1.smithi155.stdout:0/314: write d1/d6/f40 [525752,119865] 0 2024-09-13T21:44:50.956 INFO:tasks.workunit.client.1.smithi155.stdout:5/305: unlink d5/d16/d33/d1b/d2f/d3c/d44/d29/f30 0 2024-09-13T21:44:50.956 INFO:tasks.workunit.client.1.smithi155.stdout:2/171: link d2/db/f18 d2/dd/de/d15/d2e/f3e 0 2024-09-13T21:44:50.957 INFO:tasks.workunit.client.0.smithi119.stdout:7/729: creat d8/d9d/fe9 x:0 0 0 2024-09-13T21:44:50.957 INFO:tasks.workunit.client.0.smithi119.stdout:0/680: symlink de/d4e/da5/lf1 0 2024-09-13T21:44:50.958 INFO:tasks.workunit.client.1.smithi155.stdout:3/366: unlink d3/d10/f20 0 2024-09-13T21:44:50.958 INFO:tasks.workunit.client.1.smithi155.stdout:2/172: readlink d2/l3 0 2024-09-13T21:44:50.959 INFO:tasks.workunit.client.1.smithi155.stdout:6/364: dwrite db/d11/d1e/d21/f4d [0,4194304] 0 2024-09-13T21:44:50.961 INFO:tasks.workunit.client.1.smithi155.stdout:5/306: chown d5/d12/f36 650092 1 2024-09-13T21:44:50.964 INFO:tasks.workunit.client.0.smithi119.stdout:4/707: mknod d4/d1e/d28/d34/d6a/d79/d9f/dcf/ce5 0 2024-09-13T21:44:50.966 INFO:tasks.workunit.client.1.smithi155.stdout:8/242: symlink d2/l45 0 2024-09-13T21:44:50.966 INFO:tasks.workunit.client.0.smithi119.stdout:6/644: dread dc/d3d/d40/d6b/f70 [0,4194304] 0 2024-09-13T21:44:50.967 INFO:tasks.workunit.client.1.smithi155.stdout:0/315: rename d1/f22 to d1/d6/dc/d4d/f78 0 2024-09-13T21:44:50.968 INFO:tasks.workunit.client.0.smithi119.stdout:8/684: write d1b/d1d/d26/f3d [7584889,103445] 0 2024-09-13T21:44:50.971 INFO:tasks.workunit.client.0.smithi119.stdout:4/708: write d4/d1e/f78 [4432247,61565] 0 2024-09-13T21:44:50.971 INFO:tasks.workunit.client.0.smithi119.stdout:3/596: dread d6/d44/f51 [0,4194304] 0 2024-09-13T21:44:50.972 INFO:tasks.workunit.client.0.smithi119.stdout:0/681: dwrite de/d1c/d2f/f41 [0,4194304] 0 2024-09-13T21:44:50.974 INFO:tasks.workunit.client.1.smithi155.stdout:0/316: stat d1/d6/dc/d4d/f3f 0 2024-09-13T21:44:50.976 INFO:tasks.workunit.client.1.smithi155.stdout:5/307: write d5/d16/d33/d1b/f5e [148249,73433] 0 2024-09-13T21:44:50.976 INFO:tasks.workunit.client.1.smithi155.stdout:1/290: link d6/f33 d6/d15/d57/d5d/f6a 0 2024-09-13T21:44:50.977 INFO:tasks.workunit.client.0.smithi119.stdout:4/709: truncate d4/d1e/d28/d34/d66/f7b 858402 0 2024-09-13T21:44:50.977 INFO:tasks.workunit.client.1.smithi155.stdout:6/365: mkdir db/d11/d6d 0 2024-09-13T21:44:50.979 INFO:tasks.workunit.client.0.smithi119.stdout:2/640: getdents d1/d22/d55 0 2024-09-13T21:44:50.983 INFO:tasks.workunit.client.0.smithi119.stdout:2/641: write d1/d22/fb8 [436125,20104] 0 2024-09-13T21:44:50.985 INFO:tasks.workunit.client.0.smithi119.stdout:0/682: dwrite de/d1c/f20 [0,4194304] 0 2024-09-13T21:44:50.985 INFO:tasks.workunit.client.1.smithi155.stdout:3/367: dwrite d3/d21/f65 [0,4194304] 0 2024-09-13T21:44:50.985 INFO:tasks.workunit.client.1.smithi155.stdout:4/296: dread d1/d7/de/d15/f5b [0,4194304] 0 2024-09-13T21:44:50.986 INFO:tasks.workunit.client.1.smithi155.stdout:1/291: read d6/ff [3978391,5680] 0 2024-09-13T21:44:50.988 INFO:tasks.workunit.client.1.smithi155.stdout:0/317: rename d1/d6/d74 to d1/d6/d74/d79 22 2024-09-13T21:44:50.990 INFO:tasks.workunit.client.1.smithi155.stdout:9/317: truncate dc/f1a 1029290 0 2024-09-13T21:44:50.993 INFO:tasks.workunit.client.1.smithi155.stdout:8/243: dwrite d2/d6/dd/d12/f21 [0,4194304] 0 2024-09-13T21:44:50.995 INFO:tasks.workunit.client.1.smithi155.stdout:2/173: dwrite f1 [0,4194304] 0 2024-09-13T21:44:50.996 INFO:tasks.workunit.client.0.smithi119.stdout:1/675: rename d1/d3/d61/d77/d78/d32/f4b to d1/d3/dc/d24/fe2 0 2024-09-13T21:44:50.997 INFO:tasks.workunit.client.0.smithi119.stdout:8/685: getdents d1b/d1d/d26/d3e/daa 0 2024-09-13T21:44:50.997 INFO:tasks.workunit.client.0.smithi119.stdout:4/710: rename d4/d1e/d28/d34/d6a/d79 to d4/d1e/d28/d34/d6a/d79/dae/de6 22 2024-09-13T21:44:50.997 INFO:tasks.workunit.client.0.smithi119.stdout:2/642: fdatasync d1/d22/f5f 0 2024-09-13T21:44:50.998 INFO:tasks.workunit.client.1.smithi155.stdout:3/368: chown d3/d25/d17/d3b/f50 8864069 1 2024-09-13T21:44:51.001 INFO:tasks.workunit.client.1.smithi155.stdout:5/308: rename d5/d16/d33/d1b/d2f/d3c/d44/c61 to d5/d16/d33/d1b/d2f/d3c/d44/c63 0 2024-09-13T21:44:51.003 INFO:tasks.workunit.client.1.smithi155.stdout:4/297: mknod d1/d7/d21/d2d/d42/c5c 0 2024-09-13T21:44:51.003 INFO:tasks.workunit.client.0.smithi119.stdout:0/683: creat de/d1c/ff2 x:0 0 0 2024-09-13T21:44:51.004 INFO:tasks.workunit.client.1.smithi155.stdout:3/369: mknod d3/d25/d17/d3b/c7e 0 2024-09-13T21:44:51.005 INFO:tasks.workunit.client.0.smithi119.stdout:8/686: fdatasync d1b/f1f 0 2024-09-13T21:44:51.005 INFO:tasks.workunit.client.1.smithi155.stdout:9/318: symlink dc/l73 0 2024-09-13T21:44:51.006 INFO:tasks.workunit.client.1.smithi155.stdout:1/292: dread d6/d15/d3e/d17/f21 [0,4194304] 0 2024-09-13T21:44:51.006 INFO:tasks.workunit.client.0.smithi119.stdout:9/908: write d0/d8/d18/d23/dea/fd7 [529877,22299] 0 2024-09-13T21:44:51.006 INFO:tasks.workunit.client.1.smithi155.stdout:3/370: write d3/d25/fb [4628825,23629] 0 2024-09-13T21:44:51.007 INFO:tasks.workunit.client.1.smithi155.stdout:5/309: mknod d5/d16/d33/d1b/d1e/c64 0 2024-09-13T21:44:51.010 INFO:tasks.workunit.client.0.smithi119.stdout:9/909: fdatasync d0/d8/d18/d23/d27/d2d/d5f/da8/ff8 0 2024-09-13T21:44:51.012 INFO:tasks.workunit.client.0.smithi119.stdout:1/676: dwrite d1/d3/d61/d77/d78/d32/dda/d28/f3f [4194304,4194304] 0 2024-09-13T21:44:51.013 INFO:tasks.workunit.client.0.smithi119.stdout:9/910: chown d0/d8/d18/d23/d42/l100 218633937 1 2024-09-13T21:44:51.017 INFO:tasks.workunit.client.1.smithi155.stdout:7/207: sync 2024-09-13T21:44:51.018 INFO:tasks.workunit.client.0.smithi119.stdout:8/687: truncate d1b/d1d/d26/d3e/f7c 411565 0 2024-09-13T21:44:51.022 INFO:tasks.workunit.client.1.smithi155.stdout:7/208: write d5/d13/f24 [750915,26193] 0 2024-09-13T21:44:51.022 INFO:tasks.workunit.client.0.smithi119.stdout:0/684: dwrite de/d1c/d2f/d40/d66/fc5 [0,4194304] 0 2024-09-13T21:44:51.022 INFO:tasks.workunit.client.0.smithi119.stdout:0/685: read - de/d1c/d59/fdc zero size 2024-09-13T21:44:51.022 INFO:tasks.workunit.client.0.smithi119.stdout:3/597: write d6/d15/d1a/f41 [283343,102508] 0 2024-09-13T21:44:51.023 INFO:tasks.workunit.client.0.smithi119.stdout:0/686: write de/d1c/ff2 [995896,56990] 0 2024-09-13T21:44:51.026 INFO:tasks.workunit.client.0.smithi119.stdout:3/598: fsync d6/d15/d1a/d45/d47/d4d/f73 0 2024-09-13T21:44:51.026 INFO:tasks.workunit.client.0.smithi119.stdout:0/687: write fd [5259173,35936] 0 2024-09-13T21:44:51.026 INFO:tasks.workunit.client.0.smithi119.stdout:1/677: mkdir d1/d3/d61/d77/d78/d32/de3 0 2024-09-13T21:44:51.027 INFO:tasks.workunit.client.0.smithi119.stdout:6/645: truncate dc/dd/f2e 3441155 0 2024-09-13T21:44:51.030 INFO:tasks.workunit.client.0.smithi119.stdout:7/730: dread d8/d3c/d53/d37/d83/d89/d3d/fbe [0,4194304] 0 2024-09-13T21:44:51.030 INFO:tasks.workunit.client.0.smithi119.stdout:6/646: truncate dc/d3d/d4e/d91/f9a 5049079 0 2024-09-13T21:44:51.031 INFO:tasks.workunit.client.0.smithi119.stdout:8/688: mkdir d1b/d1d/d26/d3e/dd3 0 2024-09-13T21:44:51.032 INFO:tasks.workunit.client.0.smithi119.stdout:4/711: link d4/d1e/d28/c84 d4/d1e/ce7 0 2024-09-13T21:44:51.033 INFO:tasks.workunit.client.0.smithi119.stdout:1/678: write d1/f1b [3177537,74126] 0 2024-09-13T21:44:51.037 INFO:tasks.workunit.client.0.smithi119.stdout:0/688: write de/d1c/d2f/d35/d4a/d62/f75 [390150,123367] 0 2024-09-13T21:44:51.038 INFO:tasks.workunit.client.0.smithi119.stdout:6/647: rmdir dc/df/d5c/d98 0 2024-09-13T21:44:51.040 INFO:tasks.workunit.client.1.smithi155.stdout:0/318: rename d1/d6/dc/f33 to d1/d6/dc/f7a 0 2024-09-13T21:44:51.040 INFO:tasks.workunit.client.1.smithi155.stdout:1/293: truncate d6/d15/f18 1402059 0 2024-09-13T21:44:51.040 INFO:tasks.workunit.client.1.smithi155.stdout:6/366: truncate db/d12/d1c/d36/d46/f48 535241 0 2024-09-13T21:44:51.041 INFO:tasks.workunit.client.0.smithi119.stdout:0/689: chown de/d4e/da5/dec 33 1 2024-09-13T21:44:51.042 INFO:tasks.workunit.client.1.smithi155.stdout:9/319: mkdir dc/d19/d23/d70/d74 0 2024-09-13T21:44:51.044 INFO:tasks.workunit.client.0.smithi119.stdout:6/648: fdatasync dc/d4b/d6a/d75/fb4 0 2024-09-13T21:44:51.044 INFO:tasks.workunit.client.1.smithi155.stdout:7/209: creat d5/d13/f3d x:0 0 0 2024-09-13T21:44:51.044 INFO:tasks.workunit.client.1.smithi155.stdout:2/174: write d2/db/f18 [1011899,83910] 0 2024-09-13T21:44:51.046 INFO:tasks.workunit.client.1.smithi155.stdout:3/371: creat d3/d25/d1b/d1f/d36/d5c/d66/f7f x:0 0 0 2024-09-13T21:44:51.046 INFO:tasks.workunit.client.0.smithi119.stdout:7/731: rename d8/d4d/da2/cc5 to d8/d3c/d53/d37/d83/d89/de7/cea 0 2024-09-13T21:44:51.047 INFO:tasks.workunit.client.1.smithi155.stdout:7/210: write d5/d13/f20 [460027,45624] 0 2024-09-13T21:44:51.047 INFO:tasks.workunit.client.0.smithi119.stdout:4/712: dwrite d4/f21 [0,4194304] 0 2024-09-13T21:44:51.049 INFO:tasks.workunit.client.1.smithi155.stdout:8/244: truncate d2/d1f/d39/f41 806789 0 2024-09-13T21:44:51.050 INFO:tasks.workunit.client.0.smithi119.stdout:8/689: truncate d1b/d1d/f5f 718628 0 2024-09-13T21:44:51.052 INFO:tasks.workunit.client.1.smithi155.stdout:9/320: dread dc/de/f10 [0,4194304] 0 2024-09-13T21:44:51.053 INFO:tasks.workunit.client.1.smithi155.stdout:1/294: read d6/d15/d23/f3c [3884256,13984] 0 2024-09-13T21:44:51.053 INFO:tasks.workunit.client.0.smithi119.stdout:3/599: link d6/d15/d1a/c23 d6/d15/d1a/d45/d47/d4d/da7/cc7 0 2024-09-13T21:44:51.054 INFO:tasks.workunit.client.1.smithi155.stdout:2/175: mkdir d2/dd/de/d15/d3f 0 2024-09-13T21:44:51.056 INFO:tasks.workunit.client.0.smithi119.stdout:9/911: write d0/d19/f9a [469864,74638] 0 2024-09-13T21:44:51.056 INFO:tasks.workunit.client.1.smithi155.stdout:3/372: mknod d3/d25/d1b/d1f/d36/c80 0 2024-09-13T21:44:51.057 INFO:tasks.workunit.client.0.smithi119.stdout:0/690: dread de/d1c/f20 [0,4194304] 0 2024-09-13T21:44:51.058 INFO:tasks.workunit.client.1.smithi155.stdout:1/295: rmdir d6/d15/d57 39 2024-09-13T21:44:51.060 INFO:tasks.workunit.client.0.smithi119.stdout:4/713: creat d4/d1e/d26/d6d/d7c/fe8 x:0 0 0 2024-09-13T21:44:51.063 INFO:tasks.workunit.client.0.smithi119.stdout:1/679: rename d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9d/fce to d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/fe4 0 2024-09-13T21:44:51.065 INFO:tasks.workunit.client.0.smithi119.stdout:3/600: symlink d6/d15/d1a/d45/d8d/d95/lc8 0 2024-09-13T21:44:51.068 INFO:tasks.workunit.client.1.smithi155.stdout:5/310: dwrite f0 [0,4194304] 0 2024-09-13T21:44:51.070 INFO:tasks.workunit.client.1.smithi155.stdout:7/211: dread d5/f1e [0,4194304] 0 2024-09-13T21:44:51.072 INFO:tasks.workunit.client.0.smithi119.stdout:7/732: dwrite d8/d3c/d53/d3b/d48/f49 [4194304,4194304] 0 2024-09-13T21:44:51.074 INFO:tasks.workunit.client.1.smithi155.stdout:8/245: dwrite d2/d6/dd/d12/f1e [0,4194304] 0 2024-09-13T21:44:51.075 INFO:tasks.workunit.client.1.smithi155.stdout:3/373: symlink d3/d25/d1b/d1f/d36/d5c/l81 0 2024-09-13T21:44:51.075 INFO:tasks.workunit.client.1.smithi155.stdout:0/319: write d1/d6/dc/d4d/f59 [860538,56720] 0 2024-09-13T21:44:51.075 INFO:tasks.workunit.client.0.smithi119.stdout:2/643: dread d1/d22/f42 [0,4194304] 0 2024-09-13T21:44:51.078 INFO:tasks.workunit.client.0.smithi119.stdout:7/733: chown d8/d19/d2e/d34 53 1 2024-09-13T21:44:51.079 INFO:tasks.workunit.client.0.smithi119.stdout:9/912: write d0/d8/d18/d23/d27/d2d/dc1/ddf/fcd [1516433,129434] 0 2024-09-13T21:44:51.079 INFO:tasks.workunit.client.1.smithi155.stdout:1/296: symlink d6/d15/d57/d5d/l6b 0 2024-09-13T21:44:51.081 INFO:tasks.workunit.client.1.smithi155.stdout:6/367: dread db/d11/d1e/f3e [0,4194304] 0 2024-09-13T21:44:51.082 INFO:tasks.workunit.client.0.smithi119.stdout:2/644: write d1/d22/d5a/d5d/f78 [122386,83282] 0 2024-09-13T21:44:51.083 INFO:tasks.workunit.client.1.smithi155.stdout:7/212: dread d5/d13/f14 [0,4194304] 0 2024-09-13T21:44:51.083 INFO:tasks.workunit.client.1.smithi155.stdout:2/176: dwrite f1 [0,4194304] 0 2024-09-13T21:44:51.083 INFO:tasks.workunit.client.1.smithi155.stdout:5/311: dread d5/d16/d33/d1b/f5e [0,4194304] 0 2024-09-13T21:44:51.085 INFO:tasks.workunit.client.0.smithi119.stdout:2/645: dread - d1/d7/fba zero size 2024-09-13T21:44:51.085 INFO:tasks.workunit.client.1.smithi155.stdout:9/321: dwrite dc/d19/d21/f55 [0,4194304] 0 2024-09-13T21:44:51.086 INFO:tasks.workunit.client.1.smithi155.stdout:0/320: dread - d1/d6/dc/d4d/d4a/d4e/f4f zero size 2024-09-13T21:44:51.088 INFO:tasks.workunit.client.1.smithi155.stdout:8/246: creat d2/d6/dd/d12/f46 x:0 0 0 2024-09-13T21:44:51.088 INFO:tasks.workunit.client.0.smithi119.stdout:7/734: read - d8/d3c/d46/fdb zero size 2024-09-13T21:44:51.088 INFO:tasks.workunit.client.0.smithi119.stdout:9/913: write d0/d8/d18/d23/d42/fc4 [746360,111851] 0 2024-09-13T21:44:51.088 INFO:tasks.workunit.client.0.smithi119.stdout:6/649: dread dc/d3d/d40/f69 [0,4194304] 0 2024-09-13T21:44:51.089 INFO:tasks.workunit.client.1.smithi155.stdout:5/312: stat d5/d16/d33/d1b/d28/f37 0 2024-09-13T21:44:51.091 INFO:tasks.workunit.client.0.smithi119.stdout:1/680: link d1/d3/d61/d77/d78/fa4 d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/fe5 0 2024-09-13T21:44:51.093 INFO:tasks.workunit.client.0.smithi119.stdout:7/735: symlink d8/d3c/d53/d37/d57/d5f/leb 0 2024-09-13T21:44:51.093 INFO:tasks.workunit.client.1.smithi155.stdout:3/374: truncate d3/d25/d17/d3b/f50 1532882 0 2024-09-13T21:44:51.093 INFO:tasks.workunit.client.1.smithi155.stdout:7/213: stat d5/df/d15 0 2024-09-13T21:44:51.093 INFO:tasks.workunit.client.0.smithi119.stdout:3/601: write d6/d44/f7e [809305,105864] 0 2024-09-13T21:44:51.094 INFO:tasks.workunit.client.1.smithi155.stdout:6/368: creat db/d12/d1c/f6e x:0 0 0 2024-09-13T21:44:51.096 INFO:tasks.workunit.client.1.smithi155.stdout:1/297: creat d6/d7/d64/f6c x:0 0 0 2024-09-13T21:44:51.097 INFO:tasks.workunit.client.0.smithi119.stdout:6/650: symlink dc/d3d/d40/d6b/lcb 0 2024-09-13T21:44:51.097 INFO:tasks.workunit.client.0.smithi119.stdout:8/690: dread d1b/f47 [0,4194304] 0 2024-09-13T21:44:51.098 INFO:tasks.workunit.client.0.smithi119.stdout:6/651: fsync dc/f14 0 2024-09-13T21:44:51.102 INFO:tasks.workunit.client.1.smithi155.stdout:8/247: truncate d2/d6/f27 1234316 0 2024-09-13T21:44:51.102 INFO:tasks.workunit.client.1.smithi155.stdout:3/375: mkdir d3/d25/d1b/d1f/d82 0 2024-09-13T21:44:51.102 INFO:tasks.workunit.client.0.smithi119.stdout:9/914: mknod d0/d8/d18/d23/d27/d2d/dc1/ddf/d81/d128/c13e 0 2024-09-13T21:44:51.104 INFO:tasks.workunit.client.1.smithi155.stdout:0/321: mknod d1/d6/d74/c7b 0 2024-09-13T21:44:51.105 INFO:tasks.workunit.client.0.smithi119.stdout:6/652: creat dc/d3d/d40/d68/fcc x:0 0 0 2024-09-13T21:44:51.106 INFO:tasks.workunit.client.0.smithi119.stdout:2/646: truncate d1/d7/d86/fa5 1087686 0 2024-09-13T21:44:51.107 INFO:tasks.workunit.client.1.smithi155.stdout:1/298: write d6/d15/f3d [1725,52303] 0 2024-09-13T21:44:51.107 INFO:tasks.workunit.client.1.smithi155.stdout:9/322: dread fb [0,4194304] 0 2024-09-13T21:44:51.107 INFO:tasks.workunit.client.1.smithi155.stdout:7/214: getdents d5/d13/d31 0 2024-09-13T21:44:51.107 INFO:tasks.workunit.client.0.smithi119.stdout:7/736: symlink d8/d3c/d53/d3b/d7e/lec 0 2024-09-13T21:44:51.108 INFO:tasks.workunit.client.1.smithi155.stdout:2/177: rename d2/dd/de/f14 to d2/db/f40 0 2024-09-13T21:44:51.109 INFO:tasks.workunit.client.0.smithi119.stdout:9/915: rename d0/d19/f30 to d0/d8/d18/d23/d42/d11d/f13f 0 2024-09-13T21:44:51.110 INFO:tasks.workunit.client.1.smithi155.stdout:6/369: dwrite db/d12/f1a [0,4194304] 0 2024-09-13T21:44:51.111 INFO:tasks.workunit.client.0.smithi119.stdout:6/653: truncate dc/df/d5c/f89 509285 0 2024-09-13T21:44:51.112 INFO:tasks.workunit.client.1.smithi155.stdout:3/376: mkdir d3/d25/d1b/d1f/d82/d83 0 2024-09-13T21:44:51.112 INFO:tasks.workunit.client.1.smithi155.stdout:8/248: creat d2/f47 x:0 0 0 2024-09-13T21:44:51.114 INFO:tasks.workunit.client.0.smithi119.stdout:8/691: creat d1b/d1d/fd4 x:0 0 0 2024-09-13T21:44:51.114 INFO:tasks.workunit.client.1.smithi155.stdout:9/323: truncate dc/d19/d23/f47 174275 0 2024-09-13T21:44:51.115 INFO:tasks.workunit.client.1.smithi155.stdout:7/215: rename d5/d13/d31 to d5/d10/d3e 0 2024-09-13T21:44:51.115 INFO:tasks.workunit.client.0.smithi119.stdout:3/602: dwrite d6/d44/d52/f86 [0,4194304] 0 2024-09-13T21:44:51.115 INFO:tasks.workunit.client.0.smithi119.stdout:7/737: symlink d8/d3c/d53/d37/d57/d8f/led 0 2024-09-13T21:44:51.116 INFO:tasks.workunit.client.1.smithi155.stdout:5/313: truncate d5/d16/d33/d1b/d2f/d3c/d44/f2e 701271 0 2024-09-13T21:44:51.117 INFO:tasks.workunit.client.1.smithi155.stdout:3/377: dread - d3/d25/d1b/d1f/d36/d5c/f63 zero size 2024-09-13T21:44:51.120 INFO:tasks.workunit.client.0.smithi119.stdout:0/691: dread de/d1c/d2f/f6c [0,4194304] 0 2024-09-13T21:44:51.121 INFO:tasks.workunit.client.0.smithi119.stdout:6/654: chown dc/d3a/dbb/d7a/d7e/cb5 965237 1 2024-09-13T21:44:51.121 INFO:tasks.workunit.client.1.smithi155.stdout:7/216: mkdir d5/d10/d3e/d3f 0 2024-09-13T21:44:51.122 INFO:tasks.workunit.client.1.smithi155.stdout:8/249: getdents d2/d1f 0 2024-09-13T21:44:51.126 INFO:tasks.workunit.client.0.smithi119.stdout:8/692: rmdir d1b/d1d/d26/d3e/dd3 0 2024-09-13T21:44:51.127 INFO:tasks.workunit.client.0.smithi119.stdout:4/714: truncate d4/d1e/d26/d6d/f91 2148126 0 2024-09-13T21:44:51.128 INFO:tasks.workunit.client.1.smithi155.stdout:3/378: mknod d3/d25/d1b/d1f/d82/d83/c84 0 2024-09-13T21:44:51.128 INFO:tasks.workunit.client.1.smithi155.stdout:1/299: dwrite d6/d15/d3e/d17/d30/f5b [0,4194304] 0 2024-09-13T21:44:51.129 INFO:tasks.workunit.client.0.smithi119.stdout:0/692: creat de/d4e/da5/ff3 x:0 0 0 2024-09-13T21:44:51.131 INFO:tasks.workunit.client.1.smithi155.stdout:0/322: dread d1/d6/dc/d4d/f50 [0,4194304] 0 2024-09-13T21:44:51.131 INFO:tasks.workunit.client.0.smithi119.stdout:0/693: write de/d1c/d2b/dd7/fda [433409,114134] 0 2024-09-13T21:44:51.132 INFO:tasks.workunit.client.0.smithi119.stdout:6/655: dread dc/df/d5c/f5f [0,4194304] 0 2024-09-13T21:44:51.133 INFO:tasks.workunit.client.0.smithi119.stdout:3/603: rename d6/d25/d2f/d33/c53 to d6/d25/d2f/d33/cc9 0 2024-09-13T21:44:51.133 INFO:tasks.workunit.client.0.smithi119.stdout:0/694: fsync de/d1c/d2b/d76/d9a/fc2 0 2024-09-13T21:44:51.136 INFO:tasks.workunit.client.1.smithi155.stdout:8/250: unlink d2/d6/fe 0 2024-09-13T21:44:51.137 INFO:tasks.workunit.client.1.smithi155.stdout:5/314: dread d5/d12/f4b [0,4194304] 0 2024-09-13T21:44:51.137 INFO:tasks.workunit.client.1.smithi155.stdout:7/217: mkdir d5/d10/d3e/d40 0 2024-09-13T21:44:51.138 INFO:tasks.workunit.client.0.smithi119.stdout:0/695: stat de/d1c/d2f/d40/d66/dcb/dd6/d83/f88 0 2024-09-13T21:44:51.138 INFO:tasks.workunit.client.0.smithi119.stdout:0/696: readlink de/d1c/l46 0 2024-09-13T21:44:51.139 INFO:tasks.workunit.client.0.smithi119.stdout:8/693: creat d1b/d4e/d6a/fd5 x:0 0 0 2024-09-13T21:44:51.139 INFO:tasks.workunit.client.1.smithi155.stdout:1/300: creat d6/d15/d3e/d17/d30/d4b/f6d x:0 0 0 2024-09-13T21:44:51.140 INFO:tasks.workunit.client.0.smithi119.stdout:8/694: fsync d1b/d1d/d26/fa8 0 2024-09-13T21:44:51.141 INFO:tasks.workunit.client.0.smithi119.stdout:1/681: write d1/d3/dc/d24/fe2 [246139,98736] 0 2024-09-13T21:44:51.143 INFO:tasks.workunit.client.1.smithi155.stdout:8/251: creat d2/d1f/d39/f48 x:0 0 0 2024-09-13T21:44:51.146 INFO:tasks.workunit.client.1.smithi155.stdout:5/315: creat d5/d26/d45/f65 x:0 0 0 2024-09-13T21:44:51.148 INFO:tasks.workunit.client.1.smithi155.stdout:5/316: write d5/d16/d33/d1b/d1e/f50 [569672,9706] 0 2024-09-13T21:44:51.148 INFO:tasks.workunit.client.1.smithi155.stdout:9/324: dread dc/de/d2d/f40 [0,4194304] 0 2024-09-13T21:44:51.149 INFO:tasks.workunit.client.1.smithi155.stdout:7/218: rename d5/c7 to d5/d10/c41 0 2024-09-13T21:44:51.149 INFO:tasks.workunit.client.1.smithi155.stdout:1/301: mkdir d6/d15/d23/d55/d6e 0 2024-09-13T21:44:51.151 INFO:tasks.workunit.client.1.smithi155.stdout:9/325: read dc/d19/d23/d38/f5b [262324,119141] 0 2024-09-13T21:44:51.152 INFO:tasks.workunit.client.1.smithi155.stdout:6/370: dread db/d11/d1e/f2e [0,4194304] 0 2024-09-13T21:44:51.159 INFO:tasks.workunit.client.1.smithi155.stdout:1/302: unlink d6/d15/d57/d5d/f65 0 2024-09-13T21:44:51.159 INFO:tasks.workunit.client.1.smithi155.stdout:3/379: write d3/d25/f11 [1543622,5015] 0 2024-09-13T21:44:51.160 INFO:tasks.workunit.client.1.smithi155.stdout:1/303: stat d6/d15/d23/c56 0 2024-09-13T21:44:51.161 INFO:tasks.workunit.client.1.smithi155.stdout:3/380: chown d3/d25/d17/d52/c7b 40 1 2024-09-13T21:44:51.162 INFO:tasks.workunit.client.1.smithi155.stdout:3/381: read - d3/d25/d1b/f6a zero size 2024-09-13T21:44:51.163 INFO:tasks.workunit.client.1.smithi155.stdout:5/317: mknod d5/d16/d33/d1b/d59/c66 0 2024-09-13T21:44:51.164 INFO:tasks.workunit.client.1.smithi155.stdout:5/318: readlink d5/d16/d33/d1b/d2f/l5c 0 2024-09-13T21:44:51.165 INFO:tasks.workunit.client.1.smithi155.stdout:0/323: dread d1/d6/dc/d4d/d4a/d4e/d61/f6b [0,4194304] 0 2024-09-13T21:44:51.165 INFO:tasks.workunit.client.1.smithi155.stdout:5/319: dread d5/d12/f4b [0,4194304] 0 2024-09-13T21:44:51.166 INFO:tasks.workunit.client.1.smithi155.stdout:7/219: link d5/df/d15/f1f d5/d3b/f42 0 2024-09-13T21:44:51.171 INFO:tasks.workunit.client.1.smithi155.stdout:5/320: unlink d5/d12/f14 0 2024-09-13T21:44:51.171 INFO:tasks.workunit.client.1.smithi155.stdout:2/178: dwrite d2/db/f40 [0,4194304] 0 2024-09-13T21:44:51.172 INFO:tasks.workunit.client.1.smithi155.stdout:8/252: truncate d2/d6/dd/d12/f21 3729143 0 2024-09-13T21:44:51.174 INFO:tasks.workunit.client.1.smithi155.stdout:3/382: symlink d3/l85 0 2024-09-13T21:44:51.176 INFO:tasks.workunit.client.1.smithi155.stdout:3/383: chown d3/d25/d17/f74 149 1 2024-09-13T21:44:51.179 INFO:tasks.workunit.client.1.smithi155.stdout:5/321: link d5/f8 d5/d16/d33/d1b/d2f/d3c/d5b/f67 0 2024-09-13T21:44:51.180 INFO:tasks.workunit.client.1.smithi155.stdout:0/324: dwrite d1/d6/dc/f27 [4194304,4194304] 0 2024-09-13T21:44:51.186 INFO:tasks.workunit.client.1.smithi155.stdout:3/384: mkdir d3/d21/d2c/d86 0 2024-09-13T21:44:51.187 INFO:tasks.workunit.client.1.smithi155.stdout:2/179: dwrite d2/dd/de/d15/f2d [0,4194304] 0 2024-09-13T21:44:51.192 INFO:tasks.workunit.client.1.smithi155.stdout:8/253: dwrite d2/d1f/d39/f48 [0,4194304] 0 2024-09-13T21:44:51.197 INFO:tasks.workunit.client.0.smithi119.stdout:4/715: mkdir d4/d1e/d28/d34/d6a/d79/d9f/dba/dc9/de9 0 2024-09-13T21:44:51.197 INFO:tasks.workunit.client.0.smithi119.stdout:8/695: chown d1b/cbe 58318 1 2024-09-13T21:44:51.197 INFO:tasks.workunit.client.0.smithi119.stdout:6/656: symlink dc/d4b/lcd 0 2024-09-13T21:44:51.197 INFO:tasks.workunit.client.0.smithi119.stdout:8/696: readlink d1b/d1d/d48/d58/l9a 0 2024-09-13T21:44:51.198 INFO:tasks.workunit.client.0.smithi119.stdout:3/604: rename d6/d25/d2f/d8e/cad to d6/d15/d1a/d45/d47/d4d/da7/cca 0 2024-09-13T21:44:51.198 INFO:tasks.workunit.client.1.smithi155.stdout:8/254: write d2/d6/f43 [776251,107556] 0 2024-09-13T21:44:51.199 INFO:tasks.workunit.client.1.smithi155.stdout:3/385: creat d3/d21/d2c/f87 x:0 0 0 2024-09-13T21:44:51.202 INFO:tasks.workunit.client.1.smithi155.stdout:0/325: getdents d1/d6/dc/d4d/d4a 0 2024-09-13T21:44:51.202 INFO:tasks.workunit.client.0.smithi119.stdout:9/916: dwrite d0/d8/d18/d23/d27/fd0 [0,4194304] 0 2024-09-13T21:44:51.203 INFO:tasks.workunit.client.1.smithi155.stdout:7/220: dread f3 [0,4194304] 0 2024-09-13T21:44:51.204 INFO:tasks.workunit.client.0.smithi119.stdout:7/738: truncate d8/d3c/d46/f5a 7953763 0 2024-09-13T21:44:51.205 INFO:tasks.workunit.client.1.smithi155.stdout:8/255: link d2/d6/dd/d12/f2c d2/d6/f49 0 2024-09-13T21:44:51.206 INFO:tasks.workunit.client.1.smithi155.stdout:3/386: truncate d3/d25/d1b/d1f/d36/d5c/f63 637298 0 2024-09-13T21:44:51.208 INFO:tasks.workunit.client.1.smithi155.stdout:7/221: unlink d5/f2d 0 2024-09-13T21:44:51.210 INFO:tasks.workunit.client.1.smithi155.stdout:2/180: dwrite d2/dd/f24 [0,4194304] 0 2024-09-13T21:44:51.210 INFO:tasks.workunit.client.0.smithi119.stdout:9/917: read d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/db9/fe6 [200776,105058] 0 2024-09-13T21:44:51.211 INFO:tasks.workunit.client.0.smithi119.stdout:9/918: fsync d0/d8/d18/f12e 0 2024-09-13T21:44:51.211 INFO:tasks.workunit.client.0.smithi119.stdout:2/647: dwrite d1/d38/d89/d6b/f65 [0,4194304] 0 2024-09-13T21:44:51.212 INFO:tasks.workunit.client.1.smithi155.stdout:2/181: fdatasync d2/fc 0 2024-09-13T21:44:51.213 INFO:tasks.workunit.client.0.smithi119.stdout:2/648: chown d1/d38/fa2 298 1 2024-09-13T21:44:51.217 INFO:tasks.workunit.client.1.smithi155.stdout:2/182: write d2/db/f25 [213799,90146] 0 2024-09-13T21:44:51.219 INFO:tasks.workunit.client.1.smithi155.stdout:7/222: mkdir d5/df/d15/d33/d43 0 2024-09-13T21:44:51.221 INFO:tasks.workunit.client.1.smithi155.stdout:8/256: rename d2/d6/f49 to d2/d6/dd/d12/f4a 0 2024-09-13T21:44:51.221 INFO:tasks.workunit.client.1.smithi155.stdout:2/183: write d2/f22 [557236,62280] 0 2024-09-13T21:44:51.222 INFO:tasks.workunit.client.1.smithi155.stdout:0/326: getdents d1/d6/dc/d4d/d4a/d52/d5c 0 2024-09-13T21:44:51.225 INFO:tasks.workunit.client.1.smithi155.stdout:7/223: unlink l1 0 2024-09-13T21:44:51.227 INFO:tasks.workunit.client.1.smithi155.stdout:8/257: unlink d2/d6/dd/d12/f1d 0 2024-09-13T21:44:51.228 INFO:tasks.workunit.client.1.smithi155.stdout:0/327: symlink d1/d6/dc/d4d/d4a/d4e/d61/l7c 0 2024-09-13T21:44:51.228 INFO:tasks.workunit.client.1.smithi155.stdout:8/258: fdatasync d2/d8/ff 0 2024-09-13T21:44:51.229 INFO:tasks.workunit.client.1.smithi155.stdout:5/322: dread d5/d16/f32 [0,4194304] 0 2024-09-13T21:44:51.230 INFO:tasks.workunit.client.0.smithi119.stdout:4/716: readlink d4/d1e/d26/d60/dad/lc5 0 2024-09-13T21:44:51.231 INFO:tasks.workunit.client.1.smithi155.stdout:2/184: mkdir d2/dd/de/d15/d38/d41 0 2024-09-13T21:44:51.231 INFO:tasks.workunit.client.1.smithi155.stdout:2/185: read - d2/dd/d37/f3a zero size 2024-09-13T21:44:51.232 INFO:tasks.workunit.client.0.smithi119.stdout:8/697: creat d1b/d1d/d39/fd6 x:0 0 0 2024-09-13T21:44:51.233 INFO:tasks.workunit.client.0.smithi119.stdout:8/698: write d1b/d1d/d26/d6b/f87 [148298,29330] 0 2024-09-13T21:44:51.234 INFO:tasks.workunit.client.0.smithi119.stdout:3/605: rename d6/d15/d1a/d45/l90 to d6/d15/d1a/d45/d8d/d95/lcb 0 2024-09-13T21:44:51.234 INFO:tasks.workunit.client.0.smithi119.stdout:8/699: fdatasync f18 0 2024-09-13T21:44:51.235 INFO:tasks.workunit.client.1.smithi155.stdout:5/323: mknod d5/d16/d33/d1f/c68 0 2024-09-13T21:44:51.235 INFO:tasks.workunit.client.1.smithi155.stdout:2/186: write d2/dd/de/d15/d2e/f3c [581390,108618] 0 2024-09-13T21:44:51.235 INFO:tasks.workunit.client.1.smithi155.stdout:0/328: symlink d1/l7d 0 2024-09-13T21:44:51.236 INFO:tasks.workunit.client.1.smithi155.stdout:5/324: truncate d5/d16/d4e/f55 29137 0 2024-09-13T21:44:51.236 INFO:tasks.workunit.client.1.smithi155.stdout:5/325: fsync d5/f10 0 2024-09-13T21:44:51.237 INFO:tasks.workunit.client.0.smithi119.stdout:2/649: chown d1/d22/c3b 4018633 1 2024-09-13T21:44:51.238 INFO:tasks.workunit.client.1.smithi155.stdout:2/187: symlink d2/dd/de/d15/d38/d41/l42 0 2024-09-13T21:44:51.238 INFO:tasks.workunit.client.0.smithi119.stdout:6/657: mkdir dc/d3d/d40/dce 0 2024-09-13T21:44:51.238 INFO:tasks.workunit.client.0.smithi119.stdout:6/658: chown dc/dd/f47 1 1 2024-09-13T21:44:51.240 INFO:tasks.workunit.client.1.smithi155.stdout:2/188: write d2/dd/de/d15/d2e/f36 [415171,78104] 0 2024-09-13T21:44:51.241 INFO:tasks.workunit.client.0.smithi119.stdout:8/700: mknod d1b/d1d/d26/d3e/d65/cd7 0 2024-09-13T21:44:51.242 INFO:tasks.workunit.client.1.smithi155.stdout:0/329: getdents d1/d6/dc/d4d/d4a 0 2024-09-13T21:44:51.243 INFO:tasks.workunit.client.0.smithi119.stdout:6/659: dread dc/df/d5c/f89 [0,4194304] 0 2024-09-13T21:44:51.243 INFO:tasks.workunit.client.0.smithi119.stdout:9/919: creat d0/d8/d18/d23/d42/d12f/f140 x:0 0 0 2024-09-13T21:44:51.244 INFO:tasks.workunit.client.1.smithi155.stdout:2/189: symlink d2/dd/d21/l43 0 2024-09-13T21:44:51.245 INFO:tasks.workunit.client.0.smithi119.stdout:4/717: dwrite d4/d1e/d28/d34/d99/fa4 [0,4194304] 0 2024-09-13T21:44:51.245 INFO:tasks.workunit.client.0.smithi119.stdout:9/920: write d0/d8/d18/d23/dea/feb [71444,19128] 0 2024-09-13T21:44:51.246 INFO:tasks.workunit.client.1.smithi155.stdout:2/190: dread - d2/db/f1e zero size 2024-09-13T21:44:51.248 INFO:tasks.workunit.client.1.smithi155.stdout:0/330: unlink d1/l32 0 2024-09-13T21:44:51.249 INFO:tasks.workunit.client.0.smithi119.stdout:9/921: write d0/d8/d18/d23/dea/fb7 [6757752,85479] 0 2024-09-13T21:44:51.251 INFO:tasks.workunit.client.1.smithi155.stdout:2/191: symlink d2/dd/d21/l44 0 2024-09-13T21:44:51.251 INFO:tasks.workunit.client.0.smithi119.stdout:7/739: getdents d8/d3c/d53/d37/d57 0 2024-09-13T21:44:51.252 INFO:tasks.workunit.client.0.smithi119.stdout:7/740: fsync d8/d19/dd7/fe0 0 2024-09-13T21:44:51.253 INFO:tasks.workunit.client.1.smithi155.stdout:2/192: chown d2/dd/de/d15/d2e 11 1 2024-09-13T21:44:51.253 INFO:tasks.workunit.client.1.smithi155.stdout:7/224: dread d5/fa [0,4194304] 0 2024-09-13T21:44:51.254 INFO:tasks.workunit.client.0.smithi119.stdout:9/922: rmdir d0/d8/d18/d23 39 2024-09-13T21:44:51.254 INFO:tasks.workunit.client.0.smithi119.stdout:7/741: write d8/d19/d2e/d34/f5d [1011857,37067] 0 2024-09-13T21:44:51.254 INFO:tasks.workunit.client.1.smithi155.stdout:0/331: rmdir d1/d6/dc/d4d/d4a/d52/d5b 39 2024-09-13T21:44:51.256 INFO:tasks.workunit.client.0.smithi119.stdout:4/718: link d4/d1e/d10/f46 d4/d1e/d26/d6d/d7c/dde/d8f/fea 0 2024-09-13T21:44:51.258 INFO:tasks.workunit.client.0.smithi119.stdout:4/719: read d4/d1e/d10/f46 [551791,35920] 0 2024-09-13T21:44:51.259 INFO:tasks.workunit.client.0.smithi119.stdout:7/742: creat d8/d19/fee x:0 0 0 2024-09-13T21:44:51.261 INFO:tasks.workunit.client.0.smithi119.stdout:7/743: readlink d8/d3c/d53/d37/d57/d8f/led 0 2024-09-13T21:44:51.261 INFO:tasks.workunit.client.1.smithi155.stdout:2/193: symlink d2/dd/d21/d39/l45 0 2024-09-13T21:44:51.262 INFO:tasks.workunit.client.1.smithi155.stdout:7/225: creat d5/d10/d3e/d40/f44 x:0 0 0 2024-09-13T21:44:51.264 INFO:tasks.workunit.client.1.smithi155.stdout:2/194: fdatasync d2/dd/f2c 0 2024-09-13T21:44:51.264 INFO:tasks.workunit.client.1.smithi155.stdout:8/259: dwrite d2/d1f/f2b [0,4194304] 0 2024-09-13T21:44:51.265 INFO:tasks.workunit.client.1.smithi155.stdout:5/326: dread d5/d26/f46 [0,4194304] 0 2024-09-13T21:44:51.267 INFO:tasks.workunit.client.0.smithi119.stdout:1/682: write d1/d3/d61/d77/d78/d32/d33/d43/d74/f8b [493715,100534] 0 2024-09-13T21:44:51.271 INFO:tasks.workunit.client.0.smithi119.stdout:7/744: dread d8/f7d [0,4194304] 0 2024-09-13T21:44:51.272 INFO:tasks.workunit.client.0.smithi119.stdout:1/683: write d1/d3/d61/d77/d78/d32/dda/d19/d2d/f51 [3756632,120027] 0 2024-09-13T21:44:51.273 INFO:tasks.workunit.client.0.smithi119.stdout:3/606: write d6/f14 [1665266,82991] 0 2024-09-13T21:44:51.273 INFO:tasks.workunit.client.0.smithi119.stdout:5/672: sync 2024-09-13T21:44:51.274 INFO:tasks.workunit.client.0.smithi119.stdout:1/684: stat d1/d3/d61/d77/d78/d32/d33/d43/c7b 0 2024-09-13T21:44:51.275 INFO:tasks.workunit.client.1.smithi155.stdout:7/226: dread d5/d13/f24 [0,4194304] 0 2024-09-13T21:44:51.276 INFO:tasks.workunit.client.0.smithi119.stdout:2/650: write d1/d22/d55/f5e [862390,102918] 0 2024-09-13T21:44:51.277 INFO:tasks.workunit.client.1.smithi155.stdout:5/327: dwrite d5/d26/f35 [0,4194304] 0 2024-09-13T21:44:51.277 INFO:tasks.workunit.client.1.smithi155.stdout:0/332: dread d1/d6/dc/f77 [0,4194304] 0 2024-09-13T21:44:51.278 INFO:tasks.workunit.client.1.smithi155.stdout:8/260: rename d2/d6/dd/d12/f2a to d2/f4b 0 2024-09-13T21:44:51.278 INFO:tasks.workunit.client.0.smithi119.stdout:7/745: creat d8/d3c/d53/d3b/d7e/dc2/fef x:0 0 0 2024-09-13T21:44:51.279 INFO:tasks.workunit.client.0.smithi119.stdout:1/685: read d1/d3/dc/d24/fe2 [240663,103237] 0 2024-09-13T21:44:51.279 INFO:tasks.workunit.client.1.smithi155.stdout:8/261: chown d2/d6/dd/d25 0 1 2024-09-13T21:44:51.280 INFO:tasks.workunit.client.0.smithi119.stdout:3/607: mknod d6/d15/ccc 0 2024-09-13T21:44:51.280 INFO:tasks.workunit.client.0.smithi119.stdout:8/701: write d1b/d1d/d48/d58/f74 [2491620,83042] 0 2024-09-13T21:44:51.284 INFO:tasks.workunit.client.0.smithi119.stdout:4/720: rmdir d4/d1e/d26/d6d/d7c 39 2024-09-13T21:44:51.284 INFO:tasks.workunit.client.1.smithi155.stdout:2/195: dread d2/dd/de/d15/f1c [0,4194304] 0 2024-09-13T21:44:51.285 INFO:tasks.workunit.client.1.smithi155.stdout:5/328: symlink d5/d16/d33/d1b/l69 0 2024-09-13T21:44:51.287 INFO:tasks.workunit.client.1.smithi155.stdout:8/262: creat d2/d6/dd/d25/f4c x:0 0 0 2024-09-13T21:44:51.288 INFO:tasks.workunit.client.1.smithi155.stdout:2/196: chown f0 23045854 1 2024-09-13T21:44:51.289 INFO:tasks.workunit.client.1.smithi155.stdout:0/333: creat d1/d6/dc/d4d/d4a/d52/d5b/f7e x:0 0 0 2024-09-13T21:44:51.289 INFO:tasks.workunit.client.0.smithi119.stdout:1/686: mknod d1/d3/d61/d77/da6/ce6 0 2024-09-13T21:44:51.290 INFO:tasks.workunit.client.0.smithi119.stdout:9/923: truncate d0/d8/d18/d23/d42/d52/de1/f125 1879013 0 2024-09-13T21:44:51.290 INFO:tasks.workunit.client.1.smithi155.stdout:2/197: chown d2/dd/d37/f3b 223541016 1 2024-09-13T21:44:51.292 INFO:tasks.workunit.client.1.smithi155.stdout:7/227: dwrite d5/d10/f18 [0,4194304] 0 2024-09-13T21:44:51.293 INFO:tasks.workunit.client.1.smithi155.stdout:0/334: fdatasync d1/d6/dc/fe 0 2024-09-13T21:44:51.295 INFO:tasks.workunit.client.1.smithi155.stdout:8/263: rename d2/d8/c14 to d2/d1f/c4d 0 2024-09-13T21:44:51.296 INFO:tasks.workunit.client.0.smithi119.stdout:3/608: creat d6/d25/d2f/d33/d88/db9/fcd x:0 0 0 2024-09-13T21:44:51.297 INFO:tasks.workunit.client.0.smithi119.stdout:1/687: mkdir d1/d3/d61/d77/d78/d32/d33/d43/de7 0 2024-09-13T21:44:51.297 INFO:tasks.workunit.client.0.smithi119.stdout:1/688: readlink d1/l5c 0 2024-09-13T21:44:51.298 INFO:tasks.workunit.client.0.smithi119.stdout:9/924: dwrite d0/d8/d18/f12e [0,4194304] 0 2024-09-13T21:44:51.299 INFO:tasks.workunit.client.0.smithi119.stdout:7/746: rename d8/c90 to d8/d3c/d53/cf0 0 2024-09-13T21:44:51.301 INFO:tasks.workunit.client.0.smithi119.stdout:1/689: fsync d1/d3/d61/d77/d78/d32/dda/d19/d2d/f44 0 2024-09-13T21:44:51.302 INFO:tasks.workunit.client.0.smithi119.stdout:7/747: truncate d8/d3c/d46/db1/fc6 634366 0 2024-09-13T21:44:51.303 INFO:tasks.workunit.client.1.smithi155.stdout:5/329: dwrite d5/d26/f46 [0,4194304] 0 2024-09-13T21:44:51.304 INFO:tasks.workunit.client.0.smithi119.stdout:5/673: link d0/d3/f11 d0/d3/fec 0 2024-09-13T21:44:51.305 INFO:tasks.workunit.client.1.smithi155.stdout:8/264: read d2/d6/dd/d12/f21 [31299,25834] 0 2024-09-13T21:44:51.306 INFO:tasks.workunit.client.0.smithi119.stdout:2/651: getdents d1/d9d 0 2024-09-13T21:44:51.309 INFO:tasks.workunit.client.1.smithi155.stdout:8/265: read d2/d1f/d39/f48 [1888125,57233] 0 2024-09-13T21:44:51.309 INFO:tasks.workunit.client.1.smithi155.stdout:2/198: dwrite d2/dd/de/f13 [4194304,4194304] 0 2024-09-13T21:44:51.309 INFO:tasks.workunit.client.1.smithi155.stdout:0/335: rmdir d1 39 2024-09-13T21:44:51.310 INFO:tasks.workunit.client.0.smithi119.stdout:8/702: write f5 [751675,31330] 0 2024-09-13T21:44:51.313 INFO:tasks.workunit.client.0.smithi119.stdout:3/609: mkdir d6/d9f/dce 0 2024-09-13T21:44:51.313 INFO:tasks.workunit.client.1.smithi155.stdout:8/266: stat d2/d1f/l35 0 2024-09-13T21:44:51.313 INFO:tasks.workunit.client.1.smithi155.stdout:8/267: fdatasync d2/d8/f36 0 2024-09-13T21:44:51.317 INFO:tasks.workunit.client.1.smithi155.stdout:7/228: getdents d5/d10/d3e 0 2024-09-13T21:44:51.317 INFO:tasks.workunit.client.1.smithi155.stdout:2/199: unlink d2/dd/d37/f3b 0 2024-09-13T21:44:51.318 INFO:tasks.workunit.client.0.smithi119.stdout:9/925: creat d0/d8/d18/d23/d42/f141 x:0 0 0 2024-09-13T21:44:51.320 INFO:tasks.workunit.client.0.smithi119.stdout:2/652: unlink d1/f37 0 2024-09-13T21:44:51.320 INFO:tasks.workunit.client.1.smithi155.stdout:2/200: write d2/db/f1d [390853,122255] 0 2024-09-13T21:44:51.321 INFO:tasks.workunit.client.0.smithi119.stdout:1/690: dread d1/d3/d61/f85 [0,4194304] 0 2024-09-13T21:44:51.323 INFO:tasks.workunit.client.1.smithi155.stdout:2/201: write f0 [265024,79589] 0 2024-09-13T21:44:51.323 INFO:tasks.workunit.client.1.smithi155.stdout:7/229: mkdir d5/df/d45 0 2024-09-13T21:44:51.323 INFO:tasks.workunit.client.1.smithi155.stdout:2/202: chown d2/f22 995409 1 2024-09-13T21:44:51.323 INFO:tasks.workunit.client.1.smithi155.stdout:8/268: rename d2/d6/f2e to d2/d6/dd/f4e 0 2024-09-13T21:44:51.325 INFO:tasks.workunit.client.1.smithi155.stdout:8/269: readlink d2/d6/dd/l2f 0 2024-09-13T21:44:51.326 INFO:tasks.workunit.client.1.smithi155.stdout:2/203: creat d2/dd/de/d15/f46 x:0 0 0 2024-09-13T21:44:51.328 INFO:tasks.workunit.client.0.smithi119.stdout:5/674: dread d0/d3/d4/d9/f47 [0,4194304] 0 2024-09-13T21:44:51.328 INFO:tasks.workunit.client.1.smithi155.stdout:2/204: write d2/dd/de/f13 [508365,96873] 0 2024-09-13T21:44:51.329 INFO:tasks.workunit.client.1.smithi155.stdout:8/270: rename d2/d8/ff to d2/d8/f4f 0 2024-09-13T21:44:51.329 INFO:tasks.workunit.client.0.smithi119.stdout:3/610: dwrite d6/d15/d1a/d45/f5f [0,4194304] 0 2024-09-13T21:44:51.330 INFO:tasks.workunit.client.1.smithi155.stdout:7/230: dread d5/fc [0,4194304] 0 2024-09-13T21:44:51.331 INFO:tasks.workunit.client.1.smithi155.stdout:2/205: symlink d2/dd/d21/d39/l47 0 2024-09-13T21:44:51.333 INFO:tasks.workunit.client.0.smithi119.stdout:9/926: read d0/d8/d18/d23/d27/d2d/fff [1920736,15804] 0 2024-09-13T21:44:51.333 INFO:tasks.workunit.client.1.smithi155.stdout:7/231: fdatasync d5/df/f11 0 2024-09-13T21:44:51.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:51 smithi155 ceph-mon[34732]: pgmap v10: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 48 MiB/s rd, 187 MiB/s wr, 359 op/s 2024-09-13T21:44:51.334 INFO:tasks.workunit.client.1.smithi155.stdout:2/206: truncate d2/dd/d21/f32 1031766 0 2024-09-13T21:44:51.335 INFO:tasks.workunit.client.1.smithi155.stdout:7/232: write d5/d13/f14 [668838,57526] 0 2024-09-13T21:44:51.335 INFO:tasks.workunit.client.0.smithi119.stdout:3/611: unlink d6/d15/d1a/f5b 0 2024-09-13T21:44:51.336 INFO:tasks.workunit.client.0.smithi119.stdout:8/703: dwrite d1b/d1d/d26/f89 [0,4194304] 0 2024-09-13T21:44:51.336 INFO:tasks.workunit.client.0.smithi119.stdout:1/691: dread d1/d3/d61/d77/d78/d32/dda/d3d/fc2 [0,4194304] 0 2024-09-13T21:44:51.336 INFO:tasks.workunit.client.0.smithi119.stdout:5/675: symlink d0/d3/d1f/d21/d4f/led 0 2024-09-13T21:44:51.337 INFO:tasks.workunit.client.1.smithi155.stdout:7/233: symlink d5/d13/l46 0 2024-09-13T21:44:51.338 INFO:tasks.workunit.client.0.smithi119.stdout:3/612: chown d6/f29 4966 1 2024-09-13T21:44:51.339 INFO:tasks.workunit.client.0.smithi119.stdout:2/653: dwrite d1/f3d [0,4194304] 0 2024-09-13T21:44:51.340 INFO:tasks.workunit.client.1.smithi155.stdout:7/234: mknod d5/df/d15/d33/d43/c47 0 2024-09-13T21:44:51.343 INFO:tasks.workunit.client.0.smithi119.stdout:2/654: readlink d1/d38/d89/d6b/d8c/l99 0 2024-09-13T21:44:51.344 INFO:tasks.workunit.client.0.smithi119.stdout:8/704: creat d1b/d4e/d71/fd8 x:0 0 0 2024-09-13T21:44:51.345 INFO:tasks.workunit.client.0.smithi119.stdout:1/692: creat d1/d3/d61/d77/d78/d32/dda/d28/d93/fe8 x:0 0 0 2024-09-13T21:44:51.346 INFO:tasks.workunit.client.1.smithi155.stdout:7/235: dwrite d5/df/f19 [0,4194304] 0 2024-09-13T21:44:51.347 INFO:tasks.workunit.client.1.smithi155.stdout:7/236: readlink d5/l2f 0 2024-09-13T21:44:51.349 INFO:tasks.workunit.client.1.smithi155.stdout:7/237: chown d5/d10/d3e 791 1 2024-09-13T21:44:51.349 INFO:tasks.workunit.client.1.smithi155.stdout:7/238: fdatasync d5/fc 0 2024-09-13T21:44:51.350 INFO:tasks.workunit.client.1.smithi155.stdout:7/239: read - d5/d10/d3e/d40/f44 zero size 2024-09-13T21:44:51.351 INFO:tasks.workunit.client.0.smithi119.stdout:5/676: mknod d0/d3/d4/d9/d1e/cee 0 2024-09-13T21:44:51.352 INFO:tasks.workunit.client.0.smithi119.stdout:1/693: fsync d1/d3/d61/d77/d78/d32/dda/f3c 0 2024-09-13T21:44:51.352 INFO:tasks.workunit.client.0.smithi119.stdout:4/721: write d4/d1e/d28/d5d/fa0 [61820,114503] 0 2024-09-13T21:44:51.352 INFO:tasks.workunit.client.1.smithi155.stdout:0/336: write d1/d6/dc/fe [449030,110742] 0 2024-09-13T21:44:51.353 INFO:tasks.workunit.client.1.smithi155.stdout:7/240: mkdir d5/d10/d48 0 2024-09-13T21:44:51.353 INFO:tasks.workunit.client.0.smithi119.stdout:8/705: write d1b/d1d/d26/fa8 [858846,22609] 0 2024-09-13T21:44:51.353 INFO:tasks.workunit.client.0.smithi119.stdout:2/655: chown d1/d22/l7d 3789 1 2024-09-13T21:44:51.353 INFO:tasks.workunit.client.1.smithi155.stdout:7/241: write d5/d13/f14 [673419,38602] 0 2024-09-13T21:44:51.355 INFO:tasks.workunit.client.1.smithi155.stdout:0/337: mknod d1/c7f 0 2024-09-13T21:44:51.355 INFO:tasks.workunit.client.0.smithi119.stdout:3/613: dwrite d6/d15/d1a/d45/d8d/d95/fa8 [0,4194304] 0 2024-09-13T21:44:51.357 INFO:tasks.workunit.client.1.smithi155.stdout:7/242: symlink d5/d10/d3e/d40/l49 0 2024-09-13T21:44:51.358 INFO:tasks.workunit.client.0.smithi119.stdout:2/656: readlink d1/d97/lb1 0 2024-09-13T21:44:51.358 INFO:tasks.workunit.client.1.smithi155.stdout:0/338: creat d1/d6/dc/d4d/f80 x:0 0 0 2024-09-13T21:44:51.359 INFO:tasks.workunit.client.1.smithi155.stdout:8/271: rmdir d2 39 2024-09-13T21:44:51.359 INFO:tasks.workunit.client.0.smithi119.stdout:9/927: rename d0/d8/d18/d23/d27/d2d/dc1/ddf/daa/db3/fe0 to d0/d8/d18/d23/d27/d2d/f142 0 2024-09-13T21:44:51.361 INFO:tasks.workunit.client.0.smithi119.stdout:1/694: creat d1/d3/dc/fe9 x:0 0 0 2024-09-13T21:44:51.362 INFO:tasks.workunit.client.0.smithi119.stdout:8/706: read d1b/d1d/d26/d3e/d65/f76 [2315531,77658] 0 2024-09-13T21:44:51.362 INFO:tasks.workunit.client.0.smithi119.stdout:5/677: write d0/d3/d1f/d21/d4f/d86/fc1 [565152,88751] 0 2024-09-13T21:44:51.367 INFO:tasks.workunit.client.0.smithi119.stdout:4/722: dread - d4/d1e/d26/d6d/d7c/f85 zero size 2024-09-13T21:44:51.367 INFO:tasks.workunit.client.0.smithi119.stdout:2/657: stat d1/d7/d47/lcc 0 2024-09-13T21:44:51.368 INFO:tasks.workunit.client.1.smithi155.stdout:0/339: mkdir d1/d6/d81 0 2024-09-13T21:44:51.371 INFO:tasks.workunit.client.1.smithi155.stdout:8/272: link d2/d8/c22 d2/d6/dd/d25/c50 0 2024-09-13T21:44:51.371 INFO:tasks.workunit.client.1.smithi155.stdout:2/207: dread d2/dd/de/d15/f2b [0,4194304] 0 2024-09-13T21:44:51.373 INFO:tasks.workunit.client.1.smithi155.stdout:8/273: write d2/d6/dd/d12/f3a [595317,2840] 0 2024-09-13T21:44:51.373 INFO:tasks.workunit.client.1.smithi155.stdout:2/208: fdatasync d2/dd/de/d15/d2e/f36 0 2024-09-13T21:44:51.373 INFO:tasks.workunit.client.0.smithi119.stdout:8/707: rename d1b/d1d/d26/d6b/c6e to d1b/d1d/d48/d58/d7f/dcb/cd9 0 2024-09-13T21:44:51.374 INFO:tasks.workunit.client.1.smithi155.stdout:2/209: chown d2/dd/de/d15/d2e/f36 6300 1 2024-09-13T21:44:51.374 INFO:tasks.workunit.client.1.smithi155.stdout:2/210: readlink d2/dd/d21/l44 0 2024-09-13T21:44:51.375 INFO:tasks.workunit.client.1.smithi155.stdout:8/274: symlink d2/d6/dd/d12/l51 0 2024-09-13T21:44:51.375 INFO:tasks.workunit.client.0.smithi119.stdout:2/658: truncate d1/d7/d86/fac 395043 0 2024-09-13T21:44:51.376 INFO:tasks.workunit.client.1.smithi155.stdout:8/275: mknod d2/d2d/c52 0 2024-09-13T21:44:51.377 INFO:tasks.workunit.client.1.smithi155.stdout:8/276: stat d2 0 2024-09-13T21:44:51.377 INFO:tasks.workunit.client.0.smithi119.stdout:1/695: write d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/fc8 [137851,1670] 0 2024-09-13T21:44:51.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:51 smithi119 ceph-mon[27653]: pgmap v10: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 48 MiB/s rd, 187 MiB/s wr, 359 op/s 2024-09-13T21:44:51.381 INFO:tasks.workunit.client.1.smithi155.stdout:2/211: dwrite d2/db/f25 [0,4194304] 0 2024-09-13T21:44:51.382 INFO:tasks.workunit.client.0.smithi119.stdout:9/928: dwrite d0/d79/da4/fab [0,4194304] 0 2024-09-13T21:44:51.383 INFO:tasks.workunit.client.0.smithi119.stdout:8/708: symlink d1b/d4e/d6a/lda 0 2024-09-13T21:44:51.384 INFO:tasks.workunit.client.0.smithi119.stdout:3/614: dread d6/d44/f80 [0,4194304] 0 2024-09-13T21:44:51.385 INFO:tasks.workunit.client.0.smithi119.stdout:7/748: dread d8/d3c/d53/d37/d57/d5f/f78 [0,4194304] 0 2024-09-13T21:44:51.386 INFO:tasks.workunit.client.1.smithi155.stdout:2/212: creat d2/dd/d21/d39/f48 x:0 0 0 2024-09-13T21:44:51.387 INFO:tasks.workunit.client.0.smithi119.stdout:5/678: dwrite d0/d3/d4/d9/d1e/f9f [4194304,4194304] 0 2024-09-13T21:44:51.387 INFO:tasks.workunit.client.0.smithi119.stdout:4/723: write d4/f73 [312804,14182] 0 2024-09-13T21:44:51.388 INFO:tasks.workunit.client.1.smithi155.stdout:2/213: symlink d2/dd/d37/l49 0 2024-09-13T21:44:51.389 INFO:tasks.workunit.client.0.smithi119.stdout:4/724: readlink d4/d1e/d10/l9b 0 2024-09-13T21:44:51.390 INFO:tasks.workunit.client.0.smithi119.stdout:2/659: mknod d1/d22/d5a/cd1 0 2024-09-13T21:44:51.390 INFO:tasks.workunit.client.1.smithi155.stdout:7/243: write d5/d3b/f42 [1364661,77399] 0 2024-09-13T21:44:51.392 INFO:tasks.workunit.client.1.smithi155.stdout:7/244: write d5/fc [220940,68531] 0 2024-09-13T21:44:51.393 INFO:tasks.workunit.client.1.smithi155.stdout:8/277: write d2/d6/dd/d12/f2c [493024,27516] 0 2024-09-13T21:44:51.393 INFO:tasks.workunit.client.0.smithi119.stdout:3/615: mkdir d6/d15/d1a/d45/d47/d4d/dcf 0 2024-09-13T21:44:51.394 INFO:tasks.workunit.client.0.smithi119.stdout:7/749: chown d8/d3c/d46/c76 32501 1 2024-09-13T21:44:51.395 INFO:tasks.workunit.client.0.smithi119.stdout:2/660: write d1/d38/d89/f4e [780862,74889] 0 2024-09-13T21:44:51.396 INFO:tasks.workunit.client.0.smithi119.stdout:4/725: creat d4/d1e/d26/d60/d71/feb x:0 0 0 2024-09-13T21:44:51.397 INFO:tasks.workunit.client.0.smithi119.stdout:9/929: truncate d0/d8/d18/d23/d42/fc4 892694 0 2024-09-13T21:44:51.400 INFO:tasks.workunit.client.1.smithi155.stdout:2/214: getdents d2 0 2024-09-13T21:44:51.401 INFO:tasks.workunit.client.1.smithi155.stdout:7/245: creat d5/d10/d3e/d3f/f4a x:0 0 0 2024-09-13T21:44:51.401 INFO:tasks.workunit.client.1.smithi155.stdout:2/215: creat d2/dd/d37/f4a x:0 0 0 2024-09-13T21:44:51.402 INFO:tasks.workunit.client.0.smithi119.stdout:8/709: dwrite d1b/d1d/d26/d6b/f87 [0,4194304] 0 2024-09-13T21:44:51.402 INFO:tasks.workunit.client.0.smithi119.stdout:3/616: mkdir d6/d15/d1a/d45/d47/d4d/dcf/dd0 0 2024-09-13T21:44:51.403 INFO:tasks.workunit.client.1.smithi155.stdout:7/246: creat d5/d3b/f4b x:0 0 0 2024-09-13T21:44:51.404 INFO:tasks.workunit.client.1.smithi155.stdout:2/216: unlink d2/dd/de/d15/c28 0 2024-09-13T21:44:51.406 INFO:tasks.workunit.client.0.smithi119.stdout:5/679: dwrite d0/d3/d4/d2e/d65/fca [0,4194304] 0 2024-09-13T21:44:51.406 INFO:tasks.workunit.client.0.smithi119.stdout:4/726: fsync d4/d1e/d26/f32 0 2024-09-13T21:44:51.408 INFO:tasks.workunit.client.1.smithi155.stdout:2/217: link d2/db/f25 d2/db/f4b 0 2024-09-13T21:44:51.409 INFO:tasks.workunit.client.0.smithi119.stdout:7/750: dread d8/d3c/d53/d3b/d7e/fbd [0,4194304] 0 2024-09-13T21:44:51.411 INFO:tasks.workunit.client.1.smithi155.stdout:7/247: dwrite d5/df/d15/f1f [0,4194304] 0 2024-09-13T21:44:51.411 INFO:tasks.workunit.client.0.smithi119.stdout:9/930: symlink d0/l143 0 2024-09-13T21:44:51.412 INFO:tasks.workunit.client.0.smithi119.stdout:4/727: truncate d4/d1e/fda 614492 0 2024-09-13T21:44:51.412 INFO:tasks.workunit.client.1.smithi155.stdout:2/218: write d2/dd/de/d15/f1c [258847,47917] 0 2024-09-13T21:44:51.413 INFO:tasks.workunit.client.0.smithi119.stdout:5/680: dread d0/d3/f50 [0,4194304] 0 2024-09-13T21:44:51.414 INFO:tasks.workunit.client.0.smithi119.stdout:8/710: write d1b/d1d/d48/d58/d7f/fa5 [1049604,123227] 0 2024-09-13T21:44:51.416 INFO:tasks.workunit.client.1.smithi155.stdout:2/219: creat d2/dd/de/d15/f4c x:0 0 0 2024-09-13T21:44:51.417 INFO:tasks.workunit.client.0.smithi119.stdout:3/617: chown d6/d15/d1a/d45/d8d/c9d 553 1 2024-09-13T21:44:51.419 INFO:tasks.workunit.client.1.smithi155.stdout:7/248: dwrite d5/fb [4194304,4194304] 0 2024-09-13T21:44:51.419 INFO:tasks.workunit.client.1.smithi155.stdout:2/220: symlink d2/dd/de/d15/d38/d41/l4d 0 2024-09-13T21:44:51.420 INFO:tasks.workunit.client.0.smithi119.stdout:4/728: symlink d4/d1e/d28/d34/d99/lec 0 2024-09-13T21:44:51.423 INFO:tasks.workunit.client.0.smithi119.stdout:1/696: dwrite d1/d3/d61/d77/d78/fa4 [0,4194304] 0 2024-09-13T21:44:51.424 INFO:tasks.workunit.client.1.smithi155.stdout:7/249: link d5/d13/l46 d5/d10/d3e/d3f/l4c 0 2024-09-13T21:44:51.426 INFO:tasks.workunit.client.1.smithi155.stdout:7/250: dread - d5/d10/d3e/d3f/f4a zero size 2024-09-13T21:44:51.427 INFO:tasks.workunit.client.0.smithi119.stdout:9/931: readlink d0/d8/d18/d23/d27/d2d/dc1/ld9 0 2024-09-13T21:44:51.428 INFO:tasks.workunit.client.0.smithi119.stdout:9/932: chown d0/d8/d18/d23/d27/d2d/dc1/ddf/cbc 6 1 2024-09-13T21:44:51.429 INFO:tasks.workunit.client.1.smithi155.stdout:7/251: truncate d5/d10/f2a 126043 0 2024-09-13T21:44:51.429 INFO:tasks.workunit.client.1.smithi155.stdout:8/278: dwrite d2/d6/dd/d12/f1e [0,4194304] 0 2024-09-13T21:44:51.430 INFO:tasks.workunit.client.0.smithi119.stdout:2/661: link d1/d22/d5a/l91 d1/d22/ld2 0 2024-09-13T21:44:51.430 INFO:tasks.workunit.client.1.smithi155.stdout:7/252: write d5/d3b/f42 [2682921,46007] 0 2024-09-13T21:44:51.434 INFO:tasks.workunit.client.0.smithi119.stdout:1/697: write d1/d3/d61/d77/d78/db8/fd4 [691225,90935] 0 2024-09-13T21:44:51.437 INFO:tasks.workunit.client.0.smithi119.stdout:8/711: fsync d1b/d1d/f5f 0 2024-09-13T21:44:51.437 INFO:tasks.workunit.client.0.smithi119.stdout:5/681: truncate d0/d3/d4/d9/d14/d24/d25/fcf 468612 0 2024-09-13T21:44:51.440 INFO:tasks.workunit.client.1.smithi155.stdout:7/253: dread - d5/d10/d3e/d3f/f4a zero size 2024-09-13T21:44:51.440 INFO:tasks.workunit.client.0.smithi119.stdout:8/712: dread - d1b/d4e/d71/f75 zero size 2024-09-13T21:44:51.441 INFO:tasks.workunit.client.1.smithi155.stdout:7/254: write d5/d10/f18 [4709472,113723] 0 2024-09-13T21:44:51.444 INFO:tasks.workunit.client.1.smithi155.stdout:8/279: creat d2/d1f/f53 x:0 0 0 2024-09-13T21:44:51.446 INFO:tasks.workunit.client.0.smithi119.stdout:9/933: write d0/d8/d18/d23/d27/d2d/d5f/fcf [3450240,26229] 0 2024-09-13T21:44:51.446 INFO:tasks.workunit.client.0.smithi119.stdout:3/618: link d6/d15/d1a/c27 d6/d15/d1a/d45/d47/d4d/dcf/dd0/cd1 0 2024-09-13T21:44:51.449 INFO:tasks.workunit.client.1.smithi155.stdout:7/255: symlink d5/df/d15/l4d 0 2024-09-13T21:44:51.450 INFO:tasks.workunit.client.0.smithi119.stdout:2/662: dwrite d1/d22/d5a/d5d/f78 [0,4194304] 0 2024-09-13T21:44:51.455 INFO:tasks.workunit.client.0.smithi119.stdout:8/713: getdents d1b/d1d/d48/d54 0 2024-09-13T21:44:51.456 INFO:tasks.workunit.client.0.smithi119.stdout:2/663: chown d1/d38/d89/f9f 5 1 2024-09-13T21:44:51.456 INFO:tasks.workunit.client.0.smithi119.stdout:1/698: dwrite d1/d3/d61/d77/d78/d32/dda/d3d/fb1 [0,4194304] 0 2024-09-13T21:44:51.457 INFO:tasks.workunit.client.1.smithi155.stdout:8/280: dwrite d2/f30 [0,4194304] 0 2024-09-13T21:44:51.457 INFO:tasks.workunit.client.1.smithi155.stdout:2/221: dwrite d2/dd/de/d15/f2b [4194304,4194304] 0 2024-09-13T21:44:51.461 INFO:tasks.workunit.client.1.smithi155.stdout:7/256: dread d5/f1e [0,4194304] 0 2024-09-13T21:44:51.463 INFO:tasks.workunit.client.1.smithi155.stdout:7/257: write d5/d13/f20 [1233513,71358] 0 2024-09-13T21:44:51.463 INFO:tasks.workunit.client.1.smithi155.stdout:8/281: unlink d2/d2d/c52 0 2024-09-13T21:44:51.464 INFO:tasks.workunit.client.0.smithi119.stdout:7/751: dread d8/d9d/fa6 [0,4194304] 0 2024-09-13T21:44:51.466 INFO:tasks.workunit.client.0.smithi119.stdout:9/934: dread d0/d8/d18/f94 [0,4194304] 0 2024-09-13T21:44:51.467 INFO:tasks.workunit.client.1.smithi155.stdout:8/282: write d2/d6/dd/d12/f21 [4263064,46866] 0 2024-09-13T21:44:51.467 INFO:tasks.workunit.client.1.smithi155.stdout:2/222: dread d2/dd/de/f13 [4194304,4194304] 0 2024-09-13T21:44:51.468 INFO:tasks.workunit.client.1.smithi155.stdout:2/223: chown d2/dd/d21/l26 18232 1 2024-09-13T21:44:51.473 INFO:tasks.workunit.client.0.smithi119.stdout:3/619: dwrite d6/d15/d1a/d45/f87 [0,4194304] 0 2024-09-13T21:44:51.473 INFO:tasks.workunit.client.1.smithi155.stdout:8/283: mknod d2/d6/dd/d12/c54 0 2024-09-13T21:44:51.474 INFO:tasks.workunit.client.1.smithi155.stdout:2/224: rmdir d2/dd/de/d15/d38 39 2024-09-13T21:44:51.475 INFO:tasks.workunit.client.1.smithi155.stdout:2/225: dread - d2/dd/d37/f4a zero size 2024-09-13T21:44:51.475 INFO:tasks.workunit.client.1.smithi155.stdout:7/258: getdents d5/d10/d3e/d3f 0 2024-09-13T21:44:51.477 INFO:tasks.workunit.client.1.smithi155.stdout:2/226: chown d2/dd/d37/l49 123615582 1 2024-09-13T21:44:51.477 INFO:tasks.workunit.client.1.smithi155.stdout:7/259: fdatasync d5/df/f19 0 2024-09-13T21:44:51.478 INFO:tasks.workunit.client.0.smithi119.stdout:7/752: mkdir d8/d19/dd7/df1 0 2024-09-13T21:44:51.479 INFO:tasks.workunit.client.0.smithi119.stdout:2/664: dwrite d1/f3d [0,4194304] 0 2024-09-13T21:44:51.480 INFO:tasks.workunit.client.1.smithi155.stdout:8/284: unlink d2/d8/c22 0 2024-09-13T21:44:51.480 INFO:tasks.workunit.client.0.smithi119.stdout:3/620: chown d6/d15/d1a/d45/f87 244 1 2024-09-13T21:44:51.481 INFO:tasks.workunit.client.1.smithi155.stdout:8/285: dread - d2/d8/f36 zero size 2024-09-13T21:44:51.481 INFO:tasks.workunit.client.1.smithi155.stdout:2/227: mkdir d2/dd/d37/d4e 0 2024-09-13T21:44:51.483 INFO:tasks.workunit.client.1.smithi155.stdout:8/286: write d2/d1f/f53 [309674,17552] 0 2024-09-13T21:44:51.485 INFO:tasks.workunit.client.0.smithi119.stdout:9/935: creat d0/d19/de4/d102/f144 x:0 0 0 2024-09-13T21:44:51.486 INFO:tasks.workunit.client.0.smithi119.stdout:1/699: dwrite d1/d3/d61/d77/da6/fac [0,4194304] 0 2024-09-13T21:44:51.486 INFO:tasks.workunit.client.1.smithi155.stdout:7/260: dread d5/df/f11 [0,4194304] 0 2024-09-13T21:44:51.489 INFO:tasks.workunit.client.1.smithi155.stdout:2/228: creat d2/dd/de/d15/d38/f4f x:0 0 0 2024-09-13T21:44:51.490 INFO:tasks.workunit.client.1.smithi155.stdout:8/287: dread d2/d6/f27 [0,4194304] 0 2024-09-13T21:44:51.490 INFO:tasks.workunit.client.0.smithi119.stdout:2/665: dread - d1/d22/d5a/d5d/fc5 zero size 2024-09-13T21:44:51.493 INFO:tasks.workunit.client.0.smithi119.stdout:8/714: dwrite d1b/d1d/d48/d58/f79 [0,4194304] 0 2024-09-13T21:44:51.494 INFO:tasks.workunit.client.0.smithi119.stdout:9/936: fsync d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/f10c 0 2024-09-13T21:44:51.498 INFO:tasks.workunit.client.1.smithi155.stdout:8/288: unlink d2/d6/dd/c15 0 2024-09-13T21:44:51.498 INFO:tasks.workunit.client.0.smithi119.stdout:3/621: creat d6/d25/d2f/d33/d56/fd2 x:0 0 0 2024-09-13T21:44:51.498 INFO:tasks.workunit.client.0.smithi119.stdout:1/700: chown d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/lc4 510777 1 2024-09-13T21:44:51.499 INFO:tasks.workunit.client.1.smithi155.stdout:2/229: creat d2/dd/d3d/f50 x:0 0 0 2024-09-13T21:44:51.499 INFO:tasks.workunit.client.0.smithi119.stdout:8/715: fdatasync d1b/d1d/d26/d3e/d65/f76 0 2024-09-13T21:44:51.500 INFO:tasks.workunit.client.1.smithi155.stdout:2/230: rename d2/dd to d2/dd/d21/d51 22 2024-09-13T21:44:51.501 INFO:tasks.workunit.client.0.smithi119.stdout:4/729: dwrite d4/f4e [0,4194304] 0 2024-09-13T21:44:51.502 INFO:tasks.workunit.client.0.smithi119.stdout:2/666: mknod d1/d22/d5a/cd3 0 2024-09-13T21:44:51.503 INFO:tasks.workunit.client.0.smithi119.stdout:9/937: mkdir d0/d19/de4/d145 0 2024-09-13T21:44:51.504 INFO:tasks.workunit.client.1.smithi155.stdout:2/231: symlink d2/dd/d21/d39/l52 0 2024-09-13T21:44:51.505 INFO:tasks.workunit.client.0.smithi119.stdout:3/622: chown d6/d25/d2f/d33/d88/d96/faa 3 1 2024-09-13T21:44:51.505 INFO:tasks.workunit.client.1.smithi155.stdout:8/289: getdents d2/d1f 0 2024-09-13T21:44:51.506 INFO:tasks.workunit.client.1.smithi155.stdout:8/290: readlink d2/l38 0 2024-09-13T21:44:51.506 INFO:tasks.workunit.client.1.smithi155.stdout:2/232: write d2/dd/f34 [888219,1161] 0 2024-09-13T21:44:51.507 INFO:tasks.workunit.client.0.smithi119.stdout:8/716: dread - d1b/d1d/d48/d54/fa7 zero size 2024-09-13T21:44:51.509 INFO:tasks.workunit.client.0.smithi119.stdout:5/682: dread d0/d3/fec [0,4194304] 0 2024-09-13T21:44:51.510 INFO:tasks.workunit.client.1.smithi155.stdout:2/233: creat d2/f53 x:0 0 0 2024-09-13T21:44:51.510 INFO:tasks.workunit.client.0.smithi119.stdout:3/623: chown d6/d25/d2f/d8e/fb3 137318 1 2024-09-13T21:44:51.512 INFO:tasks.workunit.client.0.smithi119.stdout:5/683: stat d0/d3/d4/d9/d1e/cee 0 2024-09-13T21:44:51.513 INFO:tasks.workunit.client.0.smithi119.stdout:1/701: creat d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/dd8/d8c/fea x:0 0 0 2024-09-13T21:44:51.514 INFO:tasks.workunit.client.1.smithi155.stdout:8/291: dwrite d2/d6/dd/d12/f1e [0,4194304] 0 2024-09-13T21:44:51.516 INFO:tasks.workunit.client.0.smithi119.stdout:2/667: getdents d1/d22/d55/d31 0 2024-09-13T21:44:51.516 INFO:tasks.workunit.client.0.smithi119.stdout:5/684: chown d0/d3/d4/d2e/d6b 58 1 2024-09-13T21:44:51.516 INFO:tasks.workunit.client.0.smithi119.stdout:8/717: unlink d1b/d1d/d48/d54/fa7 0 2024-09-13T21:44:51.517 INFO:tasks.workunit.client.1.smithi155.stdout:8/292: mknod d2/d6/dd/c55 0 2024-09-13T21:44:51.519 INFO:tasks.workunit.client.0.smithi119.stdout:5/685: read - d0/d3/d1f/d21/da1/fd9 zero size 2024-09-13T21:44:51.520 INFO:tasks.workunit.client.1.smithi155.stdout:4/298: sync 2024-09-13T21:44:51.521 INFO:tasks.workunit.client.0.smithi119.stdout:9/938: dwrite d0/d79/da4/fc3 [0,4194304] 0 2024-09-13T21:44:51.522 INFO:tasks.workunit.client.1.smithi155.stdout:8/293: link d2/d6/dd/d12/f1e d2/d1f/d39/f56 0 2024-09-13T21:44:51.524 INFO:tasks.workunit.client.0.smithi119.stdout:8/718: read fd [175836,105072] 0 2024-09-13T21:44:51.526 INFO:tasks.workunit.client.0.smithi119.stdout:2/668: creat d1/d38/d89/d6b/fd4 x:0 0 0 2024-09-13T21:44:51.527 INFO:tasks.workunit.client.0.smithi119.stdout:7/753: write d8/f31 [1501889,93284] 0 2024-09-13T21:44:51.527 INFO:tasks.workunit.client.0.smithi119.stdout:1/702: truncate d1/d3/d61/d7e/d53/f83 1293149 0 2024-09-13T21:44:51.528 INFO:tasks.workunit.client.1.smithi155.stdout:4/299: dwrite d1/d7/d21/d2d/d42/f4d [0,4194304] 0 2024-09-13T21:44:51.528 INFO:tasks.workunit.client.1.smithi155.stdout:7/261: truncate d5/df/d15/f1f 979896 0 2024-09-13T21:44:51.529 INFO:tasks.workunit.client.0.smithi119.stdout:9/939: truncate d0/d8/d18/d23/d27/d2d/f142 940829 0 2024-09-13T21:44:51.530 INFO:tasks.workunit.client.0.smithi119.stdout:5/686: stat d0/d3/d4/d9/f10 0 2024-09-13T21:44:51.531 INFO:tasks.workunit.client.0.smithi119.stdout:8/719: creat d1b/d1d/dc3/fdb x:0 0 0 2024-09-13T21:44:51.532 INFO:tasks.workunit.client.0.smithi119.stdout:3/624: dread d6/d25/d2f/f57 [0,4194304] 0 2024-09-13T21:44:51.532 INFO:tasks.workunit.client.0.smithi119.stdout:2/669: fdatasync d1/d22/f6e 0 2024-09-13T21:44:51.533 INFO:tasks.workunit.client.0.smithi119.stdout:1/703: write d1/d3/d61/d77/d78/d32/dda/d19/d2d/f51 [3043435,99032] 0 2024-09-13T21:44:51.534 INFO:tasks.workunit.client.0.smithi119.stdout:0/697: sync 2024-09-13T21:44:51.534 INFO:tasks.workunit.client.0.smithi119.stdout:6/660: sync 2024-09-13T21:44:51.534 INFO:tasks.workunit.client.0.smithi119.stdout:8/720: readlink d1b/d1d/d26/d3e/lba 0 2024-09-13T21:44:51.534 INFO:tasks.workunit.client.0.smithi119.stdout:9/940: write d0/d8/d18/d23/f29 [1439503,84695] 0 2024-09-13T21:44:51.538 INFO:tasks.workunit.client.0.smithi119.stdout:1/704: read d1/d3/d61/f85 [150733,99099] 0 2024-09-13T21:44:51.541 INFO:tasks.workunit.client.1.smithi155.stdout:8/294: mknod d2/d6/dd/c57 0 2024-09-13T21:44:51.541 INFO:tasks.workunit.client.1.smithi155.stdout:7/262: dwrite d5/f30 [0,4194304] 0 2024-09-13T21:44:51.541 INFO:tasks.workunit.client.0.smithi119.stdout:9/941: stat d0/d19/de4/lf3 0 2024-09-13T21:44:51.541 INFO:tasks.workunit.client.0.smithi119.stdout:2/670: mkdir d1/d9d/dd5 0 2024-09-13T21:44:51.542 INFO:tasks.workunit.client.0.smithi119.stdout:8/721: write d1b/d1d/f80 [253233,3747] 0 2024-09-13T21:44:51.542 INFO:tasks.workunit.client.1.smithi155.stdout:4/300: rename d1/d7/d21/d2d/d42/c5c to d1/d48/c5d 0 2024-09-13T21:44:51.542 INFO:tasks.workunit.client.0.smithi119.stdout:7/754: link d8/d4d/l92 d8/d3c/d53/d37/d83/d89/lf2 0 2024-09-13T21:44:51.544 INFO:tasks.workunit.client.0.smithi119.stdout:0/698: creat de/d1c/d2f/d40/d66/ff4 x:0 0 0 2024-09-13T21:44:51.546 INFO:tasks.workunit.client.1.smithi155.stdout:4/301: rmdir d1/d7/de/dc 39 2024-09-13T21:44:51.548 INFO:tasks.workunit.client.1.smithi155.stdout:8/295: dread d2/d1f/f53 [0,4194304] 0 2024-09-13T21:44:51.550 INFO:tasks.workunit.client.0.smithi119.stdout:4/730: dwrite d4/d1e/d26/d6d/d7c/dde/d8f/fea [4194304,4194304] 0 2024-09-13T21:44:51.551 INFO:tasks.workunit.client.1.smithi155.stdout:7/263: truncate d5/f1e 2915038 0 2024-09-13T21:44:51.553 INFO:tasks.workunit.client.1.smithi155.stdout:8/296: symlink d2/d2d/l58 0 2024-09-13T21:44:51.553 INFO:tasks.workunit.client.1.smithi155.stdout:2/234: symlink d2/l54 0 2024-09-13T21:44:51.554 INFO:tasks.workunit.client.0.smithi119.stdout:3/625: link d6/d15/f35 d6/d25/d2f/d33/d88/d96/fd3 0 2024-09-13T21:44:51.554 INFO:tasks.workunit.client.0.smithi119.stdout:2/671: write d1/d22/d5a/d5d/fc5 [115961,51770] 0 2024-09-13T21:44:51.555 INFO:tasks.workunit.client.1.smithi155.stdout:7/264: mkdir d5/df/d15/d33/d43/d4e 0 2024-09-13T21:44:51.556 INFO:tasks.workunit.client.0.smithi119.stdout:7/755: write d8/d3c/d46/db1/fc6 [901938,45135] 0 2024-09-13T21:44:51.556 INFO:tasks.workunit.client.0.smithi119.stdout:5/687: rename d0/d3/d4/d9/d14/d24/d25/d54 to d0/d3/d4/def 0 2024-09-13T21:44:51.556 INFO:tasks.workunit.client.1.smithi155.stdout:8/297: rmdir d2/d6 39 2024-09-13T21:44:51.556 INFO:tasks.workunit.client.1.smithi155.stdout:7/265: write d5/d13/f3d [883528,354] 0 2024-09-13T21:44:51.559 INFO:tasks.workunit.client.0.smithi119.stdout:4/731: fsync d4/d1e/d26/d60/fbd 0 2024-09-13T21:44:51.559 INFO:tasks.workunit.client.0.smithi119.stdout:8/722: symlink d1b/d1d/d26/ldc 0 2024-09-13T21:44:51.560 INFO:tasks.workunit.client.1.smithi155.stdout:8/298: unlink d2/f20 0 2024-09-13T21:44:51.560 INFO:tasks.workunit.client.0.smithi119.stdout:6/661: getdents dc/d3a/dbb/d7a/d7e 0 2024-09-13T21:44:51.562 INFO:tasks.workunit.client.0.smithi119.stdout:9/942: creat d0/d8/d18/d23/d27/d2d/d5f/f146 x:0 0 0 2024-09-13T21:44:51.562 INFO:tasks.workunit.client.1.smithi155.stdout:2/235: creat d2/dd/de/f55 x:0 0 0 2024-09-13T21:44:51.563 INFO:tasks.workunit.client.0.smithi119.stdout:3/626: chown d6/d15/d1a/f3a 0 1 2024-09-13T21:44:51.564 INFO:tasks.workunit.client.0.smithi119.stdout:1/705: dwrite d1/f1b [0,4194304] 0 2024-09-13T21:44:51.566 INFO:tasks.workunit.client.0.smithi119.stdout:6/662: readlink dc/df/d32/l43 0 2024-09-13T21:44:51.566 INFO:tasks.workunit.client.0.smithi119.stdout:9/943: readlink d0/d8/d18/d23/d27/d2d/dc1/l133 0 2024-09-13T21:44:51.566 INFO:tasks.workunit.client.1.smithi155.stdout:7/266: creat d5/df/f4f x:0 0 0 2024-09-13T21:44:51.567 INFO:tasks.workunit.client.0.smithi119.stdout:1/706: chown d1/d3/dc/c34 2 1 2024-09-13T21:44:51.567 INFO:tasks.workunit.client.1.smithi155.stdout:2/236: dread d2/dd/de/d15/d2e/f3e [0,4194304] 0 2024-09-13T21:44:51.568 INFO:tasks.workunit.client.0.smithi119.stdout:7/756: rename d8/d3c/d53/d6b/c6d to d8/d19/db8/cf3 0 2024-09-13T21:44:51.569 INFO:tasks.workunit.client.0.smithi119.stdout:1/707: fdatasync d1/d3/d61/d77/d78/d32/dda/f3c 0 2024-09-13T21:44:51.570 INFO:tasks.workunit.client.1.smithi155.stdout:8/299: dread d2/d6/f27 [0,4194304] 0 2024-09-13T21:44:51.570 INFO:tasks.workunit.client.1.smithi155.stdout:2/237: unlink d2/dd/d37/f3a 0 2024-09-13T21:44:51.572 INFO:tasks.workunit.client.1.smithi155.stdout:7/267: creat d5/f50 x:0 0 0 2024-09-13T21:44:51.573 INFO:tasks.workunit.client.0.smithi119.stdout:1/708: readlink d1/d3/d61/d77/d78/d32/dda/d19/d2d/l4c 0 2024-09-13T21:44:51.573 INFO:tasks.workunit.client.1.smithi155.stdout:8/300: write d2/d6/dd/f4e [583311,2129] 0 2024-09-13T21:44:51.574 INFO:tasks.workunit.client.0.smithi119.stdout:9/944: mkdir d0/d8/d18/d23/d42/d12f/d147 0 2024-09-13T21:44:51.574 INFO:tasks.workunit.client.1.smithi155.stdout:2/238: symlink d2/dd/d37/d4e/l56 0 2024-09-13T21:44:51.575 INFO:tasks.workunit.client.0.smithi119.stdout:2/672: link d1/d22/d5a/d5d/f8e d1/d38/d89/d6b/d8c/fd6 0 2024-09-13T21:44:51.576 INFO:tasks.workunit.client.1.smithi155.stdout:7/268: rmdir d5/d10 39 2024-09-13T21:44:51.578 INFO:tasks.workunit.client.0.smithi119.stdout:7/757: creat d8/d3c/d53/ff4 x:0 0 0 2024-09-13T21:44:51.578 INFO:tasks.workunit.client.1.smithi155.stdout:8/301: creat d2/d2d/f59 x:0 0 0 2024-09-13T21:44:51.578 INFO:tasks.workunit.client.1.smithi155.stdout:2/239: rmdir d2/dd 39 2024-09-13T21:44:51.582 INFO:tasks.workunit.client.1.smithi155.stdout:7/269: unlink d5/d13/f20 0 2024-09-13T21:44:51.583 INFO:tasks.workunit.client.1.smithi155.stdout:7/270: stat d5/l26 0 2024-09-13T21:44:51.583 INFO:tasks.workunit.client.0.smithi119.stdout:1/709: dwrite d1/d3/fd6 [0,4194304] 0 2024-09-13T21:44:51.583 INFO:tasks.workunit.client.0.smithi119.stdout:9/945: creat d0/d8/d18/d23/f148 x:0 0 0 2024-09-13T21:44:51.585 INFO:tasks.workunit.client.1.smithi155.stdout:2/240: chown d2/dd/d21/f32 356648 1 2024-09-13T21:44:51.587 INFO:tasks.workunit.client.1.smithi155.stdout:8/302: chown d2/d1f/d39/f41 42645 1 2024-09-13T21:44:51.590 INFO:tasks.workunit.client.0.smithi119.stdout:2/673: dwrite d1/d22/f6e [0,4194304] 0 2024-09-13T21:44:51.591 INFO:tasks.workunit.client.0.smithi119.stdout:1/710: symlink d1/d3/d61/leb 0 2024-09-13T21:44:51.593 INFO:tasks.workunit.client.0.smithi119.stdout:5/688: dread d0/d3/d1f/f5d [0,4194304] 0 2024-09-13T21:44:51.594 INFO:tasks.workunit.client.1.smithi155.stdout:8/303: rename d2/d8/f36 to d2/d2d/f5a 0 2024-09-13T21:44:51.595 INFO:tasks.workunit.client.1.smithi155.stdout:7/271: mkdir d5/d10/d3e/d3f/d51 0 2024-09-13T21:44:51.597 INFO:tasks.workunit.client.1.smithi155.stdout:4/302: dwrite d1/f24 [0,4194304] 0 2024-09-13T21:44:51.598 INFO:tasks.workunit.client.0.smithi119.stdout:5/689: chown d0/d3/d4/d9/d1e/da5/db9 8 1 2024-09-13T21:44:51.599 INFO:tasks.workunit.client.0.smithi119.stdout:1/711: rmdir d1/d3/d61/d77 39 2024-09-13T21:44:51.600 INFO:tasks.workunit.client.0.smithi119.stdout:0/699: write de/d49/fb0 [386890,6835] 0 2024-09-13T21:44:51.601 INFO:tasks.workunit.client.1.smithi155.stdout:2/241: truncate d2/dd/de/d15/d2e/f36 383820 0 2024-09-13T21:44:51.604 INFO:tasks.workunit.client.0.smithi119.stdout:9/946: mkdir d0/d79/d132/d149 0 2024-09-13T21:44:51.605 INFO:tasks.workunit.client.0.smithi119.stdout:5/690: symlink d0/d3/d4/d9/d74/lf0 0 2024-09-13T21:44:51.606 INFO:tasks.workunit.client.0.smithi119.stdout:9/947: chown d0/d8/d18/d23/d27/d2d/dc1/ddf/daa/db3 10 1 2024-09-13T21:44:51.607 INFO:tasks.workunit.client.1.smithi155.stdout:9/326: sync 2024-09-13T21:44:51.607 INFO:tasks.workunit.client.0.smithi119.stdout:3/627: write d6/fc [646102,7585] 0 2024-09-13T21:44:51.608 INFO:tasks.workunit.client.1.smithi155.stdout:8/304: rename d2/d6/f43 to d2/d1f/d39/f5b 0 2024-09-13T21:44:51.609 INFO:tasks.workunit.client.1.smithi155.stdout:7/272: mknod d5/c52 0 2024-09-13T21:44:51.609 INFO:tasks.workunit.client.0.smithi119.stdout:1/712: stat d1/d3/d61/d77/d78/d32/f64 0 2024-09-13T21:44:51.610 INFO:tasks.workunit.client.1.smithi155.stdout:7/273: write d5/d10/f18 [4097948,50256] 0 2024-09-13T21:44:51.611 INFO:tasks.workunit.client.1.smithi155.stdout:9/327: unlink l1 0 2024-09-13T21:44:51.615 INFO:tasks.workunit.client.1.smithi155.stdout:2/242: mknod d2/dd/de/d15/d2e/c57 0 2024-09-13T21:44:51.616 INFO:tasks.workunit.client.0.smithi119.stdout:8/723: dwrite fd [0,4194304] 0 2024-09-13T21:44:51.617 INFO:tasks.workunit.client.0.smithi119.stdout:2/674: getdents d1/d7 0 2024-09-13T21:44:51.617 INFO:tasks.workunit.client.0.smithi119.stdout:3/628: mkdir d6/d15/d1a/d45/d47/dd4 0 2024-09-13T21:44:51.617 INFO:tasks.workunit.client.1.smithi155.stdout:8/305: mknod d2/d2d/c5c 0 2024-09-13T21:44:51.617 INFO:tasks.workunit.client.1.smithi155.stdout:2/243: dread - d2/dd/d37/f4a zero size 2024-09-13T21:44:51.619 INFO:tasks.workunit.client.1.smithi155.stdout:9/328: dwrite dc/de/d5c/f5e [0,4194304] 0 2024-09-13T21:44:51.619 INFO:tasks.workunit.client.1.smithi155.stdout:2/244: readlink d2/dd/de/d15/d38/d41/l42 0 2024-09-13T21:44:51.620 INFO:tasks.workunit.client.1.smithi155.stdout:8/306: fsync d2/d2d/f59 0 2024-09-13T21:44:51.621 INFO:tasks.workunit.client.0.smithi119.stdout:6/663: dread dc/f31 [0,4194304] 0 2024-09-13T21:44:51.622 INFO:tasks.workunit.client.1.smithi155.stdout:9/329: truncate dc/de/f45 835410 0 2024-09-13T21:44:51.624 INFO:tasks.workunit.client.1.smithi155.stdout:2/245: rmdir d2/dd/de/d15/d38 39 2024-09-13T21:44:51.627 INFO:tasks.workunit.client.1.smithi155.stdout:2/246: rename d2/dd/c1a to d2/dd/d21/c58 0 2024-09-13T21:44:51.635 INFO:tasks.workunit.client.1.smithi155.stdout:2/247: write d2/dd/de/d15/d38/f4f [520385,38701] 0 2024-09-13T21:44:51.636 INFO:tasks.workunit.client.1.smithi155.stdout:9/330: dwrite dc/f54 [0,4194304] 0 2024-09-13T21:44:51.637 INFO:tasks.workunit.client.1.smithi155.stdout:9/331: truncate dc/d18/f3d 939501 0 2024-09-13T21:44:51.638 INFO:tasks.workunit.client.1.smithi155.stdout:8/307: rename d2/d1f/d39/f48 to d2/d6/dd/d25/f5d 0 2024-09-13T21:44:51.641 INFO:tasks.workunit.client.1.smithi155.stdout:2/248: creat d2/dd/d37/d4e/f59 x:0 0 0 2024-09-13T21:44:51.643 INFO:tasks.workunit.client.1.smithi155.stdout:9/332: symlink dc/d19/d23/d70/l75 0 2024-09-13T21:44:51.644 INFO:tasks.workunit.client.1.smithi155.stdout:4/303: truncate d1/d7/d21/f2b 2027844 0 2024-09-13T21:44:51.645 INFO:tasks.workunit.client.1.smithi155.stdout:8/308: mkdir d2/d8/d5e 0 2024-09-13T21:44:51.645 INFO:tasks.workunit.client.1.smithi155.stdout:7/274: dread d5/df/f1a [0,4194304] 0 2024-09-13T21:44:51.649 INFO:tasks.workunit.client.1.smithi155.stdout:4/304: write d1/f1c [316141,88421] 0 2024-09-13T21:44:51.651 INFO:tasks.workunit.client.1.smithi155.stdout:8/309: mknod d2/d8/c5f 0 2024-09-13T21:44:51.654 INFO:tasks.workunit.client.1.smithi155.stdout:2/249: fdatasync d2/db/f4b 0 2024-09-13T21:44:51.655 INFO:tasks.workunit.client.1.smithi155.stdout:4/305: readlink d1/d7/de/dc/d2e/d26/l35 0 2024-09-13T21:44:51.656 INFO:tasks.workunit.client.0.smithi119.stdout:0/700: getdents de/d1c/d2b/d76/d9a 0 2024-09-13T21:44:51.656 INFO:tasks.workunit.client.1.smithi155.stdout:4/306: write d1/f59 [579294,7508] 0 2024-09-13T21:44:51.661 INFO:tasks.workunit.client.0.smithi119.stdout:7/758: truncate d8/d3c/d53/d3b/d7e/fd5 334827 0 2024-09-13T21:44:51.661 INFO:tasks.workunit.client.1.smithi155.stdout:2/250: dread d2/fc [0,4194304] 0 2024-09-13T21:44:51.667 INFO:tasks.workunit.client.1.smithi155.stdout:7/275: write d5/d3b/f42 [1882729,30862] 0 2024-09-13T21:44:51.667 INFO:tasks.workunit.client.1.smithi155.stdout:9/333: write dc/d19/d23/f30 [184663,114510] 0 2024-09-13T21:44:51.668 INFO:tasks.workunit.client.0.smithi119.stdout:1/713: dread d1/d3/d61/d77/d78/d32/d33/d43/f5e [0,4194304] 0 2024-09-13T21:44:51.668 INFO:tasks.workunit.client.0.smithi119.stdout:3/629: dread d6/d15/f63 [0,4194304] 0 2024-09-13T21:44:51.669 INFO:tasks.workunit.client.1.smithi155.stdout:9/334: write dc/d19/d21/f6b [20943,29741] 0 2024-09-13T21:44:51.670 INFO:tasks.workunit.client.0.smithi119.stdout:9/948: read d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/db9/fe6 [765089,54169] 0 2024-09-13T21:44:51.671 INFO:tasks.workunit.client.1.smithi155.stdout:2/251: dwrite d2/fc [0,4194304] 0 2024-09-13T21:44:51.676 INFO:tasks.workunit.client.0.smithi119.stdout:8/724: symlink d1b/d1d/d48/d58/d7f/dcb/ldd 0 2024-09-13T21:44:51.676 INFO:tasks.workunit.client.1.smithi155.stdout:9/335: dread dc/f54 [0,4194304] 0 2024-09-13T21:44:51.676 INFO:tasks.workunit.client.1.smithi155.stdout:2/252: mknod d2/dd/c5a 0 2024-09-13T21:44:51.678 INFO:tasks.workunit.client.0.smithi119.stdout:6/664: readlink dc/d3d/d40/d6b/lc5 0 2024-09-13T21:44:51.679 INFO:tasks.workunit.client.0.smithi119.stdout:0/701: truncate de/d1c/d52/fae 578970 0 2024-09-13T21:44:51.679 INFO:tasks.workunit.client.1.smithi155.stdout:7/276: getdents d5 0 2024-09-13T21:44:51.681 INFO:tasks.workunit.client.1.smithi155.stdout:9/336: symlink dc/d18/l76 0 2024-09-13T21:44:51.683 INFO:tasks.workunit.client.0.smithi119.stdout:5/691: getdents d0/d3/d4/def/dd6/de4 0 2024-09-13T21:44:51.684 INFO:tasks.workunit.client.0.smithi119.stdout:5/692: write d0/d3/d1f/d21/d4f/d86/fe0 [19961,14852] 0 2024-09-13T21:44:51.685 INFO:tasks.workunit.client.0.smithi119.stdout:3/630: symlink d6/d15/d8f/ld5 0 2024-09-13T21:44:51.686 INFO:tasks.workunit.client.1.smithi155.stdout:7/277: getdents d5/d10/d3e 0 2024-09-13T21:44:51.686 INFO:tasks.workunit.client.0.smithi119.stdout:5/693: dread d0/d3/d1f/f5d [0,4194304] 0 2024-09-13T21:44:51.687 INFO:tasks.workunit.client.0.smithi119.stdout:5/694: chown d0/d3/l13 432642513 1 2024-09-13T21:44:51.687 INFO:tasks.workunit.client.0.smithi119.stdout:1/714: truncate d1/d3/d61/d77/d78/d32/d33/d43/f5e 688647 0 2024-09-13T21:44:51.688 INFO:tasks.workunit.client.1.smithi155.stdout:7/278: creat d5/df/d15/f53 x:0 0 0 2024-09-13T21:44:51.689 INFO:tasks.workunit.client.0.smithi119.stdout:1/715: stat d1/d3/d61/d77/da6/fac 0 2024-09-13T21:44:51.690 INFO:tasks.workunit.client.0.smithi119.stdout:9/949: creat d0/d8/d18/d23/d42/d12f/f14a x:0 0 0 2024-09-13T21:44:51.690 INFO:tasks.workunit.client.1.smithi155.stdout:7/279: symlink d5/d10/d3e/l54 0 2024-09-13T21:44:51.691 INFO:tasks.workunit.client.0.smithi119.stdout:8/725: unlink d1b/d1d/d26/d3e/la9 0 2024-09-13T21:44:51.692 INFO:tasks.workunit.client.1.smithi155.stdout:7/280: mkdir d5/df/d15/d33/d55 0 2024-09-13T21:44:51.693 INFO:tasks.workunit.client.0.smithi119.stdout:6/665: write f9 [833599,10830] 0 2024-09-13T21:44:51.694 INFO:tasks.workunit.client.0.smithi119.stdout:6/666: read - dc/df/d41/fc3 zero size 2024-09-13T21:44:51.696 INFO:tasks.workunit.client.0.smithi119.stdout:3/631: mkdir d6/d15/d1a/d45/d47/d4d/dcf/dd6 0 2024-09-13T21:44:51.698 INFO:tasks.workunit.client.1.smithi155.stdout:2/253: dwrite d2/dd/de/d15/d2e/f36 [0,4194304] 0 2024-09-13T21:44:51.699 INFO:tasks.workunit.client.1.smithi155.stdout:7/281: truncate d5/df/f19 1226829 0 2024-09-13T21:44:51.700 INFO:tasks.workunit.client.0.smithi119.stdout:8/726: truncate d1b/d1d/d48/f78 3475795 0 2024-09-13T21:44:51.701 INFO:tasks.workunit.client.0.smithi119.stdout:7/759: link d8/d3c/d53/d3b/f54 d8/d19/d2e/d34/d6e/ff5 0 2024-09-13T21:44:51.702 INFO:tasks.workunit.client.0.smithi119.stdout:6/667: dwrite dc/df/d32/f6c [4194304,4194304] 0 2024-09-13T21:44:51.703 INFO:tasks.workunit.client.1.smithi155.stdout:2/254: rename d2/dd/de/d15/d2e/l33 to d2/dd/d3d/l5b 0 2024-09-13T21:44:51.706 INFO:tasks.workunit.client.0.smithi119.stdout:5/695: fdatasync d0/d3/d4/d9/f87 0 2024-09-13T21:44:51.707 INFO:tasks.workunit.client.1.smithi155.stdout:7/282: dwrite d5/d13/f14 [0,4194304] 0 2024-09-13T21:44:51.708 INFO:tasks.workunit.client.0.smithi119.stdout:3/632: symlink d6/d15/d1a/d45/d47/d4d/dcf/ld7 0 2024-09-13T21:44:51.709 INFO:tasks.workunit.client.1.smithi155.stdout:7/283: truncate d5/df/f4f 36265 0 2024-09-13T21:44:51.711 INFO:tasks.workunit.client.1.smithi155.stdout:7/284: readlink d5/df/l2b 0 2024-09-13T21:44:51.712 INFO:tasks.workunit.client.0.smithi119.stdout:6/668: dwrite dc/df/d64/f77 [0,4194304] 0 2024-09-13T21:44:51.714 INFO:tasks.workunit.client.0.smithi119.stdout:7/760: write d8/d3c/d53/d37/d83/d89/d3d/fbe [5991181,75955] 0 2024-09-13T21:44:51.716 INFO:tasks.workunit.client.1.smithi155.stdout:7/285: write d5/d10/f2a [395077,121159] 0 2024-09-13T21:44:51.716 INFO:tasks.workunit.client.1.smithi155.stdout:7/286: fsync d5/f3a 0 2024-09-13T21:44:51.717 INFO:tasks.workunit.client.0.smithi119.stdout:1/716: creat d1/d3/d61/d77/d78/d32/dda/d19/d2d/fec x:0 0 0 2024-09-13T21:44:51.718 INFO:tasks.workunit.client.1.smithi155.stdout:2/255: dread d2/db/f27 [0,4194304] 0 2024-09-13T21:44:51.721 INFO:tasks.workunit.client.1.smithi155.stdout:7/287: rename d5/df/c16 to d5/d13/c56 0 2024-09-13T21:44:51.722 INFO:tasks.workunit.client.0.smithi119.stdout:5/696: mkdir d0/d3/d4/def/df1 0 2024-09-13T21:44:51.723 INFO:tasks.workunit.client.0.smithi119.stdout:5/697: readlink d0/d3/d1f/d21/l23 0 2024-09-13T21:44:51.724 INFO:tasks.workunit.client.0.smithi119.stdout:5/698: dread - d0/d3/d4/def/dd6/fe9 zero size 2024-09-13T21:44:51.725 INFO:tasks.workunit.client.0.smithi119.stdout:6/669: mkdir dc/d3d/dcf 0 2024-09-13T21:44:51.727 INFO:tasks.workunit.client.1.smithi155.stdout:7/288: link d5/l26 d5/d10/d48/l57 0 2024-09-13T21:44:51.731 INFO:tasks.workunit.client.0.smithi119.stdout:1/717: symlink d1/d3/d61/d77/d78/d32/dda/d19/led 0 2024-09-13T21:44:51.732 INFO:tasks.workunit.client.0.smithi119.stdout:5/699: dwrite d0/d3/d4/d9/d1e/f9f [0,4194304] 0 2024-09-13T21:44:51.733 INFO:tasks.workunit.client.1.smithi155.stdout:7/289: getdents d5 0 2024-09-13T21:44:51.734 INFO:tasks.workunit.client.0.smithi119.stdout:7/761: creat d8/d3c/d53/ff6 x:0 0 0 2024-09-13T21:44:51.735 INFO:tasks.workunit.client.0.smithi119.stdout:7/762: stat d8/d19/f25 0 2024-09-13T21:44:51.738 INFO:tasks.workunit.client.1.smithi155.stdout:7/290: creat d5/df/f58 x:0 0 0 2024-09-13T21:44:51.740 INFO:tasks.workunit.client.1.smithi155.stdout:7/291: truncate d5/df/f58 894460 0 2024-09-13T21:44:51.741 INFO:tasks.workunit.client.0.smithi119.stdout:7/763: creat d8/d19/dd7/df1/ff7 x:0 0 0 2024-09-13T21:44:51.744 INFO:tasks.workunit.client.1.smithi155.stdout:7/292: rmdir d5/df/d45 0 2024-09-13T21:44:51.745 INFO:tasks.workunit.client.0.smithi119.stdout:7/764: getdents d8/d4d/da2 0 2024-09-13T21:44:51.745 INFO:tasks.workunit.client.1.smithi155.stdout:7/293: chown d5/df/d15/f1f 39 1 2024-09-13T21:44:51.746 INFO:tasks.workunit.client.1.smithi155.stdout:7/294: write d5/d3b/f4b [966214,60310] 0 2024-09-13T21:44:51.749 INFO:tasks.workunit.client.1.smithi155.stdout:7/295: dread d5/df/f4f [0,4194304] 0 2024-09-13T21:44:51.749 INFO:tasks.workunit.client.1.smithi155.stdout:7/296: chown f3 7342618 1 2024-09-13T21:44:51.750 INFO:tasks.workunit.client.1.smithi155.stdout:7/297: read d5/df/f58 [550539,11552] 0 2024-09-13T21:44:51.754 INFO:tasks.workunit.client.1.smithi155.stdout:7/298: dread d5/d10/f2a [0,4194304] 0 2024-09-13T21:44:51.755 INFO:tasks.workunit.client.0.smithi119.stdout:3/633: rename d6/d15/d1a/d45/d47/f84 to d6/d15/d1a/d45/d47/d4d/da7/fd8 0 2024-09-13T21:44:51.758 INFO:tasks.workunit.client.0.smithi119.stdout:3/634: symlink d6/d15/d1a/d45/d47/d4d/da7/ld9 0 2024-09-13T21:44:51.760 INFO:tasks.workunit.client.0.smithi119.stdout:3/635: mkdir d6/d15/d1a/d45/d47/d4d/dcf/dda 0 2024-09-13T21:44:51.764 INFO:tasks.workunit.client.0.smithi119.stdout:3/636: read d6/d15/f3f [3021312,121306] 0 2024-09-13T21:44:51.766 INFO:tasks.workunit.client.0.smithi119.stdout:3/637: write d6/d15/d1a/f3a [4206788,34485] 0 2024-09-13T21:44:51.767 INFO:tasks.workunit.client.0.smithi119.stdout:3/638: read d6/d15/d1a/f41 [284740,60482] 0 2024-09-13T21:44:51.769 INFO:tasks.workunit.client.0.smithi119.stdout:3/639: chown d6/d15/d1a/d45/d47/d4d/da7/cca 288580 1 2024-09-13T21:44:51.771 INFO:tasks.workunit.client.0.smithi119.stdout:3/640: fsync d6/f11 0 2024-09-13T21:44:51.772 INFO:tasks.workunit.client.0.smithi119.stdout:3/641: chown d6/d15/d8f/cba 47 1 2024-09-13T21:44:51.773 INFO:tasks.workunit.client.1.smithi155.stdout:7/299: dwrite d5/df/f19 [0,4194304] 0 2024-09-13T21:44:51.774 INFO:tasks.workunit.client.1.smithi155.stdout:7/300: write d5/f30 [293627,30955] 0 2024-09-13T21:44:51.775 INFO:tasks.workunit.client.0.smithi119.stdout:3/642: rename d6/d15/d1a/f3c to d6/d15/da9/fdb 0 2024-09-13T21:44:51.777 INFO:tasks.workunit.client.1.smithi155.stdout:7/301: getdents d5/df/d15/d33/d55 0 2024-09-13T21:44:51.779 INFO:tasks.workunit.client.1.smithi155.stdout:7/302: truncate d5/fe 1273162 0 2024-09-13T21:44:51.780 INFO:tasks.workunit.client.1.smithi155.stdout:7/303: read d5/df/f58 [824743,129991] 0 2024-09-13T21:44:51.782 INFO:tasks.workunit.client.1.smithi155.stdout:7/304: getdents d5/d10 0 2024-09-13T21:44:51.782 INFO:tasks.workunit.client.0.smithi119.stdout:3/643: rename d6/d15/d8f/cba to d6/cdc 0 2024-09-13T21:44:51.784 INFO:tasks.workunit.client.0.smithi119.stdout:3/644: write d6/d25/d2f/d33/d56/da0/fb0 [393982,58349] 0 2024-09-13T21:44:51.784 INFO:tasks.workunit.client.0.smithi119.stdout:3/645: chown d6/c6a 357 1 2024-09-13T21:44:51.785 INFO:tasks.workunit.client.0.smithi119.stdout:2/675: unlink d1/lab 0 2024-09-13T21:44:51.786 INFO:tasks.workunit.client.0.smithi119.stdout:8/727: rmdir d1b/d1d/d5e 39 2024-09-13T21:44:51.787 INFO:tasks.workunit.client.1.smithi155.stdout:6/371: sync 2024-09-13T21:44:51.787 INFO:tasks.workunit.client.0.smithi119.stdout:2/676: read d1/d22/f4c [302681,38816] 0 2024-09-13T21:44:51.788 INFO:tasks.workunit.client.1.smithi155.stdout:7/305: dwrite d5/d10/d3e/d3f/f4a [0,4194304] 0 2024-09-13T21:44:51.788 INFO:tasks.workunit.client.0.smithi119.stdout:5/700: truncate d0/d3/d4/d9/d14/d24/f6e 725469 0 2024-09-13T21:44:51.789 INFO:tasks.workunit.client.0.smithi119.stdout:3/646: symlink d6/d15/d8f/dbb/ldd 0 2024-09-13T21:44:51.790 INFO:tasks.workunit.client.1.smithi155.stdout:6/372: rmdir db/d12/d1c/d36/d37 39 2024-09-13T21:44:51.790 INFO:tasks.workunit.client.0.smithi119.stdout:8/728: symlink d1b/d1d/d26/d3e/lde 0 2024-09-13T21:44:51.793 INFO:tasks.workunit.client.0.smithi119.stdout:5/701: creat d0/dab/ff2 x:0 0 0 2024-09-13T21:44:51.793 INFO:tasks.workunit.client.1.smithi155.stdout:7/306: dwrite d5/df/f19 [0,4194304] 0 2024-09-13T21:44:51.795 INFO:tasks.workunit.client.0.smithi119.stdout:2/677: dwrite d1/d22/d55/d31/fa0 [0,4194304] 0 2024-09-13T21:44:51.799 INFO:tasks.workunit.client.0.smithi119.stdout:3/647: chown d6/d15/d1a/cbf 8356459 1 2024-09-13T21:44:51.801 INFO:tasks.workunit.client.1.smithi155.stdout:7/307: dwrite d5/d13/f21 [4194304,4194304] 0 2024-09-13T21:44:51.803 INFO:tasks.workunit.client.0.smithi119.stdout:5/702: rename d0/d3/d1f/d21/f62 to d0/d3/d4/d9/d14/ff3 0 2024-09-13T21:44:51.804 INFO:tasks.workunit.client.0.smithi119.stdout:8/729: rename d1b/d1d/d48/d54/fcc to d1b/d1d/d48/d54/fdf 0 2024-09-13T21:44:51.805 INFO:tasks.workunit.client.1.smithi155.stdout:7/308: creat d5/d3b/f59 x:0 0 0 2024-09-13T21:44:51.807 INFO:tasks.workunit.client.0.smithi119.stdout:3/648: creat d6/d15/d1a/d45/d8d/fde x:0 0 0 2024-09-13T21:44:51.809 INFO:tasks.workunit.client.0.smithi119.stdout:7/765: dwrite d8/d19/f25 [0,4194304] 0 2024-09-13T21:44:51.811 INFO:tasks.workunit.client.0.smithi119.stdout:3/649: readlink d6/d15/d8f/dbb/ldd 0 2024-09-13T21:44:51.811 INFO:tasks.workunit.client.0.smithi119.stdout:1/718: symlink d1/d3/lee 0 2024-09-13T21:44:51.811 INFO:tasks.workunit.client.0.smithi119.stdout:7/766: fdatasync d8/d19/f1a 0 2024-09-13T21:44:51.813 INFO:tasks.workunit.client.1.smithi155.stdout:6/373: dwrite db/d12/d1c/d36/d46/f48 [0,4194304] 0 2024-09-13T21:44:51.813 INFO:tasks.workunit.client.0.smithi119.stdout:5/703: read d0/d3/fc [3685050,43647] 0 2024-09-13T21:44:51.814 INFO:tasks.workunit.client.0.smithi119.stdout:5/704: fsync d0/d3/d4/fea 0 2024-09-13T21:44:51.816 INFO:tasks.workunit.client.0.smithi119.stdout:8/730: mkdir d1b/d1d/d48/d54/de0 0 2024-09-13T21:44:51.817 INFO:tasks.workunit.client.1.smithi155.stdout:6/374: fdatasync db/f1f 0 2024-09-13T21:44:51.818 INFO:tasks.workunit.client.1.smithi155.stdout:7/309: link d5/d10/c34 d5/df/c5a 0 2024-09-13T21:44:51.820 INFO:tasks.workunit.client.0.smithi119.stdout:7/767: chown d8/d3c/d46/f5a 0 1 2024-09-13T21:44:51.820 INFO:tasks.workunit.client.1.smithi155.stdout:6/375: creat db/d11/d6d/f6f x:0 0 0 2024-09-13T21:44:51.822 INFO:tasks.workunit.client.1.smithi155.stdout:6/376: read - db/d11/d6d/f6f zero size 2024-09-13T21:44:51.823 INFO:tasks.workunit.client.0.smithi119.stdout:8/731: chown d1b/d1d/d5e/l85 240 1 2024-09-13T21:44:51.825 INFO:tasks.workunit.client.1.smithi155.stdout:7/310: dwrite d5/d3b/f42 [0,4194304] 0 2024-09-13T21:44:51.828 INFO:tasks.workunit.client.1.smithi155.stdout:7/311: creat d5/df/d15/f5b x:0 0 0 2024-09-13T21:44:51.828 INFO:tasks.workunit.client.0.smithi119.stdout:1/719: creat d1/d3/dc/d24/fef x:0 0 0 2024-09-13T21:44:51.829 INFO:tasks.workunit.client.1.smithi155.stdout:7/312: write d5/fa [1804463,3521] 0 2024-09-13T21:44:51.829 INFO:tasks.workunit.client.0.smithi119.stdout:3/650: link d6/d15/d1a/d45/d47/l4b d6/d44/d52/d85/ldf 0 2024-09-13T21:44:51.831 INFO:tasks.workunit.client.0.smithi119.stdout:7/768: creat d8/d3c/d53/d37/d95/ff8 x:0 0 0 2024-09-13T21:44:51.831 INFO:tasks.workunit.client.1.smithi155.stdout:7/313: mknod d5/df/d15/d33/d43/d4e/c5c 0 2024-09-13T21:44:51.832 INFO:tasks.workunit.client.1.smithi155.stdout:7/314: write d5/d10/d3e/d3f/f4a [1807199,129680] 0 2024-09-13T21:44:51.832 INFO:tasks.workunit.client.0.smithi119.stdout:7/769: write d8/d19/d2e/f7c [1263728,19131] 0 2024-09-13T21:44:51.834 INFO:tasks.workunit.client.0.smithi119.stdout:1/720: symlink d1/d3/d6c/lf0 0 2024-09-13T21:44:51.835 INFO:tasks.workunit.client.1.smithi155.stdout:7/315: creat d5/df/d15/d33/d43/d4e/f5d x:0 0 0 2024-09-13T21:44:51.836 INFO:tasks.workunit.client.0.smithi119.stdout:7/770: mknod d8/d3c/d53/d37/d83/cf9 0 2024-09-13T21:44:51.838 INFO:tasks.workunit.client.0.smithi119.stdout:3/651: creat d6/d25/d2f/d33/d56/fe0 x:0 0 0 2024-09-13T21:44:51.839 INFO:tasks.workunit.client.0.smithi119.stdout:1/721: mkdir d1/d3/d61/d77/d78/db8/dde/df1 0 2024-09-13T21:44:51.840 INFO:tasks.workunit.client.1.smithi155.stdout:7/316: dwrite d5/fb [0,4194304] 0 2024-09-13T21:44:51.843 INFO:tasks.workunit.client.1.smithi155.stdout:7/317: truncate d5/d10/f2a 333811 0 2024-09-13T21:44:51.843 INFO:tasks.workunit.client.0.smithi119.stdout:1/722: creat d1/d3/d61/d77/d78/d32/d33/d72/ff2 x:0 0 0 2024-09-13T21:44:51.844 INFO:tasks.workunit.client.0.smithi119.stdout:1/723: readlink d1/d3/d61/d77/d78/d32/d33/d72/db4/lc7 0 2024-09-13T21:44:51.845 INFO:tasks.workunit.client.1.smithi155.stdout:7/318: creat d5/df/d15/d33/d55/f5e x:0 0 0 2024-09-13T21:44:51.846 INFO:tasks.workunit.client.1.smithi155.stdout:7/319: readlink d5/l26 0 2024-09-13T21:44:51.846 INFO:tasks.workunit.client.1.smithi155.stdout:7/320: readlink d5/df/d15/l25 0 2024-09-13T21:44:51.847 INFO:tasks.workunit.client.1.smithi155.stdout:7/321: chown d5/d10/d3e/l54 88 1 2024-09-13T21:44:51.848 INFO:tasks.workunit.client.0.smithi119.stdout:1/724: mknod d1/d3/d61/d77/d78/d32/d33/d72/db4/dc9/cf3 0 2024-09-13T21:44:51.849 INFO:tasks.workunit.client.1.smithi155.stdout:7/322: mkdir d5/d13/d5f 0 2024-09-13T21:44:51.852 INFO:tasks.workunit.client.1.smithi155.stdout:7/323: unlink d5/fe 0 2024-09-13T21:44:51.853 INFO:tasks.workunit.client.1.smithi155.stdout:7/324: chown d5/d10/f18 5400 1 2024-09-13T21:44:51.857 INFO:tasks.workunit.client.1.smithi155.stdout:7/325: dread d5/d3b/f4b [0,4194304] 0 2024-09-13T21:44:51.859 INFO:tasks.workunit.client.1.smithi155.stdout:7/326: mkdir d5/df/d60 0 2024-09-13T21:44:51.859 INFO:tasks.workunit.client.0.smithi119.stdout:8/732: truncate d1b/d1d/d48/d58/f74 1227204 0 2024-09-13T21:44:51.862 INFO:tasks.workunit.client.0.smithi119.stdout:7/771: write d8/d3c/d53/d6b/f72 [1072470,33082] 0 2024-09-13T21:44:51.862 INFO:tasks.workunit.client.0.smithi119.stdout:3/652: write d6/d15/d1a/d45/d47/d4d/f82 [440810,34934] 0 2024-09-13T21:44:51.865 INFO:tasks.workunit.client.1.smithi155.stdout:7/327: dwrite d5/df/d15/f1f [0,4194304] 0 2024-09-13T21:44:51.866 INFO:tasks.workunit.client.0.smithi119.stdout:1/725: truncate d1/d3/d61/d77/d78/d32/dda/d19/d2d/f51 3764478 0 2024-09-13T21:44:51.867 INFO:tasks.workunit.client.1.smithi155.stdout:7/328: truncate d5/df/d15/d33/d43/d4e/f5d 268094 0 2024-09-13T21:44:51.868 INFO:tasks.workunit.client.0.smithi119.stdout:7/772: creat d8/d3c/d46/ffa x:0 0 0 2024-09-13T21:44:51.869 INFO:tasks.workunit.client.0.smithi119.stdout:8/733: dwrite d1b/d1d/d48/f90 [4194304,4194304] 0 2024-09-13T21:44:51.870 INFO:tasks.workunit.client.1.smithi155.stdout:7/329: rmdir d5 39 2024-09-13T21:44:51.877 INFO:tasks.workunit.client.1.smithi155.stdout:7/330: dwrite d5/d13/f21 [8388608,4194304] 0 2024-09-13T21:44:51.878 INFO:tasks.workunit.client.0.smithi119.stdout:5/705: dread d0/d3/d4/d9/f10 [0,4194304] 0 2024-09-13T21:44:51.879 INFO:tasks.workunit.client.0.smithi119.stdout:8/734: mkdir d1b/d1d/dc3/de1 0 2024-09-13T21:44:51.881 INFO:tasks.workunit.client.0.smithi119.stdout:3/653: dwrite d6/d15/d1a/d45/f67 [0,4194304] 0 2024-09-13T21:44:51.883 INFO:tasks.workunit.client.1.smithi155.stdout:7/331: getdents d5/df/d15/d33/d43/d4e 0 2024-09-13T21:44:51.884 INFO:tasks.workunit.client.0.smithi119.stdout:8/735: write d1b/d1d/d26/d6b/fb3 [8985085,10491] 0 2024-09-13T21:44:51.885 INFO:tasks.workunit.client.1.smithi155.stdout:7/332: mkdir d5/d10/d3e/d3f/d61 0 2024-09-13T21:44:51.886 INFO:tasks.workunit.client.0.smithi119.stdout:7/773: dwrite d8/d3c/d53/d37/d95/ff8 [0,4194304] 0 2024-09-13T21:44:51.889 INFO:tasks.workunit.client.0.smithi119.stdout:1/726: getdents d1/d3/d61/d77/d78/d32/d33/d72/db4/dc9 0 2024-09-13T21:44:51.889 INFO:tasks.workunit.client.1.smithi155.stdout:7/333: truncate d5/d10/f2a 141435 0 2024-09-13T21:44:51.892 INFO:tasks.workunit.client.0.smithi119.stdout:7/774: creat d8/d3c/d53/d6b/ffb x:0 0 0 2024-09-13T21:44:51.897 INFO:tasks.workunit.client.0.smithi119.stdout:1/727: mkdir d1/d3/d61/d77/d78/d32/d33/d72/db4/dc9/df4 0 2024-09-13T21:44:51.900 INFO:tasks.workunit.client.0.smithi119.stdout:8/736: dwrite d1b/d1d/d26/fa8 [0,4194304] 0 2024-09-13T21:44:51.902 INFO:tasks.workunit.client.1.smithi155.stdout:7/334: write f3 [5220940,31786] 0 2024-09-13T21:44:51.904 INFO:tasks.workunit.client.1.smithi155.stdout:7/335: mknod d5/d10/d3e/c62 0 2024-09-13T21:44:51.904 INFO:tasks.workunit.client.0.smithi119.stdout:5/706: truncate d0/d3/d1f/d21/fa9 3304685 0 2024-09-13T21:44:51.907 INFO:tasks.workunit.client.1.smithi155.stdout:7/336: link d5/df/f1a d5/df/d60/f63 0 2024-09-13T21:44:51.907 INFO:tasks.workunit.client.1.smithi155.stdout:7/337: dread - d5/d10/d3e/d40/f44 zero size 2024-09-13T21:44:51.909 INFO:tasks.workunit.client.1.smithi155.stdout:7/338: creat d5/df/d15/d33/d43/f64 x:0 0 0 2024-09-13T21:44:51.913 INFO:tasks.workunit.client.0.smithi119.stdout:1/728: dwrite d1/d3/d61/d77/d78/d32/dda/d19/d2d/fae [0,4194304] 0 2024-09-13T21:44:51.913 INFO:tasks.workunit.client.1.smithi155.stdout:6/377: dread db/d12/f17 [4194304,4194304] 0 2024-09-13T21:44:51.915 INFO:tasks.workunit.client.0.smithi119.stdout:3/654: dwrite d6/d15/d1a/d45/f9e [0,4194304] 0 2024-09-13T21:44:51.915 INFO:tasks.workunit.client.0.smithi119.stdout:5/707: link d0/l60 d0/d3/lf4 0 2024-09-13T21:44:51.917 INFO:tasks.workunit.client.1.smithi155.stdout:6/378: rmdir db/d11/d1e/d21 39 2024-09-13T21:44:51.919 INFO:tasks.workunit.client.0.smithi119.stdout:5/708: mknod d0/d3/d4/d9/d1e/da5/cf5 0 2024-09-13T21:44:51.923 INFO:tasks.workunit.client.1.smithi155.stdout:6/379: dread db/d11/d1e/f2e [0,4194304] 0 2024-09-13T21:44:51.923 INFO:tasks.workunit.client.0.smithi119.stdout:7/775: dread d8/d3c/d53/d37/d57/f6c [0,4194304] 0 2024-09-13T21:44:51.924 INFO:tasks.workunit.client.0.smithi119.stdout:1/729: dwrite d1/d3/d61/d77/d78/f9c [0,4194304] 0 2024-09-13T21:44:51.926 INFO:tasks.workunit.client.0.smithi119.stdout:7/776: stat d8/d3c/d53/d3b/d48/f49 0 2024-09-13T21:44:51.926 INFO:tasks.workunit.client.0.smithi119.stdout:3/655: creat d6/d15/d1a/d45/d47/d4d/dcf/dd0/fe1 x:0 0 0 2024-09-13T21:44:51.926 INFO:tasks.workunit.client.1.smithi155.stdout:6/380: mknod db/d12/d1c/d36/d46/c70 0 2024-09-13T21:44:51.927 INFO:tasks.workunit.client.0.smithi119.stdout:5/709: mkdir d0/d3/d4/d2e/d65/df6 0 2024-09-13T21:44:51.928 INFO:tasks.workunit.client.0.smithi119.stdout:1/730: rmdir d1/d3 39 2024-09-13T21:44:51.928 INFO:tasks.workunit.client.0.smithi119.stdout:5/710: chown d0/d3/c59 120 1 2024-09-13T21:44:51.930 INFO:tasks.workunit.client.0.smithi119.stdout:3/656: mkdir d6/d25/d2f/d8e/de2 0 2024-09-13T21:44:51.930 INFO:tasks.workunit.client.0.smithi119.stdout:5/711: write d0/d3/d1f/d21/d4f/fbd [881318,103915] 0 2024-09-13T21:44:51.931 INFO:tasks.workunit.client.0.smithi119.stdout:7/777: creat d8/d3c/d46/db1/dc8/ffc x:0 0 0 2024-09-13T21:44:51.932 INFO:tasks.workunit.client.0.smithi119.stdout:5/712: write d0/f88 [5105250,21884] 0 2024-09-13T21:44:51.933 INFO:tasks.workunit.client.1.smithi155.stdout:6/381: link db/d11/d2b/l33 db/d3d/d5f/l71 0 2024-09-13T21:44:51.935 INFO:tasks.workunit.client.0.smithi119.stdout:3/657: read - d6/d25/f91 zero size 2024-09-13T21:44:51.936 INFO:tasks.workunit.client.0.smithi119.stdout:5/713: fdatasync d0/d3/d4/d9/d14/d24/f5a 0 2024-09-13T21:44:51.938 INFO:tasks.workunit.client.1.smithi155.stdout:1/304: sync 2024-09-13T21:44:51.938 INFO:tasks.workunit.client.1.smithi155.stdout:3/387: sync 2024-09-13T21:44:51.939 INFO:tasks.workunit.client.1.smithi155.stdout:6/382: dwrite db/d2c/f3b [0,4194304] 0 2024-09-13T21:44:51.939 INFO:tasks.workunit.client.0.smithi119.stdout:3/658: write d6/d25/d2f/d33/d56/f93 [1039835,62400] 0 2024-09-13T21:44:51.941 INFO:tasks.workunit.client.1.smithi155.stdout:3/388: write d3/d25/d1b/d1f/d36/f5d [2040683,112906] 0 2024-09-13T21:44:51.942 INFO:tasks.workunit.client.1.smithi155.stdout:1/305: creat d6/d15/d23/d55/f6f x:0 0 0 2024-09-13T21:44:51.943 INFO:tasks.workunit.client.0.smithi119.stdout:7/778: dwrite d8/d3c/d46/fdb [0,4194304] 0 2024-09-13T21:44:51.943 INFO:tasks.workunit.client.1.smithi155.stdout:3/389: read d3/d25/d17/d3b/f50 [224518,27528] 0 2024-09-13T21:44:51.944 INFO:tasks.workunit.client.1.smithi155.stdout:1/306: stat d6/d15/d57/d5d 0 2024-09-13T21:44:51.945 INFO:tasks.workunit.client.1.smithi155.stdout:6/383: creat db/d11/d2b/f72 x:0 0 0 2024-09-13T21:44:51.945 INFO:tasks.workunit.client.1.smithi155.stdout:1/307: chown d6/d15/d3e/d17 89 1 2024-09-13T21:44:51.946 INFO:tasks.workunit.client.0.smithi119.stdout:5/714: creat d0/d3/d4/d9/d14/d24/ff7 x:0 0 0 2024-09-13T21:44:51.946 INFO:tasks.workunit.client.1.smithi155.stdout:6/384: chown db/d11/l31 5403729 1 2024-09-13T21:44:51.947 INFO:tasks.workunit.client.1.smithi155.stdout:1/308: creat d6/d15/d23/d55/f70 x:0 0 0 2024-09-13T21:44:51.948 INFO:tasks.workunit.client.0.smithi119.stdout:1/731: rename d1/d3/d61/d77/d78/d32/dda/d19/d2d/f44 to d1/d3/d61/d7e/d53/ddf/ff5 0 2024-09-13T21:44:51.951 INFO:tasks.workunit.client.0.smithi119.stdout:5/715: write d0/d3/d4/d9/d1e/f9f [1699580,117071] 0 2024-09-13T21:44:51.951 INFO:tasks.workunit.client.1.smithi155.stdout:6/385: mkdir db/d12/d1c/d36/d37/d73 0 2024-09-13T21:44:51.952 INFO:tasks.workunit.client.1.smithi155.stdout:6/386: chown db/d11/d6d/f6f 2411256 1 2024-09-13T21:44:51.953 INFO:tasks.workunit.client.0.smithi119.stdout:3/659: mkdir d6/d15/d1a/d45/d47/de3 0 2024-09-13T21:44:51.953 INFO:tasks.workunit.client.1.smithi155.stdout:1/309: rename d6/fa to d6/d15/d3e/d17/f71 0 2024-09-13T21:44:51.954 INFO:tasks.workunit.client.1.smithi155.stdout:1/310: fsync d6/d15/f37 0 2024-09-13T21:44:51.955 INFO:tasks.workunit.client.1.smithi155.stdout:6/387: mkdir db/d11/d74 0 2024-09-13T21:44:51.956 INFO:tasks.workunit.client.0.smithi119.stdout:7/779: mkdir d8/d3c/d53/d37/d57/d8f/dfd 0 2024-09-13T21:44:51.956 INFO:tasks.workunit.client.1.smithi155.stdout:6/388: chown db/d11/d2b/d35/c5c 24 1 2024-09-13T21:44:51.956 INFO:tasks.workunit.client.1.smithi155.stdout:1/311: mkdir d6/d15/d57/d5d/d72 0 2024-09-13T21:44:51.957 INFO:tasks.workunit.client.0.smithi119.stdout:5/716: mkdir d0/d3/d1f/d21/d4f/df8 0 2024-09-13T21:44:51.958 INFO:tasks.workunit.client.0.smithi119.stdout:1/732: unlink d1/d3/d61/d77/d78/d32/dda/f3c 0 2024-09-13T21:44:51.959 INFO:tasks.workunit.client.1.smithi155.stdout:6/389: mknod db/d11/d2b/d35/c75 0 2024-09-13T21:44:51.959 INFO:tasks.workunit.client.0.smithi119.stdout:3/660: rmdir d6/d44/d52 39 2024-09-13T21:44:51.959 INFO:tasks.workunit.client.1.smithi155.stdout:6/390: chown db/d12/d1c/c45 7534 1 2024-09-13T21:44:51.961 INFO:tasks.workunit.client.0.smithi119.stdout:1/733: fdatasync d1/d3/d61/d77/d78/d32/dda/f17 0 2024-09-13T21:44:51.961 INFO:tasks.workunit.client.0.smithi119.stdout:7/780: rmdir d8/d3c/d46 39 2024-09-13T21:44:51.961 INFO:tasks.workunit.client.1.smithi155.stdout:6/391: unlink db/l34 0 2024-09-13T21:44:51.962 INFO:tasks.workunit.client.0.smithi119.stdout:7/781: chown d8/d9d/la8 0 1 2024-09-13T21:44:51.963 INFO:tasks.workunit.client.1.smithi155.stdout:6/392: mknod db/d12/d1c/d36/c76 0 2024-09-13T21:44:51.964 INFO:tasks.workunit.client.1.smithi155.stdout:6/393: chown db/d11/d1e/f3e 265014 1 2024-09-13T21:44:51.965 INFO:tasks.workunit.client.0.smithi119.stdout:1/734: mknod d1/d3/d61/d77/d78/db8/dde/df1/cf6 0 2024-09-13T21:44:51.965 INFO:tasks.workunit.client.0.smithi119.stdout:5/717: dwrite d0/d3/d4/d9/d14/d24/d25/fb7 [0,4194304] 0 2024-09-13T21:44:51.967 INFO:tasks.workunit.client.1.smithi155.stdout:3/390: dread d3/d25/fb [0,4194304] 0 2024-09-13T21:44:51.970 INFO:tasks.workunit.client.1.smithi155.stdout:6/394: dwrite db/d2c/f3b [0,4194304] 0 2024-09-13T21:44:51.972 INFO:tasks.workunit.client.1.smithi155.stdout:1/312: write d6/d15/d3e/d17/f2a [2868805,70086] 0 2024-09-13T21:44:51.972 INFO:tasks.workunit.client.1.smithi155.stdout:3/391: rename d3/d21/f65 to d3/d25/d1b/d1f/d36/d5c/d66/f88 0 2024-09-13T21:44:51.973 INFO:tasks.workunit.client.1.smithi155.stdout:6/395: creat db/d11/d4c/d64/f77 x:0 0 0 2024-09-13T21:44:51.981 INFO:tasks.workunit.client.1.smithi155.stdout:1/313: dwrite d6/f32 [0,4194304] 0 2024-09-13T21:44:51.982 INFO:tasks.workunit.client.1.smithi155.stdout:6/396: truncate db/d11/d1e/f2e 938597 0 2024-09-13T21:44:51.983 INFO:tasks.workunit.client.1.smithi155.stdout:6/397: chown db/d11/d2b/d35/c75 4 1 2024-09-13T21:44:51.984 INFO:tasks.workunit.client.1.smithi155.stdout:1/314: fsync d6/d15/f4e 0 2024-09-13T21:44:51.987 INFO:tasks.workunit.client.1.smithi155.stdout:6/398: creat db/d11/d5b/f78 x:0 0 0 2024-09-13T21:44:51.988 INFO:tasks.workunit.client.1.smithi155.stdout:1/315: unlink d6/f36 0 2024-09-13T21:44:51.989 INFO:tasks.workunit.client.0.smithi119.stdout:4/732: sync 2024-09-13T21:44:51.990 INFO:tasks.workunit.client.1.smithi155.stdout:1/316: write d6/d15/d3e/d17/d30/f5b [3689356,69346] 0 2024-09-13T21:44:51.992 INFO:tasks.workunit.client.0.smithi119.stdout:5/718: read d0/d3/d4/d2e/d65/fca [2893072,88576] 0 2024-09-13T21:44:51.993 INFO:tasks.workunit.client.1.smithi155.stdout:1/317: rmdir d6/d15/d57/d5d 39 2024-09-13T21:44:51.995 INFO:tasks.workunit.client.1.smithi155.stdout:3/392: dread d3/d25/d1b/d1f/d36/f6c [0,4194304] 0 2024-09-13T21:44:51.995 INFO:tasks.workunit.client.0.smithi119.stdout:7/782: creat d8/d3c/d53/d37/d83/d89/dc3/ffe x:0 0 0 2024-09-13T21:44:51.996 INFO:tasks.workunit.client.1.smithi155.stdout:3/393: dread - d3/f72 zero size 2024-09-13T21:44:51.996 INFO:tasks.workunit.client.1.smithi155.stdout:1/318: mknod d6/d15/d3e/d17/c73 0 2024-09-13T21:44:51.997 INFO:tasks.workunit.client.1.smithi155.stdout:3/394: stat d3/d25/d1b/l55 0 2024-09-13T21:44:51.997 INFO:tasks.workunit.client.0.smithi119.stdout:7/783: chown d8/d4d/fcd 114329 1 2024-09-13T21:44:51.998 INFO:tasks.workunit.client.0.smithi119.stdout:1/735: creat d1/d3/d61/d77/d78/db8/dde/ff7 x:0 0 0 2024-09-13T21:44:51.999 INFO:tasks.workunit.client.0.smithi119.stdout:1/736: chown d1/d3/fd6 822159751 1 2024-09-13T21:44:51.999 INFO:tasks.workunit.client.0.smithi119.stdout:7/784: dread d8/d3c/d53/d37/d57/f6c [0,4194304] 0 2024-09-13T21:44:52.000 INFO:tasks.workunit.client.0.smithi119.stdout:4/733: mknod d4/d1e/d28/d34/d6a/d79/dae/ced 0 2024-09-13T21:44:52.000 INFO:tasks.workunit.client.1.smithi155.stdout:3/395: creat d3/d25/d17/f89 x:0 0 0 2024-09-13T21:44:52.001 INFO:tasks.workunit.client.0.smithi119.stdout:5/719: mknod d0/d3/d4/d9/cf9 0 2024-09-13T21:44:52.001 INFO:tasks.workunit.client.0.smithi119.stdout:4/734: chown d4/d1e/d26/d60/d69/fa9 58353 1 2024-09-13T21:44:52.002 INFO:tasks.workunit.client.1.smithi155.stdout:1/319: mkdir d6/d15/d57/d5d/d72/d74 0 2024-09-13T21:44:52.002 INFO:tasks.workunit.client.1.smithi155.stdout:1/320: fdatasync d6/d7/f40 0 2024-09-13T21:44:52.004 INFO:tasks.workunit.client.1.smithi155.stdout:3/396: creat d3/d25/d1b/d1f/d82/d83/f8a x:0 0 0 2024-09-13T21:44:52.005 INFO:tasks.workunit.client.0.smithi119.stdout:1/737: truncate d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9d/fca 878856 0 2024-09-13T21:44:52.006 INFO:tasks.workunit.client.0.smithi119.stdout:7/785: creat d8/d19/d2e/fff x:0 0 0 2024-09-13T21:44:52.008 INFO:tasks.workunit.client.1.smithi155.stdout:3/397: symlink d3/d25/d1b/d1f/d36/d5c/l8b 0 2024-09-13T21:44:52.009 INFO:tasks.workunit.client.0.smithi119.stdout:1/738: chown d1/d3/d61/d77/d78/d32/de3 864 1 2024-09-13T21:44:52.012 INFO:tasks.workunit.client.0.smithi119.stdout:7/786: truncate d8/d3c/d53/d37/d57/d5f/fd1 1043757 0 2024-09-13T21:44:52.012 INFO:tasks.workunit.client.0.smithi119.stdout:5/720: dwrite d0/d3/d4/d2e/d65/fb2 [0,4194304] 0 2024-09-13T21:44:52.013 INFO:tasks.workunit.client.1.smithi155.stdout:1/321: dwrite d6/d7/f8 [0,4194304] 0 2024-09-13T21:44:52.014 INFO:tasks.workunit.client.0.smithi119.stdout:1/739: chown d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/dd8/ca1 35858295 1 2024-09-13T21:44:52.014 INFO:tasks.workunit.client.0.smithi119.stdout:7/787: stat d8/d3c/d53/d37/d83/d89/d47/f65 0 2024-09-13T21:44:52.015 INFO:tasks.workunit.client.0.smithi119.stdout:5/721: creat d0/d3/d4/d9/d74/ffa x:0 0 0 2024-09-13T21:44:52.015 INFO:tasks.workunit.client.1.smithi155.stdout:1/322: write d6/d15/f58 [4991093,29397] 0 2024-09-13T21:44:52.016 INFO:tasks.workunit.client.1.smithi155.stdout:3/398: dwrite d3/d25/d17/f27 [0,4194304] 0 2024-09-13T21:44:52.016 INFO:tasks.workunit.client.0.smithi119.stdout:3/661: dread d6/f14 [0,4194304] 0 2024-09-13T21:44:52.017 INFO:tasks.workunit.client.0.smithi119.stdout:3/662: rmdir d6/d15 39 2024-09-13T21:44:52.018 INFO:tasks.workunit.client.0.smithi119.stdout:7/788: truncate d8/d3c/d53/d37/d83/d89/fc4 1556 0 2024-09-13T21:44:52.020 INFO:tasks.workunit.client.0.smithi119.stdout:3/663: chown d6/d15/l7b 1 1 2024-09-13T21:44:52.022 INFO:tasks.workunit.client.0.smithi119.stdout:3/664: write d6/d15/d1a/d45/d8d/fde [286152,67085] 0 2024-09-13T21:44:52.023 INFO:tasks.workunit.client.0.smithi119.stdout:5/722: rename d0/d3/d4/d9/d1e/da5/db9 to d0/d3/d1f/d21/da1/dfb 0 2024-09-13T21:44:52.024 INFO:tasks.workunit.client.1.smithi155.stdout:3/399: write d3/d25/f1c [5450749,23634] 0 2024-09-13T21:44:52.025 INFO:tasks.workunit.client.1.smithi155.stdout:3/400: stat d3/d25/d17/d52 0 2024-09-13T21:44:52.026 INFO:tasks.workunit.client.0.smithi119.stdout:3/665: symlink d6/d15/d1a/d45/d47/d4d/le4 0 2024-09-13T21:44:52.027 INFO:tasks.workunit.client.1.smithi155.stdout:6/399: dread db/d11/d2b/d35/f29 [0,4194304] 0 2024-09-13T21:44:52.027 INFO:tasks.workunit.client.0.smithi119.stdout:5/723: getdents d0/d3/d4/def/df1 0 2024-09-13T21:44:52.029 INFO:tasks.workunit.client.0.smithi119.stdout:5/724: write d0/d3/d4/fdd [299158,199] 0 2024-09-13T21:44:52.031 INFO:tasks.workunit.client.0.smithi119.stdout:3/666: rename d6/fae to d6/d15/d1a/d45/d8d/fe5 0 2024-09-13T21:44:52.031 INFO:tasks.workunit.client.1.smithi155.stdout:1/323: dread d6/d15/f4e [0,4194304] 0 2024-09-13T21:44:52.032 INFO:tasks.workunit.client.1.smithi155.stdout:6/400: rmdir db/d12/d1c/d36 39 2024-09-13T21:44:52.033 INFO:tasks.workunit.client.1.smithi155.stdout:3/401: link d3/d21/l6d d3/d25/d1b/l8c 0 2024-09-13T21:44:52.035 INFO:tasks.workunit.client.1.smithi155.stdout:6/401: write db/d11/d4c/d64/f77 [466731,126684] 0 2024-09-13T21:44:52.035 INFO:tasks.workunit.client.1.smithi155.stdout:3/402: rmdir d3/d25/d17/d52 39 2024-09-13T21:44:52.036 INFO:tasks.workunit.client.0.smithi119.stdout:5/725: read d0/d3/d4/d9/d14/f29 [5787180,62816] 0 2024-09-13T21:44:52.036 INFO:tasks.workunit.client.1.smithi155.stdout:6/402: read db/d11/d2b/d35/f29 [819929,104074] 0 2024-09-13T21:44:52.037 INFO:tasks.workunit.client.1.smithi155.stdout:6/403: fdatasync db/f22 0 2024-09-13T21:44:52.038 INFO:tasks.workunit.client.0.smithi119.stdout:4/735: dread d4/d1e/d26/d5e/f6e [0,4194304] 0 2024-09-13T21:44:52.038 INFO:tasks.workunit.client.1.smithi155.stdout:3/403: truncate d3/d25/d17/f89 262414 0 2024-09-13T21:44:52.038 INFO:tasks.workunit.client.0.smithi119.stdout:5/726: fsync d0/d3/f12 0 2024-09-13T21:44:52.039 INFO:tasks.workunit.client.1.smithi155.stdout:1/324: link d6/d15/f37 d6/d15/d3e/d17/d30/f75 0 2024-09-13T21:44:52.039 INFO:tasks.workunit.client.1.smithi155.stdout:3/404: write d3/d25/f3f [1171955,29180] 0 2024-09-13T21:44:52.040 INFO:tasks.workunit.client.0.smithi119.stdout:5/727: symlink d0/d3/d1f/lfc 0 2024-09-13T21:44:52.043 INFO:tasks.workunit.client.1.smithi155.stdout:6/404: dread db/f1f [0,4194304] 0 2024-09-13T21:44:52.043 INFO:tasks.workunit.client.0.smithi119.stdout:5/728: symlink d0/d3/d4/d9/d14/lfd 0 2024-09-13T21:44:52.044 INFO:tasks.workunit.client.1.smithi155.stdout:3/405: dread d3/d25/d17/d3b/f50 [0,4194304] 0 2024-09-13T21:44:52.047 INFO:tasks.workunit.client.1.smithi155.stdout:1/325: dwrite d6/d15/d3e/d17/f29 [0,4194304] 0 2024-09-13T21:44:52.047 INFO:tasks.workunit.client.1.smithi155.stdout:3/406: creat d3/d10/f8d x:0 0 0 2024-09-13T21:44:52.051 INFO:tasks.workunit.client.1.smithi155.stdout:1/326: chown d6/d15/d57/d5d/f5f 46 1 2024-09-13T21:44:52.053 INFO:tasks.workunit.client.1.smithi155.stdout:6/405: dwrite db/d11/d4c/d64/f77 [0,4194304] 0 2024-09-13T21:44:52.055 INFO:tasks.workunit.client.1.smithi155.stdout:6/406: write db/d11/d4c/d64/f77 [2042994,76562] 0 2024-09-13T21:44:52.055 INFO:tasks.workunit.client.0.smithi119.stdout:7/789: write d8/d3c/d53/d37/d57/f62 [609551,50552] 0 2024-09-13T21:44:52.056 INFO:tasks.workunit.client.1.smithi155.stdout:6/407: chown db/d11/d4c/d64/f77 111 1 2024-09-13T21:44:52.057 INFO:tasks.workunit.client.0.smithi119.stdout:7/790: symlink d8/d3c/d53/d37/d83/d89/d3d/l100 0 2024-09-13T21:44:52.058 INFO:tasks.workunit.client.1.smithi155.stdout:6/408: truncate db/d11/f14 4445689 0 2024-09-13T21:44:52.058 INFO:tasks.workunit.client.1.smithi155.stdout:8/310: sync 2024-09-13T21:44:52.060 INFO:tasks.workunit.client.1.smithi155.stdout:6/409: readlink db/l63 0 2024-09-13T21:44:52.060 INFO:tasks.workunit.client.1.smithi155.stdout:9/337: sync 2024-09-13T21:44:52.060 INFO:tasks.workunit.client.1.smithi155.stdout:0/340: sync 2024-09-13T21:44:52.060 INFO:tasks.workunit.client.1.smithi155.stdout:4/307: sync 2024-09-13T21:44:52.061 INFO:tasks.workunit.client.1.smithi155.stdout:5/330: sync 2024-09-13T21:44:52.061 INFO:tasks.workunit.client.1.smithi155.stdout:2/256: sync 2024-09-13T21:44:52.062 INFO:tasks.workunit.client.1.smithi155.stdout:8/311: fdatasync d2/d6/dd/d12/f3a 0 2024-09-13T21:44:52.064 INFO:tasks.workunit.client.0.smithi119.stdout:3/667: dwrite d6/d25/d2f/d33/d88/d96/fd3 [0,4194304] 0 2024-09-13T21:44:52.065 INFO:tasks.workunit.client.1.smithi155.stdout:1/327: creat d6/d15/f76 x:0 0 0 2024-09-13T21:44:52.065 INFO:tasks.workunit.client.0.smithi119.stdout:5/729: creat d0/d3/d1f/d21/da1/dfb/ffe x:0 0 0 2024-09-13T21:44:52.066 INFO:tasks.workunit.client.1.smithi155.stdout:9/338: dread dc/d19/d23/f47 [0,4194304] 0 2024-09-13T21:44:52.066 INFO:tasks.workunit.client.1.smithi155.stdout:0/341: mkdir d1/d6/d74/d82 0 2024-09-13T21:44:52.067 INFO:tasks.workunit.client.1.smithi155.stdout:4/308: chown d1/d7/de/c4f 156 1 2024-09-13T21:44:52.068 INFO:tasks.workunit.client.0.smithi119.stdout:3/668: creat d6/d25/fe6 x:0 0 0 2024-09-13T21:44:52.068 INFO:tasks.workunit.client.1.smithi155.stdout:1/328: stat d6/d7/d48/c54 0 2024-09-13T21:44:52.069 INFO:tasks.workunit.client.1.smithi155.stdout:9/339: write dc/d18/f3d [1064277,15409] 0 2024-09-13T21:44:52.070 INFO:tasks.workunit.client.0.smithi119.stdout:3/669: fsync d6/d44/d52/f86 0 2024-09-13T21:44:52.071 INFO:tasks.workunit.client.0.smithi119.stdout:3/670: dread - d6/d44/d52/d85/fc5 zero size 2024-09-13T21:44:52.072 INFO:tasks.workunit.client.1.smithi155.stdout:2/257: creat d2/dd/de/d15/d2e/d31/f5c x:0 0 0 2024-09-13T21:44:52.072 INFO:tasks.workunit.client.0.smithi119.stdout:5/730: getdents d0/d3/d1f/d21/da1 0 2024-09-13T21:44:52.074 INFO:tasks.workunit.client.1.smithi155.stdout:8/312: mkdir d2/d8/d5e/d60 0 2024-09-13T21:44:52.077 INFO:tasks.workunit.client.1.smithi155.stdout:6/410: fsync db/d11/d4c/d64/f77 0 2024-09-13T21:44:52.079 INFO:tasks.workunit.client.1.smithi155.stdout:3/407: truncate d3/f37 886922 0 2024-09-13T21:44:52.080 INFO:tasks.workunit.client.1.smithi155.stdout:0/342: mknod d1/d6/dc/d4d/d4a/d52/d5c/d6a/c83 0 2024-09-13T21:44:52.080 INFO:tasks.workunit.client.1.smithi155.stdout:4/309: dread d1/f59 [0,4194304] 0 2024-09-13T21:44:52.080 INFO:tasks.workunit.client.1.smithi155.stdout:9/340: mknod dc/d19/d23/d70/d74/c77 0 2024-09-13T21:44:52.081 INFO:tasks.workunit.client.0.smithi119.stdout:7/791: write d8/d3c/d53/d37/d83/d89/f32 [1209494,19246] 0 2024-09-13T21:44:52.081 INFO:tasks.workunit.client.1.smithi155.stdout:1/329: mknod d6/d15/d57/d5d/d72/c77 0 2024-09-13T21:44:52.082 INFO:tasks.workunit.client.1.smithi155.stdout:2/258: mkdir d2/dd/de/d15/d2e/d31/d5d 0 2024-09-13T21:44:52.083 INFO:tasks.workunit.client.1.smithi155.stdout:6/411: creat db/d2c/f79 x:0 0 0 2024-09-13T21:44:52.084 INFO:tasks.workunit.client.1.smithi155.stdout:2/259: chown d2/dd/c11 9341 1 2024-09-13T21:44:52.085 INFO:tasks.workunit.client.1.smithi155.stdout:7/339: sync 2024-09-13T21:44:52.085 INFO:tasks.workunit.client.0.smithi119.stdout:7/792: rmdir d8/d3c/d53/d37/d57/d8f/dfd 0 2024-09-13T21:44:52.086 INFO:tasks.workunit.client.1.smithi155.stdout:4/310: rmdir d1 39 2024-09-13T21:44:52.086 INFO:tasks.workunit.client.0.smithi119.stdout:7/793: chown d8/d19/dd7/fe0 505 1 2024-09-13T21:44:52.087 INFO:tasks.workunit.client.0.smithi119.stdout:5/731: write d0/d3/d4/d9/d14/d24/f6e [135028,4695] 0 2024-09-13T21:44:52.090 INFO:tasks.workunit.client.0.smithi119.stdout:7/794: mkdir d8/d3c/d53/d37/d57/d8f/d101 0 2024-09-13T21:44:52.090 INFO:tasks.workunit.client.1.smithi155.stdout:3/408: mkdir d3/d25/d1b/d1f/d36/d8e 0 2024-09-13T21:44:52.092 INFO:tasks.workunit.client.0.smithi119.stdout:3/671: dwrite d6/f11 [4194304,4194304] 0 2024-09-13T21:44:52.092 INFO:tasks.workunit.client.1.smithi155.stdout:9/341: creat dc/d19/d23/d38/f78 x:0 0 0 2024-09-13T21:44:52.095 INFO:tasks.workunit.client.1.smithi155.stdout:8/313: mknod d2/c61 0 2024-09-13T21:44:52.095 INFO:tasks.workunit.client.1.smithi155.stdout:6/412: dwrite db/f2f [0,4194304] 0 2024-09-13T21:44:52.097 INFO:tasks.workunit.client.1.smithi155.stdout:1/330: creat d6/d15/d3e/d17/f78 x:0 0 0 2024-09-13T21:44:52.098 INFO:tasks.workunit.client.0.smithi119.stdout:7/795: truncate d8/d3c/d53/f28 4106676 0 2024-09-13T21:44:52.100 INFO:tasks.workunit.client.0.smithi119.stdout:3/672: dread d6/d15/d1a/f41 [0,4194304] 0 2024-09-13T21:44:52.102 INFO:tasks.workunit.client.1.smithi155.stdout:0/343: dwrite d1/d6/dc/f11 [4194304,4194304] 0 2024-09-13T21:44:52.103 INFO:tasks.workunit.client.0.smithi119.stdout:7/796: mkdir d8/d3c/d46/db1/dc8/d102 0 2024-09-13T21:44:52.104 INFO:tasks.workunit.client.0.smithi119.stdout:3/673: symlink d6/d15/d1a/d45/d47/d4d/da7/le7 0 2024-09-13T21:44:52.105 INFO:tasks.workunit.client.0.smithi119.stdout:5/732: dwrite d0/d3/d4/d9/f87 [0,4194304] 0 2024-09-13T21:44:52.105 INFO:tasks.workunit.client.1.smithi155.stdout:7/340: symlink d5/df/d15/d33/d43/l65 0 2024-09-13T21:44:52.106 INFO:tasks.workunit.client.1.smithi155.stdout:4/311: chown d1/d7/de/dc/d4a/f38 1151876422 1 2024-09-13T21:44:52.110 INFO:tasks.workunit.client.1.smithi155.stdout:5/331: dread d5/d26/d45/f54 [0,4194304] 0 2024-09-13T21:44:52.111 INFO:tasks.workunit.client.0.smithi119.stdout:5/733: truncate d0/d3/d4/d9/d14/d24/f5a 2364941 0 2024-09-13T21:44:52.111 INFO:tasks.workunit.client.1.smithi155.stdout:7/341: dread f3 [0,4194304] 0 2024-09-13T21:44:52.115 INFO:tasks.workunit.client.0.smithi119.stdout:7/797: dwrite d8/f20 [0,4194304] 0 2024-09-13T21:44:52.115 INFO:tasks.workunit.client.1.smithi155.stdout:9/342: rename dc/d19/d23/d2f to dc/de/d2d/d79 0 2024-09-13T21:44:52.116 INFO:tasks.workunit.client.0.smithi119.stdout:3/674: dread d6/fc [0,4194304] 0 2024-09-13T21:44:52.117 INFO:tasks.workunit.client.0.smithi119.stdout:5/734: truncate d0/d3/d4/d9/d14/d24/d25/f6f 1687075 0 2024-09-13T21:44:52.118 INFO:tasks.workunit.client.1.smithi155.stdout:2/260: symlink d2/l5e 0 2024-09-13T21:44:52.120 INFO:tasks.workunit.client.0.smithi119.stdout:7/798: symlink d8/d3c/d46/db1/dc8/l103 0 2024-09-13T21:44:52.120 INFO:tasks.workunit.client.1.smithi155.stdout:1/331: write d6/f16 [7328287,63272] 0 2024-09-13T21:44:52.120 INFO:tasks.workunit.client.0.smithi119.stdout:3/675: truncate d6/d15/d1a/d45/d47/d4d/da7/fb1 528643 0 2024-09-13T21:44:52.121 INFO:tasks.workunit.client.0.smithi119.stdout:3/676: stat d6/d15/d8f/lc1 0 2024-09-13T21:44:52.122 INFO:tasks.workunit.client.0.smithi119.stdout:5/735: symlink d0/d3/d4/d9/d14/d24/lff 0 2024-09-13T21:44:52.123 INFO:tasks.workunit.client.1.smithi155.stdout:7/342: dwrite f3 [0,4194304] 0 2024-09-13T21:44:52.126 INFO:tasks.workunit.client.0.smithi119.stdout:3/677: creat d6/d15/d1a/d45/d47/d4d/dcf/dd6/fe8 x:0 0 0 2024-09-13T21:44:52.128 INFO:tasks.workunit.client.0.smithi119.stdout:7/799: dwrite d8/d3c/d53/d37/d83/d89/d47/faf [0,4194304] 0 2024-09-13T21:44:52.129 INFO:tasks.workunit.client.0.smithi119.stdout:5/736: dread d0/d3/f11 [0,4194304] 0 2024-09-13T21:44:52.130 INFO:tasks.workunit.client.1.smithi155.stdout:8/314: write d2/f5 [4456562,108126] 0 2024-09-13T21:44:52.131 INFO:tasks.workunit.client.1.smithi155.stdout:4/312: dread d1/d7/f30 [0,4194304] 0 2024-09-13T21:44:52.131 INFO:tasks.workunit.client.1.smithi155.stdout:7/343: chown d5/d10/d3e/d40/l49 115234 1 2024-09-13T21:44:52.134 INFO:tasks.workunit.client.1.smithi155.stdout:7/344: chown d5/d10/f18 26 1 2024-09-13T21:44:52.135 INFO:tasks.workunit.client.0.smithi119.stdout:3/678: dread d6/d15/d1a/d45/d47/d4d/f94 [0,4194304] 0 2024-09-13T21:44:52.137 INFO:tasks.workunit.client.0.smithi119.stdout:3/679: dread - d6/d15/d1a/d45/d47/d4d/f73 zero size 2024-09-13T21:44:52.139 INFO:tasks.workunit.client.0.smithi119.stdout:7/800: mknod d8/d3c/d53/d3b/dbf/c104 0 2024-09-13T21:44:52.141 INFO:tasks.workunit.client.0.smithi119.stdout:5/737: creat d0/d3/d1f/d21/d4f/de6/f100 x:0 0 0 2024-09-13T21:44:52.142 INFO:tasks.workunit.client.1.smithi155.stdout:5/332: mknod d5/d16/d33/d1b/c6a 0 2024-09-13T21:44:52.143 INFO:tasks.workunit.client.0.smithi119.stdout:5/738: write d0/d3/d4/d2e/fbc [860962,119529] 0 2024-09-13T21:44:52.144 INFO:tasks.workunit.client.1.smithi155.stdout:0/344: dwrite d1/d6/dc/f10 [0,4194304] 0 2024-09-13T21:44:52.144 INFO:tasks.workunit.client.0.smithi119.stdout:3/680: dread d6/d15/d1a/d45/d8d/d95/fa8 [0,4194304] 0 2024-09-13T21:44:52.145 INFO:tasks.workunit.client.0.smithi119.stdout:7/801: chown d8/d19/d2e/fdd 10306 1 2024-09-13T21:44:52.146 INFO:tasks.workunit.client.1.smithi155.stdout:2/261: mkdir d2/dd/de/d15/d38/d41/d5f 0 2024-09-13T21:44:52.150 INFO:tasks.workunit.client.1.smithi155.stdout:3/409: dwrite d3/d25/d17/d3b/f50 [0,4194304] 0 2024-09-13T21:44:52.151 INFO:tasks.workunit.client.1.smithi155.stdout:6/413: creat db/d12/d1c/d36/d37/d4f/f7a x:0 0 0 2024-09-13T21:44:52.154 INFO:tasks.workunit.client.0.smithi119.stdout:5/739: read d0/d3/d4/d2e/d65/fca [126881,36513] 0 2024-09-13T21:44:52.154 INFO:tasks.workunit.client.0.smithi119.stdout:3/681: dwrite d6/d15/d1a/d45/d47/d4d/f73 [0,4194304] 0 2024-09-13T21:44:52.155 INFO:tasks.workunit.client.1.smithi155.stdout:2/262: readlink d2/dd/de/d15/l29 0 2024-09-13T21:44:52.155 INFO:tasks.workunit.client.1.smithi155.stdout:7/345: dwrite d5/d3b/f59 [0,4194304] 0 2024-09-13T21:44:52.155 INFO:tasks.workunit.client.1.smithi155.stdout:1/332: write d6/f49 [409555,88752] 0 2024-09-13T21:44:52.157 INFO:tasks.workunit.client.1.smithi155.stdout:9/343: getdents dc/de/d2d/d79 0 2024-09-13T21:44:52.158 INFO:tasks.workunit.client.1.smithi155.stdout:4/313: mkdir d1/d7/de/d15/d55/d5e 0 2024-09-13T21:44:52.160 INFO:tasks.workunit.client.1.smithi155.stdout:3/410: symlink d3/d25/d1b/l8f 0 2024-09-13T21:44:52.160 INFO:tasks.workunit.client.1.smithi155.stdout:5/333: read d5/d12/f4b [403114,60555] 0 2024-09-13T21:44:52.162 INFO:tasks.workunit.client.0.smithi119.stdout:3/682: unlink d6/d25/d2f/d8e/fb3 0 2024-09-13T21:44:52.163 INFO:tasks.workunit.client.0.smithi119.stdout:5/740: getdents d0/d3/d4/d2e/d65/df6 0 2024-09-13T21:44:52.163 INFO:tasks.workunit.client.1.smithi155.stdout:7/346: creat d5/d10/d3e/d3f/f66 x:0 0 0 2024-09-13T21:44:52.163 INFO:tasks.workunit.client.0.smithi119.stdout:5/741: chown d0/d3/d4/l9e 519685888 1 2024-09-13T21:44:52.164 INFO:tasks.workunit.client.1.smithi155.stdout:2/263: dread - d2/dd/d37/d4e/f59 zero size 2024-09-13T21:44:52.164 INFO:tasks.workunit.client.1.smithi155.stdout:1/333: truncate d6/d7/f8 4201426 0 2024-09-13T21:44:52.165 INFO:tasks.workunit.client.0.smithi119.stdout:5/742: fsync d0/d3/d1f/d21/d4f/f9c 0 2024-09-13T21:44:52.166 INFO:tasks.workunit.client.0.smithi119.stdout:5/743: write d0/d3/d4/fea [405524,30446] 0 2024-09-13T21:44:52.167 INFO:tasks.workunit.client.1.smithi155.stdout:9/344: creat dc/d18/f7a x:0 0 0 2024-09-13T21:44:52.168 INFO:tasks.workunit.client.1.smithi155.stdout:2/264: read - d2/f53 zero size 2024-09-13T21:44:52.168 INFO:tasks.workunit.client.1.smithi155.stdout:0/345: creat d1/d6/dc/f84 x:0 0 0 2024-09-13T21:44:52.169 INFO:tasks.workunit.client.0.smithi119.stdout:5/744: chown d0/d3/ldf 192071278 1 2024-09-13T21:44:52.170 INFO:tasks.workunit.client.0.smithi119.stdout:5/745: read d0/d3/d4/d9/d14/d24/f55 [3202432,15387] 0 2024-09-13T21:44:52.171 INFO:tasks.workunit.client.1.smithi155.stdout:5/334: mknod d5/d16/d33/d1b/d1e/c6b 0 2024-09-13T21:44:52.175 INFO:tasks.workunit.client.1.smithi155.stdout:5/335: read d5/d26/d45/f54 [3253140,56643] 0 2024-09-13T21:44:52.176 INFO:tasks.workunit.client.0.smithi119.stdout:5/746: creat d0/d3/d4/f101 x:0 0 0 2024-09-13T21:44:52.177 INFO:tasks.workunit.client.0.smithi119.stdout:5/747: write d0/d3/d1f/d21/d4f/d86/fe0 [269790,2937] 0 2024-09-13T21:44:52.178 INFO:tasks.workunit.client.1.smithi155.stdout:6/414: dwrite db/d11/d1e/f3e [0,4194304] 0 2024-09-13T21:44:52.178 INFO:tasks.workunit.client.1.smithi155.stdout:4/314: dwrite d1/f4 [0,4194304] 0 2024-09-13T21:44:52.180 INFO:tasks.workunit.client.0.smithi119.stdout:5/748: dread d0/d3/d4/d9/f10 [0,4194304] 0 2024-09-13T21:44:52.181 INFO:tasks.workunit.client.1.smithi155.stdout:9/345: read dc/de/d2d/d79/f41 [1153097,56125] 0 2024-09-13T21:44:52.182 INFO:tasks.workunit.client.1.smithi155.stdout:6/415: write db/d11/d4c/d64/f77 [2176703,5042] 0 2024-09-13T21:44:52.183 INFO:tasks.workunit.client.1.smithi155.stdout:9/346: truncate dc/de/d2d/d79/f63 839337 0 2024-09-13T21:44:52.195 INFO:tasks.workunit.client.1.smithi155.stdout:7/347: fdatasync d5/df/d15/f28 0 2024-09-13T21:44:52.198 INFO:tasks.workunit.client.1.smithi155.stdout:9/347: dread dc/d19/d23/f30 [0,4194304] 0 2024-09-13T21:44:52.204 INFO:tasks.workunit.client.0.smithi119.stdout:7/802: write d8/d3c/d53/d37/fa1 [363339,40228] 0 2024-09-13T21:44:52.208 INFO:tasks.workunit.client.0.smithi119.stdout:3/683: write d6/d44/d52/f68 [896800,124177] 0 2024-09-13T21:44:52.210 INFO:tasks.workunit.client.0.smithi119.stdout:3/684: read d6/d15/f30 [3102789,101455] 0 2024-09-13T21:44:52.210 INFO:tasks.workunit.client.1.smithi155.stdout:6/416: truncate db/d11/d1e/d21/f69 100484 0 2024-09-13T21:44:52.215 INFO:tasks.workunit.client.1.smithi155.stdout:7/348: mknod d5/d13/c67 0 2024-09-13T21:44:52.220 INFO:tasks.workunit.client.0.smithi119.stdout:5/749: dwrite d0/d3/d4/d9/d14/d24/d25/f7d [0,4194304] 0 2024-09-13T21:44:52.220 INFO:tasks.workunit.client.0.smithi119.stdout:5/750: creat d0/d3/d1f/d21/da1/dfb/f102 x:0 0 0 2024-09-13T21:44:52.221 INFO:tasks.workunit.client.1.smithi155.stdout:1/334: mknod d6/d15/d57/d5d/d72/d74/c79 0 2024-09-13T21:44:52.222 INFO:tasks.workunit.client.0.smithi119.stdout:5/751: truncate d0/d3/d4/def/dd6/fe9 200519 0 2024-09-13T21:44:52.225 INFO:tasks.workunit.client.1.smithi155.stdout:1/335: readlink d6/d15/d3e/d17/d30/l3a 0 2024-09-13T21:44:52.226 INFO:tasks.workunit.client.1.smithi155.stdout:7/349: dwrite d5/fb [0,4194304] 0 2024-09-13T21:44:52.226 INFO:tasks.workunit.client.1.smithi155.stdout:4/315: creat d1/d7/de/d15/d55/d5e/f5f x:0 0 0 2024-09-13T21:44:52.228 INFO:tasks.workunit.client.1.smithi155.stdout:2/265: mknod d2/dd/de/d15/d2e/d31/d5d/c60 0 2024-09-13T21:44:52.230 INFO:tasks.workunit.client.1.smithi155.stdout:6/417: fdatasync f3 0 2024-09-13T21:44:52.230 INFO:tasks.workunit.client.0.smithi119.stdout:7/803: dwrite d8/d3c/d53/d37/d57/f5c [0,4194304] 0 2024-09-13T21:44:52.231 INFO:tasks.workunit.client.1.smithi155.stdout:6/418: write db/d2c/f79 [881202,63719] 0 2024-09-13T21:44:52.232 INFO:tasks.workunit.client.0.smithi119.stdout:5/752: dread d0/d3/d4/d2e/d65/fca [0,4194304] 0 2024-09-13T21:44:52.234 INFO:tasks.workunit.client.1.smithi155.stdout:9/348: dread dc/d19/d21/f55 [0,4194304] 0 2024-09-13T21:44:52.234 INFO:tasks.workunit.client.0.smithi119.stdout:0/702: sync 2024-09-13T21:44:52.236 INFO:tasks.workunit.client.1.smithi155.stdout:7/350: mknod d5/df/d15/c68 0 2024-09-13T21:44:52.240 INFO:tasks.workunit.client.0.smithi119.stdout:0/703: read de/d1c/ff2 [243878,19116] 0 2024-09-13T21:44:52.241 INFO:tasks.workunit.client.1.smithi155.stdout:2/266: symlink d2/dd/de/d15/d2e/l61 0 2024-09-13T21:44:52.242 INFO:tasks.workunit.client.0.smithi119.stdout:5/753: dwrite d0/d3/d4/d9/d14/d24/d25/fb7 [0,4194304] 0 2024-09-13T21:44:52.244 INFO:tasks.workunit.client.0.smithi119.stdout:3/685: dread d6/f6c [0,4194304] 0 2024-09-13T21:44:52.246 INFO:tasks.workunit.client.1.smithi155.stdout:2/267: write d2/dd/de/d15/f2b [5522938,39033] 0 2024-09-13T21:44:52.246 INFO:tasks.workunit.client.1.smithi155.stdout:1/336: mknod d6/d15/d3e/c7a 0 2024-09-13T21:44:52.248 INFO:tasks.workunit.client.1.smithi155.stdout:9/349: dwrite dc/d19/d23/f2e [0,4194304] 0 2024-09-13T21:44:52.250 INFO:tasks.workunit.client.1.smithi155.stdout:1/337: chown d6/d7/d48/f69 556 1 2024-09-13T21:44:52.250 INFO:tasks.workunit.client.0.smithi119.stdout:7/804: dread d8/d3c/d53/d37/d57/d5f/f66 [0,4194304] 0 2024-09-13T21:44:52.251 INFO:tasks.workunit.client.1.smithi155.stdout:0/346: write d1/f3e [4640473,21231] 0 2024-09-13T21:44:52.252 INFO:tasks.workunit.client.1.smithi155.stdout:7/351: write d5/d3b/f4b [1528937,67999] 0 2024-09-13T21:44:52.253 INFO:tasks.workunit.client.0.smithi119.stdout:7/805: mkdir d8/d3c/d53/d37/d83/d105 0 2024-09-13T21:44:52.254 INFO:tasks.workunit.client.1.smithi155.stdout:9/350: write dc/de/d2d/d79/f63 [406356,20839] 0 2024-09-13T21:44:52.255 INFO:tasks.workunit.client.1.smithi155.stdout:4/316: link d1/l4c d1/d7/de/d15/d55/d5e/l60 0 2024-09-13T21:44:52.257 INFO:tasks.workunit.client.1.smithi155.stdout:1/338: symlink d6/d15/d57/d5d/l7b 0 2024-09-13T21:44:52.257 INFO:tasks.workunit.client.0.smithi119.stdout:5/754: dwrite d0/d3/d4/d9/f46 [0,4194304] 0 2024-09-13T21:44:52.260 INFO:tasks.workunit.client.1.smithi155.stdout:1/339: chown d6/d15/d23/c56 0 1 2024-09-13T21:44:52.260 INFO:tasks.workunit.client.1.smithi155.stdout:7/352: creat d5/df/d15/d33/f69 x:0 0 0 2024-09-13T21:44:52.262 INFO:tasks.workunit.client.0.smithi119.stdout:7/806: getdents d8/d19 0 2024-09-13T21:44:52.262 INFO:tasks.workunit.client.1.smithi155.stdout:1/340: stat d6/d15/f3d 0 2024-09-13T21:44:52.264 INFO:tasks.workunit.client.1.smithi155.stdout:4/317: symlink d1/l61 0 2024-09-13T21:44:52.265 INFO:tasks.workunit.client.0.smithi119.stdout:5/755: read d0/d3/d4/d9/d14/ff3 [1111928,110373] 0 2024-09-13T21:44:52.266 INFO:tasks.workunit.client.0.smithi119.stdout:7/807: mknod d8/d3c/d53/d37/c106 0 2024-09-13T21:44:52.267 INFO:tasks.workunit.client.1.smithi155.stdout:4/318: chown d1/d7/de/d15/f5b 66 1 2024-09-13T21:44:52.267 INFO:tasks.workunit.client.0.smithi119.stdout:0/704: dwrite de/d1c/d2f/d40/d66/dcb/dd6/faa [0,4194304] 0 2024-09-13T21:44:52.268 INFO:tasks.workunit.client.0.smithi119.stdout:5/756: dread - d0/d3/d1f/d21/d4f/d86/fb4 zero size 2024-09-13T21:44:52.269 INFO:tasks.workunit.client.1.smithi155.stdout:9/351: creat dc/d19/d23/d70/f7b x:0 0 0 2024-09-13T21:44:52.271 INFO:tasks.workunit.client.1.smithi155.stdout:2/268: creat d2/db/f62 x:0 0 0 2024-09-13T21:44:52.273 INFO:tasks.workunit.client.1.smithi155.stdout:7/353: dwrite d5/d13/f3d [0,4194304] 0 2024-09-13T21:44:52.278 INFO:tasks.workunit.client.1.smithi155.stdout:9/352: mknod dc/d19/c7c 0 2024-09-13T21:44:52.281 INFO:tasks.workunit.client.1.smithi155.stdout:7/354: creat d5/d10/f6a x:0 0 0 2024-09-13T21:44:52.290 INFO:tasks.workunit.client.1.smithi155.stdout:9/353: dwrite dc/d19/f36 [0,4194304] 0 2024-09-13T21:44:52.297 INFO:tasks.workunit.client.1.smithi155.stdout:7/355: unlink d5/df/d15/d33/c39 0 2024-09-13T21:44:52.298 INFO:tasks.workunit.client.1.smithi155.stdout:9/354: creat dc/de/d6f/f7d x:0 0 0 2024-09-13T21:44:52.298 INFO:tasks.workunit.client.1.smithi155.stdout:9/355: chown dc/de/d15/l2c 0 1 2024-09-13T21:44:52.299 INFO:tasks.workunit.client.1.smithi155.stdout:9/356: chown dc/d19/d23/d70/d74/c77 1 1 2024-09-13T21:44:52.299 INFO:tasks.workunit.client.1.smithi155.stdout:6/419: mknod db/c7b 0 2024-09-13T21:44:52.301 INFO:tasks.workunit.client.1.smithi155.stdout:6/420: dread - db/d2c/f59 zero size 2024-09-13T21:44:52.301 INFO:tasks.workunit.client.1.smithi155.stdout:9/357: chown dc/d19/d23/d70/d74/c77 75339887 1 2024-09-13T21:44:52.302 INFO:tasks.workunit.client.1.smithi155.stdout:9/358: dread - dc/d19/d23/d70/f7b zero size 2024-09-13T21:44:52.304 INFO:tasks.workunit.client.1.smithi155.stdout:6/421: unlink db/d2c/f3b 0 2024-09-13T21:44:52.305 INFO:tasks.workunit.client.1.smithi155.stdout:9/359: write dc/d18/d1e/f22 [554840,81683] 0 2024-09-13T21:44:52.307 INFO:tasks.workunit.client.1.smithi155.stdout:4/319: rmdir d1/d7/de/d15 39 2024-09-13T21:44:52.309 INFO:tasks.workunit.client.1.smithi155.stdout:6/422: unlink db/d11/c16 0 2024-09-13T21:44:52.310 INFO:tasks.workunit.client.1.smithi155.stdout:9/360: link dc/d19/d21/f55 dc/de/d6f/f7e 0 2024-09-13T21:44:52.311 INFO:tasks.workunit.client.1.smithi155.stdout:9/361: stat dc/de/d6f/f7e 0 2024-09-13T21:44:52.312 INFO:tasks.workunit.client.1.smithi155.stdout:6/423: mkdir db/d11/d4c/d7c 0 2024-09-13T21:44:52.313 INFO:tasks.workunit.client.1.smithi155.stdout:6/424: truncate db/d12/d1c/f6e 1030069 0 2024-09-13T21:44:52.316 INFO:tasks.workunit.client.1.smithi155.stdout:6/425: mknod db/d11/d5b/c7d 0 2024-09-13T21:44:52.318 INFO:tasks.workunit.client.1.smithi155.stdout:6/426: creat db/d12/d1c/d36/d46/f7e x:0 0 0 2024-09-13T21:44:52.319 INFO:tasks.workunit.client.1.smithi155.stdout:3/411: rename d3/d25/d1b/d1f/d36/d8e to d3/d25/d1b/d90 0 2024-09-13T21:44:52.320 INFO:tasks.workunit.client.1.smithi155.stdout:6/427: symlink db/d11/d4c/d64/d5e/l7f 0 2024-09-13T21:44:52.322 INFO:tasks.workunit.client.1.smithi155.stdout:0/347: rename d1/d6/dc/f70 to d1/d6/dc/d4d/f85 0 2024-09-13T21:44:52.322 INFO:tasks.workunit.client.1.smithi155.stdout:1/341: rename d6/d15/d3e/d17 to d6/d15/d3e/d17/d7c 22 2024-09-13T21:44:52.323 INFO:tasks.workunit.client.1.smithi155.stdout:3/412: fsync d3/d25/d1b/d1f/d36/f6c 0 2024-09-13T21:44:52.324 INFO:tasks.workunit.client.1.smithi155.stdout:6/428: readlink db/d11/d2b/l33 0 2024-09-13T21:44:52.325 INFO:tasks.workunit.client.1.smithi155.stdout:3/413: write d3/d25/d1b/d1f/f64 [175690,78603] 0 2024-09-13T21:44:52.328 INFO:tasks.workunit.client.1.smithi155.stdout:7/356: rename d5/df/d15/f1f to d5/d10/d3e/f6b 0 2024-09-13T21:44:52.331 INFO:tasks.workunit.client.1.smithi155.stdout:3/414: dread d3/d25/d1b/d1f/f64 [0,4194304] 0 2024-09-13T21:44:52.332 INFO:tasks.workunit.client.1.smithi155.stdout:3/415: chown d3 4 1 2024-09-13T21:44:52.332 INFO:tasks.workunit.client.1.smithi155.stdout:0/348: dread d1/d6/f2d [0,4194304] 0 2024-09-13T21:44:52.332 INFO:tasks.workunit.client.1.smithi155.stdout:6/429: chown db/d3d/d5f/l6a 44761 1 2024-09-13T21:44:52.333 INFO:tasks.workunit.client.1.smithi155.stdout:0/349: write d1/d6/f64 [17418,91297] 0 2024-09-13T21:44:52.334 INFO:tasks.workunit.client.1.smithi155.stdout:6/430: read - db/d12/d1c/d36/d46/f7e zero size 2024-09-13T21:44:52.335 INFO:tasks.workunit.client.0.smithi119.stdout:7/808: symlink d8/d3c/d53/d37/d83/d89/l107 0 2024-09-13T21:44:52.336 INFO:tasks.workunit.client.1.smithi155.stdout:6/431: dread - db/d11/d4c/f54 zero size 2024-09-13T21:44:52.336 INFO:tasks.workunit.client.0.smithi119.stdout:3/686: write d6/d15/d1a/d45/d8d/dbc/fbd [647396,86190] 0 2024-09-13T21:44:52.336 INFO:tasks.workunit.client.1.smithi155.stdout:0/350: dread - d1/d6/dc/d4d/f85 zero size 2024-09-13T21:44:52.338 INFO:tasks.workunit.client.0.smithi119.stdout:7/809: write d8/d19/d2e/fdd [4531979,758] 0 2024-09-13T21:44:52.340 INFO:tasks.workunit.client.0.smithi119.stdout:3/687: chown d6/d15/d1a/d45/d47/d4d/f92 86 1 2024-09-13T21:44:52.340 INFO:tasks.workunit.client.1.smithi155.stdout:7/357: creat d5/d13/d5f/f6c x:0 0 0 2024-09-13T21:44:52.341 INFO:tasks.workunit.client.1.smithi155.stdout:6/432: dread db/d11/d1e/f3e [0,4194304] 0 2024-09-13T21:44:52.341 INFO:tasks.workunit.client.0.smithi119.stdout:7/810: write d8/d4d/fcd [262809,43105] 0 2024-09-13T21:44:52.341 INFO:tasks.workunit.client.0.smithi119.stdout:5/757: link d0/d3/d1f/d21/l7c d0/d3/d4/l103 0 2024-09-13T21:44:52.342 INFO:tasks.workunit.client.1.smithi155.stdout:6/433: write db/d12/f1a [198894,30155] 0 2024-09-13T21:44:52.344 INFO:tasks.workunit.client.1.smithi155.stdout:4/320: truncate d1/f24 938143 0 2024-09-13T21:44:52.344 INFO:tasks.workunit.client.0.smithi119.stdout:7/811: chown d8/d19/d2e/fff 662 1 2024-09-13T21:44:52.345 INFO:tasks.workunit.client.0.smithi119.stdout:3/688: write d6/f18 [2627006,46202] 0 2024-09-13T21:44:52.345 INFO:tasks.workunit.client.0.smithi119.stdout:0/705: dwrite de/d1c/d52/f7a [0,4194304] 0 2024-09-13T21:44:52.346 INFO:tasks.workunit.client.0.smithi119.stdout:0/706: chown de/d3c 3 1 2024-09-13T21:44:52.346 INFO:tasks.workunit.client.1.smithi155.stdout:3/416: rename d3/d25/c60 to d3/d25/d1b/d1f/d82/d83/c91 0 2024-09-13T21:44:52.347 INFO:tasks.workunit.client.1.smithi155.stdout:9/362: write dc/f1a [1251336,19765] 0 2024-09-13T21:44:52.347 INFO:tasks.workunit.client.0.smithi119.stdout:3/689: write d6/d15/f30 [1665376,22155] 0 2024-09-13T21:44:52.349 INFO:tasks.workunit.client.1.smithi155.stdout:0/351: creat d1/d6/dc/d4d/d4a/d52/d5b/f86 x:0 0 0 2024-09-13T21:44:52.349 INFO:tasks.workunit.client.0.smithi119.stdout:7/812: creat d8/d3c/d53/d37/d83/f108 x:0 0 0 2024-09-13T21:44:52.350 INFO:tasks.workunit.client.1.smithi155.stdout:9/363: truncate dc/d19/d23/d70/f7b 858970 0 2024-09-13T21:44:52.351 INFO:tasks.workunit.client.1.smithi155.stdout:9/364: chown dc/de/d15/c17 2272 1 2024-09-13T21:44:52.353 INFO:tasks.workunit.client.1.smithi155.stdout:9/365: write dc/d19/d23/f2b [857031,108083] 0 2024-09-13T21:44:52.353 INFO:tasks.workunit.client.0.smithi119.stdout:5/758: dwrite d0/d3/d1f/d21/da1/dfb/fd7 [4194304,4194304] 0 2024-09-13T21:44:52.354 INFO:tasks.workunit.client.0.smithi119.stdout:7/813: unlink d8/d3c/d53/d3b/dbf/c104 0 2024-09-13T21:44:52.355 INFO:tasks.workunit.client.0.smithi119.stdout:0/707: creat de/d1c/d2f/d40/d66/dcb/dd6/d83/ff5 x:0 0 0 2024-09-13T21:44:52.356 INFO:tasks.workunit.client.0.smithi119.stdout:7/814: rmdir d8/d3c/d46 39 2024-09-13T21:44:52.357 INFO:tasks.workunit.client.0.smithi119.stdout:0/708: fdatasync de/d4e/fd0 0 2024-09-13T21:44:52.358 INFO:tasks.workunit.client.1.smithi155.stdout:7/358: rename d5/df/d15/d33/d43/d4e to d5/df/d60/d6d 0 2024-09-13T21:44:52.360 INFO:tasks.workunit.client.0.smithi119.stdout:5/759: fdatasync d0/d3/d1f/d21/da1/f57 0 2024-09-13T21:44:52.360 INFO:tasks.workunit.client.0.smithi119.stdout:0/709: rmdir de/d4e/da5 39 2024-09-13T21:44:52.362 INFO:tasks.workunit.client.1.smithi155.stdout:9/366: creat dc/de/d15/f7f x:0 0 0 2024-09-13T21:44:52.362 INFO:tasks.workunit.client.0.smithi119.stdout:7/815: creat d8/d3c/d53/d37/d83/d89/de7/f109 x:0 0 0 2024-09-13T21:44:52.365 INFO:tasks.workunit.client.0.smithi119.stdout:7/816: mkdir d8/d3c/d53/d37/d83/d89/dc3/d10a 0 2024-09-13T21:44:52.366 INFO:tasks.workunit.client.0.smithi119.stdout:5/760: creat d0/d3/d4/d9/d14/d24/f104 x:0 0 0 2024-09-13T21:44:52.367 INFO:tasks.workunit.client.1.smithi155.stdout:1/342: dwrite d6/d15/d23/f3c [0,4194304] 0 2024-09-13T21:44:52.367 INFO:tasks.workunit.client.0.smithi119.stdout:0/710: dwrite de/d1c/f1d [0,4194304] 0 2024-09-13T21:44:52.367 INFO:tasks.workunit.client.1.smithi155.stdout:3/417: rename d3/d25/d1b/f6a to d3/d25/d1b/d1f/f92 0 2024-09-13T21:44:52.368 INFO:tasks.workunit.client.0.smithi119.stdout:7/817: mknod d8/d3c/d53/d3b/d7e/c10b 0 2024-09-13T21:44:52.371 INFO:tasks.workunit.client.1.smithi155.stdout:9/367: symlink dc/d19/d23/d38/l80 0 2024-09-13T21:44:52.372 INFO:tasks.workunit.client.1.smithi155.stdout:0/352: dwrite d1/d6/dc/d4d/f85 [0,4194304] 0 2024-09-13T21:44:52.372 INFO:tasks.workunit.client.0.smithi119.stdout:0/711: mknod de/d1c/d2f/d35/d90/cf6 0 2024-09-13T21:44:52.376 INFO:tasks.workunit.client.0.smithi119.stdout:0/712: fdatasync de/d1c/d2f/d40/d66/fc5 0 2024-09-13T21:44:52.376 INFO:tasks.workunit.client.1.smithi155.stdout:9/368: chown dc/de/d2d/d79/d43/f5d 21023295 1 2024-09-13T21:44:52.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:52 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:52.380 INFO:tasks.workunit.client.0.smithi119.stdout:5/761: dwrite d0/d3/d1f/f5d [0,4194304] 0 2024-09-13T21:44:52.382 INFO:tasks.workunit.client.0.smithi119.stdout:0/713: truncate de/d49/fa4 171323 0 2024-09-13T21:44:52.384 INFO:tasks.workunit.client.0.smithi119.stdout:7/818: dwrite d8/f17 [0,4194304] 0 2024-09-13T21:44:52.384 INFO:tasks.workunit.client.0.smithi119.stdout:5/762: unlink d0/d3/d4/d9/d14/d24/lff 0 2024-09-13T21:44:52.386 INFO:tasks.workunit.client.0.smithi119.stdout:5/763: fdatasync d0/dab/ff2 0 2024-09-13T21:44:52.386 INFO:tasks.workunit.client.0.smithi119.stdout:9/950: sync 2024-09-13T21:44:52.386 INFO:tasks.workunit.client.0.smithi119.stdout:3/690: dread d6/d15/f3f [0,4194304] 0 2024-09-13T21:44:52.387 INFO:tasks.workunit.client.1.smithi155.stdout:7/359: rmdir d5/d10/d3e/d3f/d51 0 2024-09-13T21:44:52.387 INFO:tasks.workunit.client.0.smithi119.stdout:5/764: chown d0/d3/c27 46940 1 2024-09-13T21:44:52.388 INFO:tasks.workunit.client.0.smithi119.stdout:9/951: fsync d0/d8/d18/f12e 0 2024-09-13T21:44:52.389 INFO:tasks.workunit.client.1.smithi155.stdout:7/360: write d5/d3b/f59 [3219005,8322] 0 2024-09-13T21:44:52.389 INFO:tasks.workunit.client.0.smithi119.stdout:3/691: chown d6/d15/d1a/d45/d47/d4d/da7/fb1 1 1 2024-09-13T21:44:52.390 INFO:tasks.workunit.client.0.smithi119.stdout:7/819: write d8/d3c/d53/d37/d83/d89/f9e [1017710,67461] 0 2024-09-13T21:44:52.391 INFO:tasks.workunit.client.0.smithi119.stdout:3/692: fsync d6/d15/d1a/faf 0 2024-09-13T21:44:52.392 INFO:tasks.workunit.client.1.smithi155.stdout:0/353: rename d1/d6/dc/l2a to d1/d6/dc/d4d/d4a/d52/d5b/l87 0 2024-09-13T21:44:52.393 INFO:tasks.workunit.client.0.smithi119.stdout:9/952: creat d0/d8/d18/d23/d42/d52/f14b x:0 0 0 2024-09-13T21:44:52.394 INFO:tasks.workunit.client.1.smithi155.stdout:4/321: dwrite d1/d7/d21/f2b [0,4194304] 0 2024-09-13T21:44:52.395 INFO:tasks.workunit.client.0.smithi119.stdout:3/693: write d6/d44/f51 [1451623,92849] 0 2024-09-13T21:44:52.395 INFO:tasks.workunit.client.1.smithi155.stdout:6/434: read db/d11/d1e/f3e [215798,10462] 0 2024-09-13T21:44:52.396 INFO:tasks.workunit.client.0.smithi119.stdout:9/953: fsync d0/d8/d18/d23/d27/d2d/d5f/d10e/d56/fa2 0 2024-09-13T21:44:52.397 INFO:tasks.workunit.client.0.smithi119.stdout:9/954: readlink d0/d8/laf 0 2024-09-13T21:44:52.398 INFO:tasks.workunit.client.1.smithi155.stdout:0/354: chown d1/d6/dc 205622 1 2024-09-13T21:44:52.399 INFO:tasks.workunit.client.1.smithi155.stdout:1/343: getdents d6/d15/d57 0 2024-09-13T21:44:52.399 INFO:tasks.workunit.client.0.smithi119.stdout:3/694: creat d6/d15/d1a/d45/d47/d4d/fe9 x:0 0 0 2024-09-13T21:44:52.400 INFO:tasks.workunit.client.1.smithi155.stdout:3/418: getdents d3/d25/d1b 0 2024-09-13T21:44:52.401 INFO:tasks.workunit.client.0.smithi119.stdout:7/820: link d8/d19/db8/cf3 d8/d3c/d53/d37/d83/d89/d3d/c10c 0 2024-09-13T21:44:52.401 INFO:tasks.workunit.client.1.smithi155.stdout:1/344: chown d6/d15/d57/d5d/f6a 28860357 1 2024-09-13T21:44:52.402 INFO:tasks.workunit.client.0.smithi119.stdout:9/955: symlink d0/d8/d18/d23/d27/d2d/d5f/l14c 0 2024-09-13T21:44:52.403 INFO:tasks.workunit.client.0.smithi119.stdout:3/695: mkdir d6/d15/d1a/d45/d47/d4d/da7/dea 0 2024-09-13T21:44:52.404 INFO:tasks.workunit.client.1.smithi155.stdout:4/322: stat d1/d7/l3d 0 2024-09-13T21:44:52.404 INFO:tasks.workunit.client.1.smithi155.stdout:3/419: write d3/d25/d1b/f4e [2398564,18182] 0 2024-09-13T21:44:52.406 INFO:tasks.workunit.client.1.smithi155.stdout:0/355: mknod d1/c88 0 2024-09-13T21:44:52.406 INFO:tasks.workunit.client.0.smithi119.stdout:9/956: mkdir d0/d8/d18/d23/d42/d12f/d147/d14d 0 2024-09-13T21:44:52.407 INFO:tasks.workunit.client.0.smithi119.stdout:3/696: fdatasync d6/d15/d1a/d45/d47/d4d/f94 0 2024-09-13T21:44:52.408 INFO:tasks.workunit.client.0.smithi119.stdout:3/697: fdatasync d6/d44/f7e 0 2024-09-13T21:44:52.409 INFO:tasks.workunit.client.0.smithi119.stdout:3/698: chown d6/f3e 464 1 2024-09-13T21:44:52.410 INFO:tasks.workunit.client.0.smithi119.stdout:3/699: chown d6/d15/d1a/d45/d8d/c9d 11158741 1 2024-09-13T21:44:52.410 INFO:tasks.workunit.client.0.smithi119.stdout:3/700: readlink d6/d15/d1a/l20 0 2024-09-13T21:44:52.411 INFO:tasks.workunit.client.1.smithi155.stdout:7/361: getdents d5/df/d15/d33/d43 0 2024-09-13T21:44:52.411 INFO:tasks.workunit.client.0.smithi119.stdout:9/957: creat d0/d8/d18/d23/d42/d52/f14e x:0 0 0 2024-09-13T21:44:52.414 INFO:tasks.workunit.client.0.smithi119.stdout:9/958: read d0/d79/f11a [1353827,12203] 0 2024-09-13T21:44:52.416 INFO:tasks.workunit.client.0.smithi119.stdout:9/959: chown d0/d8/d18/d23/d42/d52/d53/lc7 17 1 2024-09-13T21:44:52.418 INFO:tasks.workunit.client.0.smithi119.stdout:9/960: symlink d0/d8/d18/dad/l14f 0 2024-09-13T21:44:52.419 INFO:tasks.workunit.client.1.smithi155.stdout:7/362: creat d5/df/f6e x:0 0 0 2024-09-13T21:44:52.420 INFO:tasks.workunit.client.1.smithi155.stdout:1/345: dwrite d6/d15/d23/f3c [0,4194304] 0 2024-09-13T21:44:52.420 INFO:tasks.workunit.client.0.smithi119.stdout:0/714: dwrite de/d1c/d2f/f6c [0,4194304] 0 2024-09-13T21:44:52.420 INFO:tasks.workunit.client.1.smithi155.stdout:6/435: dread db/d11/d2b/d35/f29 [0,4194304] 0 2024-09-13T21:44:52.425 INFO:tasks.workunit.client.0.smithi119.stdout:9/961: unlink d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/c71 0 2024-09-13T21:44:52.426 INFO:tasks.workunit.client.0.smithi119.stdout:0/715: creat de/ff7 x:0 0 0 2024-09-13T21:44:52.427 INFO:tasks.workunit.client.0.smithi119.stdout:9/962: mkdir d0/d8/d18/d23/d27/d2d/d5f/d10e/d56/d150 0 2024-09-13T21:44:52.428 INFO:tasks.workunit.client.1.smithi155.stdout:6/436: rmdir db/d11/d2b/d35 39 2024-09-13T21:44:52.429 INFO:tasks.workunit.client.1.smithi155.stdout:1/346: readlink d6/d15/d57/d5d/l6b 0 2024-09-13T21:44:52.429 INFO:tasks.workunit.client.1.smithi155.stdout:4/323: dwrite d1/d7/d21/f3a [0,4194304] 0 2024-09-13T21:44:52.429 INFO:tasks.workunit.client.1.smithi155.stdout:0/356: dwrite d1/d6/f5f [0,4194304] 0 2024-09-13T21:44:52.430 INFO:tasks.workunit.client.0.smithi119.stdout:0/716: creat de/d1c/d52/de4/ff8 x:0 0 0 2024-09-13T21:44:52.430 INFO:tasks.workunit.client.0.smithi119.stdout:0/717: dread - de/d3c/d7c/f7e zero size 2024-09-13T21:44:52.431 INFO:tasks.workunit.client.0.smithi119.stdout:9/963: mkdir d0/d19/de4/d102/d151 0 2024-09-13T21:44:52.432 INFO:tasks.workunit.client.1.smithi155.stdout:6/437: fdatasync db/d11/d4c/f6c 0 2024-09-13T21:44:52.432 INFO:tasks.workunit.client.0.smithi119.stdout:0/718: mkdir de/d1c/d59/df9 0 2024-09-13T21:44:52.433 INFO:tasks.workunit.client.1.smithi155.stdout:9/369: dread dc/de/f10 [0,4194304] 0 2024-09-13T21:44:52.435 INFO:tasks.workunit.client.0.smithi119.stdout:3/701: write d6/f3e [3313591,85831] 0 2024-09-13T21:44:52.436 INFO:tasks.workunit.client.0.smithi119.stdout:0/719: unlink de/f22 0 2024-09-13T21:44:52.438 INFO:tasks.workunit.client.1.smithi155.stdout:0/357: write d1/d6/dc/d4d/d4a/d52/d5b/f86 [536099,30627] 0 2024-09-13T21:44:52.439 INFO:tasks.workunit.client.0.smithi119.stdout:0/720: readlink de/d1c/d2b/dd7/le5 0 2024-09-13T21:44:52.440 INFO:tasks.workunit.client.1.smithi155.stdout:9/370: symlink dc/d19/d23/d70/l81 0 2024-09-13T21:44:52.441 INFO:tasks.workunit.client.1.smithi155.stdout:7/363: getdents d5/df 0 2024-09-13T21:44:52.441 INFO:tasks.workunit.client.1.smithi155.stdout:1/347: mknod d6/d15/d3e/d17/d30/d4b/c7d 0 2024-09-13T21:44:52.442 INFO:tasks.workunit.client.1.smithi155.stdout:0/358: readlink d1/d6/dc/d4d/d4a/d4e/d61/l7c 0 2024-09-13T21:44:52.443 INFO:tasks.workunit.client.1.smithi155.stdout:1/348: dread - d6/d15/d3e/d17/f78 zero size 2024-09-13T21:44:52.445 INFO:tasks.workunit.client.1.smithi155.stdout:7/364: mknod d5/d10/c6f 0 2024-09-13T21:44:52.446 INFO:tasks.workunit.client.1.smithi155.stdout:7/365: dread - d5/df/d15/f53 zero size 2024-09-13T21:44:52.448 INFO:tasks.workunit.client.0.smithi119.stdout:0/721: dwrite de/d1c/d2b/fb3 [0,4194304] 0 2024-09-13T21:44:52.450 INFO:tasks.workunit.client.1.smithi155.stdout:6/438: dwrite db/d12/d1c/d36/d37/d4f/f7a [0,4194304] 0 2024-09-13T21:44:52.450 INFO:tasks.workunit.client.1.smithi155.stdout:1/349: unlink d6/d15/f3d 0 2024-09-13T21:44:52.450 INFO:tasks.workunit.client.0.smithi119.stdout:0/722: creat de/d1c/d2f/d40/d66/ffa x:0 0 0 2024-09-13T21:44:52.452 INFO:tasks.workunit.client.1.smithi155.stdout:0/359: creat d1/d6/dc/d4d/d4a/d4e/d61/f89 x:0 0 0 2024-09-13T21:44:52.454 INFO:tasks.workunit.client.1.smithi155.stdout:7/366: creat d5/d10/d3e/d40/f70 x:0 0 0 2024-09-13T21:44:52.456 INFO:tasks.workunit.client.1.smithi155.stdout:7/367: write d5/df/d15/d33/d43/f64 [854363,97761] 0 2024-09-13T21:44:52.458 INFO:tasks.workunit.client.1.smithi155.stdout:0/360: mknod d1/d6/dc/d4d/d4a/d4e/c8a 0 2024-09-13T21:44:52.459 INFO:tasks.workunit.client.1.smithi155.stdout:3/420: dread d3/fa [0,4194304] 0 2024-09-13T21:44:52.460 INFO:tasks.workunit.client.1.smithi155.stdout:0/361: fdatasync d1/d6/dc/f72 0 2024-09-13T21:44:52.460 INFO:tasks.workunit.client.1.smithi155.stdout:9/371: getdents dc/de/d2d/d79/d43 0 2024-09-13T21:44:52.464 INFO:tasks.workunit.client.1.smithi155.stdout:1/350: link d6/ff d6/d15/d57/d5d/d72/d74/f7e 0 2024-09-13T21:44:52.465 INFO:tasks.workunit.client.1.smithi155.stdout:7/368: dread d5/d3b/f4b [0,4194304] 0 2024-09-13T21:44:52.466 INFO:tasks.workunit.client.1.smithi155.stdout:3/421: unlink d3/d25/d1b/d1f/f2e 0 2024-09-13T21:44:52.467 INFO:tasks.workunit.client.1.smithi155.stdout:1/351: chown d6/d15/d3e/c7a 1517255971 1 2024-09-13T21:44:52.467 INFO:tasks.workunit.client.1.smithi155.stdout:9/372: mknod dc/d19/d23/d70/c82 0 2024-09-13T21:44:52.469 INFO:tasks.workunit.client.1.smithi155.stdout:0/362: dread d1/f5 [4194304,4194304] 0 2024-09-13T21:44:52.471 INFO:tasks.workunit.client.1.smithi155.stdout:3/422: readlink d3/d25/d1b/l8c 0 2024-09-13T21:44:52.472 INFO:tasks.workunit.client.1.smithi155.stdout:9/373: fdatasync dc/d19/d23/d38/f5b 0 2024-09-13T21:44:52.472 INFO:tasks.workunit.client.1.smithi155.stdout:4/324: dread d1/f1c [0,4194304] 0 2024-09-13T21:44:52.473 INFO:tasks.workunit.client.1.smithi155.stdout:0/363: rmdir d1/d6/dc/d4d/d4a/d52/d5c/d6a 39 2024-09-13T21:44:52.473 INFO:tasks.workunit.client.1.smithi155.stdout:3/423: chown d3/d25/d1b/d1f/f92 22448 1 2024-09-13T21:44:52.474 INFO:tasks.workunit.client.1.smithi155.stdout:9/374: write dc/de/d15/f24 [3630094,56922] 0 2024-09-13T21:44:52.476 INFO:tasks.workunit.client.0.smithi119.stdout:3/702: dread d6/d25/d2f/d33/f71 [0,4194304] 0 2024-09-13T21:44:52.477 INFO:tasks.workunit.client.1.smithi155.stdout:4/325: creat d1/d7/de/d15/d55/f62 x:0 0 0 2024-09-13T21:44:52.477 INFO:tasks.workunit.client.1.smithi155.stdout:4/326: stat d1/f4 0 2024-09-13T21:44:52.477 INFO:tasks.workunit.client.1.smithi155.stdout:3/424: write d3/d25/d17/f3d [4920311,115902] 0 2024-09-13T21:44:52.478 INFO:tasks.workunit.client.0.smithi119.stdout:3/703: creat d6/d15/d1a/d45/d8d/feb x:0 0 0 2024-09-13T21:44:52.478 INFO:tasks.workunit.client.0.smithi119.stdout:3/704: stat d6/c17 0 2024-09-13T21:44:52.480 INFO:tasks.workunit.client.1.smithi155.stdout:0/364: rename d1/d6/dc/d4d/c48 to d1/d6/d81/c8b 0 2024-09-13T21:44:52.480 INFO:tasks.workunit.client.1.smithi155.stdout:9/375: dread dc/d19/d23/f2e [0,4194304] 0 2024-09-13T21:44:52.483 INFO:tasks.workunit.client.0.smithi119.stdout:3/705: rename d6/d15/d1a/d45/d8d/d95/lc8 to d6/d25/d2f/d33/d56/dab/dc2/lec 0 2024-09-13T21:44:52.484 INFO:tasks.workunit.client.0.smithi119.stdout:3/706: chown d6/d15/da9/f9a 31505 1 2024-09-13T21:44:52.484 INFO:tasks.workunit.client.0.smithi119.stdout:0/723: dread fd [0,4194304] 0 2024-09-13T21:44:52.485 INFO:tasks.workunit.client.1.smithi155.stdout:3/425: unlink d3/d25/d17/f74 0 2024-09-13T21:44:52.485 INFO:tasks.workunit.client.0.smithi119.stdout:3/707: write d6/d25/fe6 [825748,16240] 0 2024-09-13T21:44:52.487 INFO:tasks.workunit.client.1.smithi155.stdout:0/365: dwrite d1/f2f [0,4194304] 0 2024-09-13T21:44:52.488 INFO:tasks.workunit.client.1.smithi155.stdout:9/376: mkdir dc/de/d2d/d79/d43/d83 0 2024-09-13T21:44:52.488 INFO:tasks.workunit.client.0.smithi119.stdout:3/708: rename d6/d15/d1a/d45/d47/f64 to d6/d15/d1a/d45/d47/d4d/da7/dea/fed 0 2024-09-13T21:44:52.490 INFO:tasks.workunit.client.0.smithi119.stdout:0/724: dread de/d4e/fe0 [0,4194304] 0 2024-09-13T21:44:52.491 INFO:tasks.workunit.client.0.smithi119.stdout:0/725: readlink de/d1c/d2b/d76/d9b/da1/le9 0 2024-09-13T21:44:52.492 INFO:tasks.workunit.client.0.smithi119.stdout:6/670: sync 2024-09-13T21:44:52.492 INFO:tasks.workunit.client.0.smithi119.stdout:2/678: sync 2024-09-13T21:44:52.492 INFO:tasks.workunit.client.0.smithi119.stdout:0/726: write de/fd4 [646054,1407] 0 2024-09-13T21:44:52.493 INFO:tasks.workunit.client.1.smithi155.stdout:6/439: read db/d12/f17 [1086631,25458] 0 2024-09-13T21:44:52.493 INFO:tasks.workunit.client.0.smithi119.stdout:8/737: sync 2024-09-13T21:44:52.494 INFO:tasks.workunit.client.0.smithi119.stdout:6/671: chown dc/df/d65/cc8 1 1 2024-09-13T21:44:52.495 INFO:tasks.workunit.client.1.smithi155.stdout:3/426: dread d3/d25/d1b/d1f/f64 [0,4194304] 0 2024-09-13T21:44:52.496 INFO:tasks.workunit.client.1.smithi155.stdout:9/377: rmdir dc/d19/d21 39 2024-09-13T21:44:52.496 INFO:tasks.workunit.client.0.smithi119.stdout:8/738: write d1b/d1d/d48/f96 [839780,116815] 0 2024-09-13T21:44:52.498 INFO:tasks.workunit.client.0.smithi119.stdout:8/739: stat d1b/f46 0 2024-09-13T21:44:52.499 INFO:tasks.workunit.client.1.smithi155.stdout:0/366: mkdir d1/d6/dc/d8c 0 2024-09-13T21:44:52.500 INFO:tasks.workunit.client.1.smithi155.stdout:3/427: unlink d3/d25/f11 0 2024-09-13T21:44:52.500 INFO:tasks.workunit.client.0.smithi119.stdout:8/740: readlink d1b/d1d/d26/ldc 0 2024-09-13T21:44:52.501 INFO:tasks.workunit.client.1.smithi155.stdout:9/378: truncate dc/d18/d1e/f34 885851 0 2024-09-13T21:44:52.502 INFO:tasks.workunit.client.1.smithi155.stdout:9/379: fdatasync dc/d19/d23/d38/f78 0 2024-09-13T21:44:52.502 INFO:tasks.workunit.client.0.smithi119.stdout:8/741: chown d1b/d1d/d48/d54/de0 7048486 1 2024-09-13T21:44:52.502 INFO:tasks.workunit.client.0.smithi119.stdout:0/727: dwrite de/d4e/fe0 [0,4194304] 0 2024-09-13T21:44:52.502 INFO:tasks.workunit.client.0.smithi119.stdout:2/679: rename d1/d22/d5a/cd3 to d1/cd7 0 2024-09-13T21:44:52.502 INFO:tasks.workunit.client.1.smithi155.stdout:3/428: write d3/d25/d1b/d1f/f49 [3515272,121941] 0 2024-09-13T21:44:52.503 INFO:tasks.workunit.client.0.smithi119.stdout:8/742: chown d1b/d1d/d48/d58/f79 110374115 1 2024-09-13T21:44:52.503 INFO:tasks.workunit.client.1.smithi155.stdout:6/440: rename db/d12/d1c/d36/d37/d4f to db/d80 0 2024-09-13T21:44:52.508 INFO:tasks.workunit.client.1.smithi155.stdout:0/367: rename d1/d6/dc/f77 to d1/d6/dc/d4d/d4a/f8d 0 2024-09-13T21:44:52.510 INFO:tasks.workunit.client.0.smithi119.stdout:2/680: rename d1/d38/d89/d6b/fd4 to d1/d22/d5a/d5d/d83/fd8 0 2024-09-13T21:44:52.510 INFO:tasks.workunit.client.1.smithi155.stdout:6/441: creat db/d80/f81 x:0 0 0 2024-09-13T21:44:52.513 INFO:tasks.workunit.client.1.smithi155.stdout:4/327: write d1/f6 [3908258,72619] 0 2024-09-13T21:44:52.513 INFO:tasks.workunit.client.0.smithi119.stdout:8/743: dwrite d1b/d1d/d26/d3e/fc0 [0,4194304] 0 2024-09-13T21:44:52.514 INFO:tasks.workunit.client.0.smithi119.stdout:8/744: write d1b/d1d/d26/f3d [5721792,106307] 0 2024-09-13T21:44:52.515 INFO:tasks.workunit.client.1.smithi155.stdout:9/380: fdatasync dc/de/d2d/f40 0 2024-09-13T21:44:52.515 INFO:tasks.workunit.client.0.smithi119.stdout:2/681: dread d1/d7/d86/fac [0,4194304] 0 2024-09-13T21:44:52.515 INFO:tasks.workunit.client.1.smithi155.stdout:3/429: symlink d3/d21/d4a/l93 0 2024-09-13T21:44:52.517 INFO:tasks.workunit.client.1.smithi155.stdout:9/381: chown dc/c25 3075 1 2024-09-13T21:44:52.517 INFO:tasks.workunit.client.1.smithi155.stdout:3/430: readlink d3/d21/l6d 0 2024-09-13T21:44:52.517 INFO:tasks.workunit.client.1.smithi155.stdout:3/431: dread - d3/d21/f6e zero size 2024-09-13T21:44:52.520 INFO:tasks.workunit.client.0.smithi119.stdout:2/682: rmdir d1/d22/d55/d31 39 2024-09-13T21:44:52.520 INFO:tasks.workunit.client.1.smithi155.stdout:3/432: truncate d3/d25/d1b/d1f/f92 662680 0 2024-09-13T21:44:52.520 INFO:tasks.workunit.client.1.smithi155.stdout:6/442: truncate db/d11/d1e/f3e 4762602 0 2024-09-13T21:44:52.521 INFO:tasks.workunit.client.1.smithi155.stdout:9/382: write dc/d19/d23/f2e [2779584,98907] 0 2024-09-13T21:44:52.522 INFO:tasks.workunit.client.1.smithi155.stdout:6/443: write db/d11/d1e/d21/d44/f4b [571673,50453] 0 2024-09-13T21:44:52.523 INFO:tasks.workunit.client.0.smithi119.stdout:3/709: dwrite d6/d25/d2f/d33/f71 [0,4194304] 0 2024-09-13T21:44:52.524 INFO:tasks.workunit.client.1.smithi155.stdout:9/383: chown dc/de/d2d/d79/f63 746145316 1 2024-09-13T21:44:52.529 INFO:tasks.workunit.client.0.smithi119.stdout:8/745: link d1b/d1d/d5e/ca6 d1b/d1d/d48/d54/de0/ce2 0 2024-09-13T21:44:52.529 INFO:tasks.workunit.client.1.smithi155.stdout:0/368: creat d1/f8e x:0 0 0 2024-09-13T21:44:52.530 INFO:tasks.workunit.client.0.smithi119.stdout:8/746: read - d1b/d1d/d26/d6b/fd0 zero size 2024-09-13T21:44:52.530 INFO:tasks.workunit.client.0.smithi119.stdout:0/728: dread de/d1c/d2b/d76/d9a/fc2 [0,4194304] 0 2024-09-13T21:44:52.531 INFO:tasks.workunit.client.0.smithi119.stdout:3/710: creat d6/d15/d1a/d45/d47/d4d/fee x:0 0 0 2024-09-13T21:44:52.531 INFO:tasks.workunit.client.1.smithi155.stdout:0/369: read - d1/d6/dc/f84 zero size 2024-09-13T21:44:52.531 INFO:tasks.workunit.client.1.smithi155.stdout:9/384: creat dc/d19/d21/d67/f84 x:0 0 0 2024-09-13T21:44:52.532 INFO:tasks.workunit.client.1.smithi155.stdout:3/433: creat d3/d25/f94 x:0 0 0 2024-09-13T21:44:52.532 INFO:tasks.workunit.client.0.smithi119.stdout:0/729: dread - de/d1c/d2f/d35/fdd zero size 2024-09-13T21:44:52.534 INFO:tasks.workunit.client.0.smithi119.stdout:2/683: link d1/c3c d1/d22/d55/d31/cd9 0 2024-09-13T21:44:52.534 INFO:tasks.workunit.client.0.smithi119.stdout:8/747: creat d1b/d1d/d26/d3e/daa/fe3 x:0 0 0 2024-09-13T21:44:52.535 INFO:tasks.workunit.client.1.smithi155.stdout:3/434: fdatasync d3/d25/d1b/d1f/d36/d5c/d66/f6f 0 2024-09-13T21:44:52.535 INFO:tasks.workunit.client.1.smithi155.stdout:9/385: write dc/d19/d23/d38/f78 [384266,58928] 0 2024-09-13T21:44:52.535 INFO:tasks.workunit.client.0.smithi119.stdout:0/730: rmdir de/d1c/d59 39 2024-09-13T21:44:52.537 INFO:tasks.workunit.client.0.smithi119.stdout:8/748: symlink d1b/d1d/d48/d58/d7f/dcb/le4 0 2024-09-13T21:44:52.538 INFO:tasks.workunit.client.0.smithi119.stdout:8/749: chown d1b/f46 0 1 2024-09-13T21:44:52.540 INFO:tasks.workunit.client.0.smithi119.stdout:8/750: creat d1b/d1d/d39/fe5 x:0 0 0 2024-09-13T21:44:52.540 INFO:tasks.workunit.client.1.smithi155.stdout:0/370: getdents d1/d6/d74/d82 0 2024-09-13T21:44:52.541 INFO:tasks.workunit.client.1.smithi155.stdout:9/386: mknod dc/d19/d21/d67/c85 0 2024-09-13T21:44:52.541 INFO:tasks.workunit.client.0.smithi119.stdout:8/751: dread - d1b/d1d/d39/f9c zero size 2024-09-13T21:44:52.542 INFO:tasks.workunit.client.0.smithi119.stdout:8/752: fdatasync fd 0 2024-09-13T21:44:52.543 INFO:tasks.workunit.client.0.smithi119.stdout:8/753: write d1b/d1d/d26/fab [11465,129729] 0 2024-09-13T21:44:52.546 INFO:tasks.workunit.client.1.smithi155.stdout:3/435: dwrite d3/d10/f46 [0,4194304] 0 2024-09-13T21:44:52.551 INFO:tasks.workunit.client.1.smithi155.stdout:3/436: creat d3/d25/d17/d3b/f95 x:0 0 0 2024-09-13T21:44:52.554 INFO:tasks.workunit.client.0.smithi119.stdout:3/711: truncate d6/f6c 3326798 0 2024-09-13T21:44:52.557 INFO:tasks.workunit.client.0.smithi119.stdout:3/712: mknod d6/d25/d2f/d33/d56/dab/cef 0 2024-09-13T21:44:52.557 INFO:tasks.workunit.client.1.smithi155.stdout:4/328: dread d1/d7/de/d15/f5b [0,4194304] 0 2024-09-13T21:44:52.557 INFO:tasks.workunit.client.1.smithi155.stdout:3/437: symlink d3/d25/d17/d3b/l96 0 2024-09-13T21:44:52.557 INFO:tasks.workunit.client.0.smithi119.stdout:6/672: dread dc/dd/f2e [0,4194304] 0 2024-09-13T21:44:52.558 INFO:tasks.workunit.client.1.smithi155.stdout:9/387: dwrite dc/de/f10 [4194304,4194304] 0 2024-09-13T21:44:52.559 INFO:tasks.workunit.client.0.smithi119.stdout:3/713: mkdir d6/d15/d1a/d45/d47/d4d/dcf/df0 0 2024-09-13T21:44:52.559 INFO:tasks.workunit.client.1.smithi155.stdout:4/329: write d1/f6 [3107441,14482] 0 2024-09-13T21:44:52.559 INFO:tasks.workunit.client.0.smithi119.stdout:3/714: chown d6/d15/d1a/cbf 200206 1 2024-09-13T21:44:52.560 INFO:tasks.workunit.client.0.smithi119.stdout:6/673: mknod dc/df/d32/cd0 0 2024-09-13T21:44:52.562 INFO:tasks.workunit.client.0.smithi119.stdout:3/715: write d6/d25/d2f/d33/d56/da0/fb0 [57436,18228] 0 2024-09-13T21:44:52.562 INFO:tasks.workunit.client.1.smithi155.stdout:9/388: mkdir dc/d18/d1e/d86 0 2024-09-13T21:44:52.563 INFO:tasks.workunit.client.0.smithi119.stdout:6/674: chown dc/d4b/lbc 2 1 2024-09-13T21:44:52.563 INFO:tasks.workunit.client.1.smithi155.stdout:9/389: dread - dc/d19/d21/d67/f69 zero size 2024-09-13T21:44:52.564 INFO:tasks.workunit.client.0.smithi119.stdout:8/754: truncate d1b/f47 3433529 0 2024-09-13T21:44:52.565 INFO:tasks.workunit.client.1.smithi155.stdout:4/330: creat d1/d48/f63 x:0 0 0 2024-09-13T21:44:52.566 INFO:tasks.workunit.client.1.smithi155.stdout:3/438: mknod d3/d21/c97 0 2024-09-13T21:44:52.567 INFO:tasks.workunit.client.1.smithi155.stdout:4/331: truncate d1/d7/de/dc/d2e/f34 1026795 0 2024-09-13T21:44:52.567 INFO:tasks.workunit.client.1.smithi155.stdout:9/390: symlink dc/d18/d50/l87 0 2024-09-13T21:44:52.568 INFO:tasks.workunit.client.0.smithi119.stdout:6/675: dread dc/df/d41/f7b [0,4194304] 0 2024-09-13T21:44:52.568 INFO:tasks.workunit.client.0.smithi119.stdout:0/731: dwrite de/d3c/f6d [0,4194304] 0 2024-09-13T21:44:52.569 INFO:tasks.workunit.client.0.smithi119.stdout:8/755: truncate d1b/d1d/d26/d3e/fb7 161814 0 2024-09-13T21:44:52.570 INFO:tasks.workunit.client.0.smithi119.stdout:6/676: fdatasync dc/df/d41/f90 0 2024-09-13T21:44:52.571 INFO:tasks.workunit.client.0.smithi119.stdout:0/732: stat de/d1c/d2f/d40/d66/ff4 0 2024-09-13T21:44:52.571 INFO:tasks.workunit.client.1.smithi155.stdout:9/391: write dc/f54 [1838361,116245] 0 2024-09-13T21:44:52.577 INFO:tasks.workunit.client.1.smithi155.stdout:4/332: write d1/d7/d21/d2d/d42/f4d [4712842,108791] 0 2024-09-13T21:44:52.577 INFO:tasks.workunit.client.0.smithi119.stdout:3/716: dwrite d6/d25/d2f/d33/d88/d96/fd3 [0,4194304] 0 2024-09-13T21:44:52.577 INFO:tasks.workunit.client.0.smithi119.stdout:6/677: unlink dc/d4b/d6a/d75/caf 0 2024-09-13T21:44:52.577 INFO:tasks.workunit.client.0.smithi119.stdout:0/733: write de/d1c/d2f/d40/d66/ffa [311706,98223] 0 2024-09-13T21:44:52.578 INFO:tasks.workunit.client.0.smithi119.stdout:0/734: dread - de/d1c/d2f/d40/d66/ff4 zero size 2024-09-13T21:44:52.580 INFO:tasks.workunit.client.1.smithi155.stdout:4/333: chown d1/d7/de/d15/f5b 19 1 2024-09-13T21:44:52.580 INFO:tasks.workunit.client.1.smithi155.stdout:3/439: dwrite d3/d25/f5e [0,4194304] 0 2024-09-13T21:44:52.580 INFO:tasks.workunit.client.0.smithi119.stdout:0/735: chown de/l19 3273228 1 2024-09-13T21:44:52.581 INFO:tasks.workunit.client.0.smithi119.stdout:6/678: creat dc/d3d/dcf/fd1 x:0 0 0 2024-09-13T21:44:52.583 INFO:tasks.workunit.client.0.smithi119.stdout:3/717: rename d6/d15/d8f/dbb/cc6 to d6/d15/cf1 0 2024-09-13T21:44:52.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:52 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:44:52.584 INFO:tasks.workunit.client.1.smithi155.stdout:0/371: dwrite d1/f1d [0,4194304] 0 2024-09-13T21:44:52.586 INFO:tasks.workunit.client.1.smithi155.stdout:6/444: dread f7 [0,4194304] 0 2024-09-13T21:44:52.588 INFO:tasks.workunit.client.1.smithi155.stdout:9/392: dread fb [0,4194304] 0 2024-09-13T21:44:52.593 INFO:tasks.workunit.client.1.smithi155.stdout:0/372: truncate d1/d6/dc/d4d/f49 4503706 0 2024-09-13T21:44:52.594 INFO:tasks.workunit.client.1.smithi155.stdout:9/393: unlink dc/d18/d50/f59 0 2024-09-13T21:44:52.596 INFO:tasks.workunit.client.1.smithi155.stdout:3/440: truncate d3/d21/f41 244656 0 2024-09-13T21:44:52.597 INFO:tasks.workunit.client.1.smithi155.stdout:4/334: dwrite d1/f3b [0,4194304] 0 2024-09-13T21:44:52.598 INFO:tasks.workunit.client.1.smithi155.stdout:3/441: truncate d3/f37 1091738 0 2024-09-13T21:44:52.598 INFO:tasks.workunit.client.1.smithi155.stdout:9/394: truncate dc/d19/d23/f2b 1376319 0 2024-09-13T21:44:52.600 INFO:tasks.workunit.client.1.smithi155.stdout:0/373: creat d1/d6/dc/d4d/d4a/d52/d5b/f8f x:0 0 0 2024-09-13T21:44:52.603 INFO:tasks.workunit.client.1.smithi155.stdout:3/442: symlink d3/d25/d1b/d1f/d36/l98 0 2024-09-13T21:44:52.605 INFO:tasks.workunit.client.1.smithi155.stdout:4/335: dread d1/d7/d21/f3a [0,4194304] 0 2024-09-13T21:44:52.607 INFO:tasks.workunit.client.1.smithi155.stdout:3/443: write d3/d25/d17/f89 [340977,89682] 0 2024-09-13T21:44:52.607 INFO:tasks.workunit.client.1.smithi155.stdout:0/374: mkdir d1/d6/dc/d90 0 2024-09-13T21:44:52.607 INFO:tasks.workunit.client.1.smithi155.stdout:4/336: readlink d1/d7/de/l14 0 2024-09-13T21:44:52.609 INFO:tasks.workunit.client.1.smithi155.stdout:3/444: readlink d3/d25/l51 0 2024-09-13T21:44:52.609 INFO:tasks.workunit.client.1.smithi155.stdout:9/395: dread dc/de/f10 [4194304,4194304] 0 2024-09-13T21:44:52.609 INFO:tasks.workunit.client.1.smithi155.stdout:4/337: chown d1/d7/d21/c28 2711043 1 2024-09-13T21:44:52.610 INFO:tasks.workunit.client.1.smithi155.stdout:3/445: fsync d3/d25/f5e 0 2024-09-13T21:44:52.611 INFO:tasks.workunit.client.1.smithi155.stdout:9/396: write dc/d18/d1e/f34 [277740,36686] 0 2024-09-13T21:44:52.611 INFO:tasks.workunit.client.1.smithi155.stdout:3/446: chown d3/d21/d2c/d86 14350795 1 2024-09-13T21:44:52.612 INFO:tasks.workunit.client.1.smithi155.stdout:0/375: write d1/d6/dc/d4d/d4a/d52/d5c/f5d [341525,119016] 0 2024-09-13T21:44:52.614 INFO:tasks.workunit.client.1.smithi155.stdout:9/397: rename dc/de/c12 to dc/d18/c88 0 2024-09-13T21:44:52.615 INFO:tasks.workunit.client.0.smithi119.stdout:6/679: truncate dc/df/f24 996302 0 2024-09-13T21:44:52.615 INFO:tasks.workunit.client.1.smithi155.stdout:3/447: mkdir d3/d25/d1b/d1f/d82/d83/d99 0 2024-09-13T21:44:52.616 INFO:tasks.workunit.client.0.smithi119.stdout:6/680: chown dc/c3f 70558 1 2024-09-13T21:44:52.620 INFO:tasks.workunit.client.1.smithi155.stdout:9/398: dwrite dc/de/f45 [0,4194304] 0 2024-09-13T21:44:52.630 INFO:tasks.workunit.client.1.smithi155.stdout:0/376: symlink d1/d6/l91 0 2024-09-13T21:44:52.631 INFO:tasks.workunit.client.1.smithi155.stdout:0/377: chown d1/f8e 949682307 1 2024-09-13T21:44:52.633 INFO:tasks.workunit.client.1.smithi155.stdout:3/448: symlink d3/d25/l9a 0 2024-09-13T21:44:52.634 INFO:tasks.workunit.client.1.smithi155.stdout:0/378: creat d1/d6/dc/d90/f92 x:0 0 0 2024-09-13T21:44:52.635 INFO:tasks.workunit.client.1.smithi155.stdout:0/379: write d1/f29 [3628636,10935] 0 2024-09-13T21:44:52.636 INFO:tasks.workunit.client.1.smithi155.stdout:3/449: creat d3/d25/d1b/d1f/d82/d83/f9b x:0 0 0 2024-09-13T21:44:52.640 INFO:tasks.workunit.client.0.smithi119.stdout:6/681: write dc/d3d/d40/d6b/f70 [3946581,95043] 0 2024-09-13T21:44:52.641 INFO:tasks.workunit.client.0.smithi119.stdout:6/682: write dc/d3d/d4e/f53 [738954,21308] 0 2024-09-13T21:44:52.641 INFO:tasks.workunit.client.1.smithi155.stdout:0/380: write d1/d6/dc/d4d/d4a/d4e/d61/f6b [234275,103996] 0 2024-09-13T21:44:52.643 INFO:tasks.workunit.client.1.smithi155.stdout:4/338: truncate d1/f6 1843289 0 2024-09-13T21:44:52.644 INFO:tasks.workunit.client.0.smithi119.stdout:6/683: mkdir dc/d3a/dbb/d7a/dd2 0 2024-09-13T21:44:52.644 INFO:tasks.workunit.client.1.smithi155.stdout:6/445: dread db/d12/f23 [0,4194304] 0 2024-09-13T21:44:52.645 INFO:tasks.workunit.client.0.smithi119.stdout:6/684: symlink dc/d3d/d4e/d91/ld3 0 2024-09-13T21:44:52.646 INFO:tasks.workunit.client.0.smithi119.stdout:6/685: read - dc/d3d/d40/d68/fcc zero size 2024-09-13T21:44:52.646 INFO:tasks.workunit.client.1.smithi155.stdout:0/381: creat d1/d6/dc/d8c/f93 x:0 0 0 2024-09-13T21:44:52.647 INFO:tasks.workunit.client.0.smithi119.stdout:6/686: write dc/d3d/f8b [1350233,48444] 0 2024-09-13T21:44:52.647 INFO:tasks.workunit.client.1.smithi155.stdout:6/446: read db/d12/f1a [58883,45370] 0 2024-09-13T21:44:52.649 INFO:tasks.workunit.client.0.smithi119.stdout:6/687: symlink dc/d3a/ld4 0 2024-09-13T21:44:52.650 INFO:tasks.workunit.client.0.smithi119.stdout:6/688: fdatasync dc/dd/f38 0 2024-09-13T21:44:52.651 INFO:tasks.workunit.client.1.smithi155.stdout:3/450: dwrite d3/d25/fb [0,4194304] 0 2024-09-13T21:44:52.651 INFO:tasks.workunit.client.0.smithi119.stdout:6/689: mknod dc/d3a/dbb/d7a/cd5 0 2024-09-13T21:44:52.655 INFO:tasks.workunit.client.1.smithi155.stdout:6/447: rename db/d11/d1e/c20 to db/d3d/d5f/d67/c82 0 2024-09-13T21:44:52.656 INFO:tasks.workunit.client.1.smithi155.stdout:4/339: dwrite d1/d7/de/dc/d2e/f50 [0,4194304] 0 2024-09-13T21:44:52.657 INFO:tasks.workunit.client.0.smithi119.stdout:6/690: dread dc/d3a/dbb/d7a/d7e/fc4 [0,4194304] 0 2024-09-13T21:44:52.659 INFO:tasks.workunit.client.0.smithi119.stdout:6/691: mknod dc/d3a/dbb/cd6 0 2024-09-13T21:44:52.659 INFO:tasks.workunit.client.1.smithi155.stdout:4/340: dread - d1/d7/de/dc/d4a/f56 zero size 2024-09-13T21:44:52.667 INFO:tasks.workunit.client.1.smithi155.stdout:3/451: rename d3/d25/l54 to d3/d25/l9c 0 2024-09-13T21:44:52.669 INFO:tasks.workunit.client.1.smithi155.stdout:6/448: mkdir db/d12/d1c/d36/d83 0 2024-09-13T21:44:52.670 INFO:tasks.workunit.client.1.smithi155.stdout:0/382: rename d1/d6/dc/d4d/d4a/d52/d5c/l66 to d1/d6/dc/d4d/d4a/d52/l94 0 2024-09-13T21:44:52.670 INFO:tasks.workunit.client.1.smithi155.stdout:4/341: dwrite d1/d7/de/dc/d2e/f34 [0,4194304] 0 2024-09-13T21:44:52.673 INFO:tasks.workunit.client.1.smithi155.stdout:3/452: creat d3/d25/d1b/d1f/d82/f9d x:0 0 0 2024-09-13T21:44:52.675 INFO:tasks.workunit.client.1.smithi155.stdout:6/449: write db/d11/d1e/d21/f69 [978511,28681] 0 2024-09-13T21:44:52.676 INFO:tasks.workunit.client.1.smithi155.stdout:0/383: unlink d1/c4 0 2024-09-13T21:44:52.679 INFO:tasks.workunit.client.1.smithi155.stdout:4/342: mknod d1/d7/de/c64 0 2024-09-13T21:44:52.683 INFO:tasks.workunit.client.0.smithi119.stdout:6/692: write dc/df/f24 [1648600,109874] 0 2024-09-13T21:44:52.684 INFO:tasks.workunit.client.0.smithi119.stdout:6/693: readlink dc/df/d41/la6 0 2024-09-13T21:44:52.685 INFO:tasks.workunit.client.1.smithi155.stdout:4/343: unlink d1/d7/de/dc/d2e/d26/l35 0 2024-09-13T21:44:52.686 INFO:tasks.workunit.client.1.smithi155.stdout:4/344: symlink d1/d7/l65 0 2024-09-13T21:44:52.687 INFO:tasks.workunit.client.1.smithi155.stdout:0/384: getdents d1/d6/d74 0 2024-09-13T21:44:52.688 INFO:tasks.workunit.client.1.smithi155.stdout:4/345: read d1/d7/de/dc/d2e/f50 [3658268,8355] 0 2024-09-13T21:44:52.689 INFO:tasks.workunit.client.1.smithi155.stdout:4/346: write d1/d7/d21/f57 [730663,30910] 0 2024-09-13T21:44:52.690 INFO:tasks.workunit.client.0.smithi119.stdout:6/694: dwrite dc/d3a/dbb/d7a/d7e/fb1 [0,4194304] 0 2024-09-13T21:44:52.690 INFO:tasks.workunit.client.1.smithi155.stdout:4/347: chown d1/f4 485279 1 2024-09-13T21:44:52.691 INFO:tasks.workunit.client.0.smithi119.stdout:4/736: sync 2024-09-13T21:44:52.692 INFO:tasks.workunit.client.0.smithi119.stdout:1/740: sync 2024-09-13T21:44:52.693 INFO:tasks.workunit.client.1.smithi155.stdout:6/450: write db/f1f [727353,50504] 0 2024-09-13T21:44:52.693 INFO:tasks.workunit.client.0.smithi119.stdout:6/695: unlink dc/d3a/dbb/d7a/d86/l99 0 2024-09-13T21:44:52.693 INFO:tasks.workunit.client.1.smithi155.stdout:4/348: mkdir d1/d7/de/d15/d55/d5e/d66 0 2024-09-13T21:44:52.694 INFO:tasks.workunit.client.0.smithi119.stdout:1/741: chown d1/d3/d61/d77/d78/d32/f3e 3655265 1 2024-09-13T21:44:52.694 INFO:tasks.workunit.client.1.smithi155.stdout:6/451: chown db/d12/d1c/d36/d37/l47 3413 1 2024-09-13T21:44:52.696 INFO:tasks.workunit.client.0.smithi119.stdout:4/737: mkdir d4/d1e/d28/d34/d6a/d79/d9f/dee 0 2024-09-13T21:44:52.696 INFO:tasks.workunit.client.1.smithi155.stdout:4/349: write d1/f59 [1620805,78747] 0 2024-09-13T21:44:52.697 INFO:tasks.workunit.client.0.smithi119.stdout:1/742: write d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/dd8/fa7 [2175169,129089] 0 2024-09-13T21:44:52.698 INFO:tasks.workunit.client.1.smithi155.stdout:4/350: rename d1/d48 to d1/d48/d67 22 2024-09-13T21:44:52.698 INFO:tasks.workunit.client.1.smithi155.stdout:6/452: creat db/d3d/d5f/f84 x:0 0 0 2024-09-13T21:44:52.698 INFO:tasks.workunit.client.1.smithi155.stdout:0/385: getdents d1/d6/dc/d4d/d4a/d52/d5c/d6a 0 2024-09-13T21:44:52.698 INFO:tasks.workunit.client.0.smithi119.stdout:1/743: stat d1/d3/d61/d7e/d53 0 2024-09-13T21:44:52.699 INFO:tasks.workunit.client.0.smithi119.stdout:4/738: symlink d4/d1e/d26/d60/d71/lef 0 2024-09-13T21:44:52.703 INFO:tasks.workunit.client.1.smithi155.stdout:6/453: mkdir db/d2c/d85 0 2024-09-13T21:44:52.706 INFO:tasks.workunit.client.1.smithi155.stdout:6/454: mkdir db/d11/d86 0 2024-09-13T21:44:52.706 INFO:tasks.workunit.client.0.smithi119.stdout:4/739: dwrite d4/d1e/d26/fdb [0,4194304] 0 2024-09-13T21:44:52.706 INFO:tasks.workunit.client.1.smithi155.stdout:3/453: dread d3/d25/f58 [0,4194304] 0 2024-09-13T21:44:52.707 INFO:tasks.workunit.client.1.smithi155.stdout:3/454: chown d3/d25/d1b/l8f 3241 1 2024-09-13T21:44:52.710 INFO:tasks.workunit.client.1.smithi155.stdout:6/455: rename db/d12/d1c/d36/d46/f7e to db/d11/d2b/f87 0 2024-09-13T21:44:52.713 INFO:tasks.workunit.client.0.smithi119.stdout:4/740: dwrite d4/f52 [0,4194304] 0 2024-09-13T21:44:52.714 INFO:tasks.workunit.client.0.smithi119.stdout:4/741: chown d4/d1e/d28/d34/d66/cc1 6520 1 2024-09-13T21:44:52.716 INFO:tasks.workunit.client.1.smithi155.stdout:3/455: dwrite d3/d25/d1b/d1f/f92 [0,4194304] 0 2024-09-13T21:44:52.716 INFO:tasks.workunit.client.0.smithi119.stdout:4/742: write d4/d1e/d26/d60/d71/f88 [2755514,20616] 0 2024-09-13T21:44:52.717 INFO:tasks.workunit.client.1.smithi155.stdout:0/386: dread d1/f35 [0,4194304] 0 2024-09-13T21:44:52.717 INFO:tasks.workunit.client.0.smithi119.stdout:6/696: dread dc/df/fac [0,4194304] 0 2024-09-13T21:44:52.719 INFO:tasks.workunit.client.1.smithi155.stdout:6/456: rename db/d12/d1c/d36/d37/d73 to db/d11/d4c/d64/d88 0 2024-09-13T21:44:52.719 INFO:tasks.workunit.client.1.smithi155.stdout:6/457: chown db/d2c 92552 1 2024-09-13T21:44:52.720 INFO:tasks.workunit.client.1.smithi155.stdout:3/456: write d3/d25/d1b/f4e [6491246,54462] 0 2024-09-13T21:44:52.721 INFO:tasks.workunit.client.1.smithi155.stdout:4/351: write d1/d7/de/f1f [335689,98911] 0 2024-09-13T21:44:52.721 INFO:tasks.workunit.client.0.smithi119.stdout:1/744: write d1/d3/d61/d77/d78/d32/f64 [7592346,109097] 0 2024-09-13T21:44:52.724 INFO:tasks.workunit.client.1.smithi155.stdout:0/387: symlink d1/d6/l95 0 2024-09-13T21:44:52.725 INFO:tasks.workunit.client.1.smithi155.stdout:6/458: creat db/d3d/d5f/f89 x:0 0 0 2024-09-13T21:44:52.727 INFO:tasks.workunit.client.0.smithi119.stdout:4/743: dwrite d4/d1e/d28/d34/d99/fa4 [0,4194304] 0 2024-09-13T21:44:52.728 INFO:tasks.workunit.client.0.smithi119.stdout:6/697: dwrite dc/d3d/d4e/f53 [0,4194304] 0 2024-09-13T21:44:52.728 INFO:tasks.workunit.client.1.smithi155.stdout:0/388: mknod d1/c96 0 2024-09-13T21:44:52.729 INFO:tasks.workunit.client.0.smithi119.stdout:1/745: read d1/d3/d61/d77/d78/d32/dda/d3d/f98 [2445171,2741] 0 2024-09-13T21:44:52.732 INFO:tasks.workunit.client.0.smithi119.stdout:4/744: mkdir d4/d1e/d28/d34/d99/df0 0 2024-09-13T21:44:52.732 INFO:tasks.workunit.client.0.smithi119.stdout:6/698: mknod dc/d3d/d40/cd7 0 2024-09-13T21:44:52.733 INFO:tasks.workunit.client.1.smithi155.stdout:0/389: mkdir d1/d6/d97 0 2024-09-13T21:44:52.733 INFO:tasks.workunit.client.0.smithi119.stdout:1/746: mkdir d1/d3/d61/d77/d78/db8/dde/df1/df8 0 2024-09-13T21:44:52.735 INFO:tasks.workunit.client.0.smithi119.stdout:4/745: creat d4/d1e/d26/d60/dad/dd5/ff1 x:0 0 0 2024-09-13T21:44:52.736 INFO:tasks.workunit.client.0.smithi119.stdout:1/747: chown d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/fe5 741095 1 2024-09-13T21:44:52.736 INFO:tasks.workunit.client.0.smithi119.stdout:4/746: dread - d4/d1e/f56 zero size 2024-09-13T21:44:52.737 INFO:tasks.workunit.client.0.smithi119.stdout:1/748: chown d1/d3/d6c/l90 302437116 1 2024-09-13T21:44:52.742 INFO:tasks.workunit.client.1.smithi155.stdout:0/390: dwrite d1/d6/dc/f10 [4194304,4194304] 0 2024-09-13T21:44:52.747 INFO:tasks.workunit.client.0.smithi119.stdout:1/749: write d1/d3/dc/f67 [2792967,22950] 0 2024-09-13T21:44:52.750 INFO:tasks.workunit.client.0.smithi119.stdout:1/750: creat d1/d3/d61/d77/d78/d32/dc3/ff9 x:0 0 0 2024-09-13T21:44:52.750 INFO:tasks.workunit.client.1.smithi155.stdout:6/459: dwrite db/d11/d1e/f3e [0,4194304] 0 2024-09-13T21:44:52.751 INFO:tasks.workunit.client.1.smithi155.stdout:6/460: readlink db/d3d/d5f/l71 0 2024-09-13T21:44:52.753 INFO:tasks.workunit.client.0.smithi119.stdout:1/751: creat d1/d3/d61/d77/d78/d32/d33/d72/db4/ffa x:0 0 0 2024-09-13T21:44:52.754 INFO:tasks.workunit.client.1.smithi155.stdout:6/461: read db/d11/f39 [343827,19380] 0 2024-09-13T21:44:52.756 INFO:tasks.workunit.client.1.smithi155.stdout:6/462: symlink db/d3d/d5f/d67/l8a 0 2024-09-13T21:44:52.757 INFO:tasks.workunit.client.1.smithi155.stdout:6/463: write db/d11/d1e/f56 [554030,19361] 0 2024-09-13T21:44:52.760 INFO:tasks.workunit.client.1.smithi155.stdout:6/464: mkdir db/d11/d4c/d7c/d8b 0 2024-09-13T21:44:52.762 INFO:tasks.workunit.client.1.smithi155.stdout:6/465: rename db/d80/f81 to db/d12/d1c/d36/d46/f8c 0 2024-09-13T21:44:52.765 INFO:tasks.workunit.client.1.smithi155.stdout:6/466: rmdir db/d11/d74 0 2024-09-13T21:44:52.766 INFO:tasks.workunit.client.1.smithi155.stdout:6/467: dread - db/d11/d2b/f87 zero size 2024-09-13T21:44:52.767 INFO:tasks.workunit.client.1.smithi155.stdout:6/468: write db/d11/d1e/d21/f42 [5218850,110139] 0 2024-09-13T21:44:52.769 INFO:tasks.workunit.client.1.smithi155.stdout:6/469: mknod db/d12/d1c/d36/d46/c8d 0 2024-09-13T21:44:52.771 INFO:tasks.workunit.client.1.smithi155.stdout:6/470: getdents db/d11/d1e/d21/d44 0 2024-09-13T21:44:52.773 INFO:tasks.workunit.client.1.smithi155.stdout:6/471: mkdir db/d11/d4c/d7c/d8b/d8e 0 2024-09-13T21:44:52.778 INFO:tasks.workunit.client.1.smithi155.stdout:6/472: dwrite db/f1f [0,4194304] 0 2024-09-13T21:44:52.779 INFO:tasks.workunit.client.1.smithi155.stdout:6/473: dread - db/d11/d2b/f72 zero size 2024-09-13T21:44:52.781 INFO:tasks.workunit.client.1.smithi155.stdout:6/474: creat db/d3d/d5f/d67/f8f x:0 0 0 2024-09-13T21:44:52.782 INFO:tasks.workunit.client.1.smithi155.stdout:6/475: getdents db/d2c/d85 0 2024-09-13T21:44:52.789 INFO:tasks.workunit.client.1.smithi155.stdout:6/476: dwrite db/d3d/d5f/f89 [0,4194304] 0 2024-09-13T21:44:52.791 INFO:tasks.workunit.client.1.smithi155.stdout:6/477: mkdir db/d12/d90 0 2024-09-13T21:44:52.795 INFO:tasks.workunit.client.1.smithi155.stdout:6/478: rename db/d11/d1e/d21/f69 to db/d12/d1c/d36/d37/f91 0 2024-09-13T21:44:52.798 INFO:tasks.workunit.client.1.smithi155.stdout:6/479: creat db/d12/d1c/d36/d37/f92 x:0 0 0 2024-09-13T21:44:52.800 INFO:tasks.workunit.client.1.smithi155.stdout:6/480: mkdir db/d11/d4c/d64/d5e/d93 0 2024-09-13T21:44:52.803 INFO:tasks.workunit.client.1.smithi155.stdout:6/481: symlink db/d11/d6d/l94 0 2024-09-13T21:44:52.804 INFO:tasks.workunit.client.1.smithi155.stdout:6/482: mknod db/d2c/d85/c95 0 2024-09-13T21:44:52.805 INFO:tasks.workunit.client.1.smithi155.stdout:6/483: write f3 [39154,76844] 0 2024-09-13T21:44:52.806 INFO:tasks.workunit.client.1.smithi155.stdout:6/484: dread - db/d11/d2b/f72 zero size 2024-09-13T21:44:52.813 INFO:tasks.workunit.client.1.smithi155.stdout:6/485: rename db/d11/d2b/f87 to db/d3d/f96 0 2024-09-13T21:44:52.813 INFO:tasks.workunit.client.1.smithi155.stdout:6/486: creat db/d11/d86/f97 x:0 0 0 2024-09-13T21:44:52.814 INFO:tasks.workunit.client.1.smithi155.stdout:6/487: link db/f1f db/d11/d4c/d64/d88/f98 0 2024-09-13T21:44:52.816 INFO:tasks.workunit.client.1.smithi155.stdout:6/488: mknod db/d11/d4c/c99 0 2024-09-13T21:44:52.816 INFO:tasks.workunit.client.1.smithi155.stdout:6/489: readlink db/d12/d1c/d36/d37/l5a 0 2024-09-13T21:44:52.818 INFO:tasks.workunit.client.1.smithi155.stdout:6/490: mknod db/d11/d2b/c9a 0 2024-09-13T21:44:52.818 INFO:tasks.workunit.client.1.smithi155.stdout:6/491: chown db/d11/d6d/l94 3073 1 2024-09-13T21:44:52.820 INFO:tasks.workunit.client.1.smithi155.stdout:6/492: write db/d12/f1a [2716830,122086] 0 2024-09-13T21:44:52.825 INFO:tasks.workunit.client.1.smithi155.stdout:6/493: dwrite f0 [4194304,4194304] 0 2024-09-13T21:44:52.828 INFO:tasks.workunit.client.1.smithi155.stdout:6/494: unlink db/d11/d86/f97 0 2024-09-13T21:44:52.838 INFO:tasks.workunit.client.0.smithi119.stdout:5/765: sync 2024-09-13T21:44:52.839 INFO:tasks.workunit.client.0.smithi119.stdout:5/766: write d0/d3/d1f/d21/d4f/de6/f100 [489131,72055] 0 2024-09-13T21:44:52.843 INFO:tasks.workunit.client.0.smithi119.stdout:5/767: write d0/d3/d4/d9/d14/f68 [2467967,86786] 0 2024-09-13T21:44:52.845 INFO:tasks.workunit.client.0.smithi119.stdout:5/768: write d0/d3/d4/d9/d14/d24/d25/d67/fda [431063,2556] 0 2024-09-13T21:44:52.847 INFO:tasks.workunit.client.0.smithi119.stdout:5/769: fdatasync d0/d3/d4/d9/d14/d24/f31 0 2024-09-13T21:44:52.852 INFO:tasks.workunit.client.1.smithi155.stdout:6/495: dread db/d11/f14 [0,4194304] 0 2024-09-13T21:44:52.855 INFO:tasks.workunit.client.1.smithi155.stdout:6/496: link db/d11/d4c/d64/d5e/f68 db/d11/d2b/f9b 0 2024-09-13T21:44:52.856 INFO:tasks.workunit.client.1.smithi155.stdout:6/497: mknod db/d11/d4c/d7c/c9c 0 2024-09-13T21:44:52.857 INFO:tasks.workunit.client.1.smithi155.stdout:6/498: stat db/d3d/d5f 0 2024-09-13T21:44:52.858 INFO:tasks.workunit.client.0.smithi119.stdout:5/770: dread d0/d3/d1f/d21/da1/dfb/fd7 [0,4194304] 0 2024-09-13T21:44:52.858 INFO:tasks.workunit.client.1.smithi155.stdout:6/499: truncate db/d11/d2b/f72 220297 0 2024-09-13T21:44:52.858 INFO:tasks.workunit.client.1.smithi155.stdout:6/500: readlink db/d11/d2b/l33 0 2024-09-13T21:44:52.868 INFO:tasks.workunit.client.0.smithi119.stdout:5/771: dread d0/d3/d4/d9/d1e/da5/fc8 [0,4194304] 0 2024-09-13T21:44:52.872 INFO:tasks.workunit.client.0.smithi119.stdout:5/772: dwrite d0/d3/d4/def/fbe [0,4194304] 0 2024-09-13T21:44:52.878 INFO:tasks.workunit.client.0.smithi119.stdout:5/773: truncate d0/d3/d4/d9/d14/ff3 536973 0 2024-09-13T21:44:52.879 INFO:tasks.workunit.client.0.smithi119.stdout:5/774: chown d0/d3/d4/d9/d74/f82 46 1 2024-09-13T21:44:52.881 INFO:tasks.workunit.client.0.smithi119.stdout:5/775: creat d0/d3/d4/d2e/d6b/dcc/f105 x:0 0 0 2024-09-13T21:44:52.891 INFO:tasks.workunit.client.0.smithi119.stdout:5/776: dread d0/d3/d4/d9/d1e/da5/fd4 [0,4194304] 0 2024-09-13T21:44:52.893 INFO:tasks.workunit.client.0.smithi119.stdout:5/777: mkdir d0/d3/d4/d106 0 2024-09-13T21:44:52.894 INFO:tasks.workunit.client.0.smithi119.stdout:5/778: chown d0/d3/d1f/d21/fa9 74508176 1 2024-09-13T21:44:52.895 INFO:tasks.workunit.client.0.smithi119.stdout:5/779: creat d0/d3/d1f/d21/d4f/f107 x:0 0 0 2024-09-13T21:44:52.897 INFO:tasks.workunit.client.0.smithi119.stdout:5/780: rmdir d0/d3/d4/d9/d14/d24 39 2024-09-13T21:44:52.901 INFO:tasks.workunit.client.0.smithi119.stdout:5/781: rename d0/d3/d1f/d21/la4 to d0/d3/d4/d9/d14/d24/db6/de5/l108 0 2024-09-13T21:44:52.905 INFO:tasks.workunit.client.0.smithi119.stdout:5/782: write d0/d3/d4/d2e/d65/f81 [4922150,39632] 0 2024-09-13T21:44:52.910 INFO:tasks.workunit.client.0.smithi119.stdout:5/783: dread d0/d3/d4/def/f5f [0,4194304] 0 2024-09-13T21:44:52.913 INFO:tasks.workunit.client.0.smithi119.stdout:5/784: link d0/d3/d4/d9/f46 d0/d3/d1f/d21/d4f/df8/f109 0 2024-09-13T21:44:52.921 INFO:tasks.workunit.client.0.smithi119.stdout:5/785: dwrite d0/d3/d4/d9/f10 [0,4194304] 0 2024-09-13T21:44:52.926 INFO:tasks.workunit.client.0.smithi119.stdout:5/786: dread d0/d3/d1f/d21/d4f/d86/fc1 [0,4194304] 0 2024-09-13T21:44:52.927 INFO:tasks.workunit.client.0.smithi119.stdout:5/787: chown d0/d3/d1f/d21/d4f/df8/f109 372275 1 2024-09-13T21:44:52.928 INFO:tasks.workunit.client.0.smithi119.stdout:5/788: truncate d0/d3/d4/fdd 954319 0 2024-09-13T21:44:52.934 INFO:tasks.workunit.client.0.smithi119.stdout:7/821: sync 2024-09-13T21:44:52.934 INFO:tasks.workunit.client.0.smithi119.stdout:7/822: chown d8/d4d/lcf 2 1 2024-09-13T21:44:52.939 INFO:tasks.workunit.client.0.smithi119.stdout:7/823: dwrite d8/d3c/d53/d3b/d7e/fda [0,4194304] 0 2024-09-13T21:44:52.944 INFO:tasks.workunit.client.0.smithi119.stdout:7/824: getdents d8/d3c/d53/d3b/d7e 0 2024-09-13T21:44:52.945 INFO:tasks.workunit.client.0.smithi119.stdout:7/825: stat d8/d19/db8/cbb 0 2024-09-13T21:44:52.945 INFO:tasks.workunit.client.0.smithi119.stdout:5/789: dread d0/d3/d4/d9/d1e/f9f [0,4194304] 0 2024-09-13T21:44:52.949 INFO:tasks.workunit.client.0.smithi119.stdout:5/790: mknod d0/d3/d4/c10a 0 2024-09-13T21:44:52.952 INFO:tasks.workunit.client.0.smithi119.stdout:3/718: sync 2024-09-13T21:44:52.953 INFO:tasks.workunit.client.0.smithi119.stdout:6/699: sync 2024-09-13T21:44:52.953 INFO:tasks.workunit.client.0.smithi119.stdout:2/684: sync 2024-09-13T21:44:52.953 INFO:tasks.workunit.client.0.smithi119.stdout:8/756: sync 2024-09-13T21:44:52.953 INFO:tasks.workunit.client.0.smithi119.stdout:9/964: sync 2024-09-13T21:44:52.953 INFO:tasks.workunit.client.0.smithi119.stdout:4/747: sync 2024-09-13T21:44:52.953 INFO:tasks.workunit.client.0.smithi119.stdout:1/752: sync 2024-09-13T21:44:52.953 INFO:tasks.workunit.client.0.smithi119.stdout:0/736: sync 2024-09-13T21:44:52.958 INFO:tasks.workunit.client.0.smithi119.stdout:9/965: chown d0/d8/d18/d23/dea/cb5 2612 1 2024-09-13T21:44:52.963 INFO:tasks.workunit.client.0.smithi119.stdout:8/757: creat d1b/d1d/d48/d54/de0/fe6 x:0 0 0 2024-09-13T21:44:52.963 INFO:tasks.workunit.client.0.smithi119.stdout:1/753: dread d1/d3/d61/f85 [0,4194304] 0 2024-09-13T21:44:52.964 INFO:tasks.workunit.client.0.smithi119.stdout:4/748: rename d4/l31 to d4/d1e/d28/d34/d6a/d79/dae/lf2 0 2024-09-13T21:44:52.965 INFO:tasks.workunit.client.0.smithi119.stdout:0/737: mknod de/d1c/d2f/d40/d66/dcb/dd6/db1/cfb 0 2024-09-13T21:44:52.970 INFO:tasks.workunit.client.0.smithi119.stdout:5/791: dwrite d0/d3/d4/d9/d14/d24/d25/d67/f75 [0,4194304] 0 2024-09-13T21:44:52.971 INFO:tasks.workunit.client.0.smithi119.stdout:6/700: rename dc/df/d41/fa5 to dc/d4b/d6a/dc2/fd8 0 2024-09-13T21:44:52.973 INFO:tasks.workunit.client.0.smithi119.stdout:3/719: dwrite d6/f14 [0,4194304] 0 2024-09-13T21:44:52.974 INFO:tasks.workunit.client.0.smithi119.stdout:2/685: dwrite d1/d7/f2a [0,4194304] 0 2024-09-13T21:44:52.974 INFO:tasks.workunit.client.0.smithi119.stdout:9/966: write d0/d8/d18/d23/d27/d2d/d5f/da8/fb8 [190448,24780] 0 2024-09-13T21:44:52.975 INFO:tasks.workunit.client.0.smithi119.stdout:7/826: dread d8/d3c/d53/f28 [0,4194304] 0 2024-09-13T21:44:52.976 INFO:tasks.workunit.client.0.smithi119.stdout:0/738: write de/d4e/da5/ff3 [992682,104660] 0 2024-09-13T21:44:52.979 INFO:tasks.workunit.client.0.smithi119.stdout:2/686: fsync d1/d7/fba 0 2024-09-13T21:44:52.981 INFO:tasks.workunit.client.0.smithi119.stdout:0/739: chown de/d1c/d2f/d35/dce 17 1 2024-09-13T21:44:52.982 INFO:tasks.workunit.client.0.smithi119.stdout:3/720: write d6/fc [1295517,111012] 0 2024-09-13T21:44:52.987 INFO:tasks.workunit.client.0.smithi119.stdout:1/754: write d1/d3/dc/d24/fb0 [86900,40379] 0 2024-09-13T21:44:52.988 INFO:tasks.workunit.client.0.smithi119.stdout:6/701: mknod dc/d3a/dbb/d7a/dd2/cd9 0 2024-09-13T21:44:52.989 INFO:tasks.workunit.client.0.smithi119.stdout:0/740: fdatasync de/f17 0 2024-09-13T21:44:52.994 INFO:tasks.workunit.client.0.smithi119.stdout:4/749: link d4/d1e/d28/lc7 d4/d1e/d28/d5d/lf3 0 2024-09-13T21:44:52.997 INFO:tasks.workunit.client.0.smithi119.stdout:5/792: rename d0/d3/d4/d9/f64 to d0/d3/d4/d9/d14/f10b 0 2024-09-13T21:44:52.997 INFO:tasks.workunit.client.0.smithi119.stdout:4/750: chown d4/d1e/f36 15964165 1 2024-09-13T21:44:52.997 INFO:tasks.workunit.client.0.smithi119.stdout:8/758: dwrite d1b/d1d/d48/d58/f74 [0,4194304] 0 2024-09-13T21:44:52.998 INFO:tasks.workunit.client.0.smithi119.stdout:6/702: creat dc/df/d6d/fda x:0 0 0 2024-09-13T21:44:53.005 INFO:tasks.workunit.client.0.smithi119.stdout:9/967: dwrite d0/d8/d18/d23/d27/d2d/f5d [0,4194304] 0 2024-09-13T21:44:53.006 INFO:tasks.workunit.client.0.smithi119.stdout:1/755: rename d1/d3/d61/d77/d78/d32/de3 to d1/d3/d61/d77/d78/d32/d33/d72/db4/dfb 0 2024-09-13T21:44:53.006 INFO:tasks.workunit.client.0.smithi119.stdout:6/703: rmdir dc/d4b/d97 39 2024-09-13T21:44:53.006 INFO:tasks.workunit.client.0.smithi119.stdout:8/759: rmdir d1b/d1d/d39 39 2024-09-13T21:44:53.009 INFO:tasks.workunit.client.0.smithi119.stdout:5/793: fsync d0/d3/d4/d2e/d65/fca 0 2024-09-13T21:44:53.009 INFO:tasks.workunit.client.0.smithi119.stdout:9/968: write d0/d8/d18/d23/d42/fc4 [110768,66703] 0 2024-09-13T21:44:53.010 INFO:tasks.workunit.client.0.smithi119.stdout:1/756: write d1/d3/dc/f41 [4909764,14195] 0 2024-09-13T21:44:53.011 INFO:tasks.workunit.client.0.smithi119.stdout:4/751: rename d4/d1e/d26/d60/d71/d83 to d4/ddc/df4 0 2024-09-13T21:44:53.015 INFO:tasks.workunit.client.0.smithi119.stdout:8/760: mkdir d1b/d1d/d5e/de7 0 2024-09-13T21:44:53.016 INFO:tasks.workunit.client.0.smithi119.stdout:5/794: chown d0/d3/d4/d9/d14/d24/d25/d67/l8f 203292 1 2024-09-13T21:44:53.018 INFO:tasks.workunit.client.0.smithi119.stdout:9/969: rmdir d0/d79/d132/d149 0 2024-09-13T21:44:53.019 INFO:tasks.workunit.client.0.smithi119.stdout:1/757: chown d1/d3/d61/d77/d78/d32/d33/d72/c8f 4801 1 2024-09-13T21:44:53.020 INFO:tasks.workunit.client.0.smithi119.stdout:6/704: dwrite f9 [0,4194304] 0 2024-09-13T21:44:53.021 INFO:tasks.workunit.client.0.smithi119.stdout:8/761: write d1b/d1d/d26/d6b/fc8 [435124,3667] 0 2024-09-13T21:44:53.023 INFO:tasks.workunit.client.0.smithi119.stdout:6/705: truncate dc/d4b/fab 857329 0 2024-09-13T21:44:53.024 INFO:tasks.workunit.client.0.smithi119.stdout:8/762: readlink d1b/d1d/d26/d3e/l8e 0 2024-09-13T21:44:53.028 INFO:tasks.workunit.client.0.smithi119.stdout:3/721: dread d6/f16 [0,4194304] 0 2024-09-13T21:44:53.028 INFO:tasks.workunit.client.0.smithi119.stdout:5/795: truncate d0/d3/d4/d9/d1e/f72 874569 0 2024-09-13T21:44:53.029 INFO:tasks.workunit.client.0.smithi119.stdout:2/687: dread d1/d7/f11 [4194304,4194304] 0 2024-09-13T21:44:53.030 INFO:tasks.workunit.client.0.smithi119.stdout:1/758: mknod d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/cfc 0 2024-09-13T21:44:53.032 INFO:tasks.workunit.client.0.smithi119.stdout:2/688: stat d1/d22/d5a 0 2024-09-13T21:44:53.032 INFO:tasks.workunit.client.0.smithi119.stdout:9/970: truncate d0/d8/fd4 232356 0 2024-09-13T21:44:53.034 INFO:tasks.workunit.client.0.smithi119.stdout:8/763: truncate f18 2174829 0 2024-09-13T21:44:53.036 INFO:tasks.workunit.client.0.smithi119.stdout:0/741: dread de/f1a [0,4194304] 0 2024-09-13T21:44:53.037 INFO:tasks.workunit.client.0.smithi119.stdout:3/722: dwrite d6/d15/f35 [0,4194304] 0 2024-09-13T21:44:53.040 INFO:tasks.workunit.client.0.smithi119.stdout:6/706: getdents dc/d3d/d40 0 2024-09-13T21:44:53.040 INFO:tasks.workunit.client.0.smithi119.stdout:9/971: read d0/d8/d18/d23/d27/f32 [2883870,14557] 0 2024-09-13T21:44:53.040 INFO:tasks.workunit.client.0.smithi119.stdout:0/742: mknod de/d4e/d7f/cfc 0 2024-09-13T21:44:53.041 INFO:tasks.workunit.client.0.smithi119.stdout:8/764: unlink d1b/d1d/d48/d54/fdf 0 2024-09-13T21:44:53.042 INFO:tasks.workunit.client.1.smithi155.stdout:8/315: sync 2024-09-13T21:44:53.043 INFO:tasks.workunit.client.0.smithi119.stdout:3/723: write d6/d44/d52/d85/fc5 [974517,119336] 0 2024-09-13T21:44:53.043 INFO:tasks.workunit.client.0.smithi119.stdout:8/765: write f5 [1396633,89374] 0 2024-09-13T21:44:53.044 INFO:tasks.workunit.client.0.smithi119.stdout:5/796: dwrite d0/d3/d4/d9/d14/d24/d25/d67/f75 [0,4194304] 0 2024-09-13T21:44:53.044 INFO:tasks.workunit.client.0.smithi119.stdout:0/743: mknod de/d1c/d2f/d40/cfd 0 2024-09-13T21:44:53.045 INFO:tasks.workunit.client.0.smithi119.stdout:9/972: dread - d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/db9/f114 zero size 2024-09-13T21:44:53.048 INFO:tasks.workunit.client.0.smithi119.stdout:8/766: mknod d1b/d1d/d26/d3e/daa/ce8 0 2024-09-13T21:44:53.049 INFO:tasks.workunit.client.0.smithi119.stdout:5/797: symlink d0/d3/d4/d9/d14/d24/d25/l10c 0 2024-09-13T21:44:53.050 INFO:tasks.workunit.client.0.smithi119.stdout:0/744: creat de/d4e/ffe x:0 0 0 2024-09-13T21:44:53.051 INFO:tasks.workunit.client.0.smithi119.stdout:8/767: fdatasync d1b/d1d/dc3/fc7 0 2024-09-13T21:44:53.052 INFO:tasks.workunit.client.0.smithi119.stdout:8/768: fdatasync d1b/fce 0 2024-09-13T21:44:53.055 INFO:tasks.workunit.client.0.smithi119.stdout:3/724: rmdir d6/d15/d1a/d45/d47/d4d/dcf/dda 0 2024-09-13T21:44:53.055 INFO:tasks.workunit.client.0.smithi119.stdout:8/769: readlink d1b/d1d/l43 0 2024-09-13T21:44:53.057 INFO:tasks.workunit.client.0.smithi119.stdout:8/770: getdents d1b/d1d/db4 0 2024-09-13T21:44:53.057 INFO:tasks.workunit.client.0.smithi119.stdout:0/745: read de/d1c/f29 [3519490,66237] 0 2024-09-13T21:44:53.059 INFO:tasks.workunit.client.0.smithi119.stdout:3/725: dread d6/f13 [0,4194304] 0 2024-09-13T21:44:53.060 INFO:tasks.workunit.client.0.smithi119.stdout:8/771: fdatasync d1b/d1d/d26/d3e/f7c 0 2024-09-13T21:44:53.061 INFO:tasks.workunit.client.0.smithi119.stdout:8/772: truncate d1b/fce 755028 0 2024-09-13T21:44:53.062 INFO:tasks.workunit.client.0.smithi119.stdout:3/726: unlink d6/d25/d2f/d33/d56/dab/cef 0 2024-09-13T21:44:53.062 INFO:tasks.workunit.client.0.smithi119.stdout:8/773: chown d1b/d1d/d48/c93 208613939 1 2024-09-13T21:44:53.063 INFO:tasks.workunit.client.0.smithi119.stdout:3/727: truncate d6/d15/d1a/d45/d8d/fe5 429335 0 2024-09-13T21:44:53.064 INFO:tasks.workunit.client.1.smithi155.stdout:8/316: dread d2/d6/dd/d25/f5d [0,4194304] 0 2024-09-13T21:44:53.064 INFO:tasks.workunit.client.0.smithi119.stdout:3/728: read d6/d25/d2f/d33/d56/f93 [40192,85973] 0 2024-09-13T21:44:53.066 INFO:tasks.workunit.client.0.smithi119.stdout:3/729: truncate d6/f29 3275104 0 2024-09-13T21:44:53.066 INFO:tasks.workunit.client.1.smithi155.stdout:8/317: creat d2/d6/dd/f62 x:0 0 0 2024-09-13T21:44:53.068 INFO:tasks.workunit.client.1.smithi155.stdout:8/318: symlink d2/d6/dd/d25/l63 0 2024-09-13T21:44:53.069 INFO:tasks.workunit.client.1.smithi155.stdout:8/319: truncate d2/d6/dd/d12/f2c 1389365 0 2024-09-13T21:44:53.070 INFO:tasks.workunit.client.0.smithi119.stdout:3/730: dwrite d6/d15/d1a/d45/d47/d4d/da7/fb1 [0,4194304] 0 2024-09-13T21:44:53.076 INFO:tasks.workunit.client.1.smithi155.stdout:8/320: dread d2/d6/f1a [0,4194304] 0 2024-09-13T21:44:53.077 INFO:tasks.workunit.client.0.smithi119.stdout:3/731: dwrite d6/f1c [0,4194304] 0 2024-09-13T21:44:53.078 INFO:tasks.workunit.client.0.smithi119.stdout:3/732: chown d6/d25/d2f/f57 73771 1 2024-09-13T21:44:53.085 INFO:tasks.workunit.client.1.smithi155.stdout:8/321: dwrite d2/d1f/f2b [4194304,4194304] 0 2024-09-13T21:44:53.090 INFO:tasks.workunit.client.1.smithi155.stdout:8/322: fdatasync d2/d6/f27 0 2024-09-13T21:44:53.091 INFO:tasks.workunit.client.1.smithi155.stdout:8/323: chown d2/d1f/f2b 208 1 2024-09-13T21:44:53.095 INFO:tasks.workunit.client.1.smithi155.stdout:8/324: link d2/d2d/l3d d2/d8/l64 0 2024-09-13T21:44:53.096 INFO:tasks.workunit.client.1.smithi155.stdout:8/325: chown d2/d8/c17 3 1 2024-09-13T21:44:53.097 INFO:tasks.workunit.client.1.smithi155.stdout:8/326: write d2/f5 [2800389,21665] 0 2024-09-13T21:44:53.099 INFO:tasks.workunit.client.1.smithi155.stdout:8/327: unlink d2/l13 0 2024-09-13T21:44:53.101 INFO:tasks.workunit.client.0.smithi119.stdout:3/733: dread d6/f3e [0,4194304] 0 2024-09-13T21:44:53.102 INFO:tasks.workunit.client.1.smithi155.stdout:8/328: chown d2/d8/l64 103119 1 2024-09-13T21:44:53.102 INFO:tasks.workunit.client.0.smithi119.stdout:3/734: write d6/d15/d1a/d45/d8d/feb [407075,111034] 0 2024-09-13T21:44:53.103 INFO:tasks.workunit.client.0.smithi119.stdout:3/735: write d6/d15/da9/f9a [605648,35026] 0 2024-09-13T21:44:53.103 INFO:tasks.workunit.client.1.smithi155.stdout:8/329: write d2/d1f/d39/f56 [3689464,53556] 0 2024-09-13T21:44:53.107 INFO:tasks.workunit.client.0.smithi119.stdout:3/736: rename d6/d15/d1a/d45/d47/d4d/da7/dea/fed to d6/d44/d52/ff2 0 2024-09-13T21:44:53.108 INFO:tasks.workunit.client.1.smithi155.stdout:8/330: dread d2/d6/dd/d12/f4a [0,4194304] 0 2024-09-13T21:44:53.110 INFO:tasks.workunit.client.1.smithi155.stdout:8/331: rename d2/d1f/d39 to d2/d8/d65 0 2024-09-13T21:44:53.110 INFO:tasks.workunit.client.0.smithi119.stdout:3/737: dread d6/d15/d1a/d45/d47/d4d/f94 [0,4194304] 0 2024-09-13T21:44:53.111 INFO:tasks.workunit.client.1.smithi155.stdout:8/332: creat d2/d6/dd/d12/f66 x:0 0 0 2024-09-13T21:44:53.113 INFO:tasks.workunit.client.1.smithi155.stdout:8/333: unlink d2/d1f/c23 0 2024-09-13T21:44:53.114 INFO:tasks.workunit.client.0.smithi119.stdout:3/738: rename d6/d44/c70 to d6/d25/d2f/d33/d56/cf3 0 2024-09-13T21:44:53.114 INFO:tasks.workunit.client.1.smithi155.stdout:8/334: symlink d2/d1f/l67 0 2024-09-13T21:44:53.117 INFO:tasks.workunit.client.0.smithi119.stdout:3/739: getdents d6/d15/d1a/d45/d47/d4d/dcf/dd6 0 2024-09-13T21:44:53.120 INFO:tasks.workunit.client.0.smithi119.stdout:7/827: sync 2024-09-13T21:44:53.121 INFO:tasks.workunit.client.0.smithi119.stdout:7/828: symlink d8/d3c/d53/d6b/l10d 0 2024-09-13T21:44:53.121 INFO:tasks.workunit.client.1.smithi155.stdout:8/335: dwrite d2/d6/dd/d12/f1b [0,4194304] 0 2024-09-13T21:44:53.123 INFO:tasks.workunit.client.1.smithi155.stdout:8/336: dread d2/d8/d65/f56 [4194304,4194304] 0 2024-09-13T21:44:53.130 INFO:tasks.workunit.client.0.smithi119.stdout:7/829: dwrite d8/d3c/d53/d37/d83/fb2 [0,4194304] 0 2024-09-13T21:44:53.131 INFO:tasks.workunit.client.1.smithi155.stdout:8/337: getdents d2/d6 0 2024-09-13T21:44:53.133 INFO:tasks.workunit.client.0.smithi119.stdout:6/707: getdents dc/df/d6d 0 2024-09-13T21:44:53.134 INFO:tasks.workunit.client.0.smithi119.stdout:7/830: stat d8/d3c/d53/c93 0 2024-09-13T21:44:53.134 INFO:tasks.workunit.client.0.smithi119.stdout:6/708: readlink dc/d4b/lbc 0 2024-09-13T21:44:53.134 INFO:tasks.workunit.client.0.smithi119.stdout:6/709: stat dc/d3d/d40/dce 0 2024-09-13T21:44:53.135 INFO:tasks.workunit.client.1.smithi155.stdout:8/338: creat d2/d8/d65/f68 x:0 0 0 2024-09-13T21:44:53.135 INFO:tasks.workunit.client.0.smithi119.stdout:6/710: chown dc/d4b/fc1 603 1 2024-09-13T21:44:53.135 INFO:tasks.workunit.client.1.smithi155.stdout:8/339: readlink d2/d8/l32 0 2024-09-13T21:44:53.138 INFO:tasks.workunit.client.1.smithi155.stdout:8/340: creat d2/d2d/f69 x:0 0 0 2024-09-13T21:44:53.138 INFO:tasks.workunit.client.0.smithi119.stdout:7/831: truncate d8/d4d/f52 1027529 0 2024-09-13T21:44:53.139 INFO:tasks.workunit.client.0.smithi119.stdout:6/711: mknod dc/d3a/dbb/cdb 0 2024-09-13T21:44:53.140 INFO:tasks.workunit.client.1.smithi155.stdout:8/341: readlink d2/d2d/l3d 0 2024-09-13T21:44:53.141 INFO:tasks.workunit.client.1.smithi155.stdout:8/342: dread - d2/d6/dd/f62 zero size 2024-09-13T21:44:53.143 INFO:tasks.workunit.client.1.smithi155.stdout:8/343: truncate d2/d6/dd/f4e 843277 0 2024-09-13T21:44:53.150 INFO:tasks.workunit.client.0.smithi119.stdout:6/712: read - dc/d4b/f8c zero size 2024-09-13T21:44:53.151 INFO:tasks.workunit.client.0.smithi119.stdout:4/752: dwrite d4/d1e/d26/d6d/f91 [0,4194304] 0 2024-09-13T21:44:53.156 INFO:tasks.workunit.client.0.smithi119.stdout:7/832: dwrite d8/d3c/d53/d6b/ffb [0,4194304] 0 2024-09-13T21:44:53.158 INFO:tasks.workunit.client.0.smithi119.stdout:6/713: mknod dc/d3a/cdc 0 2024-09-13T21:44:53.161 INFO:tasks.workunit.client.0.smithi119.stdout:1/759: dwrite d1/d3/d61/d77/d78/d32/d33/d72/fcc [0,4194304] 0 2024-09-13T21:44:53.164 INFO:tasks.workunit.client.0.smithi119.stdout:6/714: write f9 [56238,123898] 0 2024-09-13T21:44:53.164 INFO:tasks.workunit.client.0.smithi119.stdout:5/798: fsync d0/d3/d4/d9/d14/d24/d25/d67/f75 0 2024-09-13T21:44:53.164 INFO:tasks.workunit.client.0.smithi119.stdout:2/689: dwrite d1/d38/f9a [0,4194304] 0 2024-09-13T21:44:53.164 INFO:tasks.workunit.client.1.smithi155.stdout:8/344: rmdir d2/d6/dd 39 2024-09-13T21:44:53.165 INFO:tasks.workunit.client.0.smithi119.stdout:9/973: write d0/d8/d18/d23/d27/d2d/dc1/ddf/fa9 [453897,48632] 0 2024-09-13T21:44:53.165 INFO:tasks.workunit.client.0.smithi119.stdout:8/774: truncate d1b/d1d/d26/f89 3204713 0 2024-09-13T21:44:53.168 INFO:tasks.workunit.client.0.smithi119.stdout:2/690: stat d1/d22/d5a/f63 0 2024-09-13T21:44:53.168 INFO:tasks.workunit.client.1.smithi155.stdout:8/345: creat d2/d6/f6a x:0 0 0 2024-09-13T21:44:53.169 INFO:tasks.workunit.client.0.smithi119.stdout:7/833: mkdir d8/d3c/d53/d37/d83/d89/dc3/d10e 0 2024-09-13T21:44:53.170 INFO:tasks.workunit.client.0.smithi119.stdout:4/753: creat d4/d1e/d28/ff5 x:0 0 0 2024-09-13T21:44:53.177 INFO:tasks.workunit.client.0.smithi119.stdout:7/834: unlink d8/d3c/d53/ff6 0 2024-09-13T21:44:53.177 INFO:tasks.workunit.client.0.smithi119.stdout:8/775: truncate d1b/d1d/d26/d3e/d65/f88 8634556 0 2024-09-13T21:44:53.179 INFO:tasks.workunit.client.0.smithi119.stdout:2/691: creat d1/d38/d89/d6b/d8c/fda x:0 0 0 2024-09-13T21:44:53.179 INFO:tasks.workunit.client.0.smithi119.stdout:0/746: dwrite de/d1c/f5c [0,4194304] 0 2024-09-13T21:44:53.180 INFO:tasks.workunit.client.0.smithi119.stdout:9/974: read d0/d8/d18/d23/d27/d2d/d5f/fcf [4003726,56703] 0 2024-09-13T21:44:53.184 INFO:tasks.workunit.client.1.smithi155.stdout:8/346: dread d2/d8/d65/f41 [0,4194304] 0 2024-09-13T21:44:53.187 INFO:tasks.workunit.client.0.smithi119.stdout:7/835: chown d8/d19/d2e/d34/lde 659 1 2024-09-13T21:44:53.187 INFO:tasks.workunit.client.0.smithi119.stdout:4/754: rename d4/d1e/d26/d60/d69/fa9 to d4/d1e/d28/d34/d99/ff6 0 2024-09-13T21:44:53.189 INFO:tasks.workunit.client.0.smithi119.stdout:1/760: dwrite d1/d3/d61/d77/d78/d32/dda/d19/fb7 [0,4194304] 0 2024-09-13T21:44:53.192 INFO:tasks.workunit.client.0.smithi119.stdout:8/776: dread - d1b/d1d/d39/fe5 zero size 2024-09-13T21:44:53.192 INFO:tasks.workunit.client.0.smithi119.stdout:2/692: unlink d1/d22/d5a/d5d/d77/daa/lcd 0 2024-09-13T21:44:53.192 INFO:tasks.workunit.client.1.smithi155.stdout:8/347: dwrite d2/d6/dd/d25/f4c [0,4194304] 0 2024-09-13T21:44:53.193 INFO:tasks.workunit.client.0.smithi119.stdout:3/740: dwrite d6/f6c [0,4194304] 0 2024-09-13T21:44:53.194 INFO:tasks.workunit.client.1.smithi155.stdout:8/348: truncate d2/d2d/f69 849700 0 2024-09-13T21:44:53.196 INFO:tasks.workunit.client.0.smithi119.stdout:9/975: chown d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/f3b 23106353 1 2024-09-13T21:44:53.199 INFO:tasks.workunit.client.0.smithi119.stdout:7/836: creat d8/d3c/d53/d3b/dbf/f10f x:0 0 0 2024-09-13T21:44:53.200 INFO:tasks.workunit.client.0.smithi119.stdout:2/693: read - d1/d22/d5a/d5d/f8e zero size 2024-09-13T21:44:53.201 INFO:tasks.workunit.client.0.smithi119.stdout:3/741: fsync d6/d15/d1a/f79 0 2024-09-13T21:44:53.204 INFO:tasks.workunit.client.1.smithi155.stdout:8/349: read d2/d6/dd/d12/f3a [317038,35194] 0 2024-09-13T21:44:53.208 INFO:tasks.workunit.client.0.smithi119.stdout:4/755: truncate d4/d1e/f56 717131 0 2024-09-13T21:44:53.208 INFO:tasks.workunit.client.1.smithi155.stdout:8/350: mkdir d2/d6/dd/d6b 0 2024-09-13T21:44:53.208 INFO:tasks.workunit.client.1.smithi155.stdout:8/351: fsync d2/d8/d65/f3e 0 2024-09-13T21:44:53.209 INFO:tasks.workunit.client.0.smithi119.stdout:6/715: truncate dc/df/f24 1561417 0 2024-09-13T21:44:53.210 INFO:tasks.workunit.client.0.smithi119.stdout:8/777: mkdir d1b/d1d/d26/d3e/d65/de9 0 2024-09-13T21:44:53.210 INFO:tasks.workunit.client.0.smithi119.stdout:9/976: dread - d0/d8/d18/d23/d42/d52/f14b zero size 2024-09-13T21:44:53.225 INFO:tasks.workunit.client.0.smithi119.stdout:0/747: dread fc [0,4194304] 0 2024-09-13T21:44:53.230 INFO:tasks.workunit.client.0.smithi119.stdout:1/761: dread d1/d3/d61/d77/da6/fac [0,4194304] 0 2024-09-13T21:44:53.231 INFO:tasks.workunit.client.0.smithi119.stdout:0/748: dwrite de/d49/fb0 [0,4194304] 0 2024-09-13T21:44:53.233 INFO:tasks.workunit.client.0.smithi119.stdout:0/749: truncate de/d1c/d2f/d35/f67 1073366 0 2024-09-13T21:44:53.235 INFO:tasks.workunit.client.0.smithi119.stdout:1/762: truncate d1/d3/d61/d77/d78/d32/d33/d72/ff2 845341 0 2024-09-13T21:44:53.241 INFO:tasks.workunit.client.0.smithi119.stdout:0/750: dwrite de/d49/fdb [0,4194304] 0 2024-09-13T21:44:53.242 INFO:tasks.workunit.client.0.smithi119.stdout:2/694: unlink d1/d22/d55/c80 0 2024-09-13T21:44:53.244 INFO:tasks.workunit.client.0.smithi119.stdout:9/977: creat d0/d19/f152 x:0 0 0 2024-09-13T21:44:53.246 INFO:tasks.workunit.client.0.smithi119.stdout:7/837: rename d8/d19/d2e/d34/lde to d8/d3c/d53/d37/d57/d8f/l110 0 2024-09-13T21:44:53.246 INFO:tasks.workunit.client.0.smithi119.stdout:9/978: write d0/d8/d18/d23/f69 [291968,120741] 0 2024-09-13T21:44:53.246 INFO:tasks.workunit.client.0.smithi119.stdout:8/778: symlink d1b/d1d/d48/d58/d7f/dcb/lea 0 2024-09-13T21:44:53.248 INFO:tasks.workunit.client.0.smithi119.stdout:0/751: dread de/d1c/d2b/fe2 [0,4194304] 0 2024-09-13T21:44:53.249 INFO:tasks.workunit.client.0.smithi119.stdout:1/763: mknod d1/d3/d61/d77/d78/d32/dda/d3d/cfd 0 2024-09-13T21:44:53.249 INFO:tasks.workunit.client.1.smithi155.stdout:8/352: dread d2/f4b [0,4194304] 0 2024-09-13T21:44:53.251 INFO:tasks.workunit.client.1.smithi155.stdout:8/353: truncate d2/d6/dd/f4e 1280728 0 2024-09-13T21:44:53.251 INFO:tasks.workunit.client.0.smithi119.stdout:3/742: symlink d6/d15/d1a/d45/lf4 0 2024-09-13T21:44:53.252 INFO:tasks.workunit.client.0.smithi119.stdout:2/695: creat d1/d7/fdb x:0 0 0 2024-09-13T21:44:53.253 INFO:tasks.workunit.client.0.smithi119.stdout:4/756: getdents d4/d1e/d28/d34/d6a/d79/d9f/dee 0 2024-09-13T21:44:53.254 INFO:tasks.workunit.client.1.smithi155.stdout:8/354: getdents d2/d6 0 2024-09-13T21:44:53.255 INFO:tasks.workunit.client.1.smithi155.stdout:8/355: creat d2/d2d/f6c x:0 0 0 2024-09-13T21:44:53.256 INFO:tasks.workunit.client.0.smithi119.stdout:8/779: unlink d1b/d1d/d48/d58/d7f/dcb/lea 0 2024-09-13T21:44:53.258 INFO:tasks.workunit.client.1.smithi155.stdout:8/356: creat d2/d6/dd/d25/f6d x:0 0 0 2024-09-13T21:44:53.258 INFO:tasks.workunit.client.1.smithi155.stdout:7/369: sync 2024-09-13T21:44:53.258 INFO:tasks.workunit.client.1.smithi155.stdout:5/336: sync 2024-09-13T21:44:53.258 INFO:tasks.workunit.client.1.smithi155.stdout:2/269: sync 2024-09-13T21:44:53.259 INFO:tasks.workunit.client.1.smithi155.stdout:8/357: dread - d2/d6/dd/d25/f6d zero size 2024-09-13T21:44:53.259 INFO:tasks.workunit.client.1.smithi155.stdout:7/370: stat d5/df/c5a 0 2024-09-13T21:44:53.260 INFO:tasks.workunit.client.0.smithi119.stdout:2/696: creat d1/d22/d5a/d5d/d83/fdc x:0 0 0 2024-09-13T21:44:53.260 INFO:tasks.workunit.client.1.smithi155.stdout:7/371: stat d5/d10/d3e/d3f/f4a 0 2024-09-13T21:44:53.261 INFO:tasks.workunit.client.1.smithi155.stdout:7/372: stat d5/d10/d3e/f6b 0 2024-09-13T21:44:53.261 INFO:tasks.workunit.client.1.smithi155.stdout:5/337: read d5/f6 [2759737,11207] 0 2024-09-13T21:44:53.262 INFO:tasks.workunit.client.0.smithi119.stdout:9/979: mknod d0/d19/de4/d145/c153 0 2024-09-13T21:44:53.263 INFO:tasks.workunit.client.1.smithi155.stdout:2/270: creat d2/db/f63 x:0 0 0 2024-09-13T21:44:53.264 INFO:tasks.workunit.client.1.smithi155.stdout:7/373: symlink d5/d10/d3e/d3f/d61/l71 0 2024-09-13T21:44:53.264 INFO:tasks.workunit.client.0.smithi119.stdout:3/743: dwrite d6/d25/d2f/f57 [0,4194304] 0 2024-09-13T21:44:53.268 INFO:tasks.workunit.client.1.smithi155.stdout:8/358: dwrite d2/f30 [0,4194304] 0 2024-09-13T21:44:53.269 INFO:tasks.workunit.client.1.smithi155.stdout:5/338: rename d5/d26 to d5/d16/d33/d1b/d2f/d3c/d6c 0 2024-09-13T21:44:53.269 INFO:tasks.workunit.client.1.smithi155.stdout:8/359: chown d2/c61 3 1 2024-09-13T21:44:53.269 INFO:tasks.workunit.client.0.smithi119.stdout:7/838: creat d8/f111 x:0 0 0 2024-09-13T21:44:53.272 INFO:tasks.workunit.client.0.smithi119.stdout:7/839: readlink d8/d3c/d53/d37/d83/d89/lb 0 2024-09-13T21:44:53.273 INFO:tasks.workunit.client.1.smithi155.stdout:3/457: sync 2024-09-13T21:44:53.273 INFO:tasks.workunit.client.1.smithi155.stdout:4/352: sync 2024-09-13T21:44:53.273 INFO:tasks.workunit.client.1.smithi155.stdout:1/352: sync 2024-09-13T21:44:53.274 INFO:tasks.workunit.client.1.smithi155.stdout:0/391: sync 2024-09-13T21:44:53.274 INFO:tasks.workunit.client.1.smithi155.stdout:6/501: sync 2024-09-13T21:44:53.274 INFO:tasks.workunit.client.1.smithi155.stdout:9/399: sync 2024-09-13T21:44:53.275 INFO:tasks.workunit.client.0.smithi119.stdout:8/780: creat d1b/d1d/dc3/de1/feb x:0 0 0 2024-09-13T21:44:53.276 INFO:tasks.workunit.client.1.smithi155.stdout:4/353: stat d1/d7/de/dc/l13 0 2024-09-13T21:44:53.276 INFO:tasks.workunit.client.0.smithi119.stdout:1/764: link d1/d3/d61/d77/d78/ccd d1/d3/d61/d77/d78/db8/dde/df1/cfe 0 2024-09-13T21:44:53.277 INFO:tasks.workunit.client.1.smithi155.stdout:7/374: rename d5/df/d60/d6d/c5c to d5/d10/c72 0 2024-09-13T21:44:53.281 INFO:tasks.workunit.client.1.smithi155.stdout:1/353: rmdir d6/d15 39 2024-09-13T21:44:53.282 INFO:tasks.workunit.client.0.smithi119.stdout:0/752: dwrite de/d1c/d52/f7a [0,4194304] 0 2024-09-13T21:44:53.282 INFO:tasks.workunit.client.0.smithi119.stdout:3/744: truncate d6/d15/d1a/f41 953177 0 2024-09-13T21:44:53.282 INFO:tasks.workunit.client.0.smithi119.stdout:9/980: dwrite d0/d79/da4/fc3 [0,4194304] 0 2024-09-13T21:44:53.282 INFO:tasks.workunit.client.0.smithi119.stdout:0/753: readlink de/d49/l9e 0 2024-09-13T21:44:53.282 INFO:tasks.workunit.client.0.smithi119.stdout:4/757: dread d4/d1e/f50 [0,4194304] 0 2024-09-13T21:44:53.283 INFO:tasks.workunit.client.0.smithi119.stdout:3/745: readlink d6/d15/d8f/lb6 0 2024-09-13T21:44:53.287 INFO:tasks.workunit.client.1.smithi155.stdout:8/360: dwrite d2/f47 [0,4194304] 0 2024-09-13T21:44:53.287 INFO:tasks.workunit.client.0.smithi119.stdout:9/981: truncate d0/d8/d18/d23/d27/d2d/d5f/f104 1858937 0 2024-09-13T21:44:53.288 INFO:tasks.workunit.client.1.smithi155.stdout:0/392: creat d1/d6/dc/d4d/d4a/f98 x:0 0 0 2024-09-13T21:44:53.290 INFO:tasks.workunit.client.0.smithi119.stdout:1/765: rmdir d1/d3/d61/d77/d78/d32/d33/d72/db4 39 2024-09-13T21:44:53.291 INFO:tasks.workunit.client.0.smithi119.stdout:1/766: read d1/d3/d61/d77/da6/fac [739646,96682] 0 2024-09-13T21:44:53.292 INFO:tasks.workunit.client.0.smithi119.stdout:8/781: chown d1b/d1d/d26/f89 55188940 1 2024-09-13T21:44:53.294 INFO:tasks.workunit.client.0.smithi119.stdout:7/840: getdents d8/d3c/d53/d37/d83/d89/de7 0 2024-09-13T21:44:53.296 INFO:tasks.workunit.client.1.smithi155.stdout:7/375: rename d5/df/c5a to d5/df/d15/c73 0 2024-09-13T21:44:53.297 INFO:tasks.workunit.client.0.smithi119.stdout:7/841: chown d8/c14 210 1 2024-09-13T21:44:53.297 INFO:tasks.workunit.client.0.smithi119.stdout:6/716: write dc/df/f44 [1872059,66423] 0 2024-09-13T21:44:53.298 INFO:tasks.workunit.client.1.smithi155.stdout:5/339: link d5/d16/d33/d1b/d2f/d3c/d5b/f67 d5/d16/d33/d1b/d2f/d3c/d6c/d45/f6d 0 2024-09-13T21:44:53.298 INFO:tasks.workunit.client.1.smithi155.stdout:2/271: truncate d2/db/f18 250823 0 2024-09-13T21:44:53.298 INFO:tasks.workunit.client.0.smithi119.stdout:8/782: rmdir d1b/d1d 39 2024-09-13T21:44:53.299 INFO:tasks.workunit.client.1.smithi155.stdout:8/361: chown d2/d6/c18 193 1 2024-09-13T21:44:53.302 INFO:tasks.workunit.client.0.smithi119.stdout:9/982: dwrite d0/d8/d18/d23/d27/d2d/dc1/ddf/d81/d128/f131 [0,4194304] 0 2024-09-13T21:44:53.303 INFO:tasks.workunit.client.1.smithi155.stdout:3/458: creat d3/d25/d1b/d1f/d36/d7c/f9e x:0 0 0 2024-09-13T21:44:53.304 INFO:tasks.workunit.client.0.smithi119.stdout:4/758: rename d4/d1e/d28/d34/d6a/d79/d9f/dba/dc9 to d4/d1e/df7 0 2024-09-13T21:44:53.304 INFO:tasks.workunit.client.1.smithi155.stdout:7/376: write f3 [894223,74567] 0 2024-09-13T21:44:53.305 INFO:tasks.workunit.client.1.smithi155.stdout:2/272: write d2/dd/f17 [1171222,61172] 0 2024-09-13T21:44:53.305 INFO:tasks.workunit.client.0.smithi119.stdout:1/767: creat d1/d3/d61/d77/d78/d32/d33/d43/fff x:0 0 0 2024-09-13T21:44:53.308 INFO:tasks.workunit.client.0.smithi119.stdout:3/746: link d6/d15/d1a/d45/d47/d4d/da7/le7 d6/d15/d1a/d45/d47/d4d/dcf/lf5 0 2024-09-13T21:44:53.309 INFO:tasks.workunit.client.1.smithi155.stdout:6/502: dwrite db/d11/d4c/d64/f77 [0,4194304] 0 2024-09-13T21:44:53.311 INFO:tasks.workunit.client.0.smithi119.stdout:6/717: dread dc/dd/f2e [0,4194304] 0 2024-09-13T21:44:53.311 INFO:tasks.workunit.client.0.smithi119.stdout:8/783: chown d1b/d1d/d26/d6b/fc8 31165150 1 2024-09-13T21:44:53.313 INFO:tasks.workunit.client.1.smithi155.stdout:4/354: truncate d1/f1c 4853051 0 2024-09-13T21:44:53.314 INFO:tasks.workunit.client.0.smithi119.stdout:7/842: dwrite d8/d3c/d53/d37/d83/d89/f32 [4194304,4194304] 0 2024-09-13T21:44:53.316 INFO:tasks.workunit.client.1.smithi155.stdout:8/362: fdatasync d2/d8/d65/f41 0 2024-09-13T21:44:53.316 INFO:tasks.workunit.client.1.smithi155.stdout:2/273: write d2/dd/f2c [178867,51646] 0 2024-09-13T21:44:53.319 INFO:tasks.workunit.client.0.smithi119.stdout:7/843: symlink d8/d3c/d53/d3b/l112 0 2024-09-13T21:44:53.320 INFO:tasks.workunit.client.0.smithi119.stdout:2/697: write d1/d22/d5a/d5d/f8e [51669,58748] 0 2024-09-13T21:44:53.320 INFO:tasks.workunit.client.1.smithi155.stdout:2/274: stat d2/dd/de/d15/d38/f4f 0 2024-09-13T21:44:53.321 INFO:tasks.workunit.client.1.smithi155.stdout:1/354: getdents d6/d7/d48 0 2024-09-13T21:44:53.323 INFO:tasks.workunit.client.1.smithi155.stdout:9/400: dwrite dc/f54 [0,4194304] 0 2024-09-13T21:44:53.323 INFO:tasks.workunit.client.1.smithi155.stdout:0/393: dread d1/d6/dc/f72 [0,4194304] 0 2024-09-13T21:44:53.323 INFO:tasks.workunit.client.0.smithi119.stdout:9/983: truncate d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/f118 112395 0 2024-09-13T21:44:53.325 INFO:tasks.workunit.client.0.smithi119.stdout:8/784: rename d1b/d1d/c8a to d1b/d4e/d6a/cec 0 2024-09-13T21:44:53.328 INFO:tasks.workunit.client.1.smithi155.stdout:5/340: dwrite d5/f49 [0,4194304] 0 2024-09-13T21:44:53.330 INFO:tasks.workunit.client.0.smithi119.stdout:3/747: dwrite d6/f13 [0,4194304] 0 2024-09-13T21:44:53.333 INFO:tasks.workunit.client.1.smithi155.stdout:9/401: fdatasync dc/de/d15/f1c 0 2024-09-13T21:44:53.335 INFO:tasks.workunit.client.1.smithi155.stdout:3/459: creat d3/d25/d1b/d1f/d36/d7c/f9f x:0 0 0 2024-09-13T21:44:53.336 INFO:tasks.workunit.client.0.smithi119.stdout:9/984: mkdir d0/d8/d18/d23/d27/d2d/dc1/ddf/d81/d154 0 2024-09-13T21:44:53.336 INFO:tasks.workunit.client.0.smithi119.stdout:8/785: read d1b/d1d/d48/f96 [820866,50136] 0 2024-09-13T21:44:53.337 INFO:tasks.workunit.client.1.smithi155.stdout:8/363: mknod d2/c6e 0 2024-09-13T21:44:53.337 INFO:tasks.workunit.client.1.smithi155.stdout:0/394: unlink d1/d6/f64 0 2024-09-13T21:44:53.338 INFO:tasks.workunit.client.0.smithi119.stdout:3/748: mknod d6/d25/d2f/d33/d56/dab/cf6 0 2024-09-13T21:44:53.341 INFO:tasks.workunit.client.0.smithi119.stdout:7/844: dwrite d8/d3c/d53/d3b/d7e/dc2/fef [0,4194304] 0 2024-09-13T21:44:53.342 INFO:tasks.workunit.client.1.smithi155.stdout:7/377: dwrite d5/df/d15/f53 [0,4194304] 0 2024-09-13T21:44:53.343 INFO:tasks.workunit.client.1.smithi155.stdout:4/355: rename d1/d7/de/dc/d2e/d26/f41 to d1/d7/de/d1a/f68 0 2024-09-13T21:44:53.343 INFO:tasks.workunit.client.1.smithi155.stdout:7/378: readlink d5/d10/d3e/l3c 0 2024-09-13T21:44:53.347 INFO:tasks.workunit.client.0.smithi119.stdout:9/985: mkdir d0/d8/d18/d23/d27/d2d/ddb/df1/d155 0 2024-09-13T21:44:53.350 INFO:tasks.workunit.client.1.smithi155.stdout:9/402: creat dc/de/d2d/f89 x:0 0 0 2024-09-13T21:44:53.351 INFO:tasks.workunit.client.0.smithi119.stdout:8/786: truncate fd 127771 0 2024-09-13T21:44:53.353 INFO:tasks.workunit.client.0.smithi119.stdout:3/749: creat d6/d15/d1a/d45/d47/d4d/dcf/dd0/ff7 x:0 0 0 2024-09-13T21:44:53.354 INFO:tasks.workunit.client.0.smithi119.stdout:4/759: dwrite d4/f29 [0,4194304] 0 2024-09-13T21:44:53.355 INFO:tasks.workunit.client.1.smithi155.stdout:3/460: creat d3/d25/fa0 x:0 0 0 2024-09-13T21:44:53.356 INFO:tasks.workunit.client.1.smithi155.stdout:1/355: dwrite d6/f16 [0,4194304] 0 2024-09-13T21:44:53.356 INFO:tasks.workunit.client.1.smithi155.stdout:7/379: mknod d5/d10/d3e/d3f/d61/c74 0 2024-09-13T21:44:53.359 INFO:tasks.workunit.client.0.smithi119.stdout:3/750: symlink d6/d15/d1a/d45/d8d/lf8 0 2024-09-13T21:44:53.360 INFO:tasks.workunit.client.0.smithi119.stdout:6/718: dread dc/df/d41/f82 [0,4194304] 0 2024-09-13T21:44:53.361 INFO:tasks.workunit.client.1.smithi155.stdout:8/364: dwrite d2/d6/f19 [4194304,4194304] 0 2024-09-13T21:44:53.361 INFO:tasks.workunit.client.1.smithi155.stdout:9/403: mknod dc/de/d2d/d79/c8a 0 2024-09-13T21:44:53.362 INFO:tasks.workunit.client.0.smithi119.stdout:7/845: rename d8/d19/d2e/d34/d6e to d8/d113 0 2024-09-13T21:44:53.363 INFO:tasks.workunit.client.1.smithi155.stdout:7/380: rmdir d5/d10/d3e/d3f/d61 39 2024-09-13T21:44:53.363 INFO:tasks.workunit.client.0.smithi119.stdout:9/986: dread d0/fa5 [0,4194304] 0 2024-09-13T21:44:53.365 INFO:tasks.workunit.client.1.smithi155.stdout:1/356: read - d6/d15/f76 zero size 2024-09-13T21:44:53.367 INFO:tasks.workunit.client.1.smithi155.stdout:9/404: symlink dc/d19/d23/d70/l8b 0 2024-09-13T21:44:53.369 INFO:tasks.workunit.client.1.smithi155.stdout:9/405: write dc/d19/f48 [1175855,8075] 0 2024-09-13T21:44:53.371 INFO:tasks.workunit.client.1.smithi155.stdout:7/381: creat d5/df/f75 x:0 0 0 2024-09-13T21:44:53.371 INFO:tasks.workunit.client.0.smithi119.stdout:8/787: creat d1b/d1d/d26/fed x:0 0 0 2024-09-13T21:44:53.371 INFO:tasks.workunit.client.0.smithi119.stdout:6/719: symlink dc/df/d41/dae/ldd 0 2024-09-13T21:44:53.373 INFO:tasks.workunit.client.1.smithi155.stdout:9/406: stat dc/de/d2d/c57 0 2024-09-13T21:44:53.373 INFO:tasks.workunit.client.1.smithi155.stdout:3/461: rename d3/f37 to d3/d25/d1b/d1f/d36/d5c/d66/fa1 0 2024-09-13T21:44:53.374 INFO:tasks.workunit.client.1.smithi155.stdout:8/365: symlink d2/d6/dd/d6b/l6f 0 2024-09-13T21:44:53.375 INFO:tasks.workunit.client.0.smithi119.stdout:2/698: dwrite d1/d22/db6/fc4 [4194304,4194304] 0 2024-09-13T21:44:53.375 INFO:tasks.workunit.client.0.smithi119.stdout:3/751: dread d6/d15/d1a/f55 [0,4194304] 0 2024-09-13T21:44:53.376 INFO:tasks.workunit.client.1.smithi155.stdout:1/357: creat d6/d15/d57/d5d/f7f x:0 0 0 2024-09-13T21:44:53.378 INFO:tasks.workunit.client.0.smithi119.stdout:4/760: dwrite d4/d1e/d28/d34/d99/fa4 [4194304,4194304] 0 2024-09-13T21:44:53.379 INFO:tasks.workunit.client.1.smithi155.stdout:7/382: symlink d5/df/d15/d33/l76 0 2024-09-13T21:44:53.380 INFO:tasks.workunit.client.0.smithi119.stdout:8/788: dread - d1b/d4e/d6a/fd5 zero size 2024-09-13T21:44:53.380 INFO:tasks.workunit.client.0.smithi119.stdout:3/752: chown d6/d15/d1a/d45/d47/dd4 136836 1 2024-09-13T21:44:53.383 INFO:tasks.workunit.client.1.smithi155.stdout:7/383: write d5/df/d15/f53 [1307017,4636] 0 2024-09-13T21:44:53.384 INFO:tasks.workunit.client.0.smithi119.stdout:2/699: fdatasync d1/d38/d89/d6b/f65 0 2024-09-13T21:44:53.385 INFO:tasks.workunit.client.1.smithi155.stdout:9/407: unlink dc/de/d15/f7f 0 2024-09-13T21:44:53.386 INFO:tasks.workunit.client.0.smithi119.stdout:9/987: getdents d0/d8/d18/d23/d42/d12f/d147/d14d 0 2024-09-13T21:44:53.388 INFO:tasks.workunit.client.0.smithi119.stdout:1/768: dread d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/dd8/fa7 [0,4194304] 0 2024-09-13T21:44:53.388 INFO:tasks.workunit.client.0.smithi119.stdout:2/700: rmdir d1/d22/d55/d31 39 2024-09-13T21:44:53.389 INFO:tasks.workunit.client.1.smithi155.stdout:2/275: dwrite d2/f6 [0,4194304] 0 2024-09-13T21:44:53.392 INFO:tasks.workunit.client.0.smithi119.stdout:6/720: dwrite dc/df/f44 [0,4194304] 0 2024-09-13T21:44:53.392 INFO:tasks.workunit.client.0.smithi119.stdout:4/761: rename d4/d1e/d26/d6d/d7c/dde to d4/d1e/df7/de9/df8 0 2024-09-13T21:44:53.395 INFO:tasks.workunit.client.0.smithi119.stdout:4/762: stat d4/f2f 0 2024-09-13T21:44:53.396 INFO:tasks.workunit.client.1.smithi155.stdout:8/366: rename d2/d6/f19 to d2/d1f/f70 0 2024-09-13T21:44:53.396 INFO:tasks.workunit.client.0.smithi119.stdout:3/753: creat d6/d15/d1a/ff9 x:0 0 0 2024-09-13T21:44:53.397 INFO:tasks.workunit.client.1.smithi155.stdout:4/356: dwrite d1/d7/de/d15/f4b [0,4194304] 0 2024-09-13T21:44:53.397 INFO:tasks.workunit.client.1.smithi155.stdout:2/276: write d2/dd/f17 [21749,4519] 0 2024-09-13T21:44:53.399 INFO:tasks.workunit.client.0.smithi119.stdout:6/721: creat dc/dd/fde x:0 0 0 2024-09-13T21:44:53.400 INFO:tasks.workunit.client.1.smithi155.stdout:7/384: unlink d5/fb 0 2024-09-13T21:44:53.402 INFO:tasks.workunit.client.1.smithi155.stdout:2/277: write d2/dd/de/d15/d38/f4f [767882,3687] 0 2024-09-13T21:44:53.403 INFO:tasks.workunit.client.0.smithi119.stdout:6/722: chown dc/d4b/f79 35 1 2024-09-13T21:44:53.403 INFO:tasks.workunit.client.0.smithi119.stdout:3/754: chown d6/d25/d2f/d33/d56/f93 195 1 2024-09-13T21:44:53.404 INFO:tasks.workunit.client.0.smithi119.stdout:6/723: chown dc/d4b/f8c 14298 1 2024-09-13T21:44:53.405 INFO:tasks.workunit.client.1.smithi155.stdout:7/385: readlink d5/df/d15/l25 0 2024-09-13T21:44:53.405 INFO:tasks.workunit.client.1.smithi155.stdout:6/503: dread db/d11/d1e/d21/f4d [0,4194304] 0 2024-09-13T21:44:53.405 INFO:tasks.workunit.client.1.smithi155.stdout:4/357: stat d1/d7/de/dc/d4a/f56 0 2024-09-13T21:44:53.406 INFO:tasks.workunit.client.1.smithi155.stdout:8/367: creat d2/d2d/f71 x:0 0 0 2024-09-13T21:44:53.407 INFO:tasks.workunit.client.1.smithi155.stdout:1/358: creat d6/d15/d3e/f80 x:0 0 0 2024-09-13T21:44:53.407 INFO:tasks.workunit.client.1.smithi155.stdout:5/341: dread d5/d16/d33/d1b/f57 [0,4194304] 0 2024-09-13T21:44:53.408 INFO:tasks.workunit.client.0.smithi119.stdout:9/988: link d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/c45 d0/d8/d18/d23/d27/d2d/d5f/d10e/d56/d150/c156 0 2024-09-13T21:44:53.409 INFO:tasks.workunit.client.1.smithi155.stdout:6/504: write db/d11/d1e/f56 [585194,112930] 0 2024-09-13T21:44:53.411 INFO:tasks.workunit.client.1.smithi155.stdout:6/505: chown db/d11/d1e/d21 7 1 2024-09-13T21:44:53.412 INFO:tasks.workunit.client.0.smithi119.stdout:6/724: rename dc/df/d5c/f89 to dc/d3d/d4e/fdf 0 2024-09-13T21:44:53.412 INFO:tasks.workunit.client.0.smithi119.stdout:4/763: dwrite d4/d1e/d26/d60/f65 [0,4194304] 0 2024-09-13T21:44:53.412 INFO:tasks.workunit.client.0.smithi119.stdout:6/725: readlink dc/d3a/dbb/l87 0 2024-09-13T21:44:53.413 INFO:tasks.workunit.client.0.smithi119.stdout:3/755: mkdir d6/dfa 0 2024-09-13T21:44:53.414 INFO:tasks.workunit.client.1.smithi155.stdout:1/359: symlink d6/d15/d57/l81 0 2024-09-13T21:44:53.414 INFO:tasks.workunit.client.1.smithi155.stdout:4/358: mkdir d1/d7/d21/d69 0 2024-09-13T21:44:53.415 INFO:tasks.workunit.client.1.smithi155.stdout:7/386: read d5/d13/f21 [4658245,48727] 0 2024-09-13T21:44:53.416 INFO:tasks.workunit.client.0.smithi119.stdout:9/989: unlink d0/d8/d18/d23/d42/l100 0 2024-09-13T21:44:53.417 INFO:tasks.workunit.client.1.smithi155.stdout:1/360: write d6/d15/d3e/d17/d30/f46 [307391,128125] 0 2024-09-13T21:44:53.421 INFO:tasks.workunit.client.1.smithi155.stdout:7/387: symlink d5/d13/d5f/l77 0 2024-09-13T21:44:53.421 INFO:tasks.workunit.client.0.smithi119.stdout:3/756: fdatasync d6/d15/d1a/d45/f69 0 2024-09-13T21:44:53.422 INFO:tasks.workunit.client.1.smithi155.stdout:0/395: dread d1/d6/dc/fe [0,4194304] 0 2024-09-13T21:44:53.422 INFO:tasks.workunit.client.0.smithi119.stdout:8/789: write d1b/d1d/d26/f89 [3410306,56784] 0 2024-09-13T21:44:53.425 INFO:tasks.workunit.client.1.smithi155.stdout:3/462: dread d3/d25/d1b/d1f/f22 [0,4194304] 0 2024-09-13T21:44:53.426 INFO:tasks.workunit.client.0.smithi119.stdout:6/726: link dc/df/d41/f5d dc/df/d64/fe0 0 2024-09-13T21:44:53.426 INFO:tasks.workunit.client.1.smithi155.stdout:1/361: dread - d6/d7/d48/f69 zero size 2024-09-13T21:44:53.428 INFO:tasks.workunit.client.1.smithi155.stdout:5/342: dwrite d5/d16/d33/d1b/d2f/d3c/f62 [0,4194304] 0 2024-09-13T21:44:53.429 INFO:tasks.workunit.client.1.smithi155.stdout:7/388: chown d5/d10/c72 128858676 1 2024-09-13T21:44:53.429 INFO:tasks.workunit.client.0.smithi119.stdout:8/790: getdents d1b/d1d/d5e/de7 0 2024-09-13T21:44:53.430 INFO:tasks.workunit.client.0.smithi119.stdout:4/764: dread d4/d1e/d26/d6d/fab [0,4194304] 0 2024-09-13T21:44:53.430 INFO:tasks.workunit.client.0.smithi119.stdout:9/990: dwrite d0/d8/d18/d23/d27/d2d/f5d [0,4194304] 0 2024-09-13T21:44:53.431 INFO:tasks.workunit.client.0.smithi119.stdout:9/991: chown d0/d8/d18 484 1 2024-09-13T21:44:53.432 INFO:tasks.workunit.client.1.smithi155.stdout:1/362: chown d6/d15/d23/c56 3214846 1 2024-09-13T21:44:53.433 INFO:tasks.workunit.client.1.smithi155.stdout:3/463: symlink d3/d25/d1b/la2 0 2024-09-13T21:44:53.434 INFO:tasks.workunit.client.0.smithi119.stdout:2/701: dread d1/d38/f59 [0,4194304] 0 2024-09-13T21:44:53.435 INFO:tasks.workunit.client.1.smithi155.stdout:7/389: write d5/df/f6e [786420,35025] 0 2024-09-13T21:44:53.435 INFO:tasks.workunit.client.1.smithi155.stdout:4/359: dwrite d1/d7/de/d15/f5b [0,4194304] 0 2024-09-13T21:44:53.435 INFO:tasks.workunit.client.1.smithi155.stdout:0/396: rename d1/d6/f68 to d1/d6/d74/f99 0 2024-09-13T21:44:53.436 INFO:tasks.workunit.client.0.smithi119.stdout:4/765: fsync d4/d1e/d28/d34/fb4 0 2024-09-13T21:44:53.438 INFO:tasks.workunit.client.0.smithi119.stdout:6/727: dwrite dc/d3d/d4e/f57 [0,4194304] 0 2024-09-13T21:44:53.440 INFO:tasks.workunit.client.0.smithi119.stdout:9/992: write d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/f4d [1651548,118367] 0 2024-09-13T21:44:53.440 INFO:tasks.workunit.client.0.smithi119.stdout:2/702: chown d1/d22/d55/f5e 8129 1 2024-09-13T21:44:53.442 INFO:tasks.workunit.client.1.smithi155.stdout:8/368: write d2/d6/dd/f62 [721769,75832] 0 2024-09-13T21:44:53.443 INFO:tasks.workunit.client.0.smithi119.stdout:1/769: truncate d1/f1b 996816 0 2024-09-13T21:44:53.444 INFO:tasks.workunit.client.1.smithi155.stdout:4/360: dread d1/d7/de/d15/f4b [0,4194304] 0 2024-09-13T21:44:53.446 INFO:tasks.workunit.client.0.smithi119.stdout:9/993: chown d0/d8/d18/d23/d27/d2d/d5f/d10e/de5/d2b/d117/f13c 35 1 2024-09-13T21:44:53.448 INFO:tasks.workunit.client.1.smithi155.stdout:9/408: write dc/d19/d23/f4a [1110323,1102] 0 2024-09-13T21:44:53.450 INFO:tasks.workunit.client.0.smithi119.stdout:4/766: mknod d4/cf9 0 2024-09-13T21:44:53.451 INFO:tasks.workunit.client.1.smithi155.stdout:7/390: symlink d5/l78 0 2024-09-13T21:44:53.452 INFO:tasks.workunit.client.1.smithi155.stdout:4/361: dread d1/d7/de/d15/f5b [0,4194304] 0 2024-09-13T21:44:53.452 INFO:tasks.workunit.client.1.smithi155.stdout:5/343: mknod d5/d16/d33/d1b/d28/c6e 0 2024-09-13T21:44:53.452 INFO:tasks.workunit.client.1.smithi155.stdout:7/391: readlink d5/l78 0 2024-09-13T21:44:53.453 INFO:tasks.workunit.client.0.smithi119.stdout:6/728: dwrite dc/d3a/dbb/d7a/f81 [0,4194304] 0 2024-09-13T21:44:53.456 INFO:tasks.workunit.client.0.smithi119.stdout:4/767: unlink d4/d1e/d26/d6d/d7c/c8c 0 2024-09-13T21:44:53.457 INFO:tasks.workunit.client.1.smithi155.stdout:6/506: write db/f1f [2620459,106878] 0 2024-09-13T21:44:53.457 INFO:tasks.workunit.client.1.smithi155.stdout:9/409: creat dc/de/d5c/f8c x:0 0 0 2024-09-13T21:44:53.458 INFO:tasks.workunit.client.1.smithi155.stdout:7/392: mkdir d5/df/d79 0 2024-09-13T21:44:53.459 INFO:tasks.workunit.client.0.smithi119.stdout:1/770: symlink d1/d3/d61/d77/d78/d32/dda/d19/d2d/l100 0 2024-09-13T21:44:53.460 INFO:tasks.workunit.client.0.smithi119.stdout:6/729: rename dc/d3a/dbb/d7a/d7e to dc/d3a/dbb/d7a/de1 0 2024-09-13T21:44:53.460 INFO:tasks.workunit.client.1.smithi155.stdout:6/507: read f0 [10199088,8527] 0 2024-09-13T21:44:53.460 INFO:tasks.workunit.client.1.smithi155.stdout:9/410: chown dc/d18/d1e/f64 2639376 1 2024-09-13T21:44:53.460 INFO:tasks.workunit.client.1.smithi155.stdout:3/464: creat d3/d21/fa3 x:0 0 0 2024-09-13T21:44:53.461 INFO:tasks.workunit.client.0.smithi119.stdout:4/768: truncate d4/d1e/d26/d6d/f95 765848 0 2024-09-13T21:44:53.461 INFO:tasks.workunit.client.1.smithi155.stdout:8/369: symlink d2/d6/dd/l72 0 2024-09-13T21:44:53.462 INFO:tasks.workunit.client.1.smithi155.stdout:3/465: stat d3/d25/d1b/f4e 0 2024-09-13T21:44:53.464 INFO:tasks.workunit.client.0.smithi119.stdout:6/730: mknod dc/df/d64/ce2 0 2024-09-13T21:44:53.465 INFO:tasks.workunit.client.1.smithi155.stdout:0/397: creat d1/d6/dc/d4d/d4a/d52/d5c/f9a x:0 0 0 2024-09-13T21:44:53.465 INFO:tasks.workunit.client.1.smithi155.stdout:0/398: fdatasync d1/f8e 0 2024-09-13T21:44:53.466 INFO:tasks.workunit.client.1.smithi155.stdout:9/411: dread dc/de/f10 [4194304,4194304] 0 2024-09-13T21:44:53.466 INFO:tasks.workunit.client.0.smithi119.stdout:4/769: write d4/d1e/d26/d6d/d7c/fe0 [391271,67363] 0 2024-09-13T21:44:53.468 INFO:tasks.workunit.client.1.smithi155.stdout:9/412: stat dc/d19/d23/d70/l81 0 2024-09-13T21:44:53.469 INFO:tasks.workunit.client.0.smithi119.stdout:1/771: dwrite d1/d3/d61/d77/d78/fa4 [8388608,4194304] 0 2024-09-13T21:44:53.470 INFO:tasks.workunit.client.1.smithi155.stdout:8/370: dread - d2/d6/f6a zero size 2024-09-13T21:44:53.472 INFO:tasks.workunit.client.1.smithi155.stdout:8/371: read - d2/d2d/f71 zero size 2024-09-13T21:44:53.472 INFO:tasks.workunit.client.1.smithi155.stdout:5/344: link d5/f7 d5/d16/d33/f6f 0 2024-09-13T21:44:53.472 INFO:tasks.workunit.client.1.smithi155.stdout:4/362: rename d1/d7/l3d to d1/d7/de/l6a 0 2024-09-13T21:44:53.474 INFO:tasks.workunit.client.1.smithi155.stdout:9/413: creat dc/d19/d23/d70/f8d x:0 0 0 2024-09-13T21:44:53.477 INFO:tasks.workunit.client.1.smithi155.stdout:6/508: rename db/d12 to db/d2c/d9d 0 2024-09-13T21:44:53.477 INFO:tasks.workunit.client.1.smithi155.stdout:9/414: dread - dc/de/d6f/f7d zero size 2024-09-13T21:44:53.478 INFO:tasks.workunit.client.1.smithi155.stdout:0/399: dwrite d1/d6/dc/d4d/d4a/d4e/d61/f6b [0,4194304] 0 2024-09-13T21:44:53.479 INFO:tasks.workunit.client.0.smithi119.stdout:3/757: dread d6/f11 [0,4194304] 0 2024-09-13T21:44:53.479 INFO:tasks.workunit.client.1.smithi155.stdout:5/345: symlink d5/d16/d4e/l70 0 2024-09-13T21:44:53.483 INFO:tasks.workunit.client.1.smithi155.stdout:4/363: creat d1/d7/f6b x:0 0 0 2024-09-13T21:44:53.483 INFO:tasks.workunit.client.0.smithi119.stdout:3/758: read d6/d44/f51 [315158,127387] 0 2024-09-13T21:44:53.485 INFO:tasks.workunit.client.1.smithi155.stdout:1/363: write d6/f33 [5031609,118054] 0 2024-09-13T21:44:53.485 INFO:tasks.workunit.client.1.smithi155.stdout:0/400: dread - d1/d6/dc/d4d/f80 zero size 2024-09-13T21:44:53.485 INFO:tasks.workunit.client.1.smithi155.stdout:3/466: creat d3/d21/fa4 x:0 0 0 2024-09-13T21:44:53.488 INFO:tasks.workunit.client.1.smithi155.stdout:1/364: stat d6/d15/d3e/d17/d30/l67 0 2024-09-13T21:44:53.489 INFO:tasks.workunit.client.1.smithi155.stdout:8/372: creat d2/d6/dd/d12/f73 x:0 0 0 2024-09-13T21:44:53.489 INFO:tasks.workunit.client.1.smithi155.stdout:7/393: getdents d5/d3b 0 2024-09-13T21:44:53.491 INFO:tasks.workunit.client.1.smithi155.stdout:7/394: write d5/d10/f6a [577530,51710] 0 2024-09-13T21:44:53.492 INFO:tasks.workunit.client.0.smithi119.stdout:2/703: dwrite d1/d22/d55/d31/f94 [0,4194304] 0 2024-09-13T21:44:53.493 INFO:tasks.workunit.client.1.smithi155.stdout:6/509: creat db/d3d/d5f/d67/f9e x:0 0 0 2024-09-13T21:44:53.494 INFO:tasks.workunit.client.1.smithi155.stdout:2/278: dread d2/dd/f34 [0,4194304] 0 2024-09-13T21:44:53.495 INFO:tasks.workunit.client.0.smithi119.stdout:3/759: rmdir d6/d15/d1a/d45/d47/d4d/dcf/df0 0 2024-09-13T21:44:53.497 INFO:tasks.workunit.client.0.smithi119.stdout:2/704: chown d1/d22/l68 22540338 1 2024-09-13T21:44:53.498 INFO:tasks.workunit.client.0.smithi119.stdout:3/760: readlink d6/d15/d1a/d45/d47/d4d/da7/ld9 0 2024-09-13T21:44:53.498 INFO:tasks.workunit.client.1.smithi155.stdout:2/279: write d2/dd/de/d15/d2e/f36 [3209238,106915] 0 2024-09-13T21:44:53.498 INFO:tasks.workunit.client.1.smithi155.stdout:3/467: creat d3/d25/d1b/d1f/d82/d83/fa5 x:0 0 0 2024-09-13T21:44:53.500 INFO:tasks.workunit.client.0.smithi119.stdout:4/770: dwrite d4/d1e/d28/d34/d66/f9c [0,4194304] 0 2024-09-13T21:44:53.503 INFO:tasks.workunit.client.0.smithi119.stdout:3/761: read - d6/d15/d1a/d45/d47/d4d/da7/fd8 zero size 2024-09-13T21:44:53.503 INFO:tasks.workunit.client.1.smithi155.stdout:5/346: getdents d5/d16/d33/d1b/d2f/d3c/d5b/d5f 0 2024-09-13T21:44:53.504 INFO:tasks.workunit.client.1.smithi155.stdout:0/401: creat d1/d6/d97/f9b x:0 0 0 2024-09-13T21:44:53.505 INFO:tasks.workunit.client.1.smithi155.stdout:7/395: creat d5/df/d60/d6d/f7a x:0 0 0 2024-09-13T21:44:53.505 INFO:tasks.workunit.client.1.smithi155.stdout:0/402: chown d1/d6/d74 1090982830 1 2024-09-13T21:44:53.506 INFO:tasks.workunit.client.0.smithi119.stdout:3/762: chown d6/d25/d2f/d33/d56/fe0 287554 1 2024-09-13T21:44:53.506 INFO:tasks.workunit.client.0.smithi119.stdout:4/771: getdents d4/d1e/df7 0 2024-09-13T21:44:53.506 INFO:tasks.workunit.client.0.smithi119.stdout:1/772: fsync d1/d3/d61/d77/d78/d32/dda/d28/f3f 0 2024-09-13T21:44:53.506 INFO:tasks.workunit.client.1.smithi155.stdout:4/364: creat d1/d7/de/d15/d55/d5e/d66/f6c x:0 0 0 2024-09-13T21:44:53.507 INFO:tasks.workunit.client.0.smithi119.stdout:4/772: chown d4/d1e/d28/d34/d6a/d79/dae/ced 1872855 1 2024-09-13T21:44:53.510 INFO:tasks.workunit.client.1.smithi155.stdout:1/365: mkdir d6/d82 0 2024-09-13T21:44:53.510 INFO:tasks.workunit.client.0.smithi119.stdout:1/773: unlink d1/d3/d61/d77/d78/db8/dde/ff7 0 2024-09-13T21:44:53.511 INFO:tasks.workunit.client.0.smithi119.stdout:3/763: creat d6/d25/d2f/d33/d56/ffb x:0 0 0 2024-09-13T21:44:53.511 INFO:tasks.workunit.client.1.smithi155.stdout:1/366: chown d6/d15/d3e/d17/d30/f5e 74993489 1 2024-09-13T21:44:53.514 INFO:tasks.workunit.client.0.smithi119.stdout:4/773: mkdir d4/d1e/df7/de9/df8/d8f/dfa 0 2024-09-13T21:44:53.515 INFO:tasks.workunit.client.0.smithi119.stdout:1/774: truncate d1/d3/dc/f5f 851984 0 2024-09-13T21:44:53.515 INFO:tasks.workunit.client.1.smithi155.stdout:0/403: rename d1/d6/dc/f72 to d1/d6/dc/d90/f9c 0 2024-09-13T21:44:53.516 INFO:tasks.workunit.client.1.smithi155.stdout:0/404: stat d1/c7f 0 2024-09-13T21:44:53.516 INFO:tasks.workunit.client.1.smithi155.stdout:3/468: mkdir d3/d25/d1b/d1f/d82/d83/d99/da6 0 2024-09-13T21:44:53.518 INFO:tasks.workunit.client.1.smithi155.stdout:2/280: dread d2/db/f16 [0,4194304] 0 2024-09-13T21:44:53.518 INFO:tasks.workunit.client.1.smithi155.stdout:8/373: creat d2/f74 x:0 0 0 2024-09-13T21:44:53.519 INFO:tasks.workunit.client.0.smithi119.stdout:2/705: write d1/d38/f59 [3067180,125545] 0 2024-09-13T21:44:53.519 INFO:tasks.workunit.client.1.smithi155.stdout:9/415: link dc/d19/d21/l28 dc/d18/d50/l8e 0 2024-09-13T21:44:53.520 INFO:tasks.workunit.client.0.smithi119.stdout:3/764: dread d6/d44/f80 [0,4194304] 0 2024-09-13T21:44:53.521 INFO:tasks.workunit.client.1.smithi155.stdout:5/347: fdatasync d5/fe 0 2024-09-13T21:44:53.521 INFO:tasks.workunit.client.0.smithi119.stdout:9/994: dread d0/d8/d18/f90 [0,4194304] 0 2024-09-13T21:44:53.522 INFO:tasks.workunit.client.1.smithi155.stdout:7/396: creat d5/d10/d48/f7b x:0 0 0 2024-09-13T21:44:53.522 INFO:tasks.workunit.client.1.smithi155.stdout:0/405: write d1/d6/dc/d8c/f93 [405085,24297] 0 2024-09-13T21:44:53.523 INFO:tasks.workunit.client.1.smithi155.stdout:3/469: creat d3/d25/d1b/d1f/d36/d5c/fa7 x:0 0 0 2024-09-13T21:44:53.524 INFO:tasks.workunit.client.0.smithi119.stdout:3/765: truncate d6/d15/d1a/faf 4974775 0 2024-09-13T21:44:53.524 INFO:tasks.workunit.client.0.smithi119.stdout:9/995: chown d0/d8/d18/d23/dea/fd2 225258 1 2024-09-13T21:44:53.529 INFO:tasks.workunit.client.1.smithi155.stdout:9/416: symlink dc/d19/d23/d70/d74/l8f 0 2024-09-13T21:44:53.529 INFO:tasks.workunit.client.1.smithi155.stdout:8/374: write d2/d6/dd/d12/f73 [387278,73648] 0 2024-09-13T21:44:53.529 INFO:tasks.workunit.client.1.smithi155.stdout:1/367: dwrite d6/d7/f2f [0,4194304] 0 2024-09-13T21:44:53.529 INFO:tasks.workunit.client.0.smithi119.stdout:2/706: dwrite d1/d22/d5a/fc9 [0,4194304] 0 2024-09-13T21:44:53.531 INFO:tasks.workunit.client.1.smithi155.stdout:1/368: write d6/d15/d23/d55/f6f [674565,74006] 0 2024-09-13T21:44:53.532 INFO:tasks.workunit.client.0.smithi119.stdout:3/766: rename c3 to d6/d44/cfc 0 2024-09-13T21:44:53.533 INFO:tasks.workunit.client.0.smithi119.stdout:9/996: creat d0/d8/d18/d23/d27/d2d/dc1/ddf/d81/d154/f157 x:0 0 0 2024-09-13T21:44:53.534 INFO:tasks.workunit.client.0.smithi119.stdout:2/707: mknod d1/d38/d89/cdd 0 2024-09-13T21:44:53.535 INFO:tasks.workunit.client.1.smithi155.stdout:8/375: chown d2/d6/dd/d25/f4c 227 1 2024-09-13T21:44:53.535 INFO:tasks.workunit.client.1.smithi155.stdout:6/510: truncate db/d2c/d9d/d1c/f6e 776660 0 2024-09-13T21:44:53.538 INFO:tasks.workunit.client.1.smithi155.stdout:6/511: read - db/d11/d4c/f6c zero size 2024-09-13T21:44:53.539 INFO:tasks.workunit.client.0.smithi119.stdout:4/774: dwrite d4/d1e/d26/d60/d71/f9e [0,4194304] 0 2024-09-13T21:44:53.539 INFO:tasks.workunit.client.0.smithi119.stdout:2/708: readlink d1/d22/d5a/d5d/d77/daa/lc6 0 2024-09-13T21:44:53.539 INFO:tasks.workunit.client.0.smithi119.stdout:3/767: write d6/d25/d2f/d33/d56/ffb [1006836,44423] 0 2024-09-13T21:44:53.545 INFO:tasks.workunit.client.0.smithi119.stdout:4/775: truncate d4/f53 4101691 0 2024-09-13T21:44:53.545 INFO:tasks.workunit.client.0.smithi119.stdout:9/997: creat d0/d8/d18/d23/d42/d52/de1/f158 x:0 0 0 2024-09-13T21:44:53.545 INFO:tasks.workunit.client.1.smithi155.stdout:6/512: read db/d11/d1e/f56 [246891,66582] 0 2024-09-13T21:44:53.547 INFO:tasks.workunit.client.0.smithi119.stdout:2/709: dread - d1/d7/fbd zero size 2024-09-13T21:44:53.549 INFO:tasks.workunit.client.0.smithi119.stdout:1/775: dread d1/d3/d61/d77/d78/d32/dda/d3d/f98 [0,4194304] 0 2024-09-13T21:44:53.549 INFO:tasks.workunit.client.1.smithi155.stdout:2/281: creat d2/dd/de/d15/f64 x:0 0 0 2024-09-13T21:44:53.553 INFO:tasks.workunit.client.0.smithi119.stdout:2/710: mkdir d1/d22/db6/dde 0 2024-09-13T21:44:53.554 INFO:tasks.workunit.client.1.smithi155.stdout:2/282: truncate d2/db/f63 1033893 0 2024-09-13T21:44:53.555 INFO:tasks.workunit.client.1.smithi155.stdout:2/283: fsync d2/db/f25 0 2024-09-13T21:44:53.555 INFO:tasks.workunit.client.1.smithi155.stdout:4/365: dread d1/d7/de/dc/f45 [0,4194304] 0 2024-09-13T21:44:53.555 INFO:tasks.workunit.client.0.smithi119.stdout:9/998: mkdir d0/d8/d18/d23/d42/d52/d159 0 2024-09-13T21:44:53.556 INFO:tasks.workunit.client.0.smithi119.stdout:4/776: mkdir d4/d1e/d28/d34/d99/df0/dfb 0 2024-09-13T21:44:53.557 INFO:tasks.workunit.client.0.smithi119.stdout:2/711: mknod d1/d22/d5a/d5d/cdf 0 2024-09-13T21:44:53.557 INFO:tasks.workunit.client.1.smithi155.stdout:8/376: stat d2/d6/dd/d25/c50 0 2024-09-13T21:44:53.558 INFO:tasks.workunit.client.0.smithi119.stdout:9/999: fdatasync d0/d8/d18/d23/d27/d2d/d5f/da8/ff8 0 2024-09-13T21:44:53.559 INFO:tasks.workunit.client.1.smithi155.stdout:8/377: stat d2/d6/dd/d25 0 2024-09-13T21:44:53.559 INFO:tasks.workunit.client.0.smithi119.stdout:1/776: rename d1/d3/d61/d77/d78/d32/dda/l12 to d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/l101 0 2024-09-13T21:44:53.560 INFO:tasks.workunit.client.1.smithi155.stdout:4/366: truncate d1/d7/de/d15/d55/d5e/d66/f6c 591446 0 2024-09-13T21:44:53.560 INFO:tasks.workunit.client.1.smithi155.stdout:7/397: truncate f3 4251404 0 2024-09-13T21:44:53.561 INFO:tasks.workunit.client.1.smithi155.stdout:0/406: creat d1/f9d x:0 0 0 2024-09-13T21:44:53.561 INFO:tasks.workunit.client.1.smithi155.stdout:6/513: unlink db/d2c/d9d/d1c/d36/d46/f48 0 2024-09-13T21:44:53.563 INFO:tasks.workunit.client.0.smithi119.stdout:4/777: dwrite d4/d1e/df7/de9/df8/d8f/fea [4194304,4194304] 0 2024-09-13T21:44:53.564 INFO:tasks.workunit.client.1.smithi155.stdout:7/398: readlink d5/df/d15/d33/l76 0 2024-09-13T21:44:53.566 INFO:tasks.workunit.client.0.smithi119.stdout:4/778: creat d4/d1e/d28/d34/d6a/d79/d9f/dba/ffc x:0 0 0 2024-09-13T21:44:53.567 INFO:tasks.workunit.client.1.smithi155.stdout:1/369: rename d6/d15/d23/d55/f70 to d6/d15/d3e/d17/d30/f83 0 2024-09-13T21:44:53.569 INFO:tasks.workunit.client.0.smithi119.stdout:3/768: truncate d6/d15/d1a/d45/f67 3099129 0 2024-09-13T21:44:53.570 INFO:tasks.workunit.client.0.smithi119.stdout:3/769: write d6/d15/d1a/d45/d47/d4d/f73 [4209129,127662] 0 2024-09-13T21:44:53.575 INFO:tasks.workunit.client.1.smithi155.stdout:7/399: chown d5/d10/c41 3994906 1 2024-09-13T21:44:53.575 INFO:tasks.workunit.client.0.smithi119.stdout:3/770: creat d6/d25/d2f/d33/d56/ffd x:0 0 0 2024-09-13T21:44:53.577 INFO:tasks.workunit.client.1.smithi155.stdout:9/417: rename dc/d19/d23/d70 to dc/d19/d23/d38/d90 0 2024-09-13T21:44:53.579 INFO:tasks.workunit.client.1.smithi155.stdout:5/348: dwrite d5/d16/d33/d1b/d28/f37 [0,4194304] 0 2024-09-13T21:44:53.579 INFO:tasks.workunit.client.1.smithi155.stdout:1/370: creat d6/d7/d64/f84 x:0 0 0 2024-09-13T21:44:53.581 INFO:tasks.workunit.client.0.smithi119.stdout:3/771: dread d6/d15/d1a/d45/d8d/feb [0,4194304] 0 2024-09-13T21:44:53.581 INFO:tasks.workunit.client.1.smithi155.stdout:2/284: dwrite d2/db/f1d [0,4194304] 0 2024-09-13T21:44:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:53 smithi155 ceph-mon[34732]: pgmap v11: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 82 MiB/s rd, 298 MiB/s wr, 546 op/s 2024-09-13T21:44:53.583 INFO:tasks.workunit.client.0.smithi119.stdout:3/772: mknod d6/d44/d52/d85/cfe 0 2024-09-13T21:44:53.585 INFO:tasks.workunit.client.0.smithi119.stdout:3/773: truncate d6/f6b 2256369 0 2024-09-13T21:44:53.588 INFO:tasks.workunit.client.1.smithi155.stdout:3/470: dread d3/d21/d2c/f48 [0,4194304] 0 2024-09-13T21:44:53.590 INFO:tasks.workunit.client.0.smithi119.stdout:4/779: truncate d4/f4e 4010206 0 2024-09-13T21:44:53.592 INFO:tasks.workunit.client.1.smithi155.stdout:8/378: dwrite d2/d6/f6a [0,4194304] 0 2024-09-13T21:44:53.592 INFO:tasks.workunit.client.0.smithi119.stdout:4/780: write d4/d1e/d28/d5d/fa0 [1066680,57483] 0 2024-09-13T21:44:53.593 INFO:tasks.workunit.client.1.smithi155.stdout:3/471: write d3/d25/f94 [732867,45684] 0 2024-09-13T21:44:53.593 INFO:tasks.workunit.client.0.smithi119.stdout:4/781: chown d4/d1e/d28/f8d 5 1 2024-09-13T21:44:53.594 INFO:tasks.workunit.client.1.smithi155.stdout:5/349: mknod d5/d16/d33/d1b/d28/c71 0 2024-09-13T21:44:53.596 INFO:tasks.workunit.client.0.smithi119.stdout:4/782: symlink d4/d1e/d26/d60/d71/lfd 0 2024-09-13T21:44:53.598 INFO:tasks.workunit.client.0.smithi119.stdout:3/774: write d6/d15/d1a/d45/d47/d4d/da7/fd8 [637068,43184] 0 2024-09-13T21:44:53.599 INFO:tasks.workunit.client.0.smithi119.stdout:2/712: dread d1/d38/d89/f4e [0,4194304] 0 2024-09-13T21:44:53.599 INFO:tasks.workunit.client.0.smithi119.stdout:4/783: write d4/d1e/d26/d60/d71/fc6 [719152,33100] 0 2024-09-13T21:44:53.601 INFO:tasks.workunit.client.0.smithi119.stdout:3/775: symlink d6/d44/d52/d85/lff 0 2024-09-13T21:44:53.601 INFO:tasks.workunit.client.1.smithi155.stdout:9/418: rename dc/de/d15/l2c to dc/d19/d23/d38/d90/l91 0 2024-09-13T21:44:53.601 INFO:tasks.workunit.client.1.smithi155.stdout:3/472: write d3/d10/f8d [856309,802] 0 2024-09-13T21:44:53.602 INFO:tasks.workunit.client.1.smithi155.stdout:8/379: dread d2/d8/d65/f41 [0,4194304] 0 2024-09-13T21:44:53.602 INFO:tasks.workunit.client.1.smithi155.stdout:0/407: dread d1/d6/dc/d4d/d4a/d4e/d61/f6b [0,4194304] 0 2024-09-13T21:44:53.604 INFO:tasks.workunit.client.0.smithi119.stdout:2/713: getdents d1 0 2024-09-13T21:44:53.605 INFO:tasks.workunit.client.1.smithi155.stdout:9/419: creat dc/de/f92 x:0 0 0 2024-09-13T21:44:53.605 INFO:tasks.workunit.client.1.smithi155.stdout:7/400: write d5/f1e [3439892,101792] 0 2024-09-13T21:44:53.606 INFO:tasks.workunit.client.1.smithi155.stdout:1/371: mknod d6/d15/d57/d5d/c85 0 2024-09-13T21:44:53.607 INFO:tasks.workunit.client.0.smithi119.stdout:2/714: rename d1/d38/d89/f34 to d1/d22/d5a/da9/fe0 0 2024-09-13T21:44:53.607 INFO:tasks.workunit.client.1.smithi155.stdout:2/285: creat d2/dd/f65 x:0 0 0 2024-09-13T21:44:53.608 INFO:tasks.workunit.client.0.smithi119.stdout:2/715: read - d1/d22/d55/fcb zero size 2024-09-13T21:44:53.609 INFO:tasks.workunit.client.1.smithi155.stdout:3/473: mkdir d3/d25/d1b/d1f/d82/da8 0 2024-09-13T21:44:53.610 INFO:tasks.workunit.client.0.smithi119.stdout:2/716: creat d1/d22/db6/dde/fe1 x:0 0 0 2024-09-13T21:44:53.611 INFO:tasks.workunit.client.1.smithi155.stdout:7/401: write d5/df/d60/d6d/f5d [831608,55948] 0 2024-09-13T21:44:53.612 INFO:tasks.workunit.client.1.smithi155.stdout:9/420: rmdir dc/de/d5c 39 2024-09-13T21:44:53.613 INFO:tasks.workunit.client.1.smithi155.stdout:4/367: dread d1/d7/f58 [0,4194304] 0 2024-09-13T21:44:53.613 INFO:tasks.workunit.client.1.smithi155.stdout:5/350: dwrite d5/d12/f4d [0,4194304] 0 2024-09-13T21:44:53.615 INFO:tasks.workunit.client.1.smithi155.stdout:2/286: mkdir d2/dd/de/d15/d2e/d66 0 2024-09-13T21:44:53.615 INFO:tasks.workunit.client.1.smithi155.stdout:9/421: fsync dc/f54 0 2024-09-13T21:44:53.616 INFO:tasks.workunit.client.0.smithi119.stdout:4/784: write d4/d1e/d26/f32 [2844519,67313] 0 2024-09-13T21:44:53.616 INFO:tasks.workunit.client.1.smithi155.stdout:4/368: readlink d1/d7/l65 0 2024-09-13T21:44:53.616 INFO:tasks.workunit.client.1.smithi155.stdout:8/380: write d2/d6/dd/d12/f21 [2700700,88473] 0 2024-09-13T21:44:53.617 INFO:tasks.workunit.client.1.smithi155.stdout:5/351: write d5/d16/d4e/f51 [278197,35701] 0 2024-09-13T21:44:53.617 INFO:tasks.workunit.client.0.smithi119.stdout:2/717: rmdir d1/d22 39 2024-09-13T21:44:53.617 INFO:tasks.workunit.client.0.smithi119.stdout:4/785: read d4/d1e/d28/f8d [761809,123070] 0 2024-09-13T21:44:53.618 INFO:tasks.workunit.client.0.smithi119.stdout:4/786: read d4/d1e/f50 [1249934,31187] 0 2024-09-13T21:44:53.620 INFO:tasks.workunit.client.0.smithi119.stdout:4/787: creat d4/d1e/d26/d60/ffe x:0 0 0 2024-09-13T21:44:53.621 INFO:tasks.workunit.client.1.smithi155.stdout:7/402: rmdir d5/d10/d3e 39 2024-09-13T21:44:53.621 INFO:tasks.workunit.client.1.smithi155.stdout:3/474: mknod d3/d25/d17/d3b/ca9 0 2024-09-13T21:44:53.622 INFO:tasks.workunit.client.1.smithi155.stdout:2/287: read d2/db/f63 [825828,29653] 0 2024-09-13T21:44:53.623 INFO:tasks.workunit.client.1.smithi155.stdout:8/381: mkdir d2/d8/d75 0 2024-09-13T21:44:53.624 INFO:tasks.workunit.client.1.smithi155.stdout:5/352: creat d5/d16/d33/d1b/d1e/f72 x:0 0 0 2024-09-13T21:44:53.625 INFO:tasks.workunit.client.0.smithi119.stdout:2/718: dwrite d1/d38/d89/d6b/f65 [0,4194304] 0 2024-09-13T21:44:53.625 INFO:tasks.workunit.client.1.smithi155.stdout:0/408: getdents d1/d6/dc/d90 0 2024-09-13T21:44:53.625 INFO:tasks.workunit.client.1.smithi155.stdout:7/403: write d5/f1e [462832,95635] 0 2024-09-13T21:44:53.626 INFO:tasks.workunit.client.1.smithi155.stdout:2/288: chown d2/dd/d21/d39/l47 355306 1 2024-09-13T21:44:53.626 INFO:tasks.workunit.client.1.smithi155.stdout:8/382: rename d2/d8 to d2/d8/d5e/d76 22 2024-09-13T21:44:53.627 INFO:tasks.workunit.client.0.smithi119.stdout:4/788: dwrite d4/d1e/d28/d34/d99/fa4 [4194304,4194304] 0 2024-09-13T21:44:53.628 INFO:tasks.workunit.client.1.smithi155.stdout:3/475: write d3/d25/d1b/d1f/d36/d5c/fa7 [908379,34657] 0 2024-09-13T21:44:53.628 INFO:tasks.workunit.client.1.smithi155.stdout:1/372: link d6/d15/d3e/d17/d30/f5b d6/f86 0 2024-09-13T21:44:53.628 INFO:tasks.workunit.client.0.smithi119.stdout:2/719: rmdir d1/d22 39 2024-09-13T21:44:53.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:53 smithi119 ceph-mon[27653]: pgmap v11: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 82 MiB/s rd, 298 MiB/s wr, 546 op/s 2024-09-13T21:44:53.630 INFO:tasks.workunit.client.0.smithi119.stdout:4/789: mknod d4/d1e/d28/d34/d6a/d79/dae/cff 0 2024-09-13T21:44:53.631 INFO:tasks.workunit.client.1.smithi155.stdout:3/476: chown d3/d25/d17/d3b/f77 246656 1 2024-09-13T21:44:53.632 INFO:tasks.workunit.client.0.smithi119.stdout:2/720: chown d1/d7/d47/f5c 1 1 2024-09-13T21:44:53.633 INFO:tasks.workunit.client.0.smithi119.stdout:4/790: mkdir d4/d1e/d28/d34/d99/df0/d100 0 2024-09-13T21:44:53.633 INFO:tasks.workunit.client.1.smithi155.stdout:4/369: link d1/d7/d21/f57 d1/d7/d21/d2d/f6d 0 2024-09-13T21:44:53.635 INFO:tasks.workunit.client.0.smithi119.stdout:2/721: symlink d1/d22/d5a/da9/le2 0 2024-09-13T21:44:53.636 INFO:tasks.workunit.client.1.smithi155.stdout:4/370: fdatasync d1/d7/de/d15/d55/f62 0 2024-09-13T21:44:53.637 INFO:tasks.workunit.client.0.smithi119.stdout:2/722: stat d1/lbc 0 2024-09-13T21:44:53.638 INFO:tasks.workunit.client.0.smithi119.stdout:4/791: link d4/d1e/d26/d5e/cb7 d4/ddc/df4/c101 0 2024-09-13T21:44:53.640 INFO:tasks.workunit.client.0.smithi119.stdout:4/792: chown d4/d1e/d26/d6d/f95 33357963 1 2024-09-13T21:44:53.640 INFO:tasks.workunit.client.0.smithi119.stdout:2/723: dread d1/d38/d89/f4e [0,4194304] 0 2024-09-13T21:44:53.642 INFO:tasks.workunit.client.0.smithi119.stdout:4/793: mknod d4/d1e/d26/d5e/c102 0 2024-09-13T21:44:53.643 INFO:tasks.workunit.client.0.smithi119.stdout:4/794: write d4/d1e/f17 [487248,106540] 0 2024-09-13T21:44:53.643 INFO:tasks.workunit.client.1.smithi155.stdout:1/373: dwrite d6/d15/d23/d55/f60 [0,4194304] 0 2024-09-13T21:44:53.644 INFO:tasks.workunit.client.1.smithi155.stdout:2/289: creat d2/dd/d37/f67 x:0 0 0 2024-09-13T21:44:53.644 INFO:tasks.workunit.client.1.smithi155.stdout:0/409: write d1/d6/dc/d4d/f3f [367272,99644] 0 2024-09-13T21:44:53.649 INFO:tasks.workunit.client.0.smithi119.stdout:5/799: sync 2024-09-13T21:44:53.650 INFO:tasks.workunit.client.1.smithi155.stdout:4/371: mknod d1/d7/de/d15/d55/d5e/d66/c6e 0 2024-09-13T21:44:53.651 INFO:tasks.workunit.client.1.smithi155.stdout:5/353: truncate d5/d16/d33/d1b/d1e/f4c 3680495 0 2024-09-13T21:44:53.651 INFO:tasks.workunit.client.0.smithi119.stdout:4/795: dwrite d4/f2f [0,4194304] 0 2024-09-13T21:44:53.651 INFO:tasks.workunit.client.1.smithi155.stdout:9/422: getdents dc/d19/d23 0 2024-09-13T21:44:53.653 INFO:tasks.workunit.client.1.smithi155.stdout:2/290: mknod d2/dd/d21/d39/c68 0 2024-09-13T21:44:53.653 INFO:tasks.workunit.client.1.smithi155.stdout:8/383: dwrite d2/d8/f10 [8388608,4194304] 0 2024-09-13T21:44:53.654 INFO:tasks.workunit.client.1.smithi155.stdout:3/477: fsync d3/d21/f41 0 2024-09-13T21:44:53.655 INFO:tasks.workunit.client.1.smithi155.stdout:2/291: dread - d2/dd/d37/f4a zero size 2024-09-13T21:44:53.656 INFO:tasks.workunit.client.1.smithi155.stdout:5/354: write d5/d16/d33/d1b/d2f/d3c/f41 [202886,57298] 0 2024-09-13T21:44:53.658 INFO:tasks.workunit.client.1.smithi155.stdout:9/423: creat dc/d19/d23/d38/d90/f93 x:0 0 0 2024-09-13T21:44:53.661 INFO:tasks.workunit.client.1.smithi155.stdout:1/374: rename d6/d15/d3e/d17 to d6/d15/d23/d87 0 2024-09-13T21:44:53.661 INFO:tasks.workunit.client.1.smithi155.stdout:7/404: creat d5/d10/d3e/d3f/f7c x:0 0 0 2024-09-13T21:44:53.662 INFO:tasks.workunit.client.1.smithi155.stdout:1/375: write d6/d15/d23/d87/d30/f50 [719828,130123] 0 2024-09-13T21:44:53.664 INFO:tasks.workunit.client.0.smithi119.stdout:4/796: dwrite d4/d1e/d26/d60/d71/f8e [0,4194304] 0 2024-09-13T21:44:53.665 INFO:tasks.workunit.client.0.smithi119.stdout:4/797: rmdir d4/d1e/d28/d5d 39 2024-09-13T21:44:53.666 INFO:tasks.workunit.client.0.smithi119.stdout:4/798: write d4/d1e/d26/f32 [4010763,58652] 0 2024-09-13T21:44:53.669 INFO:tasks.workunit.client.0.smithi119.stdout:4/799: creat d4/d1e/d10/da5/f103 x:0 0 0 2024-09-13T21:44:53.695 INFO:tasks.workunit.client.0.smithi119.stdout:5/800: dread d0/d3/d4/d9/d14/d24/f31 [0,4194304] 0 2024-09-13T21:44:53.696 INFO:tasks.workunit.client.1.smithi155.stdout:9/424: creat dc/d18/f94 x:0 0 0 2024-09-13T21:44:53.696 INFO:tasks.workunit.client.1.smithi155.stdout:7/405: dread - d5/d10/d48/f7b zero size 2024-09-13T21:44:53.697 INFO:tasks.workunit.client.1.smithi155.stdout:5/355: mkdir d5/d16/d33/d1b/d2f/d73 0 2024-09-13T21:44:53.699 INFO:tasks.workunit.client.1.smithi155.stdout:1/376: read d6/d15/f45 [2624592,75738] 0 2024-09-13T21:44:53.700 INFO:tasks.workunit.client.0.smithi119.stdout:2/724: dread d1/d38/f69 [0,4194304] 0 2024-09-13T21:44:53.700 INFO:tasks.workunit.client.0.smithi119.stdout:5/801: dread d0/d3/d4/d9/d14/d24/f6e [0,4194304] 0 2024-09-13T21:44:53.700 INFO:tasks.workunit.client.1.smithi155.stdout:3/478: mknod d3/d25/d1b/d1f/d82/d83/d99/da6/caa 0 2024-09-13T21:44:53.700 INFO:tasks.workunit.client.1.smithi155.stdout:7/406: write d5/fa [3148847,81580] 0 2024-09-13T21:44:53.701 INFO:tasks.workunit.client.0.smithi119.stdout:2/725: chown d1/d38/d89/d6b 66305160 1 2024-09-13T21:44:53.701 INFO:tasks.workunit.client.0.smithi119.stdout:5/802: chown d0/c53 72 1 2024-09-13T21:44:53.701 INFO:tasks.workunit.client.0.smithi119.stdout:2/726: stat d1/d22/d5a/da9 0 2024-09-13T21:44:53.702 INFO:tasks.workunit.client.1.smithi155.stdout:9/425: creat dc/de/d2d/f95 x:0 0 0 2024-09-13T21:44:53.704 INFO:tasks.workunit.client.1.smithi155.stdout:3/479: write d3/d25/f94 [161426,14084] 0 2024-09-13T21:44:53.709 INFO:tasks.workunit.client.1.smithi155.stdout:0/410: dwrite d1/d6/dc/d4d/d4a/d52/d5c/f60 [0,4194304] 0 2024-09-13T21:44:53.710 INFO:tasks.workunit.client.1.smithi155.stdout:1/377: rename d6/d15/d23/d87/d30/l67 to d6/d7/l88 0 2024-09-13T21:44:53.713 INFO:tasks.workunit.client.1.smithi155.stdout:7/407: rmdir d5/d10 39 2024-09-13T21:44:53.713 INFO:tasks.workunit.client.1.smithi155.stdout:5/356: dwrite d5/d16/d33/d1b/d2f/d3c/d6c/f35 [0,4194304] 0 2024-09-13T21:44:53.716 INFO:tasks.workunit.client.1.smithi155.stdout:9/426: truncate dc/f54 2932311 0 2024-09-13T21:44:53.718 INFO:tasks.workunit.client.1.smithi155.stdout:3/480: dwrite d3/d25/fb [4194304,4194304] 0 2024-09-13T21:44:53.722 INFO:tasks.workunit.client.1.smithi155.stdout:2/292: truncate d2/f6 3535059 0 2024-09-13T21:44:53.722 INFO:tasks.workunit.client.1.smithi155.stdout:7/408: fsync d5/d10/d3e/d3f/f66 0 2024-09-13T21:44:53.722 INFO:tasks.workunit.client.1.smithi155.stdout:5/357: symlink d5/d16/d33/d1b/d2f/d3c/d44/l74 0 2024-09-13T21:44:53.724 INFO:tasks.workunit.client.1.smithi155.stdout:8/384: truncate d2/d1f/f70 3832364 0 2024-09-13T21:44:53.725 INFO:tasks.workunit.client.1.smithi155.stdout:2/293: stat d2/dd/de/f55 0 2024-09-13T21:44:53.729 INFO:tasks.workunit.client.1.smithi155.stdout:8/385: fdatasync d2/d6/dd/f62 0 2024-09-13T21:44:53.729 INFO:tasks.workunit.client.1.smithi155.stdout:6/514: dread db/d11/d2b/d35/f25 [0,4194304] 0 2024-09-13T21:44:53.730 INFO:tasks.workunit.client.1.smithi155.stdout:7/409: rmdir d5/d3b 39 2024-09-13T21:44:53.733 INFO:tasks.workunit.client.1.smithi155.stdout:5/358: creat d5/d16/d33/d1b/d2f/d3c/f75 x:0 0 0 2024-09-13T21:44:53.733 INFO:tasks.workunit.client.1.smithi155.stdout:2/294: truncate d2/dd/de/d15/f2d 5079706 0 2024-09-13T21:44:53.736 INFO:tasks.workunit.client.1.smithi155.stdout:9/427: dwrite dc/d18/f94 [0,4194304] 0 2024-09-13T21:44:53.737 INFO:tasks.workunit.client.1.smithi155.stdout:2/295: write d2/dd/f2c [359152,13218] 0 2024-09-13T21:44:53.742 INFO:tasks.workunit.client.1.smithi155.stdout:8/386: getdents d2 0 2024-09-13T21:44:53.744 INFO:tasks.workunit.client.1.smithi155.stdout:9/428: symlink dc/d19/l96 0 2024-09-13T21:44:53.746 INFO:tasks.workunit.client.1.smithi155.stdout:8/387: chown d2/f5 438138 1 2024-09-13T21:44:53.747 INFO:tasks.workunit.client.1.smithi155.stdout:7/410: link d5/d10/d48/f7b d5/d10/d3e/d3f/d61/f7d 0 2024-09-13T21:44:53.750 INFO:tasks.workunit.client.1.smithi155.stdout:8/388: fdatasync d2/f47 0 2024-09-13T21:44:53.751 INFO:tasks.workunit.client.1.smithi155.stdout:1/378: dwrite d6/d15/f18 [0,4194304] 0 2024-09-13T21:44:53.753 INFO:tasks.workunit.client.1.smithi155.stdout:7/411: mknod d5/df/d60/d6d/c7e 0 2024-09-13T21:44:53.754 INFO:tasks.workunit.client.1.smithi155.stdout:1/379: stat d6/d15/d3e/c11 0 2024-09-13T21:44:53.754 INFO:tasks.workunit.client.1.smithi155.stdout:6/515: dread db/f10 [0,4194304] 0 2024-09-13T21:44:53.755 INFO:tasks.workunit.client.1.smithi155.stdout:2/296: dwrite d2/dd/d37/f4a [0,4194304] 0 2024-09-13T21:44:53.758 INFO:tasks.workunit.client.1.smithi155.stdout:9/429: dread dc/de/f45 [0,4194304] 0 2024-09-13T21:44:53.759 INFO:tasks.workunit.client.1.smithi155.stdout:1/380: chown d6/d15/d57/d5d/d72/c77 7007475 1 2024-09-13T21:44:53.759 INFO:tasks.workunit.client.1.smithi155.stdout:7/412: unlink d5/d3b/f59 0 2024-09-13T21:44:53.760 INFO:tasks.workunit.client.1.smithi155.stdout:1/381: truncate d6/d15/f58 5190616 0 2024-09-13T21:44:53.761 INFO:tasks.workunit.client.1.smithi155.stdout:8/389: dread d2/d6/dd/d25/f4c [0,4194304] 0 2024-09-13T21:44:53.762 INFO:tasks.workunit.client.1.smithi155.stdout:9/430: write dc/de/d5c/f5e [1695851,44611] 0 2024-09-13T21:44:53.762 INFO:tasks.workunit.client.1.smithi155.stdout:7/413: unlink d5/f3a 0 2024-09-13T21:44:53.764 INFO:tasks.workunit.client.1.smithi155.stdout:6/516: symlink db/d2c/d9d/d1c/d36/l9f 0 2024-09-13T21:44:53.764 INFO:tasks.workunit.client.1.smithi155.stdout:2/297: creat d2/f69 x:0 0 0 2024-09-13T21:44:53.765 INFO:tasks.workunit.client.1.smithi155.stdout:7/414: dread d5/df/d15/f28 [0,4194304] 0 2024-09-13T21:44:53.766 INFO:tasks.workunit.client.0.smithi119.stdout:0/754: sync 2024-09-13T21:44:53.767 INFO:tasks.workunit.client.1.smithi155.stdout:8/390: stat d2/d8/l64 0 2024-09-13T21:44:53.767 INFO:tasks.workunit.client.1.smithi155.stdout:8/391: chown d2/d2d/l3d 53099716 1 2024-09-13T21:44:53.768 INFO:tasks.workunit.client.1.smithi155.stdout:9/431: creat dc/de/d15/f97 x:0 0 0 2024-09-13T21:44:53.770 INFO:tasks.workunit.client.0.smithi119.stdout:2/727: symlink d1/d22/db6/le3 0 2024-09-13T21:44:53.770 INFO:tasks.workunit.client.1.smithi155.stdout:2/298: rmdir d2/dd/de/d15 39 2024-09-13T21:44:53.771 INFO:tasks.workunit.client.1.smithi155.stdout:8/392: chown d2/d6/dd/l2f 7 1 2024-09-13T21:44:53.771 INFO:tasks.workunit.client.1.smithi155.stdout:9/432: write dc/d19/d23/f2e [562400,125467] 0 2024-09-13T21:44:53.771 INFO:tasks.workunit.client.0.smithi119.stdout:0/755: dread - de/d1c/d2f/d35/f79 zero size 2024-09-13T21:44:53.774 INFO:tasks.workunit.client.0.smithi119.stdout:0/756: dread - de/d1c/d2f/d40/fbc zero size 2024-09-13T21:44:53.776 INFO:tasks.workunit.client.0.smithi119.stdout:0/757: fdatasync de/d1c/d2f/d35/f45 0 2024-09-13T21:44:53.777 INFO:tasks.workunit.client.1.smithi155.stdout:9/433: creat dc/d19/d23/d38/d90/f98 x:0 0 0 2024-09-13T21:44:53.779 INFO:tasks.workunit.client.1.smithi155.stdout:6/517: getdents db/d11/d4c/d64/d88 0 2024-09-13T21:44:53.779 INFO:tasks.workunit.client.1.smithi155.stdout:1/382: dread d6/d15/d57/d5d/f5f [0,4194304] 0 2024-09-13T21:44:53.780 INFO:tasks.workunit.client.1.smithi155.stdout:9/434: mknod dc/d18/d1e/c99 0 2024-09-13T21:44:53.780 INFO:tasks.workunit.client.1.smithi155.stdout:1/383: chown d6/d15/d3e 0 1 2024-09-13T21:44:53.782 INFO:tasks.workunit.client.1.smithi155.stdout:6/518: symlink db/d2c/d9d/d1c/la0 0 2024-09-13T21:44:53.782 INFO:tasks.workunit.client.1.smithi155.stdout:6/519: readlink db/l63 0 2024-09-13T21:44:53.785 INFO:tasks.workunit.client.1.smithi155.stdout:9/435: getdents dc/d19/d21/d67 0 2024-09-13T21:44:53.786 INFO:tasks.workunit.client.1.smithi155.stdout:6/520: symlink db/d11/d4c/d7c/d8b/d8e/la1 0 2024-09-13T21:44:53.788 INFO:tasks.workunit.client.1.smithi155.stdout:6/521: dread - db/d3d/d5f/f84 zero size 2024-09-13T21:44:53.788 INFO:tasks.workunit.client.1.smithi155.stdout:9/436: creat dc/d19/d23/f9a x:0 0 0 2024-09-13T21:44:53.789 INFO:tasks.workunit.client.1.smithi155.stdout:6/522: write db/f2f [665249,115219] 0 2024-09-13T21:44:53.793 INFO:tasks.workunit.client.1.smithi155.stdout:6/523: creat db/d11/d4c/d64/d5e/d93/fa2 x:0 0 0 2024-09-13T21:44:53.795 INFO:tasks.workunit.client.1.smithi155.stdout:6/524: truncate db/d2c/d9d/d1c/d36/d37/f92 674839 0 2024-09-13T21:44:53.796 INFO:tasks.workunit.client.1.smithi155.stdout:9/437: dread dc/d18/f3d [0,4194304] 0 2024-09-13T21:44:53.797 INFO:tasks.workunit.client.1.smithi155.stdout:6/525: creat db/d11/d2b/d35/fa3 x:0 0 0 2024-09-13T21:44:53.798 INFO:tasks.workunit.client.1.smithi155.stdout:9/438: read dc/de/d6f/f7e [1792462,57035] 0 2024-09-13T21:44:53.799 INFO:tasks.workunit.client.0.smithi119.stdout:2/728: dread d1/d22/d55/d64/fa1 [0,4194304] 0 2024-09-13T21:44:53.799 INFO:tasks.workunit.client.0.smithi119.stdout:4/800: write d4/d1e/d26/d6d/f95 [1791793,116779] 0 2024-09-13T21:44:53.800 INFO:tasks.workunit.client.1.smithi155.stdout:6/526: mknod db/d11/d4c/d64/d88/ca4 0 2024-09-13T21:44:53.800 INFO:tasks.workunit.client.1.smithi155.stdout:6/527: fsync db/f1f 0 2024-09-13T21:44:53.801 INFO:tasks.workunit.client.1.smithi155.stdout:9/439: creat dc/de/d6f/d71/f9b x:0 0 0 2024-09-13T21:44:53.802 INFO:tasks.workunit.client.1.smithi155.stdout:6/528: symlink db/d2c/d9d/la5 0 2024-09-13T21:44:53.804 INFO:tasks.workunit.client.0.smithi119.stdout:4/801: creat d4/d1e/d28/d34/d99/df0/d100/f104 x:0 0 0 2024-09-13T21:44:53.804 INFO:tasks.workunit.client.0.smithi119.stdout:2/729: dread d1/d38/f59 [0,4194304] 0 2024-09-13T21:44:53.806 INFO:tasks.workunit.client.1.smithi155.stdout:9/440: rename dc/de/d2d/f89 to dc/de/d2d/d79/d43/f9c 0 2024-09-13T21:44:53.806 INFO:tasks.workunit.client.0.smithi119.stdout:2/730: rmdir d1/d22/d55/d31 39 2024-09-13T21:44:53.807 INFO:tasks.workunit.client.1.smithi155.stdout:9/441: readlink dc/d19/l4f 0 2024-09-13T21:44:53.807 INFO:tasks.workunit.client.1.smithi155.stdout:5/359: dread d5/f8 [0,4194304] 0 2024-09-13T21:44:53.808 INFO:tasks.workunit.client.0.smithi119.stdout:4/802: mknod d4/d1e/d28/d5d/c105 0 2024-09-13T21:44:53.809 INFO:tasks.workunit.client.1.smithi155.stdout:9/442: symlink dc/de/d5c/l9d 0 2024-09-13T21:44:53.810 INFO:tasks.workunit.client.1.smithi155.stdout:9/443: stat dc/d19/d23/d38/d90/l75 0 2024-09-13T21:44:53.811 INFO:tasks.workunit.client.1.smithi155.stdout:5/360: write d5/d16/d33/d1b/d2f/d3c/d6c/d45/f54 [300264,88087] 0 2024-09-13T21:44:53.811 INFO:tasks.workunit.client.0.smithi119.stdout:2/731: rename d1/lbb to d1/d97/le4 0 2024-09-13T21:44:53.812 INFO:tasks.workunit.client.0.smithi119.stdout:4/803: creat d4/d1e/d28/d34/d6a/d79/f106 x:0 0 0 2024-09-13T21:44:53.814 INFO:tasks.workunit.client.0.smithi119.stdout:4/804: chown d4/d1e/d28/d34/d6a/d79/dae/cd0 51573 1 2024-09-13T21:44:53.814 INFO:tasks.workunit.client.0.smithi119.stdout:0/758: truncate fd 1165655 0 2024-09-13T21:44:53.816 INFO:tasks.workunit.client.1.smithi155.stdout:5/361: fsync d5/d12/f48 0 2024-09-13T21:44:53.817 INFO:tasks.workunit.client.1.smithi155.stdout:9/444: creat dc/d18/d1e/d86/f9e x:0 0 0 2024-09-13T21:44:53.817 INFO:tasks.workunit.client.0.smithi119.stdout:4/805: mknod d4/d1e/df7/de9/df8/d8f/c107 0 2024-09-13T21:44:53.819 INFO:tasks.workunit.client.1.smithi155.stdout:9/445: creat dc/d19/d21/f9f x:0 0 0 2024-09-13T21:44:53.820 INFO:tasks.workunit.client.1.smithi155.stdout:2/299: rmdir d2 39 2024-09-13T21:44:53.821 INFO:tasks.workunit.client.1.smithi155.stdout:5/362: read d5/d16/d33/d1b/d2f/d3c/d44/f2e [261988,15950] 0 2024-09-13T21:44:53.821 INFO:tasks.workunit.client.0.smithi119.stdout:4/806: creat d4/dce/f108 x:0 0 0 2024-09-13T21:44:53.828 INFO:tasks.workunit.client.1.smithi155.stdout:5/363: dread d5/d16/d33/d1b/f57 [0,4194304] 0 2024-09-13T21:44:53.829 INFO:tasks.workunit.client.0.smithi119.stdout:4/807: dwrite d4/d1e/f5c [0,4194304] 0 2024-09-13T21:44:53.829 INFO:tasks.workunit.client.1.smithi155.stdout:8/393: dread d2/d8/f4f [0,4194304] 0 2024-09-13T21:44:53.830 INFO:tasks.workunit.client.0.smithi119.stdout:0/759: dwrite de/d1c/d2f/d35/d4a/d62/fa6 [0,4194304] 0 2024-09-13T21:44:53.830 INFO:tasks.workunit.client.1.smithi155.stdout:1/384: dread d6/f86 [0,4194304] 0 2024-09-13T21:44:53.832 INFO:tasks.workunit.client.1.smithi155.stdout:8/394: readlink d2/d6/dd/l2f 0 2024-09-13T21:44:53.834 INFO:tasks.workunit.client.1.smithi155.stdout:9/446: dwrite dc/d18/f3d [0,4194304] 0 2024-09-13T21:44:53.835 INFO:tasks.workunit.client.0.smithi119.stdout:4/808: creat d4/d1e/df7/de9/f109 x:0 0 0 2024-09-13T21:44:53.837 INFO:tasks.workunit.client.0.smithi119.stdout:2/732: dread d1/d22/d5a/d5d/f61 [0,4194304] 0 2024-09-13T21:44:53.837 INFO:tasks.workunit.client.1.smithi155.stdout:9/447: chown dc/de/d6f/d71 127378235 1 2024-09-13T21:44:53.838 INFO:tasks.workunit.client.0.smithi119.stdout:0/760: dwrite de/d1c/d52/f7a [0,4194304] 0 2024-09-13T21:44:53.840 INFO:tasks.workunit.client.1.smithi155.stdout:7/415: dwrite d5/d3b/f4b [0,4194304] 0 2024-09-13T21:44:53.840 INFO:tasks.workunit.client.0.smithi119.stdout:4/809: mknod d4/d1e/d28/d5d/c10a 0 2024-09-13T21:44:53.840 INFO:tasks.workunit.client.0.smithi119.stdout:2/733: readlink d1/d22/ld2 0 2024-09-13T21:44:53.842 INFO:tasks.workunit.client.0.smithi119.stdout:0/761: getdents de/d1c/d64 0 2024-09-13T21:44:53.842 INFO:tasks.workunit.client.1.smithi155.stdout:9/448: stat dc/d19/d21/f6b 0 2024-09-13T21:44:53.844 INFO:tasks.workunit.client.1.smithi155.stdout:9/449: readlink dc/d19/d23/l3b 0 2024-09-13T21:44:53.845 INFO:tasks.workunit.client.0.smithi119.stdout:0/762: chown de/d1c/c2d 86100 1 2024-09-13T21:44:53.845 INFO:tasks.workunit.client.1.smithi155.stdout:1/385: mkdir d6/d7/d89 0 2024-09-13T21:44:53.845 INFO:tasks.workunit.client.1.smithi155.stdout:8/395: mkdir d2/d1f/d77 0 2024-09-13T21:44:53.845 INFO:tasks.workunit.client.1.smithi155.stdout:2/300: mknod d2/db/c6a 0 2024-09-13T21:44:53.846 INFO:tasks.workunit.client.0.smithi119.stdout:0/763: chown de/d1c/d2f/l9f 3581974 1 2024-09-13T21:44:53.846 INFO:tasks.workunit.client.0.smithi119.stdout:4/810: dread d4/d1e/d26/d60/d71/fc6 [0,4194304] 0 2024-09-13T21:44:53.846 INFO:tasks.workunit.client.1.smithi155.stdout:8/396: readlink d2/l38 0 2024-09-13T21:44:53.846 INFO:tasks.workunit.client.0.smithi119.stdout:2/734: rename d1/d22/ld2 to d1/d7/d47/le5 0 2024-09-13T21:44:53.847 INFO:tasks.workunit.client.1.smithi155.stdout:1/386: write d6/d15/f58 [1667810,23374] 0 2024-09-13T21:44:53.849 INFO:tasks.workunit.client.0.smithi119.stdout:4/811: creat d4/d1e/d26/d60/dad/dd5/f10b x:0 0 0 2024-09-13T21:44:53.850 INFO:tasks.workunit.client.0.smithi119.stdout:2/735: creat d1/d22/d5a/d5d/d83/fe6 x:0 0 0 2024-09-13T21:44:53.850 INFO:tasks.workunit.client.1.smithi155.stdout:8/397: dread - d2/f74 zero size 2024-09-13T21:44:53.853 INFO:tasks.workunit.client.0.smithi119.stdout:4/812: write d4/d1e/d26/d60/d71/fc6 [470830,67668] 0 2024-09-13T21:44:53.856 INFO:tasks.workunit.client.0.smithi119.stdout:2/736: creat d1/d22/d5a/d5d/d83/dce/fe7 x:0 0 0 2024-09-13T21:44:53.857 INFO:tasks.workunit.client.0.smithi119.stdout:0/764: dwrite de/d1c/d2f/d35/d4a/f60 [4194304,4194304] 0 2024-09-13T21:44:53.857 INFO:tasks.workunit.client.0.smithi119.stdout:2/737: write d1/d22/fc0 [599303,36411] 0 2024-09-13T21:44:53.857 INFO:tasks.workunit.client.1.smithi155.stdout:7/416: symlink d5/df/d15/d33/l7f 0 2024-09-13T21:44:53.857 INFO:tasks.workunit.client.1.smithi155.stdout:1/387: dwrite d6/d15/f34 [0,4194304] 0 2024-09-13T21:44:53.859 INFO:tasks.workunit.client.1.smithi155.stdout:8/398: mkdir d2/d1f/d77/d78 0 2024-09-13T21:44:53.859 INFO:tasks.workunit.client.0.smithi119.stdout:4/813: rename d4/d1e/d28/l6c to d4/d1e/d26/d6d/d7c/l10c 0 2024-09-13T21:44:53.859 INFO:tasks.workunit.client.0.smithi119.stdout:0/765: rmdir de/d1c/d2f/d40 39 2024-09-13T21:44:53.859 INFO:tasks.workunit.client.1.smithi155.stdout:7/417: creat d5/df/f80 x:0 0 0 2024-09-13T21:44:53.859 INFO:tasks.workunit.client.1.smithi155.stdout:2/301: truncate d2/dd/de/d15/f46 421050 0 2024-09-13T21:44:53.860 INFO:tasks.workunit.client.0.smithi119.stdout:2/738: symlink d1/d38/d89/le8 0 2024-09-13T21:44:53.860 INFO:tasks.workunit.client.1.smithi155.stdout:1/388: write d6/f16 [6702424,64258] 0 2024-09-13T21:44:53.862 INFO:tasks.workunit.client.1.smithi155.stdout:7/418: mknod d5/df/d60/c81 0 2024-09-13T21:44:53.864 INFO:tasks.workunit.client.1.smithi155.stdout:2/302: mkdir d2/db/d6b 0 2024-09-13T21:44:53.864 INFO:tasks.workunit.client.0.smithi119.stdout:4/814: symlink d4/d1e/d28/d34/d99/df0/d100/l10d 0 2024-09-13T21:44:53.868 INFO:tasks.workunit.client.1.smithi155.stdout:7/419: rename d5/df/d60/d6d/c7e to d5/c82 0 2024-09-13T21:44:53.868 INFO:tasks.workunit.client.0.smithi119.stdout:2/739: read d1/d22/d55/f44 [1319382,100902] 0 2024-09-13T21:44:53.869 INFO:tasks.workunit.client.1.smithi155.stdout:2/303: mkdir d2/db/d6b/d6c 0 2024-09-13T21:44:53.869 INFO:tasks.workunit.client.1.smithi155.stdout:8/399: dwrite d2/d6/f6a [0,4194304] 0 2024-09-13T21:44:53.871 INFO:tasks.workunit.client.0.smithi119.stdout:0/766: link de/d1c/d2b/d34/f5b de/d1c/d2f/d40/d66/dcb/dd6/fff 0 2024-09-13T21:44:53.872 INFO:tasks.workunit.client.0.smithi119.stdout:4/815: dwrite d4/f2b [0,4194304] 0 2024-09-13T21:44:53.874 INFO:tasks.workunit.client.1.smithi155.stdout:2/304: read d2/f6 [1676672,102668] 0 2024-09-13T21:44:53.874 INFO:tasks.workunit.client.0.smithi119.stdout:4/816: creat d4/dce/f10e x:0 0 0 2024-09-13T21:44:53.876 INFO:tasks.workunit.client.0.smithi119.stdout:0/767: mkdir de/d1c/d59/da8/d100 0 2024-09-13T21:44:53.877 INFO:tasks.workunit.client.1.smithi155.stdout:2/305: readlink d2/dd/d37/l49 0 2024-09-13T21:44:53.880 INFO:tasks.workunit.client.1.smithi155.stdout:2/306: write f1 [3057478,46466] 0 2024-09-13T21:44:53.881 INFO:tasks.workunit.client.0.smithi119.stdout:4/817: dread d4/d1e/f17 [0,4194304] 0 2024-09-13T21:44:53.881 INFO:tasks.workunit.client.1.smithi155.stdout:7/420: dwrite d5/df/d15/f53 [0,4194304] 0 2024-09-13T21:44:53.882 INFO:tasks.workunit.client.0.smithi119.stdout:4/818: chown d4/d1e/d28/d34/d6a/d79/d9f/fb8 1950 1 2024-09-13T21:44:53.882 INFO:tasks.workunit.client.1.smithi155.stdout:7/421: dread - d5/d13/d5f/f6c zero size 2024-09-13T21:44:53.883 INFO:tasks.workunit.client.0.smithi119.stdout:0/768: rename l4 to de/d1c/d2f/d35/d4a/l101 0 2024-09-13T21:44:53.884 INFO:tasks.workunit.client.0.smithi119.stdout:4/819: creat d4/d1e/d26/d60/d69/f10f x:0 0 0 2024-09-13T21:44:53.886 INFO:tasks.workunit.client.0.smithi119.stdout:0/769: rename de/d1c/d2f/d35/f45 to de/d1c/d64/f102 0 2024-09-13T21:44:53.886 INFO:tasks.workunit.client.0.smithi119.stdout:4/820: fsync d4/d1e/d26/d6d/fab 0 2024-09-13T21:44:53.887 INFO:tasks.workunit.client.0.smithi119.stdout:4/821: write d4/f52 [767759,88847] 0 2024-09-13T21:44:53.888 INFO:tasks.workunit.client.1.smithi155.stdout:7/422: link d5/d13/f3d d5/d3b/f83 0 2024-09-13T21:44:53.888 INFO:tasks.workunit.client.1.smithi155.stdout:7/423: chown d5/d10 15 1 2024-09-13T21:44:53.889 INFO:tasks.workunit.client.0.smithi119.stdout:0/770: write de/d1c/d52/f55 [9806162,25665] 0 2024-09-13T21:44:53.891 INFO:tasks.workunit.client.0.smithi119.stdout:0/771: fdatasync de/d3c/f3d 0 2024-09-13T21:44:53.896 INFO:tasks.workunit.client.0.smithi119.stdout:0/772: symlink de/d1c/d2f/d35/dce/def/l103 0 2024-09-13T21:44:53.896 INFO:tasks.workunit.client.0.smithi119.stdout:4/822: dwrite d4/d1e/d28/d5d/fcc [0,4194304] 0 2024-09-13T21:44:53.897 INFO:tasks.workunit.client.1.smithi155.stdout:7/424: dwrite d5/df/f11 [0,4194304] 0 2024-09-13T21:44:53.900 INFO:tasks.workunit.client.0.smithi119.stdout:4/823: rename d4/d1e/d28/d34/d6a/d79/d9f to d4/d1e/d28/d34/d6a/d79/d9f/d110 22 2024-09-13T21:44:53.901 INFO:tasks.workunit.client.1.smithi155.stdout:5/364: dwrite d5/d16/f2a [0,4194304] 0 2024-09-13T21:44:53.902 INFO:tasks.workunit.client.1.smithi155.stdout:7/425: symlink d5/d10/l84 0 2024-09-13T21:44:53.904 INFO:tasks.workunit.client.0.smithi119.stdout:0/773: dwrite de/d1c/d2b/dd7/fda [0,4194304] 0 2024-09-13T21:44:53.905 INFO:tasks.workunit.client.0.smithi119.stdout:0/774: read - de/d1c/d2f/d40/d66/dcb/fe3 zero size 2024-09-13T21:44:53.906 INFO:tasks.workunit.client.1.smithi155.stdout:7/426: creat d5/df/f85 x:0 0 0 2024-09-13T21:44:53.906 INFO:tasks.workunit.client.0.smithi119.stdout:0/775: chown de/d1c/d2f/d35/d4a/d62/fa6 123244268 1 2024-09-13T21:44:53.909 INFO:tasks.workunit.client.1.smithi155.stdout:5/365: creat d5/d16/d33/d1b/d2f/d3c/d6c/f76 x:0 0 0 2024-09-13T21:44:53.909 INFO:tasks.workunit.client.1.smithi155.stdout:1/389: dread d6/d15/d3e/f4a [0,4194304] 0 2024-09-13T21:44:53.912 INFO:tasks.workunit.client.0.smithi119.stdout:0/776: link de/d1c/d2b/d76/l9d de/d1c/d2f/d40/d66/dcb/dd6/d83/l104 0 2024-09-13T21:44:53.912 INFO:tasks.workunit.client.1.smithi155.stdout:7/427: creat d5/df/d60/f86 x:0 0 0 2024-09-13T21:44:53.913 INFO:tasks.workunit.client.0.smithi119.stdout:0/777: chown de/d1c/d64/lcd 6 1 2024-09-13T21:44:53.917 INFO:tasks.workunit.client.0.smithi119.stdout:0/778: creat de/d1c/d2f/d35/d4a/f105 x:0 0 0 2024-09-13T21:44:53.920 INFO:tasks.workunit.client.1.smithi155.stdout:7/428: creat d5/df/d15/d33/d55/f87 x:0 0 0 2024-09-13T21:44:53.921 INFO:tasks.workunit.client.0.smithi119.stdout:0/779: rename de/d1c/d2f/l4b to de/d1c/d2f/d35/d90/l106 0 2024-09-13T21:44:53.922 INFO:tasks.workunit.client.0.smithi119.stdout:2/740: write d1/d22/d55/f48 [4950128,67582] 0 2024-09-13T21:44:53.922 INFO:tasks.workunit.client.1.smithi155.stdout:1/390: rename d6/d7/cc to d6/d7/d48/c8a 0 2024-09-13T21:44:53.922 INFO:tasks.workunit.client.1.smithi155.stdout:9/450: dwrite dc/d19/d21/f55 [0,4194304] 0 2024-09-13T21:44:53.923 INFO:tasks.workunit.client.0.smithi119.stdout:0/780: chown de/d1c/f29 0 1 2024-09-13T21:44:53.923 INFO:tasks.workunit.client.0.smithi119.stdout:2/741: dread - d1/d7/f51 zero size 2024-09-13T21:44:53.924 INFO:tasks.workunit.client.1.smithi155.stdout:9/451: readlink dc/d19/d23/d38/d90/d74/l8f 0 2024-09-13T21:44:53.925 INFO:tasks.workunit.client.0.smithi119.stdout:0/781: rmdir de/d1c/d2b/d34 39 2024-09-13T21:44:53.926 INFO:tasks.workunit.client.0.smithi119.stdout:0/782: mknod de/d3c/d7c/c107 0 2024-09-13T21:44:53.927 INFO:tasks.workunit.client.1.smithi155.stdout:7/429: getdents d5/d13/d5f 0 2024-09-13T21:44:53.927 INFO:tasks.workunit.client.1.smithi155.stdout:9/452: fsync dc/d19/d23/d38/d90/f8d 0 2024-09-13T21:44:53.928 INFO:tasks.workunit.client.0.smithi119.stdout:0/783: stat de/d1c/d2b/d34/cd3 0 2024-09-13T21:44:53.929 INFO:tasks.workunit.client.1.smithi155.stdout:9/453: write dc/d18/d1e/f64 [375347,93533] 0 2024-09-13T21:44:53.930 INFO:tasks.workunit.client.0.smithi119.stdout:0/784: creat de/d3c/de6/f108 x:0 0 0 2024-09-13T21:44:53.931 INFO:tasks.workunit.client.0.smithi119.stdout:7/846: sync 2024-09-13T21:44:53.931 INFO:tasks.workunit.client.1.smithi155.stdout:7/430: write d5/d13/f3d [1148237,50374] 0 2024-09-13T21:44:53.932 INFO:tasks.workunit.client.1.smithi155.stdout:7/431: stat d5/df/d15/d33/d43/l65 0 2024-09-13T21:44:53.933 INFO:tasks.workunit.client.0.smithi119.stdout:0/785: fsync de/d1c/d2f/d35/d90/f95 0 2024-09-13T21:44:53.933 INFO:tasks.workunit.client.1.smithi155.stdout:9/454: creat dc/d19/d21/d67/fa0 x:0 0 0 2024-09-13T21:44:53.934 INFO:tasks.workunit.client.0.smithi119.stdout:7/847: truncate d8/d3c/d53/d3b/d7e/fd0 527792 0 2024-09-13T21:44:53.936 INFO:tasks.workunit.client.0.smithi119.stdout:7/848: creat d8/d3c/d53/d3b/d7e/dc2/f114 x:0 0 0 2024-09-13T21:44:53.937 INFO:tasks.workunit.client.0.smithi119.stdout:0/786: symlink de/d1c/d2f/d35/d4a/l109 0 2024-09-13T21:44:53.938 INFO:tasks.workunit.client.0.smithi119.stdout:7/849: dread - d8/d3c/d46/fc1 zero size 2024-09-13T21:44:53.939 INFO:tasks.workunit.client.0.smithi119.stdout:0/787: creat de/d1c/d2b/d76/d9b/da1/f10a x:0 0 0 2024-09-13T21:44:53.941 INFO:tasks.workunit.client.1.smithi155.stdout:7/432: dwrite d5/df/d15/d33/d43/f64 [0,4194304] 0 2024-09-13T21:44:53.941 INFO:tasks.workunit.client.0.smithi119.stdout:7/850: symlink d8/l115 0 2024-09-13T21:44:53.941 INFO:tasks.workunit.client.1.smithi155.stdout:2/307: dread d2/dd/de/f13 [4194304,4194304] 0 2024-09-13T21:44:53.942 INFO:tasks.workunit.client.0.smithi119.stdout:0/788: rename de/d1c/d2f/f6c to de/d1c/d2f/d40/f10b 0 2024-09-13T21:44:53.943 INFO:tasks.workunit.client.1.smithi155.stdout:7/433: symlink d5/d13/l88 0 2024-09-13T21:44:53.943 INFO:tasks.workunit.client.0.smithi119.stdout:0/789: fdatasync de/d1c/d2f/d35/d4a/d62/f75 0 2024-09-13T21:44:53.945 INFO:tasks.workunit.client.0.smithi119.stdout:7/851: rename d8/d3c/d53/f28 to d8/d3c/d53/d3b/d48/f116 0 2024-09-13T21:44:53.946 INFO:tasks.workunit.client.1.smithi155.stdout:2/308: symlink d2/l6d 0 2024-09-13T21:44:53.947 INFO:tasks.workunit.client.0.smithi119.stdout:0/790: mknod de/d1c/d2f/d35/d90/c10c 0 2024-09-13T21:44:53.949 INFO:tasks.workunit.client.1.smithi155.stdout:2/309: read d2/db/f40 [1533369,64081] 0 2024-09-13T21:44:53.950 INFO:tasks.workunit.client.0.smithi119.stdout:7/852: mkdir d8/d3c/d53/d37/d95/d117 0 2024-09-13T21:44:53.957 INFO:tasks.workunit.client.0.smithi119.stdout:0/791: rename de/d1c/d64/ca2 to de/d1c/d2f/d35/c10d 0 2024-09-13T21:44:53.957 INFO:tasks.workunit.client.0.smithi119.stdout:4/824: dwrite d4/d1e/d28/d34/f9a [0,4194304] 0 2024-09-13T21:44:53.958 INFO:tasks.workunit.client.0.smithi119.stdout:7/853: rename d8/d3c/d46 to d8/d3c/d46/db1/dc8/d118 22 2024-09-13T21:44:53.958 INFO:tasks.workunit.client.1.smithi155.stdout:2/310: dwrite d2/dd/d37/f67 [0,4194304] 0 2024-09-13T21:44:53.958 INFO:tasks.workunit.client.1.smithi155.stdout:1/391: write d6/ff [4971513,102221] 0 2024-09-13T21:44:53.959 INFO:tasks.workunit.client.0.smithi119.stdout:4/825: dread - d4/d1e/d10/da5/f103 zero size 2024-09-13T21:44:53.959 INFO:tasks.workunit.client.0.smithi119.stdout:2/742: truncate d1/d22/d5a/d5d/f78 3835135 0 2024-09-13T21:44:53.960 INFO:tasks.workunit.client.1.smithi155.stdout:9/455: dread dc/d19/d23/f2b [0,4194304] 0 2024-09-13T21:44:53.962 INFO:tasks.workunit.client.0.smithi119.stdout:0/792: mknod de/d4e/c10e 0 2024-09-13T21:44:53.962 INFO:tasks.workunit.client.1.smithi155.stdout:1/392: stat d6/d15/d23/d55/f6f 0 2024-09-13T21:44:53.963 INFO:tasks.workunit.client.0.smithi119.stdout:0/793: stat de/d1c/d59/da8/d100 0 2024-09-13T21:44:53.963 INFO:tasks.workunit.client.0.smithi119.stdout:0/794: chown de/d1c 1245 1 2024-09-13T21:44:53.963 INFO:tasks.workunit.client.0.smithi119.stdout:2/743: mknod d1/d22/d5a/d5d/d77/daa/ce9 0 2024-09-13T21:44:53.966 INFO:tasks.workunit.client.0.smithi119.stdout:4/826: dread d4/d1e/d26/d60/f65 [0,4194304] 0 2024-09-13T21:44:53.967 INFO:tasks.workunit.client.0.smithi119.stdout:2/744: write d1/d22/d55/d64/fc2 [367156,2524] 0 2024-09-13T21:44:53.967 INFO:tasks.workunit.client.1.smithi155.stdout:5/366: dwrite d5/d12/f48 [4194304,4194304] 0 2024-09-13T21:44:53.968 INFO:tasks.workunit.client.0.smithi119.stdout:0/795: creat de/d1c/d2f/f10f x:0 0 0 2024-09-13T21:44:53.969 INFO:tasks.workunit.client.0.smithi119.stdout:7/854: dread d8/d3c/d53/d37/d57/f62 [0,4194304] 0 2024-09-13T21:44:53.969 INFO:tasks.workunit.client.1.smithi155.stdout:5/367: chown d5/d16/d33/d1b/f5e 10347094 1 2024-09-13T21:44:53.969 INFO:tasks.workunit.client.0.smithi119.stdout:4/827: write d4/d1e/d26/d60/d71/f8e [1879115,111417] 0 2024-09-13T21:44:53.971 INFO:tasks.workunit.client.0.smithi119.stdout:2/745: creat d1/d7/d47/fea x:0 0 0 2024-09-13T21:44:53.973 INFO:tasks.workunit.client.0.smithi119.stdout:0/796: creat de/d1c/d2f/d35/d4a/dac/f110 x:0 0 0 2024-09-13T21:44:53.973 INFO:tasks.workunit.client.0.smithi119.stdout:4/828: symlink d4/d1e/d26/d6d/d7c/l111 0 2024-09-13T21:44:53.975 INFO:tasks.workunit.client.1.smithi155.stdout:2/311: rmdir d2/db/d6b/d6c 0 2024-09-13T21:44:53.975 INFO:tasks.workunit.client.1.smithi155.stdout:9/456: dread dc/d18/f3d [0,4194304] 0 2024-09-13T21:44:53.976 INFO:tasks.workunit.client.0.smithi119.stdout:7/855: rename d8/d3c/d53/d37/fa4 to d8/d3c/d46/f119 0 2024-09-13T21:44:53.979 INFO:tasks.workunit.client.0.smithi119.stdout:7/856: write d8/d3c/d53/d37/d83/d89/d3d/fbe [3775006,55440] 0 2024-09-13T21:44:53.980 INFO:tasks.workunit.client.0.smithi119.stdout:7/857: stat d8/d3c/d53/d37/c106 0 2024-09-13T21:44:53.980 INFO:tasks.workunit.client.1.smithi155.stdout:5/368: creat d5/d16/d33/d1b/d2f/d3c/d6c/f77 x:0 0 0 2024-09-13T21:44:53.981 INFO:tasks.workunit.client.0.smithi119.stdout:7/858: chown d8/d3c/d46/fc1 185708750 1 2024-09-13T21:44:53.982 INFO:tasks.workunit.client.1.smithi155.stdout:1/393: rename d6/c9 to d6/d15/d23/d55/d6e/c8b 0 2024-09-13T21:44:53.983 INFO:tasks.workunit.client.0.smithi119.stdout:7/859: write d8/d3c/d53/d6b/ffb [4784255,100093] 0 2024-09-13T21:44:53.984 INFO:tasks.workunit.client.1.smithi155.stdout:5/369: fsync d5/d12/f4b 0 2024-09-13T21:44:53.985 INFO:tasks.workunit.client.1.smithi155.stdout:9/457: rename dc/d18/d1e/c99 to dc/de/d5c/ca1 0 2024-09-13T21:44:53.986 INFO:tasks.workunit.client.0.smithi119.stdout:0/797: rename de/f1a to de/d1c/d2f/d35/f111 0 2024-09-13T21:44:53.987 INFO:tasks.workunit.client.1.smithi155.stdout:1/394: write d6/d15/d57/d5d/f5f [6238490,51168] 0 2024-09-13T21:44:53.987 INFO:tasks.workunit.client.1.smithi155.stdout:9/458: chown dc/d19/d23/f2b 118528 1 2024-09-13T21:44:53.989 INFO:tasks.workunit.client.0.smithi119.stdout:7/860: symlink d8/d3c/d53/d37/d95/l11a 0 2024-09-13T21:44:53.989 INFO:tasks.workunit.client.1.smithi155.stdout:5/370: getdents d5/d16/d4e 0 2024-09-13T21:44:53.990 INFO:tasks.workunit.client.1.smithi155.stdout:5/371: read - d5/f47 zero size 2024-09-13T21:44:53.991 INFO:tasks.workunit.client.0.smithi119.stdout:0/798: creat de/d1c/d2f/f112 x:0 0 0 2024-09-13T21:44:53.992 INFO:tasks.workunit.client.1.smithi155.stdout:1/395: rename d6/l12 to d6/d82/l8c 0 2024-09-13T21:44:53.996 INFO:tasks.workunit.client.1.smithi155.stdout:1/396: mknod d6/d15/d23/d55/d6e/c8d 0 2024-09-13T21:44:53.997 INFO:tasks.workunit.client.1.smithi155.stdout:9/459: dwrite dc/de/d6f/f7d [0,4194304] 0 2024-09-13T21:44:53.997 INFO:tasks.workunit.client.1.smithi155.stdout:5/372: creat d5/d16/d33/d1b/d28/d52/f78 x:0 0 0 2024-09-13T21:44:53.998 INFO:tasks.workunit.client.0.smithi119.stdout:2/746: getdents d1/d22/d5a/d5d/d77/daa 0 2024-09-13T21:44:54.000 INFO:tasks.workunit.client.1.smithi155.stdout:1/397: write d6/d15/d23/f3c [4489893,126094] 0 2024-09-13T21:44:54.002 INFO:tasks.workunit.client.1.smithi155.stdout:9/460: fdatasync dc/de/f45 0 2024-09-13T21:44:54.003 INFO:tasks.workunit.client.1.smithi155.stdout:9/461: stat dc/de/l44 0 2024-09-13T21:44:54.003 INFO:tasks.workunit.client.1.smithi155.stdout:5/373: creat d5/d16/d33/d1b/d2f/d3c/d6c/f79 x:0 0 0 2024-09-13T21:44:54.003 INFO:tasks.workunit.client.0.smithi119.stdout:7/861: truncate d8/d3c/d53/d37/fa1 121955 0 2024-09-13T21:44:54.004 INFO:tasks.workunit.client.1.smithi155.stdout:1/398: read d6/f33 [4596702,127081] 0 2024-09-13T21:44:54.004 INFO:tasks.workunit.client.1.smithi155.stdout:2/312: truncate d2/dd/de/d15/f46 35525 0 2024-09-13T21:44:54.005 INFO:tasks.workunit.client.0.smithi119.stdout:7/862: stat d8/d3c/d53/d37/d83/f108 0 2024-09-13T21:44:54.005 INFO:tasks.workunit.client.0.smithi119.stdout:0/799: truncate de/d4e/fe0 2452949 0 2024-09-13T21:44:54.006 INFO:tasks.workunit.client.1.smithi155.stdout:9/462: dread dc/d19/d23/f47 [0,4194304] 0 2024-09-13T21:44:54.006 INFO:tasks.workunit.client.1.smithi155.stdout:2/313: chown d2/db/f62 41736546 1 2024-09-13T21:44:54.008 INFO:tasks.workunit.client.1.smithi155.stdout:1/399: rmdir d6/d15 39 2024-09-13T21:44:54.009 INFO:tasks.workunit.client.1.smithi155.stdout:9/463: write dc/d18/d1e/f22 [970806,86914] 0 2024-09-13T21:44:54.010 INFO:tasks.workunit.client.0.smithi119.stdout:7/863: creat d8/d3c/d53/d37/d83/d89/dc3/d10e/f11b x:0 0 0 2024-09-13T21:44:54.011 INFO:tasks.workunit.client.0.smithi119.stdout:4/829: dread d4/f4e [0,4194304] 0 2024-09-13T21:44:54.011 INFO:tasks.workunit.client.1.smithi155.stdout:5/374: mkdir d5/d16/d33/d1b/d2f/d3c/d44/d29/d7a 0 2024-09-13T21:44:54.012 INFO:tasks.workunit.client.0.smithi119.stdout:4/830: stat d4/d1e/d28/l4f 0 2024-09-13T21:44:54.012 INFO:tasks.workunit.client.0.smithi119.stdout:7/864: write d8/d3c/d53/d37/d83/d89/d47/faf [1491570,70825] 0 2024-09-13T21:44:54.014 INFO:tasks.workunit.client.1.smithi155.stdout:9/464: fsync dc/d19/d23/f47 0 2024-09-13T21:44:54.016 INFO:tasks.workunit.client.1.smithi155.stdout:1/400: symlink d6/d15/d23/d55/d6e/l8e 0 2024-09-13T21:44:54.017 INFO:tasks.workunit.client.1.smithi155.stdout:2/314: dwrite d2/db/f1d [0,4194304] 0 2024-09-13T21:44:54.017 INFO:tasks.workunit.client.0.smithi119.stdout:7/865: rename d8/d19/f35 to d8/f11c 0 2024-09-13T21:44:54.019 INFO:tasks.workunit.client.1.smithi155.stdout:5/375: fsync d5/d16/d33/d1b/d2f/d3c/d44/f42 0 2024-09-13T21:44:54.019 INFO:tasks.workunit.client.1.smithi155.stdout:9/465: mkdir dc/d18/d1e/da2 0 2024-09-13T21:44:54.019 INFO:tasks.workunit.client.0.smithi119.stdout:4/831: dwrite d4/d1e/d28/f8d [0,4194304] 0 2024-09-13T21:44:54.021 INFO:tasks.workunit.client.1.smithi155.stdout:9/466: mkdir dc/de/d6f/da3 0 2024-09-13T21:44:54.022 INFO:tasks.workunit.client.1.smithi155.stdout:1/401: chown d6/d15/d57/d5d/d72/c77 58666540 1 2024-09-13T21:44:54.024 INFO:tasks.workunit.client.0.smithi119.stdout:0/800: write de/d4e/d7f/fa3 [1006606,115848] 0 2024-09-13T21:44:54.025 INFO:tasks.workunit.client.0.smithi119.stdout:0/801: chown de/f68 1 1 2024-09-13T21:44:54.027 INFO:tasks.workunit.client.1.smithi155.stdout:1/402: unlink d6/d15/d3e/f80 0 2024-09-13T21:44:54.030 INFO:tasks.workunit.client.0.smithi119.stdout:4/832: getdents d4/d1e/d28/d34/d6a/d79/d9f/dee 0 2024-09-13T21:44:54.032 INFO:tasks.workunit.client.0.smithi119.stdout:4/833: chown d4/d1e/d28/fc8 378123 1 2024-09-13T21:44:54.032 INFO:tasks.workunit.client.0.smithi119.stdout:0/802: creat de/d1c/d2f/d40/d66/dcb/f113 x:0 0 0 2024-09-13T21:44:54.033 INFO:tasks.workunit.client.0.smithi119.stdout:4/834: fsync d4/d1e/d26/d6d/d7c/fe8 0 2024-09-13T21:44:54.034 INFO:tasks.workunit.client.0.smithi119.stdout:0/803: fsync de/d1c/d2f/d40/d66/dcb/dd6/fff 0 2024-09-13T21:44:54.035 INFO:tasks.workunit.client.0.smithi119.stdout:4/835: dread - d4/d1e/d26/d6d/d7c/fe8 zero size 2024-09-13T21:44:54.036 INFO:tasks.workunit.client.0.smithi119.stdout:0/804: mknod de/d1c/d2f/d40/c114 0 2024-09-13T21:44:54.037 INFO:tasks.workunit.client.1.smithi155.stdout:2/315: dwrite d2/dd/de/d15/d2e/d31/f5c [0,4194304] 0 2024-09-13T21:44:54.038 INFO:tasks.workunit.client.0.smithi119.stdout:0/805: chown de/d1c/d2f/d35/d90/cf6 237 1 2024-09-13T21:44:54.038 INFO:tasks.workunit.client.1.smithi155.stdout:5/376: dwrite d5/d16/d33/d1b/d2f/d3c/d6c/f46 [0,4194304] 0 2024-09-13T21:44:54.038 INFO:tasks.workunit.client.1.smithi155.stdout:9/467: dwrite dc/de/d2d/d79/d43/f4d [0,4194304] 0 2024-09-13T21:44:54.038 INFO:tasks.workunit.client.0.smithi119.stdout:4/836: getdents d4/d1e/d26/d6d/d7c 0 2024-09-13T21:44:54.046 INFO:tasks.workunit.client.1.smithi155.stdout:9/468: creat dc/d18/d1e/fa4 x:0 0 0 2024-09-13T21:44:54.049 INFO:tasks.workunit.client.1.smithi155.stdout:5/377: dwrite d5/d16/d33/d1f/f4f [0,4194304] 0 2024-09-13T21:44:54.049 INFO:tasks.workunit.client.1.smithi155.stdout:2/316: creat d2/db/d6b/f6e x:0 0 0 2024-09-13T21:44:54.050 INFO:tasks.workunit.client.1.smithi155.stdout:9/469: chown dc/de/d2d/c57 60775958 1 2024-09-13T21:44:54.053 INFO:tasks.workunit.client.1.smithi155.stdout:5/378: creat d5/d16/d33/d1b/d28/d52/f7b x:0 0 0 2024-09-13T21:44:54.055 INFO:tasks.workunit.client.1.smithi155.stdout:2/317: mkdir d2/dd/de/d15/d2e/d66/d6f 0 2024-09-13T21:44:54.060 INFO:tasks.workunit.client.1.smithi155.stdout:9/470: link dc/d19/d23/l3c dc/de/d2d/d79/d43/la5 0 2024-09-13T21:44:54.060 INFO:tasks.workunit.client.0.smithi119.stdout:4/837: truncate d4/d1e/d28/d34/d6a/d79/d9f/dba/fe3 1804655 0 2024-09-13T21:44:54.061 INFO:tasks.workunit.client.1.smithi155.stdout:5/379: dwrite d5/f9 [0,4194304] 0 2024-09-13T21:44:54.064 INFO:tasks.workunit.client.1.smithi155.stdout:9/471: write dc/d19/d21/d67/f69 [237852,72131] 0 2024-09-13T21:44:54.064 INFO:tasks.workunit.client.1.smithi155.stdout:2/318: mkdir d2/dd/de/d15/d38/d41/d5f/d70 0 2024-09-13T21:44:54.065 INFO:tasks.workunit.client.0.smithi119.stdout:7/866: dwrite d8/d3c/d53/d37/d83/d89/f11 [0,4194304] 0 2024-09-13T21:44:54.065 INFO:tasks.workunit.client.1.smithi155.stdout:2/319: dread - d2/dd/f65 zero size 2024-09-13T21:44:54.065 INFO:tasks.workunit.client.0.smithi119.stdout:7/867: creat d8/d3c/d53/d6b/f11d x:0 0 0 2024-09-13T21:44:54.066 INFO:tasks.workunit.client.1.smithi155.stdout:2/320: fsync d2/dd/d21/d39/f48 0 2024-09-13T21:44:54.067 INFO:tasks.workunit.client.1.smithi155.stdout:9/472: unlink dc/d19/l96 0 2024-09-13T21:44:54.068 INFO:tasks.workunit.client.0.smithi119.stdout:7/868: mkdir d8/d3c/d53/d37/d83/d89/dc3/d11e 0 2024-09-13T21:44:54.071 INFO:tasks.workunit.client.0.smithi119.stdout:7/869: dread - d8/d3c/d53/d37/d83/d89/dc3/ffe zero size 2024-09-13T21:44:54.073 INFO:tasks.workunit.client.1.smithi155.stdout:9/473: link dc/d18/d1e/c26 dc/d19/d23/d38/d90/ca6 0 2024-09-13T21:44:54.073 INFO:tasks.workunit.client.0.smithi119.stdout:7/870: rename d8/d3c/ce1 to d8/d19/d2e/c11f 0 2024-09-13T21:44:54.075 INFO:tasks.workunit.client.1.smithi155.stdout:9/474: write dc/de/f45 [4872268,119040] 0 2024-09-13T21:44:54.075 INFO:tasks.workunit.client.0.smithi119.stdout:7/871: mkdir d8/d3c/d53/d37/d83/d89/dc3/d120 0 2024-09-13T21:44:54.075 INFO:tasks.workunit.client.1.smithi155.stdout:9/475: chown dc 167090 1 2024-09-13T21:44:54.077 INFO:tasks.workunit.client.0.smithi119.stdout:7/872: creat d8/d19/f121 x:0 0 0 2024-09-13T21:44:54.077 INFO:tasks.workunit.client.1.smithi155.stdout:5/380: rmdir d5/d16/d33/d1b/d28 39 2024-09-13T21:44:54.079 INFO:tasks.workunit.client.0.smithi119.stdout:7/873: dread d8/d3c/d53/d37/d57/d5f/fd1 [0,4194304] 0 2024-09-13T21:44:54.080 INFO:tasks.workunit.client.1.smithi155.stdout:9/476: symlink dc/d18/la7 0 2024-09-13T21:44:54.081 INFO:tasks.workunit.client.1.smithi155.stdout:5/381: write d5/d16/d33/d1b/d2f/d3c/d6c/f76 [778091,83700] 0 2024-09-13T21:44:54.082 INFO:tasks.workunit.client.1.smithi155.stdout:2/321: dread f0 [0,4194304] 0 2024-09-13T21:44:54.083 INFO:tasks.workunit.client.1.smithi155.stdout:9/477: readlink dc/d18/d1e/l72 0 2024-09-13T21:44:54.083 INFO:tasks.workunit.client.1.smithi155.stdout:1/403: dwrite d6/d15/d23/d87/f21 [0,4194304] 0 2024-09-13T21:44:54.085 INFO:tasks.workunit.client.1.smithi155.stdout:5/382: read d5/d16/d33/d1b/d2f/d3c/d6c/d45/f6d [4094814,106553] 0 2024-09-13T21:44:54.090 INFO:tasks.workunit.client.1.smithi155.stdout:9/478: rename dc/d18/d50/l87 to dc/d19/d23/d38/la8 0 2024-09-13T21:44:54.090 INFO:tasks.workunit.client.1.smithi155.stdout:1/404: unlink d6/d7/f40 0 2024-09-13T21:44:54.091 INFO:tasks.workunit.client.1.smithi155.stdout:1/405: write d6/d7/f2f [1203306,33183] 0 2024-09-13T21:44:54.093 INFO:tasks.workunit.client.1.smithi155.stdout:5/383: dread f0 [0,4194304] 0 2024-09-13T21:44:54.094 INFO:tasks.workunit.client.1.smithi155.stdout:1/406: rmdir d6 39 2024-09-13T21:44:54.097 INFO:tasks.workunit.client.1.smithi155.stdout:2/322: write d2/db/f18 [1105223,116337] 0 2024-09-13T21:44:54.098 INFO:tasks.workunit.client.1.smithi155.stdout:1/407: readlink d6/d15/d23/d87/l51 0 2024-09-13T21:44:54.099 INFO:tasks.workunit.client.1.smithi155.stdout:5/384: dread d5/d16/d33/d1b/d1e/f4c [0,4194304] 0 2024-09-13T21:44:54.100 INFO:tasks.workunit.client.1.smithi155.stdout:9/479: getdents dc/de/d5c 0 2024-09-13T21:44:54.100 INFO:tasks.workunit.client.1.smithi155.stdout:2/323: rmdir d2/dd/d21 39 2024-09-13T21:44:54.102 INFO:tasks.workunit.client.0.smithi119.stdout:8/791: sync 2024-09-13T21:44:54.102 INFO:tasks.workunit.client.0.smithi119.stdout:6/731: sync 2024-09-13T21:44:54.103 INFO:tasks.workunit.client.1.smithi155.stdout:2/324: mknod d2/dd/c71 0 2024-09-13T21:44:54.103 INFO:tasks.workunit.client.1.smithi155.stdout:9/480: truncate dc/de/d2d/d79/f62 4650465 0 2024-09-13T21:44:54.103 INFO:tasks.workunit.client.0.smithi119.stdout:6/732: fdatasync dc/df/d41/f90 0 2024-09-13T21:44:54.105 INFO:tasks.workunit.client.0.smithi119.stdout:6/733: read - dc/d3d/d4e/f9b zero size 2024-09-13T21:44:54.106 INFO:tasks.workunit.client.0.smithi119.stdout:7/874: dread d8/d19/d2e/f71 [0,4194304] 0 2024-09-13T21:44:54.110 INFO:tasks.workunit.client.1.smithi155.stdout:5/385: dwrite d5/d16/d33/d1b/d2f/d3c/f75 [0,4194304] 0 2024-09-13T21:44:54.110 INFO:tasks.workunit.client.0.smithi119.stdout:7/875: creat d8/d3c/f122 x:0 0 0 2024-09-13T21:44:54.112 INFO:tasks.workunit.client.1.smithi155.stdout:2/325: truncate d2/fc 3908036 0 2024-09-13T21:44:54.113 INFO:tasks.workunit.client.1.smithi155.stdout:1/408: dwrite d6/d15/d23/d87/d30/d4b/f6d [0,4194304] 0 2024-09-13T21:44:54.115 INFO:tasks.workunit.client.0.smithi119.stdout:7/876: creat d8/d3c/d53/d37/f123 x:0 0 0 2024-09-13T21:44:54.116 INFO:tasks.workunit.client.1.smithi155.stdout:5/386: dread - d5/d16/d33/d1b/d1e/f72 zero size 2024-09-13T21:44:54.117 INFO:tasks.workunit.client.1.smithi155.stdout:9/481: dwrite dc/d19/d21/d67/f84 [0,4194304] 0 2024-09-13T21:44:54.118 INFO:tasks.workunit.client.0.smithi119.stdout:8/792: dwrite f15 [0,4194304] 0 2024-09-13T21:44:54.119 INFO:tasks.workunit.client.0.smithi119.stdout:7/877: mkdir d8/d113/d124 0 2024-09-13T21:44:54.120 INFO:tasks.workunit.client.1.smithi155.stdout:5/387: read - d5/d16/d33/d1b/d2f/d3c/d6c/f77 zero size 2024-09-13T21:44:54.121 INFO:tasks.workunit.client.1.smithi155.stdout:9/482: write dc/d19/d21/d67/fa0 [735203,45283] 0 2024-09-13T21:44:54.122 INFO:tasks.workunit.client.1.smithi155.stdout:2/326: creat d2/dd/f72 x:0 0 0 2024-09-13T21:44:54.122 INFO:tasks.workunit.client.1.smithi155.stdout:9/483: chown dc/de/d5c/l61 97 1 2024-09-13T21:44:54.123 INFO:tasks.workunit.client.1.smithi155.stdout:1/409: mknod d6/d15/d3e/c8f 0 2024-09-13T21:44:54.123 INFO:tasks.workunit.client.0.smithi119.stdout:8/793: fdatasync d1b/d1d/d48/f78 0 2024-09-13T21:44:54.125 INFO:tasks.workunit.client.1.smithi155.stdout:9/484: stat dc/d19/d23/d38/d90/f98 0 2024-09-13T21:44:54.129 INFO:tasks.workunit.client.1.smithi155.stdout:1/410: rename d6/d7/d64 to d6/d82/d90 0 2024-09-13T21:44:54.130 INFO:tasks.workunit.client.0.smithi119.stdout:6/734: dread dc/d3d/d4e/f76 [0,4194304] 0 2024-09-13T21:44:54.130 INFO:tasks.workunit.client.1.smithi155.stdout:9/485: readlink dc/d19/d23/d38/d90/l91 0 2024-09-13T21:44:54.130 INFO:tasks.workunit.client.0.smithi119.stdout:7/878: dread d8/d3c/d46/db1/fc6 [0,4194304] 0 2024-09-13T21:44:54.131 INFO:tasks.workunit.client.1.smithi155.stdout:9/486: write dc/d19/d23/d38/f78 [642495,25291] 0 2024-09-13T21:44:54.132 INFO:tasks.workunit.client.1.smithi155.stdout:1/411: unlink d6/d15/d23/d55/f6f 0 2024-09-13T21:44:54.133 INFO:tasks.workunit.client.0.smithi119.stdout:7/879: write d8/d113/fd9 [3731723,82327] 0 2024-09-13T21:44:54.133 INFO:tasks.workunit.client.0.smithi119.stdout:7/880: chown d8/d19/d2e 0 1 2024-09-13T21:44:54.135 INFO:tasks.workunit.client.1.smithi155.stdout:9/487: mknod dc/de/d2d/d79/d43/d83/ca9 0 2024-09-13T21:44:54.136 INFO:tasks.workunit.client.0.smithi119.stdout:6/735: creat dc/d3d/d40/d68/fe3 x:0 0 0 2024-09-13T21:44:54.137 INFO:tasks.workunit.client.1.smithi155.stdout:9/488: chown dc/d19/d21/l28 690 1 2024-09-13T21:44:54.138 INFO:tasks.workunit.client.0.smithi119.stdout:8/794: creat d1b/fee x:0 0 0 2024-09-13T21:44:54.139 INFO:tasks.workunit.client.0.smithi119.stdout:7/881: rmdir d8/d3c/d53/d3b/d7e/dc2 39 2024-09-13T21:44:54.140 INFO:tasks.workunit.client.0.smithi119.stdout:6/736: stat dc/df/c11 0 2024-09-13T21:44:54.141 INFO:tasks.workunit.client.0.smithi119.stdout:8/795: creat d1b/d1d/d48/db2/fef x:0 0 0 2024-09-13T21:44:54.142 INFO:tasks.workunit.client.0.smithi119.stdout:8/796: read - d1b/d1d/d5e/fc2 zero size 2024-09-13T21:44:54.143 INFO:tasks.workunit.client.0.smithi119.stdout:8/797: chown d1b/d4e/lb8 0 1 2024-09-13T21:44:54.145 INFO:tasks.workunit.client.0.smithi119.stdout:7/882: link d8/d19/d2e/d34/f3a d8/d3c/d53/d37/d57/d8f/f125 0 2024-09-13T21:44:54.147 INFO:tasks.workunit.client.1.smithi155.stdout:5/388: dread d5/d16/d33/d1b/d2f/d3c/d6c/d45/f54 [0,4194304] 0 2024-09-13T21:44:54.147 INFO:tasks.workunit.client.0.smithi119.stdout:8/798: rename d1b/d1d/d5e to d1b/d1d/d26/df0 0 2024-09-13T21:44:54.147 INFO:tasks.workunit.client.0.smithi119.stdout:8/799: readlink l1a 0 2024-09-13T21:44:54.148 INFO:tasks.workunit.client.0.smithi119.stdout:7/883: creat d8/d3c/d53/d37/d83/d89/d3d/f126 x:0 0 0 2024-09-13T21:44:54.151 INFO:tasks.workunit.client.0.smithi119.stdout:7/884: creat d8/d3c/d53/d37/d83/d89/de7/f127 x:0 0 0 2024-09-13T21:44:54.152 INFO:tasks.workunit.client.1.smithi155.stdout:5/389: dwrite d5/d16/d4e/f58 [0,4194304] 0 2024-09-13T21:44:54.153 INFO:tasks.workunit.client.1.smithi155.stdout:5/390: write d5/f47 [85593,18157] 0 2024-09-13T21:44:54.154 INFO:tasks.workunit.client.0.smithi119.stdout:8/800: dwrite d1b/d1d/d26/d3e/d65/f88 [8388608,4194304] 0 2024-09-13T21:44:54.158 INFO:tasks.workunit.client.0.smithi119.stdout:7/885: link d8/d3c/d53/d37/d83/f108 d8/d3c/d46/db1/dc8/f128 0 2024-09-13T21:44:54.158 INFO:tasks.workunit.client.1.smithi155.stdout:5/391: rename d5/d16/d33/d1b/d28/f4a to d5/d16/d33/d1b/d2f/d3c/d6c/d45/f7c 0 2024-09-13T21:44:54.162 INFO:tasks.workunit.client.0.smithi119.stdout:8/801: creat d1b/d4e/ff1 x:0 0 0 2024-09-13T21:44:54.165 INFO:tasks.workunit.client.1.smithi155.stdout:5/392: rmdir d5/d16/d33/d1b/d2f/d3c/d44/d29/d7a 0 2024-09-13T21:44:54.166 INFO:tasks.workunit.client.0.smithi119.stdout:8/802: creat d1b/d1d/ff2 x:0 0 0 2024-09-13T21:44:54.167 INFO:tasks.workunit.client.0.smithi119.stdout:7/886: dwrite d8/d3c/d46/db1/fc6 [0,4194304] 0 2024-09-13T21:44:54.168 INFO:tasks.workunit.client.0.smithi119.stdout:7/887: stat d8/d3c/d53/d37/d83/lcc 0 2024-09-13T21:44:54.169 INFO:tasks.workunit.client.1.smithi155.stdout:5/393: write d5/d16/d33/d1b/d28/f37 [4081261,115109] 0 2024-09-13T21:44:54.170 INFO:tasks.workunit.client.1.smithi155.stdout:2/327: write d2/fc [2083897,64599] 0 2024-09-13T21:44:54.172 INFO:tasks.workunit.client.0.smithi119.stdout:8/803: link d1b/d4e/l52 d1b/d1d/d26/df0/de7/lf3 0 2024-09-13T21:44:54.173 INFO:tasks.workunit.client.1.smithi155.stdout:2/328: chown d2/db/f1d 178947 1 2024-09-13T21:44:54.173 INFO:tasks.workunit.client.1.smithi155.stdout:1/412: truncate d6/d15/d23/d55/f60 4001554 0 2024-09-13T21:44:54.173 INFO:tasks.workunit.client.1.smithi155.stdout:2/329: chown d2/dd/de/d15/d38/d41 0 1 2024-09-13T21:44:54.175 INFO:tasks.workunit.client.0.smithi119.stdout:6/737: dwrite dc/d3d/d4e/fdf [0,4194304] 0 2024-09-13T21:44:54.176 INFO:tasks.workunit.client.1.smithi155.stdout:1/413: readlink d6/d15/l61 0 2024-09-13T21:44:54.176 INFO:tasks.workunit.client.0.smithi119.stdout:8/804: fdatasync d1b/d1d/d48/d58/f7a 0 2024-09-13T21:44:54.178 INFO:tasks.workunit.client.0.smithi119.stdout:6/738: mkdir dc/d3a/dbb/d7a/de1/de4 0 2024-09-13T21:44:54.179 INFO:tasks.workunit.client.1.smithi155.stdout:2/330: creat d2/dd/d37/d4e/f73 x:0 0 0 2024-09-13T21:44:54.179 INFO:tasks.workunit.client.1.smithi155.stdout:1/414: fsync d6/d15/d57/d5d/f6a 0 2024-09-13T21:44:54.183 INFO:tasks.workunit.client.1.smithi155.stdout:9/489: dwrite dc/de/d2d/d79/f41 [4194304,4194304] 0 2024-09-13T21:44:54.183 INFO:tasks.workunit.client.0.smithi119.stdout:8/805: dwrite d1b/d1d/d26/fab [0,4194304] 0 2024-09-13T21:44:54.185 INFO:tasks.workunit.client.0.smithi119.stdout:6/739: link dc/d4b/f8c dc/df/d41/dbf/fe5 0 2024-09-13T21:44:54.185 INFO:tasks.workunit.client.1.smithi155.stdout:9/490: chown dc/de/d5c/ca1 58 1 2024-09-13T21:44:54.185 INFO:tasks.workunit.client.1.smithi155.stdout:9/491: read - dc/d18/f7a zero size 2024-09-13T21:44:54.187 INFO:tasks.workunit.client.0.smithi119.stdout:6/740: read - dc/d3d/d4e/f74 zero size 2024-09-13T21:44:54.189 INFO:tasks.workunit.client.0.smithi119.stdout:6/741: write dc/d3d/d4e/f53 [9105991,45034] 0 2024-09-13T21:44:54.189 INFO:tasks.workunit.client.0.smithi119.stdout:8/806: creat d1b/d1d/d26/ff4 x:0 0 0 2024-09-13T21:44:54.189 INFO:tasks.workunit.client.0.smithi119.stdout:6/742: chown dc/df 1529 1 2024-09-13T21:44:54.196 INFO:tasks.workunit.client.0.smithi119.stdout:8/807: getdents d1b/d1d/d48/d58 0 2024-09-13T21:44:54.198 INFO:tasks.workunit.client.0.smithi119.stdout:8/808: dread d1b/fce [0,4194304] 0 2024-09-13T21:44:54.199 INFO:tasks.workunit.client.0.smithi119.stdout:8/809: write d1b/d1d/f8f [994859,78619] 0 2024-09-13T21:44:54.200 INFO:tasks.workunit.client.0.smithi119.stdout:8/810: chown f5 5416630 1 2024-09-13T21:44:54.202 INFO:tasks.workunit.client.0.smithi119.stdout:8/811: link d1b/d1d/d39/l55 d1b/d1d/d26/df0/de7/lf5 0 2024-09-13T21:44:54.214 INFO:tasks.workunit.client.0.smithi119.stdout:8/812: write d1b/d1d/d26/fa8 [5231576,63870] 0 2024-09-13T21:44:54.216 INFO:tasks.workunit.client.0.smithi119.stdout:8/813: write d1b/fee [967552,114336] 0 2024-09-13T21:44:54.217 INFO:tasks.workunit.client.0.smithi119.stdout:8/814: write d1b/d1d/ff2 [808111,126699] 0 2024-09-13T21:44:54.218 INFO:tasks.workunit.client.0.smithi119.stdout:8/815: write d1b/fee [386644,87184] 0 2024-09-13T21:44:54.218 INFO:tasks.workunit.client.0.smithi119.stdout:8/816: chown d1b/d4e/d6a/lda 226 1 2024-09-13T21:44:54.227 INFO:tasks.workunit.client.0.smithi119.stdout:8/817: rename d1b/d1d/d26/d3e/d65/cd7 to d1b/d1d/d39/cf6 0 2024-09-13T21:44:54.248 INFO:tasks.workunit.client.0.smithi119.stdout:5/803: sync 2024-09-13T21:44:54.248 INFO:tasks.workunit.client.0.smithi119.stdout:1/777: sync 2024-09-13T21:44:54.248 INFO:tasks.workunit.client.0.smithi119.stdout:3/776: sync 2024-09-13T21:44:54.249 INFO:tasks.workunit.client.0.smithi119.stdout:3/777: write d6/d15/d1a/f79 [1321645,67350] 0 2024-09-13T21:44:54.251 INFO:tasks.workunit.client.0.smithi119.stdout:5/804: unlink d0/d3/d4/d9/d14/l43 0 2024-09-13T21:44:54.253 INFO:tasks.workunit.client.0.smithi119.stdout:5/805: rmdir d0/d3/d4/d9/d74 39 2024-09-13T21:44:54.253 INFO:tasks.workunit.client.0.smithi119.stdout:1/778: dread d1/d3/d61/d77/d78/f50 [0,4194304] 0 2024-09-13T21:44:54.254 INFO:tasks.workunit.client.0.smithi119.stdout:3/778: dread d6/d25/d2f/d33/d56/da0/fb0 [0,4194304] 0 2024-09-13T21:44:54.255 INFO:tasks.workunit.client.0.smithi119.stdout:3/779: stat d6/dfa 0 2024-09-13T21:44:54.256 INFO:tasks.workunit.client.0.smithi119.stdout:5/806: write d0/d3/d4/d9/f47 [1319066,108879] 0 2024-09-13T21:44:54.259 INFO:tasks.workunit.client.0.smithi119.stdout:3/780: creat d6/f100 x:0 0 0 2024-09-13T21:44:54.260 INFO:tasks.workunit.client.0.smithi119.stdout:3/781: readlink d6/d15/d1a/d45/d8d/lf8 0 2024-09-13T21:44:54.261 INFO:tasks.workunit.client.0.smithi119.stdout:5/807: truncate d0/d3/d4/d9/d14/d24/d25/f58 673407 0 2024-09-13T21:44:54.262 INFO:tasks.workunit.client.0.smithi119.stdout:1/779: link d1/d3/d61/d77/d78/db8/dde/df1/cf6 d1/d3/d61/d77/d78/d32/d33/d43/de7/c102 0 2024-09-13T21:44:54.263 INFO:tasks.workunit.client.0.smithi119.stdout:5/808: stat d0/d3/c2b 0 2024-09-13T21:44:54.264 INFO:tasks.workunit.client.0.smithi119.stdout:3/782: mknod d6/d15/d1a/d45/c101 0 2024-09-13T21:44:54.268 INFO:tasks.workunit.client.0.smithi119.stdout:5/809: rename d0/d3/d1f/d21/d4f/leb to d0/d3/d1f/d21/l10d 0 2024-09-13T21:44:54.268 INFO:tasks.workunit.client.0.smithi119.stdout:3/783: mknod d6/d15/d1a/d45/c102 0 2024-09-13T21:44:54.270 INFO:tasks.workunit.client.0.smithi119.stdout:5/810: link d0/d3/d1f/d21/l23 d0/d3/d4/d9/d1e/da5/l10e 0 2024-09-13T21:44:54.273 INFO:tasks.workunit.client.0.smithi119.stdout:3/784: rename d6/d15/d1a/d45/d8d to d6/d15/d103 0 2024-09-13T21:44:54.279 INFO:tasks.workunit.client.0.smithi119.stdout:3/785: dwrite d6/f18 [0,4194304] 0 2024-09-13T21:44:54.281 INFO:tasks.workunit.client.0.smithi119.stdout:3/786: write d6/d15/d1a/d45/d47/d4d/dcf/dd0/fe1 [587283,50860] 0 2024-09-13T21:44:54.283 INFO:tasks.workunit.client.0.smithi119.stdout:5/811: rename d0/d3/d4/d9/d14/d24/d25 to d0/d3/d4/def/d10f 0 2024-09-13T21:44:54.284 INFO:tasks.workunit.client.0.smithi119.stdout:3/787: unlink d6/d15/d1a/d45/d47/d4d/f73 0 2024-09-13T21:44:54.286 INFO:tasks.workunit.client.0.smithi119.stdout:5/812: mkdir d0/d3/d4/d2e/d65/d110 0 2024-09-13T21:44:54.288 INFO:tasks.workunit.client.0.smithi119.stdout:3/788: unlink d6/d15/d1a/d45/d47/d4d/fe9 0 2024-09-13T21:44:54.290 INFO:tasks.workunit.client.0.smithi119.stdout:5/813: creat d0/d3/d1f/d21/d4f/d86/f111 x:0 0 0 2024-09-13T21:44:54.291 INFO:tasks.workunit.client.0.smithi119.stdout:3/789: symlink d6/d25/d2f/d33/d56/dab/l104 0 2024-09-13T21:44:54.295 INFO:tasks.workunit.client.0.smithi119.stdout:3/790: rename d6/d15/d8f/dbb to d6/d15/d1a/d45/d47/d4d/dcf/dd6/d105 0 2024-09-13T21:44:54.296 INFO:tasks.workunit.client.0.smithi119.stdout:3/791: symlink d6/d9f/dce/l106 0 2024-09-13T21:44:54.297 INFO:tasks.workunit.client.0.smithi119.stdout:3/792: creat d6/d9f/f107 x:0 0 0 2024-09-13T21:44:54.298 INFO:tasks.workunit.client.0.smithi119.stdout:3/793: fdatasync d6/d15/d1a/d45/d47/d4d/fee 0 2024-09-13T21:44:54.299 INFO:tasks.workunit.client.1.smithi155.stdout:1/415: mkdir d6/d82/d91 0 2024-09-13T21:44:54.300 INFO:tasks.workunit.client.0.smithi119.stdout:3/794: unlink d6/d25/d2f/d33/d56/dab/cf6 0 2024-09-13T21:44:54.302 INFO:tasks.workunit.client.0.smithi119.stdout:3/795: readlink d6/d25/d2f/d33/d56/dab/dc2/lec 0 2024-09-13T21:44:54.303 INFO:tasks.workunit.client.0.smithi119.stdout:5/814: truncate d0/d3/d4/d9/d14/f29 5618194 0 2024-09-13T21:44:54.304 INFO:tasks.workunit.client.1.smithi155.stdout:2/331: mknod d2/dd/de/d15/d2e/d66/d6f/c74 0 2024-09-13T21:44:54.304 INFO:tasks.workunit.client.0.smithi119.stdout:3/796: creat d6/d25/d2f/d33/d56/dab/dc2/f108 x:0 0 0 2024-09-13T21:44:54.306 INFO:tasks.workunit.client.1.smithi155.stdout:2/332: chown d2/dd/de/d15/d2e/f3c 68 1 2024-09-13T21:44:54.307 INFO:tasks.workunit.client.1.smithi155.stdout:9/492: rename dc/d19/d21/d67/fa0 to dc/faa 0 2024-09-13T21:44:54.307 INFO:tasks.workunit.client.0.smithi119.stdout:3/797: mkdir d6/d25/d2f/d8e/de2/d109 0 2024-09-13T21:44:54.307 INFO:tasks.workunit.client.1.smithi155.stdout:2/333: dread - d2/dd/de/d15/f4c zero size 2024-09-13T21:44:54.308 INFO:tasks.workunit.client.1.smithi155.stdout:9/493: stat dc/d19/d23/d38/d90/c82 0 2024-09-13T21:44:54.310 INFO:tasks.workunit.client.1.smithi155.stdout:9/494: write dc/d18/f20 [778296,98296] 0 2024-09-13T21:44:54.311 INFO:tasks.workunit.client.0.smithi119.stdout:5/815: write d0/d3/d4/f5e [4032690,55496] 0 2024-09-13T21:44:54.313 INFO:tasks.workunit.client.1.smithi155.stdout:1/416: dread d6/d15/f58 [0,4194304] 0 2024-09-13T21:44:54.314 INFO:tasks.workunit.client.0.smithi119.stdout:8/818: read d1b/d4e/d6a/f9f [2352481,58837] 0 2024-09-13T21:44:54.315 INFO:tasks.workunit.client.1.smithi155.stdout:1/417: chown d6/d7/d89 196 1 2024-09-13T21:44:54.316 INFO:tasks.workunit.client.0.smithi119.stdout:8/819: dread - d1b/d1d/d39/f9c zero size 2024-09-13T21:44:54.316 INFO:tasks.workunit.client.1.smithi155.stdout:2/334: dwrite d2/dd/de/d15/f2d [0,4194304] 0 2024-09-13T21:44:54.319 INFO:tasks.workunit.client.1.smithi155.stdout:1/418: mknod d6/d15/d57/d5d/d72/c92 0 2024-09-13T21:44:54.319 INFO:tasks.workunit.client.1.smithi155.stdout:2/335: rmdir d2/dd/de 39 2024-09-13T21:44:54.319 INFO:tasks.workunit.client.0.smithi119.stdout:5/816: dwrite d0/d3/d4/d2e/d65/f81 [4194304,4194304] 0 2024-09-13T21:44:54.320 INFO:tasks.workunit.client.0.smithi119.stdout:8/820: creat d1b/d1d/d26/d3e/daa/ff7 x:0 0 0 2024-09-13T21:44:54.322 INFO:tasks.workunit.client.0.smithi119.stdout:3/798: dread d6/d44/d52/d85/f8b [0,4194304] 0 2024-09-13T21:44:54.323 INFO:tasks.workunit.client.1.smithi155.stdout:9/495: dwrite fa [4194304,4194304] 0 2024-09-13T21:44:54.325 INFO:tasks.workunit.client.0.smithi119.stdout:8/821: unlink d1b/d4e/d6a/lda 0 2024-09-13T21:44:54.327 INFO:tasks.workunit.client.0.smithi119.stdout:8/822: mkdir d1b/d1d/df8 0 2024-09-13T21:44:54.328 INFO:tasks.workunit.client.1.smithi155.stdout:2/336: symlink d2/dd/de/d15/d38/d41/d5f/d70/l75 0 2024-09-13T21:44:54.329 INFO:tasks.workunit.client.1.smithi155.stdout:9/496: rename dc/d19/d23/l56 to dc/d18/d1e/d86/lab 0 2024-09-13T21:44:54.330 INFO:tasks.workunit.client.0.smithi119.stdout:8/823: symlink d1b/d1d/d26/d3e/daa/lf9 0 2024-09-13T21:44:54.330 INFO:tasks.workunit.client.1.smithi155.stdout:9/497: chown dc/de/d6f/da3 2360 1 2024-09-13T21:44:54.331 INFO:tasks.workunit.client.0.smithi119.stdout:8/824: mknod d1b/d4e/d6a/cfa 0 2024-09-13T21:44:54.332 INFO:tasks.workunit.client.1.smithi155.stdout:9/498: mknod dc/d19/d23/cac 0 2024-09-13T21:44:54.333 INFO:tasks.workunit.client.0.smithi119.stdout:8/825: fdatasync d1b/d1d/d48/d58/f74 0 2024-09-13T21:44:54.335 INFO:tasks.workunit.client.0.smithi119.stdout:8/826: read - d1b/d1d/dc3/fc7 zero size 2024-09-13T21:44:54.336 INFO:tasks.workunit.client.0.smithi119.stdout:8/827: chown d1b/d1d/df8 72254230 1 2024-09-13T21:44:54.340 INFO:tasks.workunit.client.0.smithi119.stdout:5/817: dwrite d0/d3/fec [0,4194304] 0 2024-09-13T21:44:54.341 INFO:tasks.workunit.client.0.smithi119.stdout:8/828: creat d1b/d1d/ffb x:0 0 0 2024-09-13T21:44:54.345 INFO:tasks.workunit.client.0.smithi119.stdout:3/799: dread d6/f6b [0,4194304] 0 2024-09-13T21:44:54.346 INFO:tasks.workunit.client.0.smithi119.stdout:8/829: rename d1b/d1d/db4 to d1b/d1d/d48/d54/de0/dfc 0 2024-09-13T21:44:54.347 INFO:tasks.workunit.client.0.smithi119.stdout:8/830: write d1b/d1d/d26/f81 [4260254,23721] 0 2024-09-13T21:44:54.348 INFO:tasks.workunit.client.0.smithi119.stdout:3/800: truncate d6/d44/d52/ff2 1358884 0 2024-09-13T21:44:54.351 INFO:tasks.workunit.client.0.smithi119.stdout:3/801: creat d6/d15/d1a/d45/d47/d4d/dcf/dd0/f10a x:0 0 0 2024-09-13T21:44:54.355 INFO:tasks.workunit.client.0.smithi119.stdout:8/831: rename d1b/d1d/d26/d3e/fc0 to d1b/d1d/ffd 0 2024-09-13T21:44:54.356 INFO:tasks.workunit.client.1.smithi155.stdout:2/337: dread d2/dd/de/d15/d2e/f36 [0,4194304] 0 2024-09-13T21:44:54.358 INFO:tasks.workunit.client.0.smithi119.stdout:5/818: truncate d0/d3/d4/d2e/d65/f81 8144702 0 2024-09-13T21:44:54.359 INFO:tasks.workunit.client.0.smithi119.stdout:8/832: creat d1b/d1d/d26/d3e/d65/ffe x:0 0 0 2024-09-13T21:44:54.360 INFO:tasks.workunit.client.1.smithi155.stdout:2/338: link d2/db/l1f d2/dd/d21/l76 0 2024-09-13T21:44:54.361 INFO:tasks.workunit.client.0.smithi119.stdout:8/833: write d1b/d1d/d26/d3e/f7d [712229,22682] 0 2024-09-13T21:44:54.361 INFO:tasks.workunit.client.1.smithi155.stdout:2/339: creat d2/dd/d37/f77 x:0 0 0 2024-09-13T21:44:54.362 INFO:tasks.workunit.client.0.smithi119.stdout:8/834: write d1b/d1d/d48/d58/f79 [2280899,66451] 0 2024-09-13T21:44:54.362 INFO:tasks.workunit.client.0.smithi119.stdout:8/835: stat d1b/d1d/dc3/fc7 0 2024-09-13T21:44:54.363 INFO:tasks.workunit.client.0.smithi119.stdout:5/819: creat d0/d3/d1f/d21/da1/dfb/de1/f112 x:0 0 0 2024-09-13T21:44:54.363 INFO:tasks.workunit.client.1.smithi155.stdout:2/340: creat d2/dd/de/d15/d2e/d66/f78 x:0 0 0 2024-09-13T21:44:54.364 INFO:tasks.workunit.client.0.smithi119.stdout:3/802: write d6/d15/d1a/d45/f69 [240557,56518] 0 2024-09-13T21:44:54.364 INFO:tasks.workunit.client.0.smithi119.stdout:5/820: rmdir d0 39 2024-09-13T21:44:54.365 INFO:tasks.workunit.client.0.smithi119.stdout:3/803: write d6/d15/f30 [2680907,113820] 0 2024-09-13T21:44:54.366 INFO:tasks.workunit.client.1.smithi155.stdout:2/341: mknod d2/dd/de/d15/c79 0 2024-09-13T21:44:54.368 INFO:tasks.workunit.client.1.smithi155.stdout:2/342: write f0 [1452054,56184] 0 2024-09-13T21:44:54.369 INFO:tasks.workunit.client.0.smithi119.stdout:5/821: chown d0/d3/d4/d9/d1e/f72 166705 1 2024-09-13T21:44:54.370 INFO:tasks.workunit.client.0.smithi119.stdout:5/822: chown d0/d3/d4/d9/d14/d24/db6/de5 9696192 1 2024-09-13T21:44:54.373 INFO:tasks.workunit.client.0.smithi119.stdout:5/823: chown d0/d3/d4/l98 15785816 1 2024-09-13T21:44:54.374 INFO:tasks.workunit.client.0.smithi119.stdout:3/804: dwrite d6/d15/d1a/d45/d47/d4d/dcf/dd0/fe1 [0,4194304] 0 2024-09-13T21:44:54.377 INFO:tasks.workunit.client.0.smithi119.stdout:5/824: creat d0/f113 x:0 0 0 2024-09-13T21:44:54.379 INFO:tasks.workunit.client.1.smithi155.stdout:2/343: dread d2/dd/d21/f32 [0,4194304] 0 2024-09-13T21:44:54.381 INFO:tasks.workunit.client.0.smithi119.stdout:2/747: sync 2024-09-13T21:44:54.382 INFO:tasks.workunit.client.0.smithi119.stdout:0/806: sync 2024-09-13T21:44:54.382 INFO:tasks.workunit.client.0.smithi119.stdout:4/838: sync 2024-09-13T21:44:54.382 INFO:tasks.workunit.client.1.smithi155.stdout:2/344: mknod d2/dd/de/d15/d3f/c7a 0 2024-09-13T21:44:54.383 INFO:tasks.workunit.client.0.smithi119.stdout:0/807: fsync de/d1c/d2b/d76/d9a/fc2 0 2024-09-13T21:44:54.384 INFO:tasks.workunit.client.0.smithi119.stdout:4/839: write d4/d1e/d26/d6d/d7c/fe0 [1029319,95748] 0 2024-09-13T21:44:54.386 INFO:tasks.workunit.client.0.smithi119.stdout:4/840: write d4/f52 [1222925,28054] 0 2024-09-13T21:44:54.387 INFO:tasks.workunit.client.1.smithi155.stdout:1/419: rmdir d6/d15/d23/d55 39 2024-09-13T21:44:54.388 INFO:tasks.workunit.client.1.smithi155.stdout:5/394: dread d5/d16/d33/d1b/d2f/d3c/d6c/d45/f7c [0,4194304] 0 2024-09-13T21:44:54.389 INFO:tasks.workunit.client.0.smithi119.stdout:2/748: dread d1/d22/d55/d31/f94 [0,4194304] 0 2024-09-13T21:44:54.390 INFO:tasks.workunit.client.0.smithi119.stdout:4/841: truncate d4/d1e/d28/d34/f4c 4939964 0 2024-09-13T21:44:54.390 INFO:tasks.workunit.client.1.smithi155.stdout:5/395: readlink d5/d16/d33/d1b/d2f/d3c/d44/l24 0 2024-09-13T21:44:54.393 INFO:tasks.workunit.client.1.smithi155.stdout:1/420: dread d6/d15/d23/f3c [0,4194304] 0 2024-09-13T21:44:54.394 INFO:tasks.workunit.client.1.smithi155.stdout:1/421: chown d6/d15/f58 96 1 2024-09-13T21:44:54.397 INFO:tasks.workunit.client.1.smithi155.stdout:1/422: rename d6/d7/l27 to d6/d82/d90/l93 0 2024-09-13T21:44:54.398 INFO:tasks.workunit.client.0.smithi119.stdout:5/825: write d0/d3/d1f/d21/d4f/d86/fb4 [892174,109490] 0 2024-09-13T21:44:54.400 INFO:tasks.workunit.client.0.smithi119.stdout:5/826: readlink d0/d3/lb3 0 2024-09-13T21:44:54.400 INFO:tasks.workunit.client.0.smithi119.stdout:4/842: truncate d4/d1e/d26/d6d/f91 4109295 0 2024-09-13T21:44:54.402 INFO:tasks.workunit.client.0.smithi119.stdout:3/805: dwrite d6/f16 [4194304,4194304] 0 2024-09-13T21:44:54.405 INFO:tasks.workunit.client.1.smithi155.stdout:1/423: dwrite d6/d82/d90/f6c [0,4194304] 0 2024-09-13T21:44:54.405 INFO:tasks.workunit.client.0.smithi119.stdout:3/806: symlink d6/d9f/l10b 0 2024-09-13T21:44:54.406 INFO:tasks.workunit.client.0.smithi119.stdout:5/827: mkdir d0/d3/d4/d9/d14/d24/db6/d114 0 2024-09-13T21:44:54.408 INFO:tasks.workunit.client.1.smithi155.stdout:2/345: truncate d2/db/f1d 1911939 0 2024-09-13T21:44:54.409 INFO:tasks.workunit.client.0.smithi119.stdout:3/807: read d6/f12 [2188255,38960] 0 2024-09-13T21:44:54.410 INFO:tasks.workunit.client.0.smithi119.stdout:8/836: dread d1b/d1d/d48/d58/f95 [0,4194304] 0 2024-09-13T21:44:54.411 INFO:tasks.workunit.client.0.smithi119.stdout:2/749: dread d1/f32 [0,4194304] 0 2024-09-13T21:44:54.411 INFO:tasks.workunit.client.0.smithi119.stdout:4/843: dwrite d4/d1e/d10/f46 [0,4194304] 0 2024-09-13T21:44:54.412 INFO:tasks.workunit.client.1.smithi155.stdout:9/499: dwrite dc/d19/d23/f66 [4194304,4194304] 0 2024-09-13T21:44:54.412 INFO:tasks.workunit.client.0.smithi119.stdout:3/808: chown d6/d15/d8f/ld5 169 1 2024-09-13T21:44:54.412 INFO:tasks.workunit.client.1.smithi155.stdout:1/424: creat d6/d82/f94 x:0 0 0 2024-09-13T21:44:54.413 INFO:tasks.workunit.client.0.smithi119.stdout:8/837: chown d1b/d1d/d26/d6b/ca3 132045081 1 2024-09-13T21:44:54.414 INFO:tasks.workunit.client.0.smithi119.stdout:3/809: stat d6/d25/d2f/d33/d88/cc0 0 2024-09-13T21:44:54.415 INFO:tasks.workunit.client.1.smithi155.stdout:1/425: write d6/d15/f76 [957587,108679] 0 2024-09-13T21:44:54.416 INFO:tasks.workunit.client.0.smithi119.stdout:2/750: mkdir d1/d22/d5a/d5d/d77/daa/deb 0 2024-09-13T21:44:54.417 INFO:tasks.workunit.client.1.smithi155.stdout:2/346: creat d2/dd/de/d15/d2e/d66/f7b x:0 0 0 2024-09-13T21:44:54.418 INFO:tasks.workunit.client.0.smithi119.stdout:4/844: unlink d4/d1e/d28/c37 0 2024-09-13T21:44:54.420 INFO:tasks.workunit.client.0.smithi119.stdout:5/828: link d0/d3/d4/d9/d14/d24/f6e d0/d3/d4/def/df1/f115 0 2024-09-13T21:44:54.420 INFO:tasks.workunit.client.0.smithi119.stdout:3/810: mknod d6/d15/d1a/d45/d47/d4d/da7/dea/c10c 0 2024-09-13T21:44:54.421 INFO:tasks.workunit.client.1.smithi155.stdout:2/347: dread - d2/dd/f65 zero size 2024-09-13T21:44:54.422 INFO:tasks.workunit.client.0.smithi119.stdout:3/811: stat d6/d25/d2f/d33/d56/f7a 0 2024-09-13T21:44:54.422 INFO:tasks.workunit.client.0.smithi119.stdout:3/812: chown d6/d15/d1a/d45/d47/d4d/f94 4169953 1 2024-09-13T21:44:54.423 INFO:tasks.workunit.client.0.smithi119.stdout:4/845: creat d4/d1e/d28/d34/d6a/d79/d9f/dcf/f112 x:0 0 0 2024-09-13T21:44:54.423 INFO:tasks.workunit.client.0.smithi119.stdout:2/751: mkdir d1/d22/d5a/d5d/db7/dec 0 2024-09-13T21:44:54.424 INFO:tasks.workunit.client.0.smithi119.stdout:3/813: stat d6/d25/d2f/d33/d56/fe0 0 2024-09-13T21:44:54.425 INFO:tasks.workunit.client.1.smithi155.stdout:1/426: unlink d6/d15/d23/d87/d30/d4b/l5a 0 2024-09-13T21:44:54.426 INFO:tasks.workunit.client.0.smithi119.stdout:2/752: write d1/d22/d5a/fc9 [3955570,1716] 0 2024-09-13T21:44:54.427 INFO:tasks.workunit.client.0.smithi119.stdout:3/814: write d6/d25/d2f/d33/d56/da0/fb5 [1212191,25889] 0 2024-09-13T21:44:54.427 INFO:tasks.workunit.client.1.smithi155.stdout:5/396: dwrite d5/fe [0,4194304] 0 2024-09-13T21:44:54.427 INFO:tasks.workunit.client.0.smithi119.stdout:4/846: mkdir d4/d1e/d28/d5d/d113 0 2024-09-13T21:44:54.428 INFO:tasks.workunit.client.0.smithi119.stdout:2/753: readlink d1/d97/lb1 0 2024-09-13T21:44:54.428 INFO:tasks.workunit.client.1.smithi155.stdout:2/348: read - d2/dd/de/d15/f4c zero size 2024-09-13T21:44:54.428 INFO:tasks.workunit.client.0.smithi119.stdout:2/754: stat d1/d22/d5a/da9 0 2024-09-13T21:44:54.429 INFO:tasks.workunit.client.1.smithi155.stdout:4/372: sync 2024-09-13T21:44:54.430 INFO:tasks.workunit.client.0.smithi119.stdout:3/815: creat d6/d15/d1a/d45/d47/dd4/f10d x:0 0 0 2024-09-13T21:44:54.431 INFO:tasks.workunit.client.1.smithi155.stdout:9/500: dwrite dc/d19/d21/d67/f84 [0,4194304] 0 2024-09-13T21:44:54.431 INFO:tasks.workunit.client.0.smithi119.stdout:2/755: creat d1/d22/db6/dde/fed x:0 0 0 2024-09-13T21:44:54.432 INFO:tasks.workunit.client.0.smithi119.stdout:3/816: chown d6/d15/d1a/d45/d47/dd4/f10d 953865655 1 2024-09-13T21:44:54.435 INFO:tasks.workunit.client.0.smithi119.stdout:3/817: chown d6/d25/d2f/d8e/de2 1097789 1 2024-09-13T21:44:54.435 INFO:tasks.workunit.client.0.smithi119.stdout:2/756: rmdir d1/d22/d5a/d5d 39 2024-09-13T21:44:54.435 INFO:tasks.workunit.client.1.smithi155.stdout:4/373: write d1/d7/de/d15/d55/f62 [834240,46417] 0 2024-09-13T21:44:54.436 INFO:tasks.workunit.client.0.smithi119.stdout:4/847: getdents d4/d1e/d28/d34/ddd 0 2024-09-13T21:44:54.437 INFO:tasks.workunit.client.1.smithi155.stdout:9/501: mknod dc/de/cad 0 2024-09-13T21:44:54.437 INFO:tasks.workunit.client.1.smithi155.stdout:2/349: rmdir d2/dd/de/d15/d2e/d31/d5d 39 2024-09-13T21:44:54.438 INFO:tasks.workunit.client.0.smithi119.stdout:5/829: dread d0/d3/d4/def/f5f [0,4194304] 0 2024-09-13T21:44:54.439 INFO:tasks.workunit.client.0.smithi119.stdout:4/848: write d4/d1e/d28/f8d [5019947,15985] 0 2024-09-13T21:44:54.439 INFO:tasks.workunit.client.1.smithi155.stdout:9/502: mkdir dc/de/d6f/dae 0 2024-09-13T21:44:54.441 INFO:tasks.workunit.client.1.smithi155.stdout:9/503: write dc/d18/f94 [42486,19704] 0 2024-09-13T21:44:54.441 INFO:tasks.workunit.client.0.smithi119.stdout:2/757: mknod d1/d9d/cee 0 2024-09-13T21:44:54.442 INFO:tasks.workunit.client.1.smithi155.stdout:9/504: chown dc/de/d2d/d79/f63 1382501 1 2024-09-13T21:44:54.442 INFO:tasks.workunit.client.1.smithi155.stdout:5/397: link d5/d16/d33/d1b/d28/f60 d5/d16/d33/d1b/d2f/d3c/d44/d29/f7d 0 2024-09-13T21:44:54.443 INFO:tasks.workunit.client.1.smithi155.stdout:2/350: truncate d2/db/f40 3363108 0 2024-09-13T21:44:54.444 INFO:tasks.workunit.client.1.smithi155.stdout:9/505: dread - dc/de/d6f/d71/f9b zero size 2024-09-13T21:44:54.444 INFO:tasks.workunit.client.0.smithi119.stdout:3/818: getdents d6/d15/d1a/d45/d47/d4d/dcf/dd0 0 2024-09-13T21:44:54.444 INFO:tasks.workunit.client.1.smithi155.stdout:2/351: fsync d2/dd/f2c 0 2024-09-13T21:44:54.445 INFO:tasks.workunit.client.0.smithi119.stdout:2/758: fdatasync d1/d22/f42 0 2024-09-13T21:44:54.445 INFO:tasks.workunit.client.0.smithi119.stdout:3/819: stat d6/d25/d2f/d8e/de2/d109 0 2024-09-13T21:44:54.446 INFO:tasks.workunit.client.1.smithi155.stdout:4/374: rmdir d1/d7/de/dc/d2e/d26 0 2024-09-13T21:44:54.447 INFO:tasks.workunit.client.0.smithi119.stdout:2/759: chown d1/d7/d47/fa3 3500775 1 2024-09-13T21:44:54.448 INFO:tasks.workunit.client.0.smithi119.stdout:3/820: rename d6/d25 to d6/d25/d2f/d33/d56/dab/d10e 22 2024-09-13T21:44:54.449 INFO:tasks.workunit.client.1.smithi155.stdout:9/506: creat dc/d19/d21/faf x:0 0 0 2024-09-13T21:44:54.450 INFO:tasks.workunit.client.1.smithi155.stdout:5/398: getdents d5/d16/d33 0 2024-09-13T21:44:54.450 INFO:tasks.workunit.client.0.smithi119.stdout:3/821: mkdir d6/d15/d10f 0 2024-09-13T21:44:54.451 INFO:tasks.workunit.client.0.smithi119.stdout:2/760: write d1/d22/d5a/d5d/d83/dce/fe7 [894222,113576] 0 2024-09-13T21:44:54.451 INFO:tasks.workunit.client.0.smithi119.stdout:3/822: chown d6/d25/d2f/d33/f71 1019122 1 2024-09-13T21:44:54.452 INFO:tasks.workunit.client.1.smithi155.stdout:9/507: write dc/faa [1590587,92896] 0 2024-09-13T21:44:54.453 INFO:tasks.workunit.client.0.smithi119.stdout:2/761: symlink d1/d38/d89/lef 0 2024-09-13T21:44:54.453 INFO:tasks.workunit.client.0.smithi119.stdout:3/823: write d6/d15/d1a/f79 [2001814,110870] 0 2024-09-13T21:44:54.456 INFO:tasks.workunit.client.0.smithi119.stdout:8/838: dread d1b/d1d/d26/d3e/d65/f76 [0,4194304] 0 2024-09-13T21:44:54.456 INFO:tasks.workunit.client.1.smithi155.stdout:2/352: dwrite d2/fc [0,4194304] 0 2024-09-13T21:44:54.457 INFO:tasks.workunit.client.1.smithi155.stdout:9/508: mknod dc/d18/d1e/d86/cb0 0 2024-09-13T21:44:54.457 INFO:tasks.workunit.client.1.smithi155.stdout:5/399: dread d5/d16/d4e/f51 [0,4194304] 0 2024-09-13T21:44:54.458 INFO:tasks.workunit.client.1.smithi155.stdout:4/375: dwrite d1/d7/d21/d2d/d42/f4d [0,4194304] 0 2024-09-13T21:44:54.459 INFO:tasks.workunit.client.1.smithi155.stdout:2/353: stat d2/dd/de/d15/d38/d41/d5f/d70/l75 0 2024-09-13T21:44:54.462 INFO:tasks.workunit.client.0.smithi119.stdout:2/762: dwrite d1/d7/fdb [0,4194304] 0 2024-09-13T21:44:54.463 INFO:tasks.workunit.client.1.smithi155.stdout:9/509: creat dc/d19/d23/d38/fb1 x:0 0 0 2024-09-13T21:44:54.464 INFO:tasks.workunit.client.1.smithi155.stdout:2/354: rmdir d2/dd/de/d15/d38/d41/d5f/d70 39 2024-09-13T21:44:54.466 INFO:tasks.workunit.client.1.smithi155.stdout:5/400: fdatasync d5/d16/d33/d1b/d1e/f50 0 2024-09-13T21:44:54.468 INFO:tasks.workunit.client.1.smithi155.stdout:9/510: chown dc/d19/d23/f30 5 1 2024-09-13T21:44:54.469 INFO:tasks.workunit.client.1.smithi155.stdout:2/355: write d2/dd/d37/d4e/f59 [222413,111026] 0 2024-09-13T21:44:54.470 INFO:tasks.workunit.client.1.smithi155.stdout:4/376: rename d1/d7/d21/c28 to d1/d7/d21/c6f 0 2024-09-13T21:44:54.470 INFO:tasks.workunit.client.1.smithi155.stdout:4/377: readlink d1/ld 0 2024-09-13T21:44:54.471 INFO:tasks.workunit.client.1.smithi155.stdout:2/356: chown d2/dd/de 532078132 1 2024-09-13T21:44:54.473 INFO:tasks.workunit.client.0.smithi119.stdout:2/763: fdatasync d1/d7/f9 0 2024-09-13T21:44:54.474 INFO:tasks.workunit.client.1.smithi155.stdout:9/511: rename dc/d18/d1e/l72 to dc/d18/d1e/da2/lb2 0 2024-09-13T21:44:54.475 INFO:tasks.workunit.client.1.smithi155.stdout:2/357: mkdir d2/dd/de/d15/d2e/d66/d7c 0 2024-09-13T21:44:54.476 INFO:tasks.workunit.client.1.smithi155.stdout:5/401: getdents d5/d16/d33/d1b/d2f/d3c/d5b 0 2024-09-13T21:44:54.478 INFO:tasks.workunit.client.0.smithi119.stdout:2/764: fdatasync d1/f3d 0 2024-09-13T21:44:54.479 INFO:tasks.workunit.client.1.smithi155.stdout:9/512: unlink dc/l29 0 2024-09-13T21:44:54.480 INFO:tasks.workunit.client.1.smithi155.stdout:4/378: creat d1/d7/d21/f70 x:0 0 0 2024-09-13T21:44:54.481 INFO:tasks.workunit.client.0.smithi119.stdout:2/765: mkdir d1/d22/d55/d31/df0 0 2024-09-13T21:44:54.481 INFO:tasks.workunit.client.1.smithi155.stdout:1/427: dread d6/d15/d23/d87/f2a [0,4194304] 0 2024-09-13T21:44:54.481 INFO:tasks.workunit.client.0.smithi119.stdout:5/830: truncate d0/d3/d4/d9/d14/f68 130664 0 2024-09-13T21:44:54.482 INFO:tasks.workunit.client.1.smithi155.stdout:5/402: mkdir d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e 0 2024-09-13T21:44:54.483 INFO:tasks.workunit.client.0.smithi119.stdout:3/824: write d6/d15/f3f [4934490,104204] 0 2024-09-13T21:44:54.483 INFO:tasks.workunit.client.1.smithi155.stdout:1/428: chown d6/d15/d3e/f14 102 1 2024-09-13T21:44:54.485 INFO:tasks.workunit.client.1.smithi155.stdout:2/358: dwrite d2/fc [0,4194304] 0 2024-09-13T21:44:54.485 INFO:tasks.workunit.client.0.smithi119.stdout:2/766: mknod d1/d22/db6/cf1 0 2024-09-13T21:44:54.487 INFO:tasks.workunit.client.0.smithi119.stdout:4/849: dwrite d4/d1e/d28/d34/f4c [0,4194304] 0 2024-09-13T21:44:54.487 INFO:tasks.workunit.client.1.smithi155.stdout:5/403: write d5/d16/d33/d1f/f4f [4574711,32113] 0 2024-09-13T21:44:54.487 INFO:tasks.workunit.client.1.smithi155.stdout:2/359: chown d2/db/d6b/f6e 48 1 2024-09-13T21:44:54.488 INFO:tasks.workunit.client.1.smithi155.stdout:1/429: readlink d6/d15/d23/d87/l51 0 2024-09-13T21:44:54.489 INFO:tasks.workunit.client.0.smithi119.stdout:5/831: truncate d0/d3/d4/def/d10f/d67/fda 918063 0 2024-09-13T21:44:54.490 INFO:tasks.workunit.client.1.smithi155.stdout:2/360: chown d2/dd/d3d 24322 1 2024-09-13T21:44:54.491 INFO:tasks.workunit.client.1.smithi155.stdout:5/404: creat d5/d16/d33/d1b/d2f/d3c/f7f x:0 0 0 2024-09-13T21:44:54.492 INFO:tasks.workunit.client.1.smithi155.stdout:9/513: link dc/d19/d23/l4e dc/de/d2d/d79/d43/lb3 0 2024-09-13T21:44:54.492 INFO:tasks.workunit.client.0.smithi119.stdout:5/832: write d0/d3/f11 [5033729,66463] 0 2024-09-13T21:44:54.494 INFO:tasks.workunit.client.0.smithi119.stdout:2/767: read d1/d7/f20 [2626583,58466] 0 2024-09-13T21:44:54.495 INFO:tasks.workunit.client.1.smithi155.stdout:5/405: unlink d5/f10 0 2024-09-13T21:44:54.496 INFO:tasks.workunit.client.0.smithi119.stdout:8/839: dwrite d1b/d1d/d48/fbf [0,4194304] 0 2024-09-13T21:44:54.496 INFO:tasks.workunit.client.0.smithi119.stdout:3/825: symlink d6/d15/d1a/d45/d47/d4d/da7/dea/l110 0 2024-09-13T21:44:54.497 INFO:tasks.workunit.client.1.smithi155.stdout:9/514: creat dc/d19/d21/fb4 x:0 0 0 2024-09-13T21:44:54.498 INFO:tasks.workunit.client.1.smithi155.stdout:4/379: link d1/f24 d1/d7/de/d15/f71 0 2024-09-13T21:44:54.499 INFO:tasks.workunit.client.0.smithi119.stdout:3/826: chown d6/d25/d2f/d33/d88/d96 40 1 2024-09-13T21:44:54.500 INFO:tasks.workunit.client.1.smithi155.stdout:5/406: mkdir d5/d16/d33/d1b/d2f/d3c/d44/d80 0 2024-09-13T21:44:54.500 INFO:tasks.workunit.client.0.smithi119.stdout:2/768: read d1/d22/d5a/d5d/f61 [2239364,77983] 0 2024-09-13T21:44:54.502 INFO:tasks.workunit.client.1.smithi155.stdout:2/361: link d2/dd/d3d/f50 d2/dd/de/d15/d2e/f7d 0 2024-09-13T21:44:54.502 INFO:tasks.workunit.client.0.smithi119.stdout:8/840: write d1b/d1d/d26/fa8 [3351228,109827] 0 2024-09-13T21:44:54.503 INFO:tasks.workunit.client.1.smithi155.stdout:2/362: dread - d2/dd/d21/d39/f48 zero size 2024-09-13T21:44:54.503 INFO:tasks.workunit.client.1.smithi155.stdout:9/515: creat dc/d19/d23/d38/fb5 x:0 0 0 2024-09-13T21:44:54.504 INFO:tasks.workunit.client.1.smithi155.stdout:9/516: chown dc/d19 104640 1 2024-09-13T21:44:54.505 INFO:tasks.workunit.client.1.smithi155.stdout:5/407: mkdir d5/d16/d81 0 2024-09-13T21:44:54.507 INFO:tasks.workunit.client.0.smithi119.stdout:2/769: read - d1/d38/d89/d6b/d8c/fc1 zero size 2024-09-13T21:44:54.510 INFO:tasks.workunit.client.1.smithi155.stdout:4/380: rename d1/d7/de/dc/d2e to d1/d7/de/d72 0 2024-09-13T21:44:54.511 INFO:tasks.workunit.client.0.smithi119.stdout:8/841: rename d1b/d1d/fd4 to d1b/d1d/d26/d3e/daa/fff 0 2024-09-13T21:44:54.512 INFO:tasks.workunit.client.0.smithi119.stdout:2/770: stat d1/c4 0 2024-09-13T21:44:54.512 INFO:tasks.workunit.client.1.smithi155.stdout:2/363: dwrite d2/db/f25 [0,4194304] 0 2024-09-13T21:44:54.513 INFO:tasks.workunit.client.1.smithi155.stdout:4/381: chown d1/d7/de/d1a/c4e 1524333 1 2024-09-13T21:44:54.516 INFO:tasks.workunit.client.1.smithi155.stdout:9/517: dwrite dc/de/ff [8388608,4194304] 0 2024-09-13T21:44:54.517 INFO:tasks.workunit.client.0.smithi119.stdout:2/771: creat d1/ff2 x:0 0 0 2024-09-13T21:44:54.518 INFO:tasks.workunit.client.0.smithi119.stdout:8/842: getdents d1b/d4e/d6a 0 2024-09-13T21:44:54.519 INFO:tasks.workunit.client.0.smithi119.stdout:8/843: chown d1b/d1d/d26/f81 426 1 2024-09-13T21:44:54.521 INFO:tasks.workunit.client.1.smithi155.stdout:9/518: truncate dc/d19/d23/f2b 1943783 0 2024-09-13T21:44:54.522 INFO:tasks.workunit.client.1.smithi155.stdout:4/382: creat d1/d7/d21/d69/f73 x:0 0 0 2024-09-13T21:44:54.522 INFO:tasks.workunit.client.0.smithi119.stdout:8/844: creat d1b/d1d/d26/d6b/f100 x:0 0 0 2024-09-13T21:44:54.523 INFO:tasks.workunit.client.1.smithi155.stdout:9/519: creat dc/de/d6f/fb6 x:0 0 0 2024-09-13T21:44:54.524 INFO:tasks.workunit.client.1.smithi155.stdout:2/364: getdents d2/dd/de/d15/d38/d41/d5f/d70 0 2024-09-13T21:44:54.525 INFO:tasks.workunit.client.1.smithi155.stdout:9/520: dread - dc/d19/d23/d38/d90/f8d zero size 2024-09-13T21:44:54.526 INFO:tasks.workunit.client.1.smithi155.stdout:4/383: symlink d1/d7/d5a/l74 0 2024-09-13T21:44:54.527 INFO:tasks.workunit.client.1.smithi155.stdout:2/365: rmdir d2/dd/de 39 2024-09-13T21:44:54.527 INFO:tasks.workunit.client.0.smithi119.stdout:8/845: dread d1b/d1d/f8f [0,4194304] 0 2024-09-13T21:44:54.528 INFO:tasks.workunit.client.1.smithi155.stdout:9/521: creat dc/d18/fb7 x:0 0 0 2024-09-13T21:44:54.529 INFO:tasks.workunit.client.1.smithi155.stdout:2/366: rmdir d2/dd/d3d 39 2024-09-13T21:44:54.530 INFO:tasks.workunit.client.0.smithi119.stdout:8/846: readlink d1b/d1d/d26/d3e/d65/lb1 0 2024-09-13T21:44:54.531 INFO:tasks.workunit.client.1.smithi155.stdout:2/367: truncate d2/db/f1e 477081 0 2024-09-13T21:44:54.532 INFO:tasks.workunit.client.0.smithi119.stdout:8/847: rmdir d1b/d1d/d48/d54 39 2024-09-13T21:44:54.533 INFO:tasks.workunit.client.0.smithi119.stdout:8/848: truncate d1b/fce 169625 0 2024-09-13T21:44:54.534 INFO:tasks.workunit.client.1.smithi155.stdout:4/384: dwrite d1/f3b [0,4194304] 0 2024-09-13T21:44:54.534 INFO:tasks.workunit.client.0.smithi119.stdout:8/849: write d1b/d1d/d26/d6b/fd0 [508261,40404] 0 2024-09-13T21:44:54.535 INFO:tasks.workunit.client.1.smithi155.stdout:4/385: chown d1/d7/de/d15/d55/d5e 1377 1 2024-09-13T21:44:54.536 INFO:tasks.workunit.client.1.smithi155.stdout:2/368: creat d2/dd/de/d15/d38/d41/f7e x:0 0 0 2024-09-13T21:44:54.536 INFO:tasks.workunit.client.1.smithi155.stdout:4/386: dread - d1/d7/de/d1a/f68 zero size 2024-09-13T21:44:54.536 INFO:tasks.workunit.client.0.smithi119.stdout:8/850: creat d1b/d4e/d71/dac/f101 x:0 0 0 2024-09-13T21:44:54.537 INFO:tasks.workunit.client.1.smithi155.stdout:2/369: dread - d2/f69 zero size 2024-09-13T21:44:54.541 INFO:tasks.workunit.client.1.smithi155.stdout:2/370: dread d2/dd/f2c [0,4194304] 0 2024-09-13T21:44:54.542 INFO:tasks.workunit.client.1.smithi155.stdout:4/387: dwrite d1/f59 [0,4194304] 0 2024-09-13T21:44:54.545 INFO:tasks.workunit.client.0.smithi119.stdout:3/827: write d6/d25/d2f/d33/d88/fa3 [821337,44829] 0 2024-09-13T21:44:54.545 INFO:tasks.workunit.client.0.smithi119.stdout:5/833: truncate d0/d3/d4/d9/d1e/f91 783 0 2024-09-13T21:44:54.546 INFO:tasks.workunit.client.1.smithi155.stdout:2/371: creat d2/dd/d3d/f7f x:0 0 0 2024-09-13T21:44:54.546 INFO:tasks.workunit.client.0.smithi119.stdout:3/828: stat d6/f6c 0 2024-09-13T21:44:54.547 INFO:tasks.workunit.client.1.smithi155.stdout:4/388: mkdir d1/d7/de/dc/d4a/d75 0 2024-09-13T21:44:54.551 INFO:tasks.workunit.client.1.smithi155.stdout:4/389: unlink d1/d7/de/c64 0 2024-09-13T21:44:54.552 INFO:tasks.workunit.client.0.smithi119.stdout:3/829: mknod d6/d15/d1a/d45/c111 0 2024-09-13T21:44:54.553 INFO:tasks.workunit.client.0.smithi119.stdout:3/830: truncate d6/d25/d2f/f57 4416637 0 2024-09-13T21:44:54.554 INFO:tasks.workunit.client.1.smithi155.stdout:2/372: creat d2/dd/de/d15/d2e/d31/f80 x:0 0 0 2024-09-13T21:44:54.555 INFO:tasks.workunit.client.1.smithi155.stdout:2/373: stat d2/dd/de/d15/f2b 0 2024-09-13T21:44:54.555 INFO:tasks.workunit.client.1.smithi155.stdout:4/390: creat d1/d7/de/dc/d4a/f76 x:0 0 0 2024-09-13T21:44:54.557 INFO:tasks.workunit.client.0.smithi119.stdout:3/831: creat d6/d15/d1a/d45/d47/d4d/da7/dea/f112 x:0 0 0 2024-09-13T21:44:54.557 INFO:tasks.workunit.client.1.smithi155.stdout:2/374: truncate d2/dd/d21/f32 426949 0 2024-09-13T21:44:54.559 INFO:tasks.workunit.client.0.smithi119.stdout:8/851: dwrite d1b/d1d/d48/d54/fcf [0,4194304] 0 2024-09-13T21:44:54.561 INFO:tasks.workunit.client.0.smithi119.stdout:3/832: creat d6/d15/d103/f113 x:0 0 0 2024-09-13T21:44:54.563 INFO:tasks.workunit.client.0.smithi119.stdout:3/833: write d6/d44/d52/f86 [4722190,72480] 0 2024-09-13T21:44:54.564 INFO:tasks.workunit.client.0.smithi119.stdout:5/834: truncate d0/d3/d4/d9/d14/f10b 2570722 0 2024-09-13T21:44:54.565 INFO:tasks.workunit.client.0.smithi119.stdout:8/852: mkdir d1b/d1d/d102 0 2024-09-13T21:44:54.568 INFO:tasks.workunit.client.0.smithi119.stdout:3/834: creat d6/d15/d10f/f114 x:0 0 0 2024-09-13T21:44:54.568 INFO:tasks.workunit.client.1.smithi155.stdout:5/408: write d5/d16/d33/d1b/d2f/d3c/d44/d29/f7d [334609,65852] 0 2024-09-13T21:44:54.570 INFO:tasks.workunit.client.0.smithi119.stdout:5/835: getdents d0/d3/d4/d2e/d65/df6 0 2024-09-13T21:44:54.571 INFO:tasks.workunit.client.0.smithi119.stdout:3/835: fsync d6/d25/d2f/d33/d56/da0/fb0 0 2024-09-13T21:44:54.572 INFO:tasks.workunit.client.0.smithi119.stdout:3/836: chown d6/d15/d1a/d45/c111 17 1 2024-09-13T21:44:54.573 INFO:tasks.workunit.client.0.smithi119.stdout:5/836: write d0/d3/d4/d9/d1e/f9f [7666660,35139] 0 2024-09-13T21:44:54.575 INFO:tasks.workunit.client.0.smithi119.stdout:3/837: mknod d6/d15/da9/c115 0 2024-09-13T21:44:54.576 INFO:tasks.workunit.client.0.smithi119.stdout:3/838: chown d6/d15/f30 31866690 1 2024-09-13T21:44:54.576 INFO:tasks.workunit.client.1.smithi155.stdout:5/409: link d5/fe d5/d16/d33/d1b/d2f/d3c/f82 0 2024-09-13T21:44:54.577 INFO:tasks.workunit.client.1.smithi155.stdout:9/522: dwrite fb [0,4194304] 0 2024-09-13T21:44:54.580 INFO:tasks.workunit.client.0.smithi119.stdout:8/853: dread d1b/d1d/d48/f96 [0,4194304] 0 2024-09-13T21:44:54.582 INFO:tasks.workunit.client.1.smithi155.stdout:9/523: rename dc/faa to dc/de/d6f/d71/fb8 0 2024-09-13T21:44:54.582 INFO:tasks.workunit.client.1.smithi155.stdout:5/410: mknod d5/d16/d33/d1b/d2f/d3c/d5b/d5f/c83 0 2024-09-13T21:44:54.583 INFO:tasks.workunit.client.1.smithi155.stdout:2/375: read d2/dd/d21/f32 [242040,14288] 0 2024-09-13T21:44:54.584 INFO:tasks.workunit.client.0.smithi119.stdout:3/839: dwrite d6/d25/d2f/d33/d56/f93 [0,4194304] 0 2024-09-13T21:44:54.585 INFO:tasks.workunit.client.1.smithi155.stdout:4/391: write d1/d7/de/d15/f4b [783666,44957] 0 2024-09-13T21:44:54.586 INFO:tasks.workunit.client.1.smithi155.stdout:2/376: write d2/f53 [170108,128687] 0 2024-09-13T21:44:54.586 INFO:tasks.workunit.client.0.smithi119.stdout:3/840: stat d6/d15/d1a/d45/c101 0 2024-09-13T21:44:54.589 INFO:tasks.workunit.client.1.smithi155.stdout:4/392: fsync d1/d7/f58 0 2024-09-13T21:44:54.589 INFO:tasks.workunit.client.1.smithi155.stdout:5/411: dread d5/d16/d33/f6f [4194304,4194304] 0 2024-09-13T21:44:54.591 INFO:tasks.workunit.client.0.smithi119.stdout:8/854: dwrite d1b/d1d/d26/f89 [0,4194304] 0 2024-09-13T21:44:54.597 INFO:tasks.workunit.client.1.smithi155.stdout:2/377: dwrite d2/db/d6b/f6e [0,4194304] 0 2024-09-13T21:44:54.597 INFO:tasks.workunit.client.0.smithi119.stdout:8/855: creat d1b/d1d/d48/d58/d7f/f103 x:0 0 0 2024-09-13T21:44:54.597 INFO:tasks.workunit.client.0.smithi119.stdout:3/841: dread d6/d15/d103/fde [0,4194304] 0 2024-09-13T21:44:54.599 INFO:tasks.workunit.client.0.smithi119.stdout:8/856: symlink d1b/d1d/d26/df0/de7/l104 0 2024-09-13T21:44:54.605 INFO:tasks.workunit.client.0.smithi119.stdout:8/857: truncate d1b/d1d/d26/d3e/d65/ffe 820053 0 2024-09-13T21:44:54.605 INFO:tasks.workunit.client.0.smithi119.stdout:3/842: dwrite d6/d25/d2f/d33/d56/fe0 [0,4194304] 0 2024-09-13T21:44:54.608 INFO:tasks.workunit.client.0.smithi119.stdout:3/843: fsync d6/d15/f63 0 2024-09-13T21:44:54.610 INFO:tasks.workunit.client.0.smithi119.stdout:3/844: symlink d6/d15/d103/l116 0 2024-09-13T21:44:54.611 INFO:tasks.workunit.client.0.smithi119.stdout:8/858: link d1b/d1d/d26/d3e/l41 d1b/d1d/dc3/l105 0 2024-09-13T21:44:54.612 INFO:tasks.workunit.client.0.smithi119.stdout:3/845: write d6/d15/d1a/f79 [1574830,11866] 0 2024-09-13T21:44:54.620 INFO:tasks.workunit.client.0.smithi119.stdout:8/859: dwrite d1b/d1d/d26/f89 [4194304,4194304] 0 2024-09-13T21:44:54.621 INFO:tasks.workunit.client.0.smithi119.stdout:8/860: chown d1b/d4e/f53 658 1 2024-09-13T21:44:54.621 INFO:tasks.workunit.client.0.smithi119.stdout:7/888: sync 2024-09-13T21:44:54.621 INFO:tasks.workunit.client.0.smithi119.stdout:6/743: sync 2024-09-13T21:44:54.622 INFO:tasks.workunit.client.0.smithi119.stdout:8/861: chown d1b/d1d/d26/d6b/fc8 3 1 2024-09-13T21:44:54.625 INFO:tasks.workunit.client.0.smithi119.stdout:7/889: truncate d8/d3c/d46/f5a 5316618 0 2024-09-13T21:44:54.627 INFO:tasks.workunit.client.0.smithi119.stdout:5/837: dread d0/d3/d4/d9/d1e/f9f [4194304,4194304] 0 2024-09-13T21:44:54.627 INFO:tasks.workunit.client.0.smithi119.stdout:6/744: read dc/df/f27 [123551,94874] 0 2024-09-13T21:44:54.629 INFO:tasks.workunit.client.0.smithi119.stdout:5/838: dread - d0/d3/d4/f101 zero size 2024-09-13T21:44:54.629 INFO:tasks.workunit.client.0.smithi119.stdout:6/745: chown dc/df/f44 14193 1 2024-09-13T21:44:54.631 INFO:tasks.workunit.client.0.smithi119.stdout:7/890: creat d8/d3c/d53/d37/d83/d89/dc3/d120/f129 x:0 0 0 2024-09-13T21:44:54.634 INFO:tasks.workunit.client.0.smithi119.stdout:8/862: link d1b/d1d/d26/df0/ca6 d1b/d1d/d48/d54/de0/c106 0 2024-09-13T21:44:54.636 INFO:tasks.workunit.client.0.smithi119.stdout:7/891: creat d8/d3c/d53/d37/d57/d8f/f12a x:0 0 0 2024-09-13T21:44:54.637 INFO:tasks.workunit.client.0.smithi119.stdout:6/746: creat dc/d4b/d6a/dbd/fe6 x:0 0 0 2024-09-13T21:44:54.638 INFO:tasks.workunit.client.1.smithi155.stdout:0/411: sync 2024-09-13T21:44:54.639 INFO:tasks.workunit.client.1.smithi155.stdout:3/481: sync 2024-09-13T21:44:54.639 INFO:tasks.workunit.client.0.smithi119.stdout:6/747: chown dc/d4b 461 1 2024-09-13T21:44:54.642 INFO:tasks.workunit.client.0.smithi119.stdout:8/863: dread d1b/d1d/d26/d3e/f60 [0,4194304] 0 2024-09-13T21:44:54.643 INFO:tasks.workunit.client.0.smithi119.stdout:3/846: dwrite d6/d15/d1a/f55 [0,4194304] 0 2024-09-13T21:44:54.644 INFO:tasks.workunit.client.0.smithi119.stdout:7/892: symlink d8/d3c/d53/d37/d57/d8f/d101/l12b 0 2024-09-13T21:44:54.653 INFO:tasks.workunit.client.0.smithi119.stdout:8/864: rename d1b/d1d/d26/da4/cbd to d1b/d1d/d26/da4/c107 0 2024-09-13T21:44:54.655 INFO:tasks.workunit.client.0.smithi119.stdout:5/839: dwrite d0/d3/d4/def/f5f [0,4194304] 0 2024-09-13T21:44:54.656 INFO:tasks.workunit.client.0.smithi119.stdout:6/748: dwrite dc/d4b/d6a/dc2/fd8 [4194304,4194304] 0 2024-09-13T21:44:54.658 INFO:tasks.workunit.client.0.smithi119.stdout:3/847: rename d6/d25/d2f/d33/d56/f7a to d6/d25/d2f/d33/d88/db9/f117 0 2024-09-13T21:44:54.662 INFO:tasks.workunit.client.0.smithi119.stdout:3/848: rmdir d6/d25/d2f/d33/d56/dab 39 2024-09-13T21:44:54.663 INFO:tasks.workunit.client.0.smithi119.stdout:3/849: read - d6/f100 zero size 2024-09-13T21:44:54.666 INFO:tasks.workunit.client.0.smithi119.stdout:8/865: link d1b/d1d/dc3/fdb d1b/d1d/d39/f108 0 2024-09-13T21:44:54.667 INFO:tasks.workunit.client.0.smithi119.stdout:3/850: dread - d6/d15/d10f/f114 zero size 2024-09-13T21:44:54.668 INFO:tasks.workunit.client.1.smithi155.stdout:5/412: mkdir d5/d12/d84 0 2024-09-13T21:44:54.669 INFO:tasks.workunit.client.1.smithi155.stdout:4/393: mknod d1/d7/d21/d2d/c77 0 2024-09-13T21:44:54.669 INFO:tasks.workunit.client.0.smithi119.stdout:3/851: chown d6/d15/d1a/d45/d47/d4d/da7 8412806 1 2024-09-13T21:44:54.670 INFO:tasks.workunit.client.0.smithi119.stdout:5/840: dwrite d0/d3/d4/d2e/d65/f81 [0,4194304] 0 2024-09-13T21:44:54.671 INFO:tasks.workunit.client.1.smithi155.stdout:2/378: rename d2/dd/de/d15/d38/d41/l4d to d2/dd/d37/l81 0 2024-09-13T21:44:54.671 INFO:tasks.workunit.client.1.smithi155.stdout:0/412: mkdir d1/d6/dc/d4d/d4a/d9e 0 2024-09-13T21:44:54.672 INFO:tasks.workunit.client.1.smithi155.stdout:4/394: mkdir d1/d7/d78 0 2024-09-13T21:44:54.673 INFO:tasks.workunit.client.1.smithi155.stdout:2/379: symlink d2/dd/d21/l82 0 2024-09-13T21:44:54.675 INFO:tasks.workunit.client.1.smithi155.stdout:2/380: write d2/db/f4b [4207171,100646] 0 2024-09-13T21:44:54.677 INFO:tasks.workunit.client.1.smithi155.stdout:0/413: creat d1/d6/dc/d90/f9f x:0 0 0 2024-09-13T21:44:54.677 INFO:tasks.workunit.client.0.smithi119.stdout:8/866: dwrite d1b/d1d/d26/d3e/d65/ffe [0,4194304] 0 2024-09-13T21:44:54.678 INFO:tasks.workunit.client.1.smithi155.stdout:0/414: readlink d1/d6/dc/l42 0 2024-09-13T21:44:54.680 INFO:tasks.workunit.client.1.smithi155.stdout:2/381: rename d2/dd/de/f13 to d2/dd/de/d15/d2e/f83 0 2024-09-13T21:44:54.681 INFO:tasks.workunit.client.0.smithi119.stdout:7/893: dread d8/d3c/d53/d37/d83/d89/d47/faf [0,4194304] 0 2024-09-13T21:44:54.682 INFO:tasks.workunit.client.1.smithi155.stdout:2/382: mkdir d2/dd/d21/d39/d84 0 2024-09-13T21:44:54.684 INFO:tasks.workunit.client.0.smithi119.stdout:7/894: symlink d8/d3c/d53/d37/dd6/l12c 0 2024-09-13T21:44:54.686 INFO:tasks.workunit.client.0.smithi119.stdout:7/895: dread - d8/d3c/d53/d37/d83/d89/dc3/d120/f129 zero size 2024-09-13T21:44:54.688 INFO:tasks.workunit.client.1.smithi155.stdout:2/383: symlink d2/dd/de/d15/d2e/d66/d7c/l85 0 2024-09-13T21:44:54.689 INFO:tasks.workunit.client.1.smithi155.stdout:2/384: chown d2/dd/d21/l44 8394245 1 2024-09-13T21:44:54.689 INFO:tasks.workunit.client.0.smithi119.stdout:7/896: rename d8/d3c/d53/d37/d95/l11a to d8/d113/d124/l12d 0 2024-09-13T21:44:54.689 INFO:tasks.workunit.client.1.smithi155.stdout:3/482: truncate d3/d10/f46 1645658 0 2024-09-13T21:44:54.690 INFO:tasks.workunit.client.0.smithi119.stdout:7/897: write d8/d19/d2e/fdd [6189400,105874] 0 2024-09-13T21:44:54.691 INFO:tasks.workunit.client.1.smithi155.stdout:3/483: fdatasync d3/d25/d1b/d1f/d36/d5c/d66/f7f 0 2024-09-13T21:44:54.691 INFO:tasks.workunit.client.1.smithi155.stdout:2/385: creat d2/dd/d21/f86 x:0 0 0 2024-09-13T21:44:54.692 INFO:tasks.workunit.client.0.smithi119.stdout:7/898: symlink d8/d4d/da2/l12e 0 2024-09-13T21:44:54.694 INFO:tasks.workunit.client.1.smithi155.stdout:3/484: rename d3/d25/d17/f89 to d3/d25/d17/fab 0 2024-09-13T21:44:54.696 INFO:tasks.workunit.client.1.smithi155.stdout:3/485: dread - d3/d21/fa3 zero size 2024-09-13T21:44:54.696 INFO:tasks.workunit.client.1.smithi155.stdout:4/395: write d1/d7/de/d72/f50 [3728007,59672] 0 2024-09-13T21:44:54.698 INFO:tasks.workunit.client.1.smithi155.stdout:0/415: write d1/d6/dc/f7a [1118862,56407] 0 2024-09-13T21:44:54.699 INFO:tasks.workunit.client.0.smithi119.stdout:7/899: dwrite d8/d3c/d53/d37/d57/fd8 [0,4194304] 0 2024-09-13T21:44:54.699 INFO:tasks.workunit.client.1.smithi155.stdout:2/386: dwrite d2/f22 [0,4194304] 0 2024-09-13T21:44:54.700 INFO:tasks.workunit.client.1.smithi155.stdout:4/396: mknod d1/d7/de/dc/c79 0 2024-09-13T21:44:54.701 INFO:tasks.workunit.client.1.smithi155.stdout:0/416: dread - d1/d6/dc/d4d/d4a/d52/d5c/f9a zero size 2024-09-13T21:44:54.702 INFO:tasks.workunit.client.1.smithi155.stdout:3/486: rmdir d3/d25/d1b/d1f/d82/d83 39 2024-09-13T21:44:54.702 INFO:tasks.workunit.client.1.smithi155.stdout:2/387: write d2/dd/f2c [43788,40943] 0 2024-09-13T21:44:54.703 INFO:tasks.workunit.client.0.smithi119.stdout:7/900: rename d8/d19/f121 to d8/d4d/f12f 0 2024-09-13T21:44:54.704 INFO:tasks.workunit.client.1.smithi155.stdout:3/487: write d3/d21/fa4 [748046,77331] 0 2024-09-13T21:44:54.704 INFO:tasks.workunit.client.1.smithi155.stdout:4/397: symlink d1/d7/l7a 0 2024-09-13T21:44:54.704 INFO:tasks.workunit.client.0.smithi119.stdout:5/841: dread d0/d3/d4/d9/d14/f29 [0,4194304] 0 2024-09-13T21:44:54.705 INFO:tasks.workunit.client.1.smithi155.stdout:2/388: chown d2/dd/d21/d39 44513 1 2024-09-13T21:44:54.705 INFO:tasks.workunit.client.0.smithi119.stdout:7/901: fdatasync d8/d3c/f51 0 2024-09-13T21:44:54.708 INFO:tasks.workunit.client.1.smithi155.stdout:0/417: symlink d1/d6/d74/d82/la0 0 2024-09-13T21:44:54.709 INFO:tasks.workunit.client.0.smithi119.stdout:7/902: write d8/d3c/d53/d37/d57/f6c [1000390,23166] 0 2024-09-13T21:44:54.711 INFO:tasks.workunit.client.0.smithi119.stdout:5/842: read d0/d3/fc [83165,90247] 0 2024-09-13T21:44:54.713 INFO:tasks.workunit.client.1.smithi155.stdout:2/389: rename d2/f22 to d2/dd/d37/d4e/f87 0 2024-09-13T21:44:54.713 INFO:tasks.workunit.client.1.smithi155.stdout:2/390: chown d2/dd/d21/f86 1430298 1 2024-09-13T21:44:54.716 INFO:tasks.workunit.client.1.smithi155.stdout:0/418: creat d1/d6/dc/d4d/d4a/d52/d5b/fa1 x:0 0 0 2024-09-13T21:44:54.716 INFO:tasks.workunit.client.0.smithi119.stdout:5/843: creat d0/d3/d4/d2e/d65/d110/f116 x:0 0 0 2024-09-13T21:44:54.716 INFO:tasks.workunit.client.0.smithi119.stdout:7/903: getdents d8/d9d 0 2024-09-13T21:44:54.717 INFO:tasks.workunit.client.1.smithi155.stdout:0/419: chown d1/d6/f5a 5 1 2024-09-13T21:44:54.717 INFO:tasks.workunit.client.0.smithi119.stdout:7/904: readlink d8/d3c/d53/d37/d57/d5f/l6a 0 2024-09-13T21:44:54.718 INFO:tasks.workunit.client.1.smithi155.stdout:3/488: creat d3/d25/d17/d52/fac x:0 0 0 2024-09-13T21:44:54.719 INFO:tasks.workunit.client.1.smithi155.stdout:0/420: chown d1/d6/d81/c8b 64588972 1 2024-09-13T21:44:54.719 INFO:tasks.workunit.client.1.smithi155.stdout:3/489: write d3/d25/d17/f76 [136642,58291] 0 2024-09-13T21:44:54.720 INFO:tasks.workunit.client.1.smithi155.stdout:2/391: link d2/dd/d21/f86 d2/dd/de/d15/d2e/f88 0 2024-09-13T21:44:54.720 INFO:tasks.workunit.client.0.smithi119.stdout:7/905: mknod d8/d3c/d53/d37/c130 0 2024-09-13T21:44:54.721 INFO:tasks.workunit.client.1.smithi155.stdout:2/392: chown d2/dd/f72 78383 1 2024-09-13T21:44:54.721 INFO:tasks.workunit.client.1.smithi155.stdout:3/490: readlink d3/d10/l6b 0 2024-09-13T21:44:54.725 INFO:tasks.workunit.client.0.smithi119.stdout:7/906: dwrite d8/d19/f1a [0,4194304] 0 2024-09-13T21:44:54.726 INFO:tasks.workunit.client.1.smithi155.stdout:3/491: dread d3/d25/d1b/d1f/f64 [0,4194304] 0 2024-09-13T21:44:54.726 INFO:tasks.workunit.client.0.smithi119.stdout:7/907: chown d8/f7d 1059610934 1 2024-09-13T21:44:54.730 INFO:tasks.workunit.client.1.smithi155.stdout:3/492: rename d3/d25/d17/d3b/ca9 to d3/d25/d1b/d1f/d36/cad 0 2024-09-13T21:44:54.734 INFO:tasks.workunit.client.1.smithi155.stdout:3/493: symlink d3/d25/d17/d52/lae 0 2024-09-13T21:44:54.736 INFO:tasks.workunit.client.0.smithi119.stdout:5/844: dwrite d0/d3/fc [0,4194304] 0 2024-09-13T21:44:54.739 INFO:tasks.workunit.client.1.smithi155.stdout:3/494: dread - d3/d25/d1b/d1f/d82/d83/f9b zero size 2024-09-13T21:44:54.740 INFO:tasks.workunit.client.0.smithi119.stdout:7/908: dread d8/d3c/d46/fdb [0,4194304] 0 2024-09-13T21:44:54.740 INFO:tasks.workunit.client.0.smithi119.stdout:5/845: write d0/d3/d1f/f52 [1774183,92820] 0 2024-09-13T21:44:54.744 INFO:tasks.workunit.client.0.smithi119.stdout:7/909: rename d8/d9d to d8/d3c/d53/d37/d83/d89/dc3/d120/d131 0 2024-09-13T21:44:54.744 INFO:tasks.workunit.client.0.smithi119.stdout:7/910: readlink d8/l115 0 2024-09-13T21:44:54.744 INFO:tasks.workunit.client.1.smithi155.stdout:4/398: dwrite d1/d7/d21/d2d/f6d [0,4194304] 0 2024-09-13T21:44:54.746 INFO:tasks.workunit.client.0.smithi119.stdout:5/846: read d0/d3/d4/def/fbe [498142,29703] 0 2024-09-13T21:44:54.747 INFO:tasks.workunit.client.0.smithi119.stdout:7/911: stat d8/d3c/d53/d3b/d7e/fda 0 2024-09-13T21:44:54.747 INFO:tasks.workunit.client.1.smithi155.stdout:3/495: dread d3/d10/f8d [0,4194304] 0 2024-09-13T21:44:54.747 INFO:tasks.workunit.client.1.smithi155.stdout:2/393: dread d2/dd/f24 [0,4194304] 0 2024-09-13T21:44:54.749 INFO:tasks.workunit.client.1.smithi155.stdout:4/399: fsync d1/d7/d21/f3a 0 2024-09-13T21:44:54.750 INFO:tasks.workunit.client.0.smithi119.stdout:5/847: rmdir d0/d3/d4/def/dd6/de4 0 2024-09-13T21:44:54.751 INFO:tasks.workunit.client.1.smithi155.stdout:0/421: dread d1/d6/dc/d4d/d4a/f4b [0,4194304] 0 2024-09-13T21:44:54.751 INFO:tasks.workunit.client.1.smithi155.stdout:0/422: rename d1/d6 to d1/d6/dc/d90/da2 22 2024-09-13T21:44:54.752 INFO:tasks.workunit.client.0.smithi119.stdout:7/912: creat d8/d3c/d53/d37/d95/f132 x:0 0 0 2024-09-13T21:44:54.752 INFO:tasks.workunit.client.1.smithi155.stdout:2/394: mknod d2/dd/de/d15/d2e/d66/c89 0 2024-09-13T21:44:54.753 INFO:tasks.workunit.client.1.smithi155.stdout:2/395: write d2/dd/de/d15/d2e/f3c [233782,82455] 0 2024-09-13T21:44:54.753 INFO:tasks.workunit.client.0.smithi119.stdout:7/913: symlink d8/d3c/d46/l133 0 2024-09-13T21:44:54.755 INFO:tasks.workunit.client.1.smithi155.stdout:2/396: mknod d2/dd/de/d15/d2e/d66/d7c/c8a 0 2024-09-13T21:44:54.756 INFO:tasks.workunit.client.0.smithi119.stdout:5/848: rename d0/d3/d4/d2e/cbf to d0/d3/d4/d9/d14/d24/c117 0 2024-09-13T21:44:54.756 INFO:tasks.workunit.client.1.smithi155.stdout:2/397: chown d2/dd/de/d15/d2e/f88 90 1 2024-09-13T21:44:54.757 INFO:tasks.workunit.client.0.smithi119.stdout:7/914: rmdir d8/d3c/d53/d37/d83/d89/de7 39 2024-09-13T21:44:54.758 INFO:tasks.workunit.client.1.smithi155.stdout:2/398: mknod d2/db/c8b 0 2024-09-13T21:44:54.758 INFO:tasks.workunit.client.1.smithi155.stdout:2/399: stat d2/dd/de/d15/d2e/f36 0 2024-09-13T21:44:54.760 INFO:tasks.workunit.client.0.smithi119.stdout:7/915: rename d8/d3c/d53/d3b/ldf to d8/d113/l134 0 2024-09-13T21:44:54.762 INFO:tasks.workunit.client.0.smithi119.stdout:7/916: symlink d8/d4d/da2/l135 0 2024-09-13T21:44:54.770 INFO:tasks.workunit.client.1.smithi155.stdout:0/423: write d1/f6e [163536,104913] 0 2024-09-13T21:44:54.772 INFO:tasks.workunit.client.1.smithi155.stdout:0/424: mknod d1/ca3 0 2024-09-13T21:44:54.772 INFO:tasks.workunit.client.1.smithi155.stdout:0/425: stat d1/d6/dc/d4d/d4a/d52/d5b/c5e 0 2024-09-13T21:44:54.773 INFO:tasks.workunit.client.1.smithi155.stdout:0/426: chown d1/d6/d97/f9b 25009632 1 2024-09-13T21:44:54.773 INFO:tasks.workunit.client.0.smithi119.stdout:5/849: rename d0/d3/d4/d9/d1e/da5/ce2 to d0/d3/d4/d2e/d6b/c118 0 2024-09-13T21:44:54.775 INFO:tasks.workunit.client.0.smithi119.stdout:5/850: read d0/d3/d4/d9/d14/f29 [4766303,17501] 0 2024-09-13T21:44:54.776 INFO:tasks.workunit.client.0.smithi119.stdout:5/851: chown d0/d3/d4/fdd 174 1 2024-09-13T21:44:54.778 INFO:tasks.workunit.client.0.smithi119.stdout:7/917: dwrite f6 [8388608,4194304] 0 2024-09-13T21:44:54.778 INFO:tasks.workunit.client.1.smithi155.stdout:0/427: dwrite d1/d6/dc/d90/f92 [0,4194304] 0 2024-09-13T21:44:54.781 INFO:tasks.workunit.client.0.smithi119.stdout:7/918: creat d8/d3c/d53/d37/d95/f136 x:0 0 0 2024-09-13T21:44:54.781 INFO:tasks.workunit.client.1.smithi155.stdout:0/428: creat d1/d6/dc/d4d/d4a/d52/d5b/fa4 x:0 0 0 2024-09-13T21:44:54.785 INFO:tasks.workunit.client.1.smithi155.stdout:0/429: mkdir d1/d6/dc/d4d/d4a/d52/da5 0 2024-09-13T21:44:54.791 INFO:tasks.workunit.client.1.smithi155.stdout:0/430: link d1/d6/d74/f99 d1/d6/dc/d4d/d4a/fa6 0 2024-09-13T21:44:54.796 INFO:tasks.workunit.client.1.smithi155.stdout:0/431: read d1/d6/d74/f99 [801148,87486] 0 2024-09-13T21:44:54.798 INFO:tasks.workunit.client.1.smithi155.stdout:0/432: creat d1/d6/d97/fa7 x:0 0 0 2024-09-13T21:44:54.798 INFO:tasks.workunit.client.1.smithi155.stdout:0/433: readlink d1/d6/l41 0 2024-09-13T21:44:54.803 INFO:tasks.workunit.client.1.smithi155.stdout:0/434: creat d1/d6/dc/d4d/d4a/d52/fa8 x:0 0 0 2024-09-13T21:44:54.803 INFO:tasks.workunit.client.0.smithi119.stdout:5/852: dread d0/d3/d1f/d21/d4f/df8/f109 [0,4194304] 0 2024-09-13T21:44:54.804 INFO:tasks.workunit.client.1.smithi155.stdout:0/435: read d1/d6/f2d [262151,18045] 0 2024-09-13T21:44:54.805 INFO:tasks.workunit.client.0.smithi119.stdout:5/853: rename d0/d3/d1f/d21/d4f/de6 to d0/d3/d4/def/dd6/d119 0 2024-09-13T21:44:54.812 INFO:tasks.workunit.client.0.smithi119.stdout:5/854: dwrite d0/d3/d4/d9/d1e/da5/fc8 [0,4194304] 0 2024-09-13T21:44:54.814 INFO:tasks.workunit.client.1.smithi155.stdout:0/436: dread d1/d6/f13 [0,4194304] 0 2024-09-13T21:44:54.815 INFO:tasks.workunit.client.0.smithi119.stdout:7/919: dread f6 [0,4194304] 0 2024-09-13T21:44:54.816 INFO:tasks.workunit.client.1.smithi155.stdout:0/437: write d1/f5 [1130394,23847] 0 2024-09-13T21:44:54.819 INFO:tasks.workunit.client.0.smithi119.stdout:7/920: mknod d8/d4d/c137 0 2024-09-13T21:44:54.819 INFO:tasks.workunit.client.1.smithi155.stdout:0/438: unlink d1/d6/dc/d4d/d4a/d4e/f4f 0 2024-09-13T21:44:54.820 INFO:tasks.workunit.client.0.smithi119.stdout:5/855: dwrite d0/d3/d4/d9/d14/f68 [0,4194304] 0 2024-09-13T21:44:54.821 INFO:tasks.workunit.client.0.smithi119.stdout:7/921: mkdir d8/d3c/d53/d37/d83/d138 0 2024-09-13T21:44:54.822 INFO:tasks.workunit.client.1.smithi155.stdout:0/439: getdents d1/d6/dc/d8c 0 2024-09-13T21:44:54.823 INFO:tasks.workunit.client.0.smithi119.stdout:7/922: readlink d8/d3c/d53/d37/d83/d89/l16 0 2024-09-13T21:44:54.824 INFO:tasks.workunit.client.0.smithi119.stdout:7/923: write d8/d3c/d53/ff4 [223485,57809] 0 2024-09-13T21:44:54.825 INFO:tasks.workunit.client.0.smithi119.stdout:7/924: chown d8/d19/d2e/d34/f3a 3 1 2024-09-13T21:44:54.826 INFO:tasks.workunit.client.1.smithi155.stdout:0/440: creat d1/d6/dc/d4d/d4a/d52/d5c/d6a/fa9 x:0 0 0 2024-09-13T21:44:54.828 INFO:tasks.workunit.client.0.smithi119.stdout:5/856: dwrite d0/d3/d4/d9/d1e/f9f [0,4194304] 0 2024-09-13T21:44:54.830 INFO:tasks.workunit.client.0.smithi119.stdout:5/857: readlink d0/d3/d4/def/d10f/l70 0 2024-09-13T21:44:54.832 INFO:tasks.workunit.client.0.smithi119.stdout:7/925: rename c1 to d8/d3c/d53/d37/d83/d89/dc3/d10a/c139 0 2024-09-13T21:44:54.834 INFO:tasks.workunit.client.0.smithi119.stdout:5/858: rename d0/d3/d4/d9/d1e/f5c to d0/d3/d4/d9/d14/d24/db6/de5/f11a 0 2024-09-13T21:44:54.837 INFO:tasks.workunit.client.0.smithi119.stdout:7/926: dread d8/d3c/d53/d3b/d7e/fd0 [0,4194304] 0 2024-09-13T21:44:54.838 INFO:tasks.workunit.client.0.smithi119.stdout:7/927: fdatasync d8/d3c/d53/d3b/d48/f49 0 2024-09-13T21:44:54.838 INFO:tasks.workunit.client.0.smithi119.stdout:5/859: getdents d0/d3/d1f/d21/da1/dfb/de1 0 2024-09-13T21:44:54.839 INFO:tasks.workunit.client.0.smithi119.stdout:7/928: chown d8/d3c/d53/ff4 2700897 1 2024-09-13T21:44:54.840 INFO:tasks.workunit.client.0.smithi119.stdout:7/929: write d8/d3c/d46/ffa [422711,47205] 0 2024-09-13T21:44:54.841 INFO:tasks.workunit.client.1.smithi155.stdout:0/441: dwrite d1/f1f [0,4194304] 0 2024-09-13T21:44:54.841 INFO:tasks.workunit.client.0.smithi119.stdout:5/860: mkdir d0/d3/d4/def/d11b 0 2024-09-13T21:44:54.843 INFO:tasks.workunit.client.0.smithi119.stdout:7/930: dread - d8/d3c/d53/d37/d83/d89/dc3/d10e/f11b zero size 2024-09-13T21:44:54.844 INFO:tasks.workunit.client.1.smithi155.stdout:0/442: creat d1/d6/dc/faa x:0 0 0 2024-09-13T21:44:54.845 INFO:tasks.workunit.client.0.smithi119.stdout:5/861: truncate d0/d3/d4/d9/d14/ff3 1518022 0 2024-09-13T21:44:54.845 INFO:tasks.workunit.client.1.smithi155.stdout:0/443: mknod d1/cab 0 2024-09-13T21:44:54.848 INFO:tasks.workunit.client.0.smithi119.stdout:5/862: dread d0/d3/d4/def/dd6/fe9 [0,4194304] 0 2024-09-13T21:44:54.848 INFO:tasks.workunit.client.1.smithi155.stdout:0/444: dread d1/d6/dc/d8c/f93 [0,4194304] 0 2024-09-13T21:44:54.851 INFO:tasks.workunit.client.1.smithi155.stdout:0/445: rename d1/d6/l4c to d1/d6/d97/lac 0 2024-09-13T21:44:54.851 INFO:tasks.workunit.client.1.smithi155.stdout:0/446: stat d1/c88 0 2024-09-13T21:44:54.852 INFO:tasks.workunit.client.0.smithi119.stdout:5/863: creat d0/d3/d4/def/dd6/d119/f11c x:0 0 0 2024-09-13T21:44:54.852 INFO:tasks.workunit.client.1.smithi155.stdout:0/447: dread - d1/d6/dc/d4d/d4a/d52/d5c/f9a zero size 2024-09-13T21:44:54.854 INFO:tasks.workunit.client.0.smithi119.stdout:5/864: rename d0/d3/d4/def/d10f/d67/fda to d0/d3/d4/def/d11b/f11d 0 2024-09-13T21:44:54.858 INFO:tasks.workunit.client.1.smithi155.stdout:0/448: write d1/d6/f13 [2403300,85625] 0 2024-09-13T21:44:54.860 INFO:tasks.workunit.client.0.smithi119.stdout:5/865: dwrite d0/d3/d1f/f5d [0,4194304] 0 2024-09-13T21:44:54.866 INFO:tasks.workunit.client.1.smithi155.stdout:0/449: dwrite d1/d6/dc/fe [0,4194304] 0 2024-09-13T21:44:54.866 INFO:tasks.workunit.client.0.smithi119.stdout:5/866: dwrite d0/d3/d1f/d21/d4f/df8/f109 [0,4194304] 0 2024-09-13T21:44:54.867 INFO:tasks.workunit.client.0.smithi119.stdout:1/780: sync 2024-09-13T21:44:54.869 INFO:tasks.workunit.client.0.smithi119.stdout:1/781: chown d1/d3/d61/d77/d78/d32/dda/d28 741 1 2024-09-13T21:44:54.869 INFO:tasks.workunit.client.1.smithi155.stdout:0/450: truncate d1/d6/dc/d4d/d4a/d52/f56 4549643 0 2024-09-13T21:44:54.869 INFO:tasks.workunit.client.0.smithi119.stdout:5/867: creat d0/f11e x:0 0 0 2024-09-13T21:44:54.870 INFO:tasks.workunit.client.1.smithi155.stdout:0/451: fdatasync d1/d6/dc/d4d/d4a/d4e/f75 0 2024-09-13T21:44:54.871 INFO:tasks.workunit.client.1.smithi155.stdout:0/452: chown d1/f1d 947 1 2024-09-13T21:44:54.871 INFO:tasks.workunit.client.0.smithi119.stdout:5/868: read - d0/d3/d4/d9/d14/d24/ff7 zero size 2024-09-13T21:44:54.872 INFO:tasks.workunit.client.0.smithi119.stdout:1/782: creat d1/f103 x:0 0 0 2024-09-13T21:44:54.874 INFO:tasks.workunit.client.1.smithi155.stdout:0/453: mkdir d1/d6/d74/d82/dad 0 2024-09-13T21:44:54.877 INFO:tasks.workunit.client.1.smithi155.stdout:0/454: rename d1/l30 to d1/d6/d97/lae 0 2024-09-13T21:44:54.878 INFO:tasks.workunit.client.1.smithi155.stdout:0/455: write d1/d6/dc/d90/f9f [175800,100071] 0 2024-09-13T21:44:54.879 INFO:tasks.workunit.client.1.smithi155.stdout:0/456: chown d1/d6/dc/d4d 5532 1 2024-09-13T21:44:54.884 INFO:tasks.workunit.client.1.smithi155.stdout:0/457: truncate d1/d6/dc/f2b 408721 0 2024-09-13T21:44:54.884 INFO:tasks.workunit.client.1.smithi155.stdout:1/430: sync 2024-09-13T21:44:54.884 INFO:tasks.workunit.client.1.smithi155.stdout:0/458: write d1/d6/dc/d4d/d4a/d52/d5c/f9a [104203,127281] 0 2024-09-13T21:44:54.885 INFO:tasks.workunit.client.1.smithi155.stdout:8/400: sync 2024-09-13T21:44:54.885 INFO:tasks.workunit.client.1.smithi155.stdout:7/434: sync 2024-09-13T21:44:54.886 INFO:tasks.workunit.client.1.smithi155.stdout:6/529: sync 2024-09-13T21:44:54.886 INFO:tasks.workunit.client.1.smithi155.stdout:7/435: dread - d5/df/f85 zero size 2024-09-13T21:44:54.887 INFO:tasks.workunit.client.1.smithi155.stdout:8/401: fdatasync d2/d2d/f59 0 2024-09-13T21:44:54.889 INFO:tasks.workunit.client.0.smithi119.stdout:5/869: write d0/d3/f1a [4658133,85590] 0 2024-09-13T21:44:54.889 INFO:tasks.workunit.client.1.smithi155.stdout:6/530: symlink db/d11/d4c/d64/d5e/la6 0 2024-09-13T21:44:54.890 INFO:tasks.workunit.client.1.smithi155.stdout:7/436: mknod d5/df/d15/c89 0 2024-09-13T21:44:54.892 INFO:tasks.workunit.client.0.smithi119.stdout:5/870: mkdir d0/d3/d4/d9/d14/d24/d11f 0 2024-09-13T21:44:54.893 INFO:tasks.workunit.client.1.smithi155.stdout:6/531: symlink db/d11/d1e/d21/la7 0 2024-09-13T21:44:54.893 INFO:tasks.workunit.client.1.smithi155.stdout:0/459: dwrite d1/d6/dc/d4d/d4a/d52/d5c/d6a/fa9 [0,4194304] 0 2024-09-13T21:44:54.893 INFO:tasks.workunit.client.0.smithi119.stdout:5/871: read - d0/f113 zero size 2024-09-13T21:44:54.894 INFO:tasks.workunit.client.0.smithi119.stdout:1/783: dwrite d1/d3/f2b [0,4194304] 0 2024-09-13T21:44:54.896 INFO:tasks.workunit.client.0.smithi119.stdout:5/872: mkdir d0/d3/d1f/d21/da1/d120 0 2024-09-13T21:44:54.897 INFO:tasks.workunit.client.1.smithi155.stdout:7/437: mknod d5/d13/d5f/c8a 0 2024-09-13T21:44:54.897 INFO:tasks.workunit.client.0.smithi119.stdout:1/784: mkdir d1/d3/d61/d7e/d53/ddf/d104 0 2024-09-13T21:44:54.898 INFO:tasks.workunit.client.0.smithi119.stdout:5/873: mkdir d0/d3/d4/d9/d1e/da5/d121 0 2024-09-13T21:44:54.900 INFO:tasks.workunit.client.0.smithi119.stdout:5/874: unlink d0/d3/ce3 0 2024-09-13T21:44:54.901 INFO:tasks.workunit.client.1.smithi155.stdout:7/438: unlink d5/d10/c72 0 2024-09-13T21:44:54.901 INFO:tasks.workunit.client.0.smithi119.stdout:5/875: read d0/d3/d4/d9/d14/f29 [1144473,11566] 0 2024-09-13T21:44:54.904 INFO:tasks.workunit.client.1.smithi155.stdout:1/431: truncate d6/d15/d23/d87/d30/f50 20008 0 2024-09-13T21:44:54.904 INFO:tasks.workunit.client.1.smithi155.stdout:6/532: dwrite db/d11/d1e/f3e [0,4194304] 0 2024-09-13T21:44:54.907 INFO:tasks.workunit.client.1.smithi155.stdout:0/460: creat d1/d6/faf x:0 0 0 2024-09-13T21:44:54.910 INFO:tasks.workunit.client.1.smithi155.stdout:0/461: chown d1/d6/dc/d4d/d4a/d52/d5b/l65 184581348 1 2024-09-13T21:44:54.911 INFO:tasks.workunit.client.1.smithi155.stdout:1/432: dread d6/d82/d90/f6c [0,4194304] 0 2024-09-13T21:44:54.912 INFO:tasks.workunit.client.1.smithi155.stdout:1/433: unlink d6/d15/d3e/c11 0 2024-09-13T21:44:54.913 INFO:tasks.workunit.client.1.smithi155.stdout:7/439: link d5/df/d15/f28 d5/d13/f8b 0 2024-09-13T21:44:54.915 INFO:tasks.workunit.client.1.smithi155.stdout:7/440: unlink d5/d10/d3e/l54 0 2024-09-13T21:44:54.917 INFO:tasks.workunit.client.1.smithi155.stdout:7/441: write d5/df/d15/d33/f69 [1278,114652] 0 2024-09-13T21:44:54.922 INFO:tasks.workunit.client.1.smithi155.stdout:7/442: link d5/df/d15/d33/d55/f87 d5/d10/d3e/d3f/f8c 0 2024-09-13T21:44:54.926 INFO:tasks.workunit.client.0.smithi119.stdout:5/876: dwrite d0/d3/d4/d9/d14/f29 [4194304,4194304] 0 2024-09-13T21:44:54.927 INFO:tasks.workunit.client.1.smithi155.stdout:7/443: truncate f3 3823392 0 2024-09-13T21:44:54.927 INFO:tasks.workunit.client.0.smithi119.stdout:5/877: stat d0/d3/d4/d9/d14/d24/f104 0 2024-09-13T21:44:54.929 INFO:tasks.workunit.client.1.smithi155.stdout:8/402: dwrite d2/d1f/f70 [0,4194304] 0 2024-09-13T21:44:54.929 INFO:tasks.workunit.client.0.smithi119.stdout:5/878: mknod d0/d3/d1f/d21/d4f/df8/c122 0 2024-09-13T21:44:54.930 INFO:tasks.workunit.client.1.smithi155.stdout:7/444: truncate d5/d10/d3e/d3f/f8c 401744 0 2024-09-13T21:44:54.931 INFO:tasks.workunit.client.1.smithi155.stdout:7/445: fsync d5/d13/f14 0 2024-09-13T21:44:54.932 INFO:tasks.workunit.client.0.smithi119.stdout:5/879: write d0/d3/d1f/d21/da1/dfb/de1/f112 [165909,111647] 0 2024-09-13T21:44:54.933 INFO:tasks.workunit.client.0.smithi119.stdout:5/880: chown d0/d3/d4/def/f5f 283220 1 2024-09-13T21:44:54.934 INFO:tasks.workunit.client.0.smithi119.stdout:5/881: fsync d0/d3/d1f/d21/d4f/d86/fb4 0 2024-09-13T21:44:54.935 INFO:tasks.workunit.client.1.smithi155.stdout:8/403: rename d2/d6/dd/d25/c50 to d2/d8/d5e/d60/c79 0 2024-09-13T21:44:54.939 INFO:tasks.workunit.client.0.smithi119.stdout:5/882: creat d0/d3/f123 x:0 0 0 2024-09-13T21:44:54.940 INFO:tasks.workunit.client.0.smithi119.stdout:5/883: stat d0/d3/d4/d9/d14/d24/f5a 0 2024-09-13T21:44:54.941 INFO:tasks.workunit.client.1.smithi155.stdout:7/446: symlink d5/df/d15/d33/l8d 0 2024-09-13T21:44:54.941 INFO:tasks.workunit.client.0.smithi119.stdout:5/884: readlink d0/d3/d4/def/lc0 0 2024-09-13T21:44:54.943 INFO:tasks.workunit.client.1.smithi155.stdout:7/447: mkdir d5/d3b/d8e 0 2024-09-13T21:44:54.944 INFO:tasks.workunit.client.1.smithi155.stdout:0/462: dread d1/f34 [4194304,4194304] 0 2024-09-13T21:44:54.946 INFO:tasks.workunit.client.1.smithi155.stdout:6/533: dread db/d80/f7a [0,4194304] 0 2024-09-13T21:44:54.947 INFO:tasks.workunit.client.1.smithi155.stdout:7/448: mkdir d5/df/d15/d33/d8f 0 2024-09-13T21:44:54.948 INFO:tasks.workunit.client.1.smithi155.stdout:0/463: mkdir d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0 0 2024-09-13T21:44:54.948 INFO:tasks.workunit.client.0.smithi119.stdout:0/808: sync 2024-09-13T21:44:54.948 INFO:tasks.workunit.client.1.smithi155.stdout:1/434: dread d6/f16 [4194304,4194304] 0 2024-09-13T21:44:54.949 INFO:tasks.workunit.client.0.smithi119.stdout:0/809: read de/d1c/f5c [2055767,34562] 0 2024-09-13T21:44:54.950 INFO:tasks.workunit.client.1.smithi155.stdout:7/449: fdatasync d5/d13/f8b 0 2024-09-13T21:44:54.951 INFO:tasks.workunit.client.0.smithi119.stdout:0/810: creat de/d4e/da5/f115 x:0 0 0 2024-09-13T21:44:54.952 INFO:tasks.workunit.client.0.smithi119.stdout:0/811: write de/d1c/d52/f7a [2249699,92455] 0 2024-09-13T21:44:54.955 INFO:tasks.workunit.client.1.smithi155.stdout:7/450: link d5/d10/d3e/d3f/f4a d5/d10/f90 0 2024-09-13T21:44:54.956 INFO:tasks.workunit.client.0.smithi119.stdout:0/812: rename de/d4e/c10e to de/d1c/d2b/d76/d9a/c116 0 2024-09-13T21:44:54.956 INFO:tasks.workunit.client.1.smithi155.stdout:7/451: symlink d5/d10/d3e/l91 0 2024-09-13T21:44:54.958 INFO:tasks.workunit.client.0.smithi119.stdout:0/813: symlink de/d1c/d2f/d35/d90/l117 0 2024-09-13T21:44:54.960 INFO:tasks.workunit.client.0.smithi119.stdout:0/814: dread de/d1c/d52/fd2 [0,4194304] 0 2024-09-13T21:44:54.964 INFO:tasks.workunit.client.0.smithi119.stdout:0/815: rename de/d1c/d2f/d40/d66/ff4 to de/d1c/d2f/d35/d4a/f118 0 2024-09-13T21:44:54.964 INFO:tasks.workunit.client.1.smithi155.stdout:0/464: dread d1/d6/dc/d4d/d4a/d4e/d61/f6b [0,4194304] 0 2024-09-13T21:44:54.964 INFO:tasks.workunit.client.1.smithi155.stdout:1/435: truncate d6/d15/d57/d5d/f5f 1532435 0 2024-09-13T21:44:54.971 INFO:tasks.workunit.client.1.smithi155.stdout:0/465: dwrite d1/d6/dc/d4d/d4a/d52/fa8 [0,4194304] 0 2024-09-13T21:44:54.972 INFO:tasks.workunit.client.1.smithi155.stdout:1/436: dwrite d6/d7/f2f [0,4194304] 0 2024-09-13T21:44:54.974 INFO:tasks.workunit.client.1.smithi155.stdout:1/437: write d6/d15/d3e/f4f [4066714,54163] 0 2024-09-13T21:44:54.975 INFO:tasks.workunit.client.0.smithi119.stdout:0/816: dread de/d49/fb0 [0,4194304] 0 2024-09-13T21:44:54.977 INFO:tasks.workunit.client.0.smithi119.stdout:0/817: mknod de/d1c/d2f/d40/d66/dcb/c119 0 2024-09-13T21:44:54.978 INFO:tasks.workunit.client.1.smithi155.stdout:1/438: mkdir d6/d15/d23/d87/d95 0 2024-09-13T21:44:54.979 INFO:tasks.workunit.client.1.smithi155.stdout:1/439: chown d6/d7/f2f 2201 1 2024-09-13T21:44:54.980 INFO:tasks.workunit.client.1.smithi155.stdout:0/466: creat d1/d6/dc/d4d/d4a/d52/fb1 x:0 0 0 2024-09-13T21:44:54.981 INFO:tasks.workunit.client.1.smithi155.stdout:0/467: dread - d1/d6/d97/fa7 zero size 2024-09-13T21:44:54.983 INFO:tasks.workunit.client.1.smithi155.stdout:0/468: mkdir d1/d6/d97/db2 0 2024-09-13T21:44:54.984 INFO:tasks.workunit.client.1.smithi155.stdout:1/440: read d6/d15/d23/d87/d30/f46 [235341,97315] 0 2024-09-13T21:44:54.984 INFO:tasks.workunit.client.0.smithi119.stdout:0/818: dwrite de/d1c/d2f/d35/fdd [0,4194304] 0 2024-09-13T21:44:54.985 INFO:tasks.workunit.client.1.smithi155.stdout:1/441: chown d6/d15/f4c 247005533 1 2024-09-13T21:44:54.986 INFO:tasks.workunit.client.1.smithi155.stdout:1/442: stat d6/d7/d48/c53 0 2024-09-13T21:44:54.988 INFO:tasks.workunit.client.0.smithi119.stdout:0/819: unlink de/d1c/d2f/d35/d4a/d62/fa6 0 2024-09-13T21:44:54.990 INFO:tasks.workunit.client.0.smithi119.stdout:0/820: symlink de/d1c/d52/de4/l11a 0 2024-09-13T21:44:54.992 INFO:tasks.workunit.client.0.smithi119.stdout:0/821: creat de/d4e/da5/f11b x:0 0 0 2024-09-13T21:44:54.993 INFO:tasks.workunit.client.0.smithi119.stdout:0/822: mknod de/d49/c11c 0 2024-09-13T21:44:54.994 INFO:tasks.workunit.client.0.smithi119.stdout:0/823: chown de/d1c/d2b/fb3 4086637 1 2024-09-13T21:44:54.995 INFO:tasks.workunit.client.0.smithi119.stdout:0/824: symlink de/d1c/l11d 0 2024-09-13T21:44:54.997 INFO:tasks.workunit.client.0.smithi119.stdout:0/825: fdatasync de/f68 0 2024-09-13T21:44:55.000 INFO:tasks.workunit.client.0.smithi119.stdout:0/826: link de/d1c/d52/fd2 de/d1c/d59/f11e 0 2024-09-13T21:44:55.004 INFO:tasks.workunit.client.0.smithi119.stdout:0/827: getdents de/d1c/d2b/d76/d9b 0 2024-09-13T21:44:55.006 INFO:tasks.workunit.client.1.smithi155.stdout:0/469: dwrite d1/d6/dc/d4d/d4a/f4b [0,4194304] 0 2024-09-13T21:44:55.009 INFO:tasks.workunit.client.0.smithi119.stdout:0/828: write de/d49/f4f [277493,42370] 0 2024-09-13T21:44:55.009 INFO:tasks.workunit.client.1.smithi155.stdout:1/443: dwrite d6/d15/f20 [0,4194304] 0 2024-09-13T21:44:55.013 INFO:tasks.workunit.client.1.smithi155.stdout:0/470: unlink d1/la 0 2024-09-13T21:44:55.013 INFO:tasks.workunit.client.1.smithi155.stdout:1/444: creat d6/d7/d48/f96 x:0 0 0 2024-09-13T21:44:55.015 INFO:tasks.workunit.client.0.smithi119.stdout:0/829: dwrite de/d1c/d2f/f47 [0,4194304] 0 2024-09-13T21:44:55.016 INFO:tasks.workunit.client.1.smithi155.stdout:1/445: fdatasync d6/d15/d57/d5d/f62 0 2024-09-13T21:44:55.019 INFO:tasks.workunit.client.1.smithi155.stdout:1/446: creat d6/d15/d23/d87/d95/f97 x:0 0 0 2024-09-13T21:44:55.021 INFO:tasks.workunit.client.1.smithi155.stdout:1/447: mknod d6/d15/d3e/c98 0 2024-09-13T21:44:55.034 INFO:tasks.workunit.client.1.smithi155.stdout:0/471: write d1/d6/dc/d4d/d4a/d52/f6d [763050,92987] 0 2024-09-13T21:44:55.036 INFO:tasks.workunit.client.1.smithi155.stdout:1/448: rename d6/d15/d3e to d6/d15/d57/d99 0 2024-09-13T21:44:55.037 INFO:tasks.workunit.client.0.smithi119.stdout:0/830: dread fd [0,4194304] 0 2024-09-13T21:44:55.037 INFO:tasks.workunit.client.1.smithi155.stdout:0/472: symlink d1/d6/dc/d4d/d4a/d52/da5/lb3 0 2024-09-13T21:44:55.038 INFO:tasks.workunit.client.1.smithi155.stdout:1/449: rmdir d6/d15/d57/d5d/d72 39 2024-09-13T21:44:55.038 INFO:tasks.workunit.client.1.smithi155.stdout:0/473: write d1/f2f [4684416,6059] 0 2024-09-13T21:44:55.040 INFO:tasks.workunit.client.0.smithi119.stdout:0/831: truncate de/d1c/d2f/d35/f111 644284 0 2024-09-13T21:44:55.040 INFO:tasks.workunit.client.1.smithi155.stdout:1/450: creat d6/d15/d23/d87/f9a x:0 0 0 2024-09-13T21:44:55.043 INFO:tasks.workunit.client.1.smithi155.stdout:1/451: write d6/d15/d23/d87/d30/f46 [533964,36079] 0 2024-09-13T21:44:55.043 INFO:tasks.workunit.client.1.smithi155.stdout:0/474: link d1/d6/dc/l42 d1/d6/dc/d4d/d4a/d9e/lb4 0 2024-09-13T21:44:55.045 INFO:tasks.workunit.client.1.smithi155.stdout:0/475: mkdir d1/d6/d97/db2/db5 0 2024-09-13T21:44:55.046 INFO:tasks.workunit.client.1.smithi155.stdout:1/452: creat d6/d15/d57/d5d/d72/d74/f9b x:0 0 0 2024-09-13T21:44:55.047 INFO:tasks.workunit.client.1.smithi155.stdout:0/476: mknod d1/d6/dc/d4d/d4a/cb6 0 2024-09-13T21:44:55.048 INFO:tasks.workunit.client.1.smithi155.stdout:0/477: chown d1/d6/dc/d4d/d4a/d52/l94 1215104 1 2024-09-13T21:44:55.049 INFO:tasks.workunit.client.1.smithi155.stdout:1/453: creat d6/d15/d57/d5d/f9c x:0 0 0 2024-09-13T21:44:55.050 INFO:tasks.workunit.client.0.smithi119.stdout:0/832: dread de/d1c/d2b/d34/f5b [0,4194304] 0 2024-09-13T21:44:55.051 INFO:tasks.workunit.client.1.smithi155.stdout:0/478: symlink d1/d6/dc/d4d/d4a/d52/d5c/lb7 0 2024-09-13T21:44:55.051 INFO:tasks.workunit.client.0.smithi119.stdout:0/833: chown de/d1c/d2f/d40/d66/cee 49 1 2024-09-13T21:44:55.052 INFO:tasks.workunit.client.1.smithi155.stdout:1/454: creat d6/d15/d23/d87/d30/f9d x:0 0 0 2024-09-13T21:44:55.052 INFO:tasks.workunit.client.0.smithi119.stdout:0/834: truncate de/d3c/f3d 5055338 0 2024-09-13T21:44:55.058 INFO:tasks.workunit.client.0.smithi119.stdout:0/835: dwrite de/d1c/d2f/f10f [0,4194304] 0 2024-09-13T21:44:55.061 INFO:tasks.workunit.client.0.smithi119.stdout:0/836: truncate de/f5e 655066 0 2024-09-13T21:44:55.062 INFO:tasks.workunit.client.1.smithi155.stdout:0/479: dwrite d1/d6/dc/d4d/f71 [0,4194304] 0 2024-09-13T21:44:55.062 INFO:tasks.workunit.client.1.smithi155.stdout:0/480: stat d1/f1d 0 2024-09-13T21:44:55.064 INFO:tasks.workunit.client.1.smithi155.stdout:0/481: write d1/d6/dc/d4d/d4a/d52/d5c/f60 [5039337,114126] 0 2024-09-13T21:44:55.064 INFO:tasks.workunit.client.0.smithi119.stdout:0/837: rmdir de/d49/d7d 39 2024-09-13T21:44:55.070 INFO:tasks.workunit.client.1.smithi155.stdout:0/482: rename d1/d6/d74 to d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8 0 2024-09-13T21:44:55.071 INFO:tasks.workunit.client.1.smithi155.stdout:1/455: dread d6/d15/d57/d5d/d72/d74/f7e [0,4194304] 0 2024-09-13T21:44:55.072 INFO:tasks.workunit.client.0.smithi119.stdout:0/838: dread de/d1c/d2b/d76/f97 [0,4194304] 0 2024-09-13T21:44:55.073 INFO:tasks.workunit.client.1.smithi155.stdout:0/483: symlink d1/d6/dc/d4d/d4a/d52/da5/lb9 0 2024-09-13T21:44:55.074 INFO:tasks.workunit.client.0.smithi119.stdout:0/839: write de/d1c/d2b/d76/f93 [4295638,52873] 0 2024-09-13T21:44:55.074 INFO:tasks.workunit.client.1.smithi155.stdout:1/456: symlink d6/d15/d57/d99/l9e 0 2024-09-13T21:44:55.075 INFO:tasks.workunit.client.1.smithi155.stdout:1/457: dread - d6/d15/d23/d87/d95/f97 zero size 2024-09-13T21:44:55.076 INFO:tasks.workunit.client.1.smithi155.stdout:0/484: mknod d1/d6/d97/db2/db5/cba 0 2024-09-13T21:44:55.077 INFO:tasks.workunit.client.1.smithi155.stdout:1/458: chown d6/d15/d23/d87/c28 249393 1 2024-09-13T21:44:55.078 INFO:tasks.workunit.client.1.smithi155.stdout:1/459: truncate d6/d15/d23/d87/d30/f9d 705567 0 2024-09-13T21:44:55.080 INFO:tasks.workunit.client.1.smithi155.stdout:0/485: rmdir d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/d82/dad 0 2024-09-13T21:44:55.081 INFO:tasks.workunit.client.1.smithi155.stdout:1/460: truncate d6/d15/d23/d87/d30/f50 667578 0 2024-09-13T21:44:55.081 INFO:tasks.workunit.client.1.smithi155.stdout:0/486: readlink d1/d6/d97/lae 0 2024-09-13T21:44:55.083 INFO:tasks.workunit.client.1.smithi155.stdout:1/461: creat d6/d15/d57/d5d/d72/d74/f9f x:0 0 0 2024-09-13T21:44:55.083 INFO:tasks.workunit.client.1.smithi155.stdout:0/487: creat d1/d6/d81/fbb x:0 0 0 2024-09-13T21:44:55.085 INFO:tasks.workunit.client.1.smithi155.stdout:1/462: unlink d6/d15/d57/d5d/d72/d74/f7e 0 2024-09-13T21:44:55.122 INFO:tasks.workunit.client.1.smithi155.stdout:9/524: sync 2024-09-13T21:44:55.124 INFO:tasks.workunit.client.1.smithi155.stdout:9/525: rmdir dc/de/d6f 39 2024-09-13T21:44:55.146 INFO:tasks.workunit.client.0.smithi119.stdout:0/840: write de/d1c/d2f/d40/fbc [271304,20841] 0 2024-09-13T21:44:55.151 INFO:tasks.workunit.client.0.smithi119.stdout:0/841: dwrite de/d1c/d2f/d40/f10b [0,4194304] 0 2024-09-13T21:44:55.153 INFO:tasks.workunit.client.0.smithi119.stdout:0/842: mknod de/d4e/da5/c11f 0 2024-09-13T21:44:55.165 INFO:tasks.workunit.client.0.smithi119.stdout:0/843: dwrite de/d1c/d52/fd2 [0,4194304] 0 2024-09-13T21:44:55.185 INFO:tasks.workunit.client.0.smithi119.stdout:0/844: dread de/d1c/d2f/f43 [0,4194304] 0 2024-09-13T21:44:55.186 INFO:tasks.workunit.client.0.smithi119.stdout:0/845: write de/d1c/d2f/d40/d66/dcb/f113 [193169,116678] 0 2024-09-13T21:44:55.192 INFO:tasks.workunit.client.0.smithi119.stdout:0/846: dwrite de/d1c/d64/f8a [4194304,4194304] 0 2024-09-13T21:44:55.193 INFO:tasks.workunit.client.0.smithi119.stdout:0/847: fdatasync de/d1c/d52/fd2 0 2024-09-13T21:44:55.194 INFO:tasks.workunit.client.0.smithi119.stdout:0/848: dread - de/d1c/d2f/d35/f79 zero size 2024-09-13T21:44:55.196 INFO:tasks.workunit.client.0.smithi119.stdout:0/849: unlink de/cb8 0 2024-09-13T21:44:55.198 INFO:tasks.workunit.client.0.smithi119.stdout:0/850: mknod de/d1c/d2f/d40/d66/dcb/dd6/db1/c120 0 2024-09-13T21:44:55.198 INFO:tasks.workunit.client.0.smithi119.stdout:0/851: stat de/d4e/da5 0 2024-09-13T21:44:55.199 INFO:tasks.workunit.client.0.smithi119.stdout:0/852: write de/d1c/d64/f8e [4900484,49086] 0 2024-09-13T21:44:55.201 INFO:tasks.workunit.client.0.smithi119.stdout:0/853: symlink de/d1c/d2b/d76/d9a/l121 0 2024-09-13T21:44:55.203 INFO:tasks.workunit.client.0.smithi119.stdout:0/854: truncate de/f10 517804 0 2024-09-13T21:44:55.205 INFO:tasks.workunit.client.0.smithi119.stdout:0/855: mknod de/d1c/d2f/d40/d66/dcb/dd6/c122 0 2024-09-13T21:44:55.206 INFO:tasks.workunit.client.0.smithi119.stdout:0/856: write de/d1c/d64/f8e [2149591,24088] 0 2024-09-13T21:44:55.206 INFO:tasks.workunit.client.0.smithi119.stdout:0/857: stat de/d4e/da5 0 2024-09-13T21:44:55.210 INFO:tasks.workunit.client.0.smithi119.stdout:0/858: dread de/d1c/d64/f8a [4194304,4194304] 0 2024-09-13T21:44:55.212 INFO:tasks.workunit.client.0.smithi119.stdout:0/859: mkdir de/d1c/d2b/d76/d9b/d123 0 2024-09-13T21:44:55.220 INFO:tasks.workunit.client.0.smithi119.stdout:0/860: write de/d1c/d2f/d40/d66/ffa [1253623,81269] 0 2024-09-13T21:44:55.235 INFO:tasks.workunit.client.0.smithi119.stdout:0/861: mknod de/d1c/d2f/d40/d66/c124 0 2024-09-13T21:44:55.240 INFO:tasks.workunit.client.0.smithi119.stdout:0/862: dwrite de/d1c/d2f/d40/d66/dcb/dd6/d83/f88 [4194304,4194304] 0 2024-09-13T21:44:55.243 INFO:tasks.workunit.client.0.smithi119.stdout:0/863: rmdir de/d1c/d2f/d35/d4a/dac 39 2024-09-13T21:44:55.259 INFO:tasks.workunit.client.0.smithi119.stdout:0/864: dwrite de/d1c/f27 [0,4194304] 0 2024-09-13T21:44:55.264 INFO:tasks.workunit.client.0.smithi119.stdout:0/865: dwrite de/d4e/ffe [0,4194304] 0 2024-09-13T21:44:55.267 INFO:tasks.workunit.client.0.smithi119.stdout:0/866: chown de/c3b 1880721 1 2024-09-13T21:44:55.269 INFO:tasks.workunit.client.0.smithi119.stdout:0/867: write de/d1c/ff2 [857851,116455] 0 2024-09-13T21:44:55.271 INFO:tasks.workunit.client.0.smithi119.stdout:0/868: rmdir de/d1c/d64 39 2024-09-13T21:44:55.272 INFO:tasks.workunit.client.0.smithi119.stdout:0/869: write de/fd4 [193456,128120] 0 2024-09-13T21:44:55.274 INFO:tasks.workunit.client.0.smithi119.stdout:0/870: symlink de/d1c/d2f/d40/d66/dcb/dd6/d83/l125 0 2024-09-13T21:44:55.276 INFO:tasks.workunit.client.1.smithi155.stdout:5/413: sync 2024-09-13T21:44:55.277 INFO:tasks.workunit.client.0.smithi119.stdout:0/871: creat de/d49/f126 x:0 0 0 2024-09-13T21:44:55.278 INFO:tasks.workunit.client.1.smithi155.stdout:5/414: mkdir d5/d16/d4e/d85 0 2024-09-13T21:44:55.280 INFO:tasks.workunit.client.0.smithi119.stdout:0/872: link de/d1c/d2b/d76/d9b/cc6 de/d1c/d2f/d35/d4a/d62/c127 0 2024-09-13T21:44:55.283 INFO:tasks.workunit.client.0.smithi119.stdout:0/873: link de/d1c/d2f/d35/d90/l106 de/d1c/d2b/dd7/l128 0 2024-09-13T21:44:55.284 INFO:tasks.workunit.client.0.smithi119.stdout:2/772: sync 2024-09-13T21:44:55.284 INFO:tasks.workunit.client.0.smithi119.stdout:4/850: sync 2024-09-13T21:44:55.285 INFO:tasks.workunit.client.1.smithi155.stdout:5/415: dread d5/d12/f4b [0,4194304] 0 2024-09-13T21:44:55.287 INFO:tasks.workunit.client.1.smithi155.stdout:5/416: write d5/d16/d33/d1b/f5e [893953,47617] 0 2024-09-13T21:44:55.288 INFO:tasks.workunit.client.0.smithi119.stdout:0/874: rename de/d1c/d64/f102 to de/d4e/d7f/ded/f129 0 2024-09-13T21:44:55.288 INFO:tasks.workunit.client.0.smithi119.stdout:2/773: mkdir d1/d7/d47/df3 0 2024-09-13T21:44:55.288 INFO:tasks.workunit.client.0.smithi119.stdout:0/875: stat de/d4e/d7f/ded/f129 0 2024-09-13T21:44:55.293 INFO:tasks.workunit.client.1.smithi155.stdout:5/417: unlink d5/d16/d33/d1b/d2f/d3c/d44/f3b 0 2024-09-13T21:44:55.293 INFO:tasks.workunit.client.1.smithi155.stdout:5/418: mknod d5/c86 0 2024-09-13T21:44:55.293 INFO:tasks.workunit.client.1.smithi155.stdout:5/419: write d5/d16/d33/d1b/f57 [3677905,2349] 0 2024-09-13T21:44:55.293 INFO:tasks.workunit.client.0.smithi119.stdout:2/774: fdatasync d1/d22/d5a/d5d/d83/fd8 0 2024-09-13T21:44:55.293 INFO:tasks.workunit.client.0.smithi119.stdout:0/876: write de/d1c/d2f/d35/d4a/f105 [441405,100330] 0 2024-09-13T21:44:55.293 INFO:tasks.workunit.client.0.smithi119.stdout:2/775: fdatasync d1/d7/d47/fea 0 2024-09-13T21:44:55.294 INFO:tasks.workunit.client.0.smithi119.stdout:4/851: rename d4/d1e/df7 to d4/d114 0 2024-09-13T21:44:55.294 INFO:tasks.workunit.client.0.smithi119.stdout:2/776: rmdir d1/d22/d55/d31 39 2024-09-13T21:44:55.294 INFO:tasks.workunit.client.0.smithi119.stdout:2/777: write d1/d22/d5a/d5d/d83/f73 [6509427,31278] 0 2024-09-13T21:44:55.294 INFO:tasks.workunit.client.1.smithi155.stdout:5/420: readlink d5/d16/d33/d1b/l2b 0 2024-09-13T21:44:55.295 INFO:tasks.workunit.client.1.smithi155.stdout:5/421: rename c3 to d5/d16/d33/d1b/d2f/d3c/d6c/c87 0 2024-09-13T21:44:55.296 INFO:tasks.workunit.client.0.smithi119.stdout:2/778: chown d1/d22/d5a/d5d/d77/daa/deb 803938080 1 2024-09-13T21:44:55.297 INFO:tasks.workunit.client.1.smithi155.stdout:5/422: creat d5/d16/d33/d1b/d59/f88 x:0 0 0 2024-09-13T21:44:55.297 INFO:tasks.workunit.client.1.smithi155.stdout:5/423: chown d5/d16/f2a 33006543 1 2024-09-13T21:44:55.299 INFO:tasks.workunit.client.1.smithi155.stdout:5/424: creat d5/d12/d84/f89 x:0 0 0 2024-09-13T21:44:55.307 INFO:tasks.workunit.client.1.smithi155.stdout:5/425: rename d5/d16/d33/d1b/d28/d52/f78 to d5/d16/d33/d1b/d59/f8a 0 2024-09-13T21:44:55.309 INFO:tasks.workunit.client.1.smithi155.stdout:5/426: rename d5/d16/d33/d1b/f5e to d5/d12/f8b 0 2024-09-13T21:44:55.311 INFO:tasks.workunit.client.1.smithi155.stdout:5/427: write d5/d16/d33/d1b/d2f/d3c/d44/d29/f7d [90906,74723] 0 2024-09-13T21:44:55.314 INFO:tasks.workunit.client.1.smithi155.stdout:5/428: dread d5/d12/f8b [0,4194304] 0 2024-09-13T21:44:55.319 INFO:tasks.workunit.client.1.smithi155.stdout:4/400: sync 2024-09-13T21:44:55.319 INFO:tasks.workunit.client.1.smithi155.stdout:9/526: sync 2024-09-13T21:44:55.319 INFO:tasks.workunit.client.1.smithi155.stdout:2/400: sync 2024-09-13T21:44:55.319 INFO:tasks.workunit.client.1.smithi155.stdout:3/496: sync 2024-09-13T21:44:55.319 INFO:tasks.workunit.client.1.smithi155.stdout:7/452: sync 2024-09-13T21:44:55.320 INFO:tasks.workunit.client.1.smithi155.stdout:0/488: sync 2024-09-13T21:44:55.320 INFO:tasks.workunit.client.1.smithi155.stdout:8/404: sync 2024-09-13T21:44:55.320 INFO:tasks.workunit.client.1.smithi155.stdout:1/463: sync 2024-09-13T21:44:55.320 INFO:tasks.workunit.client.1.smithi155.stdout:6/534: sync 2024-09-13T21:44:55.322 INFO:tasks.workunit.client.1.smithi155.stdout:5/429: dwrite d5/d12/d84/f89 [0,4194304] 0 2024-09-13T21:44:55.322 INFO:tasks.workunit.client.1.smithi155.stdout:4/401: stat d1/d7/d5a/l74 0 2024-09-13T21:44:55.324 INFO:tasks.workunit.client.1.smithi155.stdout:4/402: chown d1/d7/de 1339 1 2024-09-13T21:44:55.327 INFO:tasks.workunit.client.1.smithi155.stdout:3/497: symlink d3/d25/d17/laf 0 2024-09-13T21:44:55.330 INFO:tasks.workunit.client.1.smithi155.stdout:5/430: mknod d5/d16/d4e/c8c 0 2024-09-13T21:44:55.331 INFO:tasks.workunit.client.1.smithi155.stdout:5/431: dread - d5/d16/d33/d1b/d59/f8a zero size 2024-09-13T21:44:55.334 INFO:tasks.workunit.client.1.smithi155.stdout:7/453: truncate d5/df/d15/f28 481078 0 2024-09-13T21:44:55.335 INFO:tasks.workunit.client.1.smithi155.stdout:9/527: dread dc/d18/d1e/f64 [0,4194304] 0 2024-09-13T21:44:55.335 INFO:tasks.workunit.client.1.smithi155.stdout:4/403: mkdir d1/d7/de/dc/d7b 0 2024-09-13T21:44:55.336 INFO:tasks.workunit.client.1.smithi155.stdout:0/489: truncate d1/d6/dc/f6c 452210 0 2024-09-13T21:44:55.337 INFO:tasks.workunit.client.1.smithi155.stdout:3/498: dread - d3/d21/d4a/f73 zero size 2024-09-13T21:44:55.338 INFO:tasks.workunit.client.1.smithi155.stdout:0/490: fsync d1/d6/dc/d4d/d4a/d52/d5b/f86 0 2024-09-13T21:44:55.338 INFO:tasks.workunit.client.1.smithi155.stdout:6/535: rename db/d3d/d5f/c61 to db/d3d/ca8 0 2024-09-13T21:44:55.340 INFO:tasks.workunit.client.1.smithi155.stdout:2/401: mknod d2/dd/de/d15/d2e/d31/d5d/c8c 0 2024-09-13T21:44:55.341 INFO:tasks.workunit.client.1.smithi155.stdout:8/405: getdents d2/d6 0 2024-09-13T21:44:55.341 INFO:tasks.workunit.client.1.smithi155.stdout:2/402: chown d2/dd/de/d15/d38/f4f 25675 1 2024-09-13T21:44:55.343 INFO:tasks.workunit.client.1.smithi155.stdout:4/404: write d1/d7/de/d15/f5b [1419158,42978] 0 2024-09-13T21:44:55.345 INFO:tasks.workunit.client.1.smithi155.stdout:3/499: write d3/d25/f58 [237804,39634] 0 2024-09-13T21:44:55.348 INFO:tasks.workunit.client.1.smithi155.stdout:7/454: creat d5/df/d79/f92 x:0 0 0 2024-09-13T21:44:55.348 INFO:tasks.workunit.client.1.smithi155.stdout:1/464: write d6/d7/f24 [1326598,21178] 0 2024-09-13T21:44:55.350 INFO:tasks.workunit.client.1.smithi155.stdout:2/403: mkdir d2/dd/d21/d8d 0 2024-09-13T21:44:55.350 INFO:tasks.workunit.client.1.smithi155.stdout:1/465: write d6/d82/d90/f84 [164165,6114] 0 2024-09-13T21:44:55.352 INFO:tasks.workunit.client.1.smithi155.stdout:9/528: link dc/d19/d23/f66 dc/d19/d23/d38/d90/d74/fb9 0 2024-09-13T21:44:55.353 INFO:tasks.workunit.client.1.smithi155.stdout:6/536: mknod db/d2c/d9d/d1c/ca9 0 2024-09-13T21:44:55.354 INFO:tasks.workunit.client.1.smithi155.stdout:6/537: write db/d11/d4c/f6c [426227,26050] 0 2024-09-13T21:44:55.354 INFO:tasks.workunit.client.1.smithi155.stdout:3/500: unlink d3/d21/d2c/f87 0 2024-09-13T21:44:55.356 INFO:tasks.workunit.client.1.smithi155.stdout:8/406: symlink d2/d6/dd/d25/l7a 0 2024-09-13T21:44:55.358 INFO:tasks.workunit.client.1.smithi155.stdout:3/501: chown d3/d25/d1b/d1f/d82/d83/f8a 3035 1 2024-09-13T21:44:55.358 INFO:tasks.workunit.client.1.smithi155.stdout:4/405: truncate d1/f24 1398425 0 2024-09-13T21:44:55.359 INFO:tasks.workunit.client.1.smithi155.stdout:0/491: dread d1/d6/dc/d4d/d4a/d52/d5c/f5d [0,4194304] 0 2024-09-13T21:44:55.361 INFO:tasks.workunit.client.1.smithi155.stdout:3/502: fdatasync d3/d25/d1b/d1f/d36/d7c/f9e 0 2024-09-13T21:44:55.361 INFO:tasks.workunit.client.1.smithi155.stdout:0/492: dread - d1/d6/d97/f9b zero size 2024-09-13T21:44:55.362 INFO:tasks.workunit.client.1.smithi155.stdout:8/407: mknod d2/d2d/c7b 0 2024-09-13T21:44:55.363 INFO:tasks.workunit.client.1.smithi155.stdout:4/406: write d1/d7/de/d15/d55/d5e/f5f [26202,57131] 0 2024-09-13T21:44:55.363 INFO:tasks.workunit.client.1.smithi155.stdout:6/538: mkdir db/d11/d1e/d21/d44/daa 0 2024-09-13T21:44:55.364 INFO:tasks.workunit.client.1.smithi155.stdout:4/407: stat d1/ld 0 2024-09-13T21:44:55.365 INFO:tasks.workunit.client.1.smithi155.stdout:3/503: write d3/d25/d1b/d1f/d36/d7c/f9e [62658,100568] 0 2024-09-13T21:44:55.367 INFO:tasks.workunit.client.1.smithi155.stdout:8/408: mknod d2/d1f/c7c 0 2024-09-13T21:44:55.368 INFO:tasks.workunit.client.1.smithi155.stdout:2/404: dread d2/dd/d37/f4a [0,4194304] 0 2024-09-13T21:44:55.369 INFO:tasks.workunit.client.1.smithi155.stdout:0/493: chown d1/d6/dc/c3c 318153503 1 2024-09-13T21:44:55.373 INFO:tasks.workunit.client.1.smithi155.stdout:4/408: mkdir d1/d7/de/dc/d7c 0 2024-09-13T21:44:55.374 INFO:tasks.workunit.client.1.smithi155.stdout:8/409: rmdir d2 39 2024-09-13T21:44:55.375 INFO:tasks.workunit.client.1.smithi155.stdout:2/405: symlink d2/dd/de/d15/d2e/l8e 0 2024-09-13T21:44:55.377 INFO:tasks.workunit.client.1.smithi155.stdout:1/466: link d6/d15/d57/d5d/f62 d6/d15/d23/d55/fa0 0 2024-09-13T21:44:55.378 INFO:tasks.workunit.client.1.smithi155.stdout:4/409: mkdir d1/d7/d5a/d7d 0 2024-09-13T21:44:55.378 INFO:tasks.workunit.client.1.smithi155.stdout:1/467: dread - d6/d15/d23/d87/d30/f5e zero size 2024-09-13T21:44:55.379 INFO:tasks.workunit.client.1.smithi155.stdout:7/455: dwrite d5/df/d60/f63 [0,4194304] 0 2024-09-13T21:44:55.380 INFO:tasks.workunit.client.1.smithi155.stdout:3/504: link d3/d25/f5e d3/d25/d1b/d90/fb0 0 2024-09-13T21:44:55.381 INFO:tasks.workunit.client.1.smithi155.stdout:9/529: getdents dc/de/d6f 0 2024-09-13T21:44:55.382 INFO:tasks.workunit.client.1.smithi155.stdout:0/494: creat d1/d6/dc/d4d/d4a/d9e/fbc x:0 0 0 2024-09-13T21:44:55.383 INFO:tasks.workunit.client.1.smithi155.stdout:8/410: chown d2/d6/dd/d12/l40 3750980 1 2024-09-13T21:44:55.384 INFO:tasks.workunit.client.1.smithi155.stdout:0/495: chown d1/cab 6 1 2024-09-13T21:44:55.384 INFO:tasks.workunit.client.1.smithi155.stdout:2/406: creat d2/dd/de/d15/d38/d41/f8f x:0 0 0 2024-09-13T21:44:55.386 INFO:tasks.workunit.client.1.smithi155.stdout:7/456: unlink d5/fa 0 2024-09-13T21:44:55.388 INFO:tasks.workunit.client.1.smithi155.stdout:0/496: stat d1/d6/dc/d4d/d4a/d52/d5c/lb7 0 2024-09-13T21:44:55.388 INFO:tasks.workunit.client.1.smithi155.stdout:1/468: write d6/d15/d23/d87/f2a [1007122,15184] 0 2024-09-13T21:44:55.389 INFO:tasks.workunit.client.0.smithi119.stdout:4/852: dwrite d4/d114/de9/df8/d8f/fc0 [0,4194304] 0 2024-09-13T21:44:55.389 INFO:tasks.workunit.client.1.smithi155.stdout:4/410: mkdir d1/d7/de/d15/d55/d5e/d66/d7e 0 2024-09-13T21:44:55.391 INFO:tasks.workunit.client.0.smithi119.stdout:2/779: mkdir d1/d7/d47/df4 0 2024-09-13T21:44:55.394 INFO:tasks.workunit.client.0.smithi119.stdout:4/853: creat d4/ddc/df4/dc3/f115 x:0 0 0 2024-09-13T21:44:55.394 INFO:tasks.workunit.client.1.smithi155.stdout:8/411: unlink d2/d6/dd/d12/f4a 0 2024-09-13T21:44:55.395 INFO:tasks.workunit.client.1.smithi155.stdout:3/505: dwrite d3/d25/d1b/d1f/d36/f5d [0,4194304] 0 2024-09-13T21:44:55.395 INFO:tasks.workunit.client.0.smithi119.stdout:2/780: fsync d1/d7/f23 0 2024-09-13T21:44:55.395 INFO:tasks.workunit.client.1.smithi155.stdout:4/411: write d1/d7/de/d72/f50 [347138,43944] 0 2024-09-13T21:44:55.396 INFO:tasks.workunit.client.1.smithi155.stdout:6/539: link db/d3d/d5f/d67/c82 db/d11/d4c/d7c/d8b/d8e/cab 0 2024-09-13T21:44:55.400 INFO:tasks.workunit.client.1.smithi155.stdout:9/530: mknod dc/de/cba 0 2024-09-13T21:44:55.401 INFO:tasks.workunit.client.1.smithi155.stdout:9/531: fdatasync dc/de/d5c/f8c 0 2024-09-13T21:44:55.401 INFO:tasks.workunit.client.1.smithi155.stdout:7/457: creat d5/df/d60/d6d/f93 x:0 0 0 2024-09-13T21:44:55.402 INFO:tasks.workunit.client.1.smithi155.stdout:0/497: rmdir d1/d6/dc/d4d/d4a/d52/d5b 39 2024-09-13T21:44:55.403 INFO:tasks.workunit.client.1.smithi155.stdout:2/407: dwrite d2/dd/de/d15/f64 [0,4194304] 0 2024-09-13T21:44:55.404 INFO:tasks.workunit.client.1.smithi155.stdout:4/412: write d1/d7/de/f1f [2067115,47599] 0 2024-09-13T21:44:55.405 INFO:tasks.workunit.client.1.smithi155.stdout:9/532: dread - dc/d19/d21/f9f zero size 2024-09-13T21:44:55.408 INFO:tasks.workunit.client.1.smithi155.stdout:9/533: fsync dc/d18/fb7 0 2024-09-13T21:44:55.408 INFO:tasks.workunit.client.1.smithi155.stdout:4/413: chown d1/d7/de/d15/d55/d5e/d66/c6e 811397 1 2024-09-13T21:44:55.411 INFO:tasks.workunit.client.1.smithi155.stdout:3/506: fdatasync d3/d25/d1b/d1f/f56 0 2024-09-13T21:44:55.415 INFO:tasks.workunit.client.1.smithi155.stdout:3/507: read d3/d25/d1b/d1f/f64 [474332,129987] 0 2024-09-13T21:44:55.416 INFO:tasks.workunit.client.1.smithi155.stdout:0/498: dwrite d1/d6/dc/f7a [0,4194304] 0 2024-09-13T21:44:55.418 INFO:tasks.workunit.client.1.smithi155.stdout:9/534: symlink dc/d18/d50/lbb 0 2024-09-13T21:44:55.419 INFO:tasks.workunit.client.1.smithi155.stdout:9/535: read - dc/de/d2d/f95 zero size 2024-09-13T21:44:55.420 INFO:tasks.workunit.client.1.smithi155.stdout:1/469: write d6/d15/f4c [3350198,74108] 0 2024-09-13T21:44:55.425 INFO:tasks.workunit.client.1.smithi155.stdout:4/414: creat d1/d7/d5a/f7f x:0 0 0 2024-09-13T21:44:55.425 INFO:tasks.workunit.client.1.smithi155.stdout:2/408: creat d2/dd/d21/d39/d84/f90 x:0 0 0 2024-09-13T21:44:55.426 INFO:tasks.workunit.client.1.smithi155.stdout:3/508: creat d3/d25/d1b/d1f/fb1 x:0 0 0 2024-09-13T21:44:55.431 INFO:tasks.workunit.client.1.smithi155.stdout:6/540: getdents db/d11/d86 0 2024-09-13T21:44:55.432 INFO:tasks.workunit.client.0.smithi119.stdout:4/854: dread d4/d1e/d28/d34/f9a [0,4194304] 0 2024-09-13T21:44:55.433 INFO:tasks.workunit.client.0.smithi119.stdout:4/855: chown d4/d1e/d26/c48 3 1 2024-09-13T21:44:55.433 INFO:tasks.workunit.client.1.smithi155.stdout:4/415: rmdir d1/d7/de/d15/d55/d5e/d66 39 2024-09-13T21:44:55.434 INFO:tasks.workunit.client.1.smithi155.stdout:9/536: dwrite dc/d19/d23/f9a [0,4194304] 0 2024-09-13T21:44:55.436 INFO:tasks.workunit.client.1.smithi155.stdout:7/458: getdents d5/d13/d5f 0 2024-09-13T21:44:55.436 INFO:tasks.workunit.client.1.smithi155.stdout:8/412: truncate d2/f5 3981227 0 2024-09-13T21:44:55.439 INFO:tasks.workunit.client.1.smithi155.stdout:1/470: dwrite d6/d15/f76 [0,4194304] 0 2024-09-13T21:44:55.441 INFO:tasks.workunit.client.1.smithi155.stdout:7/459: read - d5/df/d15/f5b zero size 2024-09-13T21:44:55.441 INFO:tasks.workunit.client.1.smithi155.stdout:9/537: chown dc/de/c14 1572 1 2024-09-13T21:44:55.442 INFO:tasks.workunit.client.1.smithi155.stdout:0/499: dwrite d1/d6/dc/d4d/d4a/d52/d5b/f86 [0,4194304] 0 2024-09-13T21:44:55.447 INFO:tasks.workunit.client.1.smithi155.stdout:3/509: mkdir d3/d25/d1b/d1f/d82/da8/db2 0 2024-09-13T21:44:55.448 INFO:tasks.workunit.client.1.smithi155.stdout:9/538: chown dc/d19/d23/d38/d90/l8b 234323074 1 2024-09-13T21:44:55.450 INFO:tasks.workunit.client.0.smithi119.stdout:6/749: sync 2024-09-13T21:44:55.450 INFO:tasks.workunit.client.0.smithi119.stdout:3/852: sync 2024-09-13T21:44:55.451 INFO:tasks.workunit.client.1.smithi155.stdout:3/510: fdatasync d3/d25/d1b/d1f/d36/d7c/f9f 0 2024-09-13T21:44:55.452 INFO:tasks.workunit.client.0.smithi119.stdout:6/750: truncate dc/df/d6d/fda 197044 0 2024-09-13T21:44:55.452 INFO:tasks.workunit.client.1.smithi155.stdout:8/413: creat d2/d6/dd/d12/f7d x:0 0 0 2024-09-13T21:44:55.455 INFO:tasks.workunit.client.1.smithi155.stdout:6/541: mknod db/d2c/d9d/d90/cac 0 2024-09-13T21:44:55.456 INFO:tasks.workunit.client.1.smithi155.stdout:7/460: mknod d5/df/d60/c94 0 2024-09-13T21:44:55.456 INFO:tasks.workunit.client.1.smithi155.stdout:4/416: creat d1/d7/d78/f80 x:0 0 0 2024-09-13T21:44:55.459 INFO:tasks.workunit.client.1.smithi155.stdout:2/409: dwrite d2/db/f63 [0,4194304] 0 2024-09-13T21:44:55.459 INFO:tasks.workunit.client.1.smithi155.stdout:4/417: write d1/d7/d21/f57 [1458037,1215] 0 2024-09-13T21:44:55.461 INFO:tasks.workunit.client.1.smithi155.stdout:9/539: unlink dc/de/l11 0 2024-09-13T21:44:55.461 INFO:tasks.workunit.client.1.smithi155.stdout:4/418: chown d1/d7/de/dc/d7b 9933703 1 2024-09-13T21:44:55.464 INFO:tasks.workunit.client.1.smithi155.stdout:1/471: dwrite d6/d7/d48/f69 [0,4194304] 0 2024-09-13T21:44:55.464 INFO:tasks.workunit.client.1.smithi155.stdout:2/410: dread - d2/dd/de/f55 zero size 2024-09-13T21:44:55.465 INFO:tasks.workunit.client.1.smithi155.stdout:3/511: fdatasync d3/d10/f8d 0 2024-09-13T21:44:55.470 INFO:tasks.workunit.client.1.smithi155.stdout:6/542: creat db/d11/d4c/d7c/d8b/d8e/fad x:0 0 0 2024-09-13T21:44:55.470 INFO:tasks.workunit.client.1.smithi155.stdout:7/461: creat d5/d13/d5f/f95 x:0 0 0 2024-09-13T21:44:55.471 INFO:tasks.workunit.client.0.smithi119.stdout:2/781: mknod d1/d22/d5a/d5d/d77/daa/deb/cf5 0 2024-09-13T21:44:55.471 INFO:tasks.workunit.client.1.smithi155.stdout:2/411: stat d2/dd/d37/l81 0 2024-09-13T21:44:55.472 INFO:tasks.workunit.client.1.smithi155.stdout:1/472: fsync d6/f86 0 2024-09-13T21:44:55.472 INFO:tasks.workunit.client.1.smithi155.stdout:3/512: unlink d3/d25/d1b/d1f/d36/f3c 0 2024-09-13T21:44:55.473 INFO:tasks.workunit.client.0.smithi119.stdout:3/853: creat d6/d25/d2f/d8e/de2/d109/f118 x:0 0 0 2024-09-13T21:44:55.473 INFO:tasks.workunit.client.0.smithi119.stdout:6/751: fdatasync dc/df/f24 0 2024-09-13T21:44:55.474 INFO:tasks.workunit.client.0.smithi119.stdout:2/782: mknod d1/d38/d89/cf6 0 2024-09-13T21:44:55.474 INFO:tasks.workunit.client.1.smithi155.stdout:9/540: mknod dc/d19/d23/d38/cbc 0 2024-09-13T21:44:55.474 INFO:tasks.workunit.client.1.smithi155.stdout:2/412: chown d2/dd/de/d15/d2e/c57 45 1 2024-09-13T21:44:55.476 INFO:tasks.workunit.client.1.smithi155.stdout:0/500: creat d1/d6/dc/d4d/d4a/d52/d5c/fbd x:0 0 0 2024-09-13T21:44:55.477 INFO:tasks.workunit.client.0.smithi119.stdout:3/854: write d6/f100 [494034,7461] 0 2024-09-13T21:44:55.478 INFO:tasks.workunit.client.0.smithi119.stdout:2/783: creat d1/d22/db6/ff7 x:0 0 0 2024-09-13T21:44:55.478 INFO:tasks.workunit.client.0.smithi119.stdout:4/856: write d4/f27 [4705718,91106] 0 2024-09-13T21:44:55.479 INFO:tasks.workunit.client.1.smithi155.stdout:8/414: rmdir d2/d1f/d77/d78 0 2024-09-13T21:44:55.482 INFO:tasks.workunit.client.1.smithi155.stdout:3/513: write d3/d25/d1b/d1f/d36/f6c [74026,127477] 0 2024-09-13T21:44:55.484 INFO:tasks.workunit.client.1.smithi155.stdout:9/541: rmdir dc/d18/d1e/d86 39 2024-09-13T21:44:55.485 INFO:tasks.workunit.client.1.smithi155.stdout:9/542: chown dc/d19/d21/fb4 1065 1 2024-09-13T21:44:55.485 INFO:tasks.workunit.client.0.smithi119.stdout:2/784: dwrite d1/d22/d5a/d5d/d83/fdc [0,4194304] 0 2024-09-13T21:44:55.486 INFO:tasks.workunit.client.1.smithi155.stdout:9/543: chown dc/de/d5c/l9d 558139 1 2024-09-13T21:44:55.487 INFO:tasks.workunit.client.0.smithi119.stdout:2/785: chown d1/f3d 612 1 2024-09-13T21:44:55.487 INFO:tasks.workunit.client.1.smithi155.stdout:2/413: symlink d2/dd/d21/d39/l91 0 2024-09-13T21:44:55.487 INFO:tasks.workunit.client.1.smithi155.stdout:5/432: sync 2024-09-13T21:44:55.489 INFO:tasks.workunit.client.0.smithi119.stdout:3/855: write d6/f6b [722244,125428] 0 2024-09-13T21:44:55.489 INFO:tasks.workunit.client.1.smithi155.stdout:4/419: rename d1/d7/de/dc/c79 to d1/d7/de/d15/d55/d5e/c81 0 2024-09-13T21:44:55.489 INFO:tasks.workunit.client.1.smithi155.stdout:8/415: dread d2/d8/d65/f5b [0,4194304] 0 2024-09-13T21:44:55.490 INFO:tasks.workunit.client.0.smithi119.stdout:4/857: write d4/f4b [551137,9423] 0 2024-09-13T21:44:55.490 INFO:tasks.workunit.client.0.smithi119.stdout:2/786: creat d1/d22/db6/ff8 x:0 0 0 2024-09-13T21:44:55.491 INFO:tasks.workunit.client.0.smithi119.stdout:3/856: mknod d6/d25/d2f/d8e/c119 0 2024-09-13T21:44:55.492 INFO:tasks.workunit.client.1.smithi155.stdout:0/501: mkdir d1/d6/dc/d4d/d4a/dbe 0 2024-09-13T21:44:55.493 INFO:tasks.workunit.client.1.smithi155.stdout:7/462: unlink d5/df/d15/l32 0 2024-09-13T21:44:55.494 INFO:tasks.workunit.client.0.smithi119.stdout:2/787: write d1/d22/d5a/d5d/d83/dce/fe7 [1355236,9019] 0 2024-09-13T21:44:55.494 INFO:tasks.workunit.client.0.smithi119.stdout:3/857: symlink d6/d15/d103/l11a 0 2024-09-13T21:44:55.495 INFO:tasks.workunit.client.1.smithi155.stdout:1/473: mknod d6/d82/d91/ca1 0 2024-09-13T21:44:55.496 INFO:tasks.workunit.client.0.smithi119.stdout:4/858: mknod d4/d1e/d26/c116 0 2024-09-13T21:44:55.500 INFO:tasks.workunit.client.1.smithi155.stdout:5/433: dwrite d5/d16/d33/d1b/d28/f37 [0,4194304] 0 2024-09-13T21:44:55.501 INFO:tasks.workunit.client.1.smithi155.stdout:9/544: rename dc/d18/f3d to dc/de/d2d/d79/d43/d83/fbd 0 2024-09-13T21:44:55.501 INFO:tasks.workunit.client.0.smithi119.stdout:6/752: dread dc/d3d/d4e/fdf [0,4194304] 0 2024-09-13T21:44:55.503 INFO:tasks.workunit.client.1.smithi155.stdout:4/420: read d1/d7/de/d15/f71 [616673,77244] 0 2024-09-13T21:44:55.503 INFO:tasks.workunit.client.1.smithi155.stdout:0/502: truncate d1/f19 650952 0 2024-09-13T21:44:55.503 INFO:tasks.workunit.client.0.smithi119.stdout:4/859: link d4/d1e/d26/d6d/f95 d4/d1e/d28/d5d/d113/f117 0 2024-09-13T21:44:55.504 INFO:tasks.workunit.client.0.smithi119.stdout:3/858: dwrite d6/d15/d103/dbc/fbd [0,4194304] 0 2024-09-13T21:44:55.507 INFO:tasks.workunit.client.1.smithi155.stdout:7/463: truncate d5/df/f58 993880 0 2024-09-13T21:44:55.510 INFO:tasks.workunit.client.0.smithi119.stdout:4/860: mkdir d4/d1e/d28/d34/ddd/d118 0 2024-09-13T21:44:55.512 INFO:tasks.workunit.client.0.smithi119.stdout:6/753: dwrite dc/d4b/d6a/dbd/fe6 [0,4194304] 0 2024-09-13T21:44:55.512 INFO:tasks.workunit.client.1.smithi155.stdout:5/434: symlink d5/d16/d33/d1b/d59/l8d 0 2024-09-13T21:44:55.513 INFO:tasks.workunit.client.0.smithi119.stdout:3/859: mkdir d6/d25/d2f/d8e/de2/d11b 0 2024-09-13T21:44:55.515 INFO:tasks.workunit.client.0.smithi119.stdout:4/861: mknod d4/d1e/d28/d34/d6a/c119 0 2024-09-13T21:44:55.516 INFO:tasks.workunit.client.0.smithi119.stdout:2/788: dwrite d1/d22/d5a/f81 [0,4194304] 0 2024-09-13T21:44:55.516 INFO:tasks.workunit.client.1.smithi155.stdout:1/474: dwrite d6/d15/f58 [0,4194304] 0 2024-09-13T21:44:55.518 INFO:tasks.workunit.client.1.smithi155.stdout:6/543: dread db/d11/d4c/d64/d88/f98 [0,4194304] 0 2024-09-13T21:44:55.520 INFO:tasks.workunit.client.1.smithi155.stdout:0/503: readlink d1/d6/dc/d4d/d4a/d9e/lb4 0 2024-09-13T21:44:55.521 INFO:tasks.workunit.client.0.smithi119.stdout:3/860: mknod d6/d25/d2f/d33/d56/dab/c11c 0 2024-09-13T21:44:55.521 INFO:tasks.workunit.client.1.smithi155.stdout:3/514: write d3/d10/f46 [300073,10070] 0 2024-09-13T21:44:55.523 INFO:tasks.workunit.client.0.smithi119.stdout:4/862: creat d4/d1e/d28/d34/d6a/f11a x:0 0 0 2024-09-13T21:44:55.524 INFO:tasks.workunit.client.1.smithi155.stdout:0/504: chown d1/d6/dc/d90/f92 9215541 1 2024-09-13T21:44:55.525 INFO:tasks.workunit.client.0.smithi119.stdout:2/789: rmdir d1/d9d/dd5 0 2024-09-13T21:44:55.525 INFO:tasks.workunit.client.1.smithi155.stdout:7/464: fsync d5/d10/d3e/d3f/f66 0 2024-09-13T21:44:55.528 INFO:tasks.workunit.client.1.smithi155.stdout:2/414: creat d2/f92 x:0 0 0 2024-09-13T21:44:55.528 INFO:tasks.workunit.client.1.smithi155.stdout:5/435: creat d5/d16/d33/d1b/d2f/d3c/d6c/f8e x:0 0 0 2024-09-13T21:44:55.529 INFO:tasks.workunit.client.1.smithi155.stdout:1/475: symlink d6/d15/d57/d5d/d72/la2 0 2024-09-13T21:44:55.533 INFO:tasks.workunit.client.1.smithi155.stdout:9/545: rename dc/d18/d1e/l6a to dc/d19/lbe 0 2024-09-13T21:44:55.534 INFO:tasks.workunit.client.0.smithi119.stdout:8/867: sync 2024-09-13T21:44:55.535 INFO:tasks.workunit.client.0.smithi119.stdout:4/863: mkdir d4/d114/de9/df8/d11b 0 2024-09-13T21:44:55.539 INFO:tasks.workunit.client.0.smithi119.stdout:2/790: rename d1/d7/f2a to d1/d38/d89/d6b/d8c/ff9 0 2024-09-13T21:44:55.539 INFO:tasks.workunit.client.1.smithi155.stdout:8/416: getdents d2/d6/dd/d25 0 2024-09-13T21:44:55.539 INFO:tasks.workunit.client.1.smithi155.stdout:0/505: symlink d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/lbf 0 2024-09-13T21:44:55.540 INFO:tasks.workunit.client.1.smithi155.stdout:6/544: rename db/d11/f14 to db/d11/d4c/d64/d5e/fae 0 2024-09-13T21:44:55.541 INFO:tasks.workunit.client.0.smithi119.stdout:2/791: chown d1/d7/l2f 393736 1 2024-09-13T21:44:55.541 INFO:tasks.workunit.client.0.smithi119.stdout:2/792: chown d1/d97 33 1 2024-09-13T21:44:55.542 INFO:tasks.workunit.client.0.smithi119.stdout:4/864: link d4/d114/de9/df8/f97 d4/d1e/d28/d34/d99/df0/f11c 0 2024-09-13T21:44:55.544 INFO:tasks.workunit.client.0.smithi119.stdout:2/793: write d1/d22/d5a/f81 [3535115,50393] 0 2024-09-13T21:44:55.544 INFO:tasks.workunit.client.1.smithi155.stdout:0/506: dread - d1/d6/dc/f84 zero size 2024-09-13T21:44:55.546 INFO:tasks.workunit.client.0.smithi119.stdout:4/865: unlink d4/d1e/ce7 0 2024-09-13T21:44:55.548 INFO:tasks.workunit.client.1.smithi155.stdout:1/476: dwrite d6/d82/f94 [0,4194304] 0 2024-09-13T21:44:55.549 INFO:tasks.workunit.client.1.smithi155.stdout:9/546: link dc/d18/c3f dc/de/d2d/cbf 0 2024-09-13T21:44:55.550 INFO:tasks.workunit.client.0.smithi119.stdout:2/794: dwrite d1/d22/d5a/d5d/d83/dce/fe7 [0,4194304] 0 2024-09-13T21:44:55.551 INFO:tasks.workunit.client.1.smithi155.stdout:8/417: getdents d2/d6 0 2024-09-13T21:44:55.551 INFO:tasks.workunit.client.1.smithi155.stdout:5/436: dwrite d5/d16/f2a [0,4194304] 0 2024-09-13T21:44:55.552 INFO:tasks.workunit.client.1.smithi155.stdout:4/421: dread d1/d7/de/d72/f34 [0,4194304] 0 2024-09-13T21:44:55.552 INFO:tasks.workunit.client.1.smithi155.stdout:0/507: mknod d1/d6/cc0 0 2024-09-13T21:44:55.553 INFO:tasks.workunit.client.0.smithi119.stdout:2/795: rename d1/d7/d47/cad to d1/d7/d47/df3/cfa 0 2024-09-13T21:44:55.556 INFO:tasks.workunit.client.0.smithi119.stdout:2/796: symlink d1/d97/lfb 0 2024-09-13T21:44:55.556 INFO:tasks.workunit.client.1.smithi155.stdout:1/477: write d6/d15/d57/d5d/d72/d74/f9f [891781,19375] 0 2024-09-13T21:44:55.558 INFO:tasks.workunit.client.0.smithi119.stdout:2/797: symlink d1/d38/d89/lfc 0 2024-09-13T21:44:55.559 INFO:tasks.workunit.client.0.smithi119.stdout:2/798: write d1/f3d [1723364,36736] 0 2024-09-13T21:44:55.562 INFO:tasks.workunit.client.0.smithi119.stdout:2/799: creat d1/d97/ffd x:0 0 0 2024-09-13T21:44:55.564 INFO:tasks.workunit.client.1.smithi155.stdout:9/547: dread dc/d19/d23/d38/d90/f7b [0,4194304] 0 2024-09-13T21:44:55.566 INFO:tasks.workunit.client.0.smithi119.stdout:2/800: mkdir d1/d22/d7c/dfe 0 2024-09-13T21:44:55.566 INFO:tasks.workunit.client.0.smithi119.stdout:8/868: write d1b/d4e/d6a/f9f [3252293,120042] 0 2024-09-13T21:44:55.567 INFO:tasks.workunit.client.1.smithi155.stdout:8/418: dwrite d2/d6/dd/d12/f66 [0,4194304] 0 2024-09-13T21:44:55.567 INFO:tasks.workunit.client.0.smithi119.stdout:8/869: dread - d1b/d1d/dc3/de1/feb zero size 2024-09-13T21:44:55.568 INFO:tasks.workunit.client.1.smithi155.stdout:1/478: dread d6/d82/d90/f6c [0,4194304] 0 2024-09-13T21:44:55.568 INFO:tasks.workunit.client.1.smithi155.stdout:8/419: dread - d2/d2d/f59 zero size 2024-09-13T21:44:55.569 INFO:tasks.workunit.client.0.smithi119.stdout:8/870: mkdir d1b/d4e/d71/dac/d109 0 2024-09-13T21:44:55.570 INFO:tasks.workunit.client.1.smithi155.stdout:8/420: read d2/d8/f4f [2253249,28160] 0 2024-09-13T21:44:55.570 INFO:tasks.workunit.client.0.smithi119.stdout:8/871: chown d1b/d1d/d48/f78 24 1 2024-09-13T21:44:55.571 INFO:tasks.workunit.client.1.smithi155.stdout:1/479: write d6/d15/d57/d5d/f9c [105282,18706] 0 2024-09-13T21:44:55.571 INFO:tasks.workunit.client.0.smithi119.stdout:8/872: write d1b/d1d/d48/db2/fef [937509,124349] 0 2024-09-13T21:44:55.573 INFO:tasks.workunit.client.0.smithi119.stdout:8/873: symlink d1b/d1d/dc3/de1/l10a 0 2024-09-13T21:44:55.574 INFO:tasks.workunit.client.1.smithi155.stdout:3/515: write d3/d25/d1b/f38 [3359093,32456] 0 2024-09-13T21:44:55.576 INFO:tasks.workunit.client.1.smithi155.stdout:3/516: write d3/d25/d1b/d1f/d36/d7c/f9f [9002,115586] 0 2024-09-13T21:44:55.576 INFO:tasks.workunit.client.1.smithi155.stdout:4/422: chown d1/d7/de/dc/d4a/c52 2 1 2024-09-13T21:44:55.578 INFO:tasks.workunit.client.1.smithi155.stdout:4/423: chown d1/f3b 388651067 1 2024-09-13T21:44:55.583 INFO:tasks.workunit.client.1.smithi155.stdout:2/415: truncate d2/fc 2798257 0 2024-09-13T21:44:55.584 INFO:tasks.workunit.client.1.smithi155.stdout:2/416: stat d2/dd/f24 0 2024-09-13T21:44:55.585 INFO:tasks.workunit.client.1.smithi155.stdout:5/437: fdatasync d5/d16/f2a 0 2024-09-13T21:44:55.586 INFO:tasks.workunit.client.1.smithi155.stdout:5/438: readlink d5/d16/d33/d1b/d59/l8d 0 2024-09-13T21:44:55.587 INFO:tasks.workunit.client.1.smithi155.stdout:9/548: chown dc/d18/d50/c5f 132369319 1 2024-09-13T21:44:55.587 INFO:tasks.workunit.client.1.smithi155.stdout:6/545: getdents db/d11/d4c/d64/d5e/d93 0 2024-09-13T21:44:55.588 INFO:tasks.workunit.client.1.smithi155.stdout:1/480: mknod d6/d7/ca3 0 2024-09-13T21:44:55.589 INFO:tasks.workunit.client.1.smithi155.stdout:9/549: chown dc/de/f10 0 1 2024-09-13T21:44:55.589 INFO:tasks.workunit.client.1.smithi155.stdout:6/546: stat db/d11/d4c/f6c 0 2024-09-13T21:44:55.590 INFO:tasks.workunit.client.0.smithi119.stdout:2/801: write d1/d7/f9 [1751633,103080] 0 2024-09-13T21:44:55.591 INFO:tasks.workunit.client.0.smithi119.stdout:2/802: fsync d1/d7/fdb 0 2024-09-13T21:44:55.592 INFO:tasks.workunit.client.1.smithi155.stdout:6/547: write db/d11/d4c/d64/d88/f98 [1486003,31746] 0 2024-09-13T21:44:55.592 INFO:tasks.workunit.client.1.smithi155.stdout:3/517: rename d3/d25/d1b/d1f/d82/da8 to d3/d25/d1b/d1f/d36/d5c/d66/db3 0 2024-09-13T21:44:55.594 INFO:tasks.workunit.client.1.smithi155.stdout:0/508: creat d1/fc1 x:0 0 0 2024-09-13T21:44:55.594 INFO:tasks.workunit.client.0.smithi119.stdout:2/803: unlink d1/d22/d5a/d5d/d77/daa/ce9 0 2024-09-13T21:44:55.595 INFO:tasks.workunit.client.1.smithi155.stdout:2/417: mknod d2/db/d6b/c93 0 2024-09-13T21:44:55.595 INFO:tasks.workunit.client.0.smithi119.stdout:4/866: dread d4/d1e/d28/d34/f3e [0,4194304] 0 2024-09-13T21:44:55.596 INFO:tasks.workunit.client.0.smithi119.stdout:2/804: mkdir d1/d9d/dff 0 2024-09-13T21:44:55.596 INFO:tasks.workunit.client.1.smithi155.stdout:7/465: mknod d5/df/c96 0 2024-09-13T21:44:55.597 INFO:tasks.workunit.client.1.smithi155.stdout:2/418: read d2/dd/de/d15/d2e/f3e [1007519,59342] 0 2024-09-13T21:44:55.599 INFO:tasks.workunit.client.0.smithi119.stdout:2/805: chown d1/d22/d55/d31/l7a 1 1 2024-09-13T21:44:55.600 INFO:tasks.workunit.client.1.smithi155.stdout:1/481: creat d6/d82/d91/fa4 x:0 0 0 2024-09-13T21:44:55.601 INFO:tasks.workunit.client.0.smithi119.stdout:2/806: symlink d1/d22/db6/l100 0 2024-09-13T21:44:55.602 INFO:tasks.workunit.client.1.smithi155.stdout:3/518: unlink d3/d25/d17/f3d 0 2024-09-13T21:44:55.602 INFO:tasks.workunit.client.0.smithi119.stdout:8/874: dread d1b/f1f [0,4194304] 0 2024-09-13T21:44:55.603 INFO:tasks.workunit.client.1.smithi155.stdout:3/519: chown d3/d25/d17/d52 286275 1 2024-09-13T21:44:55.604 INFO:tasks.workunit.client.1.smithi155.stdout:3/520: chown d3/d25/d17/f5b 559660457 1 2024-09-13T21:44:55.604 INFO:tasks.workunit.client.0.smithi119.stdout:2/807: unlink d1/d38/f69 0 2024-09-13T21:44:55.606 INFO:tasks.workunit.client.1.smithi155.stdout:3/521: fsync d3/d25/d1b/d1f/d82/d83/f9b 0 2024-09-13T21:44:55.606 INFO:tasks.workunit.client.1.smithi155.stdout:2/419: mkdir d2/dd/d37/d94 0 2024-09-13T21:44:55.606 INFO:tasks.workunit.client.0.smithi119.stdout:2/808: write d1/f3d [4180529,7079] 0 2024-09-13T21:44:55.607 INFO:tasks.workunit.client.1.smithi155.stdout:2/420: chown d2/dd/f65 9980 1 2024-09-13T21:44:55.608 INFO:tasks.workunit.client.0.smithi119.stdout:4/867: dwrite d4/d1e/d28/d34/fbc [0,4194304] 0 2024-09-13T21:44:55.609 INFO:tasks.workunit.client.0.smithi119.stdout:8/875: dread d1b/d1d/ff2 [0,4194304] 0 2024-09-13T21:44:55.609 INFO:tasks.workunit.client.1.smithi155.stdout:3/522: write d3/d25/fb [7988767,128028] 0 2024-09-13T21:44:55.609 INFO:tasks.workunit.client.1.smithi155.stdout:9/550: mknod dc/de/cc0 0 2024-09-13T21:44:55.609 INFO:tasks.workunit.client.1.smithi155.stdout:2/421: fsync d2/dd/de/d15/d2e/d66/f7b 0 2024-09-13T21:44:55.610 INFO:tasks.workunit.client.0.smithi119.stdout:4/868: chown d4/d1e/d10/fb9 3101 1 2024-09-13T21:44:55.610 INFO:tasks.workunit.client.0.smithi119.stdout:8/876: truncate d1b/d1d/ffb 407657 0 2024-09-13T21:44:55.611 INFO:tasks.workunit.client.0.smithi119.stdout:2/809: creat d1/d22/d5a/d5d/d77/daa/f101 x:0 0 0 2024-09-13T21:44:55.612 INFO:tasks.workunit.client.1.smithi155.stdout:5/439: write d5/d16/d33/d1b/d1e/f50 [32751,17797] 0 2024-09-13T21:44:55.612 INFO:tasks.workunit.client.0.smithi119.stdout:4/869: write d4/d1e/d26/d60/d71/fc6 [1790652,26591] 0 2024-09-13T21:44:55.613 INFO:tasks.workunit.client.1.smithi155.stdout:8/421: truncate d2/d6/dd/d12/f21 222134 0 2024-09-13T21:44:55.616 INFO:tasks.workunit.client.1.smithi155.stdout:7/466: mkdir d5/df/d15/d33/d55/d97 0 2024-09-13T21:44:55.617 INFO:tasks.workunit.client.1.smithi155.stdout:6/548: dread db/d2c/d9d/f1a [0,4194304] 0 2024-09-13T21:44:55.618 INFO:tasks.workunit.client.0.smithi119.stdout:2/810: fdatasync d1/d22/f5f 0 2024-09-13T21:44:55.618 INFO:tasks.workunit.client.0.smithi119.stdout:4/870: mkdir d4/d1e/d28/d34/d6a/d79/d9f/d11d 0 2024-09-13T21:44:55.620 INFO:tasks.workunit.client.0.smithi119.stdout:2/811: fdatasync d1/d22/d5a/d5d/d77/f96 0 2024-09-13T21:44:55.621 INFO:tasks.workunit.client.1.smithi155.stdout:4/424: getdents d1/d7/d5a 0 2024-09-13T21:44:55.621 INFO:tasks.workunit.client.0.smithi119.stdout:8/877: dwrite d1b/d1d/ff2 [0,4194304] 0 2024-09-13T21:44:55.622 INFO:tasks.workunit.client.1.smithi155.stdout:7/467: dread d5/df/d60/f63 [0,4194304] 0 2024-09-13T21:44:55.623 INFO:tasks.workunit.client.0.smithi119.stdout:8/878: write d1b/d1d/d48/d54/de0/fe6 [308907,92649] 0 2024-09-13T21:44:55.624 INFO:tasks.workunit.client.1.smithi155.stdout:4/425: truncate d1/d7/f6b 195711 0 2024-09-13T21:44:55.624 INFO:tasks.workunit.client.1.smithi155.stdout:9/551: mknod dc/d19/d23/d38/d90/d74/cc1 0 2024-09-13T21:44:55.626 INFO:tasks.workunit.client.1.smithi155.stdout:5/440: symlink d5/d16/d33/d1b/d2f/d3c/d44/l8f 0 2024-09-13T21:44:55.626 INFO:tasks.workunit.client.1.smithi155.stdout:5/441: chown d5/d16/d33/f6f 191 1 2024-09-13T21:44:55.627 INFO:tasks.workunit.client.0.smithi119.stdout:8/879: rename d1b/d1d/dc3/de1 to d1b/d1d/d26/df0/d10b 0 2024-09-13T21:44:55.628 INFO:tasks.workunit.client.0.smithi119.stdout:8/880: dread - d1b/d1d/d26/ff4 zero size 2024-09-13T21:44:55.631 INFO:tasks.workunit.client.0.smithi119.stdout:8/881: unlink d1b/d1d/d48/d54/c34 0 2024-09-13T21:44:55.631 INFO:tasks.workunit.client.0.smithi119.stdout:8/882: chown d1b/d1d/d39/f9c 252006 1 2024-09-13T21:44:55.632 INFO:tasks.workunit.client.0.smithi119.stdout:8/883: chown d1b/cbe 51 1 2024-09-13T21:44:55.634 INFO:tasks.workunit.client.1.smithi155.stdout:0/509: creat d1/fc2 x:0 0 0 2024-09-13T21:44:55.635 INFO:tasks.workunit.client.0.smithi119.stdout:8/884: read d1b/d4e/d71/f98 [169933,72248] 0 2024-09-13T21:44:55.636 INFO:tasks.workunit.client.1.smithi155.stdout:9/552: dwrite dc/d19/d23/d38/fb1 [0,4194304] 0 2024-09-13T21:44:55.636 INFO:tasks.workunit.client.1.smithi155.stdout:0/510: fdatasync d1/d6/dc/faa 0 2024-09-13T21:44:55.637 INFO:tasks.workunit.client.1.smithi155.stdout:8/422: mknod d2/d2d/c7e 0 2024-09-13T21:44:55.637 INFO:tasks.workunit.client.0.smithi119.stdout:8/885: write d1b/d1d/d48/fbf [4017628,56439] 0 2024-09-13T21:44:55.640 INFO:tasks.workunit.client.1.smithi155.stdout:6/549: write db/d2c/d9d/d1c/d36/d46/f8c [532620,84876] 0 2024-09-13T21:44:55.641 INFO:tasks.workunit.client.0.smithi119.stdout:2/812: dwrite d1/d7/d47/f57 [0,4194304] 0 2024-09-13T21:44:55.642 INFO:tasks.workunit.client.1.smithi155.stdout:7/468: mknod d5/df/d79/c98 0 2024-09-13T21:44:55.643 INFO:tasks.workunit.client.1.smithi155.stdout:7/469: chown d5/d10/d3e/d3f 54862265 1 2024-09-13T21:44:55.646 INFO:tasks.workunit.client.1.smithi155.stdout:7/470: truncate d5/d10/f6a 1093691 0 2024-09-13T21:44:55.647 INFO:tasks.workunit.client.0.smithi119.stdout:2/813: read d1/d22/d5a/f63 [3108547,125079] 0 2024-09-13T21:44:55.648 INFO:tasks.workunit.client.0.smithi119.stdout:1/785: sync 2024-09-13T21:44:55.648 INFO:tasks.workunit.client.0.smithi119.stdout:7/931: sync 2024-09-13T21:44:55.648 INFO:tasks.workunit.client.0.smithi119.stdout:5/885: sync 2024-09-13T21:44:55.648 INFO:tasks.workunit.client.0.smithi119.stdout:0/877: sync 2024-09-13T21:44:55.649 INFO:tasks.workunit.client.1.smithi155.stdout:7/471: truncate d5/df/d79/f92 183452 0 2024-09-13T21:44:55.649 INFO:tasks.workunit.client.1.smithi155.stdout:9/553: mknod dc/de/d2d/d79/d43/d83/cc2 0 2024-09-13T21:44:55.651 INFO:tasks.workunit.client.1.smithi155.stdout:4/426: dread d1/d7/de/d15/f71 [0,4194304] 0 2024-09-13T21:44:55.652 INFO:tasks.workunit.client.0.smithi119.stdout:5/886: readlink d0/l60 0 2024-09-13T21:44:55.653 INFO:tasks.workunit.client.1.smithi155.stdout:6/550: symlink db/d3d/d5f/laf 0 2024-09-13T21:44:55.654 INFO:tasks.workunit.client.1.smithi155.stdout:3/523: creat d3/d21/d4a/fb4 x:0 0 0 2024-09-13T21:44:55.655 INFO:tasks.workunit.client.1.smithi155.stdout:5/442: mknod d5/d16/d33/d1b/d2f/d3c/d44/d80/c90 0 2024-09-13T21:44:55.656 INFO:tasks.workunit.client.0.smithi119.stdout:5/887: chown d0/d3/d4/def/d10f/l10c 366558115 1 2024-09-13T21:44:55.657 INFO:tasks.workunit.client.0.smithi119.stdout:8/886: dread d1b/d1d/d48/d58/f95 [0,4194304] 0 2024-09-13T21:44:55.658 INFO:tasks.workunit.client.1.smithi155.stdout:9/554: creat dc/d19/d21/fc3 x:0 0 0 2024-09-13T21:44:55.658 INFO:tasks.workunit.client.0.smithi119.stdout:0/878: symlink de/d1c/d2f/d35/d4a/dac/l12a 0 2024-09-13T21:44:55.658 INFO:tasks.workunit.client.1.smithi155.stdout:6/551: mkdir db/d11/d4c/d7c/db0 0 2024-09-13T21:44:55.659 INFO:tasks.workunit.client.0.smithi119.stdout:2/814: dwrite d1/d38/d89/d6b/d8c/fd6 [0,4194304] 0 2024-09-13T21:44:55.659 INFO:tasks.workunit.client.1.smithi155.stdout:9/555: write dc/d19/d21/f6b [213133,90673] 0 2024-09-13T21:44:55.661 INFO:tasks.workunit.client.1.smithi155.stdout:2/422: rename d2/db/c12 to d2/dd/de/d15/d38/d41/d5f/c95 0 2024-09-13T21:44:55.661 INFO:tasks.workunit.client.0.smithi119.stdout:2/815: readlink d1/d22/l6d 0 2024-09-13T21:44:55.661 INFO:tasks.workunit.client.1.smithi155.stdout:2/423: fsync d2/dd/f65 0 2024-09-13T21:44:55.662 INFO:tasks.workunit.client.1.smithi155.stdout:5/443: symlink d5/d16/d33/l91 0 2024-09-13T21:44:55.662 INFO:tasks.workunit.client.0.smithi119.stdout:1/786: dwrite d1/d3/d61/da9/fc0 [0,4194304] 0 2024-09-13T21:44:55.666 INFO:tasks.workunit.client.1.smithi155.stdout:6/552: write db/d11/d2b/d35/f25 [1823480,7699] 0 2024-09-13T21:44:55.667 INFO:tasks.workunit.client.1.smithi155.stdout:4/427: link d1/d7/d21/d2d/c77 d1/d7/de/dc/d4a/c82 0 2024-09-13T21:44:55.668 INFO:tasks.workunit.client.0.smithi119.stdout:8/887: rename d1b/d1d/d48/db2/fef to d1b/d1d/df8/f10c 0 2024-09-13T21:44:55.668 INFO:tasks.workunit.client.1.smithi155.stdout:2/424: mkdir d2/dd/de/d15/d2e/d96 0 2024-09-13T21:44:55.669 INFO:tasks.workunit.client.1.smithi155.stdout:5/444: mkdir d5/d16/d33/d1b/d92 0 2024-09-13T21:44:55.669 INFO:tasks.workunit.client.0.smithi119.stdout:0/879: fsync de/d1c/d2f/d35/f111 0 2024-09-13T21:44:55.670 INFO:tasks.workunit.client.1.smithi155.stdout:6/553: read - db/d11/d6d/f6f zero size 2024-09-13T21:44:55.670 INFO:tasks.workunit.client.1.smithi155.stdout:9/556: dwrite dc/d19/d21/fb4 [0,4194304] 0 2024-09-13T21:44:55.672 INFO:tasks.workunit.client.0.smithi119.stdout:1/787: fsync d1/d3/f2a 0 2024-09-13T21:44:55.672 INFO:tasks.workunit.client.0.smithi119.stdout:2/816: dread d1/d22/d5a/d5d/f8e [0,4194304] 0 2024-09-13T21:44:55.673 INFO:tasks.workunit.client.0.smithi119.stdout:0/880: symlink de/d1c/d2f/d40/d66/dcb/dd6/l12b 0 2024-09-13T21:44:55.674 INFO:tasks.workunit.client.0.smithi119.stdout:8/888: truncate d1b/d1d/d48/f78 3411400 0 2024-09-13T21:44:55.677 INFO:tasks.workunit.client.0.smithi119.stdout:0/881: mkdir de/d1c/d52/d12c 0 2024-09-13T21:44:55.679 INFO:tasks.workunit.client.1.smithi155.stdout:2/425: mkdir d2/dd/de/d15/d3f/d97 0 2024-09-13T21:44:55.681 INFO:tasks.workunit.client.0.smithi119.stdout:0/882: unlink de/f61 0 2024-09-13T21:44:55.682 INFO:tasks.workunit.client.0.smithi119.stdout:8/889: getdents d1b/d1d/d48/d58/d7f 0 2024-09-13T21:44:55.685 INFO:tasks.workunit.client.1.smithi155.stdout:4/428: dwrite d1/d48/f63 [0,4194304] 0 2024-09-13T21:44:55.685 INFO:tasks.workunit.client.0.smithi119.stdout:5/888: dread d0/d3/d4/d9/d14/ff3 [0,4194304] 0 2024-09-13T21:44:55.685 INFO:tasks.workunit.client.1.smithi155.stdout:2/426: chown d2/dd/d21/l43 68985 1 2024-09-13T21:44:55.687 INFO:tasks.workunit.client.1.smithi155.stdout:5/445: mknod d5/c93 0 2024-09-13T21:44:55.687 INFO:tasks.workunit.client.0.smithi119.stdout:8/890: unlink d1b/d4e/f53 0 2024-09-13T21:44:55.690 INFO:tasks.workunit.client.0.smithi119.stdout:7/932: dread d8/d3c/d53/d3b/d48/f79 [0,4194304] 0 2024-09-13T21:44:55.690 INFO:tasks.workunit.client.1.smithi155.stdout:4/429: dread d1/d7/f6b [0,4194304] 0 2024-09-13T21:44:55.692 INFO:tasks.workunit.client.1.smithi155.stdout:0/511: truncate d1/d6/dc/d4d/d4a/f8d 563060 0 2024-09-13T21:44:55.693 INFO:tasks.workunit.client.0.smithi119.stdout:5/889: mknod d0/d3/d4/d9/d1e/da5/d121/c124 0 2024-09-13T21:44:55.694 INFO:tasks.workunit.client.0.smithi119.stdout:7/933: creat d8/d3c/d53/d37/d83/f13a x:0 0 0 2024-09-13T21:44:55.695 INFO:tasks.workunit.client.1.smithi155.stdout:9/557: dwrite dc/de/d2d/d79/f63 [0,4194304] 0 2024-09-13T21:44:55.695 INFO:tasks.workunit.client.1.smithi155.stdout:7/472: dread d5/f30 [0,4194304] 0 2024-09-13T21:44:55.695 INFO:tasks.workunit.client.0.smithi119.stdout:0/883: getdents de/d1c/d2f/d40 0 2024-09-13T21:44:55.696 INFO:tasks.workunit.client.0.smithi119.stdout:5/890: readlink d0/d3/d4/def/d10f/l10c 0 2024-09-13T21:44:55.701 INFO:tasks.workunit.client.1.smithi155.stdout:4/430: mkdir d1/d7/d83 0 2024-09-13T21:44:55.701 INFO:tasks.workunit.client.1.smithi155.stdout:9/558: write dc/de/d15/f24 [4206666,268] 0 2024-09-13T21:44:55.701 INFO:tasks.workunit.client.0.smithi119.stdout:5/891: stat d0/d3/lde 0 2024-09-13T21:44:55.701 INFO:tasks.workunit.client.0.smithi119.stdout:8/891: dread fd [0,4194304] 0 2024-09-13T21:44:55.701 INFO:tasks.workunit.client.0.smithi119.stdout:7/934: creat d8/d3c/d46/db1/dc8/f13b x:0 0 0 2024-09-13T21:44:55.702 INFO:tasks.workunit.client.1.smithi155.stdout:2/427: dread d2/dd/de/d15/f46 [0,4194304] 0 2024-09-13T21:44:55.702 INFO:tasks.workunit.client.1.smithi155.stdout:0/512: creat d1/d6/dc/d4d/d4a/d4e/fc3 x:0 0 0 2024-09-13T21:44:55.703 INFO:tasks.workunit.client.1.smithi155.stdout:5/446: symlink d5/d16/d81/l94 0 2024-09-13T21:44:55.703 INFO:tasks.workunit.client.0.smithi119.stdout:0/884: truncate de/d1c/d2b/f2c 4679230 0 2024-09-13T21:44:55.703 INFO:tasks.workunit.client.1.smithi155.stdout:8/423: dwrite d2/d6/f27 [0,4194304] 0 2024-09-13T21:44:55.704 INFO:tasks.workunit.client.1.smithi155.stdout:6/554: getdents db/d2c/d9d/d1c 0 2024-09-13T21:44:55.706 INFO:tasks.workunit.client.0.smithi119.stdout:8/892: mkdir d1b/d1d/d48/db2/d10d 0 2024-09-13T21:44:55.708 INFO:tasks.workunit.client.0.smithi119.stdout:1/788: dwrite d1/d3/f4 [0,4194304] 0 2024-09-13T21:44:55.709 INFO:tasks.workunit.client.0.smithi119.stdout:5/892: read d0/d3/d1f/d21/da1/f4d [2663871,13816] 0 2024-09-13T21:44:55.711 INFO:tasks.workunit.client.1.smithi155.stdout:9/559: write dc/d19/d23/d38/fb5 [611948,128330] 0 2024-09-13T21:44:55.712 INFO:tasks.workunit.client.0.smithi119.stdout:7/935: rename d8/d3c/d53/caa to d8/d3c/d46/db1/dc8/d102/c13c 0 2024-09-13T21:44:55.714 INFO:tasks.workunit.client.0.smithi119.stdout:5/893: mkdir d0/d3/d4/d9/d1e/da5/d121/d125 0 2024-09-13T21:44:55.715 INFO:tasks.workunit.client.0.smithi119.stdout:7/936: symlink d8/d4d/da2/l13d 0 2024-09-13T21:44:55.716 INFO:tasks.workunit.client.1.smithi155.stdout:3/524: dread d3/d21/f53 [0,4194304] 0 2024-09-13T21:44:55.717 INFO:tasks.workunit.client.1.smithi155.stdout:7/473: dwrite d5/df/d15/f53 [0,4194304] 0 2024-09-13T21:44:55.718 INFO:tasks.workunit.client.0.smithi119.stdout:1/789: creat d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/dd8/d8c/f105 x:0 0 0 2024-09-13T21:44:55.719 INFO:tasks.workunit.client.0.smithi119.stdout:8/893: dwrite d1b/d1d/d39/fe5 [0,4194304] 0 2024-09-13T21:44:55.719 INFO:tasks.workunit.client.0.smithi119.stdout:7/937: unlink d8/d113/fd9 0 2024-09-13T21:44:55.721 INFO:tasks.workunit.client.1.smithi155.stdout:5/447: write d5/d16/d33/d1b/d59/f8a [503126,50834] 0 2024-09-13T21:44:55.721 INFO:tasks.workunit.client.1.smithi155.stdout:6/555: creat db/d2c/d9d/d1c/d36/d37/fb1 x:0 0 0 2024-09-13T21:44:55.723 INFO:tasks.workunit.client.1.smithi155.stdout:8/424: symlink d2/d6/dd/l7f 0 2024-09-13T21:44:55.726 INFO:tasks.workunit.client.0.smithi119.stdout:1/790: creat d1/d3/d61/d77/d78/d32/dda/d3d/f106 x:0 0 0 2024-09-13T21:44:55.728 INFO:tasks.workunit.client.0.smithi119.stdout:1/791: readlink d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/lc4 0 2024-09-13T21:44:55.728 INFO:tasks.workunit.client.1.smithi155.stdout:4/431: dread d1/d7/de/d15/d55/d5e/d66/f6c [0,4194304] 0 2024-09-13T21:44:55.728 INFO:tasks.workunit.client.1.smithi155.stdout:2/428: dwrite d2/dd/de/d15/d2e/d66/f78 [0,4194304] 0 2024-09-13T21:44:55.729 INFO:tasks.workunit.client.0.smithi119.stdout:7/938: mkdir d8/d3c/d53/d37/d83/d89/de7/d13e 0 2024-09-13T21:44:55.730 INFO:tasks.workunit.client.0.smithi119.stdout:5/894: getdents d0/d3/d4/def/d11b 0 2024-09-13T21:44:55.731 INFO:tasks.workunit.client.1.smithi155.stdout:3/525: write d3/d25/d17/fab [518297,164] 0 2024-09-13T21:44:55.733 INFO:tasks.workunit.client.0.smithi119.stdout:7/939: symlink d8/d4d/da2/dac/l13f 0 2024-09-13T21:44:55.733 INFO:tasks.workunit.client.0.smithi119.stdout:5/895: dread - d0/d3/d1f/d21/d4f/f107 zero size 2024-09-13T21:44:55.735 INFO:tasks.workunit.client.1.smithi155.stdout:6/556: chown db/d2c/d9d/c1d 101546982 1 2024-09-13T21:44:55.735 INFO:tasks.workunit.client.0.smithi119.stdout:1/792: dread d1/d3/d61/d7e/d53/f83 [0,4194304] 0 2024-09-13T21:44:55.737 INFO:tasks.workunit.client.1.smithi155.stdout:9/560: symlink dc/de/d5c/lc4 0 2024-09-13T21:44:55.737 INFO:tasks.workunit.client.0.smithi119.stdout:5/896: mknod d0/d3/d1f/d21/da1/dfb/de1/c126 0 2024-09-13T21:44:55.739 INFO:tasks.workunit.client.0.smithi119.stdout:7/940: fdatasync d8/d3c/d53/d3b/d48/f116 0 2024-09-13T21:44:55.740 INFO:tasks.workunit.client.1.smithi155.stdout:7/474: rmdir d5/df/d15/d33/d43 39 2024-09-13T21:44:55.741 INFO:tasks.workunit.client.0.smithi119.stdout:7/941: dread - d8/d3c/d53/d37/d83/d89/dc3/d10e/f11b zero size 2024-09-13T21:44:55.741 INFO:tasks.workunit.client.0.smithi119.stdout:1/793: creat d1/d3/d61/d77/d78/d32/dda/d3d/dd3/f107 x:0 0 0 2024-09-13T21:44:55.742 INFO:tasks.workunit.client.1.smithi155.stdout:4/432: creat d1/d7/de/d15/d55/f84 x:0 0 0 2024-09-13T21:44:55.742 INFO:tasks.workunit.client.1.smithi155.stdout:3/526: creat d3/d25/d1b/d90/fb5 x:0 0 0 2024-09-13T21:44:55.744 INFO:tasks.workunit.client.1.smithi155.stdout:5/448: dwrite d5/d16/d4e/f58 [0,4194304] 0 2024-09-13T21:44:55.744 INFO:tasks.workunit.client.1.smithi155.stdout:9/561: creat dc/de/d6f/d71/fc5 x:0 0 0 2024-09-13T21:44:55.745 INFO:tasks.workunit.client.0.smithi119.stdout:0/885: dread de/d1c/d52/f7a [0,4194304] 0 2024-09-13T21:44:55.746 INFO:tasks.workunit.client.0.smithi119.stdout:1/794: fsync d1/d3/d61/d77/d78/d32/dda/d28/f3f 0 2024-09-13T21:44:55.746 INFO:tasks.workunit.client.0.smithi119.stdout:7/942: creat d8/d3c/d53/d37/f140 x:0 0 0 2024-09-13T21:44:55.747 INFO:tasks.workunit.client.1.smithi155.stdout:6/557: creat db/d2c/d9d/d1c/d36/fb2 x:0 0 0 2024-09-13T21:44:55.747 INFO:tasks.workunit.client.1.smithi155.stdout:4/433: write d1/d7/de/f1f [1614347,68378] 0 2024-09-13T21:44:55.748 INFO:tasks.workunit.client.0.smithi119.stdout:5/897: dwrite d0/d3/d4/d9/d14/d24/f104 [0,4194304] 0 2024-09-13T21:44:55.748 INFO:tasks.workunit.client.1.smithi155.stdout:8/425: dwrite d2/d2d/f71 [0,4194304] 0 2024-09-13T21:44:55.750 INFO:tasks.workunit.client.0.smithi119.stdout:0/886: mknod de/d1c/d2f/d35/dce/def/c12d 0 2024-09-13T21:44:55.751 INFO:tasks.workunit.client.0.smithi119.stdout:1/795: dread - d1/d3/d61/fb5 zero size 2024-09-13T21:44:55.751 INFO:tasks.workunit.client.1.smithi155.stdout:9/562: stat dc/de/d2d/d79/d43/lb3 0 2024-09-13T21:44:55.752 INFO:tasks.workunit.client.1.smithi155.stdout:4/434: unlink d1/d7/de/d15/f4b 0 2024-09-13T21:44:55.753 INFO:tasks.workunit.client.0.smithi119.stdout:7/943: rename d8/d3c/d53/d37/d83/d89/d47 to d8/d113/d141 0 2024-09-13T21:44:55.754 INFO:tasks.workunit.client.1.smithi155.stdout:4/435: readlink d1/l49 0 2024-09-13T21:44:55.758 INFO:tasks.workunit.client.0.smithi119.stdout:7/944: unlink d8/d3c/d53/d37/d57/d5f/l99 0 2024-09-13T21:44:55.763 INFO:tasks.workunit.client.0.smithi119.stdout:7/945: creat d8/d3c/d53/d37/d83/f142 x:0 0 0 2024-09-13T21:44:55.765 INFO:tasks.workunit.client.0.smithi119.stdout:7/946: unlink d8/f9c 0 2024-09-13T21:44:55.769 INFO:tasks.workunit.client.0.smithi119.stdout:8/894: write d1b/f46 [2533321,84393] 0 2024-09-13T21:44:55.769 INFO:tasks.workunit.client.0.smithi119.stdout:1/796: getdents d1/d3/d61/d77/d78/d32/dda/d3d 0 2024-09-13T21:44:55.772 INFO:tasks.workunit.client.0.smithi119.stdout:1/797: read d1/d3/d61/d77/da6/fac [3393814,52456] 0 2024-09-13T21:44:55.772 INFO:tasks.workunit.client.0.smithi119.stdout:7/947: dwrite d8/d19/f1a [0,4194304] 0 2024-09-13T21:44:55.774 INFO:tasks.workunit.client.0.smithi119.stdout:8/895: link d1b/d4e/d71/cd1 d1b/d4e/d71/dac/c10e 0 2024-09-13T21:44:55.778 INFO:tasks.workunit.client.0.smithi119.stdout:8/896: unlink d1b/d1d/d48/fbf 0 2024-09-13T21:44:55.780 INFO:tasks.workunit.client.0.smithi119.stdout:1/798: unlink d1/d3/d61/d77/d78/d32/d33/d43/l96 0 2024-09-13T21:44:55.784 INFO:tasks.workunit.client.0.smithi119.stdout:8/897: rename d1b/d1d/d39/fe5 to d1b/d1d/d39/f10f 0 2024-09-13T21:44:55.785 INFO:tasks.workunit.client.0.smithi119.stdout:7/948: rmdir d8/d3c/d53/d37/d83/d105 0 2024-09-13T21:44:55.789 INFO:tasks.workunit.client.0.smithi119.stdout:1/799: creat d1/d3/d61/d77/d78/d32/dda/d19/f108 x:0 0 0 2024-09-13T21:44:55.791 INFO:tasks.workunit.client.0.smithi119.stdout:8/898: creat d1b/d1d/d26/da4/f110 x:0 0 0 2024-09-13T21:44:55.792 INFO:tasks.workunit.client.0.smithi119.stdout:7/949: dwrite d8/d3c/d46/ffa [0,4194304] 0 2024-09-13T21:44:55.793 INFO:tasks.workunit.client.0.smithi119.stdout:7/950: dread - d8/d19/fee zero size 2024-09-13T21:44:55.797 INFO:tasks.workunit.client.0.smithi119.stdout:1/800: rename d1/d3/d61/d77/d78/c4f to d1/d3/d61/d7e/d53/ddf/c109 0 2024-09-13T21:44:55.801 INFO:tasks.workunit.client.0.smithi119.stdout:1/801: symlink d1/d3/d61/d7e/l10a 0 2024-09-13T21:44:55.803 INFO:tasks.workunit.client.0.smithi119.stdout:8/899: rename d1b/d1d/d48/d58 to d1b/d1d/d26/d111 0 2024-09-13T21:44:55.804 INFO:tasks.workunit.client.0.smithi119.stdout:8/900: chown d1b/d1d/d26/d111/f6d 1330 1 2024-09-13T21:44:55.804 INFO:tasks.workunit.client.0.smithi119.stdout:1/802: mknod d1/d3/d61/d77/d78/d32/dda/d3d/c10b 0 2024-09-13T21:44:55.806 INFO:tasks.workunit.client.0.smithi119.stdout:8/901: symlink d1b/d1d/dc3/l112 0 2024-09-13T21:44:55.806 INFO:tasks.workunit.client.0.smithi119.stdout:7/951: write d8/d3c/d53/f2b [1261219,126771] 0 2024-09-13T21:44:55.809 INFO:tasks.workunit.client.0.smithi119.stdout:7/952: mkdir d8/d3c/d53/d3b/d143 0 2024-09-13T21:44:55.809 INFO:tasks.workunit.client.0.smithi119.stdout:8/902: creat d1b/f113 x:0 0 0 2024-09-13T21:44:55.811 INFO:tasks.workunit.client.0.smithi119.stdout:8/903: fsync d1b/d1d/d26/d6b/f92 0 2024-09-13T21:44:55.814 INFO:tasks.workunit.client.0.smithi119.stdout:7/953: getdents d8/d3c/d53/d37/d83 0 2024-09-13T21:44:55.817 INFO:tasks.workunit.client.0.smithi119.stdout:8/904: rmdir d1b/d1d/d48/d54/de0/dfc 0 2024-09-13T21:44:55.818 INFO:tasks.workunit.client.0.smithi119.stdout:1/803: dread d1/d3/d61/d7e/d53/ddf/ff5 [0,4194304] 0 2024-09-13T21:44:55.818 INFO:tasks.workunit.client.0.smithi119.stdout:8/905: stat d1b/d1d/d26/d6b/fd0 0 2024-09-13T21:44:55.818 INFO:tasks.workunit.client.0.smithi119.stdout:7/954: mkdir d8/d3c/d53/d37/d57/d5f/d144 0 2024-09-13T21:44:55.819 INFO:tasks.workunit.client.0.smithi119.stdout:1/804: dread - d1/fd5 zero size 2024-09-13T21:44:55.820 INFO:tasks.workunit.client.0.smithi119.stdout:7/955: creat d8/d19/f145 x:0 0 0 2024-09-13T21:44:55.822 INFO:tasks.workunit.client.0.smithi119.stdout:7/956: mkdir d8/d3c/d53/d37/d146 0 2024-09-13T21:44:55.824 INFO:tasks.workunit.client.0.smithi119.stdout:1/805: symlink d1/d3/d61/d77/d78/d32/d33/d72/db4/dc9/df4/l10c 0 2024-09-13T21:44:55.824 INFO:tasks.workunit.client.0.smithi119.stdout:7/957: creat d8/d19/d2e/f147 x:0 0 0 2024-09-13T21:44:55.825 INFO:tasks.workunit.client.0.smithi119.stdout:1/806: chown d1/d3/d61/d77/d78/d32/d33/d43/d74 667737 1 2024-09-13T21:44:55.827 INFO:tasks.workunit.client.0.smithi119.stdout:7/958: creat d8/d3c/d53/d37/d83/d89/dc3/d10a/f148 x:0 0 0 2024-09-13T21:44:55.832 INFO:tasks.workunit.client.1.smithi155.stdout:7/475: dwrite d5/df/f6e [0,4194304] 0 2024-09-13T21:44:55.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:55 smithi155 ceph-mon[34732]: pgmap v12: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 92 MiB/s rd, 319 MiB/s wr, 606 op/s 2024-09-13T21:44:55.833 INFO:tasks.workunit.client.0.smithi119.stdout:7/959: getdents d8/d3c/d53/d37/d57/d8f/d101 0 2024-09-13T21:44:55.834 INFO:tasks.workunit.client.0.smithi119.stdout:8/906: dread f9 [0,4194304] 0 2024-09-13T21:44:55.836 INFO:tasks.workunit.client.0.smithi119.stdout:7/960: mknod d8/d3c/d53/d3b/d143/c149 0 2024-09-13T21:44:55.841 INFO:tasks.workunit.client.1.smithi155.stdout:9/563: dwrite dc/de/d15/f1c [0,4194304] 0 2024-09-13T21:44:55.842 INFO:tasks.workunit.client.0.smithi119.stdout:8/907: write d1b/d1d/d26/fbc [4260374,19027] 0 2024-09-13T21:44:55.842 INFO:tasks.workunit.client.0.smithi119.stdout:1/807: dread d1/d3/d61/d77/d78/d32/dda/d19/fb7 [0,4194304] 0 2024-09-13T21:44:55.843 INFO:tasks.workunit.client.0.smithi119.stdout:8/908: write d1b/d1d/ffb [1410487,36454] 0 2024-09-13T21:44:55.846 INFO:tasks.workunit.client.1.smithi155.stdout:5/449: truncate d5/d16/d33/d1b/f57 4164571 0 2024-09-13T21:44:55.848 INFO:tasks.workunit.client.1.smithi155.stdout:0/513: dwrite d1/d6/f5a [0,4194304] 0 2024-09-13T21:44:55.848 INFO:tasks.workunit.client.1.smithi155.stdout:3/527: rename d3/d21/d2c/c78 to d3/d25/d17/cb6 0 2024-09-13T21:44:55.850 INFO:tasks.workunit.client.1.smithi155.stdout:2/429: dread d2/db/f40 [0,4194304] 0 2024-09-13T21:44:55.850 INFO:tasks.workunit.client.1.smithi155.stdout:7/476: write d5/d10/d3e/f6b [1173585,87799] 0 2024-09-13T21:44:55.851 INFO:tasks.workunit.client.1.smithi155.stdout:9/564: rmdir dc/d19/d21/d67 39 2024-09-13T21:44:55.854 INFO:tasks.workunit.client.0.smithi119.stdout:1/808: link d1/d3/d61/d77/d78/db8/dde/df1/cfe d1/d3/d61/d77/d78/d32/dda/d19/c10d 0 2024-09-13T21:44:55.856 INFO:tasks.workunit.client.0.smithi119.stdout:8/909: write d1b/d1d/d26/d3e/f4c [4418458,42816] 0 2024-09-13T21:44:55.857 INFO:tasks.workunit.client.1.smithi155.stdout:4/436: dwrite d1/d7/de/dc/d4a/f56 [0,4194304] 0 2024-09-13T21:44:55.857 INFO:tasks.workunit.client.1.smithi155.stdout:5/450: mknod d5/d16/d81/c95 0 2024-09-13T21:44:55.858 INFO:tasks.workunit.client.1.smithi155.stdout:6/558: dwrite db/d11/d4c/d64/d5e/f68 [0,4194304] 0 2024-09-13T21:44:55.859 INFO:tasks.workunit.client.0.smithi119.stdout:8/910: symlink d1b/d1d/d26/d111/l114 0 2024-09-13T21:44:55.861 INFO:tasks.workunit.client.0.smithi119.stdout:8/911: mknod d1b/d1d/d26/c115 0 2024-09-13T21:44:55.861 INFO:tasks.workunit.client.1.smithi155.stdout:7/477: dread - d5/f50 zero size 2024-09-13T21:44:55.862 INFO:tasks.workunit.client.1.smithi155.stdout:0/514: creat d1/d6/dc/d4d/d4a/d9e/fc4 x:0 0 0 2024-09-13T21:44:55.862 INFO:tasks.workunit.client.0.smithi119.stdout:8/912: stat d1b/d1d/d26/df0 0 2024-09-13T21:44:55.865 INFO:tasks.workunit.client.1.smithi155.stdout:5/451: creat d5/d16/d33/d1b/d28/d52/f96 x:0 0 0 2024-09-13T21:44:55.867 INFO:tasks.workunit.client.0.smithi119.stdout:8/913: dread d1b/d1d/ffb [0,4194304] 0 2024-09-13T21:44:55.867 INFO:tasks.workunit.client.1.smithi155.stdout:2/430: fdatasync d2/fc 0 2024-09-13T21:44:55.869 INFO:tasks.workunit.client.1.smithi155.stdout:7/478: rmdir d5/df/d15 39 2024-09-13T21:44:55.871 INFO:tasks.workunit.client.1.smithi155.stdout:6/559: symlink db/d11/lb3 0 2024-09-13T21:44:55.872 INFO:tasks.workunit.client.1.smithi155.stdout:7/479: dread - d5/df/d60/f86 zero size 2024-09-13T21:44:55.872 INFO:tasks.workunit.client.1.smithi155.stdout:0/515: symlink d1/d6/d97/db2/db5/lc5 0 2024-09-13T21:44:55.876 INFO:tasks.workunit.client.0.smithi119.stdout:7/961: dread d8/d3c/d53/d37/d83/d89/f11 [0,4194304] 0 2024-09-13T21:44:55.877 INFO:tasks.workunit.client.1.smithi155.stdout:9/565: link dc/de/l27 dc/de/d2d/lc6 0 2024-09-13T21:44:55.879 INFO:tasks.workunit.client.0.smithi119.stdout:7/962: symlink d8/d3c/d53/d37/d83/d89/d3d/l14a 0 2024-09-13T21:44:55.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:55 smithi119 ceph-mon[27653]: pgmap v12: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 92 MiB/s rd, 319 MiB/s wr, 606 op/s 2024-09-13T21:44:55.881 INFO:tasks.workunit.client.1.smithi155.stdout:2/431: dwrite d2/dd/de/d15/d38/f4f [0,4194304] 0 2024-09-13T21:44:55.881 INFO:tasks.workunit.client.0.smithi119.stdout:7/963: rename d8/d4d/da2/lca to d8/d3c/d46/db1/dc8/l14b 0 2024-09-13T21:44:55.881 INFO:tasks.workunit.client.1.smithi155.stdout:7/480: mkdir d5/d13/d99 0 2024-09-13T21:44:55.882 INFO:tasks.workunit.client.0.smithi119.stdout:3/861: sync 2024-09-13T21:44:55.882 INFO:tasks.workunit.client.0.smithi119.stdout:6/754: sync 2024-09-13T21:44:55.882 INFO:tasks.workunit.client.1.smithi155.stdout:5/452: dwrite d5/d16/d33/d1f/f5a [0,4194304] 0 2024-09-13T21:44:55.882 INFO:tasks.workunit.client.1.smithi155.stdout:2/432: readlink d2/l54 0 2024-09-13T21:44:55.883 INFO:tasks.workunit.client.0.smithi119.stdout:3/862: stat d6/d15/f63 0 2024-09-13T21:44:55.884 INFO:tasks.workunit.client.0.smithi119.stdout:6/755: mkdir dc/df/d6d/de7 0 2024-09-13T21:44:55.886 INFO:tasks.workunit.client.1.smithi155.stdout:5/453: creat d5/d16/d4e/d85/f97 x:0 0 0 2024-09-13T21:44:55.886 INFO:tasks.workunit.client.1.smithi155.stdout:7/481: creat d5/d10/d3e/d3f/f9a x:0 0 0 2024-09-13T21:44:55.887 INFO:tasks.workunit.client.0.smithi119.stdout:3/863: rename d6/l49 to d6/d44/d52/l11d 0 2024-09-13T21:44:55.887 INFO:tasks.workunit.client.0.smithi119.stdout:7/964: creat d8/d3c/d53/d3b/d7e/f14c x:0 0 0 2024-09-13T21:44:55.889 INFO:tasks.workunit.client.0.smithi119.stdout:6/756: dread dc/df/f1d [0,4194304] 0 2024-09-13T21:44:55.892 INFO:tasks.workunit.client.1.smithi155.stdout:9/566: dwrite dc/d19/d23/f4a [0,4194304] 0 2024-09-13T21:44:55.893 INFO:tasks.workunit.client.1.smithi155.stdout:2/433: rename d2/dd/d37/l49 to d2/dd/de/d15/d2e/d31/d5d/l98 0 2024-09-13T21:44:55.895 INFO:tasks.workunit.client.1.smithi155.stdout:7/482: dread d5/d13/f8b [0,4194304] 0 2024-09-13T21:44:55.896 INFO:tasks.workunit.client.0.smithi119.stdout:6/757: mkdir dc/d3a/dbb/d7a/de8 0 2024-09-13T21:44:55.898 INFO:tasks.workunit.client.0.smithi119.stdout:7/965: truncate d8/d3c/d46/db1/dc8/ffc 526765 0 2024-09-13T21:44:55.904 INFO:tasks.workunit.client.0.smithi119.stdout:6/758: truncate dc/d3d/d4e/f74 627093 0 2024-09-13T21:44:55.905 INFO:tasks.workunit.client.1.smithi155.stdout:2/434: rename d2/dd/de/d15/d2e/d31/f5c to d2/dd/de/d15/d2e/d96/f99 0 2024-09-13T21:44:55.905 INFO:tasks.workunit.client.0.smithi119.stdout:3/864: dwrite d6/d15/d1a/d45/f69 [0,4194304] 0 2024-09-13T21:44:55.906 INFO:tasks.workunit.client.1.smithi155.stdout:0/516: dread d1/d6/dc/f11 [0,4194304] 0 2024-09-13T21:44:55.906 INFO:tasks.workunit.client.1.smithi155.stdout:6/560: write db/d2c/d9d/f17 [6377265,64189] 0 2024-09-13T21:44:55.907 INFO:tasks.workunit.client.0.smithi119.stdout:1/809: dread d1/d3/d61/d77/d78/d32/f3e [0,4194304] 0 2024-09-13T21:44:55.907 INFO:tasks.workunit.client.0.smithi119.stdout:8/914: dwrite d1b/d1d/d39/fbb [0,4194304] 0 2024-09-13T21:44:55.908 INFO:tasks.workunit.client.1.smithi155.stdout:5/454: getdents d5/d12 0 2024-09-13T21:44:55.908 INFO:tasks.workunit.client.0.smithi119.stdout:6/759: fsync dc/d3a/dbb/f60 0 2024-09-13T21:44:55.910 INFO:tasks.workunit.client.0.smithi119.stdout:8/915: creat d1b/d1d/d26/df0/f116 x:0 0 0 2024-09-13T21:44:55.912 INFO:tasks.workunit.client.1.smithi155.stdout:9/567: link dc/d18/c3f dc/d18/d50/cc7 0 2024-09-13T21:44:55.913 INFO:tasks.workunit.client.0.smithi119.stdout:1/810: unlink d1/d3/d61/d77/d78/d32/dda/d19/d2d/d59/lb6 0 2024-09-13T21:44:55.913 INFO:tasks.workunit.client.1.smithi155.stdout:7/483: dwrite d5/df/d15/f5b [0,4194304] 0 2024-09-13T21:44:55.913 INFO:tasks.workunit.client.1.smithi155.stdout:2/435: stat d2/dd/de/d15/d2e/f36 0 2024-09-13T21:44:55.914 INFO:tasks.workunit.client.0.smithi119.stdout:3/865: link d6/fbe d6/d25/d2f/d33/d56/dab/f11e 0 2024-09-13T21:44:55.916 INFO:tasks.workunit.client.1.smithi155.stdout:5/455: readlink d5/d16/d33/d1b/d28/l31 0 2024-09-13T21:44:55.917 INFO:tasks.workunit.client.1.smithi155.stdout:9/568: fdatasync dc/de/d2d/d79/f63 0 2024-09-13T21:44:55.918 INFO:tasks.workunit.client.1.smithi155.stdout:7/484: chown d5/d13/f21 0 1 2024-09-13T21:44:55.919 INFO:tasks.workunit.client.0.smithi119.stdout:3/866: rename d6/d9f/dce to d6/d25/d2f/d8e/de2/d11b/d11f 0 2024-09-13T21:44:55.920 INFO:tasks.workunit.client.0.smithi119.stdout:1/811: dwrite d1/d3/dc/f67 [0,4194304] 0 2024-09-13T21:44:55.920 INFO:tasks.workunit.client.1.smithi155.stdout:6/561: mkdir db/d11/d4c/d7c/d8b/db4 0 2024-09-13T21:44:55.923 INFO:tasks.workunit.client.0.smithi119.stdout:3/867: creat d6/d25/d2f/d33/d56/da0/f120 x:0 0 0 2024-09-13T21:44:55.924 INFO:tasks.workunit.client.1.smithi155.stdout:7/485: write d5/df/d15/f5b [508054,5070] 0 2024-09-13T21:44:55.927 INFO:tasks.workunit.client.0.smithi119.stdout:3/868: fdatasync d6/d15/d1a/d45/d47/d4d/fee 0 2024-09-13T21:44:55.927 INFO:tasks.workunit.client.0.smithi119.stdout:1/812: mknod d1/d3/d61/d77/d78/d32/c10e 0 2024-09-13T21:44:55.927 INFO:tasks.workunit.client.0.smithi119.stdout:1/813: fsync d1/d3/dc/f41 0 2024-09-13T21:44:55.928 INFO:tasks.workunit.client.1.smithi155.stdout:5/456: rename d5/d12 to d5/d16/d81/d98 0 2024-09-13T21:44:55.930 INFO:tasks.workunit.client.1.smithi155.stdout:6/562: symlink db/d2c/d9d/lb5 0 2024-09-13T21:44:55.930 INFO:tasks.workunit.client.1.smithi155.stdout:0/517: read d1/d6/dc/d4d/d4a/d4e/d61/f6b [3709339,128741] 0 2024-09-13T21:44:55.930 INFO:tasks.workunit.client.1.smithi155.stdout:6/563: chown db/f2f 46 1 2024-09-13T21:44:55.932 INFO:tasks.workunit.client.1.smithi155.stdout:5/457: mkdir d5/d16/d4e/d99 0 2024-09-13T21:44:55.933 INFO:tasks.workunit.client.1.smithi155.stdout:4/437: dread d1/d7/de/f1f [0,4194304] 0 2024-09-13T21:44:55.933 INFO:tasks.workunit.client.1.smithi155.stdout:7/486: link d5/df/f19 d5/df/d15/d33/d55/f9b 0 2024-09-13T21:44:55.934 INFO:tasks.workunit.client.0.smithi119.stdout:1/814: rename d1/d3/d61/d77/d78/db8/dde/df1/cf6 to d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/c10f 0 2024-09-13T21:44:55.935 INFO:tasks.workunit.client.1.smithi155.stdout:5/458: readlink d5/d16/d81/l94 0 2024-09-13T21:44:55.935 INFO:tasks.workunit.client.1.smithi155.stdout:6/564: dread db/d11/d4c/f6c [0,4194304] 0 2024-09-13T21:44:55.936 INFO:tasks.workunit.client.0.smithi119.stdout:1/815: fdatasync d1/d3/d61/d77/d78/d32/d33/d72/ff2 0 2024-09-13T21:44:55.936 INFO:tasks.workunit.client.1.smithi155.stdout:2/436: dread d2/dd/de/d15/d2e/f3c [0,4194304] 0 2024-09-13T21:44:55.937 INFO:tasks.workunit.client.1.smithi155.stdout:0/518: link d1/d6/dc/d4d/d4a/d9e/fc4 d1/d6/dc/d4d/d4a/d4e/d61/fc6 0 2024-09-13T21:44:55.938 INFO:tasks.workunit.client.0.smithi119.stdout:3/869: getdents d6 0 2024-09-13T21:44:55.938 INFO:tasks.workunit.client.1.smithi155.stdout:5/459: fdatasync d5/f49 0 2024-09-13T21:44:55.939 INFO:tasks.workunit.client.0.smithi119.stdout:3/870: fsync d6/d25/d2f/d33/d56/f93 0 2024-09-13T21:44:55.939 INFO:tasks.workunit.client.1.smithi155.stdout:4/438: getdents d1/d7/de/dc/d7b 0 2024-09-13T21:44:55.940 INFO:tasks.workunit.client.0.smithi119.stdout:1/816: mkdir d1/d3/d61/d77/d78/d32/dda/d28/d110 0 2024-09-13T21:44:55.940 INFO:tasks.workunit.client.1.smithi155.stdout:2/437: write d2/dd/de/d15/f2d [2823901,7041] 0 2024-09-13T21:44:55.940 INFO:tasks.workunit.client.0.smithi119.stdout:1/817: readlink d1/d3/d61/d77/l9a 0 2024-09-13T21:44:55.941 INFO:tasks.workunit.client.1.smithi155.stdout:0/519: mknod d1/d6/dc/d4d/d4a/cc7 0 2024-09-13T21:44:55.942 INFO:tasks.workunit.client.1.smithi155.stdout:5/460: readlink d5/d16/d33/d1b/d2f/d3c/d44/l8f 0 2024-09-13T21:44:55.943 INFO:tasks.workunit.client.1.smithi155.stdout:4/439: write d1/d7/de/dc/f45 [1950728,85556] 0 2024-09-13T21:44:55.944 INFO:tasks.workunit.client.0.smithi119.stdout:1/818: creat d1/f111 x:0 0 0 2024-09-13T21:44:55.945 INFO:tasks.workunit.client.1.smithi155.stdout:5/461: chown d5/f49 35984447 1 2024-09-13T21:44:55.946 INFO:tasks.workunit.client.1.smithi155.stdout:2/438: chown d2/dd/de/d15/d38/d41/d5f/c95 899 1 2024-09-13T21:44:55.948 INFO:tasks.workunit.client.1.smithi155.stdout:7/487: dwrite d5/df/d15/f53 [0,4194304] 0 2024-09-13T21:44:55.948 INFO:tasks.workunit.client.1.smithi155.stdout:0/520: creat d1/d6/dc/d4d/d4a/d52/d5c/d6a/fc8 x:0 0 0 2024-09-13T21:44:55.948 INFO:tasks.workunit.client.1.smithi155.stdout:9/569: write dc/d19/d23/f4a [4480664,64116] 0 2024-09-13T21:44:55.948 INFO:tasks.workunit.client.0.smithi119.stdout:6/760: write dc/df/d41/f72 [86725,33065] 0 2024-09-13T21:44:55.949 INFO:tasks.workunit.client.0.smithi119.stdout:6/761: chown dc/d4b/l54 96916 1 2024-09-13T21:44:55.950 INFO:tasks.workunit.client.1.smithi155.stdout:4/440: link d1/d7/d21/f3a d1/d7/de/dc/d4a/d75/f85 0 2024-09-13T21:44:55.952 INFO:tasks.workunit.client.0.smithi119.stdout:6/762: unlink dc/df/fac 0 2024-09-13T21:44:55.952 INFO:tasks.workunit.client.1.smithi155.stdout:9/570: write dc/de/d6f/f7d [1204184,45502] 0 2024-09-13T21:44:55.954 INFO:tasks.workunit.client.1.smithi155.stdout:5/462: symlink d5/d16/d33/d1b/d92/l9a 0 2024-09-13T21:44:55.954 INFO:tasks.workunit.client.1.smithi155.stdout:7/488: write d5/f30 [829330,121408] 0 2024-09-13T21:44:55.955 INFO:tasks.workunit.client.1.smithi155.stdout:0/521: creat d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/fc9 x:0 0 0 2024-09-13T21:44:55.957 INFO:tasks.workunit.client.1.smithi155.stdout:7/489: chown d5/d13/d5f/f95 19 1 2024-09-13T21:44:55.957 INFO:tasks.workunit.client.1.smithi155.stdout:9/571: creat dc/d19/d23/d38/d90/d74/fc8 x:0 0 0 2024-09-13T21:44:55.958 INFO:tasks.workunit.client.0.smithi119.stdout:7/966: dread d8/d3c/d53/d3b/d48/f49 [4194304,4194304] 0 2024-09-13T21:44:55.958 INFO:tasks.workunit.client.0.smithi119.stdout:3/871: dwrite d6/d25/f2a [0,4194304] 0 2024-09-13T21:44:55.959 INFO:tasks.workunit.client.1.smithi155.stdout:2/439: getdents d2/dd/d21 0 2024-09-13T21:44:55.963 INFO:tasks.workunit.client.0.smithi119.stdout:7/967: rmdir d8/d3c/d53/d37/d83/d89/dc3 39 2024-09-13T21:44:55.963 INFO:tasks.workunit.client.1.smithi155.stdout:9/572: rmdir dc/d18/d1e/da2 39 2024-09-13T21:44:55.965 INFO:tasks.workunit.client.0.smithi119.stdout:7/968: creat d8/d113/f14d x:0 0 0 2024-09-13T21:44:55.966 INFO:tasks.workunit.client.0.smithi119.stdout:6/763: write dc/d3a/dbb/d7a/de1/fb1 [5003619,67293] 0 2024-09-13T21:44:55.966 INFO:tasks.workunit.client.1.smithi155.stdout:2/440: write d2/dd/de/d15/d2e/f36 [2327787,14687] 0 2024-09-13T21:44:55.967 INFO:tasks.workunit.client.0.smithi119.stdout:6/764: stat dc/d3a/dbb/d7a 0 2024-09-13T21:44:55.967 INFO:tasks.workunit.client.1.smithi155.stdout:4/441: dwrite d1/d7/d21/d2d/d42/f4d [0,4194304] 0 2024-09-13T21:44:55.969 INFO:tasks.workunit.client.1.smithi155.stdout:5/463: rename d5/d16/d33/d1b/f57 to d5/d16/d33/d1b/d2f/f9b 0 2024-09-13T21:44:55.970 INFO:tasks.workunit.client.0.smithi119.stdout:6/765: truncate dc/df/d65/fb2 392641 0 2024-09-13T21:44:55.972 INFO:tasks.workunit.client.1.smithi155.stdout:5/464: chown d5/d16/d33/d1b/d1e/c3f 0 1 2024-09-13T21:44:55.973 INFO:tasks.workunit.client.1.smithi155.stdout:6/565: dread db/d11/d1e/d21/f42 [0,4194304] 0 2024-09-13T21:44:55.975 INFO:tasks.workunit.client.1.smithi155.stdout:9/573: creat dc/de/d2d/fc9 x:0 0 0 2024-09-13T21:44:55.977 INFO:tasks.workunit.client.1.smithi155.stdout:9/574: dread - dc/de/d15/f97 zero size 2024-09-13T21:44:55.980 INFO:tasks.workunit.client.1.smithi155.stdout:6/566: mkdir db/d11/d4c/db6 0 2024-09-13T21:44:55.980 INFO:tasks.workunit.client.1.smithi155.stdout:4/442: dwrite d1/d7/de/d15/d55/d5e/f5f [0,4194304] 0 2024-09-13T21:44:55.981 INFO:tasks.workunit.client.1.smithi155.stdout:5/465: creat d5/d16/d33/d1b/f9c x:0 0 0 2024-09-13T21:44:55.983 INFO:tasks.workunit.client.1.smithi155.stdout:4/443: write d1/d7/d21/d2d/d42/f4d [3911406,74807] 0 2024-09-13T21:44:55.984 INFO:tasks.workunit.client.0.smithi119.stdout:6/766: dwrite dc/d3a/dbb/d7a/fc6 [0,4194304] 0 2024-09-13T21:44:55.985 INFO:tasks.workunit.client.1.smithi155.stdout:6/567: mkdir db/d2c/d9d/d1c/d36/d37/db7 0 2024-09-13T21:44:55.987 INFO:tasks.workunit.client.1.smithi155.stdout:4/444: fdatasync d1/d7/de/f1f 0 2024-09-13T21:44:55.987 INFO:tasks.workunit.client.0.smithi119.stdout:6/767: mknod dc/d3a/ce9 0 2024-09-13T21:44:55.987 INFO:tasks.workunit.client.1.smithi155.stdout:0/522: rmdir d1/d6/dc/d4d/d4a/d52 39 2024-09-13T21:44:55.990 INFO:tasks.workunit.client.1.smithi155.stdout:5/466: dwrite d5/d16/d4e/f55 [0,4194304] 0 2024-09-13T21:44:55.991 INFO:tasks.workunit.client.0.smithi119.stdout:6/768: creat dc/df/d41/dbf/fea x:0 0 0 2024-09-13T21:44:55.992 INFO:tasks.workunit.client.1.smithi155.stdout:4/445: mknod d1/d7/d5a/c86 0 2024-09-13T21:44:55.993 INFO:tasks.workunit.client.1.smithi155.stdout:0/523: write d1/f34 [5162068,68466] 0 2024-09-13T21:44:55.995 INFO:tasks.workunit.client.0.smithi119.stdout:3/872: dread d6/f1c [0,4194304] 0 2024-09-13T21:44:55.997 INFO:tasks.workunit.client.0.smithi119.stdout:6/769: dwrite dc/dd/f38 [0,4194304] 0 2024-09-13T21:44:55.998 INFO:tasks.workunit.client.0.smithi119.stdout:3/873: creat d6/d15/da9/f121 x:0 0 0 2024-09-13T21:44:56.000 INFO:tasks.workunit.client.1.smithi155.stdout:6/568: getdents db/d11/d4c/d7c/d8b 0 2024-09-13T21:44:56.003 INFO:tasks.workunit.client.0.smithi119.stdout:6/770: link dc/dd/f85 dc/df/feb 0 2024-09-13T21:44:56.004 INFO:tasks.workunit.client.1.smithi155.stdout:6/569: creat db/d2c/d9d/d1c/d36/d46/fb8 x:0 0 0 2024-09-13T21:44:56.005 INFO:tasks.workunit.client.1.smithi155.stdout:4/446: read d1/d7/de/d15/f37 [1547991,114666] 0 2024-09-13T21:44:56.006 INFO:tasks.workunit.client.0.smithi119.stdout:6/771: fsync dc/df/fb6 0 2024-09-13T21:44:56.006 INFO:tasks.workunit.client.1.smithi155.stdout:6/570: write db/d2c/d9d/d1c/d36/d37/f91 [1071185,84764] 0 2024-09-13T21:44:56.009 INFO:tasks.workunit.client.1.smithi155.stdout:6/571: rmdir db/d3d/d5f 39 2024-09-13T21:44:56.022 INFO:tasks.workunit.client.0.smithi119.stdout:3/874: truncate d6/d25/d2f/d33/d56/ffb 436468 0 2024-09-13T21:44:56.023 INFO:tasks.workunit.client.0.smithi119.stdout:3/875: write d6/d15/d1a/d45/f9e [1169779,103208] 0 2024-09-13T21:44:56.024 INFO:tasks.workunit.client.0.smithi119.stdout:3/876: readlink d6/d44/d52/d85/lff 0 2024-09-13T21:44:56.027 INFO:tasks.workunit.client.0.smithi119.stdout:3/877: unlink d6/d25/d2f/d8e/de2/d109/f118 0 2024-09-13T21:44:56.028 INFO:tasks.workunit.client.1.smithi155.stdout:6/572: dread db/d11/d4c/d64/f77 [0,4194304] 0 2024-09-13T21:44:56.030 INFO:tasks.workunit.client.1.smithi155.stdout:0/524: dread d1/f34 [4194304,4194304] 0 2024-09-13T21:44:56.030 INFO:tasks.workunit.client.0.smithi119.stdout:6/772: dread dc/f31 [0,4194304] 0 2024-09-13T21:44:56.031 INFO:tasks.workunit.client.0.smithi119.stdout:4/871: sync 2024-09-13T21:44:56.032 INFO:tasks.workunit.client.0.smithi119.stdout:3/878: unlink d6/d25/d2f/d33/d56/da0/f120 0 2024-09-13T21:44:56.032 INFO:tasks.workunit.client.0.smithi119.stdout:4/872: fdatasync d4/d1e/f78 0 2024-09-13T21:44:56.033 INFO:tasks.workunit.client.0.smithi119.stdout:4/873: readlink d4/d1e/d26/d6d/d7c/l10c 0 2024-09-13T21:44:56.036 INFO:tasks.workunit.client.1.smithi155.stdout:6/573: truncate db/d11/d2b/d35/f29 3268096 0 2024-09-13T21:44:56.038 INFO:tasks.workunit.client.0.smithi119.stdout:4/874: symlink d4/ddc/df4/l11e 0 2024-09-13T21:44:56.039 INFO:tasks.workunit.client.0.smithi119.stdout:6/773: write dc/df/f24 [489005,65147] 0 2024-09-13T21:44:56.041 INFO:tasks.workunit.client.0.smithi119.stdout:3/879: unlink d6/d15/d1a/d45/f67 0 2024-09-13T21:44:56.043 INFO:tasks.workunit.client.1.smithi155.stdout:4/447: dread d1/d7/de/d15/f37 [0,4194304] 0 2024-09-13T21:44:56.044 INFO:tasks.workunit.client.1.smithi155.stdout:5/467: dread d5/d16/d33/d1b/d2f/d3c/f82 [0,4194304] 0 2024-09-13T21:44:56.044 INFO:tasks.workunit.client.0.smithi119.stdout:3/880: readlink d6/d25/d2f/d33/d56/da0/lb4 0 2024-09-13T21:44:56.045 INFO:tasks.workunit.client.0.smithi119.stdout:4/875: dwrite d4/f21 [4194304,4194304] 0 2024-09-13T21:44:56.045 INFO:tasks.workunit.client.1.smithi155.stdout:0/525: dwrite d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/f99 [4194304,4194304] 0 2024-09-13T21:44:56.047 INFO:tasks.workunit.client.1.smithi155.stdout:5/468: chown d5/d16/d33/d1f/f5a 251198494 1 2024-09-13T21:44:56.049 INFO:tasks.workunit.client.0.smithi119.stdout:6/774: dwrite dc/d3d/d4e/fdf [0,4194304] 0 2024-09-13T21:44:56.050 INFO:tasks.workunit.client.0.smithi119.stdout:4/876: unlink d4/dce/f108 0 2024-09-13T21:44:56.051 INFO:tasks.workunit.client.1.smithi155.stdout:6/574: dwrite db/f10 [0,4194304] 0 2024-09-13T21:44:56.052 INFO:tasks.workunit.client.0.smithi119.stdout:4/877: write d4/dce/f10e [96296,2037] 0 2024-09-13T21:44:56.052 INFO:tasks.workunit.client.1.smithi155.stdout:5/469: chown d5/d16/d33/d1b/d59/l8d 172 1 2024-09-13T21:44:56.052 INFO:tasks.workunit.client.1.smithi155.stdout:0/526: rmdir d1/d6/dc/d4d/d4a/d52/da5 39 2024-09-13T21:44:56.055 INFO:tasks.workunit.client.0.smithi119.stdout:6/775: rename dc/d3d/d40/d68/fad to dc/df/d64/fec 0 2024-09-13T21:44:56.056 INFO:tasks.workunit.client.1.smithi155.stdout:6/575: truncate db/f22 1473478 0 2024-09-13T21:44:56.056 INFO:tasks.workunit.client.0.smithi119.stdout:4/878: stat d4/d1e/d26/d60/d69/la2 0 2024-09-13T21:44:56.057 INFO:tasks.workunit.client.0.smithi119.stdout:4/879: fdatasync d4/d1e/f5c 0 2024-09-13T21:44:56.057 INFO:tasks.workunit.client.0.smithi119.stdout:6/776: chown dc/d3a/dbb/l87 1512023 1 2024-09-13T21:44:56.058 INFO:tasks.workunit.client.1.smithi155.stdout:5/470: rename d5/d16/d81/c95 to d5/d16/d33/d1b/d2f/c9d 0 2024-09-13T21:44:56.061 INFO:tasks.workunit.client.0.smithi119.stdout:6/777: symlink dc/df/d32/led 0 2024-09-13T21:44:56.065 INFO:tasks.workunit.client.0.smithi119.stdout:6/778: creat dc/df/d6d/de7/fee x:0 0 0 2024-09-13T21:44:56.065 INFO:tasks.workunit.client.0.smithi119.stdout:4/880: dwrite d4/d1e/d28/d34/d6a/d79/d9f/dba/ffc [0,4194304] 0 2024-09-13T21:44:56.066 INFO:tasks.workunit.client.1.smithi155.stdout:6/576: rename db/d2c/d9d to db/d11/d6d/db9 0 2024-09-13T21:44:56.066 INFO:tasks.workunit.client.1.smithi155.stdout:6/577: chown db/d11/d6d/db9/f17 363 1 2024-09-13T21:44:56.068 INFO:tasks.workunit.client.1.smithi155.stdout:0/527: dwrite d1/d6/dc/d90/f9f [0,4194304] 0 2024-09-13T21:44:56.068 INFO:tasks.workunit.client.1.smithi155.stdout:5/471: mknod d5/d16/d33/d1b/d2f/c9e 0 2024-09-13T21:44:56.068 INFO:tasks.workunit.client.0.smithi119.stdout:6/779: mknod dc/d3a/dbb/d7a/de8/cef 0 2024-09-13T21:44:56.070 INFO:tasks.workunit.client.0.smithi119.stdout:3/881: dread d6/d44/d52/f58 [0,4194304] 0 2024-09-13T21:44:56.072 INFO:tasks.workunit.client.1.smithi155.stdout:5/472: creat d5/d16/f9f x:0 0 0 2024-09-13T21:44:56.074 INFO:tasks.workunit.client.1.smithi155.stdout:0/528: creat d1/d6/d97/db2/db5/fca x:0 0 0 2024-09-13T21:44:56.075 INFO:tasks.workunit.client.0.smithi119.stdout:6/780: dread dc/d3d/d4e/fdf [0,4194304] 0 2024-09-13T21:44:56.075 INFO:tasks.workunit.client.1.smithi155.stdout:5/473: symlink d5/la0 0 2024-09-13T21:44:56.076 INFO:tasks.workunit.client.1.smithi155.stdout:4/448: dwrite d1/d7/de/dc/d4a/d75/f85 [0,4194304] 0 2024-09-13T21:44:56.078 INFO:tasks.workunit.client.1.smithi155.stdout:0/529: truncate d1/d6/dc/d4d/f80 799542 0 2024-09-13T21:44:56.078 INFO:tasks.workunit.client.1.smithi155.stdout:5/474: write d5/d16/d81/d98/f4d [2863430,15663] 0 2024-09-13T21:44:56.078 INFO:tasks.workunit.client.0.smithi119.stdout:6/781: creat dc/d4b/d6a/dbd/ff0 x:0 0 0 2024-09-13T21:44:56.080 INFO:tasks.workunit.client.0.smithi119.stdout:3/882: dwrite d6/d25/d2f/d33/d56/da0/fb5 [0,4194304] 0 2024-09-13T21:44:56.080 INFO:tasks.workunit.client.1.smithi155.stdout:4/449: mknod d1/d7/c87 0 2024-09-13T21:44:56.081 INFO:tasks.workunit.client.1.smithi155.stdout:0/530: creat d1/d6/dc/d90/fcb x:0 0 0 2024-09-13T21:44:56.082 INFO:tasks.workunit.client.0.smithi119.stdout:3/883: write d6/d25/d2f/d33/d56/fe0 [4345761,42559] 0 2024-09-13T21:44:56.083 INFO:tasks.workunit.client.1.smithi155.stdout:5/475: mkdir d5/d16/d33/d1b/d1e/da1 0 2024-09-13T21:44:56.083 INFO:tasks.workunit.client.0.smithi119.stdout:3/884: fsync d6/d15/d1a/d45/d47/d4d/da7/fb1 0 2024-09-13T21:44:56.084 INFO:tasks.workunit.client.0.smithi119.stdout:6/782: mknod dc/d4b/d6a/dc2/cf1 0 2024-09-13T21:44:56.085 INFO:tasks.workunit.client.1.smithi155.stdout:0/531: mknod d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/d82/ccc 0 2024-09-13T21:44:56.085 INFO:tasks.workunit.client.1.smithi155.stdout:0/532: read - d1/fc1 zero size 2024-09-13T21:44:56.086 INFO:tasks.workunit.client.0.smithi119.stdout:3/885: chown d6/d25/d2f/d33/d56/dab/dc2/lec 1928473 1 2024-09-13T21:44:56.087 INFO:tasks.workunit.client.0.smithi119.stdout:6/783: symlink dc/df/d41/dae/lf2 0 2024-09-13T21:44:56.089 INFO:tasks.workunit.client.1.smithi155.stdout:4/450: rmdir d1/d7/de/dc/d7b 0 2024-09-13T21:44:56.089 INFO:tasks.workunit.client.1.smithi155.stdout:5/476: link d5/d16/d33/f53 d5/d16/d4e/d85/fa2 0 2024-09-13T21:44:56.089 INFO:tasks.workunit.client.0.smithi119.stdout:3/886: symlink d6/d25/l122 0 2024-09-13T21:44:56.091 INFO:tasks.workunit.client.0.smithi119.stdout:6/784: creat dc/d4b/d97/ff3 x:0 0 0 2024-09-13T21:44:56.092 INFO:tasks.workunit.client.1.smithi155.stdout:5/477: mknod d5/d16/d81/d98/ca3 0 2024-09-13T21:44:56.093 INFO:tasks.workunit.client.0.smithi119.stdout:6/785: write dc/d3d/d40/f69 [2411019,81885] 0 2024-09-13T21:44:56.093 INFO:tasks.workunit.client.1.smithi155.stdout:5/478: chown d5/d16/d33/d1b/d2f/d3c/f82 45 1 2024-09-13T21:44:56.094 INFO:tasks.workunit.client.1.smithi155.stdout:4/451: mknod d1/d7/d83/c88 0 2024-09-13T21:44:56.094 INFO:tasks.workunit.client.0.smithi119.stdout:6/786: chown dc/d4b/d97 232 1 2024-09-13T21:44:56.096 INFO:tasks.workunit.client.0.smithi119.stdout:6/787: mkdir dc/df/d64/df4 0 2024-09-13T21:44:56.098 INFO:tasks.workunit.client.1.smithi155.stdout:0/533: link d1/l28 d1/d6/d97/lcd 0 2024-09-13T21:44:56.103 INFO:tasks.workunit.client.1.smithi155.stdout:0/534: dwrite d1/d6/dc/d4d/d4a/d9e/fbc [0,4194304] 0 2024-09-13T21:44:56.113 INFO:tasks.workunit.client.1.smithi155.stdout:0/535: dwrite d1/d6/dc/d4d/f85 [0,4194304] 0 2024-09-13T21:44:56.114 INFO:tasks.workunit.client.1.smithi155.stdout:6/578: dread db/d80/f7a [0,4194304] 0 2024-09-13T21:44:56.115 INFO:tasks.workunit.client.0.smithi119.stdout:6/788: getdents dc/df/d41/dae 0 2024-09-13T21:44:56.116 INFO:tasks.workunit.client.1.smithi155.stdout:6/579: write db/d2c/f79 [306716,19536] 0 2024-09-13T21:44:56.118 INFO:tasks.workunit.client.0.smithi119.stdout:4/881: dwrite d4/d1e/d26/d6d/f72 [4194304,4194304] 0 2024-09-13T21:44:56.120 INFO:tasks.workunit.client.1.smithi155.stdout:6/580: symlink db/d11/d6d/db9/d90/lba 0 2024-09-13T21:44:56.121 INFO:tasks.workunit.client.0.smithi119.stdout:4/882: write d4/d1e/d26/d60/d71/f88 [5184728,122630] 0 2024-09-13T21:44:56.121 INFO:tasks.workunit.client.1.smithi155.stdout:6/581: read db/d11/d4c/d64/d5e/fae [3588002,54958] 0 2024-09-13T21:44:56.121 INFO:tasks.workunit.client.1.smithi155.stdout:0/536: creat d1/fce x:0 0 0 2024-09-13T21:44:56.122 INFO:tasks.workunit.client.0.smithi119.stdout:6/789: creat dc/d3d/ff5 x:0 0 0 2024-09-13T21:44:56.123 INFO:tasks.workunit.client.1.smithi155.stdout:0/537: stat d1/d6/l91 0 2024-09-13T21:44:56.123 INFO:tasks.workunit.client.1.smithi155.stdout:6/582: chown db/d11/d4c/d64/d88/f98 111530 1 2024-09-13T21:44:56.124 INFO:tasks.workunit.client.0.smithi119.stdout:4/883: truncate d4/d1e/d26/d60/f65 4213404 0 2024-09-13T21:44:56.124 INFO:tasks.workunit.client.1.smithi155.stdout:0/538: write d1/d6/dc/d90/f92 [1744844,3495] 0 2024-09-13T21:44:56.125 INFO:tasks.workunit.client.0.smithi119.stdout:6/790: truncate dc/d3d/f8b 2266582 0 2024-09-13T21:44:56.129 INFO:tasks.workunit.client.0.smithi119.stdout:6/791: symlink dc/d3a/dbb/d7a/dc7/lf6 0 2024-09-13T21:44:56.130 INFO:tasks.workunit.client.0.smithi119.stdout:4/884: dread d4/d1e/d28/d34/d6a/d79/d9f/dba/ffc [0,4194304] 0 2024-09-13T21:44:56.131 INFO:tasks.workunit.client.1.smithi155.stdout:6/583: getdents db/d11 0 2024-09-13T21:44:56.132 INFO:tasks.workunit.client.0.smithi119.stdout:3/887: dread d6/f14 [0,4194304] 0 2024-09-13T21:44:56.133 INFO:tasks.workunit.client.0.smithi119.stdout:6/792: mknod dc/d4b/d6a/d75/dbe/cf7 0 2024-09-13T21:44:56.134 INFO:tasks.workunit.client.1.smithi155.stdout:4/452: rmdir d1/d7 39 2024-09-13T21:44:56.134 INFO:tasks.workunit.client.0.smithi119.stdout:4/885: mknod d4/d1e/d28/d5d/c11f 0 2024-09-13T21:44:56.134 INFO:tasks.workunit.client.0.smithi119.stdout:6/793: fdatasync dc/dd/fde 0 2024-09-13T21:44:56.136 INFO:tasks.workunit.client.1.smithi155.stdout:5/479: write d5/d16/d33/d1b/d2f/f9b [3947914,81342] 0 2024-09-13T21:44:56.137 INFO:tasks.workunit.client.1.smithi155.stdout:6/584: read db/f2f [710086,77346] 0 2024-09-13T21:44:56.140 INFO:tasks.workunit.client.1.smithi155.stdout:4/453: mknod d1/d7/de/d15/d55/c89 0 2024-09-13T21:44:56.141 INFO:tasks.workunit.client.1.smithi155.stdout:6/585: fsync db/d3d/d5f/f89 0 2024-09-13T21:44:56.141 INFO:tasks.workunit.client.1.smithi155.stdout:0/539: dread d1/d6/dc/d4d/d4a/d4e/d61/f6b [0,4194304] 0 2024-09-13T21:44:56.142 INFO:tasks.workunit.client.1.smithi155.stdout:4/454: fsync d1/d7/de/d15/d55/d5e/f5f 0 2024-09-13T21:44:56.142 INFO:tasks.workunit.client.0.smithi119.stdout:3/888: dwrite d6/d44/f80 [0,4194304] 0 2024-09-13T21:44:56.143 INFO:tasks.workunit.client.1.smithi155.stdout:6/586: chown db/d3d/d5f/f84 1 1 2024-09-13T21:44:56.143 INFO:tasks.workunit.client.0.smithi119.stdout:4/886: dwrite d4/f2f [4194304,4194304] 0 2024-09-13T21:44:56.144 INFO:tasks.workunit.client.1.smithi155.stdout:5/480: link d5/f1c d5/d16/d33/d1b/d28/fa4 0 2024-09-13T21:44:56.146 INFO:tasks.workunit.client.1.smithi155.stdout:5/481: chown d5/d16/d33/d1b/d2f/d3c/d44/d29/f7d 97 1 2024-09-13T21:44:56.147 INFO:tasks.workunit.client.1.smithi155.stdout:4/455: symlink d1/l8a 0 2024-09-13T21:44:56.148 INFO:tasks.workunit.client.0.smithi119.stdout:2/817: sync 2024-09-13T21:44:56.148 INFO:tasks.workunit.client.0.smithi119.stdout:4/887: symlink d4/d1e/d28/d5d/d113/l120 0 2024-09-13T21:44:56.148 INFO:tasks.workunit.client.1.smithi155.stdout:6/587: creat db/d11/d4c/d7c/d8b/db4/fbb x:0 0 0 2024-09-13T21:44:56.149 INFO:tasks.workunit.client.0.smithi119.stdout:4/888: stat d4/d1e/d28/d5d/c11f 0 2024-09-13T21:44:56.149 INFO:tasks.workunit.client.1.smithi155.stdout:4/456: write d1/d7/de/dc/d4a/f76 [367930,42561] 0 2024-09-13T21:44:56.150 INFO:tasks.workunit.client.1.smithi155.stdout:5/482: creat d5/d16/d33/d1f/fa5 x:0 0 0 2024-09-13T21:44:56.151 INFO:tasks.workunit.client.0.smithi119.stdout:4/889: rmdir d4/ddc/df4 39 2024-09-13T21:44:56.151 INFO:tasks.workunit.client.1.smithi155.stdout:6/588: chown db/d11/d1e/d21/d44/daa 14241391 1 2024-09-13T21:44:56.152 INFO:tasks.workunit.client.1.smithi155.stdout:0/540: rename d1/f1d to d1/d6/dc/d4d/d4a/d52/d5c/fcf 0 2024-09-13T21:44:56.153 INFO:tasks.workunit.client.1.smithi155.stdout:5/483: truncate d5/d16/d81/d98/f8b 1159784 0 2024-09-13T21:44:56.154 INFO:tasks.workunit.client.0.smithi119.stdout:2/818: rename d1/d7/l1e to d1/d9d/l102 0 2024-09-13T21:44:56.155 INFO:tasks.workunit.client.1.smithi155.stdout:4/457: rmdir d1/d7/d21/d69 39 2024-09-13T21:44:56.156 INFO:tasks.workunit.client.0.smithi119.stdout:2/819: chown d1/d22/d55/l8d 23 1 2024-09-13T21:44:56.156 INFO:tasks.workunit.client.1.smithi155.stdout:6/589: mkdir db/d2c/dbc 0 2024-09-13T21:44:56.157 INFO:tasks.workunit.client.1.smithi155.stdout:6/590: fdatasync db/d11/d6d/db9/d1c/d36/fb2 0 2024-09-13T21:44:56.158 INFO:tasks.workunit.client.0.smithi119.stdout:4/890: mknod d4/d1e/d28/d34/d99/df0/dfb/c121 0 2024-09-13T21:44:56.159 INFO:tasks.workunit.client.1.smithi155.stdout:0/541: symlink d1/d6/dc/d4d/ld0 0 2024-09-13T21:44:56.159 INFO:tasks.workunit.client.1.smithi155.stdout:6/591: truncate db/d3d/d5f/f84 984543 0 2024-09-13T21:44:56.159 INFO:tasks.workunit.client.0.smithi119.stdout:6/794: dread dc/df/f44 [4194304,4194304] 0 2024-09-13T21:44:56.162 INFO:tasks.workunit.client.1.smithi155.stdout:0/542: creat d1/d6/fd1 x:0 0 0 2024-09-13T21:44:56.163 INFO:tasks.workunit.client.1.smithi155.stdout:0/543: write d1/d6/dc/d4d/d4a/f4b [203865,10459] 0 2024-09-13T21:44:56.164 INFO:tasks.workunit.client.1.smithi155.stdout:0/544: dread - d1/d6/fd1 zero size 2024-09-13T21:44:56.166 INFO:tasks.workunit.client.1.smithi155.stdout:0/545: symlink d1/d6/dc/d4d/ld2 0 2024-09-13T21:44:56.167 INFO:tasks.workunit.client.1.smithi155.stdout:0/546: creat d1/d6/dc/d4d/d4a/d4e/d61/fd3 x:0 0 0 2024-09-13T21:44:56.169 INFO:tasks.workunit.client.1.smithi155.stdout:0/547: chown d1/d6/dc/d4d/d4a/d52/da5/lb9 32103040 1 2024-09-13T21:44:56.171 INFO:tasks.workunit.client.1.smithi155.stdout:0/548: mknod d1/d6/dc/d4d/d4a/cd4 0 2024-09-13T21:44:56.171 INFO:tasks.workunit.client.1.smithi155.stdout:0/549: chown d1/d6/dc/d8c 229255427 1 2024-09-13T21:44:56.174 INFO:tasks.workunit.client.1.smithi155.stdout:0/550: creat d1/d6/dc/d4d/d4a/dbe/fd5 x:0 0 0 2024-09-13T21:44:56.175 INFO:tasks.workunit.client.1.smithi155.stdout:4/458: write d1/f24 [2338917,36511] 0 2024-09-13T21:44:56.176 INFO:tasks.workunit.client.1.smithi155.stdout:0/551: rmdir d1/d6/dc/d4d/d4a/d52 39 2024-09-13T21:44:56.176 INFO:tasks.workunit.client.1.smithi155.stdout:4/459: write d1/d7/d21/f3a [1083036,124701] 0 2024-09-13T21:44:56.179 INFO:tasks.workunit.client.1.smithi155.stdout:4/460: rmdir d1/d7/de/d15/d55/d5e 39 2024-09-13T21:44:56.181 INFO:tasks.workunit.client.1.smithi155.stdout:0/552: dread d1/d6/dc/d4d/d4a/d52/d5c/f9a [0,4194304] 0 2024-09-13T21:44:56.182 INFO:tasks.workunit.client.1.smithi155.stdout:4/461: creat d1/d7/de/dc/d4a/d75/f8b x:0 0 0 2024-09-13T21:44:56.182 INFO:tasks.workunit.client.1.smithi155.stdout:0/553: dread - d1/d6/dc/d4d/d4a/d52/d5c/fbd zero size 2024-09-13T21:44:56.182 INFO:tasks.workunit.client.1.smithi155.stdout:4/462: read - d1/d7/d21/f70 zero size 2024-09-13T21:44:56.183 INFO:tasks.workunit.client.1.smithi155.stdout:0/554: write d1/d6/dc/d4d/d4a/f98 [806953,123441] 0 2024-09-13T21:44:56.188 INFO:tasks.workunit.client.1.smithi155.stdout:0/555: write d1/d6/dc/d4d/d4a/d4e/d61/fc6 [1005155,85655] 0 2024-09-13T21:44:56.191 INFO:tasks.workunit.client.1.smithi155.stdout:0/556: creat d1/d6/dc/d4d/d4a/d4e/fd6 x:0 0 0 2024-09-13T21:44:56.192 INFO:tasks.workunit.client.1.smithi155.stdout:0/557: chown d1/d6/dc/d4d/d4a/d52/d5c/lb7 160535482 1 2024-09-13T21:44:56.196 INFO:tasks.workunit.client.1.smithi155.stdout:0/558: rename d1/d6/d97/lcd to d1/d6/dc/d4d/d4a/ld7 0 2024-09-13T21:44:56.197 INFO:tasks.workunit.client.1.smithi155.stdout:4/463: dread d1/f59 [0,4194304] 0 2024-09-13T21:44:56.198 INFO:tasks.workunit.client.1.smithi155.stdout:0/559: mkdir d1/d6/dc/d4d/d4a/d52/d5c/d6a/dd8 0 2024-09-13T21:44:56.198 INFO:tasks.workunit.client.1.smithi155.stdout:4/464: rmdir d1/d7/d5a 39 2024-09-13T21:44:56.202 INFO:tasks.workunit.client.1.smithi155.stdout:4/465: rmdir d1/d7/d5a/d7d 0 2024-09-13T21:44:56.205 INFO:tasks.workunit.client.1.smithi155.stdout:4/466: symlink d1/d7/d78/l8c 0 2024-09-13T21:44:56.205 INFO:tasks.workunit.client.1.smithi155.stdout:0/560: dwrite d1/d6/dc/d4d/f50 [0,4194304] 0 2024-09-13T21:44:56.206 INFO:tasks.workunit.client.1.smithi155.stdout:4/467: chown d1/d7/de/l14 3773799 1 2024-09-13T21:44:56.208 INFO:tasks.workunit.client.1.smithi155.stdout:0/561: mknod d1/d6/dc/d4d/d4a/d52/d5c/d6a/cd9 0 2024-09-13T21:44:56.212 INFO:tasks.workunit.client.1.smithi155.stdout:0/562: dread d1/d6/dc/d4d/d4a/d4e/d61/fc6 [0,4194304] 0 2024-09-13T21:44:56.212 INFO:tasks.workunit.client.1.smithi155.stdout:4/468: creat d1/d7/d21/f8d x:0 0 0 2024-09-13T21:44:56.218 INFO:tasks.workunit.client.1.smithi155.stdout:4/469: rename d1/d7/d21/c6f to d1/c8e 0 2024-09-13T21:44:56.221 INFO:tasks.workunit.client.1.smithi155.stdout:4/470: truncate d1/d7/d21/d69/f73 1004959 0 2024-09-13T21:44:56.221 INFO:tasks.workunit.client.1.smithi155.stdout:4/471: chown d1/d7/de/d15/f71 5191 1 2024-09-13T21:44:56.226 INFO:tasks.workunit.client.1.smithi155.stdout:4/472: dwrite d1/d7/d21/f70 [0,4194304] 0 2024-09-13T21:44:56.231 INFO:tasks.workunit.client.1.smithi155.stdout:0/563: fdatasync d1/d6/dc/d4d/f50 0 2024-09-13T21:44:56.233 INFO:tasks.workunit.client.1.smithi155.stdout:4/473: dwrite d1/f24 [0,4194304] 0 2024-09-13T21:44:56.233 INFO:tasks.workunit.client.1.smithi155.stdout:0/564: write d1/d6/dc/d4d/d4a/fa6 [5332382,119961] 0 2024-09-13T21:44:56.235 INFO:tasks.workunit.client.1.smithi155.stdout:0/565: dread - d1/d6/dc/d4d/d4a/d4e/fc3 zero size 2024-09-13T21:44:56.236 INFO:tasks.workunit.client.1.smithi155.stdout:4/474: mknod d1/d7/d5a/c8f 0 2024-09-13T21:44:56.237 INFO:tasks.workunit.client.1.smithi155.stdout:0/566: creat d1/d6/dc/d8c/fda x:0 0 0 2024-09-13T21:44:56.240 INFO:tasks.workunit.client.1.smithi155.stdout:0/567: rmdir d1/d6/dc/d4d/d4a 39 2024-09-13T21:44:56.242 INFO:tasks.workunit.client.1.smithi155.stdout:4/475: link d1/d7/d21/f3a d1/d7/de/dc/d4a/d75/f90 0 2024-09-13T21:44:56.243 INFO:tasks.workunit.client.1.smithi155.stdout:4/476: write d1/f24 [3104110,112182] 0 2024-09-13T21:44:56.243 INFO:tasks.workunit.client.1.smithi155.stdout:0/568: stat d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/c7b 0 2024-09-13T21:44:56.244 INFO:tasks.workunit.client.1.smithi155.stdout:4/477: mknod d1/d7/d5a/c91 0 2024-09-13T21:44:56.247 INFO:tasks.workunit.client.1.smithi155.stdout:4/478: dread d1/d7/de/d15/f37 [0,4194304] 0 2024-09-13T21:44:56.287 INFO:tasks.workunit.client.0.smithi119.stdout:4/891: mkdir d4/d114/de9/df8/d11b/d122 0 2024-09-13T21:44:56.295 INFO:tasks.workunit.client.0.smithi119.stdout:2/820: dwrite d1/d38/d89/d6b/d8c/fc1 [0,4194304] 0 2024-09-13T21:44:56.300 INFO:tasks.workunit.client.0.smithi119.stdout:3/889: dread d6/f6c [0,4194304] 0 2024-09-13T21:44:56.300 INFO:tasks.workunit.client.0.smithi119.stdout:4/892: dwrite d4/d1e/d28/d34/d66/f9c [0,4194304] 0 2024-09-13T21:44:56.311 INFO:tasks.workunit.client.0.smithi119.stdout:3/890: creat d6/d15/d10f/f123 x:0 0 0 2024-09-13T21:44:56.312 INFO:tasks.workunit.client.0.smithi119.stdout:2/821: mkdir d1/d103 0 2024-09-13T21:44:56.314 INFO:tasks.workunit.client.0.smithi119.stdout:2/822: symlink d1/d22/d55/d64/l104 0 2024-09-13T21:44:56.317 INFO:tasks.workunit.client.0.smithi119.stdout:3/891: rename d6/f29 to d6/d25/d2f/d8e/de2/d109/f124 0 2024-09-13T21:44:56.317 INFO:tasks.workunit.client.0.smithi119.stdout:2/823: chown d1/d22/d5a/l91 17021272 1 2024-09-13T21:44:56.320 INFO:tasks.workunit.client.0.smithi119.stdout:5/898: sync 2024-09-13T21:44:56.325 INFO:tasks.workunit.client.0.smithi119.stdout:5/899: truncate d0/d3/d4/def/d10f/d67/f75 601037 0 2024-09-13T21:44:56.327 INFO:tasks.workunit.client.1.smithi155.stdout:1/482: sync 2024-09-13T21:44:56.327 INFO:tasks.workunit.client.0.smithi119.stdout:5/900: chown d0/d3/d4/d2e/d6b/ca8 407844442 1 2024-09-13T21:44:56.328 INFO:tasks.workunit.client.0.smithi119.stdout:5/901: stat d0/d3/d4/d9/l90 0 2024-09-13T21:44:56.328 INFO:tasks.workunit.client.1.smithi155.stdout:1/483: mknod d6/d15/d57/d5d/d72/d74/ca5 0 2024-09-13T21:44:56.329 INFO:tasks.workunit.client.1.smithi155.stdout:1/484: creat d6/d7/d48/fa6 x:0 0 0 2024-09-13T21:44:56.330 INFO:tasks.workunit.client.0.smithi119.stdout:5/902: mknod d0/d3/d4/c127 0 2024-09-13T21:44:56.331 INFO:tasks.workunit.client.1.smithi155.stdout:1/485: read d6/d15/f45 [1405877,37495] 0 2024-09-13T21:44:56.331 INFO:tasks.workunit.client.1.smithi155.stdout:1/486: write d6/d15/d57/d5d/f5f [4662173,100678] 0 2024-09-13T21:44:56.333 INFO:tasks.workunit.client.1.smithi155.stdout:1/487: write d6/d15/d23/d87/f29 [467053,4232] 0 2024-09-13T21:44:56.333 INFO:tasks.workunit.client.1.smithi155.stdout:1/488: readlink d6/d15/d57/d99/l44 0 2024-09-13T21:44:56.335 INFO:tasks.workunit.client.0.smithi119.stdout:4/893: write d4/d1e/d28/d34/d99/ff6 [49885,84461] 0 2024-09-13T21:44:56.337 INFO:tasks.workunit.client.0.smithi119.stdout:2/824: write d1/f90 [55691,14932] 0 2024-09-13T21:44:56.338 INFO:tasks.workunit.client.0.smithi119.stdout:2/825: read d1/d22/fc0 [78780,121262] 0 2024-09-13T21:44:56.339 INFO:tasks.workunit.client.0.smithi119.stdout:4/894: creat d4/d1e/d28/d34/d6a/d79/d9f/d11d/f123 x:0 0 0 2024-09-13T21:44:56.341 INFO:tasks.workunit.client.0.smithi119.stdout:2/826: creat d1/d22/db6/f105 x:0 0 0 2024-09-13T21:44:56.343 INFO:tasks.workunit.client.0.smithi119.stdout:2/827: symlink d1/l106 0 2024-09-13T21:44:56.343 INFO:tasks.workunit.client.0.smithi119.stdout:4/895: dread d4/d1e/d28/d34/fbc [0,4194304] 0 2024-09-13T21:44:56.346 INFO:tasks.workunit.client.0.smithi119.stdout:2/828: rename d1/d22/d55/f48 to d1/d22/d55/d64/f107 0 2024-09-13T21:44:56.347 INFO:tasks.workunit.client.0.smithi119.stdout:4/896: symlink d4/d1e/d26/l124 0 2024-09-13T21:44:56.349 INFO:tasks.workunit.client.0.smithi119.stdout:2/829: truncate d1/d7/d47/f5c 1126815 0 2024-09-13T21:44:56.349 INFO:tasks.workunit.client.0.smithi119.stdout:2/830: dread - d1/d97/ffd zero size 2024-09-13T21:44:56.350 INFO:tasks.workunit.client.0.smithi119.stdout:4/897: mknod d4/d1e/d28/d5d/d113/c125 0 2024-09-13T21:44:56.350 INFO:tasks.workunit.client.0.smithi119.stdout:3/892: dread d6/d25/d2f/d8e/de2/d109/f124 [0,4194304] 0 2024-09-13T21:44:56.353 INFO:tasks.workunit.client.0.smithi119.stdout:3/893: rename d6/d15/d1a/d45/d47/d4d/da7/dea/f112 to d6/d25/d2f/d33/f125 0 2024-09-13T21:44:56.356 INFO:tasks.workunit.client.0.smithi119.stdout:4/898: getdents d4/d1e/d28/d34 0 2024-09-13T21:44:56.357 INFO:tasks.workunit.client.0.smithi119.stdout:3/894: creat d6/d15/d103/dbc/f126 x:0 0 0 2024-09-13T21:44:56.357 INFO:tasks.workunit.client.0.smithi119.stdout:2/831: dread d1/d22/d5a/d5d/fc5 [0,4194304] 0 2024-09-13T21:44:56.358 INFO:tasks.workunit.client.0.smithi119.stdout:3/895: fdatasync d6/d25/d2f/d33/d56/fd2 0 2024-09-13T21:44:56.359 INFO:tasks.workunit.client.0.smithi119.stdout:4/899: symlink d4/d1e/d28/d34/l126 0 2024-09-13T21:44:56.360 INFO:tasks.workunit.client.0.smithi119.stdout:5/903: truncate d0/d3/d4/d9/f10 4089857 0 2024-09-13T21:44:56.360 INFO:tasks.workunit.client.0.smithi119.stdout:2/832: truncate d1/d22/d5a/d5d/d83/fe6 783537 0 2024-09-13T21:44:56.361 INFO:tasks.workunit.client.0.smithi119.stdout:5/904: stat d0/d3/d4/c1d 0 2024-09-13T21:44:56.361 INFO:tasks.workunit.client.1.smithi155.stdout:1/489: read d6/d15/f4e [111847,92236] 0 2024-09-13T21:44:56.362 INFO:tasks.workunit.client.1.smithi155.stdout:1/490: write d6/d82/d91/fa4 [202768,7017] 0 2024-09-13T21:44:56.362 INFO:tasks.workunit.client.0.smithi119.stdout:5/905: fsync d0/d3/d1f/f5d 0 2024-09-13T21:44:56.364 INFO:tasks.workunit.client.0.smithi119.stdout:2/833: mkdir d1/d7/d47/df3/d108 0 2024-09-13T21:44:56.365 INFO:tasks.workunit.client.1.smithi155.stdout:1/491: symlink d6/la7 0 2024-09-13T21:44:56.367 INFO:tasks.workunit.client.0.smithi119.stdout:3/896: creat d6/f127 x:0 0 0 2024-09-13T21:44:56.376 INFO:tasks.workunit.client.1.smithi155.stdout:1/492: write d6/d7/f8 [4456840,35142] 0 2024-09-13T21:44:56.380 INFO:tasks.workunit.client.1.smithi155.stdout:1/493: read d6/d15/d23/d87/f71 [3290305,126733] 0 2024-09-13T21:44:56.382 INFO:tasks.workunit.client.1.smithi155.stdout:1/494: symlink d6/d15/la8 0 2024-09-13T21:44:56.383 INFO:tasks.workunit.client.0.smithi119.stdout:4/900: chown d4/d1e/d28/d34/l4a 6870 1 2024-09-13T21:44:56.385 INFO:tasks.workunit.client.0.smithi119.stdout:3/897: truncate d6/d15/f21 3131297 0 2024-09-13T21:44:56.386 INFO:tasks.workunit.client.0.smithi119.stdout:4/901: mknod d4/ddc/df4/dc3/c127 0 2024-09-13T21:44:56.387 INFO:tasks.workunit.client.1.smithi155.stdout:1/495: truncate d6/d15/d57/d5d/f5f 4431700 0 2024-09-13T21:44:56.389 INFO:tasks.workunit.client.0.smithi119.stdout:3/898: unlink d6/d44/d52/ff2 0 2024-09-13T21:44:56.389 INFO:tasks.workunit.client.0.smithi119.stdout:3/899: chown d6/d15/d1a/d45/c102 1 1 2024-09-13T21:44:56.390 INFO:tasks.workunit.client.0.smithi119.stdout:4/902: mkdir d4/d1e/d128 0 2024-09-13T21:44:56.392 INFO:tasks.workunit.client.0.smithi119.stdout:2/834: dread d1/d22/d5a/da9/fe0 [0,4194304] 0 2024-09-13T21:44:56.392 INFO:tasks.workunit.client.1.smithi155.stdout:1/496: write d6/d15/d23/d87/d30/f50 [526967,28820] 0 2024-09-13T21:44:56.394 INFO:tasks.workunit.client.0.smithi119.stdout:2/835: symlink d1/d22/d7c/l109 0 2024-09-13T21:44:56.394 INFO:tasks.workunit.client.1.smithi155.stdout:1/497: mkdir d6/d15/d23/d87/d95/da9 0 2024-09-13T21:44:56.395 INFO:tasks.workunit.client.1.smithi155.stdout:1/498: rmdir d6/d15/d23 39 2024-09-13T21:44:56.398 INFO:tasks.workunit.client.0.smithi119.stdout:2/836: mknod d1/d7/d86/c10a 0 2024-09-13T21:44:56.399 INFO:tasks.workunit.client.0.smithi119.stdout:3/900: creat d6/d25/d2f/d33/d56/f128 x:0 0 0 2024-09-13T21:44:56.400 INFO:tasks.workunit.client.0.smithi119.stdout:2/837: symlink d1/d22/d7c/l10b 0 2024-09-13T21:44:56.402 INFO:tasks.workunit.client.0.smithi119.stdout:3/901: unlink d6/d15/d1a/d45/d47/d4d/da7/fd8 0 2024-09-13T21:44:56.405 INFO:tasks.workunit.client.0.smithi119.stdout:2/838: creat d1/d7/d47/df4/f10c x:0 0 0 2024-09-13T21:44:56.405 INFO:tasks.workunit.client.0.smithi119.stdout:4/903: write d4/d1e/d26/d6d/f95 [224435,114757] 0 2024-09-13T21:44:56.407 INFO:tasks.workunit.client.0.smithi119.stdout:3/902: unlink d6/d15/d1a/d45/d47/c50 0 2024-09-13T21:44:56.408 INFO:tasks.workunit.client.0.smithi119.stdout:3/903: dread - d6/f127 zero size 2024-09-13T21:44:56.408 INFO:tasks.workunit.client.1.smithi155.stdout:1/499: dread d6/f33 [0,4194304] 0 2024-09-13T21:44:56.409 INFO:tasks.workunit.client.0.smithi119.stdout:2/839: mkdir d1/d22/d10d 0 2024-09-13T21:44:56.411 INFO:tasks.workunit.client.0.smithi119.stdout:4/904: mkdir d4/d1e/d28/d5d/d129 0 2024-09-13T21:44:56.412 INFO:tasks.workunit.client.0.smithi119.stdout:2/840: mknod d1/d22/d5a/d5d/d77/daa/deb/c10e 0 2024-09-13T21:44:56.412 INFO:tasks.workunit.client.0.smithi119.stdout:3/904: read d6/d15/d1a/faf [3382967,75730] 0 2024-09-13T21:44:56.413 INFO:tasks.workunit.client.1.smithi155.stdout:1/500: chown d6/d15/d23/d87/f71 4118895 1 2024-09-13T21:44:56.413 INFO:tasks.workunit.client.0.smithi119.stdout:4/905: mknod d4/d1e/d10/c12a 0 2024-09-13T21:44:56.414 INFO:tasks.workunit.client.1.smithi155.stdout:1/501: write d6/f16 [8125184,116529] 0 2024-09-13T21:44:56.415 INFO:tasks.workunit.client.1.smithi155.stdout:1/502: write d6/d7/f8 [291977,14564] 0 2024-09-13T21:44:56.415 INFO:tasks.workunit.client.0.smithi119.stdout:2/841: mknod d1/d22/c10f 0 2024-09-13T21:44:56.416 INFO:tasks.workunit.client.1.smithi155.stdout:1/503: write d6/d15/d57/d5d/f7f [546541,40814] 0 2024-09-13T21:44:56.419 INFO:tasks.workunit.client.0.smithi119.stdout:4/906: getdents d4/ddc 0 2024-09-13T21:44:56.419 INFO:tasks.workunit.client.1.smithi155.stdout:1/504: symlink d6/laa 0 2024-09-13T21:44:56.419 INFO:tasks.workunit.client.1.smithi155.stdout:1/505: write d6/d15/d57/d99/f4a [2212023,122654] 0 2024-09-13T21:44:56.420 INFO:tasks.workunit.client.0.smithi119.stdout:2/842: rmdir d1/d7/d47 39 2024-09-13T21:44:56.421 INFO:tasks.workunit.client.1.smithi155.stdout:1/506: rmdir d6/d15/d57 39 2024-09-13T21:44:56.422 INFO:tasks.workunit.client.0.smithi119.stdout:4/907: symlink d4/d1e/d28/d34/d99/df0/d100/l12b 0 2024-09-13T21:44:56.423 INFO:tasks.workunit.client.0.smithi119.stdout:2/843: mkdir d1/d22/d7c/dfe/d110 0 2024-09-13T21:44:56.424 INFO:tasks.workunit.client.1.smithi155.stdout:1/507: read d6/d15/f45 [1097466,39266] 0 2024-09-13T21:44:56.425 INFO:tasks.workunit.client.1.smithi155.stdout:1/508: stat d6/d15/d23/d87/f2a 0 2024-09-13T21:44:56.425 INFO:tasks.workunit.client.0.smithi119.stdout:2/844: read d1/d22/f42 [243030,65837] 0 2024-09-13T21:44:56.426 INFO:tasks.workunit.client.0.smithi119.stdout:4/908: dread d4/d1e/d26/d6d/f72 [4194304,4194304] 0 2024-09-13T21:44:56.426 INFO:tasks.workunit.client.1.smithi155.stdout:1/509: write d6/d15/d57/d99/f4a [2929091,46342] 0 2024-09-13T21:44:56.429 INFO:tasks.workunit.client.1.smithi155.stdout:1/510: truncate d6/d15/d57/d99/f14 2650659 0 2024-09-13T21:44:56.430 INFO:tasks.workunit.client.1.smithi155.stdout:1/511: mkdir d6/d7/d48/dab 0 2024-09-13T21:44:56.431 INFO:tasks.workunit.client.0.smithi119.stdout:4/909: mknod d4/d1e/d28/d34/d6a/d79/d9f/d11d/c12c 0 2024-09-13T21:44:56.431 INFO:tasks.workunit.client.0.smithi119.stdout:3/905: write d6/d15/d103/d95/fa5 [3668636,47082] 0 2024-09-13T21:44:56.431 INFO:tasks.workunit.client.1.smithi155.stdout:1/512: chown d6/d15/d57/d99/c47 48 1 2024-09-13T21:44:56.431 INFO:tasks.workunit.client.0.smithi119.stdout:2/845: getdents d1/d22/d5a/d5d/db7 0 2024-09-13T21:44:56.432 INFO:tasks.workunit.client.1.smithi155.stdout:1/513: write d6/d15/f18 [2592044,70349] 0 2024-09-13T21:44:56.432 INFO:tasks.workunit.client.0.smithi119.stdout:4/910: write d4/d1e/d26/d60/d71/feb [118196,114564] 0 2024-09-13T21:44:56.432 INFO:tasks.workunit.client.0.smithi119.stdout:3/906: chown d6/d25/d2f/d33/d56/fd2 3609 1 2024-09-13T21:44:56.434 INFO:tasks.workunit.client.0.smithi119.stdout:2/846: write d1/d7/d47/df4/f10c [389886,117820] 0 2024-09-13T21:44:56.437 INFO:tasks.workunit.client.0.smithi119.stdout:4/911: truncate d4/d1e/d28/d34/d6a/d79/d9f/dcf/f112 716609 0 2024-09-13T21:44:56.437 INFO:tasks.workunit.client.0.smithi119.stdout:2/847: mkdir d1/d7/d47/df3/d111 0 2024-09-13T21:44:56.439 INFO:tasks.workunit.client.0.smithi119.stdout:3/907: link d6/d25/d2f/d33/d56/fe0 d6/d15/d8f/f129 0 2024-09-13T21:44:56.439 INFO:tasks.workunit.client.1.smithi155.stdout:1/514: truncate d6/d82/f94 1016298 0 2024-09-13T21:44:56.440 INFO:tasks.workunit.client.1.smithi155.stdout:1/515: write d6/f32 [1699720,110527] 0 2024-09-13T21:44:56.440 INFO:tasks.workunit.client.0.smithi119.stdout:2/848: chown d1/d22/d5a/d5d/d77/ca6 67 1 2024-09-13T21:44:56.440 INFO:tasks.workunit.client.0.smithi119.stdout:2/849: chown d1/d9d 45124 1 2024-09-13T21:44:56.441 INFO:tasks.workunit.client.0.smithi119.stdout:4/912: creat d4/d114/de9/df8/f12d x:0 0 0 2024-09-13T21:44:56.443 INFO:tasks.workunit.client.1.smithi155.stdout:1/516: rename d6/d15/d57/d5d/d72/d74 to d6/d7/d48/dab/dac 0 2024-09-13T21:44:56.444 INFO:tasks.workunit.client.1.smithi155.stdout:1/517: write d6/d15/f76 [748461,43442] 0 2024-09-13T21:44:56.445 INFO:tasks.workunit.client.0.smithi119.stdout:4/913: mknod d4/d1e/d28/d5d/c12e 0 2024-09-13T21:44:56.447 INFO:tasks.workunit.client.0.smithi119.stdout:2/850: rename d1/d22/l6f to d1/d22/d7c/dfe/d110/l112 0 2024-09-13T21:44:56.447 INFO:tasks.workunit.client.0.smithi119.stdout:3/908: dwrite d6/d15/d1a/d45/d47/d4d/f82 [0,4194304] 0 2024-09-13T21:44:56.448 INFO:tasks.workunit.client.1.smithi155.stdout:1/518: link d6/d7/d48/f69 d6/d15/d57/d5d/d72/fad 0 2024-09-13T21:44:56.449 INFO:tasks.workunit.client.1.smithi155.stdout:1/519: write d6/d15/d57/d5d/f7f [760552,54909] 0 2024-09-13T21:44:56.450 INFO:tasks.workunit.client.0.smithi119.stdout:2/851: write d1/d22/d5a/d5d/f61 [2791260,128469] 0 2024-09-13T21:44:56.453 INFO:tasks.workunit.client.0.smithi119.stdout:2/852: symlink d1/d103/l113 0 2024-09-13T21:44:56.454 INFO:tasks.workunit.client.1.smithi155.stdout:1/520: creat d6/d15/d23/fae x:0 0 0 2024-09-13T21:44:56.456 INFO:tasks.workunit.client.0.smithi119.stdout:8/916: sync 2024-09-13T21:44:56.456 INFO:tasks.workunit.client.0.smithi119.stdout:0/887: sync 2024-09-13T21:44:56.456 INFO:tasks.workunit.client.0.smithi119.stdout:2/853: read d1/d22/d55/f5e [319710,127411] 0 2024-09-13T21:44:56.457 INFO:tasks.workunit.client.1.smithi155.stdout:1/521: rename d6/d7/d48/dab/dac to d6/d82/d91/daf 0 2024-09-13T21:44:56.459 INFO:tasks.workunit.client.0.smithi119.stdout:0/888: creat de/d1c/d2f/d40/f12e x:0 0 0 2024-09-13T21:44:56.460 INFO:tasks.workunit.client.1.smithi155.stdout:1/522: rename d6/d15/d57/d5d/f6a to d6/d15/d23/d87/d30/d4b/fb0 0 2024-09-13T21:44:56.461 INFO:tasks.workunit.client.0.smithi119.stdout:8/917: rename d1b/d4e/f5a to d1b/d1d/d26/df0/d10b/f117 0 2024-09-13T21:44:56.461 INFO:tasks.workunit.client.0.smithi119.stdout:0/889: write de/d1c/d59/f11e [864135,117091] 0 2024-09-13T21:44:56.464 INFO:tasks.workunit.client.0.smithi119.stdout:4/914: dread d4/d114/de9/df8/f82 [0,4194304] 0 2024-09-13T21:44:56.464 INFO:tasks.workunit.client.0.smithi119.stdout:3/909: dread d6/d15/d1a/f3a [0,4194304] 0 2024-09-13T21:44:56.465 INFO:tasks.workunit.client.1.smithi155.stdout:1/523: dwrite d6/d15/d23/d87/f29 [0,4194304] 0 2024-09-13T21:44:56.466 INFO:tasks.workunit.client.1.smithi155.stdout:1/524: fsync d6/d15/d23/d87/d30/f5b 0 2024-09-13T21:44:56.467 INFO:tasks.workunit.client.0.smithi119.stdout:3/910: creat d6/d15/d10f/f12a x:0 0 0 2024-09-13T21:44:56.470 INFO:tasks.workunit.client.1.smithi155.stdout:1/525: creat d6/d15/d57/d5d/fb1 x:0 0 0 2024-09-13T21:44:56.470 INFO:tasks.workunit.client.0.smithi119.stdout:4/915: rename d4/d1e/d10 to d4/d1e/d28/d34/d99/df0/d100/d12f 0 2024-09-13T21:44:56.470 INFO:tasks.workunit.client.0.smithi119.stdout:3/911: truncate d6/d25/f91 1015615 0 2024-09-13T21:44:56.471 INFO:tasks.workunit.client.1.smithi155.stdout:1/526: creat d6/d7/fb2 x:0 0 0 2024-09-13T21:44:56.472 INFO:tasks.workunit.client.1.smithi155.stdout:1/527: write d6/d15/f58 [1738298,20289] 0 2024-09-13T21:44:56.474 INFO:tasks.workunit.client.1.smithi155.stdout:1/528: write d6/d7/d48/f96 [443895,58347] 0 2024-09-13T21:44:56.475 INFO:tasks.workunit.client.0.smithi119.stdout:3/912: symlink d6/d25/d2f/d33/d56/l12b 0 2024-09-13T21:44:56.476 INFO:tasks.workunit.client.1.smithi155.stdout:1/529: symlink d6/d15/d57/d99/lb3 0 2024-09-13T21:44:56.477 INFO:tasks.workunit.client.0.smithi119.stdout:4/916: creat d4/d1e/d28/d34/f130 x:0 0 0 2024-09-13T21:44:56.479 INFO:tasks.workunit.client.0.smithi119.stdout:3/913: symlink d6/d15/d1a/d45/d47/de3/l12c 0 2024-09-13T21:44:56.481 INFO:tasks.workunit.client.0.smithi119.stdout:2/854: dread d1/d7/f9 [0,4194304] 0 2024-09-13T21:44:56.481 INFO:tasks.workunit.client.0.smithi119.stdout:1/819: sync 2024-09-13T21:44:56.481 INFO:tasks.workunit.client.0.smithi119.stdout:7/969: sync 2024-09-13T21:44:56.482 INFO:tasks.workunit.client.0.smithi119.stdout:6/795: sync 2024-09-13T21:44:56.483 INFO:tasks.workunit.client.0.smithi119.stdout:3/914: mkdir d6/d25/d2f/d12d 0 2024-09-13T21:44:56.484 INFO:tasks.workunit.client.0.smithi119.stdout:4/917: truncate d4/d1e/d28/d34/f3e 4782249 0 2024-09-13T21:44:56.484 INFO:tasks.workunit.client.0.smithi119.stdout:7/970: fdatasync d8/d3c/d53/d37/d83/f142 0 2024-09-13T21:44:56.487 INFO:tasks.workunit.client.0.smithi119.stdout:6/796: symlink dc/df/d32/lf8 0 2024-09-13T21:44:56.489 INFO:tasks.workunit.client.0.smithi119.stdout:8/918: dread d1b/d1d/ffd [0,4194304] 0 2024-09-13T21:44:56.493 INFO:tasks.workunit.client.0.smithi119.stdout:2/855: dread d1/d7/f9 [0,4194304] 0 2024-09-13T21:44:56.493 INFO:tasks.workunit.client.0.smithi119.stdout:0/890: dwrite de/d1c/d59/f71 [0,4194304] 0 2024-09-13T21:44:56.493 INFO:tasks.workunit.client.0.smithi119.stdout:6/797: mkdir dc/d3d/d40/d6b/df9 0 2024-09-13T21:44:56.495 INFO:tasks.workunit.client.0.smithi119.stdout:4/918: creat d4/d1e/d28/d34/d6a/d79/d9f/dcf/f131 x:0 0 0 2024-09-13T21:44:56.497 INFO:tasks.workunit.client.0.smithi119.stdout:7/971: truncate d8/d3c/d53/d37/d83/d89/d3d/f126 453769 0 2024-09-13T21:44:56.498 INFO:tasks.workunit.client.0.smithi119.stdout:3/915: dread d6/d25/d2f/d8e/de2/d109/f124 [0,4194304] 0 2024-09-13T21:44:56.498 INFO:tasks.workunit.client.0.smithi119.stdout:1/820: write d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/f7f [111506,69856] 0 2024-09-13T21:44:56.500 INFO:tasks.workunit.client.0.smithi119.stdout:7/972: dread - d8/d19/dd7/df1/ff7 zero size 2024-09-13T21:44:56.500 INFO:tasks.workunit.client.0.smithi119.stdout:0/891: mknod de/d1c/d2b/d34/c12f 0 2024-09-13T21:44:56.500 INFO:tasks.workunit.client.0.smithi119.stdout:6/798: creat dc/df/d5c/ffa x:0 0 0 2024-09-13T21:44:56.506 INFO:tasks.workunit.client.0.smithi119.stdout:1/821: creat d1/d3/d61/d77/da6/db3/f112 x:0 0 0 2024-09-13T21:44:56.507 INFO:tasks.workunit.client.0.smithi119.stdout:2/856: dwrite d1/d38/d89/d6b/f65 [0,4194304] 0 2024-09-13T21:44:56.507 INFO:tasks.workunit.client.0.smithi119.stdout:4/919: write d4/ddc/df4/f68 [3118146,92829] 0 2024-09-13T21:44:56.510 INFO:tasks.workunit.client.0.smithi119.stdout:0/892: mkdir de/d1c/d2b/d76/d9a/d130 0 2024-09-13T21:44:56.512 INFO:tasks.workunit.client.0.smithi119.stdout:2/857: rename d1/d38/d89/d6b/c49 to d1/d7/d47/df3/d111/c114 0 2024-09-13T21:44:56.513 INFO:tasks.workunit.client.0.smithi119.stdout:1/822: rename d1/d3/d61/d77/d78/db8/dde/df1/df8 to d1/d3/d61/d77/d78/db8/dde/df1/df8/d113 22 2024-09-13T21:44:56.513 INFO:tasks.workunit.client.0.smithi119.stdout:7/973: symlink d8/d3c/d53/d37/d146/l14e 0 2024-09-13T21:44:56.515 INFO:tasks.workunit.client.0.smithi119.stdout:2/858: read d1/d22/d5a/f81 [1712875,49500] 0 2024-09-13T21:44:56.515 INFO:tasks.workunit.client.0.smithi119.stdout:6/799: write dc/d3d/d4e/f74 [1124347,128598] 0 2024-09-13T21:44:56.516 INFO:tasks.workunit.client.0.smithi119.stdout:6/800: chown dc/df/d64/dc0 90300 1 2024-09-13T21:44:56.517 INFO:tasks.workunit.client.0.smithi119.stdout:0/893: mkdir de/d1c/d2f/d35/d4a/d62/d131 0 2024-09-13T21:44:56.518 INFO:tasks.workunit.client.0.smithi119.stdout:3/916: getdents d6/d25/d2f/d33/d56/dab/dc2 0 2024-09-13T21:44:56.520 INFO:tasks.workunit.client.0.smithi119.stdout:7/974: creat d8/d3c/d53/d37/d146/f14f x:0 0 0 2024-09-13T21:44:56.521 INFO:tasks.workunit.client.0.smithi119.stdout:0/894: mkdir de/d1c/d64/d132 0 2024-09-13T21:44:56.521 INFO:tasks.workunit.client.0.smithi119.stdout:7/975: dread - d8/d3c/d53/d37/d146/f14f zero size 2024-09-13T21:44:56.523 INFO:tasks.workunit.client.0.smithi119.stdout:0/895: fsync de/d1c/d2b/dd7/fda 0 2024-09-13T21:44:56.524 INFO:tasks.workunit.client.0.smithi119.stdout:3/917: write d6/f6c [2781000,21336] 0 2024-09-13T21:44:56.525 INFO:tasks.workunit.client.0.smithi119.stdout:0/896: readlink de/d3c/d7c/la9 0 2024-09-13T21:44:56.528 INFO:tasks.workunit.client.0.smithi119.stdout:3/918: read d6/fc [233538,33555] 0 2024-09-13T21:44:56.530 INFO:tasks.workunit.client.0.smithi119.stdout:7/976: link d8/d3c/d53/d37/d57/d8f/f12a d8/d3c/d46/db1/f150 0 2024-09-13T21:44:56.532 INFO:tasks.workunit.client.0.smithi119.stdout:4/920: dread d4/d1e/f36 [0,4194304] 0 2024-09-13T21:44:56.532 INFO:tasks.workunit.client.0.smithi119.stdout:0/897: creat de/d1c/d2f/d35/d90/f133 x:0 0 0 2024-09-13T21:44:56.532 INFO:tasks.workunit.client.0.smithi119.stdout:7/977: dread - d8/d113/f14d zero size 2024-09-13T21:44:56.534 INFO:tasks.workunit.client.0.smithi119.stdout:0/898: write de/d1c/d59/f71 [694601,54967] 0 2024-09-13T21:44:56.537 INFO:tasks.workunit.client.0.smithi119.stdout:3/919: rename d6/d25/d2f/d8e to d6/d15/d8f/d12e 0 2024-09-13T21:44:56.538 INFO:tasks.workunit.client.0.smithi119.stdout:3/920: chown d6/d15/d103/c99 12763 1 2024-09-13T21:44:56.539 INFO:tasks.workunit.client.1.smithi155.stdout:1/530: dwrite d6/f86 [0,4194304] 0 2024-09-13T21:44:56.541 INFO:tasks.workunit.client.0.smithi119.stdout:6/801: dread dc/df/d32/fa2 [0,4194304] 0 2024-09-13T21:44:56.543 INFO:tasks.workunit.client.1.smithi155.stdout:1/531: rename d6/d15/d57/d5d/l7b to d6/d82/d90/lb4 0 2024-09-13T21:44:56.543 INFO:tasks.workunit.client.0.smithi119.stdout:7/978: write d8/d19/d2e/f71 [2666837,36780] 0 2024-09-13T21:44:56.544 INFO:tasks.workunit.client.1.smithi155.stdout:1/532: write d6/f86 [4379986,75568] 0 2024-09-13T21:44:56.544 INFO:tasks.workunit.client.0.smithi119.stdout:0/899: symlink de/d1c/d59/l134 0 2024-09-13T21:44:56.545 INFO:tasks.workunit.client.0.smithi119.stdout:3/921: dread d6/d44/d52/d85/fc5 [0,4194304] 0 2024-09-13T21:44:56.547 INFO:tasks.workunit.client.0.smithi119.stdout:4/921: truncate d4/d1e/d28/d34/d99/df0/d100/d12f/da5/f103 863409 0 2024-09-13T21:44:56.547 INFO:tasks.workunit.client.0.smithi119.stdout:6/802: mkdir dc/d3a/dbb/d7a/de1/dfb 0 2024-09-13T21:44:56.552 INFO:tasks.workunit.client.0.smithi119.stdout:4/922: write d4/f29 [2452953,29174] 0 2024-09-13T21:44:56.553 INFO:tasks.workunit.client.0.smithi119.stdout:6/803: creat dc/d3a/dbb/d7a/d86/ffc x:0 0 0 2024-09-13T21:44:56.553 INFO:tasks.workunit.client.0.smithi119.stdout:3/922: truncate d6/d15/d103/d95/fa8 2748554 0 2024-09-13T21:44:56.554 INFO:tasks.workunit.client.0.smithi119.stdout:7/979: truncate d8/d3c/d53/d37/d57/d8f/fa7 2853765 0 2024-09-13T21:44:56.555 INFO:tasks.workunit.client.0.smithi119.stdout:4/923: readlink d4/d1e/d28/d34/d6a/d79/ld6 0 2024-09-13T21:44:56.556 INFO:tasks.workunit.client.0.smithi119.stdout:0/900: getdents de/d1c/d9c 0 2024-09-13T21:44:56.557 INFO:tasks.workunit.client.0.smithi119.stdout:3/923: fdatasync d6/d15/d103/fe5 0 2024-09-13T21:44:56.558 INFO:tasks.workunit.client.0.smithi119.stdout:4/924: dread d4/d1e/d26/d60/d71/feb [0,4194304] 0 2024-09-13T21:44:56.559 INFO:tasks.workunit.client.0.smithi119.stdout:7/980: fsync d8/d3c/d53/d37/fa1 0 2024-09-13T21:44:56.560 INFO:tasks.workunit.client.0.smithi119.stdout:0/901: truncate de/d1c/d2f/d40/d66/dcb/fe3 283252 0 2024-09-13T21:44:56.561 INFO:tasks.workunit.client.0.smithi119.stdout:3/924: write d6/f6b [69217,42472] 0 2024-09-13T21:44:56.563 INFO:tasks.workunit.client.0.smithi119.stdout:0/902: chown de/d1c/d2f/d35/l98 2568904 1 2024-09-13T21:44:56.566 INFO:tasks.workunit.client.0.smithi119.stdout:4/925: symlink d4/d1e/d28/d34/ddd/d118/l132 0 2024-09-13T21:44:56.568 INFO:tasks.workunit.client.0.smithi119.stdout:4/926: write d4/ddc/df4/f68 [326763,26824] 0 2024-09-13T21:44:56.572 INFO:tasks.workunit.client.0.smithi119.stdout:6/804: truncate dc/df/f12 955923 0 2024-09-13T21:44:56.573 INFO:tasks.workunit.client.0.smithi119.stdout:3/925: write d6/d15/d8f/d12e/de2/d109/f124 [528371,10570] 0 2024-09-13T21:44:56.575 INFO:tasks.workunit.client.0.smithi119.stdout:6/805: creat dc/df/d41/dae/ffd x:0 0 0 2024-09-13T21:44:56.578 INFO:tasks.workunit.client.0.smithi119.stdout:6/806: unlink dc/df/d41/f5d 0 2024-09-13T21:44:56.582 INFO:tasks.workunit.client.0.smithi119.stdout:6/807: mknod dc/d3a/dbb/d7a/de1/de4/cfe 0 2024-09-13T21:44:56.588 INFO:tasks.workunit.client.0.smithi119.stdout:3/926: dwrite d6/d44/d52/f58 [0,4194304] 0 2024-09-13T21:44:56.599 INFO:tasks.workunit.client.0.smithi119.stdout:0/903: dread de/d1c/d2b/d34/f3a [4194304,4194304] 0 2024-09-13T21:44:56.600 INFO:tasks.workunit.client.0.smithi119.stdout:6/808: dwrite dc/d3d/d4e/d91/f9a [4194304,4194304] 0 2024-09-13T21:44:56.601 INFO:tasks.workunit.client.0.smithi119.stdout:3/927: dwrite d6/f13 [0,4194304] 0 2024-09-13T21:44:56.603 INFO:tasks.workunit.client.0.smithi119.stdout:0/904: symlink de/d1c/d2f/d35/d4a/dac/l135 0 2024-09-13T21:44:56.604 INFO:tasks.workunit.client.0.smithi119.stdout:3/928: write d6/d25/d2f/d33/f71 [1563652,102567] 0 2024-09-13T21:44:56.608 INFO:tasks.workunit.client.0.smithi119.stdout:3/929: fdatasync d6/d15/d1a/d45/f5f 0 2024-09-13T21:44:56.609 INFO:tasks.workunit.client.0.smithi119.stdout:6/809: mknod dc/df/d64/dc0/cff 0 2024-09-13T21:44:56.609 INFO:tasks.workunit.client.1.smithi155.stdout:1/533: dwrite d6/d7/d48/f69 [0,4194304] 0 2024-09-13T21:44:56.611 INFO:tasks.workunit.client.0.smithi119.stdout:0/905: creat de/d1c/d2f/d35/d4a/d62/f136 x:0 0 0 2024-09-13T21:44:56.611 INFO:tasks.workunit.client.0.smithi119.stdout:3/930: fdatasync d6/d44/d52/d85/fc5 0 2024-09-13T21:44:56.612 INFO:tasks.workunit.client.1.smithi155.stdout:1/534: mknod d6/d15/d23/d87/d30/cb5 0 2024-09-13T21:44:56.614 INFO:tasks.workunit.client.0.smithi119.stdout:6/810: fsync dc/df/d64/fec 0 2024-09-13T21:44:56.614 INFO:tasks.workunit.client.1.smithi155.stdout:1/535: symlink d6/d15/d57/lb6 0 2024-09-13T21:44:56.618 INFO:tasks.workunit.client.1.smithi155.stdout:1/536: link d6/d15/d57/d99/lb3 d6/d82/d90/lb7 0 2024-09-13T21:44:56.621 INFO:tasks.workunit.client.1.smithi155.stdout:1/537: creat d6/d15/d23/fb8 x:0 0 0 2024-09-13T21:44:56.623 INFO:tasks.workunit.client.1.smithi155.stdout:1/538: write d6/d15/f45 [1908994,62057] 0 2024-09-13T21:44:56.651 INFO:tasks.workunit.client.0.smithi119.stdout:5/906: sync 2024-09-13T21:44:56.670 INFO:tasks.workunit.client.0.smithi119.stdout:5/907: dread d0/d3/f15 [4194304,4194304] 0 2024-09-13T21:44:56.671 INFO:tasks.workunit.client.0.smithi119.stdout:6/811: rename dc/d4b/ca9 to dc/df/d65/c100 0 2024-09-13T21:44:56.674 INFO:tasks.workunit.client.0.smithi119.stdout:0/906: getdents de/d1c/d2b/d76/d9b 0 2024-09-13T21:44:56.678 INFO:tasks.workunit.client.0.smithi119.stdout:6/812: truncate dc/d3d/d40/f49 11924076 0 2024-09-13T21:44:56.764 INFO:tasks.workunit.client.1.smithi155.stdout:8/426: sync 2024-09-13T21:44:56.764 INFO:tasks.workunit.client.1.smithi155.stdout:3/528: sync 2024-09-13T21:44:56.766 INFO:tasks.workunit.client.1.smithi155.stdout:8/427: unlink d2/d6/c18 0 2024-09-13T21:44:56.767 INFO:tasks.workunit.client.1.smithi155.stdout:3/529: mknod d3/d21/d2c/cb7 0 2024-09-13T21:44:56.768 INFO:tasks.workunit.client.1.smithi155.stdout:8/428: creat d2/d8/f80 x:0 0 0 2024-09-13T21:44:56.769 INFO:tasks.workunit.client.1.smithi155.stdout:3/530: mknod d3/d25/d17/d52/cb8 0 2024-09-13T21:44:56.769 INFO:tasks.workunit.client.0.smithi119.stdout:3/931: dwrite d6/f12 [0,4194304] 0 2024-09-13T21:44:56.770 INFO:tasks.workunit.client.1.smithi155.stdout:8/429: symlink d2/d8/d75/l81 0 2024-09-13T21:44:56.771 INFO:tasks.workunit.client.1.smithi155.stdout:3/531: creat d3/d25/d1b/d1f/d36/d5c/fb9 x:0 0 0 2024-09-13T21:44:56.773 INFO:tasks.workunit.client.1.smithi155.stdout:8/430: fdatasync d2/d6/dd/d12/f21 0 2024-09-13T21:44:56.774 INFO:tasks.workunit.client.1.smithi155.stdout:3/532: mkdir d3/d25/d1b/d1f/d36/d5c/dba 0 2024-09-13T21:44:56.775 INFO:tasks.workunit.client.1.smithi155.stdout:3/533: chown d3/fa 448 1 2024-09-13T21:44:56.775 INFO:tasks.workunit.client.1.smithi155.stdout:8/431: mkdir d2/d8/d75/d82 0 2024-09-13T21:44:56.777 INFO:tasks.workunit.client.1.smithi155.stdout:3/534: write d3/d25/d1b/d1f/d82/d83/f8a [711547,64486] 0 2024-09-13T21:44:56.782 INFO:tasks.workunit.client.1.smithi155.stdout:8/432: dwrite d2/d1f/f2b [0,4194304] 0 2024-09-13T21:44:56.789 INFO:tasks.workunit.client.1.smithi155.stdout:8/433: read d2/f4b [134809,96038] 0 2024-09-13T21:44:56.789 INFO:tasks.workunit.client.1.smithi155.stdout:8/434: chown d2/f4b 323613 1 2024-09-13T21:44:56.792 INFO:tasks.workunit.client.1.smithi155.stdout:8/435: symlink d2/d8/d75/l83 0 2024-09-13T21:44:56.793 INFO:tasks.workunit.client.1.smithi155.stdout:8/436: unlink d2/d2d/c7b 0 2024-09-13T21:44:56.794 INFO:tasks.workunit.client.0.smithi119.stdout:6/813: dwrite dc/d4b/f8c [0,4194304] 0 2024-09-13T21:44:56.796 INFO:tasks.workunit.client.1.smithi155.stdout:8/437: creat d2/d1f/f84 x:0 0 0 2024-09-13T21:44:56.798 INFO:tasks.workunit.client.0.smithi119.stdout:5/908: rename d0/d3/f11 to d0/d3/d4/d9/d1e/da5/d121/f128 0 2024-09-13T21:44:56.799 INFO:tasks.workunit.client.1.smithi155.stdout:3/535: dread d3/d25/d1b/d1f/d36/d5c/d66/fa1 [0,4194304] 0 2024-09-13T21:44:56.800 INFO:tasks.workunit.client.0.smithi119.stdout:5/909: chown d0/d3/d4/def/dd6 48612 1 2024-09-13T21:44:56.800 INFO:tasks.workunit.client.0.smithi119.stdout:6/814: unlink dc/df/d64/fe0 0 2024-09-13T21:44:56.800 INFO:tasks.workunit.client.1.smithi155.stdout:3/536: dread - d3/d25/d17/d3b/f95 zero size 2024-09-13T21:44:56.801 INFO:tasks.workunit.client.1.smithi155.stdout:8/438: dread d2/d6/dd/d12/f1e [0,4194304] 0 2024-09-13T21:44:56.802 INFO:tasks.workunit.client.1.smithi155.stdout:8/439: chown d2/d6/dd/d12/l40 10648 1 2024-09-13T21:44:56.803 INFO:tasks.workunit.client.0.smithi119.stdout:0/907: rename de/d4e/d7f/ded/f129 to de/d1c/d2f/d40/d66/dcb/dd6/d83/f137 0 2024-09-13T21:44:56.807 INFO:tasks.workunit.client.0.smithi119.stdout:3/932: rename d6/d15/d1a/ff9 to d6/d25/d2f/d33/d88/d96/f12f 0 2024-09-13T21:44:56.807 INFO:tasks.workunit.client.0.smithi119.stdout:3/933: chown d6/d44/f5a 0 1 2024-09-13T21:44:56.808 INFO:tasks.workunit.client.1.smithi155.stdout:3/537: dwrite d3/d10/f8d [0,4194304] 0 2024-09-13T21:44:56.809 INFO:tasks.workunit.client.0.smithi119.stdout:5/910: getdents d0/d3/d4/d2e/d65/df6 0 2024-09-13T21:44:56.811 INFO:tasks.workunit.client.1.smithi155.stdout:8/440: dwrite d2/d6/dd/d25/f4c [0,4194304] 0 2024-09-13T21:44:56.814 INFO:tasks.workunit.client.0.smithi119.stdout:3/934: creat d6/d25/d2f/d33/d88/f130 x:0 0 0 2024-09-13T21:44:56.814 INFO:tasks.workunit.client.0.smithi119.stdout:0/908: dwrite de/d1c/d2f/d40/d66/dcb/dd6/d83/f137 [4194304,4194304] 0 2024-09-13T21:44:56.815 INFO:tasks.workunit.client.1.smithi155.stdout:3/538: dwrite d3/d25/d17/d52/fac [0,4194304] 0 2024-09-13T21:44:56.817 INFO:tasks.workunit.client.1.smithi155.stdout:2/441: sync 2024-09-13T21:44:56.817 INFO:tasks.workunit.client.1.smithi155.stdout:9/575: sync 2024-09-13T21:44:56.818 INFO:tasks.workunit.client.1.smithi155.stdout:0/569: sync 2024-09-13T21:44:56.818 INFO:tasks.workunit.client.1.smithi155.stdout:6/592: sync 2024-09-13T21:44:56.818 INFO:tasks.workunit.client.1.smithi155.stdout:1/539: sync 2024-09-13T21:44:56.818 INFO:tasks.workunit.client.1.smithi155.stdout:7/490: sync 2024-09-13T21:44:56.818 INFO:tasks.workunit.client.1.smithi155.stdout:5/484: sync 2024-09-13T21:44:56.818 INFO:tasks.workunit.client.1.smithi155.stdout:4/479: sync 2024-09-13T21:44:56.818 INFO:tasks.workunit.client.1.smithi155.stdout:8/441: dread - d2/d6/dd/d12/f46 zero size 2024-09-13T21:44:56.818 INFO:tasks.workunit.client.0.smithi119.stdout:3/935: chown d6/d15/d1a/d45/d47/d4d/fee 407268 1 2024-09-13T21:44:56.819 INFO:tasks.workunit.client.0.smithi119.stdout:0/909: fsync de/d1c/d59/f71 0 2024-09-13T21:44:56.823 INFO:tasks.workunit.client.0.smithi119.stdout:3/936: mknod d6/d15/d8f/d12e/c131 0 2024-09-13T21:44:56.823 INFO:tasks.workunit.client.1.smithi155.stdout:2/442: chown d2/dd/d3d 1 1 2024-09-13T21:44:56.824 INFO:tasks.workunit.client.1.smithi155.stdout:5/485: stat d5/d16/d33/d1f/f4f 0 2024-09-13T21:44:56.825 INFO:tasks.workunit.client.0.smithi119.stdout:0/910: rename de/d1c/d2f/lca to de/d1c/d2f/d35/dce/l138 0 2024-09-13T21:44:56.827 INFO:tasks.workunit.client.0.smithi119.stdout:3/937: mkdir d6/d15/d1a/d45/d47/d4d/dcf/d132 0 2024-09-13T21:44:56.828 INFO:tasks.workunit.client.0.smithi119.stdout:0/911: fsync de/d1c/d2f/d35/d4a/f105 0 2024-09-13T21:44:56.828 INFO:tasks.workunit.client.0.smithi119.stdout:6/815: dwrite dc/d3d/d4e/f9b [0,4194304] 0 2024-09-13T21:44:56.830 INFO:tasks.workunit.client.1.smithi155.stdout:8/442: write d2/d6/dd/d12/f7d [639012,720] 0 2024-09-13T21:44:56.830 INFO:tasks.workunit.client.1.smithi155.stdout:9/576: rmdir dc/d19/d23/d38 39 2024-09-13T21:44:56.831 INFO:tasks.workunit.client.1.smithi155.stdout:3/539: mkdir d3/dbb 0 2024-09-13T21:44:56.832 INFO:tasks.workunit.client.1.smithi155.stdout:2/443: write d2/dd/de/d15/d2e/d31/f80 [764104,124361] 0 2024-09-13T21:44:56.832 INFO:tasks.workunit.client.1.smithi155.stdout:6/593: creat db/d11/d5b/fbd x:0 0 0 2024-09-13T21:44:56.835 INFO:tasks.workunit.client.1.smithi155.stdout:0/570: mknod d1/d6/dc/d4d/d4a/d52/d5c/d6a/cdb 0 2024-09-13T21:44:56.836 INFO:tasks.workunit.client.1.smithi155.stdout:7/491: mknod d5/d10/d3e/d40/c9c 0 2024-09-13T21:44:56.836 INFO:tasks.workunit.client.1.smithi155.stdout:8/443: fdatasync d2/d1f/f70 0 2024-09-13T21:44:56.838 INFO:tasks.workunit.client.1.smithi155.stdout:3/540: mkdir d3/d25/d1b/d1f/d36/d5c/dbc 0 2024-09-13T21:44:56.839 INFO:tasks.workunit.client.1.smithi155.stdout:2/444: chown d2/dd/de/d15/d2e/d31/f80 1 1 2024-09-13T21:44:56.839 INFO:tasks.workunit.client.1.smithi155.stdout:4/480: symlink d1/d7/de/d15/d55/d5e/d66/l92 0 2024-09-13T21:44:56.841 INFO:tasks.workunit.client.1.smithi155.stdout:7/492: chown d5/d3b/f42 638340666 1 2024-09-13T21:44:56.841 INFO:tasks.workunit.client.1.smithi155.stdout:6/594: creat db/d11/d2b/d35/fbe x:0 0 0 2024-09-13T21:44:56.841 INFO:tasks.workunit.client.1.smithi155.stdout:1/540: dread d6/d82/d91/daf/f9f [0,4194304] 0 2024-09-13T21:44:56.841 INFO:tasks.workunit.client.1.smithi155.stdout:8/444: creat d2/d6/dd/d25/f85 x:0 0 0 2024-09-13T21:44:56.842 INFO:tasks.workunit.client.1.smithi155.stdout:7/493: chown d5/d3b 11438076 1 2024-09-13T21:44:56.843 INFO:tasks.workunit.client.1.smithi155.stdout:4/481: rename d1/d7/de to d1/d7/de/dc/d4a/d75/d93 22 2024-09-13T21:44:56.844 INFO:tasks.workunit.client.1.smithi155.stdout:3/541: creat d3/dbb/fbd x:0 0 0 2024-09-13T21:44:56.844 INFO:tasks.workunit.client.1.smithi155.stdout:9/577: dread dc/d18/d1e/f64 [0,4194304] 0 2024-09-13T21:44:56.846 INFO:tasks.workunit.client.1.smithi155.stdout:0/571: rename d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8 to d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/d82/ddc 22 2024-09-13T21:44:56.847 INFO:tasks.workunit.client.0.smithi119.stdout:0/912: fsync de/d1c/d2f/d40/d66/ffa 0 2024-09-13T21:44:56.847 INFO:tasks.workunit.client.1.smithi155.stdout:8/445: truncate d2/d1f/f53 41426 0 2024-09-13T21:44:56.852 INFO:tasks.workunit.client.1.smithi155.stdout:9/578: read - dc/d18/f60 zero size 2024-09-13T21:44:56.852 INFO:tasks.workunit.client.1.smithi155.stdout:1/541: truncate d6/d15/d23/d87/d95/f97 1003002 0 2024-09-13T21:44:56.852 INFO:tasks.workunit.client.1.smithi155.stdout:4/482: dread d1/d7/f6b [0,4194304] 0 2024-09-13T21:44:56.852 INFO:tasks.workunit.client.1.smithi155.stdout:0/572: write d1/f34 [1044032,42287] 0 2024-09-13T21:44:56.853 INFO:tasks.workunit.client.0.smithi119.stdout:6/816: dread - dc/d3a/dbb/d7a/de1/f94 zero size 2024-09-13T21:44:56.853 INFO:tasks.workunit.client.0.smithi119.stdout:6/817: dread - dc/df/d41/fc3 zero size 2024-09-13T21:44:56.853 INFO:tasks.workunit.client.0.smithi119.stdout:6/818: read - dc/df/d41/dae/ffd zero size 2024-09-13T21:44:56.853 INFO:tasks.workunit.client.0.smithi119.stdout:3/938: read d6/d15/d1a/d45/f5f [3027948,122378] 0 2024-09-13T21:44:56.853 INFO:tasks.workunit.client.0.smithi119.stdout:6/819: dread - dc/d3d/d40/d68/fcc zero size 2024-09-13T21:44:56.853 INFO:tasks.workunit.client.0.smithi119.stdout:3/939: mkdir d6/d133 0 2024-09-13T21:44:56.853 INFO:tasks.workunit.client.0.smithi119.stdout:6/820: chown dc/d3d/d40/f69 7 1 2024-09-13T21:44:56.855 INFO:tasks.workunit.client.0.smithi119.stdout:3/940: truncate d6/d15/d103/feb 1504980 0 2024-09-13T21:44:56.856 INFO:tasks.workunit.client.0.smithi119.stdout:5/911: dread d0/d3/d4/d9/d14/d24/db6/de5/f11a [0,4194304] 0 2024-09-13T21:44:56.856 INFO:tasks.workunit.client.0.smithi119.stdout:6/821: symlink dc/d3a/dbb/d7a/de1/l101 0 2024-09-13T21:44:56.860 INFO:tasks.workunit.client.1.smithi155.stdout:6/595: dwrite db/d3d/d5f/f84 [0,4194304] 0 2024-09-13T21:44:56.860 INFO:tasks.workunit.client.1.smithi155.stdout:1/542: unlink d6/d15/f76 0 2024-09-13T21:44:56.861 INFO:tasks.workunit.client.0.smithi119.stdout:5/912: write d0/d3/d4/def/d10f/f6f [2715690,6830] 0 2024-09-13T21:44:56.864 INFO:tasks.workunit.client.1.smithi155.stdout:7/494: dwrite d5/df/d60/d6d/f7a [0,4194304] 0 2024-09-13T21:44:56.864 INFO:tasks.workunit.client.0.smithi119.stdout:3/941: dwrite d6/d25/d2f/d33/d56/da0/fb5 [0,4194304] 0 2024-09-13T21:44:56.865 INFO:tasks.workunit.client.0.smithi119.stdout:5/913: chown d0/d3/d4/d9/d14/f17 3 1 2024-09-13T21:44:56.868 INFO:tasks.workunit.client.0.smithi119.stdout:6/822: dwrite dc/df/d41/f82 [0,4194304] 0 2024-09-13T21:44:56.868 INFO:tasks.workunit.client.0.smithi119.stdout:3/942: dread - d6/d25/d2f/d33/d56/f9b zero size 2024-09-13T21:44:56.872 INFO:tasks.workunit.client.0.smithi119.stdout:5/914: unlink d0/d3/d4/d2e/ca6 0 2024-09-13T21:44:56.872 INFO:tasks.workunit.client.0.smithi119.stdout:0/913: dwrite de/d4e/fe0 [0,4194304] 0 2024-09-13T21:44:56.873 INFO:tasks.workunit.client.0.smithi119.stdout:6/823: mkdir dc/d4b/d6a/d75/d102 0 2024-09-13T21:44:56.874 INFO:tasks.workunit.client.1.smithi155.stdout:6/596: dwrite db/d11/d4c/d64/d5e/f68 [0,4194304] 0 2024-09-13T21:44:56.874 INFO:tasks.workunit.client.0.smithi119.stdout:3/943: write d6/f100 [780803,19188] 0 2024-09-13T21:44:56.874 INFO:tasks.workunit.client.0.smithi119.stdout:0/914: dread - de/d1c/d2f/d40/f12e zero size 2024-09-13T21:44:56.877 INFO:tasks.workunit.client.0.smithi119.stdout:5/915: read d0/d3/d1f/d21/d4f/fbd [724237,29275] 0 2024-09-13T21:44:56.878 INFO:tasks.workunit.client.0.smithi119.stdout:6/824: write dc/df/d41/dbf/fe5 [4663466,11882] 0 2024-09-13T21:44:56.878 INFO:tasks.workunit.client.0.smithi119.stdout:3/944: fdatasync d6/d25/d2f/d33/d88/db9/fcd 0 2024-09-13T21:44:56.879 INFO:tasks.workunit.client.0.smithi119.stdout:0/915: rmdir de/d1c/d64 39 2024-09-13T21:44:56.881 INFO:tasks.workunit.client.0.smithi119.stdout:3/945: chown d6/c17 59109590 1 2024-09-13T21:44:56.881 INFO:tasks.workunit.client.1.smithi155.stdout:8/446: write d2/d8/d65/f41 [1370502,79408] 0 2024-09-13T21:44:56.881 INFO:tasks.workunit.client.0.smithi119.stdout:5/916: write d0/d3/d1f/d21/d4f/d86/fc1 [346987,113817] 0 2024-09-13T21:44:56.883 INFO:tasks.workunit.client.1.smithi155.stdout:7/495: write d5/d13/f3d [302510,22519] 0 2024-09-13T21:44:56.883 INFO:tasks.workunit.client.0.smithi119.stdout:6/825: fdatasync dc/d3a/dbb/d7a/d86/fb9 0 2024-09-13T21:44:56.884 INFO:tasks.workunit.client.1.smithi155.stdout:6/597: write db/d11/d4c/d64/d88/f98 [341419,11690] 0 2024-09-13T21:44:56.885 INFO:tasks.workunit.client.1.smithi155.stdout:9/579: rmdir dc/d19/d23/d38/d90 39 2024-09-13T21:44:56.886 INFO:tasks.workunit.client.0.smithi119.stdout:3/946: rename d6/d15/c62 to d6/d25/d2f/d33/d56/dab/c134 0 2024-09-13T21:44:56.891 INFO:tasks.workunit.client.1.smithi155.stdout:7/496: write d5/d10/d3e/d3f/f66 [504009,106170] 0 2024-09-13T21:44:56.891 INFO:tasks.workunit.client.1.smithi155.stdout:6/598: fsync db/d11/d2b/d35/fbe 0 2024-09-13T21:44:56.891 INFO:tasks.workunit.client.1.smithi155.stdout:1/543: mkdir d6/d15/d23/d55/db9 0 2024-09-13T21:44:56.892 INFO:tasks.workunit.client.0.smithi119.stdout:0/916: getdents de/d1c 0 2024-09-13T21:44:56.892 INFO:tasks.workunit.client.0.smithi119.stdout:6/826: mknod dc/d3a/dbb/d7a/dd2/c103 0 2024-09-13T21:44:56.892 INFO:tasks.workunit.client.0.smithi119.stdout:5/917: rename d0/d3/f15 to d0/d3/f129 0 2024-09-13T21:44:56.892 INFO:tasks.workunit.client.0.smithi119.stdout:6/827: mknod dc/d3d/d40/c104 0 2024-09-13T21:44:56.893 INFO:tasks.workunit.client.1.smithi155.stdout:5/486: dwrite d5/d16/f32 [0,4194304] 0 2024-09-13T21:44:56.893 INFO:tasks.workunit.client.1.smithi155.stdout:8/447: symlink d2/d8/d75/l86 0 2024-09-13T21:44:56.893 INFO:tasks.workunit.client.0.smithi119.stdout:0/917: mknod de/d1c/d2b/d76/c139 0 2024-09-13T21:44:56.893 INFO:tasks.workunit.client.0.smithi119.stdout:0/918: readlink de/l15 0 2024-09-13T21:44:56.894 INFO:tasks.workunit.client.0.smithi119.stdout:6/828: mknod dc/d4b/d97/c105 0 2024-09-13T21:44:56.894 INFO:tasks.workunit.client.0.smithi119.stdout:5/918: truncate d0/d3/d4/d9/d1e/f72 1295721 0 2024-09-13T21:44:56.895 INFO:tasks.workunit.client.1.smithi155.stdout:8/448: truncate d2/d2d/f69 1086857 0 2024-09-13T21:44:56.896 INFO:tasks.workunit.client.1.smithi155.stdout:9/580: fdatasync dc/d19/d23/d38/d90/f8d 0 2024-09-13T21:44:56.896 INFO:tasks.workunit.client.0.smithi119.stdout:3/947: rename d6/d15/d103/d95/fa8 to d6/d25/d2f/d33/d56/dab/dc2/f135 0 2024-09-13T21:44:56.896 INFO:tasks.workunit.client.1.smithi155.stdout:7/497: chown d5/d10/d3e/d40/f70 5 1 2024-09-13T21:44:56.898 INFO:tasks.workunit.client.1.smithi155.stdout:7/498: stat d5/d10/d48 0 2024-09-13T21:44:56.899 INFO:tasks.workunit.client.0.smithi119.stdout:3/948: creat d6/d15/d8f/d12e/f136 x:0 0 0 2024-09-13T21:44:56.900 INFO:tasks.workunit.client.1.smithi155.stdout:7/499: write d5/df/f85 [373033,14860] 0 2024-09-13T21:44:56.901 INFO:tasks.workunit.client.1.smithi155.stdout:4/483: rename d1/l4c to d1/d7/d21/l94 0 2024-09-13T21:44:56.901 INFO:tasks.workunit.client.0.smithi119.stdout:6/829: creat dc/d4b/f106 x:0 0 0 2024-09-13T21:44:56.901 INFO:tasks.workunit.client.0.smithi119.stdout:0/919: rmdir de/d1c/d59/da8/d100 0 2024-09-13T21:44:56.903 INFO:tasks.workunit.client.0.smithi119.stdout:6/830: creat dc/d3d/dcf/f107 x:0 0 0 2024-09-13T21:44:56.903 INFO:tasks.workunit.client.0.smithi119.stdout:0/920: chown de/d1c/d59/f71 114300 1 2024-09-13T21:44:56.903 INFO:tasks.workunit.client.0.smithi119.stdout:3/949: write d6/f14 [753408,37724] 0 2024-09-13T21:44:56.904 INFO:tasks.workunit.client.0.smithi119.stdout:0/921: dread - de/d1c/d2f/f112 zero size 2024-09-13T21:44:56.904 INFO:tasks.workunit.client.0.smithi119.stdout:6/831: chown dc/df/d6d/l7f 14 1 2024-09-13T21:44:56.905 INFO:tasks.workunit.client.1.smithi155.stdout:5/487: fdatasync d5/d16/d33/d1b/d1e/f72 0 2024-09-13T21:44:56.905 INFO:tasks.workunit.client.1.smithi155.stdout:3/542: truncate d3/d25/d1b/d1f/f92 1374729 0 2024-09-13T21:44:56.906 INFO:tasks.workunit.client.0.smithi119.stdout:6/832: stat dc/d4b/d97/c9f 0 2024-09-13T21:44:56.906 INFO:tasks.workunit.client.1.smithi155.stdout:5/488: chown d5/f7 17103284 1 2024-09-13T21:44:56.906 INFO:tasks.workunit.client.1.smithi155.stdout:8/449: mkdir d2/d1f/d87 0 2024-09-13T21:44:56.907 INFO:tasks.workunit.client.0.smithi119.stdout:0/922: truncate de/d1c/d2f/d35/d4a/f118 658752 0 2024-09-13T21:44:56.908 INFO:tasks.workunit.client.1.smithi155.stdout:6/599: symlink db/d11/d4c/d7c/db0/lbf 0 2024-09-13T21:44:56.910 INFO:tasks.workunit.client.1.smithi155.stdout:0/573: getdents d1/d6/dc/d4d/d4a/d4e 0 2024-09-13T21:44:56.912 INFO:tasks.workunit.client.0.smithi119.stdout:3/950: getdents d6/d25/d2f/d33/d88/db9 0 2024-09-13T21:44:56.913 INFO:tasks.workunit.client.1.smithi155.stdout:0/574: chown d1/f2f 0 1 2024-09-13T21:44:56.913 INFO:tasks.workunit.client.1.smithi155.stdout:8/450: creat d2/d6/dd/d6b/f88 x:0 0 0 2024-09-13T21:44:56.913 INFO:tasks.workunit.client.1.smithi155.stdout:9/581: creat dc/d19/d21/fca x:0 0 0 2024-09-13T21:44:56.914 INFO:tasks.workunit.client.0.smithi119.stdout:0/923: dwrite de/d4e/da5/ff3 [0,4194304] 0 2024-09-13T21:44:56.915 INFO:tasks.workunit.client.1.smithi155.stdout:6/600: readlink db/d11/d6d/db9/d1c/d36/d37/l47 0 2024-09-13T21:44:56.915 INFO:tasks.workunit.client.1.smithi155.stdout:4/484: truncate d1/d7/d21/d2d/f53 381413 0 2024-09-13T21:44:56.915 INFO:tasks.workunit.client.1.smithi155.stdout:1/544: dwrite d6/d15/f18 [4194304,4194304] 0 2024-09-13T21:44:56.919 INFO:tasks.workunit.client.1.smithi155.stdout:6/601: unlink f0 0 2024-09-13T21:44:56.923 INFO:tasks.workunit.client.1.smithi155.stdout:0/575: creat d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/fdd x:0 0 0 2024-09-13T21:44:56.923 INFO:tasks.workunit.client.1.smithi155.stdout:6/602: stat db/d11/d6d/db9/d90 0 2024-09-13T21:44:56.925 INFO:tasks.workunit.client.1.smithi155.stdout:1/545: creat d6/d15/fba x:0 0 0 2024-09-13T21:44:56.926 INFO:tasks.workunit.client.1.smithi155.stdout:3/543: dwrite d3/d25/f94 [0,4194304] 0 2024-09-13T21:44:56.928 INFO:tasks.workunit.client.1.smithi155.stdout:6/603: mkdir db/d2c/dc0 0 2024-09-13T21:44:56.928 INFO:tasks.workunit.client.1.smithi155.stdout:9/582: link dc/d18/l51 dc/de/d6f/da3/lcb 0 2024-09-13T21:44:56.932 INFO:tasks.workunit.client.1.smithi155.stdout:1/546: truncate d6/d15/fba 844358 0 2024-09-13T21:44:56.933 INFO:tasks.workunit.client.1.smithi155.stdout:0/576: rename d1/d6/f1e to d1/d6/d97/db2/db5/fde 0 2024-09-13T21:44:56.933 INFO:tasks.workunit.client.1.smithi155.stdout:4/485: dwrite d1/f3b [0,4194304] 0 2024-09-13T21:44:56.935 INFO:tasks.workunit.client.1.smithi155.stdout:9/583: mkdir dc/d18/d1e/dcc 0 2024-09-13T21:44:56.936 INFO:tasks.workunit.client.1.smithi155.stdout:0/577: truncate d1/d6/dc/d4d/d4a/f98 1540230 0 2024-09-13T21:44:56.937 INFO:tasks.workunit.client.1.smithi155.stdout:6/604: creat db/d11/d4c/d7c/d8b/fc1 x:0 0 0 2024-09-13T21:44:56.939 INFO:tasks.workunit.client.1.smithi155.stdout:4/486: creat d1/d48/f95 x:0 0 0 2024-09-13T21:44:56.939 INFO:tasks.workunit.client.1.smithi155.stdout:3/544: dread d3/d10/f8d [0,4194304] 0 2024-09-13T21:44:56.942 INFO:tasks.workunit.client.0.smithi119.stdout:5/919: write d0/d3/d4/def/dd6/fe9 [503381,40463] 0 2024-09-13T21:44:56.943 INFO:tasks.workunit.client.1.smithi155.stdout:6/605: write db/d11/d6d/db9/f1a [3659058,59349] 0 2024-09-13T21:44:56.943 INFO:tasks.workunit.client.0.smithi119.stdout:5/920: chown d0/d3/d4/d9/d14/d24/ff7 440507 1 2024-09-13T21:44:56.944 INFO:tasks.workunit.client.1.smithi155.stdout:4/487: creat d1/d7/d21/d69/f96 x:0 0 0 2024-09-13T21:44:56.945 INFO:tasks.workunit.client.1.smithi155.stdout:7/500: write d5/d10/d48/f7b [748288,45798] 0 2024-09-13T21:44:56.945 INFO:tasks.workunit.client.0.smithi119.stdout:3/951: write d6/d25/f61 [803353,63608] 0 2024-09-13T21:44:56.945 INFO:tasks.workunit.client.1.smithi155.stdout:0/578: mknod d1/d6/dc/d4d/d4a/d52/d5c/d6a/dd8/cdf 0 2024-09-13T21:44:56.946 INFO:tasks.workunit.client.0.smithi119.stdout:5/921: chown d0/d3/d1f/d21/l23 7 1 2024-09-13T21:44:56.948 INFO:tasks.workunit.client.1.smithi155.stdout:7/501: fsync d5/df/f6e 0 2024-09-13T21:44:56.949 INFO:tasks.workunit.client.1.smithi155.stdout:3/545: creat d3/d25/d1b/d1f/d82/d83/fbe x:0 0 0 2024-09-13T21:44:56.949 INFO:tasks.workunit.client.1.smithi155.stdout:6/606: rename db/d80 to db/d2c/dbc/dc2 0 2024-09-13T21:44:56.949 INFO:tasks.workunit.client.1.smithi155.stdout:4/488: mknod d1/d7/de/d1a/c97 0 2024-09-13T21:44:56.950 INFO:tasks.workunit.client.1.smithi155.stdout:0/579: mkdir d1/d6/dc/d4d/d4a/d9e/de0 0 2024-09-13T21:44:56.952 INFO:tasks.workunit.client.0.smithi119.stdout:6/833: dwrite dc/df/d65/fb2 [0,4194304] 0 2024-09-13T21:44:56.952 INFO:tasks.workunit.client.0.smithi119.stdout:3/952: truncate d6/d15/da9/fdb 2344088 0 2024-09-13T21:44:56.953 INFO:tasks.workunit.client.0.smithi119.stdout:5/922: creat d0/d3/d4/d9/d1e/da5/d121/f12a x:0 0 0 2024-09-13T21:44:56.953 INFO:tasks.workunit.client.0.smithi119.stdout:0/924: dwrite de/d1c/f20 [0,4194304] 0 2024-09-13T21:44:56.954 INFO:tasks.workunit.client.1.smithi155.stdout:3/546: write d3/d25/d1b/d1f/d36/d7c/f9e [1151583,81174] 0 2024-09-13T21:44:56.956 INFO:tasks.workunit.client.1.smithi155.stdout:5/489: dwrite d5/f6 [4194304,4194304] 0 2024-09-13T21:44:56.957 INFO:tasks.workunit.client.0.smithi119.stdout:3/953: rmdir d6/d15/d1a/d45 39 2024-09-13T21:44:56.958 INFO:tasks.workunit.client.1.smithi155.stdout:6/607: link db/d11/f39 db/d2c/fc3 0 2024-09-13T21:44:56.960 INFO:tasks.workunit.client.0.smithi119.stdout:6/834: creat dc/d3a/dbb/d7a/de1/dfb/f108 x:0 0 0 2024-09-13T21:44:56.961 INFO:tasks.workunit.client.1.smithi155.stdout:4/489: rename d1/d7/de/dc/d4a/d75 to d1/d7/d21/d69/d98 0 2024-09-13T21:44:56.963 INFO:tasks.workunit.client.0.smithi119.stdout:5/923: mkdir d0/d3/d4/d2e/d65/df6/d12b 0 2024-09-13T21:44:56.963 INFO:tasks.workunit.client.0.smithi119.stdout:8/919: sync 2024-09-13T21:44:56.964 INFO:tasks.workunit.client.0.smithi119.stdout:0/925: dread fd [0,4194304] 0 2024-09-13T21:44:56.965 INFO:tasks.workunit.client.0.smithi119.stdout:6/835: mknod dc/df/d64/df4/c109 0 2024-09-13T21:44:56.965 INFO:tasks.workunit.client.0.smithi119.stdout:8/920: chown d1b/d1d/d48/d54/c56 75079048 1 2024-09-13T21:44:56.967 INFO:tasks.workunit.client.1.smithi155.stdout:7/502: dwrite d5/d10/d3e/d3f/f66 [0,4194304] 0 2024-09-13T21:44:56.970 INFO:tasks.workunit.client.1.smithi155.stdout:8/451: truncate d2/d6/f27 2073629 0 2024-09-13T21:44:56.970 INFO:tasks.workunit.client.1.smithi155.stdout:7/503: read - d5/df/f75 zero size 2024-09-13T21:44:56.970 INFO:tasks.workunit.client.0.smithi119.stdout:0/926: rename de/d1c/d2f/d35/d4a/d62/l69 to de/d1c/d2f/d40/d66/dcb/dd6/d83/l13a 0 2024-09-13T21:44:56.971 INFO:tasks.workunit.client.1.smithi155.stdout:5/490: fsync d5/d16/d33/f53 0 2024-09-13T21:44:56.974 INFO:tasks.workunit.client.1.smithi155.stdout:7/504: chown d5/d10/f90 153185 1 2024-09-13T21:44:56.975 INFO:tasks.workunit.client.0.smithi119.stdout:6/836: rename dc/d3a/dbb/d7a/dc7/lf6 to dc/d3a/dbb/d7a/de1/dfb/l10a 0 2024-09-13T21:44:56.975 INFO:tasks.workunit.client.1.smithi155.stdout:4/490: dread d1/d7/d21/d2d/d42/f4d [0,4194304] 0 2024-09-13T21:44:56.975 INFO:tasks.workunit.client.1.smithi155.stdout:7/505: stat d5/d10/d3e/d3f/f4a 0 2024-09-13T21:44:56.976 INFO:tasks.workunit.client.0.smithi119.stdout:8/921: dread d1b/d1d/d26/d3e/f5d [0,4194304] 0 2024-09-13T21:44:56.977 INFO:tasks.workunit.client.0.smithi119.stdout:8/922: chown d1b/d1d/d48/db2/lc5 41922804 1 2024-09-13T21:44:56.978 INFO:tasks.workunit.client.1.smithi155.stdout:4/491: write d1/d7/de/f1f [1952461,19147] 0 2024-09-13T21:44:56.979 INFO:tasks.workunit.client.1.smithi155.stdout:4/492: fdatasync d1/f24 0 2024-09-13T21:44:56.980 INFO:tasks.workunit.client.1.smithi155.stdout:6/608: creat db/d11/d1e/d21/fc4 x:0 0 0 2024-09-13T21:44:56.980 INFO:tasks.workunit.client.0.smithi119.stdout:8/923: mknod d1b/d4e/d6a/c118 0 2024-09-13T21:44:56.980 INFO:tasks.workunit.client.1.smithi155.stdout:1/547: dread d6/d15/f4c [0,4194304] 0 2024-09-13T21:44:56.981 INFO:tasks.workunit.client.0.smithi119.stdout:6/837: dwrite dc/d3d/ff5 [0,4194304] 0 2024-09-13T21:44:56.983 INFO:tasks.workunit.client.0.smithi119.stdout:6/838: symlink dc/d3d/dcf/l10b 0 2024-09-13T21:44:56.984 INFO:tasks.workunit.client.0.smithi119.stdout:6/839: readlink dc/d3d/d4e/d91/ld3 0 2024-09-13T21:44:56.984 INFO:tasks.workunit.client.0.smithi119.stdout:6/840: readlink dc/d3a/dbb/lc9 0 2024-09-13T21:44:56.985 INFO:tasks.workunit.client.0.smithi119.stdout:6/841: chown dc/df/c11 679734 1 2024-09-13T21:44:56.986 INFO:tasks.workunit.client.0.smithi119.stdout:8/924: link d1b/d4e/d71/cca d1b/d1d/d26/d3e/d65/c119 0 2024-09-13T21:44:56.986 INFO:tasks.workunit.client.0.smithi119.stdout:6/842: stat dc/df/d41/f7b 0 2024-09-13T21:44:56.988 INFO:tasks.workunit.client.1.smithi155.stdout:1/548: dwrite d6/d15/d57/d99/f4a [0,4194304] 0 2024-09-13T21:44:56.991 INFO:tasks.workunit.client.1.smithi155.stdout:5/491: rmdir d5/d16/d4e/d85 39 2024-09-13T21:44:56.996 INFO:tasks.workunit.client.1.smithi155.stdout:3/547: mknod d3/d25/d1b/d1f/d36/d5c/d66/db3/cbf 0 2024-09-13T21:44:56.997 INFO:tasks.workunit.client.0.smithi119.stdout:5/924: dwrite d0/d3/d4/def/d10f/f9b [0,4194304] 0 2024-09-13T21:44:56.999 INFO:tasks.workunit.client.0.smithi119.stdout:0/927: dwrite de/d1c/d64/f73 [0,4194304] 0 2024-09-13T21:44:57.000 INFO:tasks.workunit.client.0.smithi119.stdout:0/928: chown de/d1c/d64/f73 1102 1 2024-09-13T21:44:57.000 INFO:tasks.workunit.client.1.smithi155.stdout:8/452: creat d2/d1f/d87/f89 x:0 0 0 2024-09-13T21:44:57.002 INFO:tasks.workunit.client.1.smithi155.stdout:5/492: creat d5/d16/d33/d1b/d2f/fa6 x:0 0 0 2024-09-13T21:44:57.003 INFO:tasks.workunit.client.1.smithi155.stdout:8/453: write d2/d1f/d87/f89 [941168,36359] 0 2024-09-13T21:44:57.003 INFO:tasks.workunit.client.0.smithi119.stdout:0/929: symlink de/d4e/da5/l13b 0 2024-09-13T21:44:57.005 INFO:tasks.workunit.client.1.smithi155.stdout:8/454: fsync d2/d2d/f59 0 2024-09-13T21:44:57.006 INFO:tasks.workunit.client.0.smithi119.stdout:0/930: chown de/d1c/d2f/d35/d4a 33415217 1 2024-09-13T21:44:57.006 INFO:tasks.workunit.client.0.smithi119.stdout:8/925: dread d1b/f46 [0,4194304] 0 2024-09-13T21:44:57.006 INFO:tasks.workunit.client.0.smithi119.stdout:5/925: creat d0/d3/f12c x:0 0 0 2024-09-13T21:44:57.006 INFO:tasks.workunit.client.1.smithi155.stdout:1/549: rename d6/d15/d23/d87/d30 to d6/d15/d23/d55/d6e/dbb 0 2024-09-13T21:44:57.008 INFO:tasks.workunit.client.0.smithi119.stdout:0/931: chown de/d1c/d2f/d40/d66/dcb/dd6/d83 18 1 2024-09-13T21:44:57.008 INFO:tasks.workunit.client.1.smithi155.stdout:7/506: symlink d5/df/d15/d33/d43/l9d 0 2024-09-13T21:44:57.009 INFO:tasks.workunit.client.1.smithi155.stdout:0/580: link d1/d6/dc/d4d/d4a/d52/d5c/d6a/cdb d1/d6/dc/d4d/d4a/d9e/de0/ce1 0 2024-09-13T21:44:57.011 INFO:tasks.workunit.client.0.smithi119.stdout:8/926: symlink d1b/d1d/d26/d3e/daa/l11a 0 2024-09-13T21:44:57.011 INFO:tasks.workunit.client.1.smithi155.stdout:3/548: dread d3/d25/d1b/d1f/f22 [0,4194304] 0 2024-09-13T21:44:57.012 INFO:tasks.workunit.client.0.smithi119.stdout:0/932: symlink de/d1c/d2b/dd7/l13c 0 2024-09-13T21:44:57.014 INFO:tasks.workunit.client.1.smithi155.stdout:5/493: dread d5/d16/d33/f38 [0,4194304] 0 2024-09-13T21:44:57.014 INFO:tasks.workunit.client.1.smithi155.stdout:8/455: unlink d2/d1f/f2b 0 2024-09-13T21:44:57.015 INFO:tasks.workunit.client.1.smithi155.stdout:1/550: creat d6/d82/fbc x:0 0 0 2024-09-13T21:44:57.016 INFO:tasks.workunit.client.0.smithi119.stdout:0/933: write de/d49/fb0 [5123577,71591] 0 2024-09-13T21:44:57.016 INFO:tasks.workunit.client.0.smithi119.stdout:5/926: dwrite d0/d3/d4/d2e/d65/d110/f116 [0,4194304] 0 2024-09-13T21:44:57.016 INFO:tasks.workunit.client.1.smithi155.stdout:1/551: readlink d6/d15/d57/l81 0 2024-09-13T21:44:57.017 INFO:tasks.workunit.client.0.smithi119.stdout:0/934: dread - de/d1c/d59/fdc zero size 2024-09-13T21:44:57.018 INFO:tasks.workunit.client.1.smithi155.stdout:1/552: write d6/d15/f58 [2724700,27362] 0 2024-09-13T21:44:57.019 INFO:tasks.workunit.client.1.smithi155.stdout:5/494: truncate d5/d16/d33/d1b/d2f/d3c/d44/d29/f7d 1399903 0 2024-09-13T21:44:57.020 INFO:tasks.workunit.client.1.smithi155.stdout:0/581: mkdir d1/d6/dc/d4d/d4a/d4e/de2 0 2024-09-13T21:44:57.021 INFO:tasks.workunit.client.0.smithi119.stdout:5/927: rename d0/d3/d4/d9/d14/ld8 to d0/d3/d1f/d21/d4f/d86/l12d 0 2024-09-13T21:44:57.021 INFO:tasks.workunit.client.1.smithi155.stdout:3/549: symlink d3/d25/d1b/d1f/d82/d83/d99/lc0 0 2024-09-13T21:44:57.023 INFO:tasks.workunit.client.1.smithi155.stdout:7/507: creat d5/df/d15/d33/d55/d97/f9e x:0 0 0 2024-09-13T21:44:57.025 INFO:tasks.workunit.client.1.smithi155.stdout:4/493: link d1/f1c d1/d48/f99 0 2024-09-13T21:44:57.026 INFO:tasks.workunit.client.0.smithi119.stdout:5/928: mkdir d0/d3/d4/d9/d1e/da5/d121/d125/d12e 0 2024-09-13T21:44:57.026 INFO:tasks.workunit.client.1.smithi155.stdout:1/553: dread - d6/d15/d23/f3f zero size 2024-09-13T21:44:57.027 INFO:tasks.workunit.client.0.smithi119.stdout:0/935: rename de/f5e to de/d1c/d2b/d76/f13d 0 2024-09-13T21:44:57.027 INFO:tasks.workunit.client.1.smithi155.stdout:5/495: creat d5/d16/d33/d1b/d2f/d3c/fa7 x:0 0 0 2024-09-13T21:44:57.027 INFO:tasks.workunit.client.0.smithi119.stdout:5/929: symlink d0/d3/d4/d2e/d65/l12f 0 2024-09-13T21:44:57.028 INFO:tasks.workunit.client.0.smithi119.stdout:8/927: write d1b/d4e/d71/f75 [761240,21458] 0 2024-09-13T21:44:57.030 INFO:tasks.workunit.client.1.smithi155.stdout:0/582: rename d1/d6/dc/d4d/d4a/d4e/f55 to d1/d6/d97/fe3 0 2024-09-13T21:44:57.031 INFO:tasks.workunit.client.1.smithi155.stdout:8/456: link d2/d1f/f84 d2/d6/dd/d6b/f8a 0 2024-09-13T21:44:57.032 INFO:tasks.workunit.client.0.smithi119.stdout:0/936: rename de/d1c/d2b/dd7/le5 to de/d1c/d2b/d76/d9b/da1/l13e 0 2024-09-13T21:44:57.033 INFO:tasks.workunit.client.0.smithi119.stdout:8/928: creat d1b/d1d/d26/d111/d7f/dcb/f11b x:0 0 0 2024-09-13T21:44:57.036 INFO:tasks.workunit.client.1.smithi155.stdout:5/496: rmdir d5/d16/d81/d98/d84 39 2024-09-13T21:44:57.037 INFO:tasks.workunit.client.0.smithi119.stdout:8/929: mkdir d1b/d1d/d26/d3e/d65/d11c 0 2024-09-13T21:44:57.038 INFO:tasks.workunit.client.1.smithi155.stdout:8/457: creat d2/d8/f8b x:0 0 0 2024-09-13T21:44:57.038 INFO:tasks.workunit.client.0.smithi119.stdout:0/937: getdents de/d4e/d7f 0 2024-09-13T21:44:57.039 INFO:tasks.workunit.client.0.smithi119.stdout:5/930: write d0/d3/d1f/d21/da1/dfb/fc9 [907794,127222] 0 2024-09-13T21:44:57.039 INFO:tasks.workunit.client.0.smithi119.stdout:8/930: read d1b/d1d/d39/f44 [1883231,79180] 0 2024-09-13T21:44:57.041 INFO:tasks.workunit.client.0.smithi119.stdout:0/938: mkdir de/d1c/d2f/d35/dce/d13f 0 2024-09-13T21:44:57.041 INFO:tasks.workunit.client.1.smithi155.stdout:0/583: mknod d1/d6/ce4 0 2024-09-13T21:44:57.042 INFO:tasks.workunit.client.1.smithi155.stdout:4/494: creat d1/d7/f9a x:0 0 0 2024-09-13T21:44:57.044 INFO:tasks.workunit.client.0.smithi119.stdout:0/939: mknod de/d1c/d64/d132/c140 0 2024-09-13T21:44:57.046 INFO:tasks.workunit.client.0.smithi119.stdout:8/931: link d1b/d1d/d48/d54/cb9 d1b/c11d 0 2024-09-13T21:44:57.046 INFO:tasks.workunit.client.0.smithi119.stdout:5/931: write d0/d3/d4/d9/d1e/f91 [307923,17754] 0 2024-09-13T21:44:57.047 INFO:tasks.workunit.client.1.smithi155.stdout:5/497: link d5/d16/d81/d98/f8b d5/d16/d4e/fa8 0 2024-09-13T21:44:57.048 INFO:tasks.workunit.client.0.smithi119.stdout:8/932: unlink d1b/d4e/d6a/c118 0 2024-09-13T21:44:57.049 INFO:tasks.workunit.client.0.smithi119.stdout:5/932: rmdir d0/d3/d1f/d21/da1 39 2024-09-13T21:44:57.049 INFO:tasks.workunit.client.1.smithi155.stdout:1/554: write d6/d15/d23/d55/d6e/dbb/f75 [160943,98833] 0 2024-09-13T21:44:57.050 INFO:tasks.workunit.client.0.smithi119.stdout:0/940: dwrite de/d1c/d2b/d76/d9a/fc2 [0,4194304] 0 2024-09-13T21:44:57.050 INFO:tasks.workunit.client.1.smithi155.stdout:8/458: creat d2/d6/dd/f8c x:0 0 0 2024-09-13T21:44:57.051 INFO:tasks.workunit.client.0.smithi119.stdout:8/933: mkdir d1b/d1d/d48/db2/d11e 0 2024-09-13T21:44:57.052 INFO:tasks.workunit.client.1.smithi155.stdout:3/550: dwrite d3/d21/d4a/f73 [0,4194304] 0 2024-09-13T21:44:57.053 INFO:tasks.workunit.client.0.smithi119.stdout:0/941: creat de/d4e/d7f/ded/f141 x:0 0 0 2024-09-13T21:44:57.053 INFO:tasks.workunit.client.1.smithi155.stdout:8/459: readlink d2/l38 0 2024-09-13T21:44:57.054 INFO:tasks.workunit.client.0.smithi119.stdout:8/934: chown d1b/d1d/d26/df0/d10b/feb 1 1 2024-09-13T21:44:57.055 INFO:tasks.workunit.client.0.smithi119.stdout:8/935: write d1b/d4e/d71/dac/f101 [685609,39652] 0 2024-09-13T21:44:57.056 INFO:tasks.workunit.client.1.smithi155.stdout:0/584: getdents d1/d6/dc/d8c 0 2024-09-13T21:44:57.056 INFO:tasks.workunit.client.1.smithi155.stdout:1/555: creat d6/d7/d48/fbd x:0 0 0 2024-09-13T21:44:57.057 INFO:tasks.workunit.client.0.smithi119.stdout:5/933: rename d0/d3/d1f/d21/d4f/f9c to d0/d3/d4/d2e/f130 0 2024-09-13T21:44:57.058 INFO:tasks.workunit.client.1.smithi155.stdout:8/460: rmdir d2/d1f 39 2024-09-13T21:44:57.059 INFO:tasks.workunit.client.0.smithi119.stdout:8/936: read d1b/d1d/d26/d3e/f7c [356403,43898] 0 2024-09-13T21:44:57.059 INFO:tasks.workunit.client.1.smithi155.stdout:5/498: dread d5/d16/d4e/fa8 [0,4194304] 0 2024-09-13T21:44:57.060 INFO:tasks.workunit.client.0.smithi119.stdout:0/942: getdents de/d4e/d7f 0 2024-09-13T21:44:57.061 INFO:tasks.workunit.client.1.smithi155.stdout:7/508: dwrite d5/df/d15/f28 [0,4194304] 0 2024-09-13T21:44:57.063 INFO:tasks.workunit.client.0.smithi119.stdout:0/943: mkdir de/d1c/d2b/d34/d142 0 2024-09-13T21:44:57.064 INFO:tasks.workunit.client.1.smithi155.stdout:4/495: truncate d1/d7/de/d15/f37 3507392 0 2024-09-13T21:44:57.067 INFO:tasks.workunit.client.0.smithi119.stdout:5/934: dwrite d0/d3/d4/d9/d1e/da5/d121/f12a [0,4194304] 0 2024-09-13T21:44:57.068 INFO:tasks.workunit.client.0.smithi119.stdout:0/944: rename de/d1c/d64/f8a to de/d3c/f143 0 2024-09-13T21:44:57.068 INFO:tasks.workunit.client.1.smithi155.stdout:3/551: unlink d3/d25/d1b/d1f/d36/d5c/l8b 0 2024-09-13T21:44:57.069 INFO:tasks.workunit.client.1.smithi155.stdout:7/509: symlink d5/df/d60/l9f 0 2024-09-13T21:44:57.069 INFO:tasks.workunit.client.1.smithi155.stdout:4/496: fsync d1/d7/f58 0 2024-09-13T21:44:57.069 INFO:tasks.workunit.client.0.smithi119.stdout:0/945: dread - de/d1c/d2b/d76/d9b/da1/f10a zero size 2024-09-13T21:44:57.071 INFO:tasks.workunit.client.0.smithi119.stdout:5/935: truncate d0/d3/d1f/d21/da1/dfb/ffe 431792 0 2024-09-13T21:44:57.071 INFO:tasks.workunit.client.1.smithi155.stdout:8/461: read d2/d6/f27 [720632,91166] 0 2024-09-13T21:44:57.073 INFO:tasks.workunit.client.0.smithi119.stdout:0/946: chown de/d49/d7d 456681 1 2024-09-13T21:44:57.073 INFO:tasks.workunit.client.0.smithi119.stdout:5/936: chown d0/d3/d1f/d21/d4f/d86/fc1 4 1 2024-09-13T21:44:57.073 INFO:tasks.workunit.client.1.smithi155.stdout:4/497: write d1/d7/d21/f57 [2515631,6194] 0 2024-09-13T21:44:57.074 INFO:tasks.workunit.client.1.smithi155.stdout:1/556: dwrite d6/d82/d91/fa4 [0,4194304] 0 2024-09-13T21:44:57.074 INFO:tasks.workunit.client.0.smithi119.stdout:0/947: write de/d1c/d2f/d40/d66/ffa [1696402,91759] 0 2024-09-13T21:44:57.076 INFO:tasks.workunit.client.1.smithi155.stdout:3/552: symlink d3/d25/d1b/d1f/d82/d83/d99/da6/lc1 0 2024-09-13T21:44:57.076 INFO:tasks.workunit.client.1.smithi155.stdout:0/585: truncate d1/d6/dc/d4d/f50 805521 0 2024-09-13T21:44:57.077 INFO:tasks.workunit.client.0.smithi119.stdout:0/948: mknod de/d1c/c144 0 2024-09-13T21:44:57.081 INFO:tasks.workunit.client.1.smithi155.stdout:8/462: symlink d2/d1f/d77/l8d 0 2024-09-13T21:44:57.082 INFO:tasks.workunit.client.1.smithi155.stdout:7/510: creat d5/d10/d3e/d3f/fa0 x:0 0 0 2024-09-13T21:44:57.082 INFO:tasks.workunit.client.1.smithi155.stdout:8/463: readlink d2/d8/d75/l83 0 2024-09-13T21:44:57.083 INFO:tasks.workunit.client.1.smithi155.stdout:3/553: symlink d3/d25/d1b/d1f/d82/d83/d99/lc2 0 2024-09-13T21:44:57.083 INFO:tasks.workunit.client.1.smithi155.stdout:1/557: symlink d6/d15/d23/d87/d95/da9/lbe 0 2024-09-13T21:44:57.084 INFO:tasks.workunit.client.1.smithi155.stdout:4/498: dread d1/d7/de/d15/d55/f62 [0,4194304] 0 2024-09-13T21:44:57.087 INFO:tasks.workunit.client.1.smithi155.stdout:1/558: write d6/d15/fba [1261160,116594] 0 2024-09-13T21:44:57.087 INFO:tasks.workunit.client.1.smithi155.stdout:7/511: read d5/df/f4f [24013,78439] 0 2024-09-13T21:44:57.088 INFO:tasks.workunit.client.1.smithi155.stdout:3/554: rmdir d3/d25/d17/d52 39 2024-09-13T21:44:57.090 INFO:tasks.workunit.client.1.smithi155.stdout:4/499: unlink d1/d7/d5a/f7f 0 2024-09-13T21:44:57.091 INFO:tasks.workunit.client.1.smithi155.stdout:1/559: chown d6/d15/d57/d5d/f62 1825 1 2024-09-13T21:44:57.091 INFO:tasks.workunit.client.1.smithi155.stdout:0/586: dwrite d1/d6/dc/faa [0,4194304] 0 2024-09-13T21:44:57.092 INFO:tasks.workunit.client.1.smithi155.stdout:7/512: mkdir d5/df/d15/da1 0 2024-09-13T21:44:57.094 INFO:tasks.workunit.client.1.smithi155.stdout:7/513: write d5/df/d15/d33/f69 [566317,11735] 0 2024-09-13T21:44:57.095 INFO:tasks.workunit.client.0.smithi119.stdout:5/937: dread d0/d3/d4/d9/d14/d24/f55 [0,4194304] 0 2024-09-13T21:44:57.100 INFO:tasks.workunit.client.1.smithi155.stdout:7/514: mkdir d5/d10/d3e/d40/da2 0 2024-09-13T21:44:57.102 INFO:tasks.workunit.client.1.smithi155.stdout:0/587: truncate d1/d6/dc/d4d/d4a/f8d 1541303 0 2024-09-13T21:44:57.103 INFO:tasks.workunit.client.1.smithi155.stdout:4/500: link d1/d7/de/d15/c20 d1/d7/d78/c9b 0 2024-09-13T21:44:57.104 INFO:tasks.workunit.client.1.smithi155.stdout:7/515: truncate d5/d10/f90 3156958 0 2024-09-13T21:44:57.106 INFO:tasks.workunit.client.1.smithi155.stdout:1/560: link d6/d15/d23/d55/f60 d6/d15/d57/d5d/fbf 0 2024-09-13T21:44:57.108 INFO:tasks.workunit.client.0.smithi119.stdout:8/937: write d1b/d1d/d26/df0/fc2 [567490,15852] 0 2024-09-13T21:44:57.110 INFO:tasks.workunit.client.0.smithi119.stdout:8/938: symlink d1b/d1d/d26/d3e/daa/l11f 0 2024-09-13T21:44:57.110 INFO:tasks.workunit.client.1.smithi155.stdout:8/464: dread d2/d8/f4f [0,4194304] 0 2024-09-13T21:44:57.111 INFO:tasks.workunit.client.1.smithi155.stdout:8/465: stat d2/d8/l64 0 2024-09-13T21:44:57.111 INFO:tasks.workunit.client.0.smithi119.stdout:8/939: unlink d1b/f46 0 2024-09-13T21:44:57.112 INFO:tasks.workunit.client.1.smithi155.stdout:8/466: read - d2/d6/dd/d6b/f88 zero size 2024-09-13T21:44:57.112 INFO:tasks.workunit.client.1.smithi155.stdout:4/501: link d1/d7/f30 d1/d7/d83/f9c 0 2024-09-13T21:44:57.113 INFO:tasks.workunit.client.0.smithi119.stdout:8/940: symlink d1b/d1d/d26/d3e/d65/d11c/l120 0 2024-09-13T21:44:57.114 INFO:tasks.workunit.client.1.smithi155.stdout:0/588: creat d1/d6/dc/d4d/d4a/d52/d5c/fe5 x:0 0 0 2024-09-13T21:44:57.116 INFO:tasks.workunit.client.0.smithi119.stdout:5/938: write d0/d3/d4/f78 [4102488,44737] 0 2024-09-13T21:44:57.118 INFO:tasks.workunit.client.1.smithi155.stdout:0/589: write d1/d6/dc/f84 [319279,115949] 0 2024-09-13T21:44:57.119 INFO:tasks.workunit.client.1.smithi155.stdout:5/499: truncate d5/d16/d33/d1b/d2f/f9b 3166397 0 2024-09-13T21:44:57.119 INFO:tasks.workunit.client.1.smithi155.stdout:1/561: getdents d6/d7/d48/dab 0 2024-09-13T21:44:57.120 INFO:tasks.workunit.client.0.smithi119.stdout:5/939: chown d0/d3/d4/def/d10f/d67/l8f 25 1 2024-09-13T21:44:57.120 INFO:tasks.workunit.client.1.smithi155.stdout:7/516: dread d5/f30 [0,4194304] 0 2024-09-13T21:44:57.120 INFO:tasks.workunit.client.0.smithi119.stdout:8/941: dwrite d1b/d1d/d39/f10f [4194304,4194304] 0 2024-09-13T21:44:57.121 INFO:tasks.workunit.client.1.smithi155.stdout:4/502: read d1/d7/de/d15/d55/d5e/d66/f6c [403518,57703] 0 2024-09-13T21:44:57.121 INFO:tasks.workunit.client.1.smithi155.stdout:7/517: readlink d5/df/d15/l25 0 2024-09-13T21:44:57.122 INFO:tasks.workunit.client.0.smithi119.stdout:8/942: truncate d1b/f113 46387 0 2024-09-13T21:44:57.124 INFO:tasks.workunit.client.1.smithi155.stdout:0/590: mknod d1/d6/ce6 0 2024-09-13T21:44:57.125 INFO:tasks.workunit.client.0.smithi119.stdout:0/949: dwrite de/d1c/d52/f7a [0,4194304] 0 2024-09-13T21:44:57.126 INFO:tasks.workunit.client.0.smithi119.stdout:8/943: truncate d1b/d1d/f5f 1576270 0 2024-09-13T21:44:57.127 INFO:tasks.workunit.client.0.smithi119.stdout:8/944: chown d1b/d4e/d71/fd8 462550 1 2024-09-13T21:44:57.129 INFO:tasks.workunit.client.0.smithi119.stdout:0/950: write de/d3c/de6/f108 [5892,73227] 0 2024-09-13T21:44:57.129 INFO:tasks.workunit.client.1.smithi155.stdout:3/555: truncate d3/d25/fb 4149444 0 2024-09-13T21:44:57.129 INFO:tasks.workunit.client.0.smithi119.stdout:0/951: chown de/d4e/c87 13280 1 2024-09-13T21:44:57.130 INFO:tasks.workunit.client.1.smithi155.stdout:3/556: dread - d3/dbb/fbd zero size 2024-09-13T21:44:57.131 INFO:tasks.workunit.client.0.smithi119.stdout:8/945: creat d1b/d1d/df8/f121 x:0 0 0 2024-09-13T21:44:57.132 INFO:tasks.workunit.client.0.smithi119.stdout:0/952: readlink de/d1c/l33 0 2024-09-13T21:44:57.133 INFO:tasks.workunit.client.1.smithi155.stdout:4/503: link d1/l49 d1/d7/de/d15/d55/d5e/d66/d7e/l9d 0 2024-09-13T21:44:57.135 INFO:tasks.workunit.client.0.smithi119.stdout:0/953: creat de/d1c/d2f/d35/d90/f145 x:0 0 0 2024-09-13T21:44:57.136 INFO:tasks.workunit.client.0.smithi119.stdout:0/954: creat de/d1c/d2f/d40/d66/dcb/dd6/d83/f146 x:0 0 0 2024-09-13T21:44:57.137 INFO:tasks.workunit.client.1.smithi155.stdout:3/557: creat d3/d25/d1b/d90/fc3 x:0 0 0 2024-09-13T21:44:57.138 INFO:tasks.workunit.client.0.smithi119.stdout:0/955: chown de/d1c/d52/fae 0 1 2024-09-13T21:44:57.140 INFO:tasks.workunit.client.0.smithi119.stdout:8/946: write f18 [3085096,53337] 0 2024-09-13T21:44:57.140 INFO:tasks.workunit.client.1.smithi155.stdout:3/558: mknod d3/d21/d2c/cc4 0 2024-09-13T21:44:57.141 INFO:tasks.workunit.client.1.smithi155.stdout:0/591: link d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/c7b d1/d6/dc/ce7 0 2024-09-13T21:44:57.142 INFO:tasks.workunit.client.1.smithi155.stdout:8/467: truncate d2/d8/d65/f41 1250233 0 2024-09-13T21:44:57.143 INFO:tasks.workunit.client.1.smithi155.stdout:8/468: write d2/d2d/f59 [963169,51298] 0 2024-09-13T21:44:57.146 INFO:tasks.workunit.client.1.smithi155.stdout:2/445: sync 2024-09-13T21:44:57.146 INFO:tasks.workunit.client.0.smithi119.stdout:0/956: write de/f10 [530317,129987] 0 2024-09-13T21:44:57.146 INFO:tasks.workunit.client.1.smithi155.stdout:0/592: creat d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/fe8 x:0 0 0 2024-09-13T21:44:57.147 INFO:tasks.workunit.client.0.smithi119.stdout:8/947: truncate d1b/d1d/ffb 587514 0 2024-09-13T21:44:57.147 INFO:tasks.workunit.client.1.smithi155.stdout:8/469: creat d2/d6/dd/d6b/f8e x:0 0 0 2024-09-13T21:44:57.148 INFO:tasks.workunit.client.0.smithi119.stdout:0/957: truncate de/f17 950753 0 2024-09-13T21:44:57.149 INFO:tasks.workunit.client.1.smithi155.stdout:2/446: truncate d2/dd/d37/d4e/f59 1127036 0 2024-09-13T21:44:57.150 INFO:tasks.workunit.client.1.smithi155.stdout:8/470: dread d2/d6/dd/d12/f21 [0,4194304] 0 2024-09-13T21:44:57.152 INFO:tasks.workunit.client.0.smithi119.stdout:1/823: sync 2024-09-13T21:44:57.152 INFO:tasks.workunit.client.0.smithi119.stdout:2/859: sync 2024-09-13T21:44:57.152 INFO:tasks.workunit.client.0.smithi119.stdout:7/981: sync 2024-09-13T21:44:57.152 INFO:tasks.workunit.client.1.smithi155.stdout:7/518: truncate d5/df/d60/d6d/f7a 1660339 0 2024-09-13T21:44:57.153 INFO:tasks.workunit.client.0.smithi119.stdout:8/948: dwrite f18 [0,4194304] 0 2024-09-13T21:44:57.153 INFO:tasks.workunit.client.0.smithi119.stdout:2/860: dread - d1/d22/db6/ff8 zero size 2024-09-13T21:44:57.156 INFO:tasks.workunit.client.1.smithi155.stdout:7/519: dread - d5/f50 zero size 2024-09-13T21:44:57.156 INFO:tasks.workunit.client.1.smithi155.stdout:1/562: dread d6/d15/f18 [0,4194304] 0 2024-09-13T21:44:57.157 INFO:tasks.workunit.client.1.smithi155.stdout:8/471: chown d2/d1f/c3b 1 1 2024-09-13T21:44:57.159 INFO:tasks.workunit.client.0.smithi119.stdout:2/861: truncate d1/d22/fc0 959078 0 2024-09-13T21:44:57.162 INFO:tasks.workunit.client.0.smithi119.stdout:8/949: link d1b/d1d/dc3/l112 d1b/d1d/d26/d3e/daa/l122 0 2024-09-13T21:44:57.162 INFO:tasks.workunit.client.0.smithi119.stdout:0/958: dwrite de/d1c/d52/fae [0,4194304] 0 2024-09-13T21:44:57.163 INFO:tasks.workunit.client.1.smithi155.stdout:1/563: chown d6/d7/d48/c53 440377685 1 2024-09-13T21:44:57.163 INFO:tasks.workunit.client.0.smithi119.stdout:1/824: getdents d1 0 2024-09-13T21:44:57.164 INFO:tasks.workunit.client.1.smithi155.stdout:0/593: dwrite d1/d6/dc/d4d/d4a/d4e/f75 [0,4194304] 0 2024-09-13T21:44:57.165 INFO:tasks.workunit.client.0.smithi119.stdout:1/825: chown d1/cb 1891464 1 2024-09-13T21:44:57.167 INFO:tasks.workunit.client.0.smithi119.stdout:2/862: link d1/d22/d55/d31/f94 d1/d22/db6/dde/f115 0 2024-09-13T21:44:57.167 INFO:tasks.workunit.client.0.smithi119.stdout:0/959: write de/d1c/d2b/d76/d9a/fc2 [3903446,80787] 0 2024-09-13T21:44:57.170 INFO:tasks.workunit.client.0.smithi119.stdout:1/826: rmdir d1/d3/d61/d77/da6 39 2024-09-13T21:44:57.170 INFO:tasks.workunit.client.0.smithi119.stdout:0/960: stat de/d1c/d2f/d35/d4a/d62/d131 0 2024-09-13T21:44:57.173 INFO:tasks.workunit.client.0.smithi119.stdout:1/827: chown d1/d3/dc/d24 10 1 2024-09-13T21:44:57.174 INFO:tasks.workunit.client.0.smithi119.stdout:2/863: creat d1/d7/d47/df3/d108/f116 x:0 0 0 2024-09-13T21:44:57.175 INFO:tasks.workunit.client.0.smithi119.stdout:8/950: dwrite d1b/d1d/d48/f90 [0,4194304] 0 2024-09-13T21:44:57.178 INFO:tasks.workunit.client.1.smithi155.stdout:7/520: dwrite d5/d10/f6a [0,4194304] 0 2024-09-13T21:44:57.178 INFO:tasks.workunit.client.1.smithi155.stdout:8/472: dread d2/d2d/f59 [0,4194304] 0 2024-09-13T21:44:57.178 INFO:tasks.workunit.client.1.smithi155.stdout:3/559: dread d3/d25/d1b/d1f/d36/f5d [0,4194304] 0 2024-09-13T21:44:57.178 INFO:tasks.workunit.client.0.smithi119.stdout:0/961: truncate de/d1c/d2f/f43 4906876 0 2024-09-13T21:44:57.181 INFO:tasks.workunit.client.0.smithi119.stdout:8/951: mknod d1b/d1d/d26/df0/de7/c123 0 2024-09-13T21:44:57.181 INFO:tasks.workunit.client.0.smithi119.stdout:8/952: dread - d1b/d1d/d39/f108 zero size 2024-09-13T21:44:57.187 INFO:tasks.workunit.client.1.smithi155.stdout:8/473: dwrite d2/d6/f6a [0,4194304] 0 2024-09-13T21:44:57.188 INFO:tasks.workunit.client.0.smithi119.stdout:8/953: getdents d1b/d1d/d48/db2/d10d 0 2024-09-13T21:44:57.188 INFO:tasks.workunit.client.0.smithi119.stdout:0/962: getdents de/d1c/d2f/d40/d66/dcb 0 2024-09-13T21:44:57.192 INFO:tasks.workunit.client.0.smithi119.stdout:8/954: mkdir d1b/d1d/d26/d111/d7f/dcb/d124 0 2024-09-13T21:44:57.193 INFO:tasks.workunit.client.0.smithi119.stdout:0/963: mkdir de/d1c/d64/d132/d147 0 2024-09-13T21:44:57.196 INFO:tasks.workunit.client.1.smithi155.stdout:8/474: dwrite d2/d8/d65/f68 [0,4194304] 0 2024-09-13T21:44:57.201 INFO:tasks.workunit.client.0.smithi119.stdout:0/964: rename de/d49/l9e to de/d3c/l148 0 2024-09-13T21:44:57.202 INFO:tasks.workunit.client.0.smithi119.stdout:8/955: dwrite d1b/d4e/d71/fd8 [0,4194304] 0 2024-09-13T21:44:57.204 INFO:tasks.workunit.client.1.smithi155.stdout:3/560: dread d3/d25/d17/f76 [0,4194304] 0 2024-09-13T21:44:57.205 INFO:tasks.workunit.client.0.smithi119.stdout:1/828: dwrite d1/d3/dc/d24/fe2 [0,4194304] 0 2024-09-13T21:44:57.205 INFO:tasks.workunit.client.1.smithi155.stdout:3/561: stat d3/d10/f46 0 2024-09-13T21:44:57.211 INFO:tasks.workunit.client.0.smithi119.stdout:0/965: creat de/d1c/d2f/f149 x:0 0 0 2024-09-13T21:44:57.216 INFO:tasks.workunit.client.0.smithi119.stdout:8/956: dwrite d1b/d1d/d39/f10f [0,4194304] 0 2024-09-13T21:44:57.218 INFO:tasks.workunit.client.0.smithi119.stdout:1/829: rename d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/dd8/d8c/f105 to d1/d3/d61/d77/d78/d32/dc3/f114 0 2024-09-13T21:44:57.221 INFO:tasks.workunit.client.0.smithi119.stdout:2/864: dwrite d1/d7/d47/fa3 [0,4194304] 0 2024-09-13T21:44:57.222 INFO:tasks.workunit.client.0.smithi119.stdout:2/865: chown d1/d7/d86 189848043 1 2024-09-13T21:44:57.222 INFO:tasks.workunit.client.0.smithi119.stdout:2/866: stat d1/d22/d55/d64/l104 0 2024-09-13T21:44:57.223 INFO:tasks.workunit.client.0.smithi119.stdout:2/867: readlink d1/d22/d5a/d5d/la4 0 2024-09-13T21:44:57.224 INFO:tasks.workunit.client.1.smithi155.stdout:0/594: rmdir d1/d6/dc/d4d/d4a/d52 39 2024-09-13T21:44:57.225 INFO:tasks.workunit.client.1.smithi155.stdout:0/595: chown d1/f2f 121225793 1 2024-09-13T21:44:57.225 INFO:tasks.workunit.client.0.smithi119.stdout:1/830: symlink d1/d3/d61/d77/d78/d32/d33/d72/db4/dfb/l115 0 2024-09-13T21:44:57.226 INFO:tasks.workunit.client.1.smithi155.stdout:0/596: readlink d1/d6/dc/d4d/d4a/d4e/l63 0 2024-09-13T21:44:57.228 INFO:tasks.workunit.client.0.smithi119.stdout:8/957: dread d1b/d1d/d39/f44 [4194304,4194304] 0 2024-09-13T21:44:57.232 INFO:tasks.workunit.client.0.smithi119.stdout:1/831: mknod d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/c116 0 2024-09-13T21:44:57.232 INFO:tasks.workunit.client.0.smithi119.stdout:2/868: dwrite d1/d22/d5a/d5d/d83/fdc [0,4194304] 0 2024-09-13T21:44:57.233 INFO:tasks.workunit.client.0.smithi119.stdout:8/958: rename d1b/d1d/d48/f49 to d1b/d1d/d26/d3e/d65/f125 0 2024-09-13T21:44:57.235 INFO:tasks.workunit.client.0.smithi119.stdout:2/869: dread - d1/d7/fba zero size 2024-09-13T21:44:57.237 INFO:tasks.workunit.client.0.smithi119.stdout:1/832: mkdir d1/d3/d61/d7e/d53/ddf/d117 0 2024-09-13T21:44:57.238 INFO:tasks.workunit.client.1.smithi155.stdout:2/447: getdents d2/dd/de/d15/d38 0 2024-09-13T21:44:57.240 INFO:tasks.workunit.client.1.smithi155.stdout:0/597: readlink d1/d6/dc/l38 0 2024-09-13T21:44:57.240 INFO:tasks.workunit.client.0.smithi119.stdout:1/833: stat d1/d3/d61/d77/d78/d32/d33/d72/db4/dc9/df4 0 2024-09-13T21:44:57.240 INFO:tasks.workunit.client.1.smithi155.stdout:0/598: chown d1/d6/f5f 7 1 2024-09-13T21:44:57.241 INFO:tasks.workunit.client.0.smithi119.stdout:2/870: read d1/d7/d86/fac [107917,24894] 0 2024-09-13T21:44:57.242 INFO:tasks.workunit.client.1.smithi155.stdout:0/599: write d1/d6/dc/d4d/d4a/f4b [861075,15266] 0 2024-09-13T21:44:57.243 INFO:tasks.workunit.client.0.smithi119.stdout:8/959: rename d1b/d4e/f84 to d1b/d1d/d26/da4/f126 0 2024-09-13T21:44:57.244 INFO:tasks.workunit.client.1.smithi155.stdout:0/600: chown d1/d6/dc/d4d/f78 820861653 1 2024-09-13T21:44:57.246 INFO:tasks.workunit.client.0.smithi119.stdout:1/834: link d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/fc8 d1/d3/f118 0 2024-09-13T21:44:57.247 INFO:tasks.workunit.client.0.smithi119.stdout:8/960: fdatasync f15 0 2024-09-13T21:44:57.248 INFO:tasks.workunit.client.1.smithi155.stdout:1/564: getdents d6/d15/d57/d5d 0 2024-09-13T21:44:57.249 INFO:tasks.workunit.client.0.smithi119.stdout:8/961: creat d1b/d1d/df8/f127 x:0 0 0 2024-09-13T21:44:57.250 INFO:tasks.workunit.client.0.smithi119.stdout:1/835: dread d1/d3/d61/d77/d78/d32/d33/d72/ff2 [0,4194304] 0 2024-09-13T21:44:57.252 INFO:tasks.workunit.client.1.smithi155.stdout:8/475: dwrite d2/d6/dd/d25/f6d [0,4194304] 0 2024-09-13T21:44:57.253 INFO:tasks.workunit.client.1.smithi155.stdout:8/476: readlink d2/d8/d75/l83 0 2024-09-13T21:44:57.255 INFO:tasks.workunit.client.1.smithi155.stdout:2/448: link d2/db/f1e d2/dd/de/f9a 0 2024-09-13T21:44:57.257 INFO:tasks.workunit.client.0.smithi119.stdout:8/962: dwrite d1b/d1d/d26/f89 [4194304,4194304] 0 2024-09-13T21:44:57.257 INFO:tasks.workunit.client.1.smithi155.stdout:8/477: creat d2/d1f/d87/f8f x:0 0 0 2024-09-13T21:44:57.263 INFO:tasks.workunit.client.0.smithi119.stdout:0/966: truncate de/fd4 578420 0 2024-09-13T21:44:57.264 INFO:tasks.workunit.client.1.smithi155.stdout:2/449: creat d2/dd/de/d15/d2e/f9b x:0 0 0 2024-09-13T21:44:57.267 INFO:tasks.workunit.client.0.smithi119.stdout:0/967: read de/d1c/d2f/f43 [2142344,52337] 0 2024-09-13T21:44:57.269 INFO:tasks.workunit.client.0.smithi119.stdout:8/963: link d1b/d1d/d26/d111/d7f/dcb/ldd d1b/d1d/d26/da4/l128 0 2024-09-13T21:44:57.272 INFO:tasks.workunit.client.0.smithi119.stdout:0/968: dread de/d1c/d2b/d76/d9a/fc2 [0,4194304] 0 2024-09-13T21:44:57.273 INFO:tasks.workunit.client.0.smithi119.stdout:0/969: dread - de/d4e/d7f/f96 zero size 2024-09-13T21:44:57.273 INFO:tasks.workunit.client.0.smithi119.stdout:8/964: creat d1b/d1d/d48/d54/de0/f129 x:0 0 0 2024-09-13T21:44:57.275 INFO:tasks.workunit.client.0.smithi119.stdout:2/871: truncate d1/d38/d89/d6b/f65 1384969 0 2024-09-13T21:44:57.275 INFO:tasks.workunit.client.0.smithi119.stdout:2/872: chown d1/d97 219652 1 2024-09-13T21:44:57.275 INFO:tasks.workunit.client.1.smithi155.stdout:2/450: rename d2/l5e to d2/dd/d37/l9c 0 2024-09-13T21:44:57.278 INFO:tasks.workunit.client.0.smithi119.stdout:8/965: creat d1b/d1d/d26/da4/f12a x:0 0 0 2024-09-13T21:44:57.279 INFO:tasks.workunit.client.0.smithi119.stdout:2/873: symlink d1/d22/d5a/d5d/l117 0 2024-09-13T21:44:57.280 INFO:tasks.workunit.client.0.smithi119.stdout:2/874: truncate d1/d7/fdb 5145676 0 2024-09-13T21:44:57.281 INFO:tasks.workunit.client.1.smithi155.stdout:2/451: link d2/dd/de/d15/d2e/d66/c89 d2/db/d6b/c9d 0 2024-09-13T21:44:57.281 INFO:tasks.workunit.client.0.smithi119.stdout:2/875: fdatasync d1/d97/ffd 0 2024-09-13T21:44:57.282 INFO:tasks.workunit.client.0.smithi119.stdout:1/836: dread d1/d3/d61/d77/d78/d32/dda/d3d/fb1 [0,4194304] 0 2024-09-13T21:44:57.284 INFO:tasks.workunit.client.0.smithi119.stdout:0/970: write de/f3e [632185,93902] 0 2024-09-13T21:44:57.284 INFO:tasks.workunit.client.1.smithi155.stdout:2/452: creat d2/dd/de/d15/d2e/d31/f9e x:0 0 0 2024-09-13T21:44:57.285 INFO:tasks.workunit.client.1.smithi155.stdout:3/562: write d3/d25/f5e [4779896,129219] 0 2024-09-13T21:44:57.288 INFO:tasks.workunit.client.0.smithi119.stdout:0/971: fsync de/d1c/d2b/d76/d9b/da1/f10a 0 2024-09-13T21:44:57.290 INFO:tasks.workunit.client.1.smithi155.stdout:2/453: rename d2/dd/de/d15/d2e/d31/d5d/c60 to d2/dd/de/d15/d2e/d66/d6f/c9f 0 2024-09-13T21:44:57.291 INFO:tasks.workunit.client.0.smithi119.stdout:8/966: truncate d1b/d1d/d48/d54/de0/fe6 98810 0 2024-09-13T21:44:57.292 INFO:tasks.workunit.client.1.smithi155.stdout:3/563: dread d3/d25/d17/fab [0,4194304] 0 2024-09-13T21:44:57.292 INFO:tasks.workunit.client.1.smithi155.stdout:7/521: rmdir d5/df/d15/d33 39 2024-09-13T21:44:57.293 INFO:tasks.workunit.client.1.smithi155.stdout:2/454: mkdir d2/dd/d21/d8d/da0 0 2024-09-13T21:44:57.294 INFO:tasks.workunit.client.1.smithi155.stdout:3/564: stat d3/d25/l9c 0 2024-09-13T21:44:57.296 INFO:tasks.workunit.client.1.smithi155.stdout:0/601: rename d1/ca3 to d1/ce9 0 2024-09-13T21:44:57.296 INFO:tasks.workunit.client.1.smithi155.stdout:7/522: read f3 [2679401,11111] 0 2024-09-13T21:44:57.297 INFO:tasks.workunit.client.0.smithi119.stdout:1/837: dwrite d1/f103 [0,4194304] 0 2024-09-13T21:44:57.297 INFO:tasks.workunit.client.1.smithi155.stdout:2/455: rename d2/dd/d3d/f50 to d2/dd/d21/d8d/da0/fa1 0 2024-09-13T21:44:57.299 INFO:tasks.workunit.client.0.smithi119.stdout:1/838: chown d1/d3/d61/d77/d78/d32/d33/d72/db4/cc5 11499 1 2024-09-13T21:44:57.301 INFO:tasks.workunit.client.0.smithi119.stdout:8/967: rmdir d1b 39 2024-09-13T21:44:57.304 INFO:tasks.workunit.client.0.smithi119.stdout:2/876: dwrite d1/d22/f42 [4194304,4194304] 0 2024-09-13T21:44:57.304 INFO:tasks.workunit.client.1.smithi155.stdout:3/565: rename d3/d21/fa4 to d3/d25/d1b/fc5 0 2024-09-13T21:44:57.306 INFO:tasks.workunit.client.1.smithi155.stdout:2/456: mkdir d2/dd/de/d15/d3f/d97/da2 0 2024-09-13T21:44:57.314 INFO:tasks.workunit.client.1.smithi155.stdout:0/602: rename d1/d6/d81/c8b to d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/d82/cea 0 2024-09-13T21:44:57.316 INFO:tasks.workunit.client.1.smithi155.stdout:2/457: mkdir d2/dd/de/d15/d2e/da3 0 2024-09-13T21:44:57.316 INFO:tasks.workunit.client.1.smithi155.stdout:7/523: rmdir d5/d10/d48 39 2024-09-13T21:44:57.317 INFO:tasks.workunit.client.1.smithi155.stdout:2/458: write d2/f53 [485511,16901] 0 2024-09-13T21:44:57.317 INFO:tasks.workunit.client.1.smithi155.stdout:8/478: rmdir d2/d8/d65 39 2024-09-13T21:44:57.323 INFO:tasks.workunit.client.1.smithi155.stdout:0/603: dwrite d1/d6/faf [0,4194304] 0 2024-09-13T21:44:57.324 INFO:tasks.workunit.client.0.smithi119.stdout:0/972: dread de/d3c/f3d [0,4194304] 0 2024-09-13T21:44:57.328 INFO:tasks.workunit.client.1.smithi155.stdout:7/524: creat d5/d13/fa3 x:0 0 0 2024-09-13T21:44:57.329 INFO:tasks.workunit.client.1.smithi155.stdout:8/479: mknod d2/d8/d5e/d60/c90 0 2024-09-13T21:44:57.330 INFO:tasks.workunit.client.1.smithi155.stdout:8/480: write d2/d6/dd/d6b/f8e [615305,119344] 0 2024-09-13T21:44:57.331 INFO:tasks.workunit.client.1.smithi155.stdout:3/566: link d3/d25/d1b/d1f/d82/d83/f9b d3/d21/fc6 0 2024-09-13T21:44:57.334 INFO:tasks.workunit.client.0.smithi119.stdout:0/973: getdents de/d4e/d7f 0 2024-09-13T21:44:57.335 INFO:tasks.workunit.client.1.smithi155.stdout:8/481: unlink d2/d6/f27 0 2024-09-13T21:44:57.335 INFO:tasks.workunit.client.0.smithi119.stdout:8/968: mkdir d1b/d4e/d12b 0 2024-09-13T21:44:57.337 INFO:tasks.workunit.client.1.smithi155.stdout:0/604: creat d1/feb x:0 0 0 2024-09-13T21:44:57.338 INFO:tasks.workunit.client.0.smithi119.stdout:8/969: creat d1b/d1d/d26/d3e/d65/de9/f12c x:0 0 0 2024-09-13T21:44:57.339 INFO:tasks.workunit.client.0.smithi119.stdout:6/843: sync 2024-09-13T21:44:57.339 INFO:tasks.workunit.client.0.smithi119.stdout:3/954: sync 2024-09-13T21:44:57.339 INFO:tasks.workunit.client.0.smithi119.stdout:4/927: sync 2024-09-13T21:44:57.339 INFO:tasks.workunit.client.1.smithi155.stdout:0/605: write d1/d6/f5f [413277,103990] 0 2024-09-13T21:44:57.341 INFO:tasks.workunit.client.1.smithi155.stdout:8/482: rename d2/d6/dd/d6b to d2/d91 0 2024-09-13T21:44:57.342 INFO:tasks.workunit.client.0.smithi119.stdout:6/844: read - dc/d3d/fa0 zero size 2024-09-13T21:44:57.343 INFO:tasks.workunit.client.0.smithi119.stdout:3/955: truncate d6/d44/f5a 125811 0 2024-09-13T21:44:57.344 INFO:tasks.workunit.client.0.smithi119.stdout:8/970: link d1b/d4e/d71/lc1 d1b/d4e/d71/dac/d109/l12d 0 2024-09-13T21:44:57.344 INFO:tasks.workunit.client.1.smithi155.stdout:7/525: dwrite d5/df/d15/d33/d55/f5e [0,4194304] 0 2024-09-13T21:44:57.345 INFO:tasks.workunit.client.0.smithi119.stdout:6/845: fdatasync dc/df/f1d 0 2024-09-13T21:44:57.346 INFO:tasks.workunit.client.1.smithi155.stdout:3/567: rename d3/d25/c67 to d3/d25/d17/d52/cc7 0 2024-09-13T21:44:57.346 INFO:tasks.workunit.client.0.smithi119.stdout:6/846: stat dc/d4b/d6a/d75/dbe/cf7 0 2024-09-13T21:44:57.347 INFO:tasks.workunit.client.0.smithi119.stdout:3/956: chown d6/dfa 849 1 2024-09-13T21:44:57.349 INFO:tasks.workunit.client.0.smithi119.stdout:3/957: chown d6/d25/d2f/c37 7 1 2024-09-13T21:44:57.349 INFO:tasks.workunit.client.1.smithi155.stdout:0/606: symlink d1/d6/dc/d4d/d4a/d52/d5c/d6a/dd8/lec 0 2024-09-13T21:44:57.350 INFO:tasks.workunit.client.1.smithi155.stdout:7/526: dread - d5/d13/f29 zero size 2024-09-13T21:44:57.351 INFO:tasks.workunit.client.1.smithi155.stdout:7/527: write d5/df/f11 [1945623,116235] 0 2024-09-13T21:44:57.352 INFO:tasks.workunit.client.0.smithi119.stdout:6/847: unlink dc/d4b/d6a/d75/dbe/cf7 0 2024-09-13T21:44:57.353 INFO:tasks.workunit.client.0.smithi119.stdout:0/974: dread de/d1c/d2f/f47 [0,4194304] 0 2024-09-13T21:44:57.354 INFO:tasks.workunit.client.0.smithi119.stdout:0/975: stat de/d1c/d2b/d76/d9a 0 2024-09-13T21:44:57.354 INFO:tasks.workunit.client.0.smithi119.stdout:8/971: rename d1b/d1d/d26/d111/f79 to d1b/d1d/d26/f12e 0 2024-09-13T21:44:57.355 INFO:tasks.workunit.client.1.smithi155.stdout:0/607: symlink d1/d6/dc/d4d/d4a/d4e/d61/led 0 2024-09-13T21:44:57.356 INFO:tasks.workunit.client.1.smithi155.stdout:7/528: truncate d5/d13/f29 403430 0 2024-09-13T21:44:57.359 INFO:tasks.workunit.client.1.smithi155.stdout:0/608: mknod d1/d6/dc/d4d/d4a/cee 0 2024-09-13T21:44:57.359 INFO:tasks.workunit.client.0.smithi119.stdout:3/958: rename d6/d25/d2f/f39 to d6/d15/d8f/d12e/de2/f137 0 2024-09-13T21:44:57.362 INFO:tasks.workunit.client.0.smithi119.stdout:6/848: rename dc/d3a/dbb/d7a/f81 to dc/d3a/f10c 0 2024-09-13T21:44:57.363 INFO:tasks.workunit.client.1.smithi155.stdout:0/609: link d1/f5 d1/d6/fef 0 2024-09-13T21:44:57.365 INFO:tasks.workunit.client.0.smithi119.stdout:8/972: link d1b/d1d/d39/cf6 d1b/d1d/d26/d3e/d65/c12f 0 2024-09-13T21:44:57.367 INFO:tasks.workunit.client.1.smithi155.stdout:0/610: unlink d1/f2f 0 2024-09-13T21:44:57.367 INFO:tasks.workunit.client.1.smithi155.stdout:2/459: truncate d2/dd/de/d15/d2e/f83 2059453 0 2024-09-13T21:44:57.367 INFO:tasks.workunit.client.0.smithi119.stdout:8/973: symlink d1b/d4e/d71/dac/l130 0 2024-09-13T21:44:57.368 INFO:tasks.workunit.client.1.smithi155.stdout:0/611: stat d1/d6/dc/d4d/d4a/f98 0 2024-09-13T21:44:57.369 INFO:tasks.workunit.client.1.smithi155.stdout:2/460: creat d2/dd/d21/d39/d84/fa4 x:0 0 0 2024-09-13T21:44:57.370 INFO:tasks.workunit.client.0.smithi119.stdout:6/849: rename dc/df/d41/dae/ldd to dc/d3d/d40/d6b/df9/l10d 0 2024-09-13T21:44:57.371 INFO:tasks.workunit.client.0.smithi119.stdout:3/959: getdents d6/d9f 0 2024-09-13T21:44:57.372 INFO:tasks.workunit.client.1.smithi155.stdout:7/529: dread d5/d10/f18 [4194304,4194304] 0 2024-09-13T21:44:57.373 INFO:tasks.workunit.client.0.smithi119.stdout:6/850: mkdir dc/d3a/dbb/d7a/dc7/d10e 0 2024-09-13T21:44:57.374 INFO:tasks.workunit.client.0.smithi119.stdout:3/960: symlink d6/d15/d8f/d12e/de2/d109/l138 0 2024-09-13T21:44:57.375 INFO:tasks.workunit.client.0.smithi119.stdout:3/961: readlink d6/d25/d2f/d33/d88/d96/la4 0 2024-09-13T21:44:57.376 INFO:tasks.workunit.client.0.smithi119.stdout:8/974: rename ca to d1b/d1d/d26/d3e/d65/c131 0 2024-09-13T21:44:57.376 INFO:tasks.workunit.client.1.smithi155.stdout:7/530: rename d5/d10/d3e/d40/f44 to d5/d13/fa4 0 2024-09-13T21:44:57.377 INFO:tasks.workunit.client.0.smithi119.stdout:3/962: mknod d6/d15/d103/d95/c139 0 2024-09-13T21:44:57.377 INFO:tasks.workunit.client.1.smithi155.stdout:3/568: write d3/d21/f41 [309205,104487] 0 2024-09-13T21:44:57.378 INFO:tasks.workunit.client.0.smithi119.stdout:6/851: link dc/d3d/d4e/f74 dc/d3d/dcf/f10f 0 2024-09-13T21:44:57.380 INFO:tasks.workunit.client.0.smithi119.stdout:3/963: mknod d6/d15/da9/c13a 0 2024-09-13T21:44:57.381 INFO:tasks.workunit.client.1.smithi155.stdout:8/483: dwrite d2/d6/dd/d12/f46 [0,4194304] 0 2024-09-13T21:44:57.382 INFO:tasks.workunit.client.1.smithi155.stdout:7/531: truncate d5/d10/d3e/d3f/f7c 79192 0 2024-09-13T21:44:57.383 INFO:tasks.workunit.client.0.smithi119.stdout:8/975: rename d1b/d1d/d26/d3e/daa/l122 to d1b/d1d/d48/db2/d11e/l132 0 2024-09-13T21:44:57.385 INFO:tasks.workunit.client.1.smithi155.stdout:3/569: mkdir d3/d25/d1b/d1f/dc8 0 2024-09-13T21:44:57.385 INFO:tasks.workunit.client.0.smithi119.stdout:8/976: write d1b/d1d/d26/d3e/d65/f76 [370902,80778] 0 2024-09-13T21:44:57.387 INFO:tasks.workunit.client.1.smithi155.stdout:2/461: write d2/db/f62 [321360,103549] 0 2024-09-13T21:44:57.388 INFO:tasks.workunit.client.0.smithi119.stdout:3/964: dwrite d6/d44/d52/f58 [0,4194304] 0 2024-09-13T21:44:57.388 INFO:tasks.workunit.client.0.smithi119.stdout:8/977: creat d1b/d1d/dc3/f133 x:0 0 0 2024-09-13T21:44:57.391 INFO:tasks.workunit.client.0.smithi119.stdout:3/965: truncate d6/d15/d10f/f12a 862027 0 2024-09-13T21:44:57.393 INFO:tasks.workunit.client.0.smithi119.stdout:8/978: fdatasync d1b/d1d/d48/d54/f9d 0 2024-09-13T21:44:57.393 INFO:tasks.workunit.client.0.smithi119.stdout:3/966: fdatasync d6/d25/fe6 0 2024-09-13T21:44:57.393 INFO:tasks.workunit.client.1.smithi155.stdout:8/484: creat d2/d6/dd/f92 x:0 0 0 2024-09-13T21:44:57.394 INFO:tasks.workunit.client.1.smithi155.stdout:3/570: mkdir d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9 0 2024-09-13T21:44:57.398 INFO:tasks.workunit.client.0.smithi119.stdout:8/979: stat d1b/d1d/d39/fd6 0 2024-09-13T21:44:57.398 INFO:tasks.workunit.client.1.smithi155.stdout:8/485: rename d2/d8/d75/l83 to d2/d91/l93 0 2024-09-13T21:44:57.399 INFO:tasks.workunit.client.0.smithi119.stdout:4/928: truncate d4/d1e/d28/d34/d6a/d79/d9f/dba/ffc 81964 0 2024-09-13T21:44:57.401 INFO:tasks.workunit.client.1.smithi155.stdout:8/486: creat d2/d6/f94 x:0 0 0 2024-09-13T21:44:57.402 INFO:tasks.workunit.client.0.smithi119.stdout:1/839: dwrite d1/d3/d61/f85 [0,4194304] 0 2024-09-13T21:44:57.402 INFO:tasks.workunit.client.0.smithi119.stdout:2/877: dwrite d1/d38/d89/f9f [0,4194304] 0 2024-09-13T21:44:57.402 INFO:tasks.workunit.client.1.smithi155.stdout:7/532: write d5/df/d60/d6d/f7a [2266677,116324] 0 2024-09-13T21:44:57.403 INFO:tasks.workunit.client.1.smithi155.stdout:8/487: stat d2/d6/dd/f62 0 2024-09-13T21:44:57.403 INFO:tasks.workunit.client.1.smithi155.stdout:2/462: write d2/dd/de/d15/d2e/f7d [1015518,62869] 0 2024-09-13T21:44:57.404 INFO:tasks.workunit.client.0.smithi119.stdout:4/929: stat d4/d1e/d26/d60/d71/feb 0 2024-09-13T21:44:57.406 INFO:tasks.workunit.client.1.smithi155.stdout:2/463: symlink d2/dd/de/d15/d38/la5 0 2024-09-13T21:44:57.411 INFO:tasks.workunit.client.0.smithi119.stdout:3/967: write d6/d15/d1a/d45/d47/d4d/da7/fb1 [1179681,40003] 0 2024-09-13T21:44:57.412 INFO:tasks.workunit.client.0.smithi119.stdout:2/878: link d1/d22/d55/d64/f107 d1/d97/f118 0 2024-09-13T21:44:57.413 INFO:tasks.workunit.client.1.smithi155.stdout:3/571: dwrite d3/d25/d1b/d1f/f22 [0,4194304] 0 2024-09-13T21:44:57.414 INFO:tasks.workunit.client.1.smithi155.stdout:2/464: getdents d2/db 0 2024-09-13T21:44:57.415 INFO:tasks.workunit.client.0.smithi119.stdout:1/840: creat d1/d3/d61/d7e/d53/f119 x:0 0 0 2024-09-13T21:44:57.415 INFO:tasks.workunit.client.0.smithi119.stdout:3/968: fsync d6/d25/f2a 0 2024-09-13T21:44:57.416 INFO:tasks.workunit.client.1.smithi155.stdout:3/572: mknod d3/d25/d1b/d90/cca 0 2024-09-13T21:44:57.417 INFO:tasks.workunit.client.0.smithi119.stdout:0/976: dwrite de/d1c/d59/ff0 [0,4194304] 0 2024-09-13T21:44:57.417 INFO:tasks.workunit.client.0.smithi119.stdout:3/969: dread - d6/d9f/f107 zero size 2024-09-13T21:44:57.418 INFO:tasks.workunit.client.1.smithi155.stdout:2/465: readlink d2/dd/de/d15/d2e/d31/d5d/l98 0 2024-09-13T21:44:57.420 INFO:tasks.workunit.client.0.smithi119.stdout:2/879: creat d1/d7/d47/f119 x:0 0 0 2024-09-13T21:44:57.423 INFO:tasks.workunit.client.0.smithi119.stdout:8/980: dread d1b/fee [0,4194304] 0 2024-09-13T21:44:57.423 INFO:tasks.workunit.client.0.smithi119.stdout:1/841: mkdir d1/d3/d6c/da8/d11a 0 2024-09-13T21:44:57.424 INFO:tasks.workunit.client.1.smithi155.stdout:2/466: rename d2/dd/de/d15/d2e/f3c to d2/dd/de/d15/d2e/d31/fa6 0 2024-09-13T21:44:57.426 INFO:tasks.workunit.client.0.smithi119.stdout:3/970: stat d6/d15/d1a/d45/d47/d4d/dcf/dd0/cd1 0 2024-09-13T21:44:57.427 INFO:tasks.workunit.client.0.smithi119.stdout:0/977: dwrite de/d1c/d64/f73 [0,4194304] 0 2024-09-13T21:44:57.429 INFO:tasks.workunit.client.0.smithi119.stdout:2/880: creat d1/d22/d5a/d5d/db7/f11a x:0 0 0 2024-09-13T21:44:57.429 INFO:tasks.workunit.client.0.smithi119.stdout:4/930: link d4/f53 d4/d1e/d28/d34/d99/df0/d100/d12f/f133 0 2024-09-13T21:44:57.432 INFO:tasks.workunit.client.1.smithi155.stdout:2/467: dwrite f0 [0,4194304] 0 2024-09-13T21:44:57.433 INFO:tasks.workunit.client.0.smithi119.stdout:1/842: rmdir d1/d3/d61/d77/d78/d32/d33/d72/db4 39 2024-09-13T21:44:57.434 INFO:tasks.workunit.client.0.smithi119.stdout:5/940: sync 2024-09-13T21:44:57.434 INFO:tasks.workunit.client.0.smithi119.stdout:7/982: sync 2024-09-13T21:44:57.441 INFO:tasks.workunit.client.0.smithi119.stdout:2/881: symlink d1/d7/d47/df3/d108/l11b 0 2024-09-13T21:44:57.441 INFO:tasks.workunit.client.0.smithi119.stdout:7/983: read - d8/d3c/d53/d37/d83/d89/de7/f109 zero size 2024-09-13T21:44:57.444 INFO:tasks.workunit.client.0.smithi119.stdout:2/882: readlink d1/d38/d89/lef 0 2024-09-13T21:44:57.446 INFO:tasks.workunit.client.0.smithi119.stdout:8/981: dwrite d1b/d1d/f8f [0,4194304] 0 2024-09-13T21:44:57.447 INFO:tasks.workunit.client.1.smithi155.stdout:3/573: dread d3/d25/d1b/f38 [0,4194304] 0 2024-09-13T21:44:57.448 INFO:tasks.workunit.client.0.smithi119.stdout:1/843: creat d1/d3/d61/d77/d78/d32/d33/dd0/f11b x:0 0 0 2024-09-13T21:44:57.449 INFO:tasks.workunit.client.1.smithi155.stdout:3/574: fdatasync d3/d21/f41 0 2024-09-13T21:44:57.449 INFO:tasks.workunit.client.1.smithi155.stdout:3/575: chown d3/d25/d1b/d1f/d82/f9d 7336 1 2024-09-13T21:44:57.451 INFO:tasks.workunit.client.0.smithi119.stdout:5/941: dwrite d0/d3/d4/f5e [0,4194304] 0 2024-09-13T21:44:57.452 INFO:tasks.workunit.client.0.smithi119.stdout:1/844: stat d1/d3/d61/d77/d78/db8/dde/df1/df8 0 2024-09-13T21:44:57.454 INFO:tasks.workunit.client.0.smithi119.stdout:8/982: symlink d1b/d1d/df8/l134 0 2024-09-13T21:44:57.455 INFO:tasks.workunit.client.0.smithi119.stdout:0/978: getdents de/d1c/d2f/d35/dce 0 2024-09-13T21:44:57.456 INFO:tasks.workunit.client.0.smithi119.stdout:4/931: getdents d4/d114/de9 0 2024-09-13T21:44:57.457 INFO:tasks.workunit.client.0.smithi119.stdout:8/983: dread - d1b/d1d/d26/df0/d10b/feb zero size 2024-09-13T21:44:57.462 INFO:tasks.workunit.client.0.smithi119.stdout:8/984: stat d1b/d1d/d26/df0/f116 0 2024-09-13T21:44:57.462 INFO:tasks.workunit.client.0.smithi119.stdout:0/979: truncate de/d49/f126 756924 0 2024-09-13T21:44:57.462 INFO:tasks.workunit.client.0.smithi119.stdout:7/984: getdents d8/d19/dd7 0 2024-09-13T21:44:57.462 INFO:tasks.workunit.client.0.smithi119.stdout:5/942: mknod d0/d3/d4/def/df1/c131 0 2024-09-13T21:44:57.462 INFO:tasks.workunit.client.0.smithi119.stdout:7/985: chown d8/d3c/fe3 4908 1 2024-09-13T21:44:57.462 INFO:tasks.workunit.client.0.smithi119.stdout:4/932: write d4/f2b [4514148,72718] 0 2024-09-13T21:44:57.463 INFO:tasks.workunit.client.0.smithi119.stdout:7/986: fsync d8/d3c/d53/d37/f140 0 2024-09-13T21:44:57.463 INFO:tasks.workunit.client.1.smithi155.stdout:2/468: dwrite d2/db/f18 [0,4194304] 0 2024-09-13T21:44:57.464 INFO:tasks.workunit.client.0.smithi119.stdout:3/971: write d6/d25/d2f/d33/d56/f9b [247299,92986] 0 2024-09-13T21:44:57.465 INFO:tasks.workunit.client.0.smithi119.stdout:5/943: mkdir d0/d3/d4/d9/d1e/da5/d121/d132 0 2024-09-13T21:44:57.467 INFO:tasks.workunit.client.0.smithi119.stdout:3/972: write d6/d15/f35 [3579922,15482] 0 2024-09-13T21:44:57.467 INFO:tasks.workunit.client.1.smithi155.stdout:2/469: symlink d2/dd/d21/la7 0 2024-09-13T21:44:57.467 INFO:tasks.workunit.client.1.smithi155.stdout:2/470: dread - d2/dd/de/d15/f4c zero size 2024-09-13T21:44:57.469 INFO:tasks.workunit.client.0.smithi119.stdout:3/973: chown d6/d15/d1a/d45/d47/d4d/da7/fb1 2473 1 2024-09-13T21:44:57.469 INFO:tasks.workunit.client.0.smithi119.stdout:1/845: dread d1/d3/d61/d77/d78/d32/d33/d43/d74/f8b [0,4194304] 0 2024-09-13T21:44:57.471 INFO:tasks.workunit.client.1.smithi155.stdout:2/471: mkdir d2/dd/de/d15/d38/d41/d5f/d70/da8 0 2024-09-13T21:44:57.472 INFO:tasks.workunit.client.1.smithi155.stdout:2/472: truncate d2/dd/f72 213249 0 2024-09-13T21:44:57.472 INFO:tasks.workunit.client.0.smithi119.stdout:0/980: dread de/d1c/d2f/d35/d4a/f105 [0,4194304] 0 2024-09-13T21:44:57.473 INFO:tasks.workunit.client.0.smithi119.stdout:1/846: rmdir d1/d3/dc/d24 39 2024-09-13T21:44:57.473 INFO:tasks.workunit.client.0.smithi119.stdout:5/944: symlink d0/d3/d4/def/d10f/l133 0 2024-09-13T21:44:57.473 INFO:tasks.workunit.client.1.smithi155.stdout:2/473: creat d2/dd/de/d15/d2e/d66/d6f/fa9 x:0 0 0 2024-09-13T21:44:57.474 INFO:tasks.workunit.client.1.smithi155.stdout:2/474: chown d2/db/f1e 0 1 2024-09-13T21:44:57.474 INFO:tasks.workunit.client.0.smithi119.stdout:3/974: symlink d6/d15/d1a/d45/d47/d4d/dcf/dd6/l13b 0 2024-09-13T21:44:57.477 INFO:tasks.workunit.client.0.smithi119.stdout:2/883: dwrite d1/d22/d55/d31/f94 [0,4194304] 0 2024-09-13T21:44:57.477 INFO:tasks.workunit.client.1.smithi155.stdout:2/475: rename d2/dd/de/d15/d2e/d31/fa6 to d2/dd/d21/d39/faa 0 2024-09-13T21:44:57.477 INFO:tasks.workunit.client.0.smithi119.stdout:3/975: symlink d6/d15/d10f/l13c 0 2024-09-13T21:44:57.478 INFO:tasks.workunit.client.1.smithi155.stdout:3/576: dread d3/d25/d1b/f4e [0,4194304] 0 2024-09-13T21:44:57.479 INFO:tasks.workunit.client.1.smithi155.stdout:2/476: symlink d2/lab 0 2024-09-13T21:44:57.480 INFO:tasks.workunit.client.0.smithi119.stdout:5/945: unlink d0/d3/d4/def/d10f/cba 0 2024-09-13T21:44:57.482 INFO:tasks.workunit.client.0.smithi119.stdout:0/981: dread de/d1c/d2f/d40/d66/dcb/f113 [0,4194304] 0 2024-09-13T21:44:57.484 INFO:tasks.workunit.client.0.smithi119.stdout:3/976: rmdir d6/d15/d103 39 2024-09-13T21:44:57.487 INFO:tasks.workunit.client.0.smithi119.stdout:2/884: creat d1/d22/d55/d31/df0/f11c x:0 0 0 2024-09-13T21:44:57.488 INFO:tasks.workunit.client.0.smithi119.stdout:3/977: creat d6/d25/d2f/d33/d56/da0/f13d x:0 0 0 2024-09-13T21:44:57.491 INFO:tasks.workunit.client.0.smithi119.stdout:5/946: rename d0/d3/d1f/d21/da1/dfb to d0/d3/d4/d2e/d97/d134 0 2024-09-13T21:44:57.493 INFO:tasks.workunit.client.0.smithi119.stdout:3/978: write d6/d44/f51 [1742555,53825] 0 2024-09-13T21:44:57.495 INFO:tasks.workunit.client.0.smithi119.stdout:8/985: dwrite d1b/d4e/d71/f98 [0,4194304] 0 2024-09-13T21:44:57.495 INFO:tasks.workunit.client.0.smithi119.stdout:1/847: dwrite d1/d3/d61/d77/d78/d32/dda/d3d/fb1 [0,4194304] 0 2024-09-13T21:44:57.498 INFO:tasks.workunit.client.0.smithi119.stdout:5/947: mknod d0/d3/d4/d9/c135 0 2024-09-13T21:44:57.498 INFO:tasks.workunit.client.0.smithi119.stdout:3/979: chown d6/d25/d2f/d33/l4a 40 1 2024-09-13T21:44:57.499 INFO:tasks.workunit.client.0.smithi119.stdout:1/848: read - d1/d3/d61/fb5 zero size 2024-09-13T21:44:57.499 INFO:tasks.workunit.client.0.smithi119.stdout:7/987: write d8/d3c/d53/d37/d57/d5f/fd1 [1785442,3207] 0 2024-09-13T21:44:57.500 INFO:tasks.workunit.client.0.smithi119.stdout:0/982: dread de/f77 [4194304,4194304] 0 2024-09-13T21:44:57.501 INFO:tasks.workunit.client.1.smithi155.stdout:3/577: dwrite d3/d25/d17/d3b/f77 [0,4194304] 0 2024-09-13T21:44:57.503 INFO:tasks.workunit.client.1.smithi155.stdout:3/578: write d3/d25/d17/d52/fac [583646,52704] 0 2024-09-13T21:44:57.503 INFO:tasks.workunit.client.0.smithi119.stdout:3/980: write d6/fc [2674082,121823] 0 2024-09-13T21:44:57.503 INFO:tasks.workunit.client.1.smithi155.stdout:3/579: readlink d3/d25/l51 0 2024-09-13T21:44:57.510 INFO:tasks.workunit.client.1.smithi155.stdout:3/580: link d3/d25/d1b/d1f/d82/d83/fbe d3/d25/d1b/d1f/d36/d7c/fcb 0 2024-09-13T21:44:57.513 INFO:tasks.workunit.client.1.smithi155.stdout:3/581: getdents d3/d21/d4a 0 2024-09-13T21:44:57.513 INFO:tasks.workunit.client.1.smithi155.stdout:9/584: sync 2024-09-13T21:44:57.514 INFO:tasks.workunit.client.1.smithi155.stdout:3/582: fdatasync d3/d25/d1b/d1f/d82/d83/fa5 0 2024-09-13T21:44:57.516 INFO:tasks.workunit.client.0.smithi119.stdout:8/986: rename d1b/d4e/d6a to d1b/d1d/d48/db2/d11e/d135 0 2024-09-13T21:44:57.518 INFO:tasks.workunit.client.0.smithi119.stdout:5/948: symlink d0/d3/d4/d2e/d65/l136 0 2024-09-13T21:44:57.519 INFO:tasks.workunit.client.1.smithi155.stdout:9/585: dwrite dc/de/d5c/f5e [0,4194304] 0 2024-09-13T21:44:57.519 INFO:tasks.workunit.client.0.smithi119.stdout:5/949: readlink d0/d3/d1f/d21/l23 0 2024-09-13T21:44:57.521 INFO:tasks.workunit.client.0.smithi119.stdout:5/950: write d0/d3/d4/d9/f46 [1069678,119968] 0 2024-09-13T21:44:57.522 INFO:tasks.workunit.client.0.smithi119.stdout:0/983: rename de/d49/le1 to de/d1c/d2f/d35/dce/l14a 0 2024-09-13T21:44:57.525 INFO:tasks.workunit.client.0.smithi119.stdout:3/981: link d6/d25/d2f/d33/d56/ffd d6/d15/d1a/d45/d47/d4d/da7/f13e 0 2024-09-13T21:44:57.528 INFO:tasks.workunit.client.1.smithi155.stdout:9/586: dwrite dc/de/d6f/fb6 [0,4194304] 0 2024-09-13T21:44:57.530 INFO:tasks.workunit.client.0.smithi119.stdout:3/982: dread d6/d15/d8f/d12e/de2/d109/f124 [0,4194304] 0 2024-09-13T21:44:57.531 INFO:tasks.workunit.client.0.smithi119.stdout:0/984: unlink de/d3c/c53 0 2024-09-13T21:44:57.531 INFO:tasks.workunit.client.1.smithi155.stdout:9/587: creat dc/de/d6f/d71/fcd x:0 0 0 2024-09-13T21:44:57.532 INFO:tasks.workunit.client.1.smithi155.stdout:3/583: write d3/d25/d1b/d1f/f30 [3332978,62310] 0 2024-09-13T21:44:57.535 INFO:tasks.workunit.client.1.smithi155.stdout:3/584: mkdir d3/d25/d1b/d1f/d36/d5c/dcc 0 2024-09-13T21:44:57.535 INFO:tasks.workunit.client.0.smithi119.stdout:5/951: rename d0/d3/d4/d9/d1e/da5/d121 to d0/d3/d4/d9/d14/d137 0 2024-09-13T21:44:57.536 INFO:tasks.workunit.client.0.smithi119.stdout:3/983: creat d6/d15/d8f/f13f x:0 0 0 2024-09-13T21:44:57.536 INFO:tasks.workunit.client.1.smithi155.stdout:2/477: dread d2/dd/de/d15/f64 [0,4194304] 0 2024-09-13T21:44:57.537 INFO:tasks.workunit.client.0.smithi119.stdout:3/984: dread - d6/d15/d10f/f123 zero size 2024-09-13T21:44:57.537 INFO:tasks.workunit.client.0.smithi119.stdout:7/988: write d8/d4d/f64 [420107,26215] 0 2024-09-13T21:44:57.540 INFO:tasks.workunit.client.0.smithi119.stdout:0/985: link de/d1c/d2b/d34/cd5 de/d1c/d2b/d76/d9b/c14b 0 2024-09-13T21:44:57.541 INFO:tasks.workunit.client.1.smithi155.stdout:9/588: dwrite dc/d18/f7a [0,4194304] 0 2024-09-13T21:44:57.541 INFO:tasks.workunit.client.1.smithi155.stdout:3/585: write d3/d25/d1b/d1f/d36/f5d [1980761,60973] 0 2024-09-13T21:44:57.544 INFO:tasks.workunit.client.1.smithi155.stdout:2/478: mknod d2/dd/de/d15/d2e/da3/cac 0 2024-09-13T21:44:57.545 INFO:tasks.workunit.client.1.smithi155.stdout:9/589: chown dc/d18/d1e/f64 47945 1 2024-09-13T21:44:57.545 INFO:tasks.workunit.client.0.smithi119.stdout:1/849: dread d1/f22 [0,4194304] 0 2024-09-13T21:44:57.545 INFO:tasks.workunit.client.0.smithi119.stdout:0/986: rmdir de/d1c/d52/de4 39 2024-09-13T21:44:57.545 INFO:tasks.workunit.client.0.smithi119.stdout:3/985: link d6/d25/l122 d6/d25/d2f/d33/d56/dab/dc2/l140 0 2024-09-13T21:44:57.548 INFO:tasks.workunit.client.0.smithi119.stdout:3/986: dread - d6/d9f/f107 zero size 2024-09-13T21:44:57.548 INFO:tasks.workunit.client.1.smithi155.stdout:9/590: creat dc/d19/d23/d38/d90/d74/fce x:0 0 0 2024-09-13T21:44:57.548 INFO:tasks.workunit.client.0.smithi119.stdout:0/987: symlink de/d3c/de6/l14c 0 2024-09-13T21:44:57.549 INFO:tasks.workunit.client.1.smithi155.stdout:2/479: getdents d2/dd/de/d15/d2e/d96 0 2024-09-13T21:44:57.549 INFO:tasks.workunit.client.0.smithi119.stdout:0/988: dread - de/d4e/da5/f11b zero size 2024-09-13T21:44:57.550 INFO:tasks.workunit.client.1.smithi155.stdout:9/591: rmdir dc/de/d5c 39 2024-09-13T21:44:57.552 INFO:tasks.workunit.client.1.smithi155.stdout:9/592: write dc/de/d15/f24 [3886769,98632] 0 2024-09-13T21:44:57.553 INFO:tasks.workunit.client.0.smithi119.stdout:1/850: mknod d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/c11c 0 2024-09-13T21:44:57.554 INFO:tasks.workunit.client.1.smithi155.stdout:2/480: rename d2/f6 to d2/dd/d37/d4e/fad 0 2024-09-13T21:44:57.555 INFO:tasks.workunit.client.1.smithi155.stdout:2/481: dread - d2/dd/de/d15/d38/d41/f8f zero size 2024-09-13T21:44:57.556 INFO:tasks.workunit.client.1.smithi155.stdout:9/593: fdatasync dc/de/d6f/d71/fb8 0 2024-09-13T21:44:57.556 INFO:tasks.workunit.client.0.smithi119.stdout:3/987: dread d6/d15/d10f/f12a [0,4194304] 0 2024-09-13T21:44:57.558 INFO:tasks.workunit.client.0.smithi119.stdout:0/989: rmdir de/d1c/d2f/d35/d90 39 2024-09-13T21:44:57.559 INFO:tasks.workunit.client.1.smithi155.stdout:2/482: creat d2/dd/de/d15/d2e/d66/d7c/fae x:0 0 0 2024-09-13T21:44:57.561 INFO:tasks.workunit.client.1.smithi155.stdout:2/483: fdatasync d2/dd/f72 0 2024-09-13T21:44:57.564 INFO:tasks.workunit.client.0.smithi119.stdout:3/988: dwrite d6/d44/d52/f86 [0,4194304] 0 2024-09-13T21:44:57.564 INFO:tasks.workunit.client.0.smithi119.stdout:1/851: mknod d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/dd8/c11d 0 2024-09-13T21:44:57.564 INFO:tasks.workunit.client.1.smithi155.stdout:3/586: dwrite d3/d21/fc6 [0,4194304] 0 2024-09-13T21:44:57.566 INFO:tasks.workunit.client.1.smithi155.stdout:9/594: dwrite dc/de/d15/f24 [0,4194304] 0 2024-09-13T21:44:57.568 INFO:tasks.workunit.client.0.smithi119.stdout:5/952: dwrite d0/d3/d4/d9/d1e/f72 [0,4194304] 0 2024-09-13T21:44:57.569 INFO:tasks.workunit.client.0.smithi119.stdout:0/990: truncate de/d1c/d2b/dd7/fda 3936933 0 2024-09-13T21:44:57.569 INFO:tasks.workunit.client.1.smithi155.stdout:9/595: truncate dc/de/d6f/d71/f9b 271243 0 2024-09-13T21:44:57.570 INFO:tasks.workunit.client.1.smithi155.stdout:3/587: mkdir d3/d21/d4a/dcd 0 2024-09-13T21:44:57.575 INFO:tasks.workunit.client.0.smithi119.stdout:1/852: symlink d1/d3/d61/d77/d78/d32/d33/d43/l11e 0 2024-09-13T21:44:57.575 INFO:tasks.workunit.client.1.smithi155.stdout:3/588: write d3/d25/d1b/d1f/d82/f9d [28120,89913] 0 2024-09-13T21:44:57.577 INFO:tasks.workunit.client.1.smithi155.stdout:2/484: write d2/dd/de/d15/f1c [1231622,7498] 0 2024-09-13T21:44:57.578 INFO:tasks.workunit.client.0.smithi119.stdout:0/991: mkdir de/d49/d14d 0 2024-09-13T21:44:57.581 INFO:tasks.workunit.client.0.smithi119.stdout:1/853: dread - d1/d3/d61/d77/d78/d32/dda/d28/d93/fe8 zero size 2024-09-13T21:44:57.582 INFO:tasks.workunit.client.1.smithi155.stdout:9/596: dwrite dc/d18/d1e/f22 [0,4194304] 0 2024-09-13T21:44:57.583 INFO:tasks.workunit.client.0.smithi119.stdout:3/989: link d6/d15/da9/f121 d6/d15/d1a/d45/f141 0 2024-09-13T21:44:57.584 INFO:tasks.workunit.client.1.smithi155.stdout:9/597: chown dc/d19/d23/d38/d90/f8d 36032704 1 2024-09-13T21:44:57.584 INFO:tasks.workunit.client.1.smithi155.stdout:3/589: dread d3/d25/f94 [0,4194304] 0 2024-09-13T21:44:57.587 INFO:tasks.workunit.client.0.smithi119.stdout:3/990: fdatasync d6/d15/d103/fe5 0 2024-09-13T21:44:57.588 INFO:tasks.workunit.client.0.smithi119.stdout:1/854: creat d1/d3/d61/d77/d78/db8/dde/f11f x:0 0 0 2024-09-13T21:44:57.590 INFO:tasks.workunit.client.1.smithi155.stdout:2/485: link d2/dd/de/d15/d3f/c7a d2/dd/de/d15/d2e/d31/d5d/caf 0 2024-09-13T21:44:57.590 INFO:tasks.workunit.client.0.smithi119.stdout:0/992: dwrite de/d4e/fe0 [0,4194304] 0 2024-09-13T21:44:57.591 INFO:tasks.workunit.client.0.smithi119.stdout:3/991: symlink d6/d15/d8f/l142 0 2024-09-13T21:44:57.593 INFO:tasks.workunit.client.1.smithi155.stdout:9/598: dwrite dc/de/d15/f24 [0,4194304] 0 2024-09-13T21:44:57.593 INFO:tasks.workunit.client.1.smithi155.stdout:2/486: truncate d2/dd/d37/d4e/f73 886036 0 2024-09-13T21:44:57.594 INFO:tasks.workunit.client.1.smithi155.stdout:3/590: link d3/d25/l18 d3/d25/d1b/d1f/d36/d5c/dba/lce 0 2024-09-13T21:44:57.594 INFO:tasks.workunit.client.1.smithi155.stdout:9/599: chown dc/d19/d23/f9a 221448515 1 2024-09-13T21:44:57.596 INFO:tasks.workunit.client.1.smithi155.stdout:9/600: chown dc/de/d15/f97 2051280 1 2024-09-13T21:44:57.599 INFO:tasks.workunit.client.0.smithi119.stdout:0/993: rmdir de/d1c/d64/d132/d147 0 2024-09-13T21:44:57.600 INFO:tasks.workunit.client.0.smithi119.stdout:3/992: link d6/d15/d8f/d12e/de2/d11b/d11f/l106 d6/d44/d52/l143 0 2024-09-13T21:44:57.601 INFO:tasks.workunit.client.0.smithi119.stdout:3/993: write d6/d44/d52/f58 [5153854,2275] 0 2024-09-13T21:44:57.601 INFO:tasks.workunit.client.1.smithi155.stdout:9/601: symlink dc/d19/d21/lcf 0 2024-09-13T21:44:57.602 INFO:tasks.workunit.client.0.smithi119.stdout:1/855: creat d1/d3/d61/d77/d78/d32/d33/d72/f120 x:0 0 0 2024-09-13T21:44:57.603 INFO:tasks.workunit.client.1.smithi155.stdout:2/487: dwrite d2/db/f62 [0,4194304] 0 2024-09-13T21:44:57.604 INFO:tasks.workunit.client.0.smithi119.stdout:0/994: symlink de/d3c/de6/l14e 0 2024-09-13T21:44:57.606 INFO:tasks.workunit.client.1.smithi155.stdout:9/602: rename dc/de/d15/c17 to dc/de/d6f/d71/cd0 0 2024-09-13T21:44:57.607 INFO:tasks.workunit.client.0.smithi119.stdout:0/995: write de/d1c/d52/f7a [2042146,31019] 0 2024-09-13T21:44:57.608 INFO:tasks.workunit.client.1.smithi155.stdout:2/488: mkdir d2/dd/d21/d39/d84/db0 0 2024-09-13T21:44:57.608 INFO:tasks.workunit.client.1.smithi155.stdout:9/603: write dc/d19/d21/f55 [104389,62260] 0 2024-09-13T21:44:57.610 INFO:tasks.workunit.client.1.smithi155.stdout:2/489: write d2/dd/de/d15/d2e/d66/d7c/fae [7998,38151] 0 2024-09-13T21:44:57.611 INFO:tasks.workunit.client.0.smithi119.stdout:1/856: rename d1/d3/d61/leb to d1/d3/d61/d77/d78/d32/dda/d3d/l121 0 2024-09-13T21:44:57.612 INFO:tasks.workunit.client.1.smithi155.stdout:9/604: creat dc/de/d6f/dae/fd1 x:0 0 0 2024-09-13T21:44:57.613 INFO:tasks.workunit.client.0.smithi119.stdout:3/994: dwrite d6/d25/d2f/d33/f71 [0,4194304] 0 2024-09-13T21:44:57.615 INFO:tasks.workunit.client.0.smithi119.stdout:3/995: unlink d6/d15/c32 0 2024-09-13T21:44:57.618 INFO:tasks.workunit.client.0.smithi119.stdout:1/857: rename d1/d3/d61/d77/d78/db8/fd4 to d1/d3/d61/d77/d78/d32/d33/dd0/f122 0 2024-09-13T21:44:57.621 INFO:tasks.workunit.client.1.smithi155.stdout:9/605: dwrite dc/d19/d21/f6b [0,4194304] 0 2024-09-13T21:44:57.621 INFO:tasks.workunit.client.1.smithi155.stdout:2/490: dwrite d2/dd/de/d15/d2e/d31/f80 [0,4194304] 0 2024-09-13T21:44:57.622 INFO:tasks.workunit.client.0.smithi119.stdout:1/858: rmdir d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/dd8/d8c 39 2024-09-13T21:44:57.623 INFO:tasks.workunit.client.0.smithi119.stdout:3/996: dread d6/fc [0,4194304] 0 2024-09-13T21:44:57.623 INFO:tasks.workunit.client.0.smithi119.stdout:5/953: dread d0/d3/d1f/d21/d4f/df8/f109 [0,4194304] 0 2024-09-13T21:44:57.625 INFO:tasks.workunit.client.0.smithi119.stdout:3/997: mknod d6/d25/d2f/c144 0 2024-09-13T21:44:57.627 INFO:tasks.workunit.client.0.smithi119.stdout:5/954: unlink d0/d3/d4/d9/d14/d24/l83 0 2024-09-13T21:44:57.628 INFO:tasks.workunit.client.1.smithi155.stdout:2/491: mknod d2/dd/de/d15/d2e/da3/cb1 0 2024-09-13T21:44:57.629 INFO:tasks.workunit.client.0.smithi119.stdout:1/859: creat d1/d3/d61/d77/d78/d32/dda/f123 x:0 0 0 2024-09-13T21:44:57.629 INFO:tasks.workunit.client.1.smithi155.stdout:2/492: dread - d2/dd/de/d15/d2e/d66/d6f/fa9 zero size 2024-09-13T21:44:57.630 INFO:tasks.workunit.client.0.smithi119.stdout:3/998: mkdir d6/d44/d145 0 2024-09-13T21:44:57.632 INFO:tasks.workunit.client.0.smithi119.stdout:5/955: mknod d0/d3/d4/d9/d14/d137/d132/c138 0 2024-09-13T21:44:57.632 INFO:tasks.workunit.client.0.smithi119.stdout:3/999: fsync d6/d25/d2f/d33/d56/da0/fb5 0 2024-09-13T21:44:57.633 INFO:tasks.workunit.client.1.smithi155.stdout:2/493: unlink d2/dd/f2c 0 2024-09-13T21:44:57.634 INFO:tasks.workunit.client.0.smithi119.stdout:5/956: readlink d0/d3/d4/d9/d14/d24/la7 0 2024-09-13T21:44:57.634 INFO:tasks.workunit.client.1.smithi155.stdout:2/494: creat d2/dd/de/d15/d38/d41/fb2 x:0 0 0 2024-09-13T21:44:57.636 INFO:tasks.workunit.client.1.smithi155.stdout:2/495: symlink d2/dd/de/d15/lb3 0 2024-09-13T21:44:57.637 INFO:tasks.workunit.client.0.smithi119.stdout:5/957: truncate d0/d3/d4/d2e/d65/fca 3471838 0 2024-09-13T21:44:57.637 INFO:tasks.workunit.client.1.smithi155.stdout:2/496: creat d2/dd/de/d15/d2e/d66/d7c/fb4 x:0 0 0 2024-09-13T21:44:57.637 INFO:tasks.workunit.client.1.smithi155.stdout:2/497: fsync d2/dd/de/d15/f4c 0 2024-09-13T21:44:57.638 INFO:tasks.workunit.client.1.smithi155.stdout:2/498: chown d2/dd/de/d15/d38/la5 209 1 2024-09-13T21:44:57.639 INFO:tasks.workunit.client.0.smithi119.stdout:5/958: chown d0/d3/d4/d9/d74/le8 663 1 2024-09-13T21:44:57.640 INFO:tasks.workunit.client.1.smithi155.stdout:2/499: mknod d2/dd/de/d15/d2e/d31/d5d/cb5 0 2024-09-13T21:44:57.640 INFO:tasks.workunit.client.0.smithi119.stdout:1/860: dwrite d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/dd8/fa7 [4194304,4194304] 0 2024-09-13T21:44:57.641 INFO:tasks.workunit.client.1.smithi155.stdout:2/500: write d2/dd/d21/d39/d84/fa4 [120740,52091] 0 2024-09-13T21:44:57.642 INFO:tasks.workunit.client.0.smithi119.stdout:5/959: mkdir d0/d3/d1f/d21/d4f/d86/d139 0 2024-09-13T21:44:57.643 INFO:tasks.workunit.client.1.smithi155.stdout:2/501: write d2/dd/d37/d4e/f87 [3230286,11650] 0 2024-09-13T21:44:57.646 INFO:tasks.workunit.client.1.smithi155.stdout:2/502: getdents d2/dd/d3d 0 2024-09-13T21:44:57.646 INFO:tasks.workunit.client.0.smithi119.stdout:5/960: truncate d0/d3/d4/d9/d14/d137/f128 402167 0 2024-09-13T21:44:57.648 INFO:tasks.workunit.client.0.smithi119.stdout:5/961: symlink d0/d3/d4/d9/d14/l13a 0 2024-09-13T21:44:57.650 INFO:tasks.workunit.client.1.smithi155.stdout:2/503: dread d2/dd/de/d15/d2e/f7d [0,4194304] 0 2024-09-13T21:44:57.652 INFO:tasks.workunit.client.0.smithi119.stdout:5/962: link d0/c53 d0/d3/d4/d2e/d65/df6/d12b/c13b 0 2024-09-13T21:44:57.652 INFO:tasks.workunit.client.1.smithi155.stdout:2/504: unlink d2/dd/f24 0 2024-09-13T21:44:57.654 INFO:tasks.workunit.client.1.smithi155.stdout:2/505: creat d2/dd/de/d15/d38/d41/fb6 x:0 0 0 2024-09-13T21:44:57.657 INFO:tasks.workunit.client.1.smithi155.stdout:3/591: write d3/d25/f3f [3528144,119629] 0 2024-09-13T21:44:57.659 INFO:tasks.workunit.client.1.smithi155.stdout:3/592: stat d3/d25/d1b/d1f/d36/f5d 0 2024-09-13T21:44:57.664 INFO:tasks.workunit.client.0.smithi119.stdout:0/996: dwrite de/d3c/d7c/f7e [0,4194304] 0 2024-09-13T21:44:57.666 INFO:tasks.workunit.client.1.smithi155.stdout:9/606: write dc/d19/d23/f47 [289645,123610] 0 2024-09-13T21:44:57.667 INFO:tasks.workunit.client.1.smithi155.stdout:3/593: dwrite d3/d25/d1b/d1f/d36/d5c/d66/f7f [0,4194304] 0 2024-09-13T21:44:57.670 INFO:tasks.workunit.client.0.smithi119.stdout:5/963: rename d0/d3/d1f/d21/d4f to d0/d3/d4/def/dd6/d119/d13c 0 2024-09-13T21:44:57.671 INFO:tasks.workunit.client.1.smithi155.stdout:2/506: truncate d2/db/d6b/f6e 3371013 0 2024-09-13T21:44:57.672 INFO:tasks.workunit.client.1.smithi155.stdout:3/594: truncate d3/d25/d17/d3b/f50 357882 0 2024-09-13T21:44:57.672 INFO:tasks.workunit.client.1.smithi155.stdout:2/507: readlink d2/dd/d21/d39/l52 0 2024-09-13T21:44:57.673 INFO:tasks.workunit.client.1.smithi155.stdout:9/607: creat dc/d19/d21/d67/fd2 x:0 0 0 2024-09-13T21:44:57.674 INFO:tasks.workunit.client.1.smithi155.stdout:2/508: write d2/dd/f17 [5183797,61194] 0 2024-09-13T21:44:57.675 INFO:tasks.workunit.client.1.smithi155.stdout:9/608: write dc/d18/f7a [2979496,49774] 0 2024-09-13T21:44:57.675 INFO:tasks.workunit.client.1.smithi155.stdout:3/595: fdatasync d3/d21/d4a/f73 0 2024-09-13T21:44:57.678 INFO:tasks.workunit.client.1.smithi155.stdout:3/596: write d3/d21/d2c/f48 [4277761,93593] 0 2024-09-13T21:44:57.679 INFO:tasks.workunit.client.1.smithi155.stdout:2/509: mknod d2/dd/de/d15/d2e/da3/cb7 0 2024-09-13T21:44:57.679 INFO:tasks.workunit.client.0.smithi119.stdout:0/997: rename de/d4e/cd1 to de/d1c/d2b/d76/d9b/d123/c14f 0 2024-09-13T21:44:57.680 INFO:tasks.workunit.client.0.smithi119.stdout:0/998: chown de/d4e/f6e 40509 1 2024-09-13T21:44:57.684 INFO:tasks.workunit.client.1.smithi155.stdout:3/597: creat d3/d21/d4a/dcd/fcf x:0 0 0 2024-09-13T21:44:57.684 INFO:tasks.workunit.client.0.smithi119.stdout:0/999: rename de/d1c/d2b/d76/d9a/fc2 to de/d1c/d2f/d35/d4a/d62/f150 0 2024-09-13T21:44:57.684 INFO:tasks.workunit.client.1.smithi155.stdout:9/609: dwrite dc/d19/f48 [0,4194304] 0 2024-09-13T21:44:57.686 INFO:tasks.workunit.client.1.smithi155.stdout:9/610: write dc/de/f45 [3005515,25005] 0 2024-09-13T21:44:57.687 INFO:tasks.workunit.client.1.smithi155.stdout:3/598: write d3/d25/d1b/d1f/d82/d83/f9b [3150698,85361] 0 2024-09-13T21:44:57.687 INFO:tasks.workunit.client.1.smithi155.stdout:9/611: chown dc/d19/d23/d38/d90/f8d 9840891 1 2024-09-13T21:44:57.692 INFO:tasks.workunit.client.1.smithi155.stdout:3/599: dread d3/d21/d4a/f73 [0,4194304] 0 2024-09-13T21:44:57.693 INFO:tasks.workunit.client.1.smithi155.stdout:9/612: creat dc/de/fd3 x:0 0 0 2024-09-13T21:44:57.700 INFO:tasks.workunit.client.1.smithi155.stdout:9/613: creat dc/d19/d23/d38/fd4 x:0 0 0 2024-09-13T21:44:57.703 INFO:tasks.workunit.client.1.smithi155.stdout:9/614: dread - dc/d18/d1e/d86/f9e zero size 2024-09-13T21:44:57.703 INFO:tasks.workunit.client.0.smithi119.stdout:5/964: dwrite d0/d3/d4/d2e/f2f [0,4194304] 0 2024-09-13T21:44:57.705 INFO:tasks.workunit.client.1.smithi155.stdout:2/510: truncate d2/dd/de/d15/d2e/d96/f99 2097547 0 2024-09-13T21:44:57.706 INFO:tasks.workunit.client.0.smithi119.stdout:5/965: mkdir d0/d3/d4/def/d11b/d13d 0 2024-09-13T21:44:57.708 INFO:tasks.workunit.client.0.smithi119.stdout:5/966: write d0/d3/d4/d2e/d6b/dcc/f105 [455529,39980] 0 2024-09-13T21:44:57.713 INFO:tasks.workunit.client.1.smithi155.stdout:2/511: truncate d2/dd/de/d15/d2e/f83 2226552 0 2024-09-13T21:44:57.715 INFO:tasks.workunit.client.1.smithi155.stdout:9/615: write dc/d19/d23/d38/d90/f7b [132216,87953] 0 2024-09-13T21:44:57.720 INFO:tasks.workunit.client.1.smithi155.stdout:9/616: creat dc/d19/d23/d38/fd5 x:0 0 0 2024-09-13T21:44:57.721 INFO:tasks.workunit.client.1.smithi155.stdout:2/512: dwrite d2/dd/de/d15/f2b [0,4194304] 0 2024-09-13T21:44:57.722 INFO:tasks.workunit.client.0.smithi119.stdout:5/967: dread d0/d3/d4/d9/d14/d24/f104 [0,4194304] 0 2024-09-13T21:44:57.723 INFO:tasks.workunit.client.0.smithi119.stdout:5/968: dread - d0/d3/d4/d9/d74/ffa zero size 2024-09-13T21:44:57.724 INFO:tasks.workunit.client.0.smithi119.stdout:5/969: stat d0/d3/d4/d9/d14/d24/f5a 0 2024-09-13T21:44:57.725 INFO:tasks.workunit.client.0.smithi119.stdout:5/970: fsync d0/d3/f80 0 2024-09-13T21:44:57.726 INFO:tasks.workunit.client.0.smithi119.stdout:5/971: write d0/d3/d4/f5e [3298535,127319] 0 2024-09-13T21:44:57.729 INFO:tasks.workunit.client.0.smithi119.stdout:5/972: chown d0/d3/d4/def/d10f/l133 4 1 2024-09-13T21:44:57.730 INFO:tasks.workunit.client.1.smithi155.stdout:2/513: dwrite d2/dd/de/d15/d38/d41/f7e [0,4194304] 0 2024-09-13T21:44:57.731 INFO:tasks.workunit.client.1.smithi155.stdout:3/600: dread d3/d25/fb [0,4194304] 0 2024-09-13T21:44:57.735 INFO:tasks.workunit.client.1.smithi155.stdout:3/601: symlink d3/d25/d17/d52/ld0 0 2024-09-13T21:44:57.743 INFO:tasks.workunit.client.1.smithi155.stdout:3/602: dwrite d3/d25/d17/d52/fac [0,4194304] 0 2024-09-13T21:44:57.745 INFO:tasks.workunit.client.1.smithi155.stdout:3/603: chown d3/d25/l9c 0 1 2024-09-13T21:44:57.745 INFO:tasks.workunit.client.1.smithi155.stdout:2/514: dwrite d2/dd/de/f9a [0,4194304] 0 2024-09-13T21:44:57.752 INFO:tasks.workunit.client.1.smithi155.stdout:3/604: creat d3/d21/d2c/fd1 x:0 0 0 2024-09-13T21:44:57.753 INFO:tasks.workunit.client.1.smithi155.stdout:2/515: unlink d2/dd/de/d15/d2e/d31/f80 0 2024-09-13T21:44:57.753 INFO:tasks.workunit.client.1.smithi155.stdout:5/500: sync 2024-09-13T21:44:57.753 INFO:tasks.workunit.client.1.smithi155.stdout:6/609: sync 2024-09-13T21:44:57.753 INFO:tasks.workunit.client.1.smithi155.stdout:9/617: dread dc/de/f10 [0,4194304] 0 2024-09-13T21:44:57.753 INFO:tasks.workunit.client.1.smithi155.stdout:2/516: chown d2/dd/de/d15/d2e/da3/cb1 0 1 2024-09-13T21:44:57.754 INFO:tasks.workunit.client.1.smithi155.stdout:6/610: write db/f1f [3368285,32505] 0 2024-09-13T21:44:57.754 INFO:tasks.workunit.client.1.smithi155.stdout:3/605: chown d3/d25/d1b/d1f/d82/d83/c84 124 1 2024-09-13T21:44:57.757 INFO:tasks.workunit.client.1.smithi155.stdout:5/501: write d5/d16/d33/d1b/d2f/d3c/d6c/f8e [650244,104413] 0 2024-09-13T21:44:57.757 INFO:tasks.workunit.client.1.smithi155.stdout:6/611: write db/d11/d4c/d64/d5e/f68 [3279537,62313] 0 2024-09-13T21:44:57.761 INFO:tasks.workunit.client.1.smithi155.stdout:2/517: creat d2/dd/d37/d94/fb8 x:0 0 0 2024-09-13T21:44:57.762 INFO:tasks.workunit.client.1.smithi155.stdout:5/502: write d5/d16/d81/d98/d84/f89 [331547,47913] 0 2024-09-13T21:44:57.762 INFO:tasks.workunit.client.1.smithi155.stdout:9/618: symlink dc/de/d5c/ld6 0 2024-09-13T21:44:57.764 INFO:tasks.workunit.client.1.smithi155.stdout:6/612: read db/d11/f39 [62578,41540] 0 2024-09-13T21:44:57.765 INFO:tasks.workunit.client.1.smithi155.stdout:9/619: write dc/d19/d23/f47 [720737,11484] 0 2024-09-13T21:44:57.765 INFO:tasks.workunit.client.1.smithi155.stdout:2/518: creat d2/dd/d21/d8d/fb9 x:0 0 0 2024-09-13T21:44:57.766 INFO:tasks.workunit.client.1.smithi155.stdout:9/620: read - dc/de/d2d/f95 zero size 2024-09-13T21:44:57.767 INFO:tasks.workunit.client.1.smithi155.stdout:6/613: write f7 [1901457,14445] 0 2024-09-13T21:44:57.769 INFO:tasks.workunit.client.1.smithi155.stdout:2/519: mkdir d2/dd/de/d15/d2e/d96/dba 0 2024-09-13T21:44:57.771 INFO:tasks.workunit.client.1.smithi155.stdout:2/520: readlink d2/dd/de/d15/d2e/l8e 0 2024-09-13T21:44:57.772 INFO:tasks.workunit.client.1.smithi155.stdout:6/614: creat db/d11/d6d/fc5 x:0 0 0 2024-09-13T21:44:57.773 INFO:tasks.workunit.client.1.smithi155.stdout:9/621: creat dc/de/fd7 x:0 0 0 2024-09-13T21:44:57.775 INFO:tasks.workunit.client.1.smithi155.stdout:5/503: dwrite d5/d16/d33/d1b/d2f/d3c/d5b/f67 [4194304,4194304] 0 2024-09-13T21:44:57.775 INFO:tasks.workunit.client.1.smithi155.stdout:9/622: creat dc/de/d6f/fd8 x:0 0 0 2024-09-13T21:44:57.776 INFO:tasks.workunit.client.1.smithi155.stdout:2/521: truncate d2/dd/de/d15/d2e/f88 994176 0 2024-09-13T21:44:57.781 INFO:tasks.workunit.client.1.smithi155.stdout:2/522: read d2/dd/de/d15/d2e/d66/d7c/fae [37152,82123] 0 2024-09-13T21:44:57.782 INFO:tasks.workunit.client.1.smithi155.stdout:5/504: symlink d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/la9 0 2024-09-13T21:44:57.784 INFO:tasks.workunit.client.1.smithi155.stdout:6/615: dwrite db/d11/d4c/d64/d5e/f68 [0,4194304] 0 2024-09-13T21:44:57.786 INFO:tasks.workunit.client.1.smithi155.stdout:9/623: dwrite dc/de/f10 [0,4194304] 0 2024-09-13T21:44:57.787 INFO:tasks.workunit.client.1.smithi155.stdout:6/616: chown db/d3d/d5f/laf 4 1 2024-09-13T21:44:57.788 INFO:tasks.workunit.client.1.smithi155.stdout:2/523: mknod d2/dd/de/d15/d2e/d96/cbb 0 2024-09-13T21:44:57.790 INFO:tasks.workunit.client.1.smithi155.stdout:5/505: mknod d5/d16/d33/d1b/d2f/caa 0 2024-09-13T21:44:57.795 INFO:tasks.workunit.client.1.smithi155.stdout:2/524: creat d2/dd/d21/d39/d84/fbc x:0 0 0 2024-09-13T21:44:57.797 INFO:tasks.workunit.client.1.smithi155.stdout:9/624: dwrite dc/f54 [4194304,4194304] 0 2024-09-13T21:44:57.799 INFO:tasks.workunit.client.1.smithi155.stdout:2/525: write d2/dd/d21/d39/d84/fbc [196336,78268] 0 2024-09-13T21:44:57.800 INFO:tasks.workunit.client.1.smithi155.stdout:5/506: mknod d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/cab 0 2024-09-13T21:44:57.802 INFO:tasks.workunit.client.1.smithi155.stdout:6/617: mknod db/d11/d6d/db9/d1c/d36/d83/cc6 0 2024-09-13T21:44:57.804 INFO:tasks.workunit.client.1.smithi155.stdout:9/625: mknod dc/d18/d1e/da2/cd9 0 2024-09-13T21:44:57.806 INFO:tasks.workunit.client.1.smithi155.stdout:5/507: link d5/d16/d33/d1b/d1e/c64 d5/d16/d33/d1b/d28/cac 0 2024-09-13T21:44:57.808 INFO:tasks.workunit.client.1.smithi155.stdout:5/508: chown d5/f8 2 1 2024-09-13T21:44:57.808 INFO:tasks.workunit.client.1.smithi155.stdout:6/618: getdents db/d11/d5b 0 2024-09-13T21:44:57.810 INFO:tasks.workunit.client.1.smithi155.stdout:6/619: symlink db/d11/d4c/d7c/db0/lc7 0 2024-09-13T21:44:57.812 INFO:tasks.workunit.client.1.smithi155.stdout:5/509: dread d5/fa [0,4194304] 0 2024-09-13T21:44:57.812 INFO:tasks.workunit.client.1.smithi155.stdout:6/620: unlink db/d11/d1e/d21/fc4 0 2024-09-13T21:44:57.813 INFO:tasks.workunit.client.1.smithi155.stdout:6/621: dread - db/d11/d4c/d7c/d8b/fc1 zero size 2024-09-13T21:44:57.814 INFO:tasks.workunit.client.0.smithi119.stdout:5/973: stat d0/d3/d4/d2e/d65/fca 0 2024-09-13T21:44:57.815 INFO:tasks.workunit.client.1.smithi155.stdout:5/510: creat d5/d16/d33/d1b/d2f/d3c/d44/d80/fad x:0 0 0 2024-09-13T21:44:57.815 INFO:tasks.workunit.client.1.smithi155.stdout:6/622: mknod db/d11/d5b/cc8 0 2024-09-13T21:44:57.816 INFO:tasks.workunit.client.0.smithi119.stdout:5/974: rename d0/d3/d4/d2e/d97/d134/de1/c126 to d0/d3/d4/d9/d74/c13e 0 2024-09-13T21:44:57.817 INFO:tasks.workunit.client.0.smithi119.stdout:5/975: read - d0/d3/d4/f101 zero size 2024-09-13T21:44:57.817 INFO:tasks.workunit.client.1.smithi155.stdout:6/623: rename db/c7b to db/d2c/dc0/cc9 0 2024-09-13T21:44:57.819 INFO:tasks.workunit.client.1.smithi155.stdout:6/624: mkdir db/d11/d1e/dca 0 2024-09-13T21:44:57.820 INFO:tasks.workunit.client.0.smithi119.stdout:5/976: creat d0/d3/d1f/f13f x:0 0 0 2024-09-13T21:44:57.822 INFO:tasks.workunit.client.1.smithi155.stdout:6/625: link db/f22 db/d11/d4c/d7c/d8b/d8e/fcb 0 2024-09-13T21:44:57.823 INFO:tasks.workunit.client.0.smithi119.stdout:5/977: write d0/d3/d1f/f52 [2344329,24627] 0 2024-09-13T21:44:57.824 INFO:tasks.workunit.client.1.smithi155.stdout:6/626: creat db/d11/d86/fcc x:0 0 0 2024-09-13T21:44:57.828 INFO:tasks.workunit.client.0.smithi119.stdout:5/978: dread d0/d3/d4/def/dd6/d119/d13c/d86/fb4 [0,4194304] 0 2024-09-13T21:44:57.829 INFO:tasks.workunit.client.1.smithi155.stdout:9/626: truncate dc/d19/d23/f2e 4005671 0 2024-09-13T21:44:57.830 INFO:tasks.workunit.client.1.smithi155.stdout:9/627: chown dc/d19/d21/fca 3 1 2024-09-13T21:44:57.830 INFO:tasks.workunit.client.1.smithi155.stdout:6/627: dwrite db/d3d/d5f/f84 [0,4194304] 0 2024-09-13T21:44:57.831 INFO:tasks.workunit.client.0.smithi119.stdout:5/979: unlink d0/d3/f129 0 2024-09-13T21:44:57.833 INFO:tasks.workunit.client.0.smithi119.stdout:5/980: rename d0/d3/d4/d2e/d6b to d0/d3/d140 0 2024-09-13T21:44:57.835 INFO:tasks.workunit.client.0.smithi119.stdout:5/981: chown d0/d3/d4/def/dd6/d119/f11c 63 1 2024-09-13T21:44:57.836 INFO:tasks.workunit.client.1.smithi155.stdout:6/628: unlink db/d11/d4c/d7c/d8b/fc1 0 2024-09-13T21:44:57.838 INFO:tasks.workunit.client.1.smithi155.stdout:6/629: write db/d3d/d5f/f89 [3862439,105815] 0 2024-09-13T21:44:57.838 INFO:tasks.workunit.client.1.smithi155.stdout:9/628: dread dc/de/d2d/f40 [0,4194304] 0 2024-09-13T21:44:57.839 INFO:tasks.workunit.client.1.smithi155.stdout:6/630: chown db/d11/c3f 5748025 1 2024-09-13T21:44:57.840 INFO:tasks.workunit.client.1.smithi155.stdout:2/526: dread f1 [0,4194304] 0 2024-09-13T21:44:57.841 INFO:tasks.workunit.client.1.smithi155.stdout:6/631: dread - db/d3d/d5f/d67/f8f zero size 2024-09-13T21:44:57.841 INFO:tasks.workunit.client.1.smithi155.stdout:9/629: mknod dc/de/d15/cda 0 2024-09-13T21:44:57.842 INFO:tasks.workunit.client.0.smithi119.stdout:5/982: write d0/d3/d4/def/d10f/d67/f69 [661338,69940] 0 2024-09-13T21:44:57.845 INFO:tasks.workunit.client.1.smithi155.stdout:6/632: creat db/d11/d6d/db9/d1c/d36/d37/db7/fcd x:0 0 0 2024-09-13T21:44:57.847 INFO:tasks.workunit.client.1.smithi155.stdout:9/630: rename dc/de/d2d/d79/d43/d83 to dc/de/d6f/dae/ddb 0 2024-09-13T21:44:57.852 INFO:tasks.workunit.client.1.smithi155.stdout:6/633: rename db/d11/d1e/f3e to db/d11/d1e/fce 0 2024-09-13T21:44:57.853 INFO:tasks.workunit.client.1.smithi155.stdout:2/527: write d2/dd/d21/f86 [857648,45251] 0 2024-09-13T21:44:57.853 INFO:tasks.workunit.client.1.smithi155.stdout:6/634: truncate db/f2f 4449625 0 2024-09-13T21:44:57.856 INFO:tasks.workunit.client.1.smithi155.stdout:9/631: write dc/d19/f36 [2399443,51612] 0 2024-09-13T21:44:57.857 INFO:tasks.workunit.client.1.smithi155.stdout:6/635: dread db/d11/d6d/db9/d1c/f6e [0,4194304] 0 2024-09-13T21:44:57.859 INFO:tasks.workunit.client.0.smithi119.stdout:5/983: dread d0/d3/d4/d2e/f32 [0,4194304] 0 2024-09-13T21:44:57.860 INFO:tasks.workunit.client.0.smithi119.stdout:5/984: stat d0/d3/d4/def/d10f/f9b 0 2024-09-13T21:44:57.861 INFO:tasks.workunit.client.0.smithi119.stdout:5/985: rmdir d0/d3/d4/d2e/d65/df6 39 2024-09-13T21:44:57.862 INFO:tasks.workunit.client.1.smithi155.stdout:2/528: dread d2/dd/d37/f4a [0,4194304] 0 2024-09-13T21:44:57.863 INFO:tasks.workunit.client.0.smithi119.stdout:5/986: symlink d0/l141 0 2024-09-13T21:44:57.864 INFO:tasks.workunit.client.1.smithi155.stdout:2/529: symlink d2/dd/de/d15/d2e/d66/lbd 0 2024-09-13T21:44:57.864 INFO:tasks.workunit.client.0.smithi119.stdout:5/987: write d0/d3/d4/d2e/d97/d134/ffe [656989,23142] 0 2024-09-13T21:44:57.865 INFO:tasks.workunit.client.1.smithi155.stdout:2/530: write f0 [1963378,76256] 0 2024-09-13T21:44:57.866 INFO:tasks.workunit.client.1.smithi155.stdout:2/531: write d2/f53 [272995,48137] 0 2024-09-13T21:44:57.866 INFO:tasks.workunit.client.0.smithi119.stdout:5/988: unlink d0/l60 0 2024-09-13T21:44:57.867 INFO:tasks.workunit.client.0.smithi119.stdout:5/989: read d0/d3/d4/def/dd6/d119/d13c/d86/fb4 [339872,117661] 0 2024-09-13T21:44:57.869 INFO:tasks.workunit.client.1.smithi155.stdout:2/532: symlink d2/dd/de/d15/d38/lbe 0 2024-09-13T21:44:57.870 INFO:tasks.workunit.client.0.smithi119.stdout:5/990: mkdir d0/d3/d140/d142 0 2024-09-13T21:44:57.870 INFO:tasks.workunit.client.1.smithi155.stdout:2/533: chown d2/dd/de/d15/d38/d41/fb2 1392361 1 2024-09-13T21:44:57.870 INFO:tasks.workunit.client.0.smithi119.stdout:5/991: chown d0/d3/d4/def/d10f/l10c 5297 1 2024-09-13T21:44:57.871 INFO:tasks.workunit.client.0.smithi119.stdout:5/992: stat d0/d3/d4/f5 0 2024-09-13T21:44:57.874 INFO:tasks.workunit.client.1.smithi155.stdout:6/636: dread db/d11/d1e/d21/f4d [0,4194304] 0 2024-09-13T21:44:57.875 INFO:tasks.workunit.client.1.smithi155.stdout:2/534: write d2/dd/de/d15/d2e/d66/d7c/fae [958277,31378] 0 2024-09-13T21:44:57.876 INFO:tasks.workunit.client.1.smithi155.stdout:2/535: write d2/db/f25 [2764490,73635] 0 2024-09-13T21:44:57.877 INFO:tasks.workunit.client.0.smithi119.stdout:5/993: write d0/d3/d4/def/dd6/d119/d13c/d86/fc2 [816322,101729] 0 2024-09-13T21:44:57.878 INFO:tasks.workunit.client.1.smithi155.stdout:6/637: mknod db/d2c/dbc/dc2/ccf 0 2024-09-13T21:44:57.878 INFO:tasks.workunit.client.1.smithi155.stdout:2/536: chown d2/dd/de/d15/d38/d41/fb2 2 1 2024-09-13T21:44:57.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:57 smithi119 ceph-mon[27653]: pgmap v13: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 81 MiB/s rd, 263 MiB/s wr, 475 op/s 2024-09-13T21:44:57.882 INFO:tasks.workunit.client.1.smithi155.stdout:2/537: link d2/dd/d37/d4e/f59 d2/dd/de/d15/d2e/d96/dba/fbf 0 2024-09-13T21:44:57.884 INFO:tasks.workunit.client.1.smithi155.stdout:2/538: creat d2/dd/d37/fc0 x:0 0 0 2024-09-13T21:44:57.885 INFO:tasks.workunit.client.1.smithi155.stdout:2/539: write d2/dd/de/d15/f4c [958033,125442] 0 2024-09-13T21:44:57.886 INFO:tasks.workunit.client.1.smithi155.stdout:2/540: read d2/dd/d37/d4e/f73 [760780,16600] 0 2024-09-13T21:44:57.888 INFO:tasks.workunit.client.0.smithi119.stdout:5/994: rename d0/d3/d4/d9/d74/c13e to d0/d3/d4/def/d10f/d67/c143 0 2024-09-13T21:44:57.890 INFO:tasks.workunit.client.0.smithi119.stdout:5/995: creat d0/d3/d4/def/df1/f144 x:0 0 0 2024-09-13T21:44:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:5/996: fsync d0/d3/d4/def/df1/f115 0 2024-09-13T21:44:57.893 INFO:tasks.workunit.client.1.smithi155.stdout:2/541: truncate d2/dd/de/d15/d2e/d96/dba/fbf 148996 0 2024-09-13T21:44:57.894 INFO:tasks.workunit.client.1.smithi155.stdout:6/638: dread db/d11/d2b/d35/f25 [0,4194304] 0 2024-09-13T21:44:57.895 INFO:tasks.workunit.client.0.smithi119.stdout:5/997: dread d0/d3/d4/fea [0,4194304] 0 2024-09-13T21:44:57.896 INFO:tasks.workunit.client.0.smithi119.stdout:5/998: creat d0/d3/d4/def/dd6/f145 x:0 0 0 2024-09-13T21:44:57.896 INFO:tasks.workunit.client.1.smithi155.stdout:6/639: rmdir db/d11/d1e/d21 39 2024-09-13T21:44:57.897 INFO:tasks.workunit.client.0.smithi119.stdout:5/999: chown d0/d3/d4/def/d10f/f9b 1 1 2024-09-13T21:44:57.900 INFO:tasks.workunit.client.1.smithi155.stdout:2/542: rename d2/dd/de/d15/d2e to d2/dd/d21/d39/dc1 0 2024-09-13T21:44:57.901 INFO:tasks.workunit.client.1.smithi155.stdout:2/543: readlink d2/dd/d21/l82 0 2024-09-13T21:44:57.903 INFO:tasks.workunit.client.1.smithi155.stdout:6/640: link db/d11/d4c/f54 db/d11/d86/fd0 0 2024-09-13T21:44:57.906 INFO:tasks.workunit.client.1.smithi155.stdout:2/544: dwrite d2/db/f25 [0,4194304] 0 2024-09-13T21:44:57.915 INFO:tasks.workunit.client.1.smithi155.stdout:7/533: sync 2024-09-13T21:44:57.915 INFO:tasks.workunit.client.1.smithi155.stdout:4/504: sync 2024-09-13T21:44:57.915 INFO:tasks.workunit.client.1.smithi155.stdout:8/488: sync 2024-09-13T21:44:57.915 INFO:tasks.workunit.client.1.smithi155.stdout:1/565: sync 2024-09-13T21:44:57.915 INFO:tasks.workunit.client.1.smithi155.stdout:0/612: sync 2024-09-13T21:44:57.919 INFO:tasks.workunit.client.1.smithi155.stdout:6/641: dwrite db/f10 [4194304,4194304] 0 2024-09-13T21:44:57.919 INFO:tasks.workunit.client.1.smithi155.stdout:2/545: dwrite d2/dd/f34 [0,4194304] 0 2024-09-13T21:44:57.920 INFO:tasks.workunit.client.1.smithi155.stdout:7/534: creat d5/d13/fa5 x:0 0 0 2024-09-13T21:44:57.923 INFO:tasks.workunit.client.1.smithi155.stdout:8/489: read d2/d8/f10 [7406775,44747] 0 2024-09-13T21:44:57.925 INFO:tasks.workunit.client.1.smithi155.stdout:0/613: mkdir d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/df0 0 2024-09-13T21:44:57.927 INFO:tasks.workunit.client.1.smithi155.stdout:1/566: truncate d6/d15/d23/d55/fa0 697946 0 2024-09-13T21:44:57.928 INFO:tasks.workunit.client.1.smithi155.stdout:7/535: mkdir d5/da6 0 2024-09-13T21:44:57.929 INFO:tasks.workunit.client.1.smithi155.stdout:4/505: dwrite d1/d7/de/d15/f5b [4194304,4194304] 0 2024-09-13T21:44:57.930 INFO:tasks.workunit.client.1.smithi155.stdout:6/642: mkdir db/d11/d6d/db9/d90/dd1 0 2024-09-13T21:44:57.931 INFO:tasks.workunit.client.1.smithi155.stdout:0/614: mkdir d1/d6/dc/d90/df1 0 2024-09-13T21:44:57.932 INFO:tasks.workunit.client.1.smithi155.stdout:2/546: symlink d2/dd/de/d15/d38/d41/d5f/lc2 0 2024-09-13T21:44:57.934 INFO:tasks.workunit.client.1.smithi155.stdout:6/643: write db/d11/d4c/d7c/d8b/db4/fbb [686713,53950] 0 2024-09-13T21:44:57.935 INFO:tasks.workunit.client.1.smithi155.stdout:8/490: mkdir d2/d95 0 2024-09-13T21:44:57.935 INFO:tasks.workunit.client.1.smithi155.stdout:4/506: truncate d1/d7/f9a 347193 0 2024-09-13T21:44:57.936 INFO:tasks.workunit.client.1.smithi155.stdout:8/491: chown d2/d8/d75 3815167 1 2024-09-13T21:44:57.938 INFO:tasks.workunit.client.1.smithi155.stdout:8/492: write d2/d6/dd/d12/f1b [1530633,65522] 0 2024-09-13T21:44:57.938 INFO:tasks.workunit.client.1.smithi155.stdout:0/615: write d1/d6/dc/d4d/d4a/d4e/d61/f89 [883640,48210] 0 2024-09-13T21:44:57.940 INFO:tasks.workunit.client.1.smithi155.stdout:6/644: creat db/d11/d6d/db9/d1c/d36/d37/db7/fd2 x:0 0 0 2024-09-13T21:44:57.941 INFO:tasks.workunit.client.1.smithi155.stdout:8/493: readlink d2/d1f/d77/l8d 0 2024-09-13T21:44:57.944 INFO:tasks.workunit.client.1.smithi155.stdout:4/507: rename d1/l49 to d1/d7/de/d15/d55/d5e/d66/d7e/l9e 0 2024-09-13T21:44:57.945 INFO:tasks.workunit.client.1.smithi155.stdout:2/547: rmdir d2/dd/de/d15/d38/d41/d5f/d70/da8 0 2024-09-13T21:44:57.947 INFO:tasks.workunit.client.1.smithi155.stdout:6/645: mknod db/d11/d6d/db9/d1c/d36/d37/db7/cd3 0 2024-09-13T21:44:57.950 INFO:tasks.workunit.client.1.smithi155.stdout:0/616: rmdir d1/d6/dc/d4d/d4a/d4e/de2 0 2024-09-13T21:44:57.952 INFO:tasks.workunit.client.1.smithi155.stdout:2/548: mkdir d2/dd/d21/d39/dc1/dc3 0 2024-09-13T21:44:57.957 INFO:tasks.workunit.client.1.smithi155.stdout:1/567: dread d6/d15/d23/d55/d6e/dbb/f46 [0,4194304] 0 2024-09-13T21:44:57.957 INFO:tasks.workunit.client.1.smithi155.stdout:6/646: rename db/d11/d6d/db9/d1c/d36/d37/db7/fcd to db/d11/d5b/fd4 0 2024-09-13T21:44:57.957 INFO:tasks.workunit.client.1.smithi155.stdout:2/549: write d2/f92 [630017,80452] 0 2024-09-13T21:44:57.957 INFO:tasks.workunit.client.1.smithi155.stdout:1/568: symlink d6/d82/lc0 0 2024-09-13T21:44:57.957 INFO:tasks.workunit.client.1.smithi155.stdout:4/508: dwrite d1/d7/d21/d69/f96 [0,4194304] 0 2024-09-13T21:44:57.961 INFO:tasks.workunit.client.1.smithi155.stdout:6/647: write db/d11/d4c/d64/f77 [2512890,90621] 0 2024-09-13T21:44:57.965 INFO:tasks.workunit.client.1.smithi155.stdout:0/617: getdents d1/d6/dc/d4d 0 2024-09-13T21:44:57.967 INFO:tasks.workunit.client.1.smithi155.stdout:6/648: chown db/d11/c18 20746 1 2024-09-13T21:44:57.972 INFO:tasks.workunit.client.1.smithi155.stdout:2/550: dwrite d2/dd/d21/d39/dc1/f3e [4194304,4194304] 0 2024-09-13T21:44:57.975 INFO:tasks.workunit.client.1.smithi155.stdout:6/649: mknod db/d11/d4c/d64/d5e/cd5 0 2024-09-13T21:44:57.977 INFO:tasks.workunit.client.1.smithi155.stdout:0/618: symlink d1/d6/dc/d4d/d4a/d52/d5c/lf2 0 2024-09-13T21:44:57.980 INFO:tasks.workunit.client.1.smithi155.stdout:2/551: mknod d2/dd/d37/d4e/cc4 0 2024-09-13T21:44:57.980 INFO:tasks.workunit.client.1.smithi155.stdout:1/569: dwrite d6/d82/d90/f6c [4194304,4194304] 0 2024-09-13T21:44:57.981 INFO:tasks.workunit.client.1.smithi155.stdout:8/494: dwrite d2/d6/dd/d12/f2c [0,4194304] 0 2024-09-13T21:44:57.983 INFO:tasks.workunit.client.1.smithi155.stdout:0/619: stat d1/d6/dc/d4d/d4a/d52/d5c/d6a/dd8 0 2024-09-13T21:44:57.983 INFO:tasks.workunit.client.1.smithi155.stdout:7/536: dread d5/df/f19 [0,4194304] 0 2024-09-13T21:44:57.989 INFO:tasks.workunit.client.1.smithi155.stdout:2/552: write d2/db/f16 [2407915,43070] 0 2024-09-13T21:44:57.990 INFO:tasks.workunit.client.1.smithi155.stdout:2/553: fsync d2/dd/de/d15/d38/d41/f7e 0 2024-09-13T21:44:57.990 INFO:tasks.workunit.client.1.smithi155.stdout:2/554: symlink d2/dd/de/d15/d38/lc5 0 2024-09-13T21:44:57.990 INFO:tasks.workunit.client.1.smithi155.stdout:6/650: getdents db/d11/d6d/db9/d1c 0 2024-09-13T21:44:57.991 INFO:tasks.workunit.client.1.smithi155.stdout:2/555: stat d2/dd/c5a 0 2024-09-13T21:44:57.992 INFO:tasks.workunit.client.1.smithi155.stdout:6/651: stat db/d3d/f96 0 2024-09-13T21:44:58.000 INFO:tasks.workunit.client.1.smithi155.stdout:1/570: link d6/d15/d57/d99/f14 d6/d15/d57/fc1 0 2024-09-13T21:44:58.004 INFO:tasks.workunit.client.1.smithi155.stdout:7/537: dwrite d5/d10/d48/f7b [0,4194304] 0 2024-09-13T21:44:58.007 INFO:tasks.workunit.client.1.smithi155.stdout:1/571: write d6/d15/d23/d87/f9a [756473,48947] 0 2024-09-13T21:44:58.007 INFO:tasks.workunit.client.1.smithi155.stdout:2/556: dwrite d2/db/f63 [0,4194304] 0 2024-09-13T21:44:58.007 INFO:tasks.workunit.client.1.smithi155.stdout:6/652: dwrite db/d11/d6d/db9/d1c/d36/d37/db7/fd2 [0,4194304] 0 2024-09-13T21:44:58.007 INFO:tasks.workunit.client.1.smithi155.stdout:0/620: truncate d1/d6/dc/d90/f92 2898877 0 2024-09-13T21:44:58.011 INFO:tasks.workunit.client.1.smithi155.stdout:2/557: chown d2/dd/d37/d94/fb8 3513252 1 2024-09-13T21:44:58.016 INFO:tasks.workunit.client.1.smithi155.stdout:6/653: creat db/d11/d6d/db9/d1c/d36/d83/fd6 x:0 0 0 2024-09-13T21:44:58.016 INFO:tasks.workunit.client.1.smithi155.stdout:2/558: mkdir d2/dd/d21/dc6 0 2024-09-13T21:44:58.016 INFO:tasks.workunit.client.1.smithi155.stdout:1/572: mknod d6/d15/d57/cc2 0 2024-09-13T21:44:58.019 INFO:tasks.workunit.client.1.smithi155.stdout:6/654: rmdir db/d2c/d85 39 2024-09-13T21:44:58.019 INFO:tasks.workunit.client.1.smithi155.stdout:6/655: readlink db/d2c/l4e 0 2024-09-13T21:44:58.020 INFO:tasks.workunit.client.1.smithi155.stdout:6/656: stat db/d2c 0 2024-09-13T21:44:58.020 INFO:tasks.workunit.client.1.smithi155.stdout:2/559: write d2/dd/d21/d39/dc1/f7d [1502158,44532] 0 2024-09-13T21:44:58.021 INFO:tasks.workunit.client.1.smithi155.stdout:6/657: read db/d11/d2b/f72 [667,103897] 0 2024-09-13T21:44:58.021 INFO:tasks.workunit.client.1.smithi155.stdout:2/560: chown d2/dd/d21/d39/dc1/l61 7 1 2024-09-13T21:44:58.022 INFO:tasks.workunit.client.1.smithi155.stdout:1/573: getdents d6/d15/d23/d55/d6e/dbb/d4b 0 2024-09-13T21:44:58.023 INFO:tasks.workunit.client.1.smithi155.stdout:2/561: chown d2/dd/de/d15/d38/d41/d5f/d70/l75 62094 1 2024-09-13T21:44:58.025 INFO:tasks.workunit.client.1.smithi155.stdout:1/574: mkdir d6/d15/d23/d55/d6e/dbb/d4b/dc3 0 2024-09-13T21:44:58.027 INFO:tasks.workunit.client.1.smithi155.stdout:1/575: truncate d6/d7/fb2 672 0 2024-09-13T21:44:58.027 INFO:tasks.workunit.client.1.smithi155.stdout:1/576: chown d6/d82/d91/ca1 113614 1 2024-09-13T21:44:58.029 INFO:tasks.workunit.client.1.smithi155.stdout:6/658: link db/d11/d6d/db9/d90/lba db/d3d/d5f/d67/ld7 0 2024-09-13T21:44:58.029 INFO:tasks.workunit.client.1.smithi155.stdout:8/495: dread d2/d8/f10 [0,4194304] 0 2024-09-13T21:44:58.029 INFO:tasks.workunit.client.1.smithi155.stdout:8/496: chown d2 1 1 2024-09-13T21:44:58.030 INFO:tasks.workunit.client.1.smithi155.stdout:2/562: creat d2/dd/de/fc7 x:0 0 0 2024-09-13T21:44:58.033 INFO:tasks.workunit.client.1.smithi155.stdout:0/621: write d1/d6/dc/f18 [815501,52556] 0 2024-09-13T21:44:58.033 INFO:tasks.workunit.client.1.smithi155.stdout:6/659: mkdir db/d11/d4c/d7c/d8b/db4/dd8 0 2024-09-13T21:44:58.035 INFO:tasks.workunit.client.1.smithi155.stdout:1/577: symlink d6/d15/d23/lc4 0 2024-09-13T21:44:58.036 INFO:tasks.workunit.client.1.smithi155.stdout:2/563: rename d2/dd/de/d15/c79 to d2/dd/de/d15/d38/d41/d5f/d70/cc8 0 2024-09-13T21:44:58.037 INFO:tasks.workunit.client.1.smithi155.stdout:0/622: symlink d1/d6/dc/d4d/d4a/d4e/d61/lf3 0 2024-09-13T21:44:58.038 INFO:tasks.workunit.client.1.smithi155.stdout:6/660: creat db/d11/d6d/db9/d1c/d36/d46/fd9 x:0 0 0 2024-09-13T21:44:58.039 INFO:tasks.workunit.client.0.smithi119.stdout:6/852: sync 2024-09-13T21:44:58.040 INFO:tasks.workunit.client.1.smithi155.stdout:1/578: creat d6/d82/d90/fc5 x:0 0 0 2024-09-13T21:44:58.041 INFO:tasks.workunit.client.1.smithi155.stdout:0/623: unlink d1/d6/f5a 0 2024-09-13T21:44:58.041 INFO:tasks.workunit.client.0.smithi119.stdout:6/853: creat dc/d3d/d4e/d91/f110 x:0 0 0 2024-09-13T21:44:58.042 INFO:tasks.workunit.client.0.smithi119.stdout:6/854: write dc/d4b/d97/ff3 [498984,83328] 0 2024-09-13T21:44:58.045 INFO:tasks.workunit.client.1.smithi155.stdout:6/661: mkdir db/d11/d6d/db9/d1c/d36/d46/dda 0 2024-09-13T21:44:58.045 INFO:tasks.workunit.client.1.smithi155.stdout:2/564: dwrite d2/dd/de/d15/d38/d41/f8f [0,4194304] 0 2024-09-13T21:44:58.045 INFO:tasks.workunit.client.0.smithi119.stdout:6/855: getdents dc/d3a/dbb/d7a/d86 0 2024-09-13T21:44:58.047 INFO:tasks.workunit.client.1.smithi155.stdout:1/579: symlink d6/d15/d23/d55/lc6 0 2024-09-13T21:44:58.047 INFO:tasks.workunit.client.0.smithi119.stdout:6/856: rename dc/f1e to dc/d3a/f111 0 2024-09-13T21:44:58.047 INFO:tasks.workunit.client.1.smithi155.stdout:8/497: write d2/d91/f8a [459802,33325] 0 2024-09-13T21:44:58.049 INFO:tasks.workunit.client.1.smithi155.stdout:6/662: mknod db/d11/d2b/d35/cdb 0 2024-09-13T21:44:58.049 INFO:tasks.workunit.client.0.smithi119.stdout:6/857: creat dc/d3d/d40/d6b/f112 x:0 0 0 2024-09-13T21:44:58.050 INFO:tasks.workunit.client.0.smithi119.stdout:6/858: chown dc/d4b/d6a/dc2/fd8 187 1 2024-09-13T21:44:58.051 INFO:tasks.workunit.client.1.smithi155.stdout:1/580: unlink d6/d15/d23/d55/f66 0 2024-09-13T21:44:58.052 INFO:tasks.workunit.client.1.smithi155.stdout:8/498: truncate d2/d6/dd/f92 399783 0 2024-09-13T21:44:58.053 INFO:tasks.workunit.client.1.smithi155.stdout:8/499: chown d2/d2d/c7e 1278 1 2024-09-13T21:44:58.054 INFO:tasks.workunit.client.0.smithi119.stdout:6/859: getdents dc/df/d64/df4 0 2024-09-13T21:44:58.054 INFO:tasks.workunit.client.1.smithi155.stdout:0/624: link d1/d6/dc/d4d/d4a/d52/d5c/d6a/dd8/cdf d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/df0/cf4 0 2024-09-13T21:44:58.056 INFO:tasks.workunit.client.1.smithi155.stdout:1/581: mkdir d6/d15/d57/d5d/d72/dc7 0 2024-09-13T21:44:58.057 INFO:tasks.workunit.client.1.smithi155.stdout:8/500: mkdir d2/d2d/d96 0 2024-09-13T21:44:58.058 INFO:tasks.workunit.client.0.smithi119.stdout:6/860: rmdir dc/d4b/d6a/d75/d102 0 2024-09-13T21:44:58.059 INFO:tasks.workunit.client.1.smithi155.stdout:0/625: creat d1/d6/dc/d4d/d4a/d4e/d61/ff5 x:0 0 0 2024-09-13T21:44:58.061 INFO:tasks.workunit.client.1.smithi155.stdout:2/565: dread d2/dd/d21/d39/dc1/d96/f99 [0,4194304] 0 2024-09-13T21:44:58.061 INFO:tasks.workunit.client.1.smithi155.stdout:8/501: creat d2/d6/dd/d12/f97 x:0 0 0 2024-09-13T21:44:58.064 INFO:tasks.workunit.client.1.smithi155.stdout:8/502: mknod d2/d2d/c98 0 2024-09-13T21:44:58.064 INFO:tasks.workunit.client.1.smithi155.stdout:6/663: dread db/d2c/dbc/dc2/f7a [0,4194304] 0 2024-09-13T21:44:58.067 INFO:tasks.workunit.client.1.smithi155.stdout:2/566: mknod d2/dd/cc9 0 2024-09-13T21:44:58.068 INFO:tasks.workunit.client.1.smithi155.stdout:0/626: mkdir d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/df0/df6 0 2024-09-13T21:44:58.069 INFO:tasks.workunit.client.0.smithi119.stdout:6/861: dwrite dc/df/d32/f6c [4194304,4194304] 0 2024-09-13T21:44:58.069 INFO:tasks.workunit.client.0.smithi119.stdout:6/862: chown dc/df/d5c/f5f 1969756556 1 2024-09-13T21:44:58.072 INFO:tasks.workunit.client.1.smithi155.stdout:0/627: write d1/d6/dc/d4d/d4a/d52/d5c/f5d [1109529,38570] 0 2024-09-13T21:44:58.073 INFO:tasks.workunit.client.0.smithi119.stdout:6/863: write dc/df/d5c/f5f [932646,124175] 0 2024-09-13T21:44:58.073 INFO:tasks.workunit.client.1.smithi155.stdout:6/664: link db/d11/d2b/d35/fbe db/d11/d6d/db9/d1c/d36/d46/dda/fdc 0 2024-09-13T21:44:58.076 INFO:tasks.workunit.client.1.smithi155.stdout:8/503: link d2/d91/l6f d2/d1f/d87/l99 0 2024-09-13T21:44:58.076 INFO:tasks.workunit.client.1.smithi155.stdout:1/582: write d6/d15/d57/d5d/f62 [629006,125717] 0 2024-09-13T21:44:58.077 INFO:tasks.workunit.client.1.smithi155.stdout:0/628: mkdir d1/d6/d81/df7 0 2024-09-13T21:44:58.078 INFO:tasks.workunit.client.1.smithi155.stdout:1/583: fsync d6/d7/d48/f96 0 2024-09-13T21:44:58.079 INFO:tasks.workunit.client.0.smithi119.stdout:6/864: dwrite dc/dd/fde [0,4194304] 0 2024-09-13T21:44:58.083 INFO:tasks.workunit.client.0.smithi119.stdout:6/865: truncate dc/d3d/d40/d68/fe3 386465 0 2024-09-13T21:44:58.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:57 smithi155 ceph-mon[34732]: pgmap v13: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 81 MiB/s rd, 263 MiB/s wr, 475 op/s 2024-09-13T21:44:58.083 INFO:tasks.workunit.client.1.smithi155.stdout:0/629: truncate d1/d6/dc/d4d/d4a/d52/d5b/fa4 515814 0 2024-09-13T21:44:58.083 INFO:tasks.workunit.client.1.smithi155.stdout:1/584: symlink d6/d15/d23/d87/d95/lc8 0 2024-09-13T21:44:58.084 INFO:tasks.workunit.client.1.smithi155.stdout:0/630: fdatasync d1/feb 0 2024-09-13T21:44:58.084 INFO:tasks.workunit.client.1.smithi155.stdout:6/665: dread db/d11/d1e/d21/f4d [0,4194304] 0 2024-09-13T21:44:58.086 INFO:tasks.workunit.client.0.smithi119.stdout:6/866: rename dc/d4b/d6a/dbd/ff0 to dc/d3a/dbb/d7a/dc7/d10e/f113 0 2024-09-13T21:44:58.086 INFO:tasks.workunit.client.1.smithi155.stdout:8/504: dwrite d2/d8/d65/f68 [0,4194304] 0 2024-09-13T21:44:58.087 INFO:tasks.workunit.client.0.smithi119.stdout:6/867: write dc/d3d/f8b [384894,44348] 0 2024-09-13T21:44:58.089 INFO:tasks.workunit.client.1.smithi155.stdout:1/585: symlink d6/d15/d23/d87/d95/lc9 0 2024-09-13T21:44:58.089 INFO:tasks.workunit.client.0.smithi119.stdout:6/868: stat dc/d3d/ff5 0 2024-09-13T21:44:58.089 INFO:tasks.workunit.client.1.smithi155.stdout:1/586: fdatasync d6/d82/d90/f84 0 2024-09-13T21:44:58.090 INFO:tasks.workunit.client.0.smithi119.stdout:6/869: write dc/df/d6d/fda [207172,29643] 0 2024-09-13T21:44:58.092 INFO:tasks.workunit.client.0.smithi119.stdout:6/870: creat dc/df/d6d/f114 x:0 0 0 2024-09-13T21:44:58.092 INFO:tasks.workunit.client.1.smithi155.stdout:6/666: rename db/d11/d4c to db/d11/d6d/db9/d1c/d36/d83/ddd 0 2024-09-13T21:44:58.093 INFO:tasks.workunit.client.1.smithi155.stdout:8/505: read d2/d6/dd/d12/f73 [19559,106853] 0 2024-09-13T21:44:58.095 INFO:tasks.workunit.client.1.smithi155.stdout:1/587: creat d6/d82/d90/fca x:0 0 0 2024-09-13T21:44:58.096 INFO:tasks.workunit.client.1.smithi155.stdout:0/631: dwrite d1/d6/dc/d4d/d4a/d52/d5c/d6a/fc8 [0,4194304] 0 2024-09-13T21:44:58.098 INFO:tasks.workunit.client.0.smithi119.stdout:7/989: sync 2024-09-13T21:44:58.098 INFO:tasks.workunit.client.0.smithi119.stdout:2/885: sync 2024-09-13T21:44:58.098 INFO:tasks.workunit.client.0.smithi119.stdout:8/987: sync 2024-09-13T21:44:58.098 INFO:tasks.workunit.client.0.smithi119.stdout:4/933: sync 2024-09-13T21:44:58.098 INFO:tasks.workunit.client.0.smithi119.stdout:1/861: sync 2024-09-13T21:44:58.099 INFO:tasks.workunit.client.1.smithi155.stdout:8/506: mkdir d2/d1f/d87/d9a 0 2024-09-13T21:44:58.100 INFO:tasks.workunit.client.1.smithi155.stdout:1/588: creat d6/d15/d57/d5d/fcb x:0 0 0 2024-09-13T21:44:58.100 INFO:tasks.workunit.client.0.smithi119.stdout:2/886: fsync d1/d7/fbd 0 2024-09-13T21:44:58.102 INFO:tasks.workunit.client.1.smithi155.stdout:6/667: rename db/d11/d2b/d35/fa3 to db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d88/fde 0 2024-09-13T21:44:58.102 INFO:tasks.workunit.client.0.smithi119.stdout:6/871: dwrite dc/d3d/d40/d68/fe3 [0,4194304] 0 2024-09-13T21:44:58.103 INFO:tasks.workunit.client.1.smithi155.stdout:6/668: truncate db/d11/d86/fcc 592579 0 2024-09-13T21:44:58.105 INFO:tasks.workunit.client.1.smithi155.stdout:6/669: chown db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/la6 2 1 2024-09-13T21:44:58.107 INFO:tasks.workunit.client.1.smithi155.stdout:6/670: dread db/d11/d86/fcc [0,4194304] 0 2024-09-13T21:44:58.107 INFO:tasks.workunit.client.0.smithi119.stdout:7/990: symlink d8/d3c/d53/d3b/dbf/l151 0 2024-09-13T21:44:58.108 INFO:tasks.workunit.client.1.smithi155.stdout:6/671: chown db/d11/d6d/db9/d1c/d36/d83/ddd/f54 1542 1 2024-09-13T21:44:58.110 INFO:tasks.workunit.client.1.smithi155.stdout:6/672: creat db/d11/d2b/d35/fdf x:0 0 0 2024-09-13T21:44:58.111 INFO:tasks.workunit.client.0.smithi119.stdout:6/872: write dc/d4b/d6a/dc2/fd8 [3664417,99580] 0 2024-09-13T21:44:58.114 INFO:tasks.workunit.client.1.smithi155.stdout:8/507: truncate d2/d2d/f71 919836 0 2024-09-13T21:44:58.114 INFO:tasks.workunit.client.0.smithi119.stdout:2/887: creat d1/d22/db6/dde/f11d x:0 0 0 2024-09-13T21:44:58.115 INFO:tasks.workunit.client.0.smithi119.stdout:1/862: dwrite d1/d3/dc/d24/fb0 [0,4194304] 0 2024-09-13T21:44:58.116 INFO:tasks.workunit.client.1.smithi155.stdout:8/508: mknod d2/d8/c9b 0 2024-09-13T21:44:58.117 INFO:tasks.workunit.client.0.smithi119.stdout:8/988: rename d1b/d1d/d26/d3e/d65/f125 to d1b/f136 0 2024-09-13T21:44:58.123 INFO:tasks.workunit.client.0.smithi119.stdout:7/991: creat d8/d3c/d53/d37/f152 x:0 0 0 2024-09-13T21:44:58.125 INFO:tasks.workunit.client.0.smithi119.stdout:6/873: link dc/df/d32/l80 dc/d3d/d4e/dba/l115 0 2024-09-13T21:44:58.128 INFO:tasks.workunit.client.0.smithi119.stdout:2/888: creat d1/d22/d55/f11e x:0 0 0 2024-09-13T21:44:58.129 INFO:tasks.workunit.client.0.smithi119.stdout:8/989: creat d1b/f137 x:0 0 0 2024-09-13T21:44:58.132 INFO:tasks.workunit.client.0.smithi119.stdout:4/934: dwrite d4/d1e/d28/d34/d66/f7b [0,4194304] 0 2024-09-13T21:44:58.134 INFO:tasks.workunit.client.0.smithi119.stdout:6/874: fdatasync dc/d3d/d40/f58 0 2024-09-13T21:44:58.134 INFO:tasks.workunit.client.0.smithi119.stdout:1/863: dread d1/d3/d61/d7e/d53/ddf/ff5 [0,4194304] 0 2024-09-13T21:44:58.137 INFO:tasks.workunit.client.0.smithi119.stdout:7/992: dwrite d8/f17 [0,4194304] 0 2024-09-13T21:44:58.137 INFO:tasks.workunit.client.0.smithi119.stdout:8/990: write d1b/d1d/d26/d3e/d65/ffe [4367086,11490] 0 2024-09-13T21:44:58.140 INFO:tasks.workunit.client.0.smithi119.stdout:4/935: mkdir d4/d1e/d26/d60/d69/d134 0 2024-09-13T21:44:58.146 INFO:tasks.workunit.client.0.smithi119.stdout:1/864: truncate d1/d3/d61/d77/d78/d32/dda/d19/d2d/fec 395283 0 2024-09-13T21:44:58.147 INFO:tasks.workunit.client.0.smithi119.stdout:8/991: symlink d1b/d1d/d26/d3e/d65/d11c/l138 0 2024-09-13T21:44:58.148 INFO:tasks.workunit.client.0.smithi119.stdout:8/992: truncate d1b/f137 543131 0 2024-09-13T21:44:58.149 INFO:tasks.workunit.client.0.smithi119.stdout:6/875: rename dc/dd/f4f to dc/df/d65/f116 0 2024-09-13T21:44:58.149 INFO:tasks.workunit.client.1.smithi155.stdout:8/509: dread d2/d8/f4f [0,4194304] 0 2024-09-13T21:44:58.149 INFO:tasks.workunit.client.0.smithi119.stdout:8/993: dread d1b/fee [0,4194304] 0 2024-09-13T21:44:58.150 INFO:tasks.workunit.client.1.smithi155.stdout:8/510: chown d2/d6/dd/d12/f2c 15944 1 2024-09-13T21:44:58.150 INFO:tasks.workunit.client.0.smithi119.stdout:4/936: mkdir d4/d1e/d28/d34/d66/d135 0 2024-09-13T21:44:58.151 INFO:tasks.workunit.client.1.smithi155.stdout:8/511: stat d2/d6/dd/d25/f6d 0 2024-09-13T21:44:58.151 INFO:tasks.workunit.client.0.smithi119.stdout:1/865: mkdir d1/d3/d61/d77/d78/d32/dda/d19/d2d/d59/d124 0 2024-09-13T21:44:58.152 INFO:tasks.workunit.client.0.smithi119.stdout:8/994: read - d1b/d1d/d39/f9c zero size 2024-09-13T21:44:58.152 INFO:tasks.workunit.client.0.smithi119.stdout:6/876: fsync dc/d3d/d40/d68/fe3 0 2024-09-13T21:44:58.152 INFO:tasks.workunit.client.1.smithi155.stdout:8/512: write d2/d6/dd/d25/f85 [337500,87429] 0 2024-09-13T21:44:58.155 INFO:tasks.workunit.client.0.smithi119.stdout:8/995: truncate d1b/d1d/d26/fed 31307 0 2024-09-13T21:44:58.160 INFO:tasks.workunit.client.0.smithi119.stdout:6/877: truncate dc/d3a/dbb/d7a/dc7/d10e/f113 921152 0 2024-09-13T21:44:58.161 INFO:tasks.workunit.client.1.smithi155.stdout:8/513: dwrite d2/d2d/f59 [0,4194304] 0 2024-09-13T21:44:58.161 INFO:tasks.workunit.client.1.smithi155.stdout:8/514: chown d2/d1f/d87/d9a 5 1 2024-09-13T21:44:58.161 INFO:tasks.workunit.client.0.smithi119.stdout:8/996: write d1b/d1d/d26/d6b/f100 [389649,118892] 0 2024-09-13T21:44:58.161 INFO:tasks.workunit.client.0.smithi119.stdout:7/993: write d8/d3c/d53/d3b/f54 [2886437,95528] 0 2024-09-13T21:44:58.163 INFO:tasks.workunit.client.0.smithi119.stdout:1/866: dwrite d1/d3/f13 [0,4194304] 0 2024-09-13T21:44:58.165 INFO:tasks.workunit.client.1.smithi155.stdout:8/515: creat d2/d1f/d87/d9a/f9c x:0 0 0 2024-09-13T21:44:58.165 INFO:tasks.workunit.client.0.smithi119.stdout:7/994: dread - d8/d3c/d53/d6b/f11d zero size 2024-09-13T21:44:58.166 INFO:tasks.workunit.client.1.smithi155.stdout:8/516: chown d2/d8/d75/l81 11 1 2024-09-13T21:44:58.166 INFO:tasks.workunit.client.0.smithi119.stdout:2/889: dread d1/d22/db6/fc4 [8388608,4194304] 0 2024-09-13T21:44:58.169 INFO:tasks.workunit.client.0.smithi119.stdout:1/867: chown d1/d3/d61/d77/d78/d32/fb9 23953403 1 2024-09-13T21:44:58.169 INFO:tasks.workunit.client.0.smithi119.stdout:6/878: rename dc/d4b/f106 to dc/df/d64/dc0/f117 0 2024-09-13T21:44:58.174 INFO:tasks.workunit.client.1.smithi155.stdout:8/517: dwrite d2/d6/dd/d12/f97 [0,4194304] 0 2024-09-13T21:44:58.174 INFO:tasks.workunit.client.0.smithi119.stdout:7/995: readlink d8/d3c/d53/d37/d83/d89/dc3/d120/d131/la8 0 2024-09-13T21:44:58.179 INFO:tasks.workunit.client.0.smithi119.stdout:8/997: dwrite d1b/d1d/ff2 [0,4194304] 0 2024-09-13T21:44:58.180 INFO:tasks.workunit.client.0.smithi119.stdout:1/868: creat d1/d3/d61/d7e/d53/ddf/d117/f125 x:0 0 0 2024-09-13T21:44:58.182 INFO:tasks.workunit.client.1.smithi155.stdout:8/518: dwrite d2/f74 [0,4194304] 0 2024-09-13T21:44:58.187 INFO:tasks.workunit.client.1.smithi155.stdout:8/519: rename d2/f30 to d2/d2d/d96/f9d 0 2024-09-13T21:44:58.191 INFO:tasks.workunit.client.0.smithi119.stdout:2/890: dwrite d1/d7/fba [0,4194304] 0 2024-09-13T21:44:58.191 INFO:tasks.workunit.client.0.smithi119.stdout:8/998: chown d1b/d4e/d71/cca 1213059 1 2024-09-13T21:44:58.192 INFO:tasks.workunit.client.0.smithi119.stdout:4/937: dread d4/d1e/d28/d34/d66/fd1 [0,4194304] 0 2024-09-13T21:44:58.192 INFO:tasks.workunit.client.0.smithi119.stdout:6/879: dwrite dc/df/d41/dbf/fea [0,4194304] 0 2024-09-13T21:44:58.192 INFO:tasks.workunit.client.0.smithi119.stdout:1/869: truncate d1/d3/d61/d7e/d53/ddf/ff5 5055952 0 2024-09-13T21:44:58.194 INFO:tasks.workunit.client.1.smithi155.stdout:8/520: link d2/d6/dd/d25/c3f d2/d8/d5e/d60/c9e 0 2024-09-13T21:44:58.195 INFO:tasks.workunit.client.1.smithi155.stdout:8/521: truncate d2/d1f/f84 1219666 0 2024-09-13T21:44:58.199 INFO:tasks.workunit.client.1.smithi155.stdout:8/522: link d2/d2d/f5a d2/d91/f9f 0 2024-09-13T21:44:58.199 INFO:tasks.workunit.client.0.smithi119.stdout:2/891: creat d1/d22/d5a/d5d/d83/f11f x:0 0 0 2024-09-13T21:44:58.199 INFO:tasks.workunit.client.0.smithi119.stdout:8/999: symlink d1b/d1d/d26/df0/d10b/l139 0 2024-09-13T21:44:58.202 INFO:tasks.workunit.client.0.smithi119.stdout:4/938: rename d4/d1e/d28/d34/d66/d135 to d4/d114/de9/df8/d11b/d122/d136 0 2024-09-13T21:44:58.203 INFO:tasks.workunit.client.1.smithi155.stdout:8/523: creat d2/d8/d75/d82/fa0 x:0 0 0 2024-09-13T21:44:58.205 INFO:tasks.workunit.client.1.smithi155.stdout:8/524: symlink d2/d1f/d87/la1 0 2024-09-13T21:44:58.206 INFO:tasks.workunit.client.0.smithi119.stdout:4/939: creat d4/d114/de9/f137 x:0 0 0 2024-09-13T21:44:58.206 INFO:tasks.workunit.client.0.smithi119.stdout:1/870: dwrite d1/d3/d61/d7e/d53/ddf/ff5 [4194304,4194304] 0 2024-09-13T21:44:58.207 INFO:tasks.workunit.client.1.smithi155.stdout:8/525: truncate d2/d2d/f5a 889258 0 2024-09-13T21:44:58.207 INFO:tasks.workunit.client.0.smithi119.stdout:4/940: chown d4/d1e/f6b 408 1 2024-09-13T21:44:58.209 INFO:tasks.workunit.client.0.smithi119.stdout:4/941: mknod d4/d1e/d28/d34/ddd/c138 0 2024-09-13T21:44:58.210 INFO:tasks.workunit.client.1.smithi155.stdout:8/526: symlink d2/d2d/la2 0 2024-09-13T21:44:58.211 INFO:tasks.workunit.client.0.smithi119.stdout:1/871: truncate d1/d3/d61/d77/d78/d32/d33/d72/f120 925279 0 2024-09-13T21:44:58.212 INFO:tasks.workunit.client.0.smithi119.stdout:4/942: truncate d4/d1e/d26/f75 2085167 0 2024-09-13T21:44:58.213 INFO:tasks.workunit.client.0.smithi119.stdout:4/943: write d4/f21 [5976561,70040] 0 2024-09-13T21:44:58.213 INFO:tasks.workunit.client.1.smithi155.stdout:8/527: creat d2/d6/dd/fa3 x:0 0 0 2024-09-13T21:44:58.214 INFO:tasks.workunit.client.1.smithi155.stdout:8/528: read - d2/d1f/d87/d9a/f9c zero size 2024-09-13T21:44:58.216 INFO:tasks.workunit.client.1.smithi155.stdout:8/529: mknod d2/d6/dd/ca4 0 2024-09-13T21:44:58.219 INFO:tasks.workunit.client.0.smithi119.stdout:7/996: truncate d8/d3c/d53/d37/d57/fd8 2752382 0 2024-09-13T21:44:58.220 INFO:tasks.workunit.client.0.smithi119.stdout:7/997: symlink d8/d3c/d53/d37/d146/l153 0 2024-09-13T21:44:58.221 INFO:tasks.workunit.client.0.smithi119.stdout:7/998: stat d8/d3c/d53/d37/d57/d5f/f67 0 2024-09-13T21:44:58.221 INFO:tasks.workunit.client.0.smithi119.stdout:7/999: stat d8/d3c/d53/d3b/d48/cce 0 2024-09-13T21:44:58.223 INFO:tasks.workunit.client.1.smithi155.stdout:8/530: dwrite d2/d1f/d87/d9a/f9c [0,4194304] 0 2024-09-13T21:44:58.227 INFO:tasks.workunit.client.1.smithi155.stdout:8/531: mknod d2/ca5 0 2024-09-13T21:44:58.228 INFO:tasks.workunit.client.1.smithi155.stdout:8/532: fsync d2/d8/d65/f3e 0 2024-09-13T21:44:58.229 INFO:tasks.workunit.client.1.smithi155.stdout:8/533: write d2/d1f/d87/f8f [134449,55676] 0 2024-09-13T21:44:58.231 INFO:tasks.workunit.client.1.smithi155.stdout:8/534: symlink d2/d2d/d96/la6 0 2024-09-13T21:44:58.233 INFO:tasks.workunit.client.1.smithi155.stdout:8/535: creat d2/d6/dd/fa7 x:0 0 0 2024-09-13T21:44:58.235 INFO:tasks.workunit.client.1.smithi155.stdout:8/536: mkdir d2/d8/d65/da8 0 2024-09-13T21:44:58.237 INFO:tasks.workunit.client.1.smithi155.stdout:8/537: symlink d2/d1f/d87/la9 0 2024-09-13T21:44:58.239 INFO:tasks.workunit.client.1.smithi155.stdout:8/538: rmdir d2/d6/dd/d12 39 2024-09-13T21:44:58.241 INFO:tasks.workunit.client.0.smithi119.stdout:2/892: dread d1/d38/d89/d6b/d8c/fc1 [0,4194304] 0 2024-09-13T21:44:58.241 INFO:tasks.workunit.client.0.smithi119.stdout:6/880: dwrite dc/df/d64/fec [0,4194304] 0 2024-09-13T21:44:58.241 INFO:tasks.workunit.client.1.smithi155.stdout:8/539: truncate d2/d8/d65/f41 525072 0 2024-09-13T21:44:58.242 INFO:tasks.workunit.client.0.smithi119.stdout:2/893: dread - d1/d22/d5a/d5d/d77/daa/f101 zero size 2024-09-13T21:44:58.244 INFO:tasks.workunit.client.0.smithi119.stdout:6/881: truncate dc/df/fb6 730711 0 2024-09-13T21:44:58.245 INFO:tasks.workunit.client.0.smithi119.stdout:6/882: stat dc/d3d/fa0 0 2024-09-13T21:44:58.246 INFO:tasks.workunit.client.1.smithi155.stdout:8/540: getdents d2 0 2024-09-13T21:44:58.247 INFO:tasks.workunit.client.1.smithi155.stdout:8/541: chown d2/d6/dd/fa7 36 1 2024-09-13T21:44:58.249 INFO:tasks.workunit.client.0.smithi119.stdout:6/883: dread dc/df/d6d/fda [0,4194304] 0 2024-09-13T21:44:58.250 INFO:tasks.workunit.client.1.smithi155.stdout:3/606: sync 2024-09-13T21:44:58.250 INFO:tasks.workunit.client.1.smithi155.stdout:3/607: readlink d3/d25/d1b/l8c 0 2024-09-13T21:44:58.251 INFO:tasks.workunit.client.1.smithi155.stdout:8/542: getdents d2/d8/d75 0 2024-09-13T21:44:58.253 INFO:tasks.workunit.client.0.smithi119.stdout:4/944: write d4/f4e [1977450,113278] 0 2024-09-13T21:44:58.253 INFO:tasks.workunit.client.1.smithi155.stdout:8/543: read - d2/d8/d75/d82/fa0 zero size 2024-09-13T21:44:58.258 INFO:tasks.workunit.client.1.smithi155.stdout:3/608: dwrite d3/d25/f94 [0,4194304] 0 2024-09-13T21:44:58.259 INFO:tasks.workunit.client.1.smithi155.stdout:3/609: write d3/d25/f3f [2844879,49870] 0 2024-09-13T21:44:58.262 INFO:tasks.workunit.client.1.smithi155.stdout:3/610: creat d3/d25/d17/d52/fd2 x:0 0 0 2024-09-13T21:44:58.262 INFO:tasks.workunit.client.0.smithi119.stdout:6/884: dwrite dc/df/d41/fc3 [0,4194304] 0 2024-09-13T21:44:58.263 INFO:tasks.workunit.client.0.smithi119.stdout:1/872: dwrite d1/d3/d61/d7e/d53/f83 [0,4194304] 0 2024-09-13T21:44:58.263 INFO:tasks.workunit.client.1.smithi155.stdout:3/611: read d3/d25/d17/d3b/f77 [720573,61141] 0 2024-09-13T21:44:58.271 INFO:tasks.workunit.client.0.smithi119.stdout:6/885: mknod dc/d3a/dbb/d7a/de1/dfb/c118 0 2024-09-13T21:44:58.271 INFO:tasks.workunit.client.0.smithi119.stdout:2/894: dread d1/f3d [0,4194304] 0 2024-09-13T21:44:58.277 INFO:tasks.workunit.client.0.smithi119.stdout:6/886: creat dc/d3a/dbb/d7a/de1/de4/f119 x:0 0 0 2024-09-13T21:44:58.277 INFO:tasks.workunit.client.0.smithi119.stdout:1/873: creat d1/d3/d61/d77/d78/d32/dda/f126 x:0 0 0 2024-09-13T21:44:58.280 INFO:tasks.workunit.client.0.smithi119.stdout:2/895: dwrite d1/d22/d55/d31/f94 [0,4194304] 0 2024-09-13T21:44:58.280 INFO:tasks.workunit.client.1.smithi155.stdout:3/612: truncate d3/d10/f8d 3498864 0 2024-09-13T21:44:58.280 INFO:tasks.workunit.client.0.smithi119.stdout:6/887: creat dc/d3a/dbb/d7a/de1/f11a x:0 0 0 2024-09-13T21:44:58.281 INFO:tasks.workunit.client.0.smithi119.stdout:6/888: dread - dc/d3d/d40/d68/fcc zero size 2024-09-13T21:44:58.282 INFO:tasks.workunit.client.1.smithi155.stdout:3/613: symlink d3/d21/ld3 0 2024-09-13T21:44:58.285 INFO:tasks.workunit.client.1.smithi155.stdout:3/614: unlink d3/d25/f3f 0 2024-09-13T21:44:58.288 INFO:tasks.workunit.client.0.smithi119.stdout:6/889: rename dc/df/d64/ce2 to dc/d3a/dbb/d7a/d86/c11b 0 2024-09-13T21:44:58.289 INFO:tasks.workunit.client.0.smithi119.stdout:1/874: dwrite d1/d3/d61/d77/d78/d32/dda/d3d/f98 [4194304,4194304] 0 2024-09-13T21:44:58.291 INFO:tasks.workunit.client.0.smithi119.stdout:1/875: write d1/d3/d61/d77/d78/d32/dda/d28/f3f [12897724,1695] 0 2024-09-13T21:44:58.294 INFO:tasks.workunit.client.0.smithi119.stdout:4/945: dread d4/d1e/ff [0,4194304] 0 2024-09-13T21:44:58.295 INFO:tasks.workunit.client.0.smithi119.stdout:4/946: chown d4/d1e/d28/d34/d99/fd8 0 1 2024-09-13T21:44:58.302 INFO:tasks.workunit.client.0.smithi119.stdout:4/947: symlink d4/d114/de9/df8/d11b/l139 0 2024-09-13T21:44:58.314 INFO:tasks.workunit.client.0.smithi119.stdout:2/896: dwrite d1/d22/d5a/d5d/d77/daa/fb3 [0,4194304] 0 2024-09-13T21:44:58.320 INFO:tasks.workunit.client.0.smithi119.stdout:6/890: dread dc/d3a/dbb/d7a/de1/fb1 [0,4194304] 0 2024-09-13T21:44:58.321 INFO:tasks.workunit.client.0.smithi119.stdout:6/891: read dc/d3d/d40/d68/fe3 [2699820,1665] 0 2024-09-13T21:44:58.321 INFO:tasks.workunit.client.0.smithi119.stdout:6/892: chown dc/df 5 1 2024-09-13T21:44:58.328 INFO:tasks.workunit.client.0.smithi119.stdout:4/948: unlink d4/d1e/d28/d5d/d113/c125 0 2024-09-13T21:44:58.329 INFO:tasks.workunit.client.0.smithi119.stdout:2/897: dread - d1/d38/d89/d6b/d8c/fda zero size 2024-09-13T21:44:58.330 INFO:tasks.workunit.client.0.smithi119.stdout:1/876: link d1/d3/d61/d77/d78/d32/d33/d43/f5e d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/f127 0 2024-09-13T21:44:58.331 INFO:tasks.workunit.client.0.smithi119.stdout:4/949: unlink d4/f73 0 2024-09-13T21:44:58.334 INFO:tasks.workunit.client.0.smithi119.stdout:4/950: chown d4/d114/de9/df8/f97 1 1 2024-09-13T21:44:58.337 INFO:tasks.workunit.client.0.smithi119.stdout:2/898: dread d1/d7/d47/f8b [0,4194304] 0 2024-09-13T21:44:58.340 INFO:tasks.workunit.client.0.smithi119.stdout:1/877: dwrite d1/d3/d61/d77/d78/d32/dda/d19/fb7 [0,4194304] 0 2024-09-13T21:44:58.340 INFO:tasks.workunit.client.0.smithi119.stdout:2/899: mknod d1/d38/d89/d6b/c120 0 2024-09-13T21:44:58.342 INFO:tasks.workunit.client.0.smithi119.stdout:2/900: stat d1/d7/l5b 0 2024-09-13T21:44:58.345 INFO:tasks.workunit.client.0.smithi119.stdout:2/901: fsync d1/d22/db6/dde/f11d 0 2024-09-13T21:44:58.347 INFO:tasks.workunit.client.0.smithi119.stdout:6/893: dread dc/d3d/d4e/d91/f9a [4194304,4194304] 0 2024-09-13T21:44:58.351 INFO:tasks.workunit.client.0.smithi119.stdout:1/878: dwrite d1/d3/d61/d77/d78/d32/dda/d3d/f106 [0,4194304] 0 2024-09-13T21:44:58.353 INFO:tasks.workunit.client.0.smithi119.stdout:6/894: creat dc/d3d/d40/f11c x:0 0 0 2024-09-13T21:44:58.356 INFO:tasks.workunit.client.0.smithi119.stdout:2/902: dwrite d1/d22/d55/f44 [0,4194304] 0 2024-09-13T21:44:58.369 INFO:tasks.workunit.client.0.smithi119.stdout:4/951: write d4/d1e/d28/f24 [643998,46971] 0 2024-09-13T21:44:58.372 INFO:tasks.workunit.client.0.smithi119.stdout:4/952: readlink d4/d1e/d28/d34/ddd/d118/l132 0 2024-09-13T21:44:58.376 INFO:tasks.workunit.client.0.smithi119.stdout:1/879: dwrite d1/d3/dc/f1c [0,4194304] 0 2024-09-13T21:44:58.377 INFO:tasks.workunit.client.0.smithi119.stdout:6/895: dwrite dc/df/d65/f116 [0,4194304] 0 2024-09-13T21:44:58.380 INFO:tasks.workunit.client.0.smithi119.stdout:2/903: dread d1/f4a [0,4194304] 0 2024-09-13T21:44:58.382 INFO:tasks.workunit.client.0.smithi119.stdout:2/904: write d1/d22/db6/f105 [391620,110385] 0 2024-09-13T21:44:58.383 INFO:tasks.workunit.client.0.smithi119.stdout:6/896: rename dc/df/l19 to dc/d4b/d6a/d75/l11d 0 2024-09-13T21:44:58.383 INFO:tasks.workunit.client.0.smithi119.stdout:1/880: symlink d1/d3/d61/d77/d78/d32/dda/l128 0 2024-09-13T21:44:58.385 INFO:tasks.workunit.client.0.smithi119.stdout:2/905: mknod d1/d38/d89/c121 0 2024-09-13T21:44:58.385 INFO:tasks.workunit.client.0.smithi119.stdout:4/953: write d4/d1e/d28/d34/d6a/d79/d9f/dba/fe3 [1037376,8911] 0 2024-09-13T21:44:58.386 INFO:tasks.workunit.client.0.smithi119.stdout:6/897: symlink dc/df/d65/l11e 0 2024-09-13T21:44:58.389 INFO:tasks.workunit.client.0.smithi119.stdout:4/954: read d4/d1e/d26/d60/d71/fc6 [842095,914] 0 2024-09-13T21:44:58.390 INFO:tasks.workunit.client.0.smithi119.stdout:6/898: write dc/f31 [4546505,39645] 0 2024-09-13T21:44:58.391 INFO:tasks.workunit.client.0.smithi119.stdout:2/906: getdents d1/d7/d47/df3/d108 0 2024-09-13T21:44:58.395 INFO:tasks.workunit.client.0.smithi119.stdout:6/899: rename dc/d3d/d40/dce to dc/d4b/d6a/d75/d11f 0 2024-09-13T21:44:58.395 INFO:tasks.workunit.client.0.smithi119.stdout:2/907: truncate d1/d7/f20 3614648 0 2024-09-13T21:44:58.397 INFO:tasks.workunit.client.0.smithi119.stdout:2/908: chown d1/d38/d89/d6b/f87 182338095 1 2024-09-13T21:44:58.397 INFO:tasks.workunit.client.0.smithi119.stdout:6/900: chown dc/d3d/d40/d6b/df9/l10d 8 1 2024-09-13T21:44:58.398 INFO:tasks.workunit.client.0.smithi119.stdout:2/909: creat d1/d22/d5a/d5d/d83/dce/f122 x:0 0 0 2024-09-13T21:44:58.400 INFO:tasks.workunit.client.0.smithi119.stdout:6/901: creat dc/d3a/dbb/d7a/d86/f120 x:0 0 0 2024-09-13T21:44:58.401 INFO:tasks.workunit.client.0.smithi119.stdout:6/902: truncate dc/df/d64/dc0/f117 768600 0 2024-09-13T21:44:58.404 INFO:tasks.workunit.client.0.smithi119.stdout:1/881: truncate d1/d3/d61/d77/da6/fac 1861045 0 2024-09-13T21:44:58.406 INFO:tasks.workunit.client.0.smithi119.stdout:2/910: dwrite d1/d7/f9 [0,4194304] 0 2024-09-13T21:44:58.408 INFO:tasks.workunit.client.1.smithi155.stdout:5/511: sync 2024-09-13T21:44:58.408 INFO:tasks.workunit.client.0.smithi119.stdout:6/903: rename dc/d4b/d6a to dc/df/d64/df4/d121 0 2024-09-13T21:44:58.409 INFO:tasks.workunit.client.0.smithi119.stdout:6/904: readlink dc/l3b 0 2024-09-13T21:44:58.409 INFO:tasks.workunit.client.0.smithi119.stdout:4/955: dread d4/d1e/d26/f75 [0,4194304] 0 2024-09-13T21:44:58.410 INFO:tasks.workunit.client.1.smithi155.stdout:5/512: truncate d5/d16/d33/d1b/d1e/f5d 343185 0 2024-09-13T21:44:58.411 INFO:tasks.workunit.client.1.smithi155.stdout:5/513: chown d5/d16/d33/d1b/d2f/d3c/d44/d80 482 1 2024-09-13T21:44:58.413 INFO:tasks.workunit.client.0.smithi119.stdout:6/905: creat dc/d3a/dbb/d7a/f122 x:0 0 0 2024-09-13T21:44:58.415 INFO:tasks.workunit.client.0.smithi119.stdout:4/956: dread - d4/d1e/d28/d34/ddd/fdf zero size 2024-09-13T21:44:58.418 INFO:tasks.workunit.client.0.smithi119.stdout:6/906: mknod dc/d3a/dbb/d7a/de1/dfb/c123 0 2024-09-13T21:44:58.419 INFO:tasks.workunit.client.0.smithi119.stdout:6/907: rename dc to dc/d3d/d4e/dba/d124 22 2024-09-13T21:44:58.420 INFO:tasks.workunit.client.0.smithi119.stdout:4/957: mknod d4/d114/de9/df8/c13a 0 2024-09-13T21:44:58.421 INFO:tasks.workunit.client.0.smithi119.stdout:2/911: getdents d1/d7/d47 0 2024-09-13T21:44:58.422 INFO:tasks.workunit.client.0.smithi119.stdout:6/908: fdatasync dc/d4b/f8c 0 2024-09-13T21:44:58.425 INFO:tasks.workunit.client.0.smithi119.stdout:1/882: dwrite d1/d3/d61/d77/d78/d32/dda/d28/f5d [0,4194304] 0 2024-09-13T21:44:58.426 INFO:tasks.workunit.client.0.smithi119.stdout:2/912: mknod d1/d103/c123 0 2024-09-13T21:44:58.428 INFO:tasks.workunit.client.1.smithi155.stdout:5/514: write d5/d16/d33/d1b/d28/fa4 [14959,66458] 0 2024-09-13T21:44:58.429 INFO:tasks.workunit.client.0.smithi119.stdout:4/958: rename d4/d1e/d26/d6d/d7c/l111 to d4/d1e/d28/d34/d99/l13b 0 2024-09-13T21:44:58.430 INFO:tasks.workunit.client.1.smithi155.stdout:5/515: unlink d5/d16/d33/f43 0 2024-09-13T21:44:58.431 INFO:tasks.workunit.client.0.smithi119.stdout:4/959: write d4/f4b [957471,40617] 0 2024-09-13T21:44:58.432 INFO:tasks.workunit.client.1.smithi155.stdout:5/516: write d5/d16/d33/d1b/d28/f37 [1765206,78084] 0 2024-09-13T21:44:58.433 INFO:tasks.workunit.client.0.smithi119.stdout:6/909: dwrite dc/dd/f38 [0,4194304] 0 2024-09-13T21:44:58.435 INFO:tasks.workunit.client.0.smithi119.stdout:4/960: write d4/d1e/d28/d5d/d113/f117 [979179,76544] 0 2024-09-13T21:44:58.440 INFO:tasks.workunit.client.0.smithi119.stdout:6/910: symlink dc/d3a/dbb/d7a/de1/l125 0 2024-09-13T21:44:58.440 INFO:tasks.workunit.client.0.smithi119.stdout:1/883: link d1/d3/d61/d77/d78/d32/dda/d28/d93/cbb d1/d3/d61/d77/d78/db8/c129 0 2024-09-13T21:44:58.442 INFO:tasks.workunit.client.0.smithi119.stdout:4/961: dread d4/d1e/d28/d34/d6a/d79/d9f/dcf/f112 [0,4194304] 0 2024-09-13T21:44:58.444 INFO:tasks.workunit.client.0.smithi119.stdout:4/962: chown d4/d1e/d26/d60/d69/lb2 2 1 2024-09-13T21:44:58.445 INFO:tasks.workunit.client.0.smithi119.stdout:4/963: creat d4/ddc/f13c x:0 0 0 2024-09-13T21:44:58.453 INFO:tasks.workunit.client.0.smithi119.stdout:4/964: truncate d4/d1e/d28/d34/d66/f9c 397468 0 2024-09-13T21:44:58.455 INFO:tasks.workunit.client.0.smithi119.stdout:4/965: symlink d4/d1e/d28/d5d/d129/l13d 0 2024-09-13T21:44:58.458 INFO:tasks.workunit.client.0.smithi119.stdout:2/913: dread d1/d22/d5a/d5d/d83/dce/fe7 [0,4194304] 0 2024-09-13T21:44:58.459 INFO:tasks.workunit.client.0.smithi119.stdout:4/966: getdents d4/d1e/d28/d34/d6a/d79/d9f/d11d 0 2024-09-13T21:44:58.460 INFO:tasks.workunit.client.0.smithi119.stdout:2/914: rmdir d1/d7/d86 39 2024-09-13T21:44:58.463 INFO:tasks.workunit.client.0.smithi119.stdout:6/911: dread dc/d3d/d4e/f57 [0,4194304] 0 2024-09-13T21:44:58.464 INFO:tasks.workunit.client.0.smithi119.stdout:6/912: chown dc/d3d/d4e/l67 147356 1 2024-09-13T21:44:58.465 INFO:tasks.workunit.client.0.smithi119.stdout:4/967: getdents d4/d114/de9/df8/d8f 0 2024-09-13T21:44:58.465 INFO:tasks.workunit.client.0.smithi119.stdout:2/915: getdents d1/d22/d5a/d5d/d77 0 2024-09-13T21:44:58.466 INFO:tasks.workunit.client.0.smithi119.stdout:6/913: chown dc/f36 1044843 1 2024-09-13T21:44:58.467 INFO:tasks.workunit.client.0.smithi119.stdout:6/914: write dc/d3d/d40/d68/fcc [816181,50937] 0 2024-09-13T21:44:58.468 INFO:tasks.workunit.client.0.smithi119.stdout:2/916: unlink d1/d38/f2e 0 2024-09-13T21:44:58.469 INFO:tasks.workunit.client.0.smithi119.stdout:4/968: mknod d4/d1e/d28/d34/ddd/c13e 0 2024-09-13T21:44:58.470 INFO:tasks.workunit.client.0.smithi119.stdout:4/969: chown d4/d1e/d28/d5d/c10a 3807 1 2024-09-13T21:44:58.470 INFO:tasks.workunit.client.0.smithi119.stdout:6/915: symlink dc/d4b/l126 0 2024-09-13T21:44:58.471 INFO:tasks.workunit.client.0.smithi119.stdout:6/916: write dc/d3d/d40/d6b/f112 [333657,62413] 0 2024-09-13T21:44:58.472 INFO:tasks.workunit.client.0.smithi119.stdout:4/970: mkdir d4/d1e/d28/d5d/d129/d13f 0 2024-09-13T21:44:58.474 INFO:tasks.workunit.client.0.smithi119.stdout:6/917: symlink dc/d3a/dbb/d7a/dc7/l127 0 2024-09-13T21:44:58.474 INFO:tasks.workunit.client.0.smithi119.stdout:4/971: mkdir d4/d1e/d128/d140 0 2024-09-13T21:44:58.476 INFO:tasks.workunit.client.0.smithi119.stdout:6/918: unlink dc/dd/f47 0 2024-09-13T21:44:58.477 INFO:tasks.workunit.client.0.smithi119.stdout:6/919: write dc/df/d64/df4/d121/dc2/fd8 [4419635,108048] 0 2024-09-13T21:44:58.477 INFO:tasks.workunit.client.0.smithi119.stdout:4/972: creat d4/d1e/d28/d34/d6a/d79/d9f/d11d/f141 x:0 0 0 2024-09-13T21:44:58.479 INFO:tasks.workunit.client.0.smithi119.stdout:4/973: creat d4/d1e/d28/d34/ddd/d118/f142 x:0 0 0 2024-09-13T21:44:58.480 INFO:tasks.workunit.client.0.smithi119.stdout:6/920: creat dc/d3d/f128 x:0 0 0 2024-09-13T21:44:58.485 INFO:tasks.workunit.client.0.smithi119.stdout:6/921: truncate dc/d3d/d40/d68/fe3 3177410 0 2024-09-13T21:44:58.485 INFO:tasks.workunit.client.0.smithi119.stdout:4/974: dwrite d4/d114/de9/df8/d8f/fc0 [0,4194304] 0 2024-09-13T21:44:58.488 INFO:tasks.workunit.client.0.smithi119.stdout:6/922: creat dc/d3d/d40/d68/f129 x:0 0 0 2024-09-13T21:44:58.491 INFO:tasks.workunit.client.0.smithi119.stdout:6/923: symlink dc/df/d6d/l12a 0 2024-09-13T21:44:58.494 INFO:tasks.workunit.client.0.smithi119.stdout:4/975: write d4/d114/de9/df8/f97 [789222,115530] 0 2024-09-13T21:44:58.494 INFO:tasks.workunit.client.0.smithi119.stdout:6/924: write dc/d3a/dbb/d7a/dc7/d10e/f113 [222787,125827] 0 2024-09-13T21:44:58.497 INFO:tasks.workunit.client.0.smithi119.stdout:4/976: mkdir d4/d1e/d28/d34/d99/d143 0 2024-09-13T21:44:58.499 INFO:tasks.workunit.client.0.smithi119.stdout:4/977: creat d4/d1e/d28/d5d/d113/f144 x:0 0 0 2024-09-13T21:44:58.500 INFO:tasks.workunit.client.0.smithi119.stdout:4/978: chown d4/d1e/d26/d60 2 1 2024-09-13T21:44:58.501 INFO:tasks.workunit.client.0.smithi119.stdout:4/979: write d4/d1e/d28/d34/d6a/f11a [360610,64897] 0 2024-09-13T21:44:58.502 INFO:tasks.workunit.client.0.smithi119.stdout:4/980: write d4/d1e/d26/d60/d71/f8e [34378,77825] 0 2024-09-13T21:44:58.504 INFO:tasks.workunit.client.0.smithi119.stdout:4/981: write d4/d1e/d26/d6d/f72 [1270791,103533] 0 2024-09-13T21:44:58.507 INFO:tasks.workunit.client.0.smithi119.stdout:4/982: mkdir d4/d114/de9/df8/d11b/d145 0 2024-09-13T21:44:58.509 INFO:tasks.workunit.client.0.smithi119.stdout:4/983: write d4/d1e/d26/d6d/f72 [5347849,17209] 0 2024-09-13T21:44:58.510 INFO:tasks.workunit.client.0.smithi119.stdout:4/984: chown d4/d1e/d26/d60 223 1 2024-09-13T21:44:58.511 INFO:tasks.workunit.client.0.smithi119.stdout:6/925: dwrite dc/df/d41/f7b [0,4194304] 0 2024-09-13T21:44:58.514 INFO:tasks.workunit.client.0.smithi119.stdout:6/926: chown dc/df/d64/df4/d121/dc2/cf1 2 1 2024-09-13T21:44:58.516 INFO:tasks.workunit.client.0.smithi119.stdout:6/927: dread - dc/d3d/d40/f11c zero size 2024-09-13T21:44:58.517 INFO:tasks.workunit.client.0.smithi119.stdout:4/985: dwrite d4/d1e/d26/d6d/d7c/fe0 [0,4194304] 0 2024-09-13T21:44:58.519 INFO:tasks.workunit.client.0.smithi119.stdout:4/986: creat d4/d1e/d26/d60/f146 x:0 0 0 2024-09-13T21:44:58.523 INFO:tasks.workunit.client.0.smithi119.stdout:6/928: link dc/d3a/dbb/f60 dc/d3d/d40/d6b/f12b 0 2024-09-13T21:44:58.526 INFO:tasks.workunit.client.0.smithi119.stdout:6/929: truncate dc/df/d41/f90 2394481 0 2024-09-13T21:44:58.527 INFO:tasks.workunit.client.0.smithi119.stdout:6/930: fdatasync dc/d3d/dcf/f107 0 2024-09-13T21:44:58.529 INFO:tasks.workunit.client.0.smithi119.stdout:6/931: link dc/d4b/fc1 dc/d3d/d40/d6b/f12c 0 2024-09-13T21:44:58.541 INFO:tasks.workunit.client.0.smithi119.stdout:6/932: write dc/f36 [1329939,7881] 0 2024-09-13T21:44:58.541 INFO:tasks.workunit.client.0.smithi119.stdout:6/933: fdatasync dc/df/d41/f82 0 2024-09-13T21:44:58.544 INFO:tasks.workunit.client.0.smithi119.stdout:6/934: mknod dc/df/d64/df4/c12d 0 2024-09-13T21:44:58.546 INFO:tasks.workunit.client.0.smithi119.stdout:6/935: mknod dc/d4b/c12e 0 2024-09-13T21:44:58.550 INFO:tasks.workunit.client.0.smithi119.stdout:4/987: dread d4/d1e/f36 [0,4194304] 0 2024-09-13T21:44:58.554 INFO:tasks.workunit.client.0.smithi119.stdout:4/988: dread d4/d114/de9/df8/f97 [0,4194304] 0 2024-09-13T21:44:58.554 INFO:tasks.workunit.client.0.smithi119.stdout:6/936: dwrite dc/d3d/d40/f49 [8388608,4194304] 0 2024-09-13T21:44:58.555 INFO:tasks.workunit.client.0.smithi119.stdout:6/937: fdatasync dc/df/d41/fc3 0 2024-09-13T21:44:58.559 INFO:tasks.workunit.client.0.smithi119.stdout:6/938: creat dc/d3d/d40/d6b/f12f x:0 0 0 2024-09-13T21:44:58.559 INFO:tasks.workunit.client.0.smithi119.stdout:4/989: link d4/d1e/d28/d34/d6a/d79/f106 d4/d1e/d28/d34/d66/f147 0 2024-09-13T21:44:58.560 INFO:tasks.workunit.client.0.smithi119.stdout:6/939: rmdir dc/d3a/dbb/d7a/de8 39 2024-09-13T21:44:58.560 INFO:tasks.workunit.client.0.smithi119.stdout:4/990: chown d4/d1e/d28/d34/d6a 18931275 1 2024-09-13T21:44:58.561 INFO:tasks.workunit.client.0.smithi119.stdout:6/940: fdatasync dc/df/f44 0 2024-09-13T21:44:58.561 INFO:tasks.workunit.client.0.smithi119.stdout:4/991: chown d4/d114/de9/df8/l80 1752738196 1 2024-09-13T21:44:58.562 INFO:tasks.workunit.client.0.smithi119.stdout:6/941: write dc/d3d/d40/d6b/f12b [12488005,86501] 0 2024-09-13T21:44:58.565 INFO:tasks.workunit.client.0.smithi119.stdout:6/942: creat dc/d3d/dcf/f130 x:0 0 0 2024-09-13T21:44:58.568 INFO:tasks.workunit.client.0.smithi119.stdout:6/943: fsync dc/d3d/d40/d6b/f12b 0 2024-09-13T21:44:58.572 INFO:tasks.workunit.client.0.smithi119.stdout:6/944: dread dc/df/d64/dc0/f117 [0,4194304] 0 2024-09-13T21:44:58.572 INFO:tasks.workunit.client.0.smithi119.stdout:6/945: write dc/df/d32/f6c [2023157,13393] 0 2024-09-13T21:44:58.576 INFO:tasks.workunit.client.0.smithi119.stdout:4/992: dwrite d4/d1e/f6b [0,4194304] 0 2024-09-13T21:44:58.583 INFO:tasks.workunit.client.0.smithi119.stdout:4/993: dwrite d4/f29 [0,4194304] 0 2024-09-13T21:44:58.583 INFO:tasks.workunit.client.0.smithi119.stdout:6/946: dwrite dc/d3a/dbb/d7a/de1/f94 [0,4194304] 0 2024-09-13T21:44:58.586 INFO:tasks.workunit.client.0.smithi119.stdout:4/994: dread - d4/ddc/f13c zero size 2024-09-13T21:44:58.594 INFO:tasks.workunit.client.0.smithi119.stdout:6/947: dwrite dc/df/d41/fc3 [0,4194304] 0 2024-09-13T21:44:58.595 INFO:tasks.workunit.client.0.smithi119.stdout:4/995: rmdir d4 39 2024-09-13T21:44:58.598 INFO:tasks.workunit.client.0.smithi119.stdout:6/948: creat dc/d3d/d4e/f131 x:0 0 0 2024-09-13T21:44:58.599 INFO:tasks.workunit.client.0.smithi119.stdout:4/996: symlink d4/d1e/d28/d5d/d129/d13f/l148 0 2024-09-13T21:44:58.601 INFO:tasks.workunit.client.0.smithi119.stdout:4/997: rmdir d4/d1e/d28/d34/d6a/d79/d9f 39 2024-09-13T21:44:58.604 INFO:tasks.workunit.client.1.smithi155.stdout:1/589: sync 2024-09-13T21:44:58.604 INFO:tasks.workunit.client.1.smithi155.stdout:5/517: sync 2024-09-13T21:44:58.604 INFO:tasks.workunit.client.1.smithi155.stdout:9/632: sync 2024-09-13T21:44:58.604 INFO:tasks.workunit.client.1.smithi155.stdout:0/632: sync 2024-09-13T21:44:58.604 INFO:tasks.workunit.client.1.smithi155.stdout:6/673: sync 2024-09-13T21:44:58.604 INFO:tasks.workunit.client.1.smithi155.stdout:3/615: sync 2024-09-13T21:44:58.604 INFO:tasks.workunit.client.1.smithi155.stdout:7/538: sync 2024-09-13T21:44:58.604 INFO:tasks.workunit.client.1.smithi155.stdout:2/567: sync 2024-09-13T21:44:58.605 INFO:tasks.workunit.client.0.smithi119.stdout:6/949: dwrite dc/df/d32/fa2 [0,4194304] 0 2024-09-13T21:44:58.607 INFO:tasks.workunit.client.0.smithi119.stdout:6/950: mkdir dc/d4b/d97/d132 0 2024-09-13T21:44:58.608 INFO:tasks.workunit.client.1.smithi155.stdout:9/633: unlink dc/de/d6f/d71/f9b 0 2024-09-13T21:44:58.608 INFO:tasks.workunit.client.1.smithi155.stdout:7/539: write d5/df/d15/f53 [4334312,32765] 0 2024-09-13T21:44:58.609 INFO:tasks.workunit.client.0.smithi119.stdout:6/951: mkdir dc/d3a/dbb/d7a/de1/d133 0 2024-09-13T21:44:58.609 INFO:tasks.workunit.client.1.smithi155.stdout:4/509: sync 2024-09-13T21:44:58.609 INFO:tasks.workunit.client.1.smithi155.stdout:8/544: sync 2024-09-13T21:44:58.610 INFO:tasks.workunit.client.0.smithi119.stdout:6/952: fdatasync dc/df/d64/df4/d121/dc2/fd8 0 2024-09-13T21:44:58.610 INFO:tasks.workunit.client.1.smithi155.stdout:6/674: write db/d11/d6d/db9/d1c/d36/d37/f92 [1072857,92707] 0 2024-09-13T21:44:58.610 INFO:tasks.workunit.client.1.smithi155.stdout:7/540: dread - d5/d13/fa3 zero size 2024-09-13T21:44:58.610 INFO:tasks.workunit.client.1.smithi155.stdout:4/510: fdatasync d1/d7/f58 0 2024-09-13T21:44:58.614 INFO:tasks.workunit.client.0.smithi119.stdout:6/953: dread dc/d3a/dbb/d7a/de1/f94 [0,4194304] 0 2024-09-13T21:44:58.615 INFO:tasks.workunit.client.1.smithi155.stdout:1/590: rename d6/d7/d48/f69 to d6/d7/d48/dab/fcc 0 2024-09-13T21:44:58.615 INFO:tasks.workunit.client.1.smithi155.stdout:9/634: write dc/de/f45 [876787,34389] 0 2024-09-13T21:44:58.616 INFO:tasks.workunit.client.0.smithi119.stdout:6/954: mkdir dc/d3a/dbb/d7a/dc7/d10e/d134 0 2024-09-13T21:44:58.616 INFO:tasks.workunit.client.1.smithi155.stdout:6/675: fdatasync db/f2f 0 2024-09-13T21:44:58.618 INFO:tasks.workunit.client.1.smithi155.stdout:5/518: link d5/f49 d5/d16/d33/d1b/d59/fae 0 2024-09-13T21:44:58.618 INFO:tasks.workunit.client.1.smithi155.stdout:4/511: read d1/d7/f30 [130460,22555] 0 2024-09-13T21:44:58.620 INFO:tasks.workunit.client.1.smithi155.stdout:7/541: mkdir d5/d10/da7 0 2024-09-13T21:44:58.621 INFO:tasks.workunit.client.1.smithi155.stdout:1/591: creat d6/d82/d90/fcd x:0 0 0 2024-09-13T21:44:58.621 INFO:tasks.workunit.client.1.smithi155.stdout:7/542: readlink d5/df/d15/d33/d43/l9d 0 2024-09-13T21:44:58.622 INFO:tasks.workunit.client.1.smithi155.stdout:9/635: mknod dc/de/d2d/d79/cdc 0 2024-09-13T21:44:58.624 INFO:tasks.workunit.client.1.smithi155.stdout:6/676: symlink db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/le0 0 2024-09-13T21:44:58.624 INFO:tasks.workunit.client.0.smithi119.stdout:6/955: dwrite dc/df/f1c [0,4194304] 0 2024-09-13T21:44:58.625 INFO:tasks.workunit.client.1.smithi155.stdout:5/519: mkdir d5/d16/d33/d1b/d2f/d3c/d5b/d5f/daf 0 2024-09-13T21:44:58.626 INFO:tasks.workunit.client.0.smithi119.stdout:6/956: write dc/d3a/dbb/d7a/de1/dfb/f108 [519605,82525] 0 2024-09-13T21:44:58.626 INFO:tasks.workunit.client.1.smithi155.stdout:0/633: getdents d1/d6/dc/d4d/d4a/dbe 0 2024-09-13T21:44:58.627 INFO:tasks.workunit.client.1.smithi155.stdout:5/520: dread d5/f47 [0,4194304] 0 2024-09-13T21:44:58.628 INFO:tasks.workunit.client.1.smithi155.stdout:4/512: mknod d1/d7/d21/c9f 0 2024-09-13T21:44:58.630 INFO:tasks.workunit.client.1.smithi155.stdout:9/636: rename dc/d19/d21/fc3 to dc/de/d6f/d71/fdd 0 2024-09-13T21:44:58.633 INFO:tasks.workunit.client.1.smithi155.stdout:9/637: write dc/de/d15/f97 [932686,116228] 0 2024-09-13T21:44:58.635 INFO:tasks.workunit.client.1.smithi155.stdout:9/638: write dc/d19/d23/d38/d90/f98 [544028,30659] 0 2024-09-13T21:44:58.636 INFO:tasks.workunit.client.0.smithi119.stdout:6/957: dwrite dc/d3d/d4e/f76 [0,4194304] 0 2024-09-13T21:44:58.637 INFO:tasks.workunit.client.1.smithi155.stdout:9/639: chown dc/de/d6f/dae/ddb/cc2 101 1 2024-09-13T21:44:58.637 INFO:tasks.workunit.client.1.smithi155.stdout:0/634: symlink d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/lf8 0 2024-09-13T21:44:58.638 INFO:tasks.workunit.client.0.smithi119.stdout:6/958: mknod dc/d3a/dbb/c135 0 2024-09-13T21:44:58.638 INFO:tasks.workunit.client.1.smithi155.stdout:9/640: read - dc/de/d6f/d71/fcd zero size 2024-09-13T21:44:58.638 INFO:tasks.workunit.client.0.smithi119.stdout:6/959: readlink dc/d3d/dcf/l10b 0 2024-09-13T21:44:58.639 INFO:tasks.workunit.client.1.smithi155.stdout:4/513: rmdir d1/d7/de/d15/d55 39 2024-09-13T21:44:58.641 INFO:tasks.workunit.client.0.smithi119.stdout:6/960: symlink dc/df/d41/l136 0 2024-09-13T21:44:58.641 INFO:tasks.workunit.client.1.smithi155.stdout:0/635: truncate d1/d6/dc/d4d/d4a/d52/d5c/f60 5440626 0 2024-09-13T21:44:58.641 INFO:tasks.workunit.client.1.smithi155.stdout:8/545: getdents d2/d1f/d77 0 2024-09-13T21:44:58.643 INFO:tasks.workunit.client.0.smithi119.stdout:6/961: unlink dc/d3d/c50 0 2024-09-13T21:44:58.644 INFO:tasks.workunit.client.1.smithi155.stdout:1/592: creat d6/d15/d23/d55/d6e/dbb/fce x:0 0 0 2024-09-13T21:44:58.644 INFO:tasks.workunit.client.0.smithi119.stdout:4/998: dread d4/f21 [0,4194304] 0 2024-09-13T21:44:58.645 INFO:tasks.workunit.client.0.smithi119.stdout:6/962: fsync dc/d3a/dbb/d7a/de1/dfb/f108 0 2024-09-13T21:44:58.646 INFO:tasks.workunit.client.1.smithi155.stdout:3/616: write d3/d25/d1b/d1f/f92 [1926478,21428] 0 2024-09-13T21:44:58.647 INFO:tasks.workunit.client.0.smithi119.stdout:6/963: fsync dc/d3d/d4e/f74 0 2024-09-13T21:44:58.647 INFO:tasks.workunit.client.1.smithi155.stdout:4/514: truncate d1/d7/de/d15/d55/f62 1670317 0 2024-09-13T21:44:58.648 INFO:tasks.workunit.client.1.smithi155.stdout:1/593: mknod d6/d7/ccf 0 2024-09-13T21:44:58.649 INFO:tasks.workunit.client.0.smithi119.stdout:6/964: symlink dc/dd/l137 0 2024-09-13T21:44:58.650 INFO:tasks.workunit.client.1.smithi155.stdout:1/594: dread - d6/d15/d57/d5d/fcb zero size 2024-09-13T21:44:58.650 INFO:tasks.workunit.client.0.smithi119.stdout:6/965: creat dc/d3a/dbb/d7a/de1/f138 x:0 0 0 2024-09-13T21:44:58.651 INFO:tasks.workunit.client.1.smithi155.stdout:8/546: rename d2/d91/l6f to d2/d8/d75/laa 0 2024-09-13T21:44:58.652 INFO:tasks.workunit.client.1.smithi155.stdout:5/521: rmdir d5/d16 39 2024-09-13T21:44:58.654 INFO:tasks.workunit.client.1.smithi155.stdout:9/641: creat dc/d19/d21/fde x:0 0 0 2024-09-13T21:44:58.655 INFO:tasks.workunit.client.1.smithi155.stdout:9/642: write dc/de/d15/f97 [497412,87159] 0 2024-09-13T21:44:58.656 INFO:tasks.workunit.client.1.smithi155.stdout:0/636: creat d1/d6/dc/ff9 x:0 0 0 2024-09-13T21:44:58.657 INFO:tasks.workunit.client.1.smithi155.stdout:1/595: rmdir d6/d82/d91 39 2024-09-13T21:44:58.657 INFO:tasks.workunit.client.0.smithi119.stdout:6/966: write dc/df/d32/f35 [1931451,124289] 0 2024-09-13T21:44:58.659 INFO:tasks.workunit.client.0.smithi119.stdout:6/967: read dc/df/d6d/fda [6148,14150] 0 2024-09-13T21:44:58.660 INFO:tasks.workunit.client.1.smithi155.stdout:4/515: rename d1/d7/d21/l22 to d1/d7/de/d15/d55/d5e/d66/la0 0 2024-09-13T21:44:58.660 INFO:tasks.workunit.client.1.smithi155.stdout:1/596: read d6/d15/fba [1107888,63537] 0 2024-09-13T21:44:58.661 INFO:tasks.workunit.client.0.smithi119.stdout:4/999: dwrite d4/d1e/d26/d60/dad/dd5/ff1 [0,4194304] 0 2024-09-13T21:44:58.663 INFO:tasks.workunit.client.0.smithi119.stdout:6/968: mkdir dc/d4b/d139 0 2024-09-13T21:44:58.663 INFO:tasks.workunit.client.1.smithi155.stdout:6/677: dwrite db/d11/d1e/f56 [0,4194304] 0 2024-09-13T21:44:58.664 INFO:tasks.workunit.client.1.smithi155.stdout:8/547: write d2/d6/dd/d12/f7d [1239900,53809] 0 2024-09-13T21:44:58.669 INFO:tasks.workunit.client.1.smithi155.stdout:8/548: truncate d2/d6/dd/fa7 1042939 0 2024-09-13T21:44:58.676 INFO:tasks.workunit.client.1.smithi155.stdout:1/597: rename d6/d7/d48/fbd to d6/d15/d57/d5d/fd0 0 2024-09-13T21:44:58.680 INFO:tasks.workunit.client.1.smithi155.stdout:4/516: unlink d1/d7/d21/l94 0 2024-09-13T21:44:58.683 INFO:tasks.workunit.client.1.smithi155.stdout:6/678: fsync db/d11/d6d/db9/d1c/f58 0 2024-09-13T21:44:58.684 INFO:tasks.workunit.client.1.smithi155.stdout:3/617: getdents d3/d21/d2c 0 2024-09-13T21:44:58.685 INFO:tasks.workunit.client.1.smithi155.stdout:1/598: mknod d6/d15/d23/d87/d95/da9/cd1 0 2024-09-13T21:44:58.687 INFO:tasks.workunit.client.0.smithi119.stdout:6/969: truncate dc/d4b/f79 9 0 2024-09-13T21:44:58.689 INFO:tasks.workunit.client.1.smithi155.stdout:0/637: dread d1/d6/dc/d4d/d4a/d4e/f53 [0,4194304] 0 2024-09-13T21:44:58.689 INFO:tasks.workunit.client.1.smithi155.stdout:6/679: mkdir db/d11/d1e/dca/de1 0 2024-09-13T21:44:58.690 INFO:tasks.workunit.client.1.smithi155.stdout:0/638: stat d1/d6/dc/f27 0 2024-09-13T21:44:58.690 INFO:tasks.workunit.client.0.smithi119.stdout:6/970: mknod dc/d3a/dbb/d7a/de8/c13a 0 2024-09-13T21:44:58.691 INFO:tasks.workunit.client.1.smithi155.stdout:0/639: truncate d1/d6/d97/f9b 145492 0 2024-09-13T21:44:58.691 INFO:tasks.workunit.client.1.smithi155.stdout:1/599: rename d6/d15/f37 to d6/d15/d57/d5d/d72/fd2 0 2024-09-13T21:44:58.692 INFO:tasks.workunit.client.1.smithi155.stdout:1/600: fdatasync d6/d15/d57/d99/f4a 0 2024-09-13T21:44:58.692 INFO:tasks.workunit.client.1.smithi155.stdout:8/549: getdents d2/d8 0 2024-09-13T21:44:58.694 INFO:tasks.workunit.client.1.smithi155.stdout:6/680: truncate db/d2c/f59 17385 0 2024-09-13T21:44:58.695 INFO:tasks.workunit.client.0.smithi119.stdout:6/971: dwrite dc/d3d/f8b [0,4194304] 0 2024-09-13T21:44:58.696 INFO:tasks.workunit.client.0.smithi119.stdout:6/972: chown dc/dd/f2e 60 1 2024-09-13T21:44:58.696 INFO:tasks.workunit.client.0.smithi119.stdout:6/973: fsync dc/d3a/dbb/d7a/fc6 0 2024-09-13T21:44:58.697 INFO:tasks.workunit.client.0.smithi119.stdout:6/974: read - dc/d3d/fa0 zero size 2024-09-13T21:44:58.698 INFO:tasks.workunit.client.1.smithi155.stdout:8/550: mknod d2/d95/cab 0 2024-09-13T21:44:58.698 INFO:tasks.workunit.client.0.smithi119.stdout:6/975: fdatasync dc/d3d/d4e/f9b 0 2024-09-13T21:44:58.700 INFO:tasks.workunit.client.1.smithi155.stdout:8/551: chown d2/d6/dd/d12/f66 1 1 2024-09-13T21:44:58.701 INFO:tasks.workunit.client.1.smithi155.stdout:6/681: rename db/d2c/dbc/dc2/f7a to db/d11/d5b/fe2 0 2024-09-13T21:44:58.702 INFO:tasks.workunit.client.1.smithi155.stdout:1/601: dwrite d6/d82/d90/f6c [4194304,4194304] 0 2024-09-13T21:44:58.702 INFO:tasks.workunit.client.0.smithi119.stdout:6/976: rename dc/df/d6d to dc/df/d5c/d13b 0 2024-09-13T21:44:58.703 INFO:tasks.workunit.client.1.smithi155.stdout:8/552: readlink d2/d6/dd/l44 0 2024-09-13T21:44:58.705 INFO:tasks.workunit.client.1.smithi155.stdout:5/522: dread d5/d16/f32 [0,4194304] 0 2024-09-13T21:44:58.706 INFO:tasks.workunit.client.1.smithi155.stdout:3/618: write d3/d25/d1b/d1f/d82/d83/fbe [544221,81114] 0 2024-09-13T21:44:58.709 INFO:tasks.workunit.client.1.smithi155.stdout:1/602: rmdir d6/d7/d48 39 2024-09-13T21:44:58.711 INFO:tasks.workunit.client.1.smithi155.stdout:4/517: dread d1/d7/de/d72/f50 [0,4194304] 0 2024-09-13T21:44:58.712 INFO:tasks.workunit.client.1.smithi155.stdout:6/682: rename db/l50 to db/d2c/dbc/le3 0 2024-09-13T21:44:58.714 INFO:tasks.workunit.client.1.smithi155.stdout:4/518: read d1/d7/d21/f3a [3105953,21263] 0 2024-09-13T21:44:58.715 INFO:tasks.workunit.client.1.smithi155.stdout:1/603: read d6/d7/f8 [601647,52939] 0 2024-09-13T21:44:58.716 INFO:tasks.workunit.client.0.smithi119.stdout:6/977: dread dc/df/f44 [0,4194304] 0 2024-09-13T21:44:58.717 INFO:tasks.workunit.client.1.smithi155.stdout:1/604: stat d6/d15/d23/d55/d6e/dbb/f5b 0 2024-09-13T21:44:58.718 INFO:tasks.workunit.client.0.smithi119.stdout:6/978: read dc/d3a/dbb/d7a/de1/f94 [3992744,14955] 0 2024-09-13T21:44:58.718 INFO:tasks.workunit.client.1.smithi155.stdout:1/605: readlink d6/d15/d57/d99/l44 0 2024-09-13T21:44:58.719 INFO:tasks.workunit.client.0.smithi119.stdout:6/979: symlink dc/d3a/dbb/l13c 0 2024-09-13T21:44:58.720 INFO:tasks.workunit.client.1.smithi155.stdout:6/683: mkdir db/d3d/d5f/de4 0 2024-09-13T21:44:58.720 INFO:tasks.workunit.client.0.smithi119.stdout:6/980: chown dc/d3d/d4e/d91 73 1 2024-09-13T21:44:58.722 INFO:tasks.workunit.client.0.smithi119.stdout:6/981: mkdir dc/df/d64/df4/d121/d75/dbe/d13d 0 2024-09-13T21:44:58.725 INFO:tasks.workunit.client.0.smithi119.stdout:6/982: creat dc/d3a/dbb/d7a/f13e x:0 0 0 2024-09-13T21:44:58.726 INFO:tasks.workunit.client.1.smithi155.stdout:8/553: write d2/d1f/f70 [1180331,80648] 0 2024-09-13T21:44:58.728 INFO:tasks.workunit.client.0.smithi119.stdout:6/983: creat dc/df/d64/df4/d121/d75/dbe/f13f x:0 0 0 2024-09-13T21:44:58.728 INFO:tasks.workunit.client.1.smithi155.stdout:6/684: mknod db/d11/d6d/db9/d1c/d36/d37/db7/ce5 0 2024-09-13T21:44:58.730 INFO:tasks.workunit.client.1.smithi155.stdout:3/619: link d3/d25/l9a d3/d25/d1b/d1f/dc8/ld4 0 2024-09-13T21:44:58.731 INFO:tasks.workunit.client.0.smithi119.stdout:6/984: rename dc/d3d to dc/df/d5c/d13b/d140 0 2024-09-13T21:44:58.734 INFO:tasks.workunit.client.0.smithi119.stdout:6/985: chown dc/df/d5c/d13b/d140/d40/l63 1747 1 2024-09-13T21:44:58.734 INFO:tasks.workunit.client.1.smithi155.stdout:4/519: truncate d1/d7/de/d15/f5b 6552713 0 2024-09-13T21:44:58.736 INFO:tasks.workunit.client.1.smithi155.stdout:1/606: getdents d6/d82/d91/daf 0 2024-09-13T21:44:58.736 INFO:tasks.workunit.client.1.smithi155.stdout:8/554: dwrite d2/d6/dd/d25/f85 [0,4194304] 0 2024-09-13T21:44:58.737 INFO:tasks.workunit.client.0.smithi119.stdout:6/986: link dc/df/d5c/d13b/d140/d4e/f74 dc/d3a/dbb/d7a/d86/f141 0 2024-09-13T21:44:58.738 INFO:tasks.workunit.client.0.smithi119.stdout:6/987: mknod dc/d3a/dbb/d7a/de1/c142 0 2024-09-13T21:44:58.739 INFO:tasks.workunit.client.1.smithi155.stdout:3/620: symlink d3/d25/d17/ld5 0 2024-09-13T21:44:58.739 INFO:tasks.workunit.client.1.smithi155.stdout:5/523: dwrite d5/d16/d33/d1b/d2f/f9b [0,4194304] 0 2024-09-13T21:44:58.740 INFO:tasks.workunit.client.0.smithi119.stdout:6/988: symlink dc/d3a/dbb/l143 0 2024-09-13T21:44:58.740 INFO:tasks.workunit.client.0.smithi119.stdout:6/989: chown dc/df/d65 152639 1 2024-09-13T21:44:58.740 INFO:tasks.workunit.client.0.smithi119.stdout:6/990: chown dc/d3a/dbb/d7a/de1/f11a 16 1 2024-09-13T21:44:58.743 INFO:tasks.workunit.client.0.smithi119.stdout:6/991: chown dc/df/d5c/d13b/d140/d40/d68/fe3 2193882 1 2024-09-13T21:44:58.744 INFO:tasks.workunit.client.1.smithi155.stdout:6/685: dwrite db/d11/d6d/db9/d1c/d36/d46/fd9 [0,4194304] 0 2024-09-13T21:44:58.745 INFO:tasks.workunit.client.1.smithi155.stdout:5/524: chown d5/d16/d33/d1f/fa5 896259290 1 2024-09-13T21:44:58.746 INFO:tasks.workunit.client.1.smithi155.stdout:4/520: creat d1/d7/fa1 x:0 0 0 2024-09-13T21:44:58.749 INFO:tasks.workunit.client.1.smithi155.stdout:1/607: creat d6/d15/d23/d55/db9/fd3 x:0 0 0 2024-09-13T21:44:58.750 INFO:tasks.workunit.client.1.smithi155.stdout:3/621: getdents d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9 0 2024-09-13T21:44:58.751 INFO:tasks.workunit.client.1.smithi155.stdout:5/525: mknod d5/d16/d81/d98/d84/cb0 0 2024-09-13T21:44:58.753 INFO:tasks.workunit.client.1.smithi155.stdout:5/526: read d5/fa [1229271,10996] 0 2024-09-13T21:44:58.753 INFO:tasks.workunit.client.1.smithi155.stdout:1/608: unlink d6/d15/d57/d5d/d72/fd2 0 2024-09-13T21:44:58.756 INFO:tasks.workunit.client.1.smithi155.stdout:6/686: unlink db/d11/d6d/db9/c1d 0 2024-09-13T21:44:58.758 INFO:tasks.workunit.client.1.smithi155.stdout:4/521: dwrite d1/f24 [0,4194304] 0 2024-09-13T21:44:58.758 INFO:tasks.workunit.client.1.smithi155.stdout:3/622: creat d3/fd6 x:0 0 0 2024-09-13T21:44:58.760 INFO:tasks.workunit.client.1.smithi155.stdout:3/623: write d3/d25/d1b/d1f/f30 [1583199,67519] 0 2024-09-13T21:44:58.760 INFO:tasks.workunit.client.1.smithi155.stdout:6/687: chown db/d11/d2b/f72 913 1 2024-09-13T21:44:58.762 INFO:tasks.workunit.client.1.smithi155.stdout:4/522: mkdir d1/d48/da2 0 2024-09-13T21:44:58.766 INFO:tasks.workunit.client.1.smithi155.stdout:1/609: symlink d6/d7/d48/ld4 0 2024-09-13T21:44:58.767 INFO:tasks.workunit.client.1.smithi155.stdout:4/523: write d1/d7/d21/d69/d98/f8b [565176,23368] 0 2024-09-13T21:44:58.771 INFO:tasks.workunit.client.1.smithi155.stdout:3/624: creat d3/d25/d1b/d1f/d36/d5c/d66/fd7 x:0 0 0 2024-09-13T21:44:58.771 INFO:tasks.workunit.client.1.smithi155.stdout:4/524: mknod d1/d7/ca3 0 2024-09-13T21:44:58.772 INFO:tasks.workunit.client.1.smithi155.stdout:6/688: dread db/d11/d6d/db9/d1c/d36/d83/ddd/f6c [0,4194304] 0 2024-09-13T21:44:58.776 INFO:tasks.workunit.client.1.smithi155.stdout:3/625: rmdir d3/d21/d2c/d86 0 2024-09-13T21:44:58.777 INFO:tasks.workunit.client.1.smithi155.stdout:6/689: getdents db/d11/d6d/db9/d1c 0 2024-09-13T21:44:58.779 INFO:tasks.workunit.client.1.smithi155.stdout:3/626: unlink d3/d25/d17/d3b/f95 0 2024-09-13T21:44:58.781 INFO:tasks.workunit.client.1.smithi155.stdout:3/627: write d3/d25/f61 [2637555,24278] 0 2024-09-13T21:44:58.784 INFO:tasks.workunit.client.1.smithi155.stdout:3/628: mkdir d3/d21/d4a/dcd/dd8 0 2024-09-13T21:44:58.786 INFO:tasks.workunit.client.1.smithi155.stdout:6/690: dwrite db/d3d/d5f/f84 [0,4194304] 0 2024-09-13T21:44:58.786 INFO:tasks.workunit.client.1.smithi155.stdout:3/629: chown d3/d21/d2c/f48 3777 1 2024-09-13T21:44:58.788 INFO:tasks.workunit.client.1.smithi155.stdout:6/691: write db/d3d/d5f/f89 [2688482,115676] 0 2024-09-13T21:44:58.791 INFO:tasks.workunit.client.1.smithi155.stdout:5/527: write d5/f49 [5115011,57681] 0 2024-09-13T21:44:58.794 INFO:tasks.workunit.client.1.smithi155.stdout:5/528: truncate d5/d16/d33/d1f/fa5 961394 0 2024-09-13T21:44:58.795 INFO:tasks.workunit.client.1.smithi155.stdout:5/529: write d5/d16/d33/d1b/d2f/d3c/d44/d80/fad [480667,92286] 0 2024-09-13T21:44:58.798 INFO:tasks.workunit.client.1.smithi155.stdout:3/630: link d3/d25/d17/d3b/c44 d3/d25/d1b/d1f/d36/d5c/cd9 0 2024-09-13T21:44:58.798 INFO:tasks.workunit.client.1.smithi155.stdout:5/530: truncate d5/d16/d33/d1b/d2f/fa6 935642 0 2024-09-13T21:44:58.803 INFO:tasks.workunit.client.1.smithi155.stdout:4/525: dwrite d1/d7/d21/d69/d98/f85 [0,4194304] 0 2024-09-13T21:44:58.806 INFO:tasks.workunit.client.1.smithi155.stdout:4/526: symlink d1/d7/d21/d2d/la4 0 2024-09-13T21:44:58.807 INFO:tasks.workunit.client.1.smithi155.stdout:5/531: link d5/d16/d33/d1b/d59/c66 d5/d16/d33/d1b/d2f/d3c/d6c/d45/cb1 0 2024-09-13T21:44:58.808 INFO:tasks.workunit.client.1.smithi155.stdout:4/527: readlink d1/d7/de/d15/d55/d5e/l60 0 2024-09-13T21:44:58.810 INFO:tasks.workunit.client.1.smithi155.stdout:4/528: mknod d1/d7/d21/d2d/ca5 0 2024-09-13T21:44:58.811 INFO:tasks.workunit.client.1.smithi155.stdout:5/532: rmdir d5/d16/d33/d1b/d2f/d73 0 2024-09-13T21:44:58.813 INFO:tasks.workunit.client.1.smithi155.stdout:5/533: creat d5/d16/d33/d1b/d2f/d3c/d44/d29/fb2 x:0 0 0 2024-09-13T21:44:58.815 INFO:tasks.workunit.client.1.smithi155.stdout:4/529: dread d1/d48/f99 [4194304,4194304] 0 2024-09-13T21:44:58.816 INFO:tasks.workunit.client.1.smithi155.stdout:5/534: getdents d5/d16/d33/d1b/d2f/d3c/d44 0 2024-09-13T21:44:58.818 INFO:tasks.workunit.client.1.smithi155.stdout:5/535: creat d5/d16/d33/d1b/d2f/fb3 x:0 0 0 2024-09-13T21:44:58.820 INFO:tasks.workunit.client.1.smithi155.stdout:4/530: rename d1/d48/da2 to d1/d7/de/d72/da6 0 2024-09-13T21:44:58.820 INFO:tasks.workunit.client.1.smithi155.stdout:5/536: mkdir d5/d16/db4 0 2024-09-13T21:44:58.821 INFO:tasks.workunit.client.1.smithi155.stdout:4/531: write d1/d7/de/dc/d4a/f76 [977060,15153] 0 2024-09-13T21:44:58.822 INFO:tasks.workunit.client.1.smithi155.stdout:5/537: chown d5/d16/d33/d1b/d2f/d3c/d6c/d45 60337929 1 2024-09-13T21:44:58.827 INFO:tasks.workunit.client.1.smithi155.stdout:4/532: dwrite d1/d7/de/d15/d55/d5e/f5f [0,4194304] 0 2024-09-13T21:44:58.881 INFO:tasks.workunit.client.1.smithi155.stdout:6/692: dwrite db/d11/d6d/db9/d1c/d36/d83/ddd/f54 [0,4194304] 0 2024-09-13T21:44:58.888 INFO:tasks.workunit.client.1.smithi155.stdout:6/693: rename db/d3d to db/d11/d6d/db9/de6 0 2024-09-13T21:44:58.891 INFO:tasks.workunit.client.1.smithi155.stdout:3/631: dwrite d3/d25/d17/d3b/f50 [0,4194304] 0 2024-09-13T21:44:58.894 INFO:tasks.workunit.client.1.smithi155.stdout:3/632: write d3/d25/d1b/d1f/d82/d83/f8a [361140,86339] 0 2024-09-13T21:44:58.894 INFO:tasks.workunit.client.1.smithi155.stdout:6/694: mknod db/d11/d86/ce7 0 2024-09-13T21:44:58.895 INFO:tasks.workunit.client.1.smithi155.stdout:6/695: write db/d2c/f79 [194337,109152] 0 2024-09-13T21:44:58.899 INFO:tasks.workunit.client.1.smithi155.stdout:4/533: write d1/d7/de/d15/d55/d5e/d66/f6c [179718,36130] 0 2024-09-13T21:44:58.901 INFO:tasks.workunit.client.1.smithi155.stdout:6/696: creat db/d11/d1e/d21/d44/daa/fe8 x:0 0 0 2024-09-13T21:44:58.903 INFO:tasks.workunit.client.1.smithi155.stdout:6/697: dread - db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d88/fde zero size 2024-09-13T21:44:58.903 INFO:tasks.workunit.client.1.smithi155.stdout:4/534: fdatasync d1/d7/d21/d2d/d42/f4d 0 2024-09-13T21:44:58.908 INFO:tasks.workunit.client.1.smithi155.stdout:6/698: fsync db/d11/d6d/db9/f1a 0 2024-09-13T21:44:58.909 INFO:tasks.workunit.client.1.smithi155.stdout:5/538: dread d5/d16/d33/d1b/d28/fa4 [0,4194304] 0 2024-09-13T21:44:58.911 INFO:tasks.workunit.client.1.smithi155.stdout:3/633: dwrite d3/d25/d17/f27 [0,4194304] 0 2024-09-13T21:44:58.913 INFO:tasks.workunit.client.1.smithi155.stdout:6/699: unlink db/d11/l31 0 2024-09-13T21:44:58.913 INFO:tasks.workunit.client.1.smithi155.stdout:6/700: chown db/d2c/dbc 3031 1 2024-09-13T21:44:58.915 INFO:tasks.workunit.client.1.smithi155.stdout:4/535: link d1/d7/de/d1a/c4e d1/ca7 0 2024-09-13T21:44:58.916 INFO:tasks.workunit.client.1.smithi155.stdout:5/539: creat d5/d16/d33/d1b/d59/fb5 x:0 0 0 2024-09-13T21:44:58.918 INFO:tasks.workunit.client.1.smithi155.stdout:3/634: write d3/d25/d1b/d1f/d36/d5c/d66/f88 [2387114,52022] 0 2024-09-13T21:44:58.919 INFO:tasks.workunit.client.1.smithi155.stdout:6/701: rename db/d11/d2b/d35/c75 to db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/ce9 0 2024-09-13T21:44:58.921 INFO:tasks.workunit.client.1.smithi155.stdout:6/702: dread - db/d11/d6d/db9/d1c/d36/d83/fd6 zero size 2024-09-13T21:44:58.922 INFO:tasks.workunit.client.1.smithi155.stdout:3/635: stat d3/d25/d1b/d1f/d36/cad 0 2024-09-13T21:44:58.922 INFO:tasks.workunit.client.1.smithi155.stdout:6/703: chown db/d11/d2b/d35 1402894 1 2024-09-13T21:44:58.923 INFO:tasks.workunit.client.1.smithi155.stdout:3/636: stat d3/d25/d1b/d1f/d36/d5c/fb9 0 2024-09-13T21:44:58.926 INFO:tasks.workunit.client.1.smithi155.stdout:3/637: symlink d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/lda 0 2024-09-13T21:44:58.928 INFO:tasks.workunit.client.1.smithi155.stdout:6/704: link db/d11/d6d/db9/d1c/d36/d46/c70 db/d11/d6d/db9/d1c/d36/d83/ddd/cea 0 2024-09-13T21:44:58.929 INFO:tasks.workunit.client.1.smithi155.stdout:6/705: stat db/d11/d6d/db9/d1c/f6e 0 2024-09-13T21:44:58.930 INFO:tasks.workunit.client.1.smithi155.stdout:3/638: rmdir d3/d25/d1b/d1f/d82 39 2024-09-13T21:44:58.936 INFO:tasks.workunit.client.1.smithi155.stdout:6/706: dwrite db/f1f [0,4194304] 0 2024-09-13T21:44:58.940 INFO:tasks.workunit.client.1.smithi155.stdout:5/540: dwrite d5/d16/d33/d1b/d2f/d3c/d44/f42 [0,4194304] 0 2024-09-13T21:44:58.942 INFO:tasks.workunit.client.1.smithi155.stdout:6/707: mkdir db/d11/d5b/deb 0 2024-09-13T21:44:58.946 INFO:tasks.workunit.client.1.smithi155.stdout:3/639: dwrite d3/d25/d1b/fc5 [0,4194304] 0 2024-09-13T21:44:58.947 INFO:tasks.workunit.client.1.smithi155.stdout:2/568: sync 2024-09-13T21:44:58.948 INFO:tasks.workunit.client.0.smithi119.stdout:2/917: sync 2024-09-13T21:44:58.948 INFO:tasks.workunit.client.0.smithi119.stdout:6/992: sync 2024-09-13T21:44:58.948 INFO:tasks.workunit.client.0.smithi119.stdout:1/884: sync 2024-09-13T21:44:58.952 INFO:tasks.workunit.client.1.smithi155.stdout:3/640: chown d3/d25/d17/d3b/c7e 839 1 2024-09-13T21:44:58.952 INFO:tasks.workunit.client.0.smithi119.stdout:6/993: creat dc/df/d5c/d13b/d140/d40/d6b/f144 x:0 0 0 2024-09-13T21:44:58.952 INFO:tasks.workunit.client.0.smithi119.stdout:6/994: chown dc/d3a/dbb/l87 1731720022 1 2024-09-13T21:44:58.954 INFO:tasks.workunit.client.1.smithi155.stdout:6/708: creat db/d11/d1e/d21/fec x:0 0 0 2024-09-13T21:44:58.954 INFO:tasks.workunit.client.0.smithi119.stdout:6/995: rmdir dc/df/d41 39 2024-09-13T21:44:58.955 INFO:tasks.workunit.client.0.smithi119.stdout:1/885: link d1/d3/d61/d77/d78/c5b d1/d3/d61/d77/d78/db8/c12a 0 2024-09-13T21:44:58.956 INFO:tasks.workunit.client.0.smithi119.stdout:6/996: chown dc/df/d5c/d13b/d140/d40/d68/fcc 250556862 1 2024-09-13T21:44:58.956 INFO:tasks.workunit.client.1.smithi155.stdout:2/569: dread d2/dd/de/d15/f46 [0,4194304] 0 2024-09-13T21:44:58.956 INFO:tasks.workunit.client.1.smithi155.stdout:5/541: mkdir d5/d16/d33/d1b/db6 0 2024-09-13T21:44:58.958 INFO:tasks.workunit.client.0.smithi119.stdout:1/886: creat d1/d3/d61/d77/d78/d32/dda/d19/d2d/d59/f12b x:0 0 0 2024-09-13T21:44:58.959 INFO:tasks.workunit.client.1.smithi155.stdout:3/641: mkdir d3/d25/d1b/d1f/d36/d5c/ddb 0 2024-09-13T21:44:58.960 INFO:tasks.workunit.client.1.smithi155.stdout:3/642: fdatasync d3/d10/f46 0 2024-09-13T21:44:58.961 INFO:tasks.workunit.client.0.smithi119.stdout:6/997: getdents dc/df/d32 0 2024-09-13T21:44:58.961 INFO:tasks.workunit.client.1.smithi155.stdout:2/570: symlink d2/dd/d21/d39/dc1/d66/d7c/lca 0 2024-09-13T21:44:58.962 INFO:tasks.workunit.client.0.smithi119.stdout:6/998: mknod dc/d4b/d97/c145 0 2024-09-13T21:44:58.962 INFO:tasks.workunit.client.1.smithi155.stdout:6/709: creat db/d11/d6d/db9/d1c/d36/d46/dda/fed x:0 0 0 2024-09-13T21:44:58.965 INFO:tasks.workunit.client.1.smithi155.stdout:2/571: creat d2/db/fcb x:0 0 0 2024-09-13T21:44:58.966 INFO:tasks.workunit.client.1.smithi155.stdout:5/542: dread d5/d16/d33/d1b/d59/f8a [0,4194304] 0 2024-09-13T21:44:58.967 INFO:tasks.workunit.client.0.smithi119.stdout:6/999: dwrite dc/df/d5c/d13b/d140/d40/d6b/f70 [4194304,4194304] 0 2024-09-13T21:44:58.968 INFO:tasks.workunit.client.1.smithi155.stdout:5/543: fdatasync d5/d16/d4e/f58 0 2024-09-13T21:44:58.968 INFO:tasks.workunit.client.1.smithi155.stdout:3/643: dwrite d3/d25/d1b/d1f/f92 [0,4194304] 0 2024-09-13T21:44:58.974 INFO:tasks.workunit.client.1.smithi155.stdout:5/544: chown d5/d16/d33/d1b/d1e/f50 77 1 2024-09-13T21:44:58.974 INFO:tasks.workunit.client.1.smithi155.stdout:3/644: fdatasync d3/d25/d1b/d1f/d36/d7c/f9e 0 2024-09-13T21:44:58.980 INFO:tasks.workunit.client.1.smithi155.stdout:3/645: creat d3/d21/d4a/dcd/dd8/fdc x:0 0 0 2024-09-13T21:44:58.982 INFO:tasks.workunit.client.1.smithi155.stdout:6/710: rename db/d11/d6d/db9/d1c/d36/d46 to db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee 0 2024-09-13T21:44:58.982 INFO:tasks.workunit.client.0.smithi119.stdout:2/918: write d1/d22/d55/d31/fbe [1314656,113339] 0 2024-09-13T21:44:58.984 INFO:tasks.workunit.client.1.smithi155.stdout:5/545: dwrite d5/d16/d33/d1b/d1e/f4c [4194304,4194304] 0 2024-09-13T21:44:58.984 INFO:tasks.workunit.client.0.smithi119.stdout:2/919: creat d1/d38/d89/d6b/d8c/f124 x:0 0 0 2024-09-13T21:44:58.985 INFO:tasks.workunit.client.0.smithi119.stdout:2/920: write d1/d7/d47/fea [591396,74293] 0 2024-09-13T21:44:58.986 INFO:tasks.workunit.client.1.smithi155.stdout:6/711: dread db/d2c/f59 [0,4194304] 0 2024-09-13T21:44:58.987 INFO:tasks.workunit.client.1.smithi155.stdout:5/546: chown d5/d16/d33/d1b/d28/c71 96 1 2024-09-13T21:44:58.987 INFO:tasks.workunit.client.0.smithi119.stdout:2/921: fdatasync d1/d22/fc0 0 2024-09-13T21:44:58.989 INFO:tasks.workunit.client.0.smithi119.stdout:2/922: rmdir d1/d22/d5a/d5d/d77 39 2024-09-13T21:44:58.991 INFO:tasks.workunit.client.0.smithi119.stdout:2/923: symlink d1/d9d/l125 0 2024-09-13T21:44:58.992 INFO:tasks.workunit.client.1.smithi155.stdout:5/547: rmdir d5/d16/d33/d1b/d28 39 2024-09-13T21:44:58.997 INFO:tasks.workunit.client.1.smithi155.stdout:3/646: write d3/d25/d17/f76 [555761,128752] 0 2024-09-13T21:44:58.997 INFO:tasks.workunit.client.1.smithi155.stdout:2/572: truncate d2/db/f40 952333 0 2024-09-13T21:44:58.998 INFO:tasks.workunit.client.1.smithi155.stdout:6/712: dwrite db/d11/d6d/db9/de6/d5f/f84 [4194304,4194304] 0 2024-09-13T21:44:59.000 INFO:tasks.workunit.client.1.smithi155.stdout:2/573: dread - d2/dd/de/f55 zero size 2024-09-13T21:44:59.001 INFO:tasks.workunit.client.1.smithi155.stdout:3/647: chown d3/d21/d4a/l79 0 1 2024-09-13T21:44:59.003 INFO:tasks.workunit.client.1.smithi155.stdout:5/548: link d5/d16/d33/f6f d5/fb7 0 2024-09-13T21:44:59.005 INFO:tasks.workunit.client.1.smithi155.stdout:2/574: chown d2/dd/d21/d39/dc1/da3/cb7 2464590 1 2024-09-13T21:44:59.006 INFO:tasks.workunit.client.1.smithi155.stdout:6/713: chown db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/f68 3727 1 2024-09-13T21:44:59.006 INFO:tasks.workunit.client.1.smithi155.stdout:5/549: write d5/d16/d33/d1b/d2f/f9b [112663,98148] 0 2024-09-13T21:44:59.008 INFO:tasks.workunit.client.1.smithi155.stdout:3/648: unlink d3/d21/d2c/fd1 0 2024-09-13T21:44:59.009 INFO:tasks.workunit.client.1.smithi155.stdout:6/714: mknod db/d11/d6d/db9/d1c/d36/d37/cef 0 2024-09-13T21:44:59.010 INFO:tasks.workunit.client.1.smithi155.stdout:2/575: write d2/db/f25 [3128799,115906] 0 2024-09-13T21:44:59.010 INFO:tasks.workunit.client.1.smithi155.stdout:5/550: mkdir d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/db8 0 2024-09-13T21:44:59.010 INFO:tasks.workunit.client.0.smithi119.stdout:1/887: dread d1/d3/fd6 [0,4194304] 0 2024-09-13T21:44:59.011 INFO:tasks.workunit.client.1.smithi155.stdout:3/649: symlink d3/d25/d1b/d90/ldd 0 2024-09-13T21:44:59.012 INFO:tasks.workunit.client.0.smithi119.stdout:2/924: dwrite d1/f4a [4194304,4194304] 0 2024-09-13T21:44:59.013 INFO:tasks.workunit.client.0.smithi119.stdout:1/888: stat d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9d/cc6 0 2024-09-13T21:44:59.013 INFO:tasks.workunit.client.1.smithi155.stdout:3/650: truncate d3/dbb/fbd 815418 0 2024-09-13T21:44:59.015 INFO:tasks.workunit.client.1.smithi155.stdout:3/651: dread - d3/d21/d4a/dcd/fcf zero size 2024-09-13T21:44:59.016 INFO:tasks.workunit.client.0.smithi119.stdout:1/889: mknod d1/d3/d61/d77/da6/db3/c12c 0 2024-09-13T21:44:59.016 INFO:tasks.workunit.client.1.smithi155.stdout:6/715: creat db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/ff0 x:0 0 0 2024-09-13T21:44:59.018 INFO:tasks.workunit.client.0.smithi119.stdout:2/925: unlink d1/d22/d5a/d5d/d77/daa/deb/c10e 0 2024-09-13T21:44:59.019 INFO:tasks.workunit.client.0.smithi119.stdout:1/890: symlink d1/d3/d61/d77/d78/l12d 0 2024-09-13T21:44:59.020 INFO:tasks.workunit.client.1.smithi155.stdout:5/551: mknod d5/d16/d33/d1b/d28/d52/cb9 0 2024-09-13T21:44:59.020 INFO:tasks.workunit.client.1.smithi155.stdout:2/576: dwrite d2/db/f4b [0,4194304] 0 2024-09-13T21:44:59.022 INFO:tasks.workunit.client.0.smithi119.stdout:1/891: mknod d1/d3/d61/d7e/d53/ddf/d104/c12e 0 2024-09-13T21:44:59.026 INFO:tasks.workunit.client.1.smithi155.stdout:3/652: creat d3/d25/d1b/d1f/d36/d5c/dba/fde x:0 0 0 2024-09-13T21:44:59.026 INFO:tasks.workunit.client.1.smithi155.stdout:6/716: truncate db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/dda/fdc 952312 0 2024-09-13T21:44:59.029 INFO:tasks.workunit.client.1.smithi155.stdout:3/653: dread - d3/d21/fa3 zero size 2024-09-13T21:44:59.031 INFO:tasks.workunit.client.1.smithi155.stdout:6/717: chown db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/ce9 12 1 2024-09-13T21:44:59.032 INFO:tasks.workunit.client.1.smithi155.stdout:3/654: mknod d3/d25/d1b/d1f/d36/d5c/d66/db3/cdf 0 2024-09-13T21:44:59.033 INFO:tasks.workunit.client.1.smithi155.stdout:6/718: symlink db/d11/d1e/lf1 0 2024-09-13T21:44:59.035 INFO:tasks.workunit.client.1.smithi155.stdout:6/719: chown db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/lbf 123262632 1 2024-09-13T21:44:59.036 INFO:tasks.workunit.client.1.smithi155.stdout:6/720: dread - db/d11/d5b/f78 zero size 2024-09-13T21:44:59.038 INFO:tasks.workunit.client.1.smithi155.stdout:5/552: write d5/d16/d4e/d85/fa2 [961603,119861] 0 2024-09-13T21:44:59.040 INFO:tasks.workunit.client.1.smithi155.stdout:5/553: chown d5/d16/d33/d1b/d2f/d3c/d6c/f76 316 1 2024-09-13T21:44:59.041 INFO:tasks.workunit.client.1.smithi155.stdout:6/721: write db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d88/fde [414135,61557] 0 2024-09-13T21:44:59.042 INFO:tasks.workunit.client.1.smithi155.stdout:5/554: fsync d5/f8 0 2024-09-13T21:44:59.046 INFO:tasks.workunit.client.0.smithi119.stdout:1/892: dread d1/d3/d61/f85 [0,4194304] 0 2024-09-13T21:44:59.046 INFO:tasks.workunit.client.1.smithi155.stdout:5/555: creat d5/d16/d4e/fba x:0 0 0 2024-09-13T21:44:59.047 INFO:tasks.workunit.client.1.smithi155.stdout:6/722: rename db/d11/d6d/db9/d1c/d36/d83/ddd/f54 to db/d11/d1e/dca/de1/ff2 0 2024-09-13T21:44:59.048 INFO:tasks.workunit.client.0.smithi119.stdout:1/893: mknod d1/d3/d61/d77/d78/d32/dda/d28/d110/c12f 0 2024-09-13T21:44:59.049 INFO:tasks.workunit.client.1.smithi155.stdout:2/577: dread d2/dd/d21/d39/dc1/f3e [0,4194304] 0 2024-09-13T21:44:59.050 INFO:tasks.workunit.client.1.smithi155.stdout:3/655: dread d3/d21/d4a/f73 [0,4194304] 0 2024-09-13T21:44:59.051 INFO:tasks.workunit.client.1.smithi155.stdout:5/556: mknod d5/d16/db4/cbb 0 2024-09-13T21:44:59.053 INFO:tasks.workunit.client.1.smithi155.stdout:2/578: mkdir d2/dd/d21/d39/dc1/da3/dcc 0 2024-09-13T21:44:59.054 INFO:tasks.workunit.client.1.smithi155.stdout:5/557: read d5/f8 [3120996,17564] 0 2024-09-13T21:44:59.057 INFO:tasks.workunit.client.1.smithi155.stdout:3/656: link d3/d10/f46 d3/d10/fe0 0 2024-09-13T21:44:59.057 INFO:tasks.workunit.client.1.smithi155.stdout:6/723: dwrite db/d11/d1e/d21/f4d [0,4194304] 0 2024-09-13T21:44:59.058 INFO:tasks.workunit.client.1.smithi155.stdout:5/558: rmdir d5/d16/d33/d1b 39 2024-09-13T21:44:59.058 INFO:tasks.workunit.client.1.smithi155.stdout:3/657: fsync d3/d25/f94 0 2024-09-13T21:44:59.059 INFO:tasks.workunit.client.1.smithi155.stdout:2/579: symlink d2/dd/d21/d39/dc1/d96/lcd 0 2024-09-13T21:44:59.059 INFO:tasks.workunit.client.0.smithi119.stdout:1/894: dread d1/d3/f13 [4194304,4194304] 0 2024-09-13T21:44:59.061 INFO:tasks.workunit.client.1.smithi155.stdout:3/658: chown d3/d25/d17/ld5 0 1 2024-09-13T21:44:59.062 INFO:tasks.workunit.client.1.smithi155.stdout:5/559: chown d5/d16/d33/d1b/d2f/caa 57314 1 2024-09-13T21:44:59.062 INFO:tasks.workunit.client.0.smithi119.stdout:1/895: mkdir d1/d3/d61/d77/d78/d32/d33/d43/d130 0 2024-09-13T21:44:59.063 INFO:tasks.workunit.client.1.smithi155.stdout:5/560: stat d5/f47 0 2024-09-13T21:44:59.063 INFO:tasks.workunit.client.1.smithi155.stdout:2/580: write d2/dd/d21/d39/dc1/d66/d6f/fa9 [871655,40661] 0 2024-09-13T21:44:59.064 INFO:tasks.workunit.client.0.smithi119.stdout:1/896: chown d1/d3/d61/d77/d78/d32/dda/d19/d2d/l100 105485152 1 2024-09-13T21:44:59.070 INFO:tasks.workunit.client.1.smithi155.stdout:3/659: truncate d3/d25/d1b/d1f/d82/d83/f9b 4832289 0 2024-09-13T21:44:59.071 INFO:tasks.workunit.client.0.smithi119.stdout:1/897: dwrite d1/d3/f2b [0,4194304] 0 2024-09-13T21:44:59.073 INFO:tasks.workunit.client.1.smithi155.stdout:3/660: creat d3/d25/d1b/d90/fe1 x:0 0 0 2024-09-13T21:44:59.074 INFO:tasks.workunit.client.0.smithi119.stdout:1/898: creat d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9d/f131 x:0 0 0 2024-09-13T21:44:59.074 INFO:tasks.workunit.client.1.smithi155.stdout:6/724: dwrite db/d11/d1e/d21/d44/daa/fe8 [0,4194304] 0 2024-09-13T21:44:59.075 INFO:tasks.workunit.client.0.smithi119.stdout:1/899: fsync d1/d3/d61/d7e/d53/ddf/d117/f125 0 2024-09-13T21:44:59.075 INFO:tasks.workunit.client.1.smithi155.stdout:2/581: rmdir d2/dd/d21/d39/dc1/da3/dcc 0 2024-09-13T21:44:59.076 INFO:tasks.workunit.client.0.smithi119.stdout:1/900: creat d1/d3/d61/d77/d78/d32/d33/d43/d74/f132 x:0 0 0 2024-09-13T21:44:59.079 INFO:tasks.workunit.client.0.smithi119.stdout:1/901: creat d1/d3/d6c/da8/f133 x:0 0 0 2024-09-13T21:44:59.079 INFO:tasks.workunit.client.1.smithi155.stdout:5/561: dwrite d5/d16/d33/d1b/d2f/f9b [0,4194304] 0 2024-09-13T21:44:59.081 INFO:tasks.workunit.client.0.smithi119.stdout:1/902: creat d1/d3/d61/d77/d78/d32/d33/dd0/f134 x:0 0 0 2024-09-13T21:44:59.083 INFO:tasks.workunit.client.1.smithi155.stdout:5/562: chown d5/d16/d33/d1b/d2f/d3c/d44/d29/fb2 50 1 2024-09-13T21:44:59.084 INFO:tasks.workunit.client.1.smithi155.stdout:6/725: truncate db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/dda/fed 988254 0 2024-09-13T21:44:59.085 INFO:tasks.workunit.client.1.smithi155.stdout:2/582: mkdir d2/dd/de/d15/d38/d41/d5f/d70/dce 0 2024-09-13T21:44:59.087 INFO:tasks.workunit.client.1.smithi155.stdout:3/661: rename d3/d21/d4a/f73 to d3/d25/d1b/d1f/d36/d5c/d66/db3/fe2 0 2024-09-13T21:44:59.092 INFO:tasks.workunit.client.1.smithi155.stdout:3/662: unlink d3/d10/l6b 0 2024-09-13T21:44:59.095 INFO:tasks.workunit.client.1.smithi155.stdout:5/563: dwrite d5/f6 [0,4194304] 0 2024-09-13T21:44:59.097 INFO:tasks.workunit.client.1.smithi155.stdout:2/583: link d2/c7 d2/dd/d3d/ccf 0 2024-09-13T21:44:59.097 INFO:tasks.workunit.client.1.smithi155.stdout:6/726: dwrite db/d11/d1e/d21/d44/daa/fe8 [0,4194304] 0 2024-09-13T21:44:59.099 INFO:tasks.workunit.client.1.smithi155.stdout:3/663: rename d3/d25/f5e to d3/d21/d4a/fe3 0 2024-09-13T21:44:59.101 INFO:tasks.workunit.client.1.smithi155.stdout:5/564: write d5/d16/f32 [1692141,14648] 0 2024-09-13T21:44:59.102 INFO:tasks.workunit.client.1.smithi155.stdout:5/565: stat d5/d16/d33/d1b/d28/d52/f7b 0 2024-09-13T21:44:59.103 INFO:tasks.workunit.client.1.smithi155.stdout:6/727: creat db/d11/d6d/db9/de6/d5f/ff3 x:0 0 0 2024-09-13T21:44:59.105 INFO:tasks.workunit.client.1.smithi155.stdout:6/728: write db/f10 [8223086,129770] 0 2024-09-13T21:44:59.109 INFO:tasks.workunit.client.1.smithi155.stdout:6/729: creat db/d2c/ff4 x:0 0 0 2024-09-13T21:44:59.109 INFO:tasks.workunit.client.1.smithi155.stdout:5/566: dread d5/d16/f2a [4194304,4194304] 0 2024-09-13T21:44:59.113 INFO:tasks.workunit.client.1.smithi155.stdout:6/730: creat db/d2c/dc0/ff5 x:0 0 0 2024-09-13T21:44:59.116 INFO:tasks.workunit.client.1.smithi155.stdout:5/567: rename d5/d16/d33/d1b/d2f/d3c/d44/d29/fb2 to d5/d16/d33/d1b/d92/fbc 0 2024-09-13T21:44:59.117 INFO:tasks.workunit.client.1.smithi155.stdout:6/731: write db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/ff0 [440315,33353] 0 2024-09-13T21:44:59.120 INFO:tasks.workunit.client.1.smithi155.stdout:2/584: dread f0 [0,4194304] 0 2024-09-13T21:44:59.121 INFO:tasks.workunit.client.1.smithi155.stdout:5/568: creat d5/d16/d33/d1b/d2f/d3c/d5b/fbd x:0 0 0 2024-09-13T21:44:59.122 INFO:tasks.workunit.client.1.smithi155.stdout:2/585: stat d2/l3 0 2024-09-13T21:44:59.125 INFO:tasks.workunit.client.1.smithi155.stdout:5/569: mknod d5/d16/d33/d1b/d2f/d3c/cbe 0 2024-09-13T21:44:59.127 INFO:tasks.workunit.client.1.smithi155.stdout:5/570: write d5/d16/d4e/fba [856939,124205] 0 2024-09-13T21:44:59.128 INFO:tasks.workunit.client.1.smithi155.stdout:3/664: dwrite d3/d25/d1b/d1f/f49 [0,4194304] 0 2024-09-13T21:44:59.130 INFO:tasks.workunit.client.1.smithi155.stdout:6/732: truncate db/f2f 422857 0 2024-09-13T21:44:59.131 INFO:tasks.workunit.client.1.smithi155.stdout:3/665: chown d3/d25/d1b/d1f/fb1 8143124 1 2024-09-13T21:44:59.131 INFO:tasks.workunit.client.1.smithi155.stdout:5/571: symlink d5/d16/d81/d98/d84/lbf 0 2024-09-13T21:44:59.133 INFO:tasks.workunit.client.1.smithi155.stdout:6/733: read - db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/d93/fa2 zero size 2024-09-13T21:44:59.133 INFO:tasks.workunit.client.1.smithi155.stdout:5/572: dread - d5/d16/d33/d1b/d2f/d3c/d6c/f79 zero size 2024-09-13T21:44:59.135 INFO:tasks.workunit.client.1.smithi155.stdout:3/666: getdents d3/d21/d4a 0 2024-09-13T21:44:59.136 INFO:tasks.workunit.client.0.smithi119.stdout:1/903: dread d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/f7f [0,4194304] 0 2024-09-13T21:44:59.137 INFO:tasks.workunit.client.1.smithi155.stdout:6/734: mkdir db/d11/d2b/df6 0 2024-09-13T21:44:59.138 INFO:tasks.workunit.client.0.smithi119.stdout:1/904: mknod d1/d3/d61/d77/d78/d32/dc3/c135 0 2024-09-13T21:44:59.139 INFO:tasks.workunit.client.0.smithi119.stdout:1/905: dread - d1/d3/d61/d77/d78/d32/dda/d19/f108 zero size 2024-09-13T21:44:59.141 INFO:tasks.workunit.client.0.smithi119.stdout:1/906: fsync d1/d3/d61/d77/d78/d32/dc3/f114 0 2024-09-13T21:44:59.141 INFO:tasks.workunit.client.1.smithi155.stdout:7/543: sync 2024-09-13T21:44:59.142 INFO:tasks.workunit.client.0.smithi119.stdout:1/907: dread - d1/d3/dc/d24/fc1 zero size 2024-09-13T21:44:59.142 INFO:tasks.workunit.client.1.smithi155.stdout:3/667: rename d3/d25/d17/cb6 to d3/d25/ce4 0 2024-09-13T21:44:59.143 INFO:tasks.workunit.client.1.smithi155.stdout:3/668: readlink d3/d25/l9a 0 2024-09-13T21:44:59.144 INFO:tasks.workunit.client.1.smithi155.stdout:5/573: dread d5/d16/d33/d1b/d2f/d3c/f41 [0,4194304] 0 2024-09-13T21:44:59.145 INFO:tasks.workunit.client.1.smithi155.stdout:5/574: readlink d5/d16/d33/d1b/d92/l9a 0 2024-09-13T21:44:59.145 INFO:tasks.workunit.client.1.smithi155.stdout:7/544: creat d5/df/d15/fa8 x:0 0 0 2024-09-13T21:44:59.146 INFO:tasks.workunit.client.0.smithi119.stdout:1/908: getdents d1/d3/d61/d77/d78/d32/dda/d19/d2d 0 2024-09-13T21:44:59.148 INFO:tasks.workunit.client.1.smithi155.stdout:5/575: chown d5/d16/d33/d1b/d2f/d3c/d6c/f76 183 1 2024-09-13T21:44:59.149 INFO:tasks.workunit.client.0.smithi119.stdout:1/909: getdents d1/d3/d61/d7e/d53/ddf 0 2024-09-13T21:44:59.151 INFO:tasks.workunit.client.0.smithi119.stdout:1/910: rmdir d1/d3/d61/d77/d78/d32/d33/d72/db4/dc9/df4 39 2024-09-13T21:44:59.153 INFO:tasks.workunit.client.1.smithi155.stdout:7/545: creat d5/d13/d99/fa9 x:0 0 0 2024-09-13T21:44:59.155 INFO:tasks.workunit.client.1.smithi155.stdout:3/669: truncate d3/d25/d1b/d1f/d36/d5c/d66/f88 2511981 0 2024-09-13T21:44:59.157 INFO:tasks.workunit.client.0.smithi119.stdout:1/911: dread d1/d3/d61/d77/d78/d32/d33/d43/f5e [0,4194304] 0 2024-09-13T21:44:59.159 INFO:tasks.workunit.client.0.smithi119.stdout:1/912: fsync d1/d3/f13 0 2024-09-13T21:44:59.159 INFO:tasks.workunit.client.1.smithi155.stdout:5/576: dwrite d5/d16/d33/d1b/d28/f60 [0,4194304] 0 2024-09-13T21:44:59.159 INFO:tasks.workunit.client.0.smithi119.stdout:1/913: dread - d1/d3/d61/d77/d78/db8/dde/f11f zero size 2024-09-13T21:44:59.163 INFO:tasks.workunit.client.0.smithi119.stdout:1/914: link d1/d3/d61/d77/d78/d32/dda/d3d/cfd d1/d3/d61/d77/d78/d32/dda/d28/d110/c136 0 2024-09-13T21:44:59.165 INFO:tasks.workunit.client.1.smithi155.stdout:6/735: dwrite db/d11/d2b/f72 [0,4194304] 0 2024-09-13T21:44:59.170 INFO:tasks.workunit.client.1.smithi155.stdout:7/546: dwrite d5/df/d79/f92 [0,4194304] 0 2024-09-13T21:44:59.171 INFO:tasks.workunit.client.0.smithi119.stdout:2/926: sync 2024-09-13T21:44:59.171 INFO:tasks.workunit.client.1.smithi155.stdout:3/670: getdents d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9 0 2024-09-13T21:44:59.171 INFO:tasks.workunit.client.1.smithi155.stdout:5/577: truncate d5/d16/d33/d1b/d2f/d3c/d6c/f77 985038 0 2024-09-13T21:44:59.172 INFO:tasks.workunit.client.0.smithi119.stdout:2/927: write d1/d22/d55/fcb [952796,26152] 0 2024-09-13T21:44:59.172 INFO:tasks.workunit.client.1.smithi155.stdout:3/671: read - d3/fd6 zero size 2024-09-13T21:44:59.173 INFO:tasks.workunit.client.1.smithi155.stdout:5/578: chown d5/c93 1846 1 2024-09-13T21:44:59.173 INFO:tasks.workunit.client.1.smithi155.stdout:3/672: stat d3/d25/d17/d52/cb8 0 2024-09-13T21:44:59.175 INFO:tasks.workunit.client.1.smithi155.stdout:7/547: mkdir d5/df/d15/d33/d55/d97/daa 0 2024-09-13T21:44:59.175 INFO:tasks.workunit.client.0.smithi119.stdout:2/928: creat d1/d7/f126 x:0 0 0 2024-09-13T21:44:59.176 INFO:tasks.workunit.client.1.smithi155.stdout:3/673: stat d3/d25/d1b/d1f/d36/d5c/d66/db3 0 2024-09-13T21:44:59.183 INFO:tasks.workunit.client.0.smithi119.stdout:2/929: write d1/d7/f11 [9095269,88211] 0 2024-09-13T21:44:59.184 INFO:tasks.workunit.client.1.smithi155.stdout:5/579: creat d5/d16/d81/d98/d84/fc0 x:0 0 0 2024-09-13T21:44:59.185 INFO:tasks.workunit.client.1.smithi155.stdout:3/674: chown d3/d10/c15 13137962 1 2024-09-13T21:44:59.185 INFO:tasks.workunit.client.1.smithi155.stdout:7/548: symlink d5/df/d79/lab 0 2024-09-13T21:44:59.185 INFO:tasks.workunit.client.1.smithi155.stdout:3/675: dread - d3/d25/d17/d52/fd2 zero size 2024-09-13T21:44:59.185 INFO:tasks.workunit.client.1.smithi155.stdout:6/736: getdents db/d11/d6d/db9/d1c/d36/d37/db7 0 2024-09-13T21:44:59.189 INFO:tasks.workunit.client.0.smithi119.stdout:1/915: dwrite d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9d/fca [0,4194304] 0 2024-09-13T21:44:59.189 INFO:tasks.workunit.client.1.smithi155.stdout:5/580: mkdir d5/d16/d33/d1b/d2f/d3c/d5b/dc1 0 2024-09-13T21:44:59.190 INFO:tasks.workunit.client.1.smithi155.stdout:6/737: dread - db/d2c/dc0/ff5 zero size 2024-09-13T21:44:59.190 INFO:tasks.workunit.client.1.smithi155.stdout:7/549: chown d5/df/d60/f86 37 1 2024-09-13T21:44:59.190 INFO:tasks.workunit.client.1.smithi155.stdout:3/676: creat d3/d25/d17/d52/fe5 x:0 0 0 2024-09-13T21:44:59.190 INFO:tasks.workunit.client.0.smithi119.stdout:2/930: rename d1/d7/d86 to d1/d127 0 2024-09-13T21:44:59.190 INFO:tasks.workunit.client.0.smithi119.stdout:1/916: dread - d1/d3/dc/d24/fef zero size 2024-09-13T21:44:59.191 INFO:tasks.workunit.client.1.smithi155.stdout:7/550: creat d5/d10/d3e/d40/fac x:0 0 0 2024-09-13T21:44:59.192 INFO:tasks.workunit.client.0.smithi119.stdout:2/931: symlink d1/d7/l128 0 2024-09-13T21:44:59.193 INFO:tasks.workunit.client.1.smithi155.stdout:3/677: chown d3/d25/d17/ld5 15915 1 2024-09-13T21:44:59.194 INFO:tasks.workunit.client.0.smithi119.stdout:2/932: unlink d1/d22/d5a/cd1 0 2024-09-13T21:44:59.195 INFO:tasks.workunit.client.0.smithi119.stdout:2/933: dread - d1/d22/d5a/d5d/d83/f11f zero size 2024-09-13T21:44:59.196 INFO:tasks.workunit.client.0.smithi119.stdout:2/934: write d1/d7/fba [416769,84953] 0 2024-09-13T21:44:59.197 INFO:tasks.workunit.client.0.smithi119.stdout:2/935: write d1/d22/d5a/d5d/d83/fd8 [1015952,89664] 0 2024-09-13T21:44:59.198 INFO:tasks.workunit.client.1.smithi155.stdout:6/738: dwrite db/d11/d5b/fbd [0,4194304] 0 2024-09-13T21:44:59.198 INFO:tasks.workunit.client.0.smithi119.stdout:2/936: chown d1/d38/d89/d6b/d8c/fa8 2075 1 2024-09-13T21:44:59.200 INFO:tasks.workunit.client.0.smithi119.stdout:2/937: mknod d1/d38/d89/d6b/c129 0 2024-09-13T21:44:59.201 INFO:tasks.workunit.client.1.smithi155.stdout:3/678: link d3/d25/d17/f27 d3/d25/d1b/fe6 0 2024-09-13T21:44:59.206 INFO:tasks.workunit.client.1.smithi155.stdout:5/581: dwrite d5/d16/f32 [0,4194304] 0 2024-09-13T21:44:59.208 INFO:tasks.workunit.client.1.smithi155.stdout:7/551: write d5/df/f58 [1817448,52294] 0 2024-09-13T21:44:59.210 INFO:tasks.workunit.client.1.smithi155.stdout:7/552: fsync d5/df/d15/d33/d55/f5e 0 2024-09-13T21:44:59.219 INFO:tasks.workunit.client.1.smithi155.stdout:3/679: dwrite d3/d25/d17/fab [0,4194304] 0 2024-09-13T21:44:59.221 INFO:tasks.workunit.client.1.smithi155.stdout:3/680: symlink d3/d25/d1b/d1f/d36/d5c/d66/db3/le7 0 2024-09-13T21:44:59.224 INFO:tasks.workunit.client.0.smithi119.stdout:2/938: rmdir d1/d38 39 2024-09-13T21:44:59.224 INFO:tasks.workunit.client.1.smithi155.stdout:3/681: write d3/d25/d1b/d1f/f92 [1144222,69679] 0 2024-09-13T21:44:59.224 INFO:tasks.workunit.client.0.smithi119.stdout:2/939: chown d1/d22/d55/d31/fa0 3 1 2024-09-13T21:44:59.228 INFO:tasks.workunit.client.0.smithi119.stdout:2/940: unlink d1/d22/d5a/d5d/d77/daa/f101 0 2024-09-13T21:44:59.231 INFO:tasks.workunit.client.0.smithi119.stdout:2/941: getdents d1/d38 0 2024-09-13T21:44:59.232 INFO:tasks.workunit.client.1.smithi155.stdout:6/739: dread db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/d8e/fcb [0,4194304] 0 2024-09-13T21:44:59.232 INFO:tasks.workunit.client.0.smithi119.stdout:2/942: getdents d1/d7/d47/df3/d108 0 2024-09-13T21:44:59.233 INFO:tasks.workunit.client.1.smithi155.stdout:7/553: truncate d5/df/d15/d33/d55/f9b 3560170 0 2024-09-13T21:44:59.233 INFO:tasks.workunit.client.0.smithi119.stdout:2/943: write d1/d22/db6/ff8 [461384,16950] 0 2024-09-13T21:44:59.235 INFO:tasks.workunit.client.0.smithi119.stdout:2/944: creat d1/d22/db6/f12a x:0 0 0 2024-09-13T21:44:59.236 INFO:tasks.workunit.client.1.smithi155.stdout:6/740: mknod db/d11/d6d/db9/de6/d5f/cf7 0 2024-09-13T21:44:59.237 INFO:tasks.workunit.client.0.smithi119.stdout:2/945: creat d1/d22/d7c/dfe/d110/f12b x:0 0 0 2024-09-13T21:44:59.238 INFO:tasks.workunit.client.1.smithi155.stdout:6/741: stat db/d11/d5b 0 2024-09-13T21:44:59.239 INFO:tasks.workunit.client.1.smithi155.stdout:5/582: dwrite d5/f7 [0,4194304] 0 2024-09-13T21:44:59.239 INFO:tasks.workunit.client.0.smithi119.stdout:2/946: mkdir d1/d22/d5a/d5d/db7/dec/d12c 0 2024-09-13T21:44:59.241 INFO:tasks.workunit.client.1.smithi155.stdout:3/682: dwrite d3/d25/d1b/d1f/d36/d5c/f63 [0,4194304] 0 2024-09-13T21:44:59.241 INFO:tasks.workunit.client.1.smithi155.stdout:5/583: chown d5/d16/d33/d1b/d28/c71 27586 1 2024-09-13T21:44:59.247 INFO:tasks.workunit.client.1.smithi155.stdout:6/742: symlink db/d11/d6d/db9/d1c/d36/lf8 0 2024-09-13T21:44:59.247 INFO:tasks.workunit.client.1.smithi155.stdout:5/584: truncate d5/d16/d33/d1b/d59/fb5 114341 0 2024-09-13T21:44:59.248 INFO:tasks.workunit.client.1.smithi155.stdout:7/554: truncate d5/df/d15/d33/d43/f64 2905472 0 2024-09-13T21:44:59.249 INFO:tasks.workunit.client.1.smithi155.stdout:3/683: rmdir d3/d25/d1b/d1f/d82/d83/d99 39 2024-09-13T21:44:59.249 INFO:tasks.workunit.client.1.smithi155.stdout:6/743: fsync db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d88/f98 0 2024-09-13T21:44:59.251 INFO:tasks.workunit.client.1.smithi155.stdout:3/684: chown d3/d25/d1b/l43 435 1 2024-09-13T21:44:59.252 INFO:tasks.workunit.client.1.smithi155.stdout:7/555: rmdir d5/df/d60/d6d 39 2024-09-13T21:44:59.256 INFO:tasks.workunit.client.1.smithi155.stdout:6/744: creat db/ff9 x:0 0 0 2024-09-13T21:44:59.256 INFO:tasks.workunit.client.1.smithi155.stdout:5/585: dwrite d5/d16/d81/d98/f4d [0,4194304] 0 2024-09-13T21:44:59.258 INFO:tasks.workunit.client.1.smithi155.stdout:7/556: dread d5/d10/f2a [0,4194304] 0 2024-09-13T21:44:59.260 INFO:tasks.workunit.client.1.smithi155.stdout:3/685: getdents d3/d25/d17/d52 0 2024-09-13T21:44:59.263 INFO:tasks.workunit.client.1.smithi155.stdout:3/686: stat d3/d25/d1b/d1f/d36/d5c/d66/db3/db2 0 2024-09-13T21:44:59.265 INFO:tasks.workunit.client.1.smithi155.stdout:5/586: creat d5/d16/d33/d1b/d2f/d3c/d44/d29/fc2 x:0 0 0 2024-09-13T21:44:59.266 INFO:tasks.workunit.client.1.smithi155.stdout:7/557: mkdir d5/df/dad 0 2024-09-13T21:44:59.270 INFO:tasks.workunit.client.1.smithi155.stdout:5/587: creat d5/d16/d81/d98/fc3 x:0 0 0 2024-09-13T21:44:59.271 INFO:tasks.workunit.client.1.smithi155.stdout:3/687: truncate d3/d25/d1b/d1f/d36/d5c/d66/f88 1488733 0 2024-09-13T21:44:59.275 INFO:tasks.workunit.client.1.smithi155.stdout:3/688: rename d3/d25/d1b/d1f/d36 to d3/d25/d1b/d1f/d36/d5c/dcc/de8 22 2024-09-13T21:44:59.276 INFO:tasks.workunit.client.1.smithi155.stdout:3/689: stat d3/d25 0 2024-09-13T21:44:59.276 INFO:tasks.workunit.client.1.smithi155.stdout:5/588: dread d5/d16/d33/d1b/d2f/d3c/d44/d80/fad [0,4194304] 0 2024-09-13T21:44:59.277 INFO:tasks.workunit.client.1.smithi155.stdout:6/745: write db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/dda/fdc [1981645,124622] 0 2024-09-13T21:44:59.281 INFO:tasks.workunit.client.1.smithi155.stdout:6/746: mknod db/d11/d2b/d35/cfa 0 2024-09-13T21:44:59.283 INFO:tasks.workunit.client.1.smithi155.stdout:3/690: rmdir d3/d25/d1b/d1f/d36/d5c/dcc 0 2024-09-13T21:44:59.284 INFO:tasks.workunit.client.1.smithi155.stdout:7/558: dwrite d5/df/d15/d33/d55/f9b [0,4194304] 0 2024-09-13T21:44:59.285 INFO:tasks.workunit.client.1.smithi155.stdout:6/747: truncate db/d11/d1e/dca/de1/ff2 4553458 0 2024-09-13T21:44:59.285 INFO:tasks.workunit.client.1.smithi155.stdout:3/691: dread - d3/d25/d1b/d1f/f56 zero size 2024-09-13T21:44:59.286 INFO:tasks.workunit.client.1.smithi155.stdout:5/589: mknod d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/db8/cc4 0 2024-09-13T21:44:59.287 INFO:tasks.workunit.client.1.smithi155.stdout:6/748: dread - db/d11/d6d/fc5 zero size 2024-09-13T21:44:59.289 INFO:tasks.workunit.client.1.smithi155.stdout:5/590: chown d5/d16/d33/d1b/d2f/d3c/d6c/f46 969 1 2024-09-13T21:44:59.289 INFO:tasks.workunit.client.1.smithi155.stdout:3/692: creat d3/d21/d4a/dcd/dd8/fe9 x:0 0 0 2024-09-13T21:44:59.293 INFO:tasks.workunit.client.1.smithi155.stdout:7/559: dwrite d5/d13/d5f/f95 [0,4194304] 0 2024-09-13T21:44:59.297 INFO:tasks.workunit.client.1.smithi155.stdout:5/591: getdents d5/d16/d4e/d85 0 2024-09-13T21:44:59.298 INFO:tasks.workunit.client.1.smithi155.stdout:3/693: creat d3/d25/d1b/d1f/d36/d5c/ddb/fea x:0 0 0 2024-09-13T21:44:59.301 INFO:tasks.workunit.client.1.smithi155.stdout:3/694: symlink d3/dbb/leb 0 2024-09-13T21:44:59.302 INFO:tasks.workunit.client.1.smithi155.stdout:3/695: read - d3/fd6 zero size 2024-09-13T21:44:59.303 INFO:tasks.workunit.client.1.smithi155.stdout:0/640: sync 2024-09-13T21:44:59.303 INFO:tasks.workunit.client.1.smithi155.stdout:8/555: sync 2024-09-13T21:44:59.304 INFO:tasks.workunit.client.1.smithi155.stdout:9/643: sync 2024-09-13T21:44:59.304 INFO:tasks.workunit.client.1.smithi155.stdout:4/536: sync 2024-09-13T21:44:59.304 INFO:tasks.workunit.client.1.smithi155.stdout:1/610: sync 2024-09-13T21:44:59.305 INFO:tasks.workunit.client.1.smithi155.stdout:5/592: symlink d5/d16/d33/d1b/d28/d52/lc5 0 2024-09-13T21:44:59.307 INFO:tasks.workunit.client.1.smithi155.stdout:0/641: readlink d1/d6/dc/d4d/ld2 0 2024-09-13T21:44:59.307 INFO:tasks.workunit.client.1.smithi155.stdout:7/560: dwrite d5/d13/fa3 [0,4194304] 0 2024-09-13T21:44:59.309 INFO:tasks.workunit.client.1.smithi155.stdout:6/749: dread db/d11/d1e/d21/f42 [0,4194304] 0 2024-09-13T21:44:59.310 INFO:tasks.workunit.client.1.smithi155.stdout:0/642: chown d1/d6/dc/d4d/d4a/d52/da5 1049086531 1 2024-09-13T21:44:59.310 INFO:tasks.workunit.client.1.smithi155.stdout:7/561: readlink d5/df/d15/d33/d43/l9d 0 2024-09-13T21:44:59.311 INFO:tasks.workunit.client.1.smithi155.stdout:1/611: unlink d6/d15/d57/d5d/f62 0 2024-09-13T21:44:59.312 INFO:tasks.workunit.client.1.smithi155.stdout:3/696: mknod d3/d21/d4a/dcd/dd8/cec 0 2024-09-13T21:44:59.312 INFO:tasks.workunit.client.1.smithi155.stdout:0/643: read d1/f6e [18018,82745] 0 2024-09-13T21:44:59.313 INFO:tasks.workunit.client.1.smithi155.stdout:3/697: truncate d3/fd6 467436 0 2024-09-13T21:44:59.313 INFO:tasks.workunit.client.1.smithi155.stdout:9/644: symlink dc/de/d2d/d79/d43/ldf 0 2024-09-13T21:44:59.314 INFO:tasks.workunit.client.1.smithi155.stdout:3/698: write d3/d25/f61 [2190750,100794] 0 2024-09-13T21:44:59.315 INFO:tasks.workunit.client.1.smithi155.stdout:9/645: fsync dc/de/d2d/f95 0 2024-09-13T21:44:59.317 INFO:tasks.workunit.client.1.smithi155.stdout:3/699: write d3/d25/d17/d52/fd2 [832325,21037] 0 2024-09-13T21:44:59.319 INFO:tasks.workunit.client.1.smithi155.stdout:9/646: truncate dc/de/fd3 64310 0 2024-09-13T21:44:59.319 INFO:tasks.workunit.client.1.smithi155.stdout:0/644: rmdir d1/d6/dc/d4d/d4a/d52 39 2024-09-13T21:44:59.328 INFO:tasks.workunit.client.1.smithi155.stdout:3/700: creat d3/d21/d4a/dcd/dd8/fed x:0 0 0 2024-09-13T21:44:59.328 INFO:tasks.workunit.client.1.smithi155.stdout:6/750: creat db/d11/d2b/ffb x:0 0 0 2024-09-13T21:44:59.329 INFO:tasks.workunit.client.1.smithi155.stdout:5/593: getdents d5/d16 0 2024-09-13T21:44:59.329 INFO:tasks.workunit.client.1.smithi155.stdout:4/537: getdents d1/d7/de/d72 0 2024-09-13T21:44:59.330 INFO:tasks.workunit.client.1.smithi155.stdout:9/647: write dc/de/d2d/d79/d43/f9c [941837,47449] 0 2024-09-13T21:44:59.337 INFO:tasks.workunit.client.1.smithi155.stdout:1/612: write d6/d15/d57/d5d/f5f [3575321,109939] 0 2024-09-13T21:44:59.340 INFO:tasks.workunit.client.1.smithi155.stdout:7/562: truncate d5/d13/f21 12452807 0 2024-09-13T21:44:59.346 INFO:tasks.workunit.client.1.smithi155.stdout:9/648: dread dc/d18/d1e/f64 [0,4194304] 0 2024-09-13T21:44:59.349 INFO:tasks.workunit.client.1.smithi155.stdout:0/645: rename d1/d6/dc/d4d/d4a/d4e/fd6 to d1/d6/dc/d90/ffa 0 2024-09-13T21:44:59.351 INFO:tasks.workunit.client.1.smithi155.stdout:6/751: mkdir db/d11/d2b/d35/dfc 0 2024-09-13T21:44:59.351 INFO:tasks.workunit.client.1.smithi155.stdout:4/538: creat d1/d7/d21/d69/d98/fa8 x:0 0 0 2024-09-13T21:44:59.352 INFO:tasks.workunit.client.1.smithi155.stdout:5/594: mknod d5/d16/d33/d1b/d1e/cc6 0 2024-09-13T21:44:59.352 INFO:tasks.workunit.client.1.smithi155.stdout:1/613: rmdir d6/d7 39 2024-09-13T21:44:59.353 INFO:tasks.workunit.client.1.smithi155.stdout:7/563: readlink d5/l26 0 2024-09-13T21:44:59.354 INFO:tasks.workunit.client.1.smithi155.stdout:9/649: readlink dc/d19/d23/d38/la8 0 2024-09-13T21:44:59.355 INFO:tasks.workunit.client.1.smithi155.stdout:3/701: symlink d3/d25/lee 0 2024-09-13T21:44:59.355 INFO:tasks.workunit.client.1.smithi155.stdout:9/650: dread - dc/d19/d23/d38/d90/d74/fc8 zero size 2024-09-13T21:44:59.357 INFO:tasks.workunit.client.1.smithi155.stdout:7/564: truncate d5/df/d15/d33/d55/d97/f9e 333854 0 2024-09-13T21:44:59.357 INFO:tasks.workunit.client.1.smithi155.stdout:4/539: symlink d1/d7/de/d72/da6/la9 0 2024-09-13T21:44:59.359 INFO:tasks.workunit.client.1.smithi155.stdout:6/752: rmdir db/d2c/d85 39 2024-09-13T21:44:59.359 INFO:tasks.workunit.client.1.smithi155.stdout:7/565: chown d5/df/f19 3885 1 2024-09-13T21:44:59.360 INFO:tasks.workunit.client.1.smithi155.stdout:4/540: chown d1/d7/de/dc/d7c 2417437 1 2024-09-13T21:44:59.361 INFO:tasks.workunit.client.1.smithi155.stdout:0/646: truncate d1/d6/dc/d4d/d4a/d52/d5c/f9a 348381 0 2024-09-13T21:44:59.361 INFO:tasks.workunit.client.1.smithi155.stdout:7/566: dread d5/d10/f2a [0,4194304] 0 2024-09-13T21:44:59.362 INFO:tasks.workunit.client.1.smithi155.stdout:0/647: stat d1/f5 0 2024-09-13T21:44:59.363 INFO:tasks.workunit.client.1.smithi155.stdout:9/651: mknod dc/d18/d1e/dcc/ce0 0 2024-09-13T21:44:59.363 INFO:tasks.workunit.client.1.smithi155.stdout:6/753: mknod db/d2c/dbc/cfd 0 2024-09-13T21:44:59.364 INFO:tasks.workunit.client.1.smithi155.stdout:7/567: write d5/d13/f3d [3818292,19692] 0 2024-09-13T21:44:59.368 INFO:tasks.workunit.client.1.smithi155.stdout:4/541: truncate d1/d48/f51 1227392 0 2024-09-13T21:44:59.370 INFO:tasks.workunit.client.1.smithi155.stdout:3/702: link d3/d25/d1b/d1f/d36/f5d d3/d25/d1b/d1f/d82/d83/d99/da6/fef 0 2024-09-13T21:44:59.371 INFO:tasks.workunit.client.1.smithi155.stdout:4/542: chown d1/d7/de/d15/d55/d5e 1746361 1 2024-09-13T21:44:59.373 INFO:tasks.workunit.client.1.smithi155.stdout:0/648: rename d1/d6/dc/d4d/f78 to d1/d6/dc/d4d/d4a/d52/d5b/ffb 0 2024-09-13T21:44:59.377 INFO:tasks.workunit.client.1.smithi155.stdout:6/754: dwrite db/d11/d6d/db9/f1a [0,4194304] 0 2024-09-13T21:44:59.378 INFO:tasks.workunit.client.1.smithi155.stdout:9/652: dwrite dc/de/d6f/d71/fcd [0,4194304] 0 2024-09-13T21:44:59.378 INFO:tasks.workunit.client.1.smithi155.stdout:7/568: creat d5/d10/fae x:0 0 0 2024-09-13T21:44:59.384 INFO:tasks.workunit.client.1.smithi155.stdout:4/543: rename d1/d7/c54 to d1/d7/caa 0 2024-09-13T21:44:59.385 INFO:tasks.workunit.client.1.smithi155.stdout:7/569: write d5/df/d15/d33/d55/f9b [3025873,19825] 0 2024-09-13T21:44:59.387 INFO:tasks.workunit.client.1.smithi155.stdout:7/570: fdatasync d5/d13/f3d 0 2024-09-13T21:44:59.389 INFO:tasks.workunit.client.1.smithi155.stdout:3/703: dwrite d3/d25/d17/d52/fe5 [0,4194304] 0 2024-09-13T21:44:59.390 INFO:tasks.workunit.client.1.smithi155.stdout:9/653: rename dc/d19/d23 to dc/de/d6f/dae/de1 0 2024-09-13T21:44:59.392 INFO:tasks.workunit.client.1.smithi155.stdout:6/755: creat db/d11/d6d/db9/ffe x:0 0 0 2024-09-13T21:44:59.396 INFO:tasks.workunit.client.1.smithi155.stdout:7/571: creat d5/d10/d48/faf x:0 0 0 2024-09-13T21:44:59.397 INFO:tasks.workunit.client.1.smithi155.stdout:9/654: dread - dc/d18/d1e/fa4 zero size 2024-09-13T21:44:59.399 INFO:tasks.workunit.client.1.smithi155.stdout:9/655: write dc/d19/d21/faf [1027986,7995] 0 2024-09-13T21:44:59.400 INFO:tasks.workunit.client.1.smithi155.stdout:4/544: symlink d1/d7/de/lab 0 2024-09-13T21:44:59.402 INFO:tasks.workunit.client.1.smithi155.stdout:9/656: fdatasync dc/de/d6f/fb6 0 2024-09-13T21:44:59.402 INFO:tasks.workunit.client.1.smithi155.stdout:3/704: read d3/d10/f8d [3060215,429] 0 2024-09-13T21:44:59.403 INFO:tasks.workunit.client.1.smithi155.stdout:7/572: symlink d5/df/d15/d33/d43/lb0 0 2024-09-13T21:44:59.404 INFO:tasks.workunit.client.1.smithi155.stdout:7/573: chown d5/df/dad 66 1 2024-09-13T21:44:59.406 INFO:tasks.workunit.client.1.smithi155.stdout:4/545: rmdir d1/d7/d83 39 2024-09-13T21:44:59.408 INFO:tasks.workunit.client.1.smithi155.stdout:6/756: truncate db/f2f 1298646 0 2024-09-13T21:44:59.411 INFO:tasks.workunit.client.1.smithi155.stdout:4/546: symlink d1/d7/d21/d2d/lac 0 2024-09-13T21:44:59.412 INFO:tasks.workunit.client.1.smithi155.stdout:5/595: truncate d5/d16/d81/d98/f4d 2120043 0 2024-09-13T21:44:59.414 INFO:tasks.workunit.client.1.smithi155.stdout:5/596: write d5/d16/d33/d1b/d28/f37 [2315626,89781] 0 2024-09-13T21:44:59.414 INFO:tasks.workunit.client.1.smithi155.stdout:9/657: rename dc/d19/lbe to dc/d19/d21/d67/le2 0 2024-09-13T21:44:59.417 INFO:tasks.workunit.client.1.smithi155.stdout:0/649: dread d1/d6/d97/fe3 [0,4194304] 0 2024-09-13T21:44:59.418 INFO:tasks.workunit.client.1.smithi155.stdout:7/574: link d5/df/f1a d5/d13/d5f/fb1 0 2024-09-13T21:44:59.420 INFO:tasks.workunit.client.1.smithi155.stdout:7/575: fdatasync d5/d3b/f42 0 2024-09-13T21:44:59.424 INFO:tasks.workunit.client.1.smithi155.stdout:9/658: write dc/de/d2d/f40 [947771,29173] 0 2024-09-13T21:44:59.425 INFO:tasks.workunit.client.1.smithi155.stdout:3/705: dread d3/d10/f46 [0,4194304] 0 2024-09-13T21:44:59.428 INFO:tasks.workunit.client.1.smithi155.stdout:1/614: dwrite d6/d15/d57/fc1 [0,4194304] 0 2024-09-13T21:44:59.428 INFO:tasks.workunit.client.1.smithi155.stdout:5/597: dwrite d5/d16/d33/d1f/f5a [0,4194304] 0 2024-09-13T21:44:59.430 INFO:tasks.workunit.client.0.smithi119.stdout:1/917: sync 2024-09-13T21:44:59.431 INFO:tasks.workunit.client.1.smithi155.stdout:6/757: link db/d11/d1e/d21/d44/f4b db/d11/fff 0 2024-09-13T21:44:59.435 INFO:tasks.workunit.client.0.smithi119.stdout:1/918: dread d1/d3/d61/d77/d78/d32/d33/d72/ff2 [0,4194304] 0 2024-09-13T21:44:59.437 INFO:tasks.workunit.client.1.smithi155.stdout:7/576: creat d5/df/d15/d33/d55/fb2 x:0 0 0 2024-09-13T21:44:59.439 INFO:tasks.workunit.client.0.smithi119.stdout:1/919: creat d1/d3/d61/d77/d78/d32/dda/d3d/dd3/f137 x:0 0 0 2024-09-13T21:44:59.440 INFO:tasks.workunit.client.1.smithi155.stdout:1/615: dwrite d6/d15/d23/d87/f29 [4194304,4194304] 0 2024-09-13T21:44:59.442 INFO:tasks.workunit.client.1.smithi155.stdout:5/598: dwrite d5/d16/d33/d1b/d59/fae [0,4194304] 0 2024-09-13T21:44:59.444 INFO:tasks.workunit.client.1.smithi155.stdout:1/616: chown d6/d15/f4c 0 1 2024-09-13T21:44:59.445 INFO:tasks.workunit.client.0.smithi119.stdout:1/920: rename d1/d3/d61/d77/d78/d32/d33/d43/de7 to d1/d3/d61/d77/d78/d138 0 2024-09-13T21:44:59.446 INFO:tasks.workunit.client.1.smithi155.stdout:6/758: creat db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/d93/f100 x:0 0 0 2024-09-13T21:44:59.447 INFO:tasks.workunit.client.0.smithi119.stdout:1/921: truncate d1/d3/d61/d77/d78/d32/dda/d19/fb7 4324324 0 2024-09-13T21:44:59.452 INFO:tasks.workunit.client.1.smithi155.stdout:6/759: truncate db/d11/d2b/d35/f25 4533592 0 2024-09-13T21:44:59.453 INFO:tasks.workunit.client.1.smithi155.stdout:0/650: rmdir d1/d6/dc/d4d/d4a/dbe 39 2024-09-13T21:44:59.455 INFO:tasks.workunit.client.1.smithi155.stdout:9/659: creat dc/de/fe3 x:0 0 0 2024-09-13T21:44:59.457 INFO:tasks.workunit.client.1.smithi155.stdout:3/706: dwrite d3/d10/fe0 [0,4194304] 0 2024-09-13T21:44:59.458 INFO:tasks.workunit.client.1.smithi155.stdout:9/660: read dc/d18/d1e/f64 [3565612,114480] 0 2024-09-13T21:44:59.458 INFO:tasks.workunit.client.1.smithi155.stdout:7/577: symlink d5/d10/d3e/d3f/lb3 0 2024-09-13T21:44:59.461 INFO:tasks.workunit.client.1.smithi155.stdout:0/651: unlink d1/d6/fef 0 2024-09-13T21:44:59.462 INFO:tasks.workunit.client.1.smithi155.stdout:2/586: sync 2024-09-13T21:44:59.462 INFO:tasks.workunit.client.1.smithi155.stdout:1/617: creat d6/d15/d57/d5d/d72/dc7/fd5 x:0 0 0 2024-09-13T21:44:59.465 INFO:tasks.workunit.client.1.smithi155.stdout:4/547: truncate d1/d7/de/d15/f71 3669873 0 2024-09-13T21:44:59.467 INFO:tasks.workunit.client.1.smithi155.stdout:7/578: mknod d5/d10/d3e/d3f/d61/cb4 0 2024-09-13T21:44:59.470 INFO:tasks.workunit.client.1.smithi155.stdout:6/760: creat db/d11/d5b/deb/f101 x:0 0 0 2024-09-13T21:44:59.470 INFO:tasks.workunit.client.1.smithi155.stdout:9/661: symlink dc/le4 0 2024-09-13T21:44:59.476 INFO:tasks.workunit.client.1.smithi155.stdout:0/652: mknod d1/cfc 0 2024-09-13T21:44:59.477 INFO:tasks.workunit.client.1.smithi155.stdout:0/653: chown d1/d6/dc/f84 343 1 2024-09-13T21:44:59.478 INFO:tasks.workunit.client.1.smithi155.stdout:5/599: truncate d5/fb7 1748410 0 2024-09-13T21:44:59.479 INFO:tasks.workunit.client.1.smithi155.stdout:9/662: creat dc/de/d6f/dae/ddb/fe5 x:0 0 0 2024-09-13T21:44:59.481 INFO:tasks.workunit.client.0.smithi119.stdout:1/922: rename d1/d3/d61/d77/d78/d32/dda/d3d/dd3 to d1/d3/d61/d77/d78/d32/dda/d28/d93/d139 0 2024-09-13T21:44:59.482 INFO:tasks.workunit.client.0.smithi119.stdout:1/923: readlink d1/d3/d6c/lf0 0 2024-09-13T21:44:59.482 INFO:tasks.workunit.client.1.smithi155.stdout:8/556: sync 2024-09-13T21:44:59.484 INFO:tasks.workunit.client.1.smithi155.stdout:1/618: mkdir d6/d7/d89/dd6 0 2024-09-13T21:44:59.484 INFO:tasks.workunit.client.1.smithi155.stdout:8/557: chown d2/d8/l64 13862 1 2024-09-13T21:44:59.485 INFO:tasks.workunit.client.1.smithi155.stdout:9/663: symlink dc/de/d6f/dae/le6 0 2024-09-13T21:44:59.486 INFO:tasks.workunit.client.1.smithi155.stdout:8/558: chown d2/d1f 47499 1 2024-09-13T21:44:59.486 INFO:tasks.workunit.client.0.smithi119.stdout:1/924: link d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/l6e d1/d3/d61/d77/d78/d32/d33/dd0/l13a 0 2024-09-13T21:44:59.486 INFO:tasks.workunit.client.1.smithi155.stdout:4/548: write d1/f4 [1131653,29524] 0 2024-09-13T21:44:59.488 INFO:tasks.workunit.client.0.smithi119.stdout:1/925: truncate d1/d3/d61/d77/d78/f50 1102102 0 2024-09-13T21:44:59.489 INFO:tasks.workunit.client.1.smithi155.stdout:5/600: dwrite d5/d16/d4e/d85/f97 [0,4194304] 0 2024-09-13T21:44:59.490 INFO:tasks.workunit.client.1.smithi155.stdout:6/761: rename db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d88/f98 to db/d11/d6d/db9/f102 0 2024-09-13T21:44:59.491 INFO:tasks.workunit.client.1.smithi155.stdout:4/549: stat d1/d7/de/dc 0 2024-09-13T21:44:59.491 INFO:tasks.workunit.client.0.smithi119.stdout:1/926: read d1/d3/d61/da9/fc0 [998791,112880] 0 2024-09-13T21:44:59.493 INFO:tasks.workunit.client.0.smithi119.stdout:1/927: read d1/d3/d61/d77/d78/d32/d33/d43/d74/f8b [161051,69888] 0 2024-09-13T21:44:59.497 INFO:tasks.workunit.client.0.smithi119.stdout:1/928: mkdir d1/d3/d61/d77/d78/d32/dda/d19/d13b 0 2024-09-13T21:44:59.498 INFO:tasks.workunit.client.1.smithi155.stdout:9/664: dread - dc/de/d6f/dae/de1/d38/d90/d74/fce zero size 2024-09-13T21:44:59.499 INFO:tasks.workunit.client.1.smithi155.stdout:8/559: mknod d2/d6/dd/d12/cac 0 2024-09-13T21:44:59.500 INFO:tasks.workunit.client.1.smithi155.stdout:3/707: dwrite d3/d21/f6e [0,4194304] 0 2024-09-13T21:44:59.501 INFO:tasks.workunit.client.1.smithi155.stdout:7/579: dwrite f3 [4194304,4194304] 0 2024-09-13T21:44:59.502 INFO:tasks.workunit.client.0.smithi119.stdout:1/929: dread d1/d3/d61/d77/d78/d32/dda/d3d/f106 [0,4194304] 0 2024-09-13T21:44:59.503 INFO:tasks.workunit.client.1.smithi155.stdout:2/587: truncate d2/db/f18 1789088 0 2024-09-13T21:44:59.504 INFO:tasks.workunit.client.1.smithi155.stdout:7/580: chown d5/d10/d3e 5004711 1 2024-09-13T21:44:59.505 INFO:tasks.workunit.client.1.smithi155.stdout:8/560: fdatasync d2/d6/dd/fa7 0 2024-09-13T21:44:59.506 INFO:tasks.workunit.client.0.smithi119.stdout:1/930: rename d1/d3/d61/d77/d78/d32/dda/d3d/cfd to d1/d3/d61/d77/d78/d32/dda/d19/d2d/c13c 0 2024-09-13T21:44:59.508 INFO:tasks.workunit.client.0.smithi119.stdout:1/931: creat d1/d3/dc/f13d x:0 0 0 2024-09-13T21:44:59.509 INFO:tasks.workunit.client.0.smithi119.stdout:1/932: fsync d1/d3/dc/d24/fe2 0 2024-09-13T21:44:59.509 INFO:tasks.workunit.client.0.smithi119.stdout:2/947: sync 2024-09-13T21:44:59.510 INFO:tasks.workunit.client.1.smithi155.stdout:0/654: rename d1/d6/l91 to d1/d6/d97/lfd 0 2024-09-13T21:44:59.510 INFO:tasks.workunit.client.1.smithi155.stdout:7/581: write d5/df/d60/f86 [344600,120456] 0 2024-09-13T21:44:59.511 INFO:tasks.workunit.client.0.smithi119.stdout:2/948: mkdir d1/d22/d5a/da9/d12d 0 2024-09-13T21:44:59.515 INFO:tasks.workunit.client.1.smithi155.stdout:2/588: write d2/dd/d3d/f7f [338978,111785] 0 2024-09-13T21:44:59.515 INFO:tasks.workunit.client.1.smithi155.stdout:4/550: creat d1/d7/d78/fad x:0 0 0 2024-09-13T21:44:59.516 INFO:tasks.workunit.client.0.smithi119.stdout:2/949: symlink d1/d38/d89/d6b/l12e 0 2024-09-13T21:44:59.516 INFO:tasks.workunit.client.1.smithi155.stdout:6/762: creat db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/f103 x:0 0 0 2024-09-13T21:44:59.517 INFO:tasks.workunit.client.0.smithi119.stdout:1/933: mkdir d1/d3/d61/d77/d78/d32/d33/d43/d130/d13e 0 2024-09-13T21:44:59.517 INFO:tasks.workunit.client.1.smithi155.stdout:4/551: chown d1/d7/f6b 570 1 2024-09-13T21:44:59.518 INFO:tasks.workunit.client.1.smithi155.stdout:8/561: creat d2/d8/d65/fad x:0 0 0 2024-09-13T21:44:59.519 INFO:tasks.workunit.client.1.smithi155.stdout:3/708: rename d3/d21/d4a/l4d to d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/lf0 0 2024-09-13T21:44:59.519 INFO:tasks.workunit.client.1.smithi155.stdout:2/589: chown d2/dd/de/d15/d38/d41/l42 29875 1 2024-09-13T21:44:59.520 INFO:tasks.workunit.client.0.smithi119.stdout:1/934: truncate d1/d3/d61/d77/f94 3103884 0 2024-09-13T21:44:59.521 INFO:tasks.workunit.client.1.smithi155.stdout:7/582: read - d5/d10/d3e/d40/f70 zero size 2024-09-13T21:44:59.521 INFO:tasks.workunit.client.0.smithi119.stdout:1/935: chown d1/d3/d61/d77/d78/d32/dda/d28/c9e 907609 1 2024-09-13T21:44:59.522 INFO:tasks.workunit.client.1.smithi155.stdout:1/619: mknod d6/d15/d23/d55/d6e/dbb/d4b/dc3/cd7 0 2024-09-13T21:44:59.524 INFO:tasks.workunit.client.1.smithi155.stdout:4/552: dread d1/d7/f9a [0,4194304] 0 2024-09-13T21:44:59.524 INFO:tasks.workunit.client.1.smithi155.stdout:0/655: mknod d1/d6/dc/d4d/d4a/cfe 0 2024-09-13T21:44:59.527 INFO:tasks.workunit.client.1.smithi155.stdout:6/763: unlink db/d2c/dc0/cc9 0 2024-09-13T21:44:59.530 INFO:tasks.workunit.client.1.smithi155.stdout:1/620: rmdir d6 39 2024-09-13T21:44:59.532 INFO:tasks.workunit.client.1.smithi155.stdout:5/601: getdents d5/d16/d33 0 2024-09-13T21:44:59.533 INFO:tasks.workunit.client.1.smithi155.stdout:8/562: dwrite d2/d8/f4f [0,4194304] 0 2024-09-13T21:44:59.535 INFO:tasks.workunit.client.1.smithi155.stdout:5/602: readlink d5/d16/d33/d1b/l69 0 2024-09-13T21:44:59.538 INFO:tasks.workunit.client.1.smithi155.stdout:5/603: fdatasync d5/d16/d33/d1b/d2f/d3c/d6c/d45/f6d 0 2024-09-13T21:44:59.543 INFO:tasks.workunit.client.1.smithi155.stdout:2/590: rename d2/dd/d21/d39/dc1/da3/cb7 to d2/dd/cd0 0 2024-09-13T21:44:59.544 INFO:tasks.workunit.client.1.smithi155.stdout:1/621: truncate d6/d15/d23/fb8 465250 0 2024-09-13T21:44:59.545 INFO:tasks.workunit.client.1.smithi155.stdout:0/656: dread d1/d6/d97/db2/db5/fde [0,4194304] 0 2024-09-13T21:44:59.545 INFO:tasks.workunit.client.0.smithi119.stdout:1/936: dwrite d1/d3/d61/d77/d78/d32/dda/d19/d2d/fcf [0,4194304] 0 2024-09-13T21:44:59.548 INFO:tasks.workunit.client.0.smithi119.stdout:1/937: rmdir d1/d3/d61/d77/d78/d32/dda/d28/d110 39 2024-09-13T21:44:59.551 INFO:tasks.workunit.client.1.smithi155.stdout:3/709: truncate d3/d21/d4a/fe3 1122169 0 2024-09-13T21:44:59.551 INFO:tasks.workunit.client.1.smithi155.stdout:0/657: chown d1/d6/d97/db2/db5/cba 3401 1 2024-09-13T21:44:59.551 INFO:tasks.workunit.client.0.smithi119.stdout:1/938: rename d1/d3/d61/d77/l9a to d1/d3/d61/da9/l13f 0 2024-09-13T21:44:59.553 INFO:tasks.workunit.client.0.smithi119.stdout:1/939: creat d1/d3/d61/d77/d78/d32/dc3/f140 x:0 0 0 2024-09-13T21:44:59.556 INFO:tasks.workunit.client.0.smithi119.stdout:1/940: unlink d1/d3/d61/d77/d78/ccd 0 2024-09-13T21:44:59.557 INFO:tasks.workunit.client.1.smithi155.stdout:8/563: dread d2/d6/dd/f62 [0,4194304] 0 2024-09-13T21:44:59.558 INFO:tasks.workunit.client.1.smithi155.stdout:2/591: unlink d2/dd/de/d15/d38/lbe 0 2024-09-13T21:44:59.560 INFO:tasks.workunit.client.1.smithi155.stdout:9/665: dread dc/de/d6f/dae/de1/f66 [4194304,4194304] 0 2024-09-13T21:44:59.563 INFO:tasks.workunit.client.1.smithi155.stdout:4/553: dread d1/f1c [0,4194304] 0 2024-09-13T21:44:59.563 INFO:tasks.workunit.client.1.smithi155.stdout:6/764: dread db/d11/d1e/fce [0,4194304] 0 2024-09-13T21:44:59.566 INFO:tasks.workunit.client.1.smithi155.stdout:5/604: link d5/d16/d33/d1b/d59/fae d5/d16/d33/fc7 0 2024-09-13T21:44:59.567 INFO:tasks.workunit.client.1.smithi155.stdout:2/592: mknod d2/dd/de/d15/d38/cd1 0 2024-09-13T21:44:59.570 INFO:tasks.workunit.client.1.smithi155.stdout:9/666: unlink dc/d19/d21/d67/f69 0 2024-09-13T21:44:59.573 INFO:tasks.workunit.client.1.smithi155.stdout:7/583: dread d5/d13/f21 [4194304,4194304] 0 2024-09-13T21:44:59.576 INFO:tasks.workunit.client.1.smithi155.stdout:1/622: rename d6/d82/d91/daf/c79 to d6/d82/cd8 0 2024-09-13T21:44:59.577 INFO:tasks.workunit.client.1.smithi155.stdout:9/667: readlink dc/d18/d1e/d86/lab 0 2024-09-13T21:44:59.579 INFO:tasks.workunit.client.1.smithi155.stdout:3/710: creat d3/d25/d1b/d1f/d82/d83/ff1 x:0 0 0 2024-09-13T21:44:59.583 INFO:tasks.workunit.client.1.smithi155.stdout:0/658: dwrite d1/d6/dc/d4d/d4a/d9e/fc4 [0,4194304] 0 2024-09-13T21:44:59.585 INFO:tasks.workunit.client.1.smithi155.stdout:2/593: dwrite d2/dd/f17 [0,4194304] 0 2024-09-13T21:44:59.586 INFO:tasks.workunit.client.0.smithi119.stdout:1/941: dread d1/d3/dc/d24/fb0 [0,4194304] 0 2024-09-13T21:44:59.588 INFO:tasks.workunit.client.1.smithi155.stdout:4/554: dread d1/d7/d83/f9c [0,4194304] 0 2024-09-13T21:44:59.591 INFO:tasks.workunit.client.0.smithi119.stdout:1/942: getdents d1/d3/d6c 0 2024-09-13T21:44:59.591 INFO:tasks.workunit.client.1.smithi155.stdout:3/711: write d3/d25/d1b/d1f/d82/f9d [384316,56862] 0 2024-09-13T21:44:59.591 INFO:tasks.workunit.client.1.smithi155.stdout:8/564: dwrite d2/d8/f10 [4194304,4194304] 0 2024-09-13T21:44:59.591 INFO:tasks.workunit.client.1.smithi155.stdout:6/765: write db/d2c/f59 [917966,25139] 0 2024-09-13T21:44:59.594 INFO:tasks.workunit.client.1.smithi155.stdout:3/712: readlink d3/d25/d1b/l55 0 2024-09-13T21:44:59.594 INFO:tasks.workunit.client.0.smithi119.stdout:1/943: write d1/d3/d61/d77/d78/d32/dda/d19/d2d/d59/f12b [57300,50721] 0 2024-09-13T21:44:59.596 INFO:tasks.workunit.client.1.smithi155.stdout:1/623: creat d6/d7/d89/dd6/fd9 x:0 0 0 2024-09-13T21:44:59.597 INFO:tasks.workunit.client.0.smithi119.stdout:1/944: dread - d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9d/f131 zero size 2024-09-13T21:44:59.598 INFO:tasks.workunit.client.1.smithi155.stdout:4/555: mknod d1/d7/d21/d2d/cae 0 2024-09-13T21:44:59.599 INFO:tasks.workunit.client.0.smithi119.stdout:1/945: dread - d1/d3/d61/d7e/d53/f119 zero size 2024-09-13T21:44:59.601 INFO:tasks.workunit.client.0.smithi119.stdout:1/946: mkdir d1/d3/d61/d77/d78/d32/dda/d28/d93/d141 0 2024-09-13T21:44:59.605 INFO:tasks.workunit.client.1.smithi155.stdout:9/668: symlink dc/de/d6f/dae/de1/d38/le7 0 2024-09-13T21:44:59.605 INFO:tasks.workunit.client.1.smithi155.stdout:8/565: mkdir d2/dae 0 2024-09-13T21:44:59.605 INFO:tasks.workunit.client.1.smithi155.stdout:5/605: dwrite d5/d16/d33/d1b/d2f/d3c/fa7 [0,4194304] 0 2024-09-13T21:44:59.605 INFO:tasks.workunit.client.0.smithi119.stdout:1/947: rename d1/d3/d61/d77/d78/d32/d33/d43/c68 to d1/d3/d61/d77/d78/d32/dda/d19/d2d/d59/c142 0 2024-09-13T21:44:59.606 INFO:tasks.workunit.client.1.smithi155.stdout:0/659: mknod d1/d6/dc/d4d/d4a/cff 0 2024-09-13T21:44:59.608 INFO:tasks.workunit.client.1.smithi155.stdout:1/624: symlink d6/d15/d23/d55/lda 0 2024-09-13T21:44:59.609 INFO:tasks.workunit.client.1.smithi155.stdout:4/556: dread d1/d7/f9a [0,4194304] 0 2024-09-13T21:44:59.610 INFO:tasks.workunit.client.0.smithi119.stdout:1/948: truncate d1/d3/d61/d77/d78/d32/dda/d19/d2d/fae 5057662 0 2024-09-13T21:44:59.610 INFO:tasks.workunit.client.1.smithi155.stdout:6/766: creat db/d11/d2b/d35/dfc/f104 x:0 0 0 2024-09-13T21:44:59.610 INFO:tasks.workunit.client.1.smithi155.stdout:3/713: symlink d3/lf2 0 2024-09-13T21:44:59.613 INFO:tasks.workunit.client.0.smithi119.stdout:1/949: truncate d1/d3/dc/d24/fc1 30142 0 2024-09-13T21:44:59.613 INFO:tasks.workunit.client.1.smithi155.stdout:2/594: rename d2/db/f62 to d2/dd/de/d15/d38/d41/fd2 0 2024-09-13T21:44:59.614 INFO:tasks.workunit.client.1.smithi155.stdout:5/606: mkdir d5/d16/d33/d1b/d2f/d3c/d5b/d5f/dc8 0 2024-09-13T21:44:59.615 INFO:tasks.workunit.client.1.smithi155.stdout:0/660: symlink d1/d6/dc/d4d/d4a/d52/d5b/l100 0 2024-09-13T21:44:59.615 INFO:tasks.workunit.client.0.smithi119.stdout:1/950: symlink d1/d3/dc/l143 0 2024-09-13T21:44:59.616 INFO:tasks.workunit.client.1.smithi155.stdout:0/661: dread - d1/d6/dc/d4d/d4a/d52/d5c/fbd zero size 2024-09-13T21:44:59.617 INFO:tasks.workunit.client.0.smithi119.stdout:1/951: fsync d1/f1b 0 2024-09-13T21:44:59.620 INFO:tasks.workunit.client.1.smithi155.stdout:3/714: rename d3/d21/d4a/l57 to d3/d25/d1b/d1f/d36/d5c/dbc/lf3 0 2024-09-13T21:44:59.621 INFO:tasks.workunit.client.1.smithi155.stdout:6/767: unlink db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/dda/fed 0 2024-09-13T21:44:59.622 INFO:tasks.workunit.client.0.smithi119.stdout:1/952: read d1/d3/f13 [2421277,84143] 0 2024-09-13T21:44:59.628 INFO:tasks.workunit.client.1.smithi155.stdout:8/566: link d2/d6/f6a d2/d8/d5e/faf 0 2024-09-13T21:44:59.629 INFO:tasks.workunit.client.1.smithi155.stdout:0/662: mknod d1/d6/dc/d90/df1/c101 0 2024-09-13T21:44:59.630 INFO:tasks.workunit.client.1.smithi155.stdout:8/567: chown d2/d6/dd/d12/l40 215430 1 2024-09-13T21:44:59.630 INFO:tasks.workunit.client.1.smithi155.stdout:6/768: stat db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/c70 0 2024-09-13T21:44:59.632 INFO:tasks.workunit.client.1.smithi155.stdout:1/625: rename d6/d15/d23/d55/fa0 to d6/d15/d23/d87/d95/fdb 0 2024-09-13T21:44:59.636 INFO:tasks.workunit.client.1.smithi155.stdout:6/769: dread - db/d11/d6d/db9/d1c/d36/fb2 zero size 2024-09-13T21:44:59.636 INFO:tasks.workunit.client.1.smithi155.stdout:5/607: creat d5/d16/d33/fc9 x:0 0 0 2024-09-13T21:44:59.639 INFO:tasks.workunit.client.1.smithi155.stdout:3/715: creat d3/d25/d1b/d1f/d82/ff4 x:0 0 0 2024-09-13T21:44:59.648 INFO:tasks.workunit.client.1.smithi155.stdout:9/669: dread dc/de/d6f/dae/de1/f9a [0,4194304] 0 2024-09-13T21:44:59.648 INFO:tasks.workunit.client.1.smithi155.stdout:3/716: creat d3/d25/d1b/d1f/d82/d83/d99/ff5 x:0 0 0 2024-09-13T21:44:59.654 INFO:tasks.workunit.client.1.smithi155.stdout:4/557: truncate d1/d7/d21/d2d/f6d 1557347 0 2024-09-13T21:44:59.654 INFO:tasks.workunit.client.1.smithi155.stdout:8/568: dwrite d2/d6/dd/d25/f85 [0,4194304] 0 2024-09-13T21:44:59.655 INFO:tasks.workunit.client.1.smithi155.stdout:6/770: dwrite db/d11/d2b/ffb [0,4194304] 0 2024-09-13T21:44:59.656 INFO:tasks.workunit.client.1.smithi155.stdout:3/717: chown d3/d25/f1c 664794724 1 2024-09-13T21:44:59.657 INFO:tasks.workunit.client.1.smithi155.stdout:0/663: dwrite d1/d6/dc/d4d/d4a/d4e/f53 [4194304,4194304] 0 2024-09-13T21:44:59.660 INFO:tasks.workunit.client.1.smithi155.stdout:5/608: truncate d5/d16/d33/d1b/d2f/d3c/d6c/f79 651590 0 2024-09-13T21:44:59.662 INFO:tasks.workunit.client.1.smithi155.stdout:2/595: write d2/db/f16 [3457805,108178] 0 2024-09-13T21:44:59.665 INFO:tasks.workunit.client.1.smithi155.stdout:5/609: chown d5/la0 244609 1 2024-09-13T21:44:59.665 INFO:tasks.workunit.client.1.smithi155.stdout:6/771: read db/d11/d2b/d35/fbe [1782565,52652] 0 2024-09-13T21:44:59.668 INFO:tasks.workunit.client.1.smithi155.stdout:1/626: link d6/d15/d57/cc2 d6/d7/cdc 0 2024-09-13T21:44:59.670 INFO:tasks.workunit.client.1.smithi155.stdout:1/627: readlink d6/d7/d48/ld4 0 2024-09-13T21:44:59.671 INFO:tasks.workunit.client.1.smithi155.stdout:3/718: fsync d3/d25/d1b/d1f/d82/d83/d99/da6/fef 0 2024-09-13T21:44:59.672 INFO:tasks.workunit.client.1.smithi155.stdout:5/610: mkdir d5/d16/d33/d1b/d92/dca 0 2024-09-13T21:44:59.673 INFO:tasks.workunit.client.1.smithi155.stdout:0/664: write d1/d6/dc/d4d/f71 [1977700,37267] 0 2024-09-13T21:44:59.678 INFO:tasks.workunit.client.1.smithi155.stdout:8/569: mkdir d2/d2d/d96/db0 0 2024-09-13T21:44:59.681 INFO:tasks.workunit.client.1.smithi155.stdout:0/665: truncate d1/d6/dc/d4d/d4a/d52/f6d 1387683 0 2024-09-13T21:44:59.681 INFO:tasks.workunit.client.1.smithi155.stdout:1/628: dwrite d6/d15/d23/d87/d95/f97 [0,4194304] 0 2024-09-13T21:44:59.683 INFO:tasks.workunit.client.1.smithi155.stdout:3/719: mknod d3/d25/d1b/d1f/d36/d7c/cf6 0 2024-09-13T21:44:59.686 INFO:tasks.workunit.client.1.smithi155.stdout:9/670: rename dc/de/d6f/d71/cd0 to dc/d19/d21/ce8 0 2024-09-13T21:44:59.688 INFO:tasks.workunit.client.1.smithi155.stdout:0/666: mknod d1/d6/d97/db2/c102 0 2024-09-13T21:44:59.689 INFO:tasks.workunit.client.1.smithi155.stdout:4/558: getdents d1/d7/de/d72/da6 0 2024-09-13T21:44:59.692 INFO:tasks.workunit.client.1.smithi155.stdout:0/667: write d1/d6/dc/d4d/d4a/d52/f56 [1100535,8651] 0 2024-09-13T21:44:59.693 INFO:tasks.workunit.client.1.smithi155.stdout:5/611: rename d5/d16/d33/d1b/d1e/f72 to d5/d16/d33/d1b/d2f/fcb 0 2024-09-13T21:44:59.701 INFO:tasks.workunit.client.1.smithi155.stdout:5/612: creat d5/d16/d33/d1b/d1e/fcc x:0 0 0 2024-09-13T21:44:59.702 INFO:tasks.workunit.client.1.smithi155.stdout:6/772: dwrite db/d11/d6d/db9/d1c/f6e [0,4194304] 0 2024-09-13T21:44:59.704 INFO:tasks.workunit.client.1.smithi155.stdout:3/720: getdents d3/d25/d1b/d1f/d36/d5c 0 2024-09-13T21:44:59.704 INFO:tasks.workunit.client.1.smithi155.stdout:5/613: stat d5/d16/d33/d1b/d2f/d3c/d6c/f77 0 2024-09-13T21:44:59.708 INFO:tasks.workunit.client.1.smithi155.stdout:2/596: dread d2/dd/d21/d39/dc1/d96/f99 [0,4194304] 0 2024-09-13T21:44:59.709 INFO:tasks.workunit.client.1.smithi155.stdout:4/559: getdents d1/d7/d21/d69/d98 0 2024-09-13T21:44:59.713 INFO:tasks.workunit.client.1.smithi155.stdout:2/597: dread d2/dd/de/d15/f46 [0,4194304] 0 2024-09-13T21:44:59.714 INFO:tasks.workunit.client.1.smithi155.stdout:5/614: unlink d5/d16/d81/d98/ca3 0 2024-09-13T21:44:59.714 INFO:tasks.workunit.client.0.smithi119.stdout:2/950: sync 2024-09-13T21:44:59.715 INFO:tasks.workunit.client.0.smithi119.stdout:2/951: write d1/d7/f11 [2190692,59050] 0 2024-09-13T21:44:59.716 INFO:tasks.workunit.client.0.smithi119.stdout:2/952: read - d1/fd0 zero size 2024-09-13T21:44:59.716 INFO:tasks.workunit.client.1.smithi155.stdout:2/598: stat d2/dd/d21/d8d/fb9 0 2024-09-13T21:44:59.717 INFO:tasks.workunit.client.1.smithi155.stdout:0/668: getdents d1 0 2024-09-13T21:44:59.717 INFO:tasks.workunit.client.0.smithi119.stdout:2/953: fsync d1/d127/fac 0 2024-09-13T21:44:59.721 INFO:tasks.workunit.client.1.smithi155.stdout:9/671: dwrite dc/d18/d1e/fa4 [0,4194304] 0 2024-09-13T21:44:59.721 INFO:tasks.workunit.client.1.smithi155.stdout:0/669: write d1/feb [807788,76333] 0 2024-09-13T21:44:59.723 INFO:tasks.workunit.client.0.smithi119.stdout:2/954: dwrite d1/d7/fbd [0,4194304] 0 2024-09-13T21:44:59.723 INFO:tasks.workunit.client.1.smithi155.stdout:6/773: link db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/ce9 db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d88/c105 0 2024-09-13T21:44:59.725 INFO:tasks.workunit.client.0.smithi119.stdout:2/955: truncate d1/d38/d89/d6b/d8c/fa8 448216 0 2024-09-13T21:44:59.726 INFO:tasks.workunit.client.0.smithi119.stdout:2/956: write d1/d7/fba [2956721,103637] 0 2024-09-13T21:44:59.726 INFO:tasks.workunit.client.1.smithi155.stdout:5/615: chown d5/d16/d33/d1b/d2f/d3c/d6c/d45/f65 315 1 2024-09-13T21:44:59.726 INFO:tasks.workunit.client.0.smithi119.stdout:2/957: stat d1/ff2 0 2024-09-13T21:44:59.727 INFO:tasks.workunit.client.1.smithi155.stdout:1/629: dread d6/d15/f4c [0,4194304] 0 2024-09-13T21:44:59.728 INFO:tasks.workunit.client.0.smithi119.stdout:2/958: write d1/d22/d55/fcb [1910221,50442] 0 2024-09-13T21:44:59.728 INFO:tasks.workunit.client.1.smithi155.stdout:4/560: rename d1/l8a to d1/d7/de/d15/d55/laf 0 2024-09-13T21:44:59.728 INFO:tasks.workunit.client.0.smithi119.stdout:2/959: chown d1/c4 9994 1 2024-09-13T21:44:59.729 INFO:tasks.workunit.client.1.smithi155.stdout:0/670: creat d1/f103 x:0 0 0 2024-09-13T21:44:59.731 INFO:tasks.workunit.client.0.smithi119.stdout:2/960: write d1/d7/d47/fa3 [302121,123311] 0 2024-09-13T21:44:59.732 INFO:tasks.workunit.client.1.smithi155.stdout:4/561: chown d1/d7/de/d15/d55/d5e/d66 2582 1 2024-09-13T21:44:59.732 INFO:tasks.workunit.client.1.smithi155.stdout:5/616: write d5/d16/d33/d1b/d2f/d3c/fa7 [254543,32207] 0 2024-09-13T21:44:59.732 INFO:tasks.workunit.client.0.smithi119.stdout:2/961: rmdir d1/d22/d7c/dfe/d110 39 2024-09-13T21:44:59.732 INFO:tasks.workunit.client.1.smithi155.stdout:2/599: mkdir d2/dd/dd3 0 2024-09-13T21:44:59.733 INFO:tasks.workunit.client.1.smithi155.stdout:9/672: symlink dc/de/d5c/le9 0 2024-09-13T21:44:59.733 INFO:tasks.workunit.client.0.smithi119.stdout:2/962: read - d1/d22/d5a/d5d/d83/f11f zero size 2024-09-13T21:44:59.737 INFO:tasks.workunit.client.1.smithi155.stdout:1/630: creat d6/d15/d23/d87/fdd x:0 0 0 2024-09-13T21:44:59.740 INFO:tasks.workunit.client.1.smithi155.stdout:6/774: creat db/d11/d2b/df6/f106 x:0 0 0 2024-09-13T21:44:59.743 INFO:tasks.workunit.client.1.smithi155.stdout:9/673: creat dc/de/d2d/d79/d43/fea x:0 0 0 2024-09-13T21:44:59.745 INFO:tasks.workunit.client.0.smithi119.stdout:2/963: dwrite d1/d22/f5f [0,4194304] 0 2024-09-13T21:44:59.745 INFO:tasks.workunit.client.1.smithi155.stdout:2/600: rename d2/dd/de/d15/d38/d41/d5f/c95 to d2/dd/d21/d39/dc1/d31/d5d/cd4 0 2024-09-13T21:44:59.747 INFO:tasks.workunit.client.1.smithi155.stdout:6/775: mkdir db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/d107 0 2024-09-13T21:44:59.748 INFO:tasks.workunit.client.1.smithi155.stdout:1/631: write d6/d15/d23/d55/d6e/dbb/f46 [1558606,108005] 0 2024-09-13T21:44:59.749 INFO:tasks.workunit.client.0.smithi119.stdout:2/964: creat d1/d22/d55/f12f x:0 0 0 2024-09-13T21:44:59.749 INFO:tasks.workunit.client.1.smithi155.stdout:1/632: chown d6/d15/d57/d99/c7a 7067901 1 2024-09-13T21:44:59.750 INFO:tasks.workunit.client.1.smithi155.stdout:2/601: stat d2/dd/d21/d39/dc1/d96/dba/fbf 0 2024-09-13T21:44:59.751 INFO:tasks.workunit.client.1.smithi155.stdout:1/633: write d6/d7/d48/f96 [1197812,61977] 0 2024-09-13T21:44:59.751 INFO:tasks.workunit.client.1.smithi155.stdout:9/674: mknod dc/de/d6f/da3/ceb 0 2024-09-13T21:44:59.751 INFO:tasks.workunit.client.0.smithi119.stdout:2/965: unlink d1/d38/fa2 0 2024-09-13T21:44:59.753 INFO:tasks.workunit.client.1.smithi155.stdout:6/776: mkdir db/d11/d1e/d108 0 2024-09-13T21:44:59.755 INFO:tasks.workunit.client.0.smithi119.stdout:2/966: rename d1/d22/d5a/d5d/db7 to d1/d130 0 2024-09-13T21:44:59.758 INFO:tasks.workunit.client.0.smithi119.stdout:2/967: rename d1/d22/d5a/d5d/f61 to d1/d38/f131 0 2024-09-13T21:44:59.758 INFO:tasks.workunit.client.0.smithi119.stdout:2/968: stat d1/d38/f131 0 2024-09-13T21:44:59.758 INFO:tasks.workunit.client.1.smithi155.stdout:3/721: dread d3/d21/fc6 [0,4194304] 0 2024-09-13T21:44:59.759 INFO:tasks.workunit.client.0.smithi119.stdout:2/969: write d1/d22/db6/dde/f11d [488284,79465] 0 2024-09-13T21:44:59.759 INFO:tasks.workunit.client.1.smithi155.stdout:9/675: mkdir dc/de/d6f/dae/de1/d38/d90/d74/dec 0 2024-09-13T21:44:59.760 INFO:tasks.workunit.client.1.smithi155.stdout:6/777: mknod db/d11/d1e/dca/de1/c109 0 2024-09-13T21:44:59.760 INFO:tasks.workunit.client.0.smithi119.stdout:2/970: write d1/d22/db6/ff7 [678510,123583] 0 2024-09-13T21:44:59.760 INFO:tasks.workunit.client.1.smithi155.stdout:3/722: truncate d3/d10/fe0 4942109 0 2024-09-13T21:44:59.762 INFO:tasks.workunit.client.0.smithi119.stdout:2/971: symlink d1/d22/d55/d31/l132 0 2024-09-13T21:44:59.762 INFO:tasks.workunit.client.0.smithi119.stdout:1/953: sync 2024-09-13T21:44:59.762 INFO:tasks.workunit.client.1.smithi155.stdout:1/634: dwrite d6/d15/f58 [0,4194304] 0 2024-09-13T21:44:59.763 INFO:tasks.workunit.client.1.smithi155.stdout:9/676: truncate dc/de/d2d/fc9 718159 0 2024-09-13T21:44:59.764 INFO:tasks.workunit.client.0.smithi119.stdout:1/954: unlink d1/cb 0 2024-09-13T21:44:59.764 INFO:tasks.workunit.client.1.smithi155.stdout:1/635: chown d6/d7/d48/c54 29698129 1 2024-09-13T21:44:59.766 INFO:tasks.workunit.client.1.smithi155.stdout:3/723: mknod d3/d25/d1b/cf7 0 2024-09-13T21:44:59.769 INFO:tasks.workunit.client.1.smithi155.stdout:9/677: readlink dc/de/d2d/d79/d43/la5 0 2024-09-13T21:44:59.772 INFO:tasks.workunit.client.1.smithi155.stdout:1/636: creat d6/d15/d23/d55/d6e/dbb/d4b/fde x:0 0 0 2024-09-13T21:44:59.773 INFO:tasks.workunit.client.1.smithi155.stdout:6/778: rename db/d11/d1e/d21/d44/daa/fe8 to db/d11/d6d/db9/de6/d5f/de4/f10a 0 2024-09-13T21:44:59.774 INFO:tasks.workunit.client.1.smithi155.stdout:9/678: dread - dc/d19/d21/d67/fd2 zero size 2024-09-13T21:44:59.774 INFO:tasks.workunit.client.1.smithi155.stdout:1/637: fdatasync d6/d15/d57/d99/f4a 0 2024-09-13T21:44:59.776 INFO:tasks.workunit.client.0.smithi119.stdout:2/972: getdents d1/d22/d55 0 2024-09-13T21:44:59.778 INFO:tasks.workunit.client.0.smithi119.stdout:2/973: rmdir d1/d22/d5a/d5d/d77/daa/deb 39 2024-09-13T21:44:59.780 INFO:tasks.workunit.client.0.smithi119.stdout:2/974: creat d1/d38/d89/d6b/d8c/f133 x:0 0 0 2024-09-13T21:44:59.780 INFO:tasks.workunit.client.1.smithi155.stdout:5/617: truncate d5/d16/d33/d1b/d59/f8a 79942 0 2024-09-13T21:44:59.782 INFO:tasks.workunit.client.1.smithi155.stdout:9/679: dwrite dc/de/d2d/d79/f41 [4194304,4194304] 0 2024-09-13T21:44:59.783 INFO:tasks.workunit.client.1.smithi155.stdout:6/779: truncate db/d11/d2b/d35/f29 2143357 0 2024-09-13T21:44:59.783 INFO:tasks.workunit.client.0.smithi119.stdout:2/975: mkdir d1/d22/d134 0 2024-09-13T21:44:59.785 INFO:tasks.workunit.client.0.smithi119.stdout:1/955: fdatasync d1/d3/d61/d77/d78/d32/d33/dd0/fd1 0 2024-09-13T21:44:59.786 INFO:tasks.workunit.client.1.smithi155.stdout:9/680: creat dc/de/d2d/d79/fed x:0 0 0 2024-09-13T21:44:59.786 INFO:tasks.workunit.client.1.smithi155.stdout:4/562: dread d1/d7/de/d15/f5b [4194304,4194304] 0 2024-09-13T21:44:59.788 INFO:tasks.workunit.client.0.smithi119.stdout:1/956: symlink d1/d3/d61/d77/d78/d32/d33/d43/d74/l144 0 2024-09-13T21:44:59.789 INFO:tasks.workunit.client.1.smithi155.stdout:4/563: truncate d1/d7/fa1 918867 0 2024-09-13T21:44:59.790 INFO:tasks.workunit.client.0.smithi119.stdout:1/957: chown d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9d/f131 88172774 1 2024-09-13T21:44:59.790 INFO:tasks.workunit.client.1.smithi155.stdout:9/681: mknod dc/d18/d50/cee 0 2024-09-13T21:44:59.791 INFO:tasks.workunit.client.1.smithi155.stdout:6/780: getdents db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/d107 0 2024-09-13T21:44:59.793 INFO:tasks.workunit.client.0.smithi119.stdout:1/958: mkdir d1/d3/d61/d77/d78/d32/d33/d145 0 2024-09-13T21:44:59.795 INFO:tasks.workunit.client.1.smithi155.stdout:5/618: dread d5/f1c [0,4194304] 0 2024-09-13T21:44:59.797 INFO:tasks.workunit.client.1.smithi155.stdout:9/682: symlink dc/lef 0 2024-09-13T21:44:59.798 INFO:tasks.workunit.client.1.smithi155.stdout:3/724: write d3/d21/d4a/fe3 [420057,7556] 0 2024-09-13T21:44:59.799 INFO:tasks.workunit.client.0.smithi119.stdout:2/976: dwrite d1/d7/d47/f8b [0,4194304] 0 2024-09-13T21:44:59.800 INFO:tasks.workunit.client.1.smithi155.stdout:6/781: creat db/d11/d1e/d21/d44/f10b x:0 0 0 2024-09-13T21:44:59.801 INFO:tasks.workunit.client.0.smithi119.stdout:1/959: rename d1/d3/d61/d77/d78/d32/dda/d19/d2d/fec to d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/dd8/d8c/f146 0 2024-09-13T21:44:59.803 INFO:tasks.workunit.client.1.smithi155.stdout:9/683: mkdir dc/de/d6f/dae/df0 0 2024-09-13T21:44:59.803 INFO:tasks.workunit.client.1.smithi155.stdout:1/638: truncate d6/f16 754338 0 2024-09-13T21:44:59.804 INFO:tasks.workunit.client.0.smithi119.stdout:2/977: creat d1/d7/f135 x:0 0 0 2024-09-13T21:44:59.807 INFO:tasks.workunit.client.0.smithi119.stdout:1/960: symlink d1/d3/dc/l147 0 2024-09-13T21:44:59.808 INFO:tasks.workunit.client.1.smithi155.stdout:9/684: chown dc/d18/d50/cee 387087312 1 2024-09-13T21:44:59.808 INFO:tasks.workunit.client.1.smithi155.stdout:4/564: rmdir d1/d7/de/dc/d7c 0 2024-09-13T21:44:59.809 INFO:tasks.workunit.client.1.smithi155.stdout:4/565: truncate d1/d7/d21/f3a 4289389 0 2024-09-13T21:44:59.809 INFO:tasks.workunit.client.1.smithi155.stdout:5/619: symlink d5/d16/d33/d1b/d2f/d3c/d5b/dc1/lcd 0 2024-09-13T21:44:59.809 INFO:tasks.workunit.client.0.smithi119.stdout:2/978: rmdir d1/d22/d5a/da9 39 2024-09-13T21:44:59.809 INFO:tasks.workunit.client.0.smithi119.stdout:2/979: write d1/d22/d5a/d5d/d77/daa/fb3 [4340136,5419] 0 2024-09-13T21:44:59.809 INFO:tasks.workunit.client.0.smithi119.stdout:1/961: mkdir d1/d3/d61/d77/d78/d32/dda/d28/d93/d139/d148 0 2024-09-13T21:44:59.809 INFO:tasks.workunit.client.0.smithi119.stdout:2/980: readlink d1/d22/d5a/d5d/d83/l84 0 2024-09-13T21:44:59.812 INFO:tasks.workunit.client.0.smithi119.stdout:1/962: mknod d1/d3/d61/d77/d78/d32/d33/d72/db4/c149 0 2024-09-13T21:44:59.812 INFO:tasks.workunit.client.1.smithi155.stdout:1/639: unlink d6/d15/f20 0 2024-09-13T21:44:59.815 INFO:tasks.workunit.client.0.smithi119.stdout:1/963: rename d1/d3/f4 to d1/d3/d61/d77/d78/f14a 0 2024-09-13T21:44:59.817 INFO:tasks.workunit.client.1.smithi155.stdout:4/566: creat d1/d7/d21/d2d/d42/fb0 x:0 0 0 2024-09-13T21:44:59.818 INFO:tasks.workunit.client.0.smithi119.stdout:1/964: creat d1/d3/d61/d77/d78/d32/d33/f14b x:0 0 0 2024-09-13T21:44:59.820 INFO:tasks.workunit.client.1.smithi155.stdout:5/620: symlink d5/d16/d33/lce 0 2024-09-13T21:44:59.820 INFO:tasks.workunit.client.0.smithi119.stdout:1/965: symlink d1/d3/d6c/l14c 0 2024-09-13T21:44:59.821 INFO:tasks.workunit.client.0.smithi119.stdout:1/966: fdatasync d1/d3/d61/d77/d78/d32/dda/d19/f108 0 2024-09-13T21:44:59.822 INFO:tasks.workunit.client.1.smithi155.stdout:4/567: creat d1/d7/de/d1a/fb1 x:0 0 0 2024-09-13T21:44:59.823 INFO:tasks.workunit.client.1.smithi155.stdout:6/782: getdents db/d11/d86 0 2024-09-13T21:44:59.824 INFO:tasks.workunit.client.1.smithi155.stdout:5/621: creat d5/d16/d33/d1b/d2f/d3c/d44/fcf x:0 0 0 2024-09-13T21:44:59.825 INFO:tasks.workunit.client.0.smithi119.stdout:1/967: rmdir d1/d3/d6c/da8/d11a 0 2024-09-13T21:44:59.826 INFO:tasks.workunit.client.1.smithi155.stdout:6/783: dread - db/d11/d6d/db9/de6/d5f/ff3 zero size 2024-09-13T21:44:59.827 INFO:tasks.workunit.client.0.smithi119.stdout:2/981: write d1/d7/d47/f7e [391415,40356] 0 2024-09-13T21:44:59.828 INFO:tasks.workunit.client.1.smithi155.stdout:3/725: dread d3/d10/f8d [0,4194304] 0 2024-09-13T21:44:59.831 INFO:tasks.workunit.client.0.smithi119.stdout:2/982: creat d1/d22/d5a/da9/d12d/f136 x:0 0 0 2024-09-13T21:44:59.832 INFO:tasks.workunit.client.1.smithi155.stdout:6/784: mknod db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/dda/c10c 0 2024-09-13T21:44:59.833 INFO:tasks.workunit.client.0.smithi119.stdout:1/968: dwrite d1/d3/d61/d77/d78/d32/dc3/f140 [0,4194304] 0 2024-09-13T21:44:59.834 INFO:tasks.workunit.client.1.smithi155.stdout:6/785: fdatasync db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/fae 0 2024-09-13T21:44:59.835 INFO:tasks.workunit.client.1.smithi155.stdout:1/640: dread d6/d7/f24 [0,4194304] 0 2024-09-13T21:44:59.836 INFO:tasks.workunit.client.1.smithi155.stdout:3/726: rename d3/d25/d17/d52/ld0 to d3/d21/d4a/dcd/dd8/lf8 0 2024-09-13T21:44:59.836 INFO:tasks.workunit.client.0.smithi119.stdout:2/983: write d1/d22/d5a/d5d/d77/fb5 [4710849,90183] 0 2024-09-13T21:44:59.839 INFO:tasks.workunit.client.1.smithi155.stdout:3/727: creat d3/d21/d4a/ff9 x:0 0 0 2024-09-13T21:44:59.842 INFO:tasks.workunit.client.0.smithi119.stdout:2/984: dwrite d1/d22/db6/dde/f11d [0,4194304] 0 2024-09-13T21:44:59.843 INFO:tasks.workunit.client.1.smithi155.stdout:4/568: dread d1/d7/d21/d69/f96 [0,4194304] 0 2024-09-13T21:44:59.844 INFO:tasks.workunit.client.1.smithi155.stdout:6/786: symlink db/d11/d6d/db9/d1c/d36/d37/db7/l10d 0 2024-09-13T21:44:59.844 INFO:tasks.workunit.client.1.smithi155.stdout:1/641: creat d6/d15/d23/d87/d95/fdf x:0 0 0 2024-09-13T21:44:59.845 INFO:tasks.workunit.client.0.smithi119.stdout:2/985: truncate d1/fd0 270303 0 2024-09-13T21:44:59.851 INFO:tasks.workunit.client.0.smithi119.stdout:1/969: dwrite d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/fc8 [0,4194304] 0 2024-09-13T21:44:59.852 INFO:tasks.workunit.client.1.smithi155.stdout:6/787: rename db/d11/d6d/db9/de6/d5f/f84 to db/d11/d6d/db9/d1c/f10e 0 2024-09-13T21:44:59.855 INFO:tasks.workunit.client.1.smithi155.stdout:5/622: dwrite d5/d16/d81/d98/f4d [0,4194304] 0 2024-09-13T21:44:59.858 INFO:tasks.workunit.client.0.smithi119.stdout:1/970: dwrite d1/d3/d61/d77/d78/d32/dda/d19/fb7 [0,4194304] 0 2024-09-13T21:44:59.861 INFO:tasks.workunit.client.1.smithi155.stdout:6/788: write db/d11/d6d/db9/d1c/d36/d83/ddd/f6c [361853,37154] 0 2024-09-13T21:44:59.861 INFO:tasks.workunit.client.1.smithi155.stdout:5/623: creat d5/d16/d81/d98/d84/fd0 x:0 0 0 2024-09-13T21:44:59.861 INFO:tasks.workunit.client.1.smithi155.stdout:6/789: dread - db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/d93/f100 zero size 2024-09-13T21:44:59.862 INFO:tasks.workunit.client.1.smithi155.stdout:5/624: mkdir d5/d16/d33/d1b/d59/dd1 0 2024-09-13T21:44:59.864 INFO:tasks.workunit.client.0.smithi119.stdout:2/986: dread d1/d22/d55/d31/fbe [0,4194304] 0 2024-09-13T21:44:59.864 INFO:tasks.workunit.client.1.smithi155.stdout:6/790: read db/d11/d6d/db9/d1c/d36/d83/ddd/d64/f77 [1274263,53431] 0 2024-09-13T21:44:59.868 INFO:tasks.workunit.client.0.smithi119.stdout:2/987: write d1/d38/d89/d6b/d8c/fc1 [2996145,69834] 0 2024-09-13T21:44:59.869 INFO:tasks.workunit.client.1.smithi155.stdout:5/625: dread d5/d16/d33/d1b/d1e/f5d [0,4194304] 0 2024-09-13T21:44:59.870 INFO:tasks.workunit.client.0.smithi119.stdout:2/988: mknod d1/d9d/dff/c137 0 2024-09-13T21:44:59.872 INFO:tasks.workunit.client.1.smithi155.stdout:5/626: creat d5/d16/d33/d1b/d2f/d3c/fd2 x:0 0 0 2024-09-13T21:44:59.873 INFO:tasks.workunit.client.1.smithi155.stdout:3/728: write d3/fa [2062596,21562] 0 2024-09-13T21:44:59.874 INFO:tasks.workunit.client.0.smithi119.stdout:2/989: rename d1/d22/d55/f44 to d1/d22/d5a/d5d/f138 0 2024-09-13T21:44:59.874 INFO:tasks.workunit.client.1.smithi155.stdout:5/627: rmdir d5/d16/d33/d1b/d2f/d3c/d6c 39 2024-09-13T21:44:59.876 INFO:tasks.workunit.client.0.smithi119.stdout:2/990: mknod d1/d7/d47/df3/d108/c139 0 2024-09-13T21:44:59.876 INFO:tasks.workunit.client.1.smithi155.stdout:4/569: truncate d1/d7/d21/d69/d98/f85 804364 0 2024-09-13T21:44:59.878 INFO:tasks.workunit.client.1.smithi155.stdout:3/729: creat d3/d25/d1b/ffa x:0 0 0 2024-09-13T21:44:59.878 INFO:tasks.workunit.client.1.smithi155.stdout:5/628: rmdir d5/d16/d33/d1b/d92 39 2024-09-13T21:44:59.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:59 smithi119 ceph-mon[27653]: pgmap v14: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 135 MiB/s rd, 386 MiB/s wr, 746 op/s 2024-09-13T21:44:59.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:59 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:59.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:44:59 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:44:59.880 INFO:tasks.workunit.client.1.smithi155.stdout:4/570: write d1/d7/d21/d69/f96 [2624487,73903] 0 2024-09-13T21:44:59.881 INFO:tasks.workunit.client.1.smithi155.stdout:3/730: readlink d3/d21/d4a/l79 0 2024-09-13T21:44:59.882 INFO:tasks.workunit.client.1.smithi155.stdout:5/629: symlink d5/d16/db4/ld3 0 2024-09-13T21:44:59.883 INFO:tasks.workunit.client.1.smithi155.stdout:1/642: dwrite d6/f33 [0,4194304] 0 2024-09-13T21:44:59.884 INFO:tasks.workunit.client.1.smithi155.stdout:4/571: fdatasync d1/d7/de/d15/d55/d5e/f5f 0 2024-09-13T21:44:59.887 INFO:tasks.workunit.client.1.smithi155.stdout:1/643: mkdir d6/d7/d89/dd6/de0 0 2024-09-13T21:44:59.888 INFO:tasks.workunit.client.1.smithi155.stdout:5/630: mknod d5/d16/d33/d1b/d2f/d3c/d44/d80/cd4 0 2024-09-13T21:44:59.892 INFO:tasks.workunit.client.1.smithi155.stdout:1/644: mknod d6/d15/d57/d99/ce1 0 2024-09-13T21:44:59.895 INFO:tasks.workunit.client.1.smithi155.stdout:3/731: dread d3/d25/d1b/d1f/d82/d83/f9b [0,4194304] 0 2024-09-13T21:44:59.896 INFO:tasks.workunit.client.0.smithi119.stdout:1/971: dwrite d1/d3/d61/d77/d78/f9c [0,4194304] 0 2024-09-13T21:44:59.897 INFO:tasks.workunit.client.1.smithi155.stdout:6/791: truncate db/f1f 1686965 0 2024-09-13T21:44:59.898 INFO:tasks.workunit.client.0.smithi119.stdout:1/972: read d1/d3/d61/d77/d78/d32/dc3/f140 [3787917,24153] 0 2024-09-13T21:44:59.900 INFO:tasks.workunit.client.1.smithi155.stdout:1/645: mkdir d6/d15/d23/d87/de2 0 2024-09-13T21:44:59.900 INFO:tasks.workunit.client.0.smithi119.stdout:2/991: rename d1/d22/d55/d31/fbe to d1/d22/d7c/dfe/d110/f13a 0 2024-09-13T21:44:59.900 INFO:tasks.workunit.client.0.smithi119.stdout:2/992: write d1/ff2 [408898,123881] 0 2024-09-13T21:44:59.901 INFO:tasks.workunit.client.1.smithi155.stdout:3/732: rename d3/d25/l51 to d3/d21/d4a/dcd/dd8/lfb 0 2024-09-13T21:44:59.902 INFO:tasks.workunit.client.0.smithi119.stdout:1/973: chown d1/d3/d61/d77/d78/d32/dda/d28/d110/c12f 2391 1 2024-09-13T21:44:59.904 INFO:tasks.workunit.client.0.smithi119.stdout:1/974: rmdir d1 39 2024-09-13T21:44:59.905 INFO:tasks.workunit.client.1.smithi155.stdout:3/733: dread - d3/d25/d1b/d1f/d36/d5c/fb9 zero size 2024-09-13T21:44:59.907 INFO:tasks.workunit.client.1.smithi155.stdout:6/792: mknod db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/c10f 0 2024-09-13T21:44:59.908 INFO:tasks.workunit.client.1.smithi155.stdout:1/646: symlink d6/d15/d23/d55/d6e/le3 0 2024-09-13T21:44:59.912 INFO:tasks.workunit.client.0.smithi119.stdout:1/975: dwrite d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9d/fca [4194304,4194304] 0 2024-09-13T21:44:59.913 INFO:tasks.workunit.client.1.smithi155.stdout:6/793: unlink db/f2f 0 2024-09-13T21:44:59.914 INFO:tasks.workunit.client.1.smithi155.stdout:4/572: dread d1/d7/de/d72/f34 [0,4194304] 0 2024-09-13T21:44:59.914 INFO:tasks.workunit.client.0.smithi119.stdout:1/976: symlink d1/d3/d61/d77/d78/d32/d33/dd0/l14d 0 2024-09-13T21:44:59.916 INFO:tasks.workunit.client.1.smithi155.stdout:3/734: dwrite d3/d25/d1b/d1f/d82/d83/d99/ff5 [0,4194304] 0 2024-09-13T21:44:59.918 INFO:tasks.workunit.client.1.smithi155.stdout:1/647: read d6/d15/d23/d55/d6e/dbb/d4b/f6d [2734606,12193] 0 2024-09-13T21:44:59.924 INFO:tasks.workunit.client.1.smithi155.stdout:4/573: creat d1/d7/de/d15/d55/d5e/d66/d7e/fb2 x:0 0 0 2024-09-13T21:44:59.924 INFO:tasks.workunit.client.1.smithi155.stdout:6/794: rename db/d11/d6d/db9/d90 to db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/d8e/d110 0 2024-09-13T21:44:59.927 INFO:tasks.workunit.client.1.smithi155.stdout:1/648: unlink d6/d82/l8c 0 2024-09-13T21:44:59.929 INFO:tasks.workunit.client.1.smithi155.stdout:4/574: creat d1/d7/de/dc/fb3 x:0 0 0 2024-09-13T21:44:59.929 INFO:tasks.workunit.client.1.smithi155.stdout:6/795: symlink db/d11/d1e/dca/l111 0 2024-09-13T21:44:59.930 INFO:tasks.workunit.client.0.smithi119.stdout:2/993: write d1/d22/fc0 [1096219,107105] 0 2024-09-13T21:44:59.930 INFO:tasks.workunit.client.1.smithi155.stdout:4/575: chown d1/d7/d21/d2d/d42/f4d 338484738 1 2024-09-13T21:44:59.932 INFO:tasks.workunit.client.1.smithi155.stdout:4/576: chown d1/d7/d5a 186376 1 2024-09-13T21:44:59.932 INFO:tasks.workunit.client.1.smithi155.stdout:1/649: creat d6/d15/d23/d55/d6e/dbb/fe4 x:0 0 0 2024-09-13T21:44:59.932 INFO:tasks.workunit.client.1.smithi155.stdout:6/796: chown db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/cd5 10401 1 2024-09-13T21:44:59.932 INFO:tasks.workunit.client.0.smithi119.stdout:2/994: unlink d1/d97/cc7 0 2024-09-13T21:44:59.933 INFO:tasks.workunit.client.1.smithi155.stdout:6/797: readlink db/d11/d1e/dca/l111 0 2024-09-13T21:44:59.933 INFO:tasks.workunit.client.1.smithi155.stdout:4/577: write d1/d7/fa1 [843867,120085] 0 2024-09-13T21:44:59.933 INFO:tasks.workunit.client.0.smithi119.stdout:2/995: mkdir d1/d38/d13b 0 2024-09-13T21:44:59.936 INFO:tasks.workunit.client.1.smithi155.stdout:4/578: symlink d1/d7/de/d72/da6/lb4 0 2024-09-13T21:44:59.940 INFO:tasks.workunit.client.1.smithi155.stdout:4/579: rename d1/d7/de/dc/fb3 to d1/d7/de/dc/d4a/fb5 0 2024-09-13T21:44:59.942 INFO:tasks.workunit.client.1.smithi155.stdout:3/735: dread d3/d25/f1c [0,4194304] 0 2024-09-13T21:44:59.946 INFO:tasks.workunit.client.1.smithi155.stdout:6/798: dread db/d11/d6d/db9/f23 [0,4194304] 0 2024-09-13T21:44:59.949 INFO:tasks.workunit.client.1.smithi155.stdout:3/736: dwrite d3/fa [4194304,4194304] 0 2024-09-13T21:44:59.954 INFO:tasks.workunit.client.1.smithi155.stdout:3/737: creat d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9/ffc x:0 0 0 2024-09-13T21:44:59.955 INFO:tasks.workunit.client.1.smithi155.stdout:3/738: chown d3/d21 13325 1 2024-09-13T21:44:59.955 INFO:tasks.workunit.client.0.smithi119.stdout:1/977: write d1/d3/d61/d77/d78/d32/f64 [362404,58172] 0 2024-09-13T21:44:59.956 INFO:tasks.workunit.client.0.smithi119.stdout:1/978: read - d1/d3/d61/d77/d78/d32/d33/d43/d74/f132 zero size 2024-09-13T21:44:59.957 INFO:tasks.workunit.client.0.smithi119.stdout:1/979: chown d1/d3/d61/d77/d78/d32 214 1 2024-09-13T21:44:59.958 INFO:tasks.workunit.client.1.smithi155.stdout:6/799: dwrite db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/fae [8388608,4194304] 0 2024-09-13T21:44:59.964 INFO:tasks.workunit.client.0.smithi119.stdout:1/980: dwrite d1/d3/f118 [0,4194304] 0 2024-09-13T21:44:59.965 INFO:tasks.workunit.client.1.smithi155.stdout:4/580: dread d1/d7/fa1 [0,4194304] 0 2024-09-13T21:44:59.965 INFO:tasks.workunit.client.1.smithi155.stdout:6/800: write db/d11/d6d/db9/d1c/d36/d37/db7/fd2 [390853,72292] 0 2024-09-13T21:44:59.966 INFO:tasks.workunit.client.1.smithi155.stdout:3/739: mkdir d3/d25/d1b/d1f/d36/d5c/ddb/dfd 0 2024-09-13T21:44:59.969 INFO:tasks.workunit.client.0.smithi119.stdout:1/981: symlink d1/d3/d61/d7e/d53/ddf/d104/l14e 0 2024-09-13T21:44:59.970 INFO:tasks.workunit.client.1.smithi155.stdout:4/581: write d1/d7/de/d72/f50 [1549047,13417] 0 2024-09-13T21:44:59.971 INFO:tasks.workunit.client.0.smithi119.stdout:1/982: write d1/d3/d61/d77/d78/d32/dda/d28/d93/d139/f107 [444248,125815] 0 2024-09-13T21:44:59.973 INFO:tasks.workunit.client.0.smithi119.stdout:1/983: read d1/d3/f2b [2317501,130125] 0 2024-09-13T21:44:59.973 INFO:tasks.workunit.client.1.smithi155.stdout:3/740: mknod d3/d21/d4a/dcd/dd8/cfe 0 2024-09-13T21:44:59.973 INFO:tasks.workunit.client.1.smithi155.stdout:5/631: dwrite d5/d16/d33/d1b/d2f/d3c/d6c/d45/f65 [0,4194304] 0 2024-09-13T21:44:59.974 INFO:tasks.workunit.client.1.smithi155.stdout:6/801: mkdir db/d11/d5b/deb/d112 0 2024-09-13T21:44:59.975 INFO:tasks.workunit.client.1.smithi155.stdout:4/582: write d1/d7/de/d15/f2c [556546,85508] 0 2024-09-13T21:44:59.977 INFO:tasks.workunit.client.1.smithi155.stdout:3/741: write d3/d25/d1b/d90/fc3 [152241,79753] 0 2024-09-13T21:44:59.977 INFO:tasks.workunit.client.0.smithi119.stdout:1/984: link d1/d3/d61/d77/d78/d32/dda/d28/d110/c12f d1/d3/d61/d77/d78/d32/dda/d28/d110/c14f 0 2024-09-13T21:44:59.978 INFO:tasks.workunit.client.0.smithi119.stdout:1/985: chown d1/d3/d61/d77/d78/d32/dda/d3d/l81 41289061 1 2024-09-13T21:44:59.980 INFO:tasks.workunit.client.1.smithi155.stdout:6/802: mknod db/d11/d6d/db9/d1c/d36/c113 0 2024-09-13T21:44:59.981 INFO:tasks.workunit.client.1.smithi155.stdout:1/650: dread d6/d15/d23/d55/f60 [0,4194304] 0 2024-09-13T21:44:59.982 INFO:tasks.workunit.client.1.smithi155.stdout:1/651: write d6/f32 [4424740,119415] 0 2024-09-13T21:44:59.983 INFO:tasks.workunit.client.1.smithi155.stdout:3/742: write d3/d25/d1b/d1f/d36/d5c/d66/db3/fe2 [1629534,122908] 0 2024-09-13T21:44:59.984 INFO:tasks.workunit.client.0.smithi119.stdout:1/986: symlink d1/d3/d61/d77/d78/db8/dde/df1/l150 0 2024-09-13T21:44:59.984 INFO:tasks.workunit.client.1.smithi155.stdout:6/803: creat db/d11/d6d/f114 x:0 0 0 2024-09-13T21:44:59.985 INFO:tasks.workunit.client.1.smithi155.stdout:1/652: readlink d6/d7/l88 0 2024-09-13T21:44:59.985 INFO:tasks.workunit.client.1.smithi155.stdout:3/743: write d3/d21/d4a/ff9 [51166,97611] 0 2024-09-13T21:44:59.986 INFO:tasks.workunit.client.0.smithi119.stdout:1/987: mknod d1/d3/d61/d77/d78/d32/d33/c151 0 2024-09-13T21:44:59.987 INFO:tasks.workunit.client.1.smithi155.stdout:6/804: symlink db/d11/d2b/d35/dfc/l115 0 2024-09-13T21:44:59.988 INFO:tasks.workunit.client.1.smithi155.stdout:1/653: mknod d6/d7/d89/dd6/ce5 0 2024-09-13T21:44:59.990 INFO:tasks.workunit.client.1.smithi155.stdout:6/805: write db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/ff0 [340692,55948] 0 2024-09-13T21:44:59.992 INFO:tasks.workunit.client.0.smithi119.stdout:1/988: dwrite d1/d3/d61/d77/d78/f9c [0,4194304] 0 2024-09-13T21:44:59.992 INFO:tasks.workunit.client.0.smithi119.stdout:1/989: dread - d1/d3/d61/fb5 zero size 2024-09-13T21:44:59.994 INFO:tasks.workunit.client.0.smithi119.stdout:1/990: write d1/d3/d61/d77/d78/f9c [2865411,42434] 0 2024-09-13T21:44:59.994 INFO:tasks.workunit.client.1.smithi155.stdout:3/744: dread d3/d21/fc6 [0,4194304] 0 2024-09-13T21:44:59.996 INFO:tasks.workunit.client.0.smithi119.stdout:1/991: unlink d1/d3/d61/d77/d78/d32/dda/d28/c9e 0 2024-09-13T21:44:59.997 INFO:tasks.workunit.client.1.smithi155.stdout:6/806: fdatasync db/f10 0 2024-09-13T21:44:59.999 INFO:tasks.workunit.client.1.smithi155.stdout:1/654: dwrite d6/d7/fb2 [0,4194304] 0 2024-09-13T21:45:00.001 INFO:tasks.workunit.client.1.smithi155.stdout:6/807: chown db/d11/d6d/db9 401 1 2024-09-13T21:45:00.008 INFO:tasks.workunit.client.1.smithi155.stdout:1/655: symlink d6/d7/d48/le6 0 2024-09-13T21:45:00.008 INFO:tasks.workunit.client.0.smithi119.stdout:1/992: write d1/d3/d61/d77/d78/d32/f3e [6705646,44595] 0 2024-09-13T21:45:00.008 INFO:tasks.workunit.client.1.smithi155.stdout:4/583: write d1/d48/f51 [1741029,13698] 0 2024-09-13T21:45:00.011 INFO:tasks.workunit.client.0.smithi119.stdout:1/993: mkdir d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d152 0 2024-09-13T21:45:00.011 INFO:tasks.workunit.client.1.smithi155.stdout:4/584: write d1/d48/f63 [1527938,87552] 0 2024-09-13T21:45:00.014 INFO:tasks.workunit.client.1.smithi155.stdout:4/585: stat d1/d7/d5a/c86 0 2024-09-13T21:45:00.016 INFO:tasks.workunit.client.1.smithi155.stdout:6/808: creat db/d11/d6d/db9/de6/f116 x:0 0 0 2024-09-13T21:45:00.017 INFO:tasks.workunit.client.1.smithi155.stdout:5/632: dwrite d5/fb7 [0,4194304] 0 2024-09-13T21:45:00.018 INFO:tasks.workunit.client.0.smithi119.stdout:1/994: dwrite d1/d3/d61/d77/d78/d32/d33/d72/f120 [0,4194304] 0 2024-09-13T21:45:00.021 INFO:tasks.workunit.client.1.smithi155.stdout:4/586: rename d1/d7/d21/d69/f96 to d1/d7/d21/d69/fb6 0 2024-09-13T21:45:00.022 INFO:tasks.workunit.client.0.smithi119.stdout:1/995: rename d1/d3/d61/d77/d78/d32/dda/d19/d2d/d37/d9b/c11c to d1/c153 0 2024-09-13T21:45:00.022 INFO:tasks.workunit.client.1.smithi155.stdout:5/633: dread - d5/d16/d33/d1b/d1e/fcc zero size 2024-09-13T21:45:00.024 INFO:tasks.workunit.client.1.smithi155.stdout:1/656: dwrite d6/d15/d57/d5d/f7f [0,4194304] 0 2024-09-13T21:45:00.034 INFO:tasks.workunit.client.1.smithi155.stdout:1/657: mkdir d6/d15/d23/d55/db9/de7 0 2024-09-13T21:45:00.037 INFO:tasks.workunit.client.1.smithi155.stdout:6/809: getdents db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/d8e/d110 0 2024-09-13T21:45:00.038 INFO:tasks.workunit.client.1.smithi155.stdout:5/634: dwrite d5/f7 [0,4194304] 0 2024-09-13T21:45:00.039 INFO:tasks.workunit.client.1.smithi155.stdout:1/658: symlink d6/d15/d23/d55/d6e/le8 0 2024-09-13T21:45:00.044 INFO:tasks.workunit.client.1.smithi155.stdout:4/587: dwrite d1/d7/d21/d2d/d42/fb0 [0,4194304] 0 2024-09-13T21:45:00.044 INFO:tasks.workunit.client.1.smithi155.stdout:5/635: write d5/d16/d81/d98/d84/fc0 [67324,113668] 0 2024-09-13T21:45:00.045 INFO:tasks.workunit.client.1.smithi155.stdout:1/659: truncate d6/d82/d90/fcd 638592 0 2024-09-13T21:45:00.047 INFO:tasks.workunit.client.1.smithi155.stdout:6/810: rename db/d11/d2b/d35/dfc/l115 to db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/l117 0 2024-09-13T21:45:00.051 INFO:tasks.workunit.client.1.smithi155.stdout:4/588: rmdir d1/d7/d83 39 2024-09-13T21:45:00.052 INFO:tasks.workunit.client.1.smithi155.stdout:0/671: sync 2024-09-13T21:45:00.056 INFO:tasks.workunit.client.1.smithi155.stdout:1/660: dwrite d6/d15/d57/d5d/f7f [0,4194304] 0 2024-09-13T21:45:00.058 INFO:tasks.workunit.client.1.smithi155.stdout:4/589: write d1/d7/fa1 [1270049,120882] 0 2024-09-13T21:45:00.058 INFO:tasks.workunit.client.1.smithi155.stdout:6/811: rename db/d11/d1e/dca/de1/c109 to db/d11/d6d/db9/de6/d5f/de4/c118 0 2024-09-13T21:45:00.058 INFO:tasks.workunit.client.1.smithi155.stdout:0/672: stat d1/d6/ce4 0 2024-09-13T21:45:00.060 INFO:tasks.workunit.client.1.smithi155.stdout:1/661: fsync d6/d15/d57/d99/f14 0 2024-09-13T21:45:00.062 INFO:tasks.workunit.client.1.smithi155.stdout:5/636: dwrite d5/d16/f2a [4194304,4194304] 0 2024-09-13T21:45:00.063 INFO:tasks.workunit.client.1.smithi155.stdout:4/590: rmdir d1/d7/d21/d2d 39 2024-09-13T21:45:00.066 INFO:tasks.workunit.client.1.smithi155.stdout:0/673: truncate d1/d6/dc/d90/ffa 804849 0 2024-09-13T21:45:00.069 INFO:tasks.workunit.client.1.smithi155.stdout:0/674: write d1/d6/dc/d90/fcb [188324,680] 0 2024-09-13T21:45:00.070 INFO:tasks.workunit.client.1.smithi155.stdout:1/662: chown d6/d15/d23/d55/d6e/c8b 202 1 2024-09-13T21:45:00.072 INFO:tasks.workunit.client.1.smithi155.stdout:5/637: getdents d5/d16/d33/d1b/d59/dd1 0 2024-09-13T21:45:00.073 INFO:tasks.workunit.client.1.smithi155.stdout:1/663: mknod d6/d82/d91/daf/ce9 0 2024-09-13T21:45:00.075 INFO:tasks.workunit.client.1.smithi155.stdout:6/812: dwrite db/d11/d6d/db9/d1c/d36/fb2 [0,4194304] 0 2024-09-13T21:45:00.075 INFO:tasks.workunit.client.1.smithi155.stdout:0/675: write d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/fc9 [631106,108277] 0 2024-09-13T21:45:00.076 INFO:tasks.workunit.client.1.smithi155.stdout:5/638: fdatasync d5/d16/d33/d1b/d1e/fcc 0 2024-09-13T21:45:00.077 INFO:tasks.workunit.client.1.smithi155.stdout:9/685: sync 2024-09-13T21:45:00.077 INFO:tasks.workunit.client.1.smithi155.stdout:2/602: sync 2024-09-13T21:45:00.077 INFO:tasks.workunit.client.1.smithi155.stdout:8/570: sync 2024-09-13T21:45:00.077 INFO:tasks.workunit.client.1.smithi155.stdout:7/584: sync 2024-09-13T21:45:00.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:59 smithi155 ceph-mon[34732]: pgmap v14: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 135 MiB/s rd, 386 MiB/s wr, 746 op/s 2024-09-13T21:45:00.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:59 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:00.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:44:59 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:00.083 INFO:tasks.workunit.client.1.smithi155.stdout:6/813: creat db/d11/d2b/d35/dfc/f119 x:0 0 0 2024-09-13T21:45:00.084 INFO:tasks.workunit.client.1.smithi155.stdout:5/639: chown d5/d16/d33/d1b/d59/c66 37410 1 2024-09-13T21:45:00.084 INFO:tasks.workunit.client.1.smithi155.stdout:7/585: readlink d5/df/d15/d33/l76 0 2024-09-13T21:45:00.085 INFO:tasks.workunit.client.1.smithi155.stdout:1/664: write d6/d15/d57/d5d/d72/fad [1423434,34114] 0 2024-09-13T21:45:00.087 INFO:tasks.workunit.client.1.smithi155.stdout:2/603: symlink d2/db/ld5 0 2024-09-13T21:45:00.088 INFO:tasks.workunit.client.1.smithi155.stdout:0/676: read d1/d6/dc/d4d/d4a/d4e/f53 [1452765,100694] 0 2024-09-13T21:45:00.093 INFO:tasks.workunit.client.1.smithi155.stdout:2/604: mkdir d2/dd/d21/dc6/dd6 0 2024-09-13T21:45:00.094 INFO:tasks.workunit.client.1.smithi155.stdout:5/640: dread - d5/d16/d33/d1b/d2f/d3c/d44/d29/fc2 zero size 2024-09-13T21:45:00.097 INFO:tasks.workunit.client.1.smithi155.stdout:8/571: dwrite d2/d6/dd/fa3 [0,4194304] 0 2024-09-13T21:45:00.097 INFO:tasks.workunit.client.1.smithi155.stdout:0/677: chown d1/d6/dc/d4d/d4a/d52/d5b 1872036403 1 2024-09-13T21:45:00.098 INFO:tasks.workunit.client.1.smithi155.stdout:7/586: rename d5/df/d15/l37 to d5/df/d15/d33/d43/lb5 0 2024-09-13T21:45:00.099 INFO:tasks.workunit.client.1.smithi155.stdout:1/665: link d6/d82/d91/ca1 d6/d15/d57/d5d/d72/cea 0 2024-09-13T21:45:00.100 INFO:tasks.workunit.client.1.smithi155.stdout:6/814: mknod db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/d8e/d110/c11a 0 2024-09-13T21:45:00.100 INFO:tasks.workunit.client.1.smithi155.stdout:2/605: chown d2/dd/d21/la7 1 1 2024-09-13T21:45:00.101 INFO:tasks.workunit.client.1.smithi155.stdout:9/686: dwrite dc/d19/d21/faf [0,4194304] 0 2024-09-13T21:45:00.104 INFO:tasks.workunit.client.1.smithi155.stdout:7/587: chown d5/d10/d3e/d3f/fa0 46007 1 2024-09-13T21:45:00.105 INFO:tasks.workunit.client.1.smithi155.stdout:0/678: stat d1/d6/dc/d4d/d4a/d52/d5c/d6a/fa9 0 2024-09-13T21:45:00.105 INFO:tasks.workunit.client.1.smithi155.stdout:4/591: dread d1/f59 [0,4194304] 0 2024-09-13T21:45:00.107 INFO:tasks.workunit.client.1.smithi155.stdout:4/592: stat d1/d7/de/l14 0 2024-09-13T21:45:00.108 INFO:tasks.workunit.client.1.smithi155.stdout:6/815: dread - db/d11/d1e/d21/d44/f10b zero size 2024-09-13T21:45:00.110 INFO:tasks.workunit.client.1.smithi155.stdout:1/666: symlink d6/d7/d48/leb 0 2024-09-13T21:45:00.110 INFO:tasks.workunit.client.1.smithi155.stdout:2/606: dread d2/dd/d21/d39/dc1/d96/dba/fbf [0,4194304] 0 2024-09-13T21:45:00.111 INFO:tasks.workunit.client.1.smithi155.stdout:5/641: symlink d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/ld5 0 2024-09-13T21:45:00.116 INFO:tasks.workunit.client.1.smithi155.stdout:7/588: symlink d5/df/d15/d33/lb6 0 2024-09-13T21:45:00.116 INFO:tasks.workunit.client.1.smithi155.stdout:4/593: chown d1/d48/c5d 244077353 1 2024-09-13T21:45:00.117 INFO:tasks.workunit.client.1.smithi155.stdout:8/572: link d2/d6/dd/d12/f73 d2/d8/fb1 0 2024-09-13T21:45:00.117 INFO:tasks.workunit.client.1.smithi155.stdout:5/642: mknod d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/cd6 0 2024-09-13T21:45:00.121 INFO:tasks.workunit.client.1.smithi155.stdout:2/607: write d2/dd/de/d15/d38/d41/f8f [1943641,99339] 0 2024-09-13T21:45:00.125 INFO:tasks.workunit.client.1.smithi155.stdout:9/687: rename dc/de/d6f/dae/de1/d38/f78 to dc/ff1 0 2024-09-13T21:45:00.127 INFO:tasks.workunit.client.1.smithi155.stdout:2/608: chown d2/dd/f72 1777268 1 2024-09-13T21:45:00.128 INFO:tasks.workunit.client.1.smithi155.stdout:6/816: dwrite db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/d8e/fad [0,4194304] 0 2024-09-13T21:45:00.129 INFO:tasks.workunit.client.1.smithi155.stdout:0/679: dwrite d1/fc2 [0,4194304] 0 2024-09-13T21:45:00.132 INFO:tasks.workunit.client.0.smithi119.stdout:2/996: sync 2024-09-13T21:45:00.133 INFO:tasks.workunit.client.1.smithi155.stdout:1/667: dread d6/d15/f4c [0,4194304] 0 2024-09-13T21:45:00.133 INFO:tasks.workunit.client.1.smithi155.stdout:9/688: chown dc/de/d6f/dae/de1/d38/d90/d74/fc8 100962959 1 2024-09-13T21:45:00.136 INFO:tasks.workunit.client.1.smithi155.stdout:5/643: getdents d5/d16/d81/d98 0 2024-09-13T21:45:00.137 INFO:tasks.workunit.client.1.smithi155.stdout:3/745: dwrite d3/d25/d17/f1e [0,4194304] 0 2024-09-13T21:45:00.137 INFO:tasks.workunit.client.1.smithi155.stdout:2/609: mkdir d2/dd/d21/d39/dc1/d66/dd7 0 2024-09-13T21:45:00.138 INFO:tasks.workunit.client.1.smithi155.stdout:0/680: symlink d1/d6/d97/l104 0 2024-09-13T21:45:00.141 INFO:tasks.workunit.client.1.smithi155.stdout:7/589: rename d5/d10/d3e/d3f/l4c to d5/df/d15/d33/lb7 0 2024-09-13T21:45:00.150 INFO:tasks.workunit.client.1.smithi155.stdout:7/590: chown d5/d13/l2e 32 1 2024-09-13T21:45:00.152 INFO:tasks.workunit.client.1.smithi155.stdout:3/746: chown d3/d21/d4a/dcd/dd8 235421 1 2024-09-13T21:45:00.154 INFO:tasks.workunit.client.1.smithi155.stdout:0/681: dwrite d1/fc2 [0,4194304] 0 2024-09-13T21:45:00.154 INFO:tasks.workunit.client.1.smithi155.stdout:7/591: write d5/d13/fa5 [697318,118624] 0 2024-09-13T21:45:00.154 INFO:tasks.workunit.client.1.smithi155.stdout:6/817: rename db/d11/d5b/deb to db/d11/d1e/d11b 0 2024-09-13T21:45:00.158 INFO:tasks.workunit.client.1.smithi155.stdout:1/668: dwrite d6/d82/d91/daf/f9f [0,4194304] 0 2024-09-13T21:45:00.172 INFO:tasks.workunit.client.1.smithi155.stdout:2/610: dread d2/db/f40 [0,4194304] 0 2024-09-13T21:45:00.175 INFO:tasks.workunit.client.1.smithi155.stdout:4/594: fdatasync d1/d7/d21/f3a 0 2024-09-13T21:45:00.176 INFO:tasks.workunit.client.1.smithi155.stdout:4/595: readlink d1/d7/l7a 0 2024-09-13T21:45:00.176 INFO:tasks.workunit.client.1.smithi155.stdout:0/682: mkdir d1/d6/dc/d4d/d105 0 2024-09-13T21:45:00.177 INFO:tasks.workunit.client.1.smithi155.stdout:1/669: mknod d6/cec 0 2024-09-13T21:45:00.177 INFO:tasks.workunit.client.1.smithi155.stdout:3/747: creat d3/d25/d1b/d1f/d36/d5c/ddb/dfd/fff x:0 0 0 2024-09-13T21:45:00.179 INFO:tasks.workunit.client.1.smithi155.stdout:5/644: truncate d5/d16/d33/d1b/d2f/d3c/d6c/d45/f6d 6243323 0 2024-09-13T21:45:00.180 INFO:tasks.workunit.client.1.smithi155.stdout:4/596: symlink d1/d7/d78/lb7 0 2024-09-13T21:45:00.183 INFO:tasks.workunit.client.1.smithi155.stdout:4/597: chown d1/d7/de/d15/f2c 21137 1 2024-09-13T21:45:00.183 INFO:tasks.workunit.client.1.smithi155.stdout:0/683: write d1/d6/dc/d4d/d4a/d4e/f75 [4823759,10264] 0 2024-09-13T21:45:00.183 INFO:tasks.workunit.client.1.smithi155.stdout:1/670: mknod d6/d15/d23/d87/d95/da9/ced 0 2024-09-13T21:45:00.184 INFO:tasks.workunit.client.1.smithi155.stdout:2/611: creat d2/dd/d21/d39/dc1/dc3/fd8 x:0 0 0 2024-09-13T21:45:00.186 INFO:tasks.workunit.client.1.smithi155.stdout:3/748: mknod d3/d25/d1b/d1f/d82/c100 0 2024-09-13T21:45:00.187 INFO:tasks.workunit.client.1.smithi155.stdout:2/612: write d2/dd/d21/d8d/fb9 [899461,45725] 0 2024-09-13T21:45:00.189 INFO:tasks.workunit.client.1.smithi155.stdout:1/671: unlink d6/d15/d23/d55/lc6 0 2024-09-13T21:45:00.190 INFO:tasks.workunit.client.1.smithi155.stdout:4/598: symlink d1/d7/de/d15/d55/d5e/d66/d7e/lb8 0 2024-09-13T21:45:00.192 INFO:tasks.workunit.client.1.smithi155.stdout:4/599: dread d1/d7/f9a [0,4194304] 0 2024-09-13T21:45:00.192 INFO:tasks.workunit.client.1.smithi155.stdout:5/645: write d5/d16/d33/d1b/d92/fbc [809908,57142] 0 2024-09-13T21:45:00.193 INFO:tasks.workunit.client.1.smithi155.stdout:3/749: symlink d3/dbb/l101 0 2024-09-13T21:45:00.193 INFO:tasks.workunit.client.1.smithi155.stdout:5/646: readlink d5/d16/d33/d1b/d2f/l5c 0 2024-09-13T21:45:00.194 INFO:tasks.workunit.client.1.smithi155.stdout:4/600: chown d1/d7/de/d1a/c29 425 1 2024-09-13T21:45:00.195 INFO:tasks.workunit.client.1.smithi155.stdout:5/647: fsync d5/d16/d81/d98/f48 0 2024-09-13T21:45:00.200 INFO:tasks.workunit.client.1.smithi155.stdout:4/601: creat d1/d7/d78/fb9 x:0 0 0 2024-09-13T21:45:00.201 INFO:tasks.workunit.client.1.smithi155.stdout:4/602: chown d1/d7/de/f1f 119437253 1 2024-09-13T21:45:00.201 INFO:tasks.workunit.client.1.smithi155.stdout:6/818: dread db/d2c/f79 [0,4194304] 0 2024-09-13T21:45:00.202 INFO:tasks.workunit.client.1.smithi155.stdout:3/750: rename d3/d25/d1b/d1f/d82/d83/ff1 to d3/d21/d4a/f102 0 2024-09-13T21:45:00.204 INFO:tasks.workunit.client.1.smithi155.stdout:3/751: fsync d3/d25/d17/f76 0 2024-09-13T21:45:00.207 INFO:tasks.workunit.client.1.smithi155.stdout:4/603: dread d1/f1c [0,4194304] 0 2024-09-13T21:45:00.207 INFO:tasks.workunit.client.1.smithi155.stdout:5/648: rename d5/d16/d33/d1b/d2f/f40 to d5/d16/d33/d1b/d92/fd7 0 2024-09-13T21:45:00.208 INFO:tasks.workunit.client.1.smithi155.stdout:4/604: write d1/d7/d78/fb9 [222364,44571] 0 2024-09-13T21:45:00.209 INFO:tasks.workunit.client.1.smithi155.stdout:6/819: symlink db/d11/d2b/df6/l11c 0 2024-09-13T21:45:00.211 INFO:tasks.workunit.client.1.smithi155.stdout:9/689: truncate dc/f54 6024706 0 2024-09-13T21:45:00.212 INFO:tasks.workunit.client.1.smithi155.stdout:8/573: mkdir d2/d8/d5e/d60/db2 0 2024-09-13T21:45:00.213 INFO:tasks.workunit.client.1.smithi155.stdout:1/672: getdents d6/d15/d57/d5d/d72 0 2024-09-13T21:45:00.217 INFO:tasks.workunit.client.1.smithi155.stdout:3/752: mknod d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9/c103 0 2024-09-13T21:45:00.217 INFO:tasks.workunit.client.1.smithi155.stdout:6/820: creat db/d11/d86/f11d x:0 0 0 2024-09-13T21:45:00.218 INFO:tasks.workunit.client.0.smithi119.stdout:2/997: write d1/d38/d89/d6b/d8c/fa8 [200970,6426] 0 2024-09-13T21:45:00.218 INFO:tasks.workunit.client.0.smithi119.stdout:1/996: dread - d1/d3/d61/d77/da6/db3/f112 zero size 2024-09-13T21:45:00.219 INFO:tasks.workunit.client.1.smithi155.stdout:4/605: dwrite d1/d7/d78/fad [0,4194304] 0 2024-09-13T21:45:00.219 INFO:tasks.workunit.client.1.smithi155.stdout:5/649: symlink d5/d16/d33/d1f/ld8 0 2024-09-13T21:45:00.219 INFO:tasks.workunit.client.0.smithi119.stdout:1/997: write d1/d3/d61/d77/f94 [5064158,54406] 0 2024-09-13T21:45:00.220 INFO:tasks.workunit.client.1.smithi155.stdout:8/574: chown d2/d1f/d77/l8d 97414 1 2024-09-13T21:45:00.221 INFO:tasks.workunit.client.0.smithi119.stdout:2/998: creat d1/d22/d5a/f13c x:0 0 0 2024-09-13T21:45:00.223 INFO:tasks.workunit.client.0.smithi119.stdout:2/999: mknod d1/d22/d5a/da9/d12d/c13d 0 2024-09-13T21:45:00.224 INFO:tasks.workunit.client.1.smithi155.stdout:3/753: rmdir d3/d25/d17 39 2024-09-13T21:45:00.226 INFO:tasks.workunit.client.1.smithi155.stdout:6/821: fsync f3 0 2024-09-13T21:45:00.230 INFO:tasks.workunit.client.1.smithi155.stdout:4/606: dread d1/f59 [0,4194304] 0 2024-09-13T21:45:00.236 INFO:tasks.workunit.client.1.smithi155.stdout:4/607: symlink d1/d7/de/d72/lba 0 2024-09-13T21:45:00.239 INFO:tasks.workunit.client.1.smithi155.stdout:7/592: dwrite d5/d10/f90 [0,4194304] 0 2024-09-13T21:45:00.239 INFO:tasks.workunit.client.1.smithi155.stdout:4/608: write d1/d48/f63 [5067742,15363] 0 2024-09-13T21:45:00.242 INFO:tasks.workunit.client.1.smithi155.stdout:3/754: link d3/d25/d1b/d1f/d36/d5c/d66/fd7 d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9/f104 0 2024-09-13T21:45:00.245 INFO:tasks.workunit.client.1.smithi155.stdout:0/684: write d1/d6/dc/f2b [13734,56672] 0 2024-09-13T21:45:00.248 INFO:tasks.workunit.client.1.smithi155.stdout:4/609: dread d1/d7/d78/fad [0,4194304] 0 2024-09-13T21:45:00.250 INFO:tasks.workunit.client.1.smithi155.stdout:8/575: getdents d2/d8/d75 0 2024-09-13T21:45:00.253 INFO:tasks.workunit.client.0.smithi119.stdout:1/998: dread d1/d3/d61/d77/da6/fac [0,4194304] 0 2024-09-13T21:45:00.256 INFO:tasks.workunit.client.1.smithi155.stdout:6/822: dread db/d11/d6d/db9/f17 [4194304,4194304] 0 2024-09-13T21:45:00.256 INFO:tasks.workunit.client.1.smithi155.stdout:4/610: creat d1/d48/fbb x:0 0 0 2024-09-13T21:45:00.257 INFO:tasks.workunit.client.0.smithi119.stdout:1/999: creat d1/d3/d61/d77/d78/d32/d33/d43/d74/f154 x:0 0 0 2024-09-13T21:45:00.257 INFO:tasks.workunit.client.1.smithi155.stdout:4/611: dread - d1/d48/f95 zero size 2024-09-13T21:45:00.258 INFO:tasks.workunit.client.1.smithi155.stdout:4/612: dread - d1/d7/d21/d69/d98/fa8 zero size 2024-09-13T21:45:00.259 INFO:tasks.workunit.client.1.smithi155.stdout:8/576: rename d2/d6/dd/d25/f6d to d2/d1f/fb3 0 2024-09-13T21:45:00.261 INFO:tasks.workunit.client.0.smithi119.stderr:+ rm -rf -- ./tmp.KT6xd1IvCk 2024-09-13T21:45:00.267 INFO:tasks.workunit.client.1.smithi155.stdout:9/690: dwrite dc/de/d6f/dae/de1/f2b [0,4194304] 0 2024-09-13T21:45:00.268 INFO:tasks.workunit.client.1.smithi155.stdout:6/823: creat db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/dda/f11e x:0 0 0 2024-09-13T21:45:00.268 INFO:tasks.workunit.client.1.smithi155.stdout:4/613: symlink d1/d7/de/d72/lbc 0 2024-09-13T21:45:00.269 INFO:tasks.workunit.client.1.smithi155.stdout:0/685: creat d1/d6/dc/d4d/f106 x:0 0 0 2024-09-13T21:45:00.273 INFO:tasks.workunit.client.1.smithi155.stdout:8/577: unlink d2/d6/dd/d12/c54 0 2024-09-13T21:45:00.274 INFO:tasks.workunit.client.1.smithi155.stdout:5/650: truncate d5/d16/d33/d1b/d28/f37 4001234 0 2024-09-13T21:45:00.275 INFO:tasks.workunit.client.1.smithi155.stdout:7/593: dread d5/d10/d3e/d3f/d61/f7d [0,4194304] 0 2024-09-13T21:45:00.275 INFO:tasks.workunit.client.1.smithi155.stdout:9/691: fdatasync dc/de/d2d/d79/f62 0 2024-09-13T21:45:00.278 INFO:tasks.workunit.client.1.smithi155.stdout:4/614: rmdir d1/d7/d78 39 2024-09-13T21:45:00.280 INFO:tasks.workunit.client.1.smithi155.stdout:7/594: readlink d5/df/d15/d33/d43/l65 0 2024-09-13T21:45:00.281 INFO:tasks.workunit.client.1.smithi155.stdout:4/615: dread - d1/d7/de/d1a/f68 zero size 2024-09-13T21:45:00.282 INFO:tasks.workunit.client.1.smithi155.stdout:6/824: symlink db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/l11f 0 2024-09-13T21:45:00.283 INFO:tasks.workunit.client.1.smithi155.stdout:9/692: mknod dc/d18/d50/cf2 0 2024-09-13T21:45:00.283 INFO:tasks.workunit.client.1.smithi155.stdout:1/673: dwrite d6/d15/d57/d5d/f5f [0,4194304] 0 2024-09-13T21:45:00.286 INFO:tasks.workunit.client.1.smithi155.stdout:6/825: chown db/d11/d5b/fe2 2376 1 2024-09-13T21:45:00.288 INFO:tasks.workunit.client.1.smithi155.stdout:3/755: truncate d3/d25/d17/d52/fe5 838479 0 2024-09-13T21:45:00.289 INFO:tasks.workunit.client.1.smithi155.stdout:8/578: dread d2/d1f/f70 [0,4194304] 0 2024-09-13T21:45:00.291 INFO:tasks.workunit.client.1.smithi155.stdout:3/756: chown d3/d21/fa3 103094 1 2024-09-13T21:45:00.297 INFO:tasks.workunit.client.1.smithi155.stdout:7/595: symlink d5/df/dad/lb8 0 2024-09-13T21:45:00.299 INFO:tasks.workunit.client.1.smithi155.stdout:8/579: creat d2/d8/d5e/fb4 x:0 0 0 2024-09-13T21:45:00.299 INFO:tasks.workunit.client.1.smithi155.stdout:9/693: dwrite dc/de/d6f/fb6 [0,4194304] 0 2024-09-13T21:45:00.300 INFO:tasks.workunit.client.1.smithi155.stdout:5/651: rename d5/d16/d33/d1b/l2b to d5/d16/d4e/ld9 0 2024-09-13T21:45:00.302 INFO:tasks.workunit.client.1.smithi155.stdout:1/674: dwrite d6/d7/d89/dd6/fd9 [0,4194304] 0 2024-09-13T21:45:00.306 INFO:tasks.workunit.client.1.smithi155.stdout:8/580: truncate d2/d6/dd/d12/f1b 4316134 0 2024-09-13T21:45:00.306 INFO:tasks.workunit.client.1.smithi155.stdout:1/675: read - d6/d82/d90/fca zero size 2024-09-13T21:45:00.311 INFO:tasks.workunit.client.1.smithi155.stdout:4/616: getdents d1/d7/d5a 0 2024-09-13T21:45:00.312 INFO:tasks.workunit.client.1.smithi155.stdout:7/596: unlink d5/df/d60/d6d/f5d 0 2024-09-13T21:45:00.317 INFO:tasks.workunit.client.1.smithi155.stdout:5/652: mkdir d5/d16/d33/d1b/d28/d52/dda 0 2024-09-13T21:45:00.318 INFO:tasks.workunit.client.1.smithi155.stdout:0/686: dwrite d1/d6/dc/d4d/d4a/d52/d5b/f8f [0,4194304] 0 2024-09-13T21:45:00.318 INFO:tasks.workunit.client.1.smithi155.stdout:8/581: symlink d2/d1f/d87/d9a/lb5 0 2024-09-13T21:45:00.324 INFO:tasks.workunit.client.1.smithi155.stdout:8/582: dread - d2/d6/dd/f8c zero size 2024-09-13T21:45:00.325 INFO:tasks.workunit.client.1.smithi155.stdout:5/653: truncate d5/d16/d33/d1b/d92/fbc 1367295 0 2024-09-13T21:45:00.326 INFO:tasks.workunit.client.1.smithi155.stdout:3/757: rename d3/d25/d1b/d1f/d36/c80 to d3/d25/d1b/d1f/c105 0 2024-09-13T21:45:00.327 INFO:tasks.workunit.client.1.smithi155.stdout:1/676: write d6/d15/f4c [1638107,123598] 0 2024-09-13T21:45:00.342 INFO:tasks.workunit.client.1.smithi155.stdout:9/694: dwrite dc/d18/d1e/f64 [0,4194304] 0 2024-09-13T21:45:00.345 INFO:tasks.workunit.client.1.smithi155.stdout:0/687: dwrite d1/d6/dc/fe [0,4194304] 0 2024-09-13T21:45:00.348 INFO:tasks.workunit.client.1.smithi155.stdout:6/826: dread db/d11/d2b/f72 [0,4194304] 0 2024-09-13T21:45:00.349 INFO:tasks.workunit.client.1.smithi155.stdout:4/617: write d1/d7/d21/d2d/d42/f4d [5632983,73879] 0 2024-09-13T21:45:00.351 INFO:tasks.workunit.client.1.smithi155.stdout:4/618: stat d1/d7/l7a 0 2024-09-13T21:45:00.352 INFO:tasks.workunit.client.1.smithi155.stdout:3/758: dwrite d3/d25/f61 [0,4194304] 0 2024-09-13T21:45:00.358 INFO:tasks.workunit.client.1.smithi155.stdout:7/597: rename d5/df/d15/c22 to d5/df/d15/d33/d55/d97/cb9 0 2024-09-13T21:45:00.364 INFO:tasks.workunit.client.1.smithi155.stdout:9/695: truncate dc/de/d6f/dae/de1/f30 1280182 0 2024-09-13T21:45:00.365 INFO:tasks.workunit.client.1.smithi155.stdout:4/619: dwrite d1/d7/de/d72/f50 [0,4194304] 0 2024-09-13T21:45:00.367 INFO:tasks.workunit.client.1.smithi155.stdout:1/677: rename d6/d15/d23/d87/d95 to d6/d7/d89/dd6/dee 0 2024-09-13T21:45:00.368 INFO:tasks.workunit.client.1.smithi155.stdout:8/583: symlink d2/d8/d65/da8/lb6 0 2024-09-13T21:45:00.374 INFO:tasks.workunit.client.1.smithi155.stdout:7/598: dwrite d5/d10/d3e/f6b [0,4194304] 0 2024-09-13T21:45:00.377 INFO:tasks.workunit.client.1.smithi155.stdout:0/688: rename d1/d6/f40 to d1/d6/dc/d4d/d105/f107 0 2024-09-13T21:45:00.377 INFO:tasks.workunit.client.1.smithi155.stdout:3/759: creat d3/d21/f106 x:0 0 0 2024-09-13T21:45:00.377 INFO:tasks.workunit.client.1.smithi155.stdout:8/584: mknod d2/d1f/d87/cb7 0 2024-09-13T21:45:00.377 INFO:tasks.workunit.client.1.smithi155.stdout:1/678: rmdir d6/d15/d57/d5d/d72 39 2024-09-13T21:45:00.378 INFO:tasks.workunit.client.1.smithi155.stdout:4/620: truncate d1/f6 2548414 0 2024-09-13T21:45:00.380 INFO:tasks.workunit.client.1.smithi155.stdout:7/599: read - d5/d13/fa4 zero size 2024-09-13T21:45:00.381 INFO:tasks.workunit.client.1.smithi155.stdout:1/679: symlink d6/d15/d23/d55/d6e/lef 0 2024-09-13T21:45:00.383 INFO:tasks.workunit.client.1.smithi155.stdout:8/585: mkdir d2/d2d/d96/db8 0 2024-09-13T21:45:00.383 INFO:tasks.workunit.client.1.smithi155.stdout:4/621: creat d1/d7/d5a/fbd x:0 0 0 2024-09-13T21:45:00.384 INFO:tasks.workunit.client.1.smithi155.stdout:0/689: write d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/fdd [517441,123735] 0 2024-09-13T21:45:00.387 INFO:tasks.workunit.client.1.smithi155.stdout:7/600: symlink d5/d10/lba 0 2024-09-13T21:45:00.392 INFO:tasks.workunit.client.1.smithi155.stdout:3/760: dread d3/d25/d1b/d1f/d82/d83/d99/ff5 [0,4194304] 0 2024-09-13T21:45:00.394 INFO:tasks.workunit.client.1.smithi155.stdout:4/622: dwrite d1/f4 [0,4194304] 0 2024-09-13T21:45:00.396 INFO:tasks.workunit.client.1.smithi155.stdout:8/586: link d2/d2d/f59 d2/d6/fb9 0 2024-09-13T21:45:00.397 INFO:tasks.workunit.client.1.smithi155.stdout:0/690: mknod d1/d6/dc/d4d/d4a/dbe/c108 0 2024-09-13T21:45:00.399 INFO:tasks.workunit.client.1.smithi155.stdout:4/623: creat d1/d7/d21/d69/fbe x:0 0 0 2024-09-13T21:45:00.400 INFO:tasks.workunit.client.1.smithi155.stdout:0/691: chown d1/d6/dc/d4d/d4a/d52/d5b/f86 31133 1 2024-09-13T21:45:00.402 INFO:tasks.workunit.client.1.smithi155.stdout:7/601: rename d5/d10/d48/f7b to d5/fbb 0 2024-09-13T21:45:00.403 INFO:tasks.workunit.client.1.smithi155.stdout:8/587: unlink d2/d8/d5e/faf 0 2024-09-13T21:45:00.414 INFO:tasks.workunit.client.1.smithi155.stdout:8/588: truncate d2/d6/dd/fa7 824143 0 2024-09-13T21:45:00.415 INFO:tasks.workunit.client.1.smithi155.stdout:5/654: write d5/d16/d33/d1b/d2f/d3c/d5b/f67 [2337181,64194] 0 2024-09-13T21:45:00.415 INFO:tasks.workunit.client.1.smithi155.stdout:6/827: truncate db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/fd9 3794578 0 2024-09-13T21:45:00.416 INFO:tasks.workunit.client.1.smithi155.stdout:6/828: dread - db/d11/d2b/d35/dfc/f119 zero size 2024-09-13T21:45:00.416 INFO:tasks.workunit.client.1.smithi155.stdout:8/589: rmdir d2/d8/d65 39 2024-09-13T21:45:00.417 INFO:tasks.workunit.client.1.smithi155.stdout:9/696: write dc/de/d2d/d79/d43/f4d [4404461,91263] 0 2024-09-13T21:45:00.419 INFO:tasks.workunit.client.1.smithi155.stdout:8/590: chown d2/f47 0 1 2024-09-13T21:45:00.421 INFO:tasks.workunit.client.1.smithi155.stdout:6/829: truncate db/d2c/dc0/ff5 776813 0 2024-09-13T21:45:00.421 INFO:tasks.workunit.client.1.smithi155.stdout:9/697: symlink dc/d19/lf3 0 2024-09-13T21:45:00.422 INFO:tasks.workunit.client.1.smithi155.stdout:8/591: stat d2/c61 0 2024-09-13T21:45:00.424 INFO:tasks.workunit.client.1.smithi155.stdout:9/698: chown dc/de/fd3 65069999 1 2024-09-13T21:45:00.425 INFO:tasks.workunit.client.1.smithi155.stdout:5/655: dwrite d5/d16/d33/fc9 [0,4194304] 0 2024-09-13T21:45:00.426 INFO:tasks.workunit.client.1.smithi155.stdout:6/830: chown db/d11/d6d/db9/d1c/f58 11401 1 2024-09-13T21:45:00.428 INFO:tasks.workunit.client.1.smithi155.stdout:9/699: stat dc/d18/d1e/c26 0 2024-09-13T21:45:00.430 INFO:tasks.workunit.client.1.smithi155.stdout:9/700: fsync dc/d19/d21/d67/fd2 0 2024-09-13T21:45:00.432 INFO:tasks.workunit.client.1.smithi155.stdout:3/761: truncate d3/d25/d1b/d1f/d82/d83/d99/ff5 382586 0 2024-09-13T21:45:00.434 INFO:tasks.workunit.client.1.smithi155.stdout:8/592: dread d2/d6/dd/d12/f73 [0,4194304] 0 2024-09-13T21:45:00.435 INFO:tasks.workunit.client.1.smithi155.stdout:7/602: truncate d5/d13/fa3 3787008 0 2024-09-13T21:45:00.435 INFO:tasks.workunit.client.1.smithi155.stdout:0/692: write d1/d6/f2d [110894,109320] 0 2024-09-13T21:45:00.436 INFO:tasks.workunit.client.1.smithi155.stdout:1/680: dwrite d6/d15/d23/d87/f21 [0,4194304] 0 2024-09-13T21:45:00.445 INFO:tasks.workunit.client.1.smithi155.stdout:7/603: write d5/d10/d3e/d3f/f7c [780172,14712] 0 2024-09-13T21:45:00.449 INFO:tasks.workunit.client.1.smithi155.stdout:3/762: mknod d3/d25/d1b/d1f/d36/d5c/dbc/c107 0 2024-09-13T21:45:00.454 INFO:tasks.workunit.client.1.smithi155.stdout:0/693: chown d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/fdd 124619417 1 2024-09-13T21:45:00.457 INFO:tasks.workunit.client.1.smithi155.stdout:8/593: chown d2/d8/d65/f56 1 1 2024-09-13T21:45:00.460 INFO:tasks.workunit.client.1.smithi155.stdout:5/656: dwrite d5/d16/d33/fc9 [0,4194304] 0 2024-09-13T21:45:00.461 INFO:tasks.workunit.client.1.smithi155.stdout:4/624: dwrite d1/d7/d21/d69/d98/f85 [0,4194304] 0 2024-09-13T21:45:00.464 INFO:tasks.workunit.client.1.smithi155.stdout:6/831: truncate db/d11/d86/fd0 2251465 0 2024-09-13T21:45:00.464 INFO:tasks.workunit.client.1.smithi155.stdout:9/701: dwrite dc/d18/d1e/d86/f9e [0,4194304] 0 2024-09-13T21:45:00.466 INFO:tasks.workunit.client.1.smithi155.stdout:3/763: unlink d3/d10/c15 0 2024-09-13T21:45:00.468 INFO:tasks.workunit.client.1.smithi155.stdout:8/594: fsync d2/f74 0 2024-09-13T21:45:00.470 INFO:tasks.workunit.client.1.smithi155.stdout:1/681: dwrite d6/d15/d57/d5d/fb1 [0,4194304] 0 2024-09-13T21:45:00.472 INFO:tasks.workunit.client.1.smithi155.stdout:6/832: fdatasync db/d11/d6d/db9/de6/d5f/de4/f10a 0 2024-09-13T21:45:00.473 INFO:tasks.workunit.client.1.smithi155.stdout:9/702: chown dc/d18/d50/lbb 2093 1 2024-09-13T21:45:00.473 INFO:tasks.workunit.client.1.smithi155.stdout:1/682: dread - d6/d15/d57/d5d/fd0 zero size 2024-09-13T21:45:00.478 INFO:tasks.workunit.client.1.smithi155.stdout:7/604: write d5/d13/f24 [830734,21009] 0 2024-09-13T21:45:00.481 INFO:tasks.workunit.client.1.smithi155.stdout:3/764: chown d3/d25/ce4 964346 1 2024-09-13T21:45:00.487 INFO:tasks.workunit.client.1.smithi155.stdout:6/833: unlink db/d11/d6d/db9/de6/d5f/d67/ld7 0 2024-09-13T21:45:00.488 INFO:tasks.workunit.client.1.smithi155.stdout:5/657: dwrite d5/d16/d4e/d85/f97 [0,4194304] 0 2024-09-13T21:45:00.490 INFO:tasks.workunit.client.1.smithi155.stdout:6/834: readlink db/d11/d6d/db9/d1c/d36/lf8 0 2024-09-13T21:45:00.493 INFO:tasks.workunit.client.1.smithi155.stdout:4/625: write d1/d48/f99 [1876388,125902] 0 2024-09-13T21:45:00.494 INFO:tasks.workunit.client.1.smithi155.stdout:6/835: symlink db/d11/d6d/db9/d1c/d36/d37/l120 0 2024-09-13T21:45:00.497 INFO:tasks.workunit.client.1.smithi155.stdout:1/683: dread d6/d15/d23/d55/f60 [0,4194304] 0 2024-09-13T21:45:00.498 INFO:tasks.workunit.client.1.smithi155.stdout:5/658: mkdir d5/d16/d33/d1b/d59/dd1/ddb 0 2024-09-13T21:45:00.498 INFO:tasks.workunit.client.1.smithi155.stdout:7/605: getdents d5/d10/d3e/d3f 0 2024-09-13T21:45:00.501 INFO:tasks.workunit.client.1.smithi155.stdout:2/613: sync 2024-09-13T21:45:00.505 INFO:tasks.workunit.client.1.smithi155.stdout:4/626: rename d1/d7/de/d15/d55/laf to d1/d7/d21/d2d/lbf 0 2024-09-13T21:45:00.505 INFO:tasks.workunit.client.1.smithi155.stdout:6/836: stat db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/ce9 0 2024-09-13T21:45:00.507 INFO:tasks.workunit.client.1.smithi155.stdout:0/694: dread d1/d6/dc/d4d/d4a/d9e/fbc [0,4194304] 0 2024-09-13T21:45:00.508 INFO:tasks.workunit.client.1.smithi155.stdout:4/627: write d1/d7/d21/d69/d98/f90 [2053800,128633] 0 2024-09-13T21:45:00.510 INFO:tasks.workunit.client.1.smithi155.stdout:7/606: symlink d5/df/d15/d33/d55/d97/lbc 0 2024-09-13T21:45:00.513 INFO:tasks.workunit.client.1.smithi155.stdout:9/703: truncate dc/de/d6f/dae/de1/d38/fb1 353629 0 2024-09-13T21:45:00.516 INFO:tasks.workunit.client.1.smithi155.stdout:6/837: unlink db/d11/d1e/lf1 0 2024-09-13T21:45:00.516 INFO:tasks.workunit.client.1.smithi155.stdout:7/607: read d5/df/d60/f63 [1294174,77533] 0 2024-09-13T21:45:00.518 INFO:tasks.workunit.client.1.smithi155.stdout:4/628: creat d1/d7/d21/d69/fc0 x:0 0 0 2024-09-13T21:45:00.519 INFO:tasks.workunit.client.1.smithi155.stdout:2/614: mkdir d2/db/d6b/dd9 0 2024-09-13T21:45:00.519 INFO:tasks.workunit.client.1.smithi155.stdout:8/595: dread d2/d6/dd/d25/f85 [0,4194304] 0 2024-09-13T21:45:00.522 INFO:tasks.workunit.client.1.smithi155.stdout:2/615: fsync d2/dd/d37/d94/fb8 0 2024-09-13T21:45:00.523 INFO:tasks.workunit.client.1.smithi155.stdout:5/659: rmdir d5/d16/d33/d1b/d28/d52/dda 0 2024-09-13T21:45:00.527 INFO:tasks.workunit.client.1.smithi155.stdout:1/684: rename d6/d15/d57/d99/c98 to d6/d82/cf0 0 2024-09-13T21:45:00.528 INFO:tasks.workunit.client.1.smithi155.stdout:9/704: dwrite dc/de/d6f/f7e [4194304,4194304] 0 2024-09-13T21:45:00.531 INFO:tasks.workunit.client.1.smithi155.stdout:2/616: symlink d2/db/d6b/lda 0 2024-09-13T21:45:00.532 INFO:tasks.workunit.client.1.smithi155.stdout:6/838: dwrite db/d11/d6d/f6f [0,4194304] 0 2024-09-13T21:45:00.532 INFO:tasks.workunit.client.1.smithi155.stdout:3/765: creat d3/d25/d1b/d1f/d36/d5c/d66/f108 x:0 0 0 2024-09-13T21:45:00.534 INFO:tasks.workunit.client.1.smithi155.stdout:8/596: truncate d2/f4b 1946276 0 2024-09-13T21:45:00.535 INFO:tasks.workunit.client.1.smithi155.stdout:4/629: mknod d1/cc1 0 2024-09-13T21:45:00.539 INFO:tasks.workunit.client.1.smithi155.stdout:0/695: rename d1/d6/c73 to d1/d6/dc/d90/c109 0 2024-09-13T21:45:00.544 INFO:tasks.workunit.client.1.smithi155.stdout:9/705: rmdir dc/d19/d21/d67 39 2024-09-13T21:45:00.545 INFO:tasks.workunit.client.1.smithi155.stdout:1/685: dwrite d6/d7/d89/dd6/fd9 [0,4194304] 0 2024-09-13T21:45:00.546 INFO:tasks.workunit.client.1.smithi155.stdout:9/706: fdatasync dc/de/fd3 0 2024-09-13T21:45:00.555 INFO:tasks.workunit.client.1.smithi155.stdout:5/660: rmdir d5/d16/d4e/d99 0 2024-09-13T21:45:00.556 INFO:tasks.workunit.client.1.smithi155.stdout:6/839: dwrite db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/db4/fbb [0,4194304] 0 2024-09-13T21:45:00.558 INFO:tasks.workunit.client.1.smithi155.stdout:3/766: creat d3/d25/d1b/d1f/d36/d7c/f109 x:0 0 0 2024-09-13T21:45:00.559 INFO:tasks.workunit.client.1.smithi155.stdout:9/707: symlink dc/d18/lf4 0 2024-09-13T21:45:00.561 INFO:tasks.workunit.client.1.smithi155.stdout:1/686: creat d6/d15/d57/d5d/d72/ff1 x:0 0 0 2024-09-13T21:45:00.565 INFO:tasks.workunit.client.1.smithi155.stdout:9/708: fdatasync dc/de/d6f/dae/de1/f66 0 2024-09-13T21:45:00.572 INFO:tasks.workunit.client.1.smithi155.stdout:2/617: link d2/db/f4b d2/db/fdb 0 2024-09-13T21:45:00.574 INFO:tasks.workunit.client.1.smithi155.stdout:9/709: rename dc/d18/f60 to dc/de/d6f/da3/ff5 0 2024-09-13T21:45:00.575 INFO:tasks.workunit.client.1.smithi155.stdout:6/840: getdents db/d2c/dc0 0 2024-09-13T21:45:00.577 INFO:tasks.workunit.client.1.smithi155.stdout:5/661: getdents d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/db8 0 2024-09-13T21:45:00.582 INFO:tasks.workunit.client.1.smithi155.stdout:7/608: dread d5/d3b/f4b [0,4194304] 0 2024-09-13T21:45:00.582 INFO:tasks.workunit.client.1.smithi155.stdout:1/687: dwrite d6/d82/d91/daf/f9f [0,4194304] 0 2024-09-13T21:45:00.586 INFO:tasks.workunit.client.1.smithi155.stdout:3/767: dwrite d3/d25/d17/f1e [4194304,4194304] 0 2024-09-13T21:45:00.587 INFO:tasks.workunit.client.1.smithi155.stdout:4/630: dread d1/d7/de/d15/f5b [0,4194304] 0 2024-09-13T21:45:00.589 INFO:tasks.workunit.client.1.smithi155.stdout:5/662: unlink d5/d16/d33/f38 0 2024-09-13T21:45:00.592 INFO:tasks.workunit.client.1.smithi155.stdout:6/841: read - db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/d93/f100 zero size 2024-09-13T21:45:00.593 INFO:tasks.workunit.client.1.smithi155.stdout:9/710: write dc/de/d6f/dae/de1/d38/d90/d74/fb9 [1488835,94444] 0 2024-09-13T21:45:00.597 INFO:tasks.workunit.client.1.smithi155.stdout:3/768: symlink d3/d25/d1b/d90/l10a 0 2024-09-13T21:45:00.600 INFO:tasks.workunit.client.1.smithi155.stdout:0/696: dwrite d1/d6/dc/d4d/d4a/d52/d5b/fa1 [0,4194304] 0 2024-09-13T21:45:00.601 INFO:tasks.workunit.client.1.smithi155.stdout:4/631: chown d1/d7/d21/f2b 27 1 2024-09-13T21:45:00.601 INFO:tasks.workunit.client.1.smithi155.stdout:5/663: write d5/d16/d33/d1b/d2f/d3c/d44/f2e [1698101,60564] 0 2024-09-13T21:45:00.605 INFO:tasks.workunit.client.1.smithi155.stdout:4/632: readlink d1/d7/d21/d2d/lac 0 2024-09-13T21:45:00.605 INFO:tasks.workunit.client.1.smithi155.stdout:7/609: link d5/d13/f3d d5/df/d15/d33/d55/fbd 0 2024-09-13T21:45:00.607 INFO:tasks.workunit.client.1.smithi155.stdout:3/769: unlink d3/f72 0 2024-09-13T21:45:00.611 INFO:tasks.workunit.client.1.smithi155.stdout:7/610: symlink d5/df/d15/d33/d55/lbe 0 2024-09-13T21:45:00.612 INFO:tasks.workunit.client.1.smithi155.stdout:6/842: dread db/d2c/f59 [0,4194304] 0 2024-09-13T21:45:00.613 INFO:tasks.workunit.client.1.smithi155.stdout:5/664: truncate d5/d16/d81/d98/fc3 463604 0 2024-09-13T21:45:00.613 INFO:tasks.workunit.client.1.smithi155.stdout:0/697: creat d1/d6/d81/df7/f10a x:0 0 0 2024-09-13T21:45:00.613 INFO:tasks.workunit.client.1.smithi155.stdout:1/688: dwrite d6/d7/d48/dab/fcc [0,4194304] 0 2024-09-13T21:45:00.615 INFO:tasks.workunit.client.1.smithi155.stdout:3/770: dread d3/d21/d4a/ff9 [0,4194304] 0 2024-09-13T21:45:00.616 INFO:tasks.workunit.client.1.smithi155.stdout:9/711: write dc/de/d2d/d79/f4c [1159707,97399] 0 2024-09-13T21:45:00.618 INFO:tasks.workunit.client.1.smithi155.stdout:1/689: chown d6/d7/d89/dd6/dee/lc8 2237 1 2024-09-13T21:45:00.618 INFO:tasks.workunit.client.1.smithi155.stdout:0/698: stat d1/d6/dc/d4d/d4a/d4e/d61/lf3 0 2024-09-13T21:45:00.619 INFO:tasks.workunit.client.1.smithi155.stdout:5/665: stat d5/d16/d33/d1b/d92/dca 0 2024-09-13T21:45:00.619 INFO:tasks.workunit.client.1.smithi155.stdout:4/633: rename d1/d7/d78 to d1/d7/de/d15/d55/d5e/d66/dc2 0 2024-09-13T21:45:00.620 INFO:tasks.workunit.client.1.smithi155.stdout:3/771: creat d3/d21/d4a/f10b x:0 0 0 2024-09-13T21:45:00.624 INFO:tasks.workunit.client.1.smithi155.stdout:4/634: readlink d1/l3e 0 2024-09-13T21:45:00.624 INFO:tasks.workunit.client.1.smithi155.stdout:7/611: getdents d5/d10 0 2024-09-13T21:45:00.625 INFO:tasks.workunit.client.1.smithi155.stdout:9/712: write dc/de/ff [2312138,100786] 0 2024-09-13T21:45:00.625 INFO:tasks.workunit.client.1.smithi155.stdout:6/843: creat db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/d8e/d110/f121 x:0 0 0 2024-09-13T21:45:00.625 INFO:tasks.workunit.client.1.smithi155.stdout:5/666: chown d5/d16/d33/d1b/d2f 79971098 1 2024-09-13T21:45:00.625 INFO:tasks.workunit.client.1.smithi155.stdout:0/699: mkdir d1/d10b 0 2024-09-13T21:45:00.627 INFO:tasks.workunit.client.1.smithi155.stdout:2/618: dread d2/fc [0,4194304] 0 2024-09-13T21:45:00.627 INFO:tasks.workunit.client.1.smithi155.stdout:5/667: rmdir d5/d16/d4e/d85 39 2024-09-13T21:45:00.629 INFO:tasks.workunit.client.1.smithi155.stdout:4/635: dread - d1/d7/d21/d69/fc0 zero size 2024-09-13T21:45:00.630 INFO:tasks.workunit.client.1.smithi155.stdout:7/612: mkdir d5/d10/dbf 0 2024-09-13T21:45:00.630 INFO:tasks.workunit.client.1.smithi155.stdout:3/772: stat d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9 0 2024-09-13T21:45:00.636 INFO:tasks.workunit.client.1.smithi155.stdout:9/713: creat dc/de/ff6 x:0 0 0 2024-09-13T21:45:00.637 INFO:tasks.workunit.client.1.smithi155.stdout:4/636: mknod d1/d7/de/d1a/cc3 0 2024-09-13T21:45:00.640 INFO:tasks.workunit.client.1.smithi155.stdout:1/690: dwrite d6/d7/d89/dd6/fd9 [0,4194304] 0 2024-09-13T21:45:00.641 INFO:tasks.workunit.client.1.smithi155.stdout:7/613: read d5/df/d15/d33/d43/f64 [2036407,82440] 0 2024-09-13T21:45:00.643 INFO:tasks.workunit.client.1.smithi155.stdout:9/714: fsync dc/d18/f94 0 2024-09-13T21:45:00.647 INFO:tasks.workunit.client.1.smithi155.stdout:4/637: chown d1/d7/de/d15/d55/d5e/d66/dc2/c9b 50 1 2024-09-13T21:45:00.649 INFO:tasks.workunit.client.1.smithi155.stdout:5/668: write d5/f49 [3471171,36269] 0 2024-09-13T21:45:00.650 INFO:tasks.workunit.client.1.smithi155.stdout:0/700: dwrite d1/d6/dc/f7a [0,4194304] 0 2024-09-13T21:45:00.652 INFO:tasks.workunit.client.1.smithi155.stdout:7/614: read d5/df/d15/d33/d55/fbd [166928,45168] 0 2024-09-13T21:45:00.653 INFO:tasks.workunit.client.1.smithi155.stdout:2/619: truncate d2/dd/f17 1501971 0 2024-09-13T21:45:00.653 INFO:tasks.workunit.client.1.smithi155.stdout:3/773: creat d3/d25/d1b/d1f/d36/d5c/d66/f10c x:0 0 0 2024-09-13T21:45:00.655 INFO:tasks.workunit.client.1.smithi155.stdout:4/638: chown d1/d7/d21/c43 30 1 2024-09-13T21:45:00.655 INFO:tasks.workunit.client.1.smithi155.stdout:1/691: unlink l5 0 2024-09-13T21:45:00.656 INFO:tasks.workunit.client.1.smithi155.stdout:9/715: truncate dc/de/d6f/dae/de1/d38/d90/d74/fce 815120 0 2024-09-13T21:45:00.658 INFO:tasks.workunit.client.1.smithi155.stdout:1/692: readlink d6/d15/d23/d55/lda 0 2024-09-13T21:45:00.659 INFO:tasks.workunit.client.1.smithi155.stdout:3/774: stat d3/d25/l9c 0 2024-09-13T21:45:00.659 INFO:tasks.workunit.client.1.smithi155.stdout:1/693: chown d6/d15/d23/d55/lda 121359064 1 2024-09-13T21:45:00.661 INFO:tasks.workunit.client.1.smithi155.stdout:5/669: creat d5/d16/d33/d1b/d92/dca/fdc x:0 0 0 2024-09-13T21:45:00.664 INFO:tasks.workunit.client.1.smithi155.stdout:6/844: dread db/d11/d2b/ffb [0,4194304] 0 2024-09-13T21:45:00.668 INFO:tasks.workunit.client.1.smithi155.stdout:7/615: write d5/df/d60/f63 [4290167,48638] 0 2024-09-13T21:45:00.669 INFO:tasks.workunit.client.1.smithi155.stdout:1/694: fsync d6/d7/f24 0 2024-09-13T21:45:00.671 INFO:tasks.workunit.client.1.smithi155.stdout:9/716: mkdir dc/df7 0 2024-09-13T21:45:00.672 INFO:tasks.workunit.client.1.smithi155.stdout:6/845: dread db/f22 [0,4194304] 0 2024-09-13T21:45:00.673 INFO:tasks.workunit.client.1.smithi155.stdout:0/701: creat d1/d6/dc/d4d/f10c x:0 0 0 2024-09-13T21:45:00.674 INFO:tasks.workunit.client.1.smithi155.stdout:5/670: creat d5/d16/d33/d1b/d59/dd1/fdd x:0 0 0 2024-09-13T21:45:00.675 INFO:tasks.workunit.client.1.smithi155.stdout:3/775: rename d3/d10/c14 to d3/d25/d1b/d1f/d36/c10d 0 2024-09-13T21:45:00.682 INFO:tasks.workunit.client.1.smithi155.stdout:0/702: write d1/d6/dc/d4d/d4a/d4e/fc3 [1017293,77720] 0 2024-09-13T21:45:00.682 INFO:tasks.workunit.client.1.smithi155.stdout:9/717: mknod dc/de/d6f/dae/df0/cf8 0 2024-09-13T21:45:00.684 INFO:tasks.workunit.client.1.smithi155.stdout:5/671: mknod d5/d16/d81/d98/cde 0 2024-09-13T21:45:00.684 INFO:tasks.workunit.client.1.smithi155.stdout:7/616: getdents d5/df/d60 0 2024-09-13T21:45:00.686 INFO:tasks.workunit.client.1.smithi155.stdout:4/639: dwrite d1/d7/de/d15/d55/d5e/d66/dc2/fad [4194304,4194304] 0 2024-09-13T21:45:00.689 INFO:tasks.workunit.client.1.smithi155.stdout:3/776: dread d3/d21/f41 [0,4194304] 0 2024-09-13T21:45:00.692 INFO:tasks.workunit.client.1.smithi155.stdout:1/695: dwrite d6/d7/d48/dab/fcc [0,4194304] 0 2024-09-13T21:45:00.692 INFO:tasks.workunit.client.1.smithi155.stdout:2/620: dwrite d2/dd/d21/d39/dc1/f3e [0,4194304] 0 2024-09-13T21:45:00.695 INFO:tasks.workunit.client.1.smithi155.stdout:3/777: fsync d3/d25/d1b/d1f/d36/d5c/f63 0 2024-09-13T21:45:00.695 INFO:tasks.workunit.client.1.smithi155.stdout:7/617: chown d5/d10/da7 22367 1 2024-09-13T21:45:00.700 INFO:tasks.workunit.client.1.smithi155.stdout:4/640: read d1/d7/de/d15/d55/d5e/f5f [3621572,129833] 0 2024-09-13T21:45:00.705 INFO:tasks.workunit.client.1.smithi155.stdout:3/778: mknod d3/d21/d4a/c10e 0 2024-09-13T21:45:00.705 INFO:tasks.workunit.client.1.smithi155.stdout:7/618: chown d5/f1e 0 1 2024-09-13T21:45:00.706 INFO:tasks.workunit.client.1.smithi155.stdout:5/672: dwrite d5/d16/d33/d1b/d2f/d3c/d5b/f67 [4194304,4194304] 0 2024-09-13T21:45:00.707 INFO:tasks.workunit.client.1.smithi155.stdout:2/621: symlink d2/dd/d21/d8d/ldc 0 2024-09-13T21:45:00.707 INFO:tasks.workunit.client.1.smithi155.stdout:9/718: rename dc/de/d2d/d79/d43/fea to dc/de/d6f/dae/df0/ff9 0 2024-09-13T21:45:00.709 INFO:tasks.workunit.client.1.smithi155.stdout:3/779: chown d3/d25/d1b/d1f/d36/d7c/cf6 12986 1 2024-09-13T21:45:00.710 INFO:tasks.workunit.client.1.smithi155.stdout:1/696: write d6/d15/d23/d55/d6e/dbb/f75 [300294,75550] 0 2024-09-13T21:45:00.711 INFO:tasks.workunit.client.1.smithi155.stdout:5/673: dread - d5/d16/d33/d1b/d28/d52/f96 zero size 2024-09-13T21:45:00.717 INFO:tasks.workunit.client.1.smithi155.stdout:5/674: readlink d5/d16/d4e/ld9 0 2024-09-13T21:45:00.717 INFO:tasks.workunit.client.1.smithi155.stdout:4/641: dread d1/d7/de/d15/d55/d5e/d66/dc2/fb9 [0,4194304] 0 2024-09-13T21:45:00.717 INFO:tasks.workunit.client.1.smithi155.stdout:2/622: symlink d2/dd/d21/d39/dc1/d66/d7c/ldd 0 2024-09-13T21:45:00.721 INFO:tasks.workunit.client.1.smithi155.stdout:3/780: unlink d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9/c103 0 2024-09-13T21:45:00.723 INFO:tasks.workunit.client.1.smithi155.stdout:2/623: mknod d2/dd/d21/d39/dc1/cde 0 2024-09-13T21:45:00.725 INFO:tasks.workunit.client.1.smithi155.stdout:1/697: dwrite d6/d15/d23/d55/d6e/dbb/d4b/fde [0,4194304] 0 2024-09-13T21:45:00.731 INFO:tasks.workunit.client.1.smithi155.stdout:1/698: chown d6/d7/d48/c68 5778028 1 2024-09-13T21:45:00.731 INFO:tasks.workunit.client.1.smithi155.stdout:4/642: dwrite d1/d7/de/d15/f2c [0,4194304] 0 2024-09-13T21:45:00.734 INFO:tasks.workunit.client.1.smithi155.stdout:1/699: read d6/d15/d23/d55/f60 [1342183,36099] 0 2024-09-13T21:45:00.738 INFO:tasks.workunit.client.1.smithi155.stdout:1/700: symlink d6/d7/d89/dd6/lf2 0 2024-09-13T21:45:00.754 INFO:tasks.workunit.client.1.smithi155.stdout:6/846: dread db/d11/d1e/d21/f4d [0,4194304] 0 2024-09-13T21:45:00.760 INFO:tasks.workunit.client.1.smithi155.stdout:4/643: read d1/d7/d21/d69/d98/f8b [565272,103736] 0 2024-09-13T21:45:00.781 INFO:tasks.workunit.client.1.smithi155.stdout:3/781: write d3/d25/d1b/d1f/d82/d83/d99/ff5 [1070775,26571] 0 2024-09-13T21:45:00.782 INFO:tasks.workunit.client.1.smithi155.stdout:5/675: truncate d5/d16/d33/d1b/d2f/d3c/d6c/f77 702827 0 2024-09-13T21:45:00.784 INFO:tasks.workunit.client.1.smithi155.stdout:1/701: truncate d6/d15/d23/d87/f2a 1202370 0 2024-09-13T21:45:00.786 INFO:tasks.workunit.client.1.smithi155.stdout:7/619: dwrite d5/df/d15/d33/d55/f87 [0,4194304] 0 2024-09-13T21:45:00.787 INFO:tasks.workunit.client.1.smithi155.stdout:3/782: chown d3/d25/c2d 253279914 1 2024-09-13T21:45:00.788 INFO:tasks.workunit.client.1.smithi155.stdout:9/719: dwrite dc/de/d2d/d79/f62 [0,4194304] 0 2024-09-13T21:45:00.789 INFO:tasks.workunit.client.1.smithi155.stdout:4/644: truncate d1/d7/de/d15/d55/f62 961341 0 2024-09-13T21:45:00.794 INFO:tasks.workunit.client.1.smithi155.stdout:4/645: readlink d1/l5 0 2024-09-13T21:45:00.800 INFO:tasks.workunit.client.1.smithi155.stdout:3/783: write d3/d25/d17/d3b/f50 [4614858,126240] 0 2024-09-13T21:45:00.804 INFO:tasks.workunit.client.1.smithi155.stdout:1/702: rmdir d6/d15/d23/d87 39 2024-09-13T21:45:00.806 INFO:tasks.workunit.client.1.smithi155.stdout:9/720: symlink dc/de/d6f/d71/lfa 0 2024-09-13T21:45:00.807 INFO:tasks.workunit.client.1.smithi155.stdout:4/646: truncate d1/d7/de/d1a/f68 276520 0 2024-09-13T21:45:00.809 INFO:tasks.workunit.client.1.smithi155.stdout:6/847: dwrite db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/d8e/fcb [0,4194304] 0 2024-09-13T21:45:00.809 INFO:tasks.workunit.client.1.smithi155.stdout:9/721: readlink dc/d19/l4f 0 2024-09-13T21:45:00.810 INFO:tasks.workunit.client.1.smithi155.stdout:4/647: chown d1/d7/de 69344 1 2024-09-13T21:45:00.811 INFO:tasks.workunit.client.1.smithi155.stdout:5/676: dwrite d5/d16/d33/d1b/d2f/f9b [4194304,4194304] 0 2024-09-13T21:45:00.812 INFO:tasks.workunit.client.1.smithi155.stdout:3/784: fdatasync d3/d25/d1b/d1f/d82/d83/f8a 0 2024-09-13T21:45:00.813 INFO:tasks.workunit.client.1.smithi155.stdout:9/722: fdatasync dc/d19/d21/fca 0 2024-09-13T21:45:00.815 INFO:tasks.workunit.client.1.smithi155.stdout:2/624: dread d2/dd/de/d15/d38/d41/f8f [0,4194304] 0 2024-09-13T21:45:00.817 INFO:tasks.workunit.client.1.smithi155.stdout:3/785: fsync d3/d21/d2c/f48 0 2024-09-13T21:45:00.818 INFO:tasks.workunit.client.1.smithi155.stdout:4/648: unlink d1/d7/de/lab 0 2024-09-13T21:45:00.823 INFO:tasks.workunit.client.1.smithi155.stdout:6/848: symlink db/d11/d6d/db9/d1c/d36/d83/l122 0 2024-09-13T21:45:00.828 INFO:tasks.workunit.client.1.smithi155.stdout:5/677: rmdir d5/d16/d33/d1b/d2f/d3c/d5b 39 2024-09-13T21:45:00.829 INFO:tasks.workunit.client.1.smithi155.stdout:1/703: dwrite d6/d82/fbc [0,4194304] 0 2024-09-13T21:45:00.831 INFO:tasks.workunit.client.1.smithi155.stdout:6/849: creat db/d11/d6d/db9/d1c/d36/d83/ddd/f123 x:0 0 0 2024-09-13T21:45:00.832 INFO:tasks.workunit.client.1.smithi155.stdout:4/649: dread d1/d7/de/d15/f5b [4194304,4194304] 0 2024-09-13T21:45:00.835 INFO:tasks.workunit.client.1.smithi155.stdout:2/625: mknod d2/dd/d21/dc6/dd6/cdf 0 2024-09-13T21:45:00.835 INFO:tasks.workunit.client.1.smithi155.stdout:5/678: write d5/d16/d33/d1b/d2f/d3c/d6c/f79 [120848,52889] 0 2024-09-13T21:45:00.837 INFO:tasks.workunit.client.1.smithi155.stdout:6/850: dread - db/d11/d5b/fd4 zero size 2024-09-13T21:45:00.841 INFO:tasks.workunit.client.1.smithi155.stdout:7/620: truncate d5/d10/d3e/f6b 876392 0 2024-09-13T21:45:00.842 INFO:tasks.workunit.client.1.smithi155.stdout:1/704: chown d6/d82/d91/ca1 2995766 1 2024-09-13T21:45:00.842 INFO:tasks.workunit.client.1.smithi155.stdout:9/723: dwrite dc/de/fd7 [0,4194304] 0 2024-09-13T21:45:00.844 INFO:tasks.workunit.client.1.smithi155.stdout:5/679: mknod d5/d16/cdf 0 2024-09-13T21:45:00.846 INFO:tasks.workunit.client.1.smithi155.stdout:7/621: unlink d5/d10/d3e/d3f/f4a 0 2024-09-13T21:45:00.847 INFO:tasks.workunit.client.1.smithi155.stdout:7/622: write d5/df/d15/f5b [2465385,30921] 0 2024-09-13T21:45:00.850 INFO:tasks.workunit.client.1.smithi155.stdout:1/705: mkdir d6/d15/d57/df3 0 2024-09-13T21:45:00.852 INFO:tasks.workunit.client.1.smithi155.stdout:6/851: creat db/f124 x:0 0 0 2024-09-13T21:45:00.859 INFO:tasks.workunit.client.1.smithi155.stdout:7/623: link d5/df/f19 d5/d10/d3e/d40/da2/fc0 0 2024-09-13T21:45:00.861 INFO:tasks.workunit.client.1.smithi155.stdout:3/786: dwrite d3/d10/f8d [4194304,4194304] 0 2024-09-13T21:45:00.862 INFO:tasks.workunit.client.1.smithi155.stdout:3/787: stat d3/d25/d1b/fc5 0 2024-09-13T21:45:00.863 INFO:tasks.workunit.client.1.smithi155.stdout:6/852: symlink db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/l125 0 2024-09-13T21:45:00.864 INFO:tasks.workunit.client.1.smithi155.stdout:7/624: rename d5/d10/d3e/d40/c9c to d5/df/d15/da1/cc1 0 2024-09-13T21:45:00.865 INFO:tasks.workunit.client.1.smithi155.stdout:4/650: dread d1/d7/de/dc/d4a/f56 [0,4194304] 0 2024-09-13T21:45:00.865 INFO:tasks.workunit.client.1.smithi155.stdout:6/853: dread - db/d11/d6d/db9/de6/d5f/d67/f8f zero size 2024-09-13T21:45:00.866 INFO:tasks.workunit.client.1.smithi155.stdout:3/788: creat d3/d21/d4a/f10f x:0 0 0 2024-09-13T21:45:00.868 INFO:tasks.workunit.client.1.smithi155.stdout:4/651: readlink d1/d7/d21/l47 0 2024-09-13T21:45:00.870 INFO:tasks.workunit.client.1.smithi155.stdout:7/625: unlink d5/df/d15/d33/lb7 0 2024-09-13T21:45:00.874 INFO:tasks.workunit.client.1.smithi155.stdout:6/854: mknod db/d11/d6d/db9/de6/d5f/de4/c126 0 2024-09-13T21:45:00.879 INFO:tasks.workunit.client.1.smithi155.stdout:3/789: mknod d3/d25/d1b/d1f/d36/d5c/ddb/dfd/c110 0 2024-09-13T21:45:00.880 INFO:tasks.workunit.client.1.smithi155.stdout:5/680: dread d5/d16/d81/d98/f4b [0,4194304] 0 2024-09-13T21:45:00.880 INFO:tasks.workunit.client.1.smithi155.stdout:1/706: dread d6/d82/d91/fa4 [0,4194304] 0 2024-09-13T21:45:00.880 INFO:tasks.workunit.client.1.smithi155.stdout:4/652: dread d1/d7/de/d15/d55/d5e/d66/f6c [0,4194304] 0 2024-09-13T21:45:00.884 INFO:tasks.workunit.client.1.smithi155.stdout:5/681: write d5/d16/d33/d1b/d2f/d3c/d6c/d45/f65 [4570361,75882] 0 2024-09-13T21:45:00.885 INFO:tasks.workunit.client.1.smithi155.stdout:6/855: fdatasync db/d11/d6d/db9/d1c/d36/d83/ddd/d64/f77 0 2024-09-13T21:45:00.889 INFO:tasks.workunit.client.1.smithi155.stdout:3/790: dwrite d3/d10/fe0 [0,4194304] 0 2024-09-13T21:45:00.892 INFO:tasks.workunit.client.1.smithi155.stdout:3/791: write d3/d25/d1b/d90/fe1 [385104,44173] 0 2024-09-13T21:45:00.896 INFO:tasks.workunit.client.1.smithi155.stdout:4/653: mknod d1/d7/de/d15/d55/d5e/d66/cc4 0 2024-09-13T21:45:00.898 INFO:tasks.workunit.client.1.smithi155.stdout:6/856: creat db/d11/d6d/db9/de6/d5f/f127 x:0 0 0 2024-09-13T21:45:00.900 INFO:tasks.workunit.client.1.smithi155.stdout:6/857: stat db/d11/d1e/d21 0 2024-09-13T21:45:00.902 INFO:tasks.workunit.client.1.smithi155.stdout:7/626: getdents d5/d13/d5f 0 2024-09-13T21:45:00.902 INFO:tasks.workunit.client.1.smithi155.stdout:4/654: symlink d1/d7/d21/d2d/d42/lc5 0 2024-09-13T21:45:00.903 INFO:tasks.workunit.client.1.smithi155.stdout:1/707: dwrite d6/d15/d57/d5d/fd0 [0,4194304] 0 2024-09-13T21:45:00.911 INFO:tasks.workunit.client.1.smithi155.stdout:6/858: truncate db/d11/d6d/db9/f102 2354465 0 2024-09-13T21:45:00.913 INFO:tasks.workunit.client.1.smithi155.stdout:3/792: link d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/lda d3/d25/d1b/d1f/dc8/l111 0 2024-09-13T21:45:00.914 INFO:tasks.workunit.client.1.smithi155.stdout:3/793: chown d3/d21/fc6 925 1 2024-09-13T21:45:00.914 INFO:tasks.workunit.client.1.smithi155.stdout:6/859: chown db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/d93/f100 1130 1 2024-09-13T21:45:00.916 INFO:tasks.workunit.client.1.smithi155.stdout:7/627: symlink d5/d10/dbf/lc2 0 2024-09-13T21:45:00.918 INFO:tasks.workunit.client.1.smithi155.stdout:3/794: dread - d3/d25/d1b/d1f/d36/d5c/ddb/fea zero size 2024-09-13T21:45:00.918 INFO:tasks.workunit.client.1.smithi155.stdout:1/708: link d6/d15/d23/d87/fdd d6/d15/d23/d87/de2/ff4 0 2024-09-13T21:45:00.918 INFO:tasks.workunit.client.1.smithi155.stdout:6/860: symlink db/d11/d6d/db9/d1c/d36/d83/ddd/l128 0 2024-09-13T21:45:00.918 INFO:tasks.workunit.client.1.smithi155.stdout:4/655: getdents d1/d7/de 0 2024-09-13T21:45:00.923 INFO:tasks.workunit.client.1.smithi155.stdout:6/861: creat db/d11/d6d/db9/de6/d5f/f129 x:0 0 0 2024-09-13T21:45:00.927 INFO:tasks.workunit.client.1.smithi155.stdout:5/682: dread d5/d16/d33/d1f/f20 [0,4194304] 0 2024-09-13T21:45:00.927 INFO:tasks.workunit.client.1.smithi155.stdout:7/628: truncate d5/d10/d3e/f6b 880219 0 2024-09-13T21:45:00.928 INFO:tasks.workunit.client.1.smithi155.stdout:3/795: link d3/d25/d1b/d1f/dc8/l111 d3/d21/d4a/dcd/l112 0 2024-09-13T21:45:00.929 INFO:tasks.workunit.client.1.smithi155.stdout:7/629: fsync d5/d13/f24 0 2024-09-13T21:45:00.929 INFO:tasks.workunit.client.1.smithi155.stdout:4/656: dwrite d1/f59 [0,4194304] 0 2024-09-13T21:45:00.930 INFO:tasks.workunit.client.1.smithi155.stdout:1/709: rename d6/d15/d23/d55/d6e/dbb/d4b/f6d to d6/d15/d57/d99/ff5 0 2024-09-13T21:45:00.932 INFO:tasks.workunit.client.1.smithi155.stdout:6/862: symlink db/d11/d1e/d21/d44/daa/l12a 0 2024-09-13T21:45:00.933 INFO:tasks.workunit.client.1.smithi155.stdout:4/657: write d1/f3b [1828299,71483] 0 2024-09-13T21:45:00.935 INFO:tasks.workunit.client.1.smithi155.stdout:3/796: rename d3/d21/d2c/cb7 to d3/d25/d1b/d1f/d82/d83/d99/c113 0 2024-09-13T21:45:00.935 INFO:tasks.workunit.client.1.smithi155.stdout:6/863: write db/d11/d2b/f9b [781876,52688] 0 2024-09-13T21:45:00.936 INFO:tasks.workunit.client.1.smithi155.stdout:7/630: dread d5/df/d15/d33/f69 [0,4194304] 0 2024-09-13T21:45:00.936 INFO:tasks.workunit.client.1.smithi155.stdout:1/710: stat d6/d82/f94 0 2024-09-13T21:45:00.939 INFO:tasks.workunit.client.1.smithi155.stdout:3/797: creat d3/d21/d4a/f114 x:0 0 0 2024-09-13T21:45:00.941 INFO:tasks.workunit.client.1.smithi155.stdout:3/798: dread - d3/d21/d4a/dcd/dd8/fed zero size 2024-09-13T21:45:00.944 INFO:tasks.workunit.client.1.smithi155.stdout:6/864: mknod db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/db4/c12b 0 2024-09-13T21:45:00.945 INFO:tasks.workunit.client.1.smithi155.stdout:3/799: mkdir d3/d21/d2c/d115 0 2024-09-13T21:45:00.946 INFO:tasks.workunit.client.1.smithi155.stdout:4/658: getdents d1/d7 0 2024-09-13T21:45:00.946 INFO:tasks.workunit.client.1.smithi155.stdout:3/800: readlink d3/d25/d1b/d90/ldd 0 2024-09-13T21:45:00.957 INFO:tasks.workunit.client.1.smithi155.stdout:4/659: mkdir d1/d7/d21/dc6 0 2024-09-13T21:45:00.961 INFO:tasks.workunit.client.1.smithi155.stdout:0/703: sync 2024-09-13T21:45:00.961 INFO:tasks.workunit.client.1.smithi155.stdout:8/597: sync 2024-09-13T21:45:00.966 INFO:tasks.workunit.client.1.smithi155.stdout:0/704: unlink d1/d6/dc/d4d/f59 0 2024-09-13T21:45:00.967 INFO:tasks.workunit.client.1.smithi155.stdout:8/598: creat d2/d2d/d96/db8/fba x:0 0 0 2024-09-13T21:45:00.968 INFO:tasks.workunit.client.1.smithi155.stdout:8/599: fsync d2/d2d/f69 0 2024-09-13T21:45:00.968 INFO:tasks.workunit.client.1.smithi155.stdout:0/705: chown d1/f1f 473 1 2024-09-13T21:45:00.971 INFO:tasks.workunit.client.1.smithi155.stdout:8/600: creat d2/d8/d65/da8/fbb x:0 0 0 2024-09-13T21:45:00.972 INFO:tasks.workunit.client.1.smithi155.stdout:0/706: mknod d1/d6/dc/d4d/d4a/d9e/c10d 0 2024-09-13T21:45:00.973 INFO:tasks.workunit.client.1.smithi155.stdout:1/711: write d6/d15/d23/d55/f60 [4783919,40151] 0 2024-09-13T21:45:00.974 INFO:tasks.workunit.client.1.smithi155.stdout:6/865: rmdir db/d11 39 2024-09-13T21:45:00.975 INFO:tasks.workunit.client.1.smithi155.stdout:5/683: dread d5/f9 [0,4194304] 0 2024-09-13T21:45:00.977 INFO:tasks.workunit.client.1.smithi155.stdout:4/660: write d1/d7/d21/d2d/f6d [1320411,24914] 0 2024-09-13T21:45:00.979 INFO:tasks.workunit.client.1.smithi155.stdout:1/712: symlink d6/d82/lf6 0 2024-09-13T21:45:00.981 INFO:tasks.workunit.client.1.smithi155.stdout:0/707: creat d1/d6/f10e x:0 0 0 2024-09-13T21:45:00.982 INFO:tasks.workunit.client.1.smithi155.stdout:1/713: readlink d6/d7/l42 0 2024-09-13T21:45:00.985 INFO:tasks.workunit.client.1.smithi155.stdout:4/661: chown d1/d7/d5a/c8f 229 1 2024-09-13T21:45:00.986 INFO:tasks.workunit.client.1.smithi155.stdout:1/714: fsync d6/d7/f24 0 2024-09-13T21:45:00.987 INFO:tasks.workunit.client.1.smithi155.stdout:8/601: dwrite d2/d6/f94 [0,4194304] 0 2024-09-13T21:45:00.989 INFO:tasks.workunit.client.1.smithi155.stdout:0/708: write d1/d6/fd1 [948838,105826] 0 2024-09-13T21:45:00.989 INFO:tasks.workunit.client.1.smithi155.stdout:6/866: rename db/d11/d1e/d21/fec to db/d11/d6d/db9/d1c/f12c 0 2024-09-13T21:45:00.994 INFO:tasks.workunit.client.1.smithi155.stdout:7/631: dwrite d5/d3b/f42 [0,4194304] 0 2024-09-13T21:45:01.000 INFO:tasks.workunit.client.1.smithi155.stdout:3/801: dwrite d3/d25/d17/f5b [4194304,4194304] 0 2024-09-13T21:45:01.002 INFO:tasks.workunit.client.1.smithi155.stdout:8/602: chown d2/d6/dd/d25/c3f 105766960 1 2024-09-13T21:45:01.003 INFO:tasks.workunit.client.1.smithi155.stdout:4/662: creat d1/d7/de/d15/d55/d5e/d66/fc7 x:0 0 0 2024-09-13T21:45:01.004 INFO:tasks.workunit.client.1.smithi155.stdout:0/709: chown d1/d6/dc/d4d/d4a/d4e/d61/led 502 1 2024-09-13T21:45:01.005 INFO:tasks.workunit.client.1.smithi155.stdout:5/684: dwrite d5/d16/d33/d1b/d2f/d3c/d44/f2e [0,4194304] 0 2024-09-13T21:45:01.007 INFO:tasks.workunit.client.1.smithi155.stdout:8/603: write d2/d8/d65/f68 [3736099,43177] 0 2024-09-13T21:45:01.010 INFO:tasks.workunit.client.1.smithi155.stdout:3/802: dread - d3/d25/d1b/d1f/d36/d5c/ddb/fea zero size 2024-09-13T21:45:01.010 INFO:tasks.workunit.client.1.smithi155.stdout:0/710: fsync d1/d6/dc/d4d/d4a/d52/d5b/fa1 0 2024-09-13T21:45:01.013 INFO:tasks.workunit.client.1.smithi155.stdout:5/685: chown d5/d16/d33/d1b/d2f/d3c/d6c/f76 1 1 2024-09-13T21:45:01.015 INFO:tasks.workunit.client.1.smithi155.stdout:8/604: creat d2/d1f/d77/fbc x:0 0 0 2024-09-13T21:45:01.015 INFO:tasks.workunit.client.1.smithi155.stdout:0/711: chown d1/d6/dc/d4d/d4a/d52/d5c/d6a/fc8 395 1 2024-09-13T21:45:01.017 INFO:tasks.workunit.client.1.smithi155.stdout:1/715: dread d6/f49 [0,4194304] 0 2024-09-13T21:45:01.017 INFO:tasks.workunit.client.1.smithi155.stdout:7/632: mknod d5/d10/d3e/d3f/cc3 0 2024-09-13T21:45:01.020 INFO:tasks.workunit.client.1.smithi155.stdout:4/663: link d1/f3b d1/d7/d21/d2d/fc8 0 2024-09-13T21:45:01.021 INFO:tasks.workunit.client.1.smithi155.stdout:5/686: mknod d5/d16/d33/d1b/d2f/d3c/d44/ce0 0 2024-09-13T21:45:01.022 INFO:tasks.workunit.client.1.smithi155.stdout:3/803: mknod d3/d25/d1b/d1f/d82/d83/c116 0 2024-09-13T21:45:01.023 INFO:tasks.workunit.client.1.smithi155.stdout:3/804: stat d3/d25/d17/f27 0 2024-09-13T21:45:01.025 INFO:tasks.workunit.client.1.smithi155.stdout:4/664: rename d1/f1c to d1/d7/d5a/fc9 0 2024-09-13T21:45:01.025 INFO:tasks.workunit.client.1.smithi155.stdout:8/605: read - d2/d8/f80 zero size 2024-09-13T21:45:01.030 INFO:tasks.workunit.client.1.smithi155.stdout:3/805: mkdir d3/d25/d1b/d1f/d36/d5c/dbc/d117 0 2024-09-13T21:45:01.031 INFO:tasks.workunit.client.1.smithi155.stdout:8/606: chown d2/d8/d65/f5b 4 1 2024-09-13T21:45:01.031 INFO:tasks.workunit.client.1.smithi155.stdout:4/665: write d1/d7/d83/f9c [1258613,12158] 0 2024-09-13T21:45:01.033 INFO:tasks.workunit.client.1.smithi155.stdout:0/712: dwrite d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/fc9 [0,4194304] 0 2024-09-13T21:45:01.036 INFO:tasks.workunit.client.1.smithi155.stdout:7/633: dwrite d5/d10/d3e/d3f/f7c [0,4194304] 0 2024-09-13T21:45:01.039 INFO:tasks.workunit.client.1.smithi155.stdout:6/867: truncate db/d11/d2b/f72 1145874 0 2024-09-13T21:45:01.042 INFO:tasks.workunit.client.1.smithi155.stdout:8/607: truncate d2/d6/dd/d25/f4c 5041805 0 2024-09-13T21:45:01.042 INFO:tasks.workunit.client.1.smithi155.stdout:3/806: creat d3/d21/d4a/dcd/f118 x:0 0 0 2024-09-13T21:45:01.044 INFO:tasks.workunit.client.1.smithi155.stdout:0/713: creat d1/d10b/f10f x:0 0 0 2024-09-13T21:45:01.047 INFO:tasks.workunit.client.1.smithi155.stdout:8/608: creat d2/dae/fbd x:0 0 0 2024-09-13T21:45:01.048 INFO:tasks.workunit.client.1.smithi155.stdout:0/714: mknod d1/d6/d81/df7/c110 0 2024-09-13T21:45:01.050 INFO:tasks.workunit.client.1.smithi155.stdout:6/868: mknod db/d11/d6d/db9/d1c/d36/d83/ddd/db6/c12d 0 2024-09-13T21:45:01.053 INFO:tasks.workunit.client.1.smithi155.stdout:8/609: mkdir d2/dae/dbe 0 2024-09-13T21:45:01.053 INFO:tasks.workunit.client.1.smithi155.stdout:1/716: dwrite d6/d15/d23/f3f [0,4194304] 0 2024-09-13T21:45:01.058 INFO:tasks.workunit.client.1.smithi155.stdout:5/687: dwrite d5/d16/d33/d1b/d2f/d3c/d6c/f35 [0,4194304] 0 2024-09-13T21:45:01.058 INFO:tasks.workunit.client.1.smithi155.stdout:6/869: creat db/d11/d6d/db9/d1c/d36/d83/f12e x:0 0 0 2024-09-13T21:45:01.061 INFO:tasks.workunit.client.1.smithi155.stdout:8/610: creat d2/d8/d75/fbf x:0 0 0 2024-09-13T21:45:01.062 INFO:tasks.workunit.client.1.smithi155.stdout:1/717: creat d6/d7/d89/dd6/de0/ff7 x:0 0 0 2024-09-13T21:45:01.063 INFO:tasks.workunit.client.1.smithi155.stdout:0/715: dwrite d1/d6/dc/d4d/d4a/d4e/f75 [0,4194304] 0 2024-09-13T21:45:01.064 INFO:tasks.workunit.client.1.smithi155.stdout:4/666: write d1/f24 [1419177,117670] 0 2024-09-13T21:45:01.073 INFO:tasks.workunit.client.1.smithi155.stdout:5/688: creat d5/d16/d33/d1b/d92/fe1 x:0 0 0 2024-09-13T21:45:01.073 INFO:tasks.workunit.client.1.smithi155.stdout:6/870: mkdir db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d12f 0 2024-09-13T21:45:01.073 INFO:tasks.workunit.client.1.smithi155.stdout:0/716: read - d1/d6/d81/fbb zero size 2024-09-13T21:45:01.075 INFO:tasks.workunit.client.1.smithi155.stdout:5/689: write d5/d16/d33/d1b/d2f/d3c/f41 [724867,23345] 0 2024-09-13T21:45:01.081 INFO:tasks.workunit.client.1.smithi155.stdout:4/667: getdents d1/d7/de/d15/d55/d5e 0 2024-09-13T21:45:01.081 INFO:tasks.workunit.client.1.smithi155.stdout:8/611: getdents d2/d95 0 2024-09-13T21:45:01.083 INFO:tasks.workunit.client.1.smithi155.stdout:7/634: dread d5/d13/d5f/fb1 [0,4194304] 0 2024-09-13T21:45:01.086 INFO:tasks.workunit.client.1.smithi155.stdout:5/690: dwrite d5/f7 [4194304,4194304] 0 2024-09-13T21:45:01.086 INFO:tasks.workunit.client.1.smithi155.stdout:6/871: dread db/d11/d6d/db9/d1c/d36/d37/f91 [0,4194304] 0 2024-09-13T21:45:01.090 INFO:tasks.workunit.client.1.smithi155.stdout:1/718: write d6/d82/d91/daf/f9b [91441,123894] 0 2024-09-13T21:45:01.091 INFO:tasks.workunit.client.1.smithi155.stdout:8/612: truncate d2/d6/dd/d25/f5d 3286957 0 2024-09-13T21:45:01.094 INFO:tasks.workunit.client.1.smithi155.stdout:4/668: truncate d1/d7/de/d15/d55/d5e/d66/f6c 761048 0 2024-09-13T21:45:01.097 INFO:tasks.workunit.client.1.smithi155.stdout:6/872: dwrite db/f10 [0,4194304] 0 2024-09-13T21:45:01.097 INFO:tasks.workunit.client.1.smithi155.stdout:5/691: write d5/d16/d81/d98/d84/f89 [3835422,28989] 0 2024-09-13T21:45:01.099 INFO:tasks.workunit.client.1.smithi155.stdout:7/635: getdents d5/d10/d3e/d3f 0 2024-09-13T21:45:01.099 INFO:tasks.workunit.client.1.smithi155.stdout:5/692: stat d5/d16/d4e/c8c 0 2024-09-13T21:45:01.100 INFO:tasks.workunit.client.1.smithi155.stdout:5/693: chown d5/fe 15571 1 2024-09-13T21:45:01.100 INFO:tasks.workunit.client.1.smithi155.stdout:8/613: rename d2/d8/f4f to d2/d2d/d96/fc0 0 2024-09-13T21:45:01.104 INFO:tasks.workunit.client.1.smithi155.stdout:8/614: write d2/d8/d65/f56 [2970012,63100] 0 2024-09-13T21:45:01.104 INFO:tasks.workunit.client.1.smithi155.stdout:0/717: dread d1/f35 [0,4194304] 0 2024-09-13T21:45:01.104 INFO:tasks.workunit.client.1.smithi155.stdout:6/873: truncate db/d11/f39 594918 0 2024-09-13T21:45:01.106 INFO:tasks.workunit.client.1.smithi155.stdout:4/669: rename d1/d7/d21/d2d/lbf to d1/d7/d21/d2d/d42/lca 0 2024-09-13T21:45:01.108 INFO:tasks.workunit.client.1.smithi155.stdout:8/615: truncate d2/d1f/d77/fbc 572163 0 2024-09-13T21:45:01.109 INFO:tasks.workunit.client.1.smithi155.stdout:5/694: read d5/d16/d33/d1b/d2f/d3c/d6c/f77 [577223,96904] 0 2024-09-13T21:45:01.109 INFO:tasks.workunit.client.1.smithi155.stdout:4/670: stat d1/d7/de/d15/d55/d5e/d66/dc2/fb9 0 2024-09-13T21:45:01.110 INFO:tasks.workunit.client.1.smithi155.stdout:0/718: write d1/fc2 [2793394,111804] 0 2024-09-13T21:45:01.111 INFO:tasks.workunit.client.1.smithi155.stdout:4/671: write d1/f24 [3189900,30953] 0 2024-09-13T21:45:01.111 INFO:tasks.workunit.client.1.smithi155.stdout:6/874: dread - db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/dda/f11e zero size 2024-09-13T21:45:01.113 INFO:tasks.workunit.client.1.smithi155.stdout:0/719: fsync d1/d6/dc/fe 0 2024-09-13T21:45:01.118 INFO:tasks.workunit.client.1.smithi155.stdout:1/719: truncate d6/d15/f18 312287 0 2024-09-13T21:45:01.121 INFO:tasks.workunit.client.1.smithi155.stdout:5/695: creat d5/d16/d81/d98/d84/fe2 x:0 0 0 2024-09-13T21:45:01.121 INFO:tasks.workunit.client.1.smithi155.stdout:8/616: dwrite d2/d6/dd/fa3 [4194304,4194304] 0 2024-09-13T21:45:01.121 INFO:tasks.workunit.client.1.smithi155.stdout:6/875: creat db/d11/d1e/dca/f130 x:0 0 0 2024-09-13T21:45:01.122 INFO:tasks.workunit.client.1.smithi155.stdout:7/636: dread d5/df/d79/f92 [0,4194304] 0 2024-09-13T21:45:01.122 INFO:tasks.workunit.client.1.smithi155.stdout:0/720: write d1/d6/dc/d4d/d4a/d4e/f75 [4173012,56357] 0 2024-09-13T21:45:01.130 INFO:tasks.workunit.client.1.smithi155.stdout:0/721: write d1/d6/dc/d4d/f10c [824862,20323] 0 2024-09-13T21:45:01.130 INFO:tasks.workunit.client.1.smithi155.stdout:6/876: chown db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d12f 149 1 2024-09-13T21:45:01.130 INFO:tasks.workunit.client.1.smithi155.stdout:8/617: creat d2/d8/d75/fc1 x:0 0 0 2024-09-13T21:45:01.135 INFO:tasks.workunit.client.1.smithi155.stdout:7/637: mknod d5/df/d15/d33/cc4 0 2024-09-13T21:45:01.135 INFO:tasks.workunit.client.1.smithi155.stdout:5/696: read d5/d16/d33/d1b/d2f/d3c/d6c/f76 [658341,73296] 0 2024-09-13T21:45:01.136 INFO:tasks.workunit.client.1.smithi155.stdout:6/877: chown db/d11/d6d/db9/d1c/d36/fb2 385273403 1 2024-09-13T21:45:01.136 INFO:tasks.workunit.client.1.smithi155.stdout:0/722: mkdir d1/d10b/d111 0 2024-09-13T21:45:01.136 INFO:tasks.workunit.client.1.smithi155.stdout:1/720: getdents d6/d7/d89 0 2024-09-13T21:45:01.137 INFO:tasks.workunit.client.1.smithi155.stdout:4/672: dwrite d1/d7/de/d1a/f68 [0,4194304] 0 2024-09-13T21:45:01.141 INFO:tasks.workunit.client.1.smithi155.stdout:7/638: write d5/d10/d48/faf [185362,130248] 0 2024-09-13T21:45:01.141 INFO:tasks.workunit.client.1.smithi155.stdout:8/618: rename d2/d1f/d87/f8f to d2/d6/dd/d25/fc2 0 2024-09-13T21:45:01.142 INFO:tasks.workunit.client.1.smithi155.stdout:5/697: truncate d5/fa 647418 0 2024-09-13T21:45:01.144 INFO:tasks.workunit.client.1.smithi155.stdout:5/698: chown d5/d16/d33/d1b/d59/dd1 98 1 2024-09-13T21:45:01.146 INFO:tasks.workunit.client.1.smithi155.stdout:4/673: creat d1/d7/de/d72/da6/fcb x:0 0 0 2024-09-13T21:45:01.150 INFO:tasks.workunit.client.1.smithi155.stdout:6/878: mkdir db/d11/d6d/db9/d1c/d36/d131 0 2024-09-13T21:45:01.153 INFO:tasks.workunit.client.1.smithi155.stdout:4/674: rename d1/d7/de/d72/da6/fcb to d1/d7/de/d1a/fcc 0 2024-09-13T21:45:01.154 INFO:tasks.workunit.client.1.smithi155.stdout:8/619: mknod d2/d8/d5e/d60/cc3 0 2024-09-13T21:45:01.155 INFO:tasks.workunit.client.1.smithi155.stdout:0/723: creat d1/d6/dc/d90/df1/f112 x:0 0 0 2024-09-13T21:45:01.156 INFO:tasks.workunit.client.1.smithi155.stdout:8/620: readlink d2/d6/dd/l44 0 2024-09-13T21:45:01.157 INFO:tasks.workunit.client.1.smithi155.stdout:0/724: chown d1/d6/dc/d4d/d4a/d4e/d61/l62 2656183 1 2024-09-13T21:45:01.157 INFO:tasks.workunit.client.1.smithi155.stdout:7/639: creat d5/d3b/d8e/fc5 x:0 0 0 2024-09-13T21:45:01.161 INFO:tasks.workunit.client.1.smithi155.stdout:1/721: truncate d6/d15/d23/d87/f29 6053878 0 2024-09-13T21:45:01.162 INFO:tasks.workunit.client.1.smithi155.stdout:8/621: write d2/d8/d65/f5b [62635,40187] 0 2024-09-13T21:45:01.163 INFO:tasks.workunit.client.1.smithi155.stdout:1/722: dread d6/d15/d23/fb8 [0,4194304] 0 2024-09-13T21:45:01.166 INFO:tasks.workunit.client.1.smithi155.stdout:6/879: mknod db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/db4/dd8/c132 0 2024-09-13T21:45:01.170 INFO:tasks.workunit.client.1.smithi155.stdout:7/640: dwrite d5/df/d60/f63 [0,4194304] 0 2024-09-13T21:45:01.170 INFO:tasks.workunit.client.1.smithi155.stdout:8/622: rmdir d2/d2d 39 2024-09-13T21:45:01.177 INFO:tasks.workunit.client.1.smithi155.stdout:0/725: creat d1/d6/dc/d4d/d4a/d52/f113 x:0 0 0 2024-09-13T21:45:01.178 INFO:tasks.workunit.client.1.smithi155.stdout:1/723: getdents d6/d15/d23/d55/db9/de7 0 2024-09-13T21:45:01.181 INFO:tasks.workunit.client.1.smithi155.stdout:7/641: rename d5/df/d15/d33/l8d to d5/df/d60/d6d/lc6 0 2024-09-13T21:45:01.181 INFO:tasks.workunit.client.1.smithi155.stdout:5/699: getdents d5/d16/d33/d1b/d2f/d3c/d5b/d5f 0 2024-09-13T21:45:01.181 INFO:tasks.workunit.client.1.smithi155.stdout:1/724: read d6/d82/d90/f6c [7272187,38361] 0 2024-09-13T21:45:01.182 INFO:tasks.workunit.client.1.smithi155.stdout:0/726: write d1/d6/dc/d4d/d4a/d4e/d61/fd3 [571532,79353] 0 2024-09-13T21:45:01.182 INFO:tasks.workunit.client.1.smithi155.stdout:4/675: dwrite d1/d7/de/d15/d55/d5e/d66/f6c [0,4194304] 0 2024-09-13T21:45:01.184 INFO:tasks.workunit.client.1.smithi155.stdout:0/727: chown d1/d6 1219876266 1 2024-09-13T21:45:01.186 INFO:tasks.workunit.client.1.smithi155.stdout:1/725: write d6/d7/f8 [3735744,103423] 0 2024-09-13T21:45:01.189 INFO:tasks.workunit.client.1.smithi155.stdout:6/880: getdents db/d11/d6d/db9/d1c/d36/d83/ddd/d64 0 2024-09-13T21:45:01.189 INFO:tasks.workunit.client.1.smithi155.stdout:5/700: unlink d5/d16/d33/d1b/d1e/c64 0 2024-09-13T21:45:01.191 INFO:tasks.workunit.client.1.smithi155.stdout:4/676: unlink d1/d7/d21/d2d/cae 0 2024-09-13T21:45:01.193 INFO:tasks.workunit.client.1.smithi155.stdout:0/728: symlink d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/l114 0 2024-09-13T21:45:01.194 INFO:tasks.workunit.client.1.smithi155.stdout:4/677: fsync d1/d7/d21/d69/fbe 0 2024-09-13T21:45:01.196 INFO:tasks.workunit.client.1.smithi155.stdout:4/678: chown d1/d48/fbb 22250 1 2024-09-13T21:45:01.197 INFO:tasks.workunit.client.1.smithi155.stdout:7/642: dwrite d5/df/d60/d6d/f93 [0,4194304] 0 2024-09-13T21:45:01.199 INFO:tasks.workunit.client.1.smithi155.stdout:8/623: truncate d2/d1f/f84 62531 0 2024-09-13T21:45:01.200 INFO:tasks.workunit.client.1.smithi155.stdout:6/881: rename db/d11/d1e/d21/f4d to db/d11/d6d/db9/de6/d5f/de4/f133 0 2024-09-13T21:45:01.201 INFO:tasks.workunit.client.1.smithi155.stdout:0/729: dread d1/d6/dc/d4d/f10c [0,4194304] 0 2024-09-13T21:45:01.203 INFO:tasks.workunit.client.1.smithi155.stdout:8/624: write d2/d6/dd/f8c [49618,19701] 0 2024-09-13T21:45:01.206 INFO:tasks.workunit.client.1.smithi155.stdout:1/726: write d6/d15/d23/d87/de2/ff4 [373379,45035] 0 2024-09-13T21:45:01.207 INFO:tasks.workunit.client.1.smithi155.stdout:5/701: creat d5/d16/d33/d1b/d2f/d3c/fe3 x:0 0 0 2024-09-13T21:45:01.208 INFO:tasks.workunit.client.1.smithi155.stdout:7/643: truncate d5/df/d15/d33/d43/f64 3688530 0 2024-09-13T21:45:01.209 INFO:tasks.workunit.client.1.smithi155.stdout:8/625: creat d2/d8/d5e/d60/fc4 x:0 0 0 2024-09-13T21:45:01.213 INFO:tasks.workunit.client.1.smithi155.stdout:1/727: creat d6/d15/d23/d55/d6e/ff8 x:0 0 0 2024-09-13T21:45:01.216 INFO:tasks.workunit.client.1.smithi155.stdout:5/702: unlink d5/d16/d81/d98/d84/lbf 0 2024-09-13T21:45:01.217 INFO:tasks.workunit.client.1.smithi155.stdout:7/644: creat d5/df/d15/d33/d55/d97/fc7 x:0 0 0 2024-09-13T21:45:01.219 INFO:tasks.workunit.client.1.smithi155.stdout:8/626: unlink d2/d1f/d87/f89 0 2024-09-13T21:45:01.220 INFO:tasks.workunit.client.1.smithi155.stdout:4/679: write d1/d7/de/d15/f37 [4476415,112290] 0 2024-09-13T21:45:01.221 INFO:tasks.workunit.client.1.smithi155.stdout:1/728: mknod d6/d7/d89/dd6/cf9 0 2024-09-13T21:45:01.225 INFO:tasks.workunit.client.1.smithi155.stdout:5/703: creat d5/d16/d33/d1b/d1e/fe4 x:0 0 0 2024-09-13T21:45:01.225 INFO:tasks.workunit.client.1.smithi155.stdout:0/730: dread d1/d6/f13 [0,4194304] 0 2024-09-13T21:45:01.229 INFO:tasks.workunit.client.1.smithi155.stdout:8/627: readlink d2/d8/l64 0 2024-09-13T21:45:01.232 INFO:tasks.workunit.client.1.smithi155.stdout:2/626: sync 2024-09-13T21:45:01.232 INFO:tasks.workunit.client.1.smithi155.stdout:0/731: creat d1/d6/d81/f115 x:0 0 0 2024-09-13T21:45:01.233 INFO:tasks.workunit.client.1.smithi155.stdout:5/704: truncate d5/d16/d33/d1b/d2f/d3c/f7f 925448 0 2024-09-13T21:45:01.237 INFO:tasks.workunit.client.1.smithi155.stdout:6/882: getdents db/d11/d6d/db9/d1c/d36/d37 0 2024-09-13T21:45:01.237 INFO:tasks.workunit.client.1.smithi155.stdout:2/627: creat d2/dd/d21/d39/dc1/d66/fe0 x:0 0 0 2024-09-13T21:45:01.238 INFO:tasks.workunit.client.1.smithi155.stdout:0/732: creat d1/d6/dc/d8c/f116 x:0 0 0 2024-09-13T21:45:01.239 INFO:tasks.workunit.client.1.smithi155.stdout:4/680: creat d1/fcd x:0 0 0 2024-09-13T21:45:01.240 INFO:tasks.workunit.client.1.smithi155.stdout:7/645: dwrite d5/d3b/f4b [0,4194304] 0 2024-09-13T21:45:01.240 INFO:tasks.workunit.client.1.smithi155.stdout:1/729: dread d6/d7/d89/dd6/dee/f97 [0,4194304] 0 2024-09-13T21:45:01.245 INFO:tasks.workunit.client.1.smithi155.stdout:7/646: readlink d5/d10/d3e/l3c 0 2024-09-13T21:45:01.245 INFO:tasks.workunit.client.1.smithi155.stdout:6/883: mkdir db/d2c/d85/d134 0 2024-09-13T21:45:01.249 INFO:tasks.workunit.client.1.smithi155.stdout:7/647: fsync d5/df/f85 0 2024-09-13T21:45:01.249 INFO:tasks.workunit.client.1.smithi155.stdout:4/681: readlink d1/d7/de/d15/d55/d5e/d66/la0 0 2024-09-13T21:45:01.251 INFO:tasks.workunit.client.1.smithi155.stdout:6/884: creat db/d2c/dbc/dc2/f135 x:0 0 0 2024-09-13T21:45:01.252 INFO:tasks.workunit.client.1.smithi155.stdout:8/628: dwrite d2/d2d/d96/db8/fba [0,4194304] 0 2024-09-13T21:45:01.253 INFO:tasks.workunit.client.1.smithi155.stdout:2/628: rename d2/dd/d21/d39/dc1/d66/d7c/ldd to d2/dd/le1 0 2024-09-13T21:45:01.253 INFO:tasks.workunit.client.1.smithi155.stdout:5/705: dwrite d5/d16/d33/d1b/d1e/fe4 [0,4194304] 0 2024-09-13T21:45:01.255 INFO:tasks.workunit.client.1.smithi155.stdout:4/682: unlink d1/d7/d5a/l74 0 2024-09-13T21:45:01.257 INFO:tasks.workunit.client.1.smithi155.stdout:8/629: chown d2/d6/dd/d12/f21 2018804 1 2024-09-13T21:45:01.257 INFO:tasks.workunit.client.1.smithi155.stdout:4/683: chown d1/d7/de/dc/d4a/f56 167644 1 2024-09-13T21:45:01.260 INFO:tasks.workunit.client.1.smithi155.stdout:8/630: chown d2/d6/dd/f62 0 1 2024-09-13T21:45:01.262 INFO:tasks.workunit.client.1.smithi155.stdout:5/706: mknod d5/d16/ce5 0 2024-09-13T21:45:01.264 INFO:tasks.workunit.client.1.smithi155.stdout:4/684: unlink d1/d7/d21/d2d/la4 0 2024-09-13T21:45:01.266 INFO:tasks.workunit.client.1.smithi155.stdout:2/629: mkdir d2/dd/de/d15/d3f/de2 0 2024-09-13T21:45:01.266 INFO:tasks.workunit.client.1.smithi155.stdout:8/631: dread - d2/d2d/f6c zero size 2024-09-13T21:45:01.268 INFO:tasks.workunit.client.1.smithi155.stdout:6/885: mknod db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/db4/c136 0 2024-09-13T21:45:01.269 INFO:tasks.workunit.client.1.smithi155.stdout:7/648: write d5/df/d15/d33/d55/f9b [425118,8969] 0 2024-09-13T21:45:01.274 INFO:tasks.workunit.client.1.smithi155.stdout:6/886: mknod db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/db4/c137 0 2024-09-13T21:45:01.275 INFO:tasks.workunit.client.1.smithi155.stdout:0/733: rename d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/c7b to d1/d6/dc/d4d/c117 0 2024-09-13T21:45:01.275 INFO:tasks.workunit.client.1.smithi155.stdout:7/649: mkdir d5/df/d15/d33/d55/d97/dc8 0 2024-09-13T21:45:01.276 INFO:tasks.workunit.client.1.smithi155.stdout:4/685: mkdir d1/d7/de/d15/dce 0 2024-09-13T21:45:01.277 INFO:tasks.workunit.client.1.smithi155.stdout:8/632: mkdir d2/d6/dd/d25/dc5 0 2024-09-13T21:45:01.278 INFO:tasks.workunit.client.1.smithi155.stdout:0/734: mkdir d1/d6/dc/d4d/d4a/d4e/d61/d118 0 2024-09-13T21:45:01.278 INFO:tasks.workunit.client.1.smithi155.stdout:4/686: readlink d1/d7/de/d15/d55/d5e/d66/d7e/lb8 0 2024-09-13T21:45:01.345 INFO:tasks.workunit.client.1.smithi155.stdout:9/724: sync 2024-09-13T21:45:01.345 INFO:tasks.workunit.client.1.smithi155.stdout:3/807: sync 2024-09-13T21:45:01.353 INFO:tasks.workunit.client.1.smithi155.stdout:1/730: truncate d6/d15/d23/d55/d6e/dbb/d4b/fde 3538481 0 2024-09-13T21:45:01.355 INFO:tasks.workunit.client.1.smithi155.stdout:2/630: write d2/fc [1202313,72800] 0 2024-09-13T21:45:01.356 INFO:tasks.workunit.client.1.smithi155.stdout:4/687: dwrite d1/d7/d21/d2d/d42/f4d [0,4194304] 0 2024-09-13T21:45:01.358 INFO:tasks.workunit.client.1.smithi155.stdout:4/688: dread - d1/d7/d21/d69/fbe zero size 2024-09-13T21:45:01.358 INFO:tasks.workunit.client.1.smithi155.stdout:2/631: chown d2/dd/d21/d39/dc1/d66/dd7 108079198 1 2024-09-13T21:45:01.361 INFO:tasks.workunit.client.1.smithi155.stdout:4/689: dread - d1/d7/d21/d69/d98/fa8 zero size 2024-09-13T21:45:01.362 INFO:tasks.workunit.client.1.smithi155.stdout:5/707: dwrite d5/d16/d33/d1b/d2f/d3c/d6c/f77 [0,4194304] 0 2024-09-13T21:45:01.362 INFO:tasks.workunit.client.1.smithi155.stdout:7/650: truncate d5/d13/d5f/f95 3660093 0 2024-09-13T21:45:01.367 INFO:tasks.workunit.client.1.smithi155.stdout:7/651: dread d5/d10/d3e/d3f/f8c [0,4194304] 0 2024-09-13T21:45:01.368 INFO:tasks.workunit.client.1.smithi155.stdout:7/652: read d5/df/d60/d6d/f93 [3373499,50100] 0 2024-09-13T21:45:01.388 INFO:tasks.workunit.client.1.smithi155.stdout:8/633: mknod d2/d8/cc6 0 2024-09-13T21:45:01.389 INFO:tasks.workunit.client.1.smithi155.stdout:9/725: creat dc/d18/ffb x:0 0 0 2024-09-13T21:45:01.389 INFO:tasks.workunit.client.1.smithi155.stdout:9/726: chown dc/d18/la7 14360899 1 2024-09-13T21:45:01.390 INFO:tasks.workunit.client.1.smithi155.stdout:3/808: creat d3/d25/d1b/d1f/d36/d5c/ddb/f119 x:0 0 0 2024-09-13T21:45:01.392 INFO:tasks.workunit.client.1.smithi155.stdout:2/632: mkdir d2/dd/d21/d8d/da0/de3 0 2024-09-13T21:45:01.395 INFO:tasks.workunit.client.1.smithi155.stdout:7/653: symlink d5/d13/lc9 0 2024-09-13T21:45:01.395 INFO:tasks.workunit.client.1.smithi155.stdout:8/634: rmdir d2/d2d 39 2024-09-13T21:45:01.396 INFO:tasks.workunit.client.1.smithi155.stdout:0/735: creat d1/d6/dc/d4d/d4a/d52/f119 x:0 0 0 2024-09-13T21:45:01.398 INFO:tasks.workunit.client.1.smithi155.stdout:0/736: readlink d1/d6/dc/l38 0 2024-09-13T21:45:01.400 INFO:tasks.workunit.client.1.smithi155.stdout:4/690: mknod d1/ccf 0 2024-09-13T21:45:01.401 INFO:tasks.workunit.client.1.smithi155.stdout:3/809: truncate d3/d25/d1b/d1f/d36/f5d 939220 0 2024-09-13T21:45:01.403 INFO:tasks.workunit.client.1.smithi155.stdout:2/633: readlink d2/dd/d21/l76 0 2024-09-13T21:45:01.405 INFO:tasks.workunit.client.1.smithi155.stdout:5/708: creat d5/d16/d33/d1b/d1e/da1/fe6 x:0 0 0 2024-09-13T21:45:01.406 INFO:tasks.workunit.client.1.smithi155.stdout:8/635: dwrite d2/d1f/d77/fbc [0,4194304] 0 2024-09-13T21:45:01.406 INFO:tasks.workunit.client.1.smithi155.stdout:2/634: chown d2/dd/d21/d8d/da0 0 1 2024-09-13T21:45:01.408 INFO:tasks.workunit.client.1.smithi155.stdout:1/731: dwrite d6/ff [0,4194304] 0 2024-09-13T21:45:01.423 INFO:tasks.workunit.client.1.smithi155.stdout:0/737: creat d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/d82/f11a x:0 0 0 2024-09-13T21:45:01.424 INFO:tasks.workunit.client.1.smithi155.stdout:1/732: dread d6/d15/d57/d5d/f5f [0,4194304] 0 2024-09-13T21:45:01.425 INFO:tasks.workunit.client.1.smithi155.stdout:7/654: mkdir d5/da6/dca 0 2024-09-13T21:45:01.426 INFO:tasks.workunit.client.1.smithi155.stdout:7/655: write d5/d10/d48/faf [32463,98895] 0 2024-09-13T21:45:01.428 INFO:tasks.workunit.client.1.smithi155.stdout:3/810: unlink d3/d25/d1b/d1f/d36/d5c/fa7 0 2024-09-13T21:45:01.429 INFO:tasks.workunit.client.1.smithi155.stdout:9/727: link dc/de/d6f/dae/de1/d38/cbc dc/de/d6f/dae/ddb/cfc 0 2024-09-13T21:45:01.430 INFO:tasks.workunit.client.1.smithi155.stdout:5/709: mkdir d5/d16/d81/d98/d84/de7 0 2024-09-13T21:45:01.432 INFO:tasks.workunit.client.1.smithi155.stdout:5/710: write d5/d16/d33/d1f/fa5 [1502890,62661] 0 2024-09-13T21:45:01.438 INFO:tasks.workunit.client.1.smithi155.stdout:2/635: creat d2/db/d6b/dd9/fe4 x:0 0 0 2024-09-13T21:45:01.441 INFO:tasks.workunit.client.1.smithi155.stdout:1/733: dwrite d6/d7/d89/dd6/dee/f97 [0,4194304] 0 2024-09-13T21:45:01.442 INFO:tasks.workunit.client.1.smithi155.stdout:4/691: creat d1/d7/de/d15/fd0 x:0 0 0 2024-09-13T21:45:01.444 INFO:tasks.workunit.client.1.smithi155.stdout:1/734: read d6/d15/d23/d55/d6e/dbb/f75 [266338,33137] 0 2024-09-13T21:45:01.444 INFO:tasks.workunit.client.1.smithi155.stdout:4/692: read d1/d7/de/d1a/f68 [2601851,82136] 0 2024-09-13T21:45:01.446 INFO:tasks.workunit.client.1.smithi155.stdout:1/735: stat d6/d82/d90/f6c 0 2024-09-13T21:45:01.449 INFO:tasks.workunit.client.1.smithi155.stdout:4/693: chown d1/d7/d5a/c8f 213190 1 2024-09-13T21:45:01.450 INFO:tasks.workunit.client.1.smithi155.stdout:5/711: dwrite d5/d16/d33/d1b/d2f/d3c/d44/d80/fad [0,4194304] 0 2024-09-13T21:45:01.452 INFO:tasks.workunit.client.1.smithi155.stdout:2/636: truncate d2/dd/de/d15/f2d 847118 0 2024-09-13T21:45:01.454 INFO:tasks.workunit.client.1.smithi155.stdout:0/738: creat d1/d6/dc/f11b x:0 0 0 2024-09-13T21:45:01.458 INFO:tasks.workunit.client.1.smithi155.stdout:1/736: stat d6/d15/d23/d55/d6e/dbb/f50 0 2024-09-13T21:45:01.458 INFO:tasks.workunit.client.1.smithi155.stdout:8/636: getdents d2/d8/d75 0 2024-09-13T21:45:01.458 INFO:tasks.workunit.client.1.smithi155.stdout:4/694: dread - d1/d7/de/d15/d55/f84 zero size 2024-09-13T21:45:01.464 INFO:tasks.workunit.client.1.smithi155.stdout:1/737: dwrite d6/d82/d91/daf/f9b [0,4194304] 0 2024-09-13T21:45:01.466 INFO:tasks.workunit.client.1.smithi155.stdout:5/712: stat d5/d16/d33/d1b/d28/d52 0 2024-09-13T21:45:01.469 INFO:tasks.workunit.client.1.smithi155.stdout:0/739: mkdir d1/d6/dc/d11c 0 2024-09-13T21:45:01.470 INFO:tasks.workunit.client.1.smithi155.stdout:8/637: mknod d2/d2d/d96/cc7 0 2024-09-13T21:45:01.473 INFO:tasks.workunit.client.1.smithi155.stdout:5/713: read d5/d16/d33/d1f/f5a [109291,113862] 0 2024-09-13T21:45:01.475 INFO:tasks.workunit.client.1.smithi155.stdout:2/637: getdents d2/dd/d37 0 2024-09-13T21:45:01.475 INFO:tasks.workunit.client.1.smithi155.stdout:1/738: dwrite d6/d82/d90/fc5 [0,4194304] 0 2024-09-13T21:45:01.478 INFO:tasks.workunit.client.1.smithi155.stdout:5/714: mkdir d5/d16/d81/de8 0 2024-09-13T21:45:01.480 INFO:tasks.workunit.client.1.smithi155.stdout:8/638: symlink d2/d8/d5e/d60/db2/lc8 0 2024-09-13T21:45:01.483 INFO:tasks.workunit.client.1.smithi155.stdout:1/739: mknod d6/d7/cfa 0 2024-09-13T21:45:01.488 INFO:tasks.workunit.client.1.smithi155.stdout:7/656: rename d5/d13/d5f/f95 to d5/df/d15/d33/d55/d97/dc8/fcb 0 2024-09-13T21:45:01.492 INFO:tasks.workunit.client.1.smithi155.stdout:0/740: rename d1/d6/dc/f2b to d1/d6/d97/db2/f11d 0 2024-09-13T21:45:01.495 INFO:tasks.workunit.client.1.smithi155.stdout:3/811: truncate d3/d10/fe0 1791396 0 2024-09-13T21:45:01.495 INFO:tasks.workunit.client.1.smithi155.stdout:7/657: dwrite d5/df/d60/f63 [4194304,4194304] 0 2024-09-13T21:45:01.496 INFO:tasks.workunit.client.1.smithi155.stdout:3/812: chown d3/d21/d4a/f114 42 1 2024-09-13T21:45:01.497 INFO:tasks.workunit.client.1.smithi155.stdout:1/740: rename d6/d15/d23/lc4 to d6/d7/d89/dd6/lfb 0 2024-09-13T21:45:01.498 INFO:tasks.workunit.client.1.smithi155.stdout:9/728: truncate dc/de/ff 10171053 0 2024-09-13T21:45:01.504 INFO:tasks.workunit.client.1.smithi155.stdout:8/639: dread d2/d8/d65/f68 [0,4194304] 0 2024-09-13T21:45:01.505 INFO:tasks.workunit.client.1.smithi155.stdout:7/658: rename d5/df/d15/f5b to d5/df/d15/d33/d55/d97/fcc 0 2024-09-13T21:45:01.506 INFO:tasks.workunit.client.1.smithi155.stdout:8/640: chown d2/f74 0 1 2024-09-13T21:45:01.508 INFO:tasks.workunit.client.1.smithi155.stdout:1/741: mkdir d6/d15/d57/dfc 0 2024-09-13T21:45:01.511 INFO:tasks.workunit.client.1.smithi155.stdout:9/729: rename dc/de/d6f/d71/fc5 to dc/d18/d1e/dcc/ffd 0 2024-09-13T21:45:01.516 INFO:tasks.workunit.client.1.smithi155.stdout:3/813: getdents d3/d21/d4a/dcd/dd8 0 2024-09-13T21:45:01.518 INFO:tasks.workunit.client.1.smithi155.stdout:8/641: mknod d2/d91/cc9 0 2024-09-13T21:45:01.520 INFO:tasks.workunit.client.1.smithi155.stdout:0/741: dread d1/d6/dc/d4d/f49 [0,4194304] 0 2024-09-13T21:45:01.521 INFO:tasks.workunit.client.1.smithi155.stdout:5/715: write d5/d16/d33/d1b/d2f/d3c/d6c/f46 [1789057,38504] 0 2024-09-13T21:45:01.524 INFO:tasks.workunit.client.1.smithi155.stdout:1/742: dread d6/d15/d23/d87/f2a [0,4194304] 0 2024-09-13T21:45:01.526 INFO:tasks.workunit.client.1.smithi155.stdout:9/730: creat dc/d19/d21/ffe x:0 0 0 2024-09-13T21:45:01.527 INFO:tasks.workunit.client.1.smithi155.stdout:1/743: truncate d6/d15/d57/d5d/d72/dc7/fd5 643782 0 2024-09-13T21:45:01.530 INFO:tasks.workunit.client.1.smithi155.stdout:5/716: unlink d5/d16/d33/d1b/d28/d52/f96 0 2024-09-13T21:45:01.531 INFO:tasks.workunit.client.1.smithi155.stdout:8/642: fsync d2/d6/dd/d25/f5d 0 2024-09-13T21:45:01.532 INFO:tasks.workunit.client.1.smithi155.stdout:5/717: chown d5/d16/d33/d1f 45817844 1 2024-09-13T21:45:01.537 INFO:tasks.workunit.client.1.smithi155.stdout:9/731: dwrite dc/d19/f48 [0,4194304] 0 2024-09-13T21:45:01.538 INFO:tasks.workunit.client.1.smithi155.stdout:0/742: dread d1/d6/dc/d4d/d4a/d9e/fc4 [0,4194304] 0 2024-09-13T21:45:01.539 INFO:tasks.workunit.client.1.smithi155.stdout:1/744: mkdir d6/d15/d23/d55/dfd 0 2024-09-13T21:45:01.540 INFO:tasks.workunit.client.1.smithi155.stdout:9/732: readlink dc/de/d6f/dae/de1/d38/d90/l8b 0 2024-09-13T21:45:01.542 INFO:tasks.workunit.client.1.smithi155.stdout:1/745: readlink d6/d15/d57/d99/l44 0 2024-09-13T21:45:01.542 INFO:tasks.workunit.client.1.smithi155.stdout:9/733: readlink dc/de/d6f/dae/de1/l3c 0 2024-09-13T21:45:01.546 INFO:tasks.workunit.client.1.smithi155.stdout:5/718: mknod d5/d16/d33/d1b/d2f/d3c/d6c/ce9 0 2024-09-13T21:45:01.548 INFO:tasks.workunit.client.1.smithi155.stdout:0/743: creat d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/d82/f11e x:0 0 0 2024-09-13T21:45:01.548 INFO:tasks.workunit.client.1.smithi155.stdout:7/659: write d5/fc [1330027,97380] 0 2024-09-13T21:45:01.548 INFO:tasks.workunit.client.1.smithi155.stdout:7/660: readlink d5/d13/d5f/l77 0 2024-09-13T21:45:01.550 INFO:tasks.workunit.client.1.smithi155.stdout:9/734: creat dc/de/d15/fff x:0 0 0 2024-09-13T21:45:01.553 INFO:tasks.workunit.client.1.smithi155.stdout:5/719: unlink d5/f47 0 2024-09-13T21:45:01.560 INFO:tasks.workunit.client.1.smithi155.stdout:3/814: dwrite d3/d25/fa0 [0,4194304] 0 2024-09-13T21:45:01.561 INFO:tasks.workunit.client.1.smithi155.stdout:8/643: dread d2/d6/dd/d12/f46 [0,4194304] 0 2024-09-13T21:45:01.562 INFO:tasks.workunit.client.1.smithi155.stdout:1/746: rmdir d6/d15/d57/df3 0 2024-09-13T21:45:01.563 INFO:tasks.workunit.client.1.smithi155.stdout:1/747: fsync d6/f32 0 2024-09-13T21:45:01.566 INFO:tasks.workunit.client.1.smithi155.stdout:3/815: symlink d3/d21/d2c/l11a 0 2024-09-13T21:45:01.570 INFO:tasks.workunit.client.1.smithi155.stdout:3/816: creat d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9/f11b x:0 0 0 2024-09-13T21:45:01.576 INFO:tasks.workunit.client.1.smithi155.stdout:8/644: dread d2/d8/d65/f56 [0,4194304] 0 2024-09-13T21:45:01.577 INFO:tasks.workunit.client.1.smithi155.stdout:9/735: truncate dc/de/f45 4602241 0 2024-09-13T21:45:01.586 INFO:tasks.workunit.client.1.smithi155.stdout:5/720: dwrite d5/d16/d4e/f51 [0,4194304] 0 2024-09-13T21:45:01.586 INFO:tasks.workunit.client.1.smithi155.stdout:9/736: creat dc/de/d6f/dae/de1/d38/d90/f100 x:0 0 0 2024-09-13T21:45:01.587 INFO:tasks.workunit.client.1.smithi155.stdout:0/744: dwrite d1/f6e [0,4194304] 0 2024-09-13T21:45:01.589 INFO:tasks.workunit.client.1.smithi155.stdout:5/721: stat d5/d16/d81 0 2024-09-13T21:45:01.593 INFO:tasks.workunit.client.1.smithi155.stdout:3/817: dwrite d3/d21/d4a/fb4 [0,4194304] 0 2024-09-13T21:45:01.596 INFO:tasks.workunit.client.1.smithi155.stdout:5/722: write d5/d16/d4e/d85/fa2 [4943184,38781] 0 2024-09-13T21:45:01.596 INFO:tasks.workunit.client.1.smithi155.stdout:0/745: mkdir d1/d6/dc/d4d/d4a/d52/d5c/d6a/dd8/d11f 0 2024-09-13T21:45:01.599 INFO:tasks.workunit.client.1.smithi155.stdout:5/723: chown d5/d16/d33/d1b/d2f/d3c/d44/l8f 80 1 2024-09-13T21:45:01.602 INFO:tasks.workunit.client.1.smithi155.stdout:3/818: mknod d3/d25/d1b/d1f/d82/d83/c11c 0 2024-09-13T21:45:01.604 INFO:tasks.workunit.client.1.smithi155.stdout:3/819: write d3/d25/d17/f5b [6627124,58573] 0 2024-09-13T21:45:01.606 INFO:tasks.workunit.client.1.smithi155.stdout:9/737: link c5 dc/c101 0 2024-09-13T21:45:01.607 INFO:tasks.workunit.client.1.smithi155.stdout:9/738: chown dc/de/d2d/f40 22358828 1 2024-09-13T21:45:01.607 INFO:tasks.workunit.client.1.smithi155.stdout:5/724: truncate d5/fa 1394635 0 2024-09-13T21:45:01.611 INFO:tasks.workunit.client.1.smithi155.stdout:5/725: mknod d5/d16/d33/d1b/d2f/d3c/d5b/d5f/cea 0 2024-09-13T21:45:01.613 INFO:tasks.workunit.client.1.smithi155.stdout:3/820: rename d3/d10/f46 to d3/d21/f11d 0 2024-09-13T21:45:01.615 INFO:tasks.workunit.client.1.smithi155.stdout:3/821: fsync d3/d25/f61 0 2024-09-13T21:45:01.615 INFO:tasks.workunit.client.1.smithi155.stdout:9/739: link c9 dc/c102 0 2024-09-13T21:45:01.616 INFO:tasks.workunit.client.1.smithi155.stdout:3/822: stat d3/d25/d1b/f38 0 2024-09-13T21:45:01.619 INFO:tasks.workunit.client.1.smithi155.stdout:5/726: getdents d5/d16/d81/d98/d84 0 2024-09-13T21:45:01.619 INFO:tasks.workunit.client.1.smithi155.stdout:8/645: dread d2/d1f/d87/d9a/f9c [0,4194304] 0 2024-09-13T21:45:01.621 INFO:tasks.workunit.client.1.smithi155.stdout:8/646: write d2/d8/d65/f5b [158830,68844] 0 2024-09-13T21:45:01.628 INFO:tasks.workunit.client.1.smithi155.stdout:5/727: symlink d5/d16/d33/d1b/d59/dd1/leb 0 2024-09-13T21:45:01.629 INFO:tasks.workunit.client.1.smithi155.stdout:0/746: dwrite d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/f99 [4194304,4194304] 0 2024-09-13T21:45:01.631 INFO:tasks.workunit.client.1.smithi155.stdout:8/647: dread d2/d91/f8a [0,4194304] 0 2024-09-13T21:45:01.632 INFO:tasks.workunit.client.1.smithi155.stdout:9/740: rmdir dc/de/d6f/dae/de1/d38/d90/d74/dec 0 2024-09-13T21:45:01.634 INFO:tasks.workunit.client.1.smithi155.stdout:0/747: fdatasync d1/d6/dc/f27 0 2024-09-13T21:45:01.634 INFO:tasks.workunit.client.1.smithi155.stdout:3/823: getdents d3 0 2024-09-13T21:45:01.691 INFO:tasks.workunit.client.1.smithi155.stdout:9/741: symlink dc/de/d6f/dae/df0/l103 0 2024-09-13T21:45:01.695 INFO:tasks.workunit.client.1.smithi155.stdout:3/824: read d3/d25/d1b/d90/fb0 [705654,52646] 0 2024-09-13T21:45:01.695 INFO:tasks.workunit.client.1.smithi155.stdout:9/742: creat dc/de/d5c/f104 x:0 0 0 2024-09-13T21:45:01.696 INFO:tasks.workunit.client.1.smithi155.stdout:5/728: dwrite d5/d16/d81/d98/d84/fd0 [0,4194304] 0 2024-09-13T21:45:01.696 INFO:tasks.workunit.client.1.smithi155.stdout:8/648: dread d2/d1f/f70 [0,4194304] 0 2024-09-13T21:45:01.698 INFO:tasks.workunit.client.1.smithi155.stdout:9/743: chown dc/de/d5c/le9 1034 1 2024-09-13T21:45:01.698 INFO:tasks.workunit.client.1.smithi155.stdout:3/825: dread - d3/d21/d4a/dcd/dd8/fed zero size 2024-09-13T21:45:01.701 INFO:tasks.workunit.client.1.smithi155.stdout:0/748: getdents d1/d6/dc/d4d/d4a/d52/d5c/d6a/dd8 0 2024-09-13T21:45:01.707 INFO:tasks.workunit.client.1.smithi155.stdout:3/826: mknod d3/d25/d1b/d1f/d36/d5c/d66/c11e 0 2024-09-13T21:45:01.709 INFO:tasks.workunit.client.1.smithi155.stdout:9/744: read dc/d18/d1e/f22 [3387505,43588] 0 2024-09-13T21:45:01.710 INFO:tasks.workunit.client.1.smithi155.stdout:3/827: fsync d3/d25/d1b/d1f/d82/f9d 0 2024-09-13T21:45:01.711 INFO:tasks.workunit.client.1.smithi155.stdout:8/649: dwrite d2/d8/d65/f56 [0,4194304] 0 2024-09-13T21:45:01.714 INFO:tasks.workunit.client.1.smithi155.stdout:9/745: mknod dc/de/d6f/dae/c105 0 2024-09-13T21:45:01.717 INFO:tasks.workunit.client.1.smithi155.stdout:8/650: fsync d2/d6/dd/d12/f66 0 2024-09-13T21:45:01.718 INFO:tasks.workunit.client.1.smithi155.stdout:8/651: chown d2/d6/dd/d25/c3f 232830665 1 2024-09-13T21:45:01.720 INFO:tasks.workunit.client.1.smithi155.stdout:9/746: mknod dc/de/d6f/dae/de1/d38/d90/d74/c106 0 2024-09-13T21:45:01.721 INFO:tasks.workunit.client.1.smithi155.stdout:3/828: truncate d3/d25/d1b/d1f/d36/d7c/f9f 224908 0 2024-09-13T21:45:01.725 INFO:tasks.workunit.client.1.smithi155.stdout:9/747: symlink dc/de/l107 0 2024-09-13T21:45:01.732 INFO:tasks.workunit.client.1.smithi155.stdout:8/652: getdents d2/d6/dd 0 2024-09-13T21:45:01.733 INFO:tasks.workunit.client.1.smithi155.stdout:5/729: dread d5/d16/d33/d1f/fa5 [0,4194304] 0 2024-09-13T21:45:01.733 INFO:tasks.workunit.client.1.smithi155.stdout:8/653: stat d2/d91 0 2024-09-13T21:45:01.733 INFO:tasks.workunit.client.1.smithi155.stdout:9/748: unlink dc/de/d6f/dae/df0/cf8 0 2024-09-13T21:45:01.737 INFO:tasks.workunit.client.1.smithi155.stdout:9/749: write dc/d19/d21/fca [899558,72938] 0 2024-09-13T21:45:01.738 INFO:tasks.workunit.client.1.smithi155.stdout:9/750: write dc/de/fd7 [1429582,57420] 0 2024-09-13T21:45:01.738 INFO:tasks.workunit.client.1.smithi155.stdout:3/829: getdents d3/d25/d1b/d90 0 2024-09-13T21:45:01.740 INFO:tasks.workunit.client.1.smithi155.stdout:5/730: symlink d5/d16/d33/d1b/d92/dca/lec 0 2024-09-13T21:45:01.742 INFO:tasks.workunit.client.1.smithi155.stdout:0/749: dwrite d1/d6/dc/f10 [4194304,4194304] 0 2024-09-13T21:45:01.742 INFO:tasks.workunit.client.1.smithi155.stdout:9/751: write dc/de/d6f/fd8 [293560,112551] 0 2024-09-13T21:45:01.742 INFO:tasks.workunit.client.1.smithi155.stdout:8/654: truncate d2/f47 4640621 0 2024-09-13T21:45:01.746 INFO:tasks.workunit.client.1.smithi155.stdout:3/830: mkdir d3/d25/d1b/d1f/d82/d11f 0 2024-09-13T21:45:01.748 INFO:tasks.workunit.client.1.smithi155.stdout:9/752: creat dc/de/d6f/d71/f108 x:0 0 0 2024-09-13T21:45:01.751 INFO:tasks.workunit.client.1.smithi155.stdout:9/753: chown dc/de/d6f/dae/ddb/cc2 50855241 1 2024-09-13T21:45:01.751 INFO:tasks.workunit.client.1.smithi155.stdout:9/754: chown dc/de/d6f/d71/lfa 5829 1 2024-09-13T21:45:01.752 INFO:tasks.workunit.client.1.smithi155.stdout:8/655: rename d2/d1f/d87/la9 to d2/d8/d65/da8/lca 0 2024-09-13T21:45:01.753 INFO:tasks.workunit.client.1.smithi155.stdout:0/750: stat d1/d6/dc/d4d/d4a/d9e/de0/ce1 0 2024-09-13T21:45:01.755 INFO:tasks.workunit.client.1.smithi155.stdout:8/656: write d2/d8/d65/fad [334071,13977] 0 2024-09-13T21:45:01.757 INFO:tasks.workunit.client.1.smithi155.stdout:8/657: stat d2/d1f/d87 0 2024-09-13T21:45:01.757 INFO:tasks.workunit.client.1.smithi155.stdout:3/831: rename d3/d25/d17/laf to d3/d25/d1b/d1f/d36/d5c/ddb/dfd/l120 0 2024-09-13T21:45:01.760 INFO:tasks.workunit.client.1.smithi155.stdout:3/832: chown d3/d25/d17/d52/lae 870 1 2024-09-13T21:45:01.762 INFO:tasks.workunit.client.1.smithi155.stdout:3/833: fdatasync d3/d21/d4a/f10f 0 2024-09-13T21:45:01.763 INFO:tasks.workunit.client.1.smithi155.stdout:3/834: stat d3/d25/d17/d3b/f77 0 2024-09-13T21:45:01.764 INFO:tasks.workunit.client.1.smithi155.stdout:9/755: rename dc/de/d6f/dae/df0/l103 to dc/de/l109 0 2024-09-13T21:45:01.767 INFO:tasks.workunit.client.1.smithi155.stdout:0/751: rename d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/d82/la0 to d1/d6/d81/l120 0 2024-09-13T21:45:01.771 INFO:tasks.workunit.client.1.smithi155.stdout:0/752: truncate d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/d82/f11a 180026 0 2024-09-13T21:45:01.776 INFO:tasks.workunit.client.1.smithi155.stdout:9/756: link dc/de/d2d/d79/f41 dc/d19/d21/d67/f10a 0 2024-09-13T21:45:01.785 INFO:tasks.workunit.client.1.smithi155.stdout:0/753: write d1/f8e [956141,111862] 0 2024-09-13T21:45:01.789 INFO:tasks.workunit.client.1.smithi155.stdout:0/754: write d1/d6/dc/d4d/f71 [1163084,102779] 0 2024-09-13T21:45:01.792 INFO:tasks.workunit.client.1.smithi155.stdout:0/755: chown d1/d6/dc/d4d/f85 6687610 1 2024-09-13T21:45:01.797 INFO:tasks.workunit.client.1.smithi155.stdout:0/756: write d1/d6/dc/d4d/d4a/d52/d5b/ffb [6363237,115129] 0 2024-09-13T21:45:01.799 INFO:tasks.workunit.client.1.smithi155.stdout:0/757: mknod d1/d6/dc/d4d/d4a/d52/d5c/d6a/c121 0 2024-09-13T21:45:01.806 INFO:tasks.workunit.client.1.smithi155.stdout:9/757: dread dc/d19/f36 [0,4194304] 0 2024-09-13T21:45:01.810 INFO:tasks.workunit.client.1.smithi155.stdout:0/758: write d1/d6/dc/d8c/f93 [791971,124180] 0 2024-09-13T21:45:01.813 INFO:tasks.workunit.client.1.smithi155.stdout:9/758: link dc/d18/c88 dc/d19/c10b 0 2024-09-13T21:45:01.816 INFO:tasks.workunit.client.1.smithi155.stdout:9/759: unlink dc/de/d6f/f7d 0 2024-09-13T21:45:01.819 INFO:tasks.workunit.client.1.smithi155.stdout:0/759: getdents d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0 0 2024-09-13T21:45:01.823 INFO:tasks.workunit.client.1.smithi155.stdout:9/760: symlink dc/d19/d21/l10c 0 2024-09-13T21:45:01.826 INFO:tasks.workunit.client.1.smithi155.stdout:9/761: mkdir dc/de/d15/d10d 0 2024-09-13T21:45:01.830 INFO:tasks.workunit.client.1.smithi155.stdout:0/760: link d1/d6/dc/d4d/d4a/d52/d5c/d6a/cd9 d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/df0/df6/c122 0 2024-09-13T21:45:01.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:01 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:01.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:01 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:01.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:01 smithi155 ceph-mon[34732]: pgmap v15: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 104 MiB/s rd, 273 MiB/s wr, 549 op/s 2024-09-13T21:45:01.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:01 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:01.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:01 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:01.833 INFO:tasks.workunit.client.1.smithi155.stdout:0/761: creat d1/d6/dc/d4d/d4a/d52/da5/f123 x:0 0 0 2024-09-13T21:45:01.841 INFO:tasks.workunit.client.1.smithi155.stdout:0/762: dwrite d1/d6/dc/d4d/d4a/d52/d5c/fbd [0,4194304] 0 2024-09-13T21:45:01.849 INFO:tasks.workunit.client.1.smithi155.stdout:9/762: dwrite dc/de/d2d/d79/f63 [0,4194304] 0 2024-09-13T21:45:01.851 INFO:tasks.workunit.client.1.smithi155.stdout:9/763: read - dc/d18/d1e/dcc/ffd zero size 2024-09-13T21:45:01.870 INFO:tasks.workunit.client.1.smithi155.stdout:9/764: dread dc/d19/d21/d67/f84 [0,4194304] 0 2024-09-13T21:45:01.878 INFO:tasks.workunit.client.1.smithi155.stdout:9/765: truncate dc/de/d2d/d79/f4c 148958 0 2024-09-13T21:45:01.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:01 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:01.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:01 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:01.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:01 smithi119 ceph-mon[27653]: pgmap v15: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 104 MiB/s rd, 273 MiB/s wr, 549 op/s 2024-09-13T21:45:01.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:01 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:01.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:01 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:01.886 INFO:tasks.workunit.client.1.smithi155.stdout:9/766: write dc/de/d6f/da3/ff5 [168265,32676] 0 2024-09-13T21:45:01.890 INFO:tasks.workunit.client.1.smithi155.stdout:9/767: getdents dc/de/d6f/dae/de1/d38/d90/d74 0 2024-09-13T21:45:01.891 INFO:tasks.workunit.client.1.smithi155.stdout:9/768: chown dc/de/d2d/d79/d43/ldf 340 1 2024-09-13T21:45:01.893 INFO:tasks.workunit.client.1.smithi155.stdout:9/769: creat dc/d18/d1e/d86/f10e x:0 0 0 2024-09-13T21:45:01.893 INFO:tasks.workunit.client.1.smithi155.stdout:9/770: chown dc/d18/d1e/dcc 133049583 1 2024-09-13T21:45:01.897 INFO:tasks.workunit.client.1.smithi155.stdout:9/771: write dc/de/d2d/d79/f41 [3656886,114088] 0 2024-09-13T21:45:01.899 INFO:tasks.workunit.client.1.smithi155.stdout:9/772: creat dc/d18/d50/f10f x:0 0 0 2024-09-13T21:45:01.901 INFO:tasks.workunit.client.1.smithi155.stdout:9/773: read dc/de/d6f/dae/de1/f9a [367740,104433] 0 2024-09-13T21:45:01.902 INFO:tasks.workunit.client.1.smithi155.stdout:9/774: dread - dc/de/d6f/dae/de1/d38/d90/f93 zero size 2024-09-13T21:45:01.904 INFO:tasks.workunit.client.1.smithi155.stdout:9/775: creat dc/de/d2d/f110 x:0 0 0 2024-09-13T21:45:01.906 INFO:tasks.workunit.client.1.smithi155.stdout:9/776: mknod dc/de/d15/d10d/c111 0 2024-09-13T21:45:01.906 INFO:tasks.workunit.client.1.smithi155.stdout:9/777: chown dc/d19/d21/d67/fd2 0 1 2024-09-13T21:45:01.908 INFO:tasks.workunit.client.1.smithi155.stdout:9/778: symlink dc/de/d6f/dae/de1/l112 0 2024-09-13T21:45:01.909 INFO:tasks.workunit.client.1.smithi155.stdout:9/779: unlink dc/de/c13 0 2024-09-13T21:45:01.910 INFO:tasks.workunit.client.1.smithi155.stdout:9/780: chown dc/de/d6f/d71/f108 1050492 1 2024-09-13T21:45:01.912 INFO:tasks.workunit.client.1.smithi155.stdout:9/781: unlink dc/de/d6f/dae/de1/d38/d90/l81 0 2024-09-13T21:45:01.913 INFO:tasks.workunit.client.1.smithi155.stdout:9/782: dread dc/de/fd3 [0,4194304] 0 2024-09-13T21:45:01.916 INFO:tasks.workunit.client.1.smithi155.stdout:9/783: link dc/le4 dc/de/d6f/dae/de1/l113 0 2024-09-13T21:45:01.919 INFO:tasks.workunit.client.1.smithi155.stdout:9/784: rename dc/de/d2d/d79/f63 to dc/df7/f114 0 2024-09-13T21:45:01.930 INFO:tasks.workunit.client.1.smithi155.stdout:9/785: dread dc/d19/d21/f6b [0,4194304] 0 2024-09-13T21:45:01.931 INFO:tasks.workunit.client.1.smithi155.stdout:9/786: readlink dc/de/d6f/dae/de1/l112 0 2024-09-13T21:45:01.932 INFO:tasks.workunit.client.1.smithi155.stdout:9/787: write dc/d19/d21/ffe [470867,71427] 0 2024-09-13T21:45:01.934 INFO:tasks.workunit.client.1.smithi155.stdout:9/788: truncate dc/de/d6f/dae/ddb/fe5 142657 0 2024-09-13T21:45:01.935 INFO:tasks.workunit.client.1.smithi155.stdout:9/789: creat dc/de/d2d/f115 x:0 0 0 2024-09-13T21:45:01.937 INFO:tasks.workunit.client.1.smithi155.stdout:9/790: rename dc/d19/d21/fde to dc/de/d2d/f116 0 2024-09-13T21:45:01.938 INFO:tasks.workunit.client.1.smithi155.stdout:9/791: symlink dc/de/d6f/d71/l117 0 2024-09-13T21:45:01.939 INFO:tasks.workunit.client.1.smithi155.stdout:9/792: write dc/d18/d1e/d86/f10e [339809,88512] 0 2024-09-13T21:45:01.941 INFO:tasks.workunit.client.1.smithi155.stdout:9/793: rename dc/de/ff6 to dc/d19/f118 0 2024-09-13T21:45:01.942 INFO:tasks.workunit.client.1.smithi155.stdout:9/794: dread - dc/d18/d1e/dcc/ffd zero size 2024-09-13T21:45:01.943 INFO:tasks.workunit.client.1.smithi155.stdout:9/795: write dc/de/d2d/d79/fed [605351,130359] 0 2024-09-13T21:45:01.947 INFO:tasks.workunit.client.1.smithi155.stdout:9/796: dread dc/de/d6f/dae/de1/d38/fb1 [0,4194304] 0 2024-09-13T21:45:01.949 INFO:tasks.workunit.client.1.smithi155.stdout:9/797: mkdir dc/de/d6f/dae/de1/d38/d119 0 2024-09-13T21:45:01.950 INFO:tasks.workunit.client.1.smithi155.stdout:9/798: dread - dc/d19/f118 zero size 2024-09-13T21:45:01.964 INFO:tasks.workunit.client.1.smithi155.stdout:9/799: unlink dc/de/d15/c31 0 2024-09-13T21:45:01.965 INFO:tasks.workunit.client.1.smithi155.stdout:9/800: write dc/de/d6f/dae/de1/d38/d90/d74/fb9 [2189537,71090] 0 2024-09-13T21:45:01.966 INFO:tasks.workunit.client.1.smithi155.stdout:9/801: write dc/de/fd7 [1414433,51459] 0 2024-09-13T21:45:01.968 INFO:tasks.workunit.client.1.smithi155.stdout:9/802: mknod dc/d18/d1e/c11a 0 2024-09-13T21:45:01.970 INFO:tasks.workunit.client.1.smithi155.stdout:9/803: creat dc/de/d6f/dae/de1/d38/d90/f11b x:0 0 0 2024-09-13T21:45:01.975 INFO:tasks.workunit.client.1.smithi155.stdout:9/804: dwrite dc/de/d5c/f104 [0,4194304] 0 2024-09-13T21:45:01.981 INFO:tasks.workunit.client.1.smithi155.stdout:9/805: write dc/de/f45 [1721269,123829] 0 2024-09-13T21:45:01.982 INFO:tasks.workunit.client.1.smithi155.stdout:9/806: dread - dc/de/d6f/dae/de1/d38/d90/f11b zero size 2024-09-13T21:45:01.991 INFO:tasks.workunit.client.1.smithi155.stdout:9/807: write dc/d19/d21/fb4 [294225,38440] 0 2024-09-13T21:45:01.993 INFO:tasks.workunit.client.1.smithi155.stdout:9/808: creat dc/de/d15/f11c x:0 0 0 2024-09-13T21:45:01.994 INFO:tasks.workunit.client.1.smithi155.stdout:9/809: write dc/d18/f7a [2733951,31844] 0 2024-09-13T21:45:01.999 INFO:tasks.workunit.client.1.smithi155.stdout:9/810: write fb [5560667,85549] 0 2024-09-13T21:45:02.002 INFO:tasks.workunit.client.1.smithi155.stdout:9/811: truncate dc/d18/d1e/f22 686800 0 2024-09-13T21:45:02.004 INFO:tasks.workunit.client.1.smithi155.stdout:9/812: chown dc/de/l109 54837 1 2024-09-13T21:45:02.005 INFO:tasks.workunit.client.1.smithi155.stdout:9/813: creat dc/de/f11d x:0 0 0 2024-09-13T21:45:02.006 INFO:tasks.workunit.client.1.smithi155.stdout:9/814: chown dc/d19/d21/f6b 1354628536 1 2024-09-13T21:45:02.008 INFO:tasks.workunit.client.1.smithi155.stdout:9/815: getdents dc/d19 0 2024-09-13T21:45:02.009 INFO:tasks.workunit.client.1.smithi155.stdout:9/816: write dc/d19/f118 [853117,51801] 0 2024-09-13T21:45:02.011 INFO:tasks.workunit.client.1.smithi155.stdout:9/817: symlink dc/d18/d1e/l11e 0 2024-09-13T21:45:02.012 INFO:tasks.workunit.client.1.smithi155.stdout:9/818: fdatasync dc/d19/d21/ffe 0 2024-09-13T21:45:02.013 INFO:tasks.workunit.client.1.smithi155.stdout:9/819: fsync dc/d19/f36 0 2024-09-13T21:45:02.018 INFO:tasks.workunit.client.1.smithi155.stdout:9/820: write dc/d18/f20 [995193,29484] 0 2024-09-13T21:45:02.021 INFO:tasks.workunit.client.1.smithi155.stdout:9/821: truncate dc/de/d6f/dae/de1/f30 1366142 0 2024-09-13T21:45:02.023 INFO:tasks.workunit.client.1.smithi155.stdout:9/822: creat dc/de/d2d/d79/f11f x:0 0 0 2024-09-13T21:45:02.024 INFO:tasks.workunit.client.1.smithi155.stdout:9/823: creat dc/d19/d21/d67/f120 x:0 0 0 2024-09-13T21:45:02.032 INFO:tasks.workunit.client.1.smithi155.stdout:9/824: dwrite dc/de/f92 [0,4194304] 0 2024-09-13T21:45:02.039 INFO:tasks.workunit.client.1.smithi155.stdout:9/825: write dc/ff1 [1458782,27271] 0 2024-09-13T21:45:02.041 INFO:tasks.workunit.client.1.smithi155.stdout:9/826: symlink dc/de/d15/d10d/l121 0 2024-09-13T21:45:02.059 INFO:tasks.workunit.client.1.smithi155.stdout:9/827: dread dc/d18/f7a [0,4194304] 0 2024-09-13T21:45:02.066 INFO:tasks.workunit.client.1.smithi155.stdout:9/828: dwrite dc/de/d6f/dae/de1/f4a [0,4194304] 0 2024-09-13T21:45:02.071 INFO:tasks.workunit.client.1.smithi155.stdout:9/829: truncate dc/de/d6f/dae/de1/f2e 1221770 0 2024-09-13T21:45:02.073 INFO:tasks.workunit.client.1.smithi155.stdout:9/830: mknod dc/d19/d21/c122 0 2024-09-13T21:45:02.073 INFO:tasks.workunit.client.1.smithi155.stdout:9/831: readlink dc/de/l44 0 2024-09-13T21:45:02.075 INFO:tasks.workunit.client.1.smithi155.stdout:9/832: creat dc/de/d6f/dae/df0/f123 x:0 0 0 2024-09-13T21:45:02.077 INFO:tasks.workunit.client.1.smithi155.stdout:9/833: symlink dc/de/d15/l124 0 2024-09-13T21:45:02.081 INFO:tasks.workunit.client.1.smithi155.stdout:9/834: rename dc/de/d2d/d79/f4c to dc/f125 0 2024-09-13T21:45:02.082 INFO:tasks.workunit.client.1.smithi155.stdout:9/835: creat dc/d18/d50/f126 x:0 0 0 2024-09-13T21:45:02.098 INFO:tasks.workunit.client.1.smithi155.stdout:9/836: dread dc/de/d15/f24 [4194304,4194304] 0 2024-09-13T21:45:02.099 INFO:tasks.workunit.client.1.smithi155.stdout:9/837: rename dc/d18 to dc/d18/d1e/d127 22 2024-09-13T21:45:02.100 INFO:tasks.workunit.client.1.smithi155.stdout:9/838: rmdir dc/d18/d1e 39 2024-09-13T21:45:02.101 INFO:tasks.workunit.client.1.smithi155.stdout:9/839: write dc/de/d6f/fb6 [4327455,61251] 0 2024-09-13T21:45:02.104 INFO:tasks.workunit.client.1.smithi155.stdout:9/840: read dc/de/d6f/dae/de1/f30 [615058,11619] 0 2024-09-13T21:45:02.117 INFO:tasks.workunit.client.1.smithi155.stdout:9/841: dread dc/de/d6f/dae/ddb/fbd [0,4194304] 0 2024-09-13T21:45:02.120 INFO:tasks.workunit.client.1.smithi155.stdout:9/842: rename dc/d19/d21 to dc/de/d6f/dae/df0/d128 0 2024-09-13T21:45:02.121 INFO:tasks.workunit.client.1.smithi155.stdout:9/843: fdatasync dc/de/d6f/d71/fb8 0 2024-09-13T21:45:02.124 INFO:tasks.workunit.client.1.smithi155.stdout:9/844: rename dc/de/d6f/dae/de1/l113 to dc/de/d6f/d71/l129 0 2024-09-13T21:45:02.127 INFO:tasks.workunit.client.1.smithi155.stdout:9/845: rmdir dc/de/d6f/dae/de1/d38/d119 0 2024-09-13T21:45:02.128 INFO:tasks.workunit.client.1.smithi155.stdout:9/846: chown dc/de/d6f/dae/df0/d128/l28 248511 1 2024-09-13T21:45:02.412 INFO:tasks.workunit.client.1.smithi155.stdout:6/887: sync 2024-09-13T21:45:02.414 INFO:tasks.workunit.client.1.smithi155.stdout:6/888: creat db/d2c/dbc/dc2/f138 x:0 0 0 2024-09-13T21:45:02.422 INFO:tasks.workunit.client.1.smithi155.stdout:6/889: fsync db/d2c/dbc/dc2/f138 0 2024-09-13T21:45:02.424 INFO:tasks.workunit.client.1.smithi155.stdout:6/890: mknod db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/c139 0 2024-09-13T21:45:02.425 INFO:tasks.workunit.client.1.smithi155.stdout:6/891: chown db/d11/d6d/db9/d1c/d36/d83/ddd/c99 1 1 2024-09-13T21:45:02.546 INFO:tasks.workunit.client.1.smithi155.stdout:4/695: sync 2024-09-13T21:45:02.548 INFO:tasks.workunit.client.1.smithi155.stdout:4/696: mkdir d1/d7/de/dc/d4a/dd1 0 2024-09-13T21:45:02.556 INFO:tasks.workunit.client.1.smithi155.stdout:4/697: dwrite d1/d7/d21/d69/d98/f8b [0,4194304] 0 2024-09-13T21:45:02.556 INFO:tasks.workunit.client.1.smithi155.stdout:4/698: stat d1/d7/d21/d69/f73 0 2024-09-13T21:45:02.561 INFO:tasks.workunit.client.1.smithi155.stdout:4/699: dwrite d1/d7/d21/d69/d98/f85 [0,4194304] 0 2024-09-13T21:45:02.566 INFO:tasks.workunit.client.1.smithi155.stdout:4/700: dwrite d1/f59 [0,4194304] 0 2024-09-13T21:45:02.688 INFO:tasks.workunit.client.1.smithi155.stdout:7/661: sync 2024-09-13T21:45:02.788 INFO:tasks.workunit.client.1.smithi155.stdout:1/748: sync 2024-09-13T21:45:02.788 INFO:tasks.workunit.client.1.smithi155.stdout:5/731: sync 2024-09-13T21:45:02.789 INFO:tasks.workunit.client.1.smithi155.stdout:2/638: sync 2024-09-13T21:45:02.789 INFO:tasks.workunit.client.1.smithi155.stdout:3/835: sync 2024-09-13T21:45:02.789 INFO:tasks.workunit.client.1.smithi155.stdout:6/892: sync 2024-09-13T21:45:02.789 INFO:tasks.workunit.client.1.smithi155.stdout:0/763: sync 2024-09-13T21:45:02.789 INFO:tasks.workunit.client.1.smithi155.stdout:9/847: sync 2024-09-13T21:45:02.789 INFO:tasks.workunit.client.1.smithi155.stdout:8/658: sync 2024-09-13T21:45:02.793 INFO:tasks.workunit.client.1.smithi155.stdout:0/764: chown d1/d6/dc/l42 1230738 1 2024-09-13T21:45:02.793 INFO:tasks.workunit.client.1.smithi155.stdout:3/836: fsync d3/d25/d1b/d1f/d82/d83/fa5 0 2024-09-13T21:45:02.793 INFO:tasks.workunit.client.1.smithi155.stdout:1/749: readlink d6/d15/d23/d55/d6e/lef 0 2024-09-13T21:45:02.793 INFO:tasks.workunit.client.1.smithi155.stdout:2/639: mknod d2/dd/de/d15/ce5 0 2024-09-13T21:45:02.793 INFO:tasks.workunit.client.1.smithi155.stdout:0/765: chown d1/d6/d81/df7/f10a 2006 1 2024-09-13T21:45:02.793 INFO:tasks.workunit.client.1.smithi155.stdout:5/732: rmdir d5/d16/d33/d1b/d2f/d3c/d5b 39 2024-09-13T21:45:02.794 INFO:tasks.workunit.client.1.smithi155.stdout:9/848: rename dc/l73 to dc/de/d6f/l12a 0 2024-09-13T21:45:02.794 INFO:tasks.workunit.client.1.smithi155.stdout:8/659: truncate d2/d6/dd/f4e 768665 0 2024-09-13T21:45:02.794 INFO:tasks.workunit.client.1.smithi155.stdout:3/837: dread d3/d25/d17/d52/fd2 [0,4194304] 0 2024-09-13T21:45:02.794 INFO:tasks.workunit.client.1.smithi155.stdout:8/660: fdatasync d2/d2d/d96/db8/fba 0 2024-09-13T21:45:02.794 INFO:tasks.workunit.client.1.smithi155.stdout:5/733: symlink d5/d16/d33/d1b/d2f/d3c/d5b/led 0 2024-09-13T21:45:02.794 INFO:tasks.workunit.client.1.smithi155.stdout:0/766: dread d1/d6/fd1 [0,4194304] 0 2024-09-13T21:45:02.794 INFO:tasks.workunit.client.1.smithi155.stdout:7/662: rename d5/df/d15/da1 to d5/dcd 0 2024-09-13T21:45:02.794 INFO:tasks.workunit.client.1.smithi155.stdout:7/663: stat d5/df/d15/d33/d55/d97/fc7 0 2024-09-13T21:45:02.794 INFO:tasks.workunit.client.1.smithi155.stdout:6/893: rename db/d2c/dbc/dc2/f138 to db/d11/d6d/db9/d1c/d36/d83/ddd/db6/f13a 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:2/640: dwrite d2/db/f16 [4194304,4194304] 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:3/838: creat d3/d25/d1b/d1f/d82/d83/f121 x:0 0 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:5/734: dwrite d5/d16/f32 [0,4194304] 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:8/661: dwrite d2/d6/dd/d25/f85 [0,4194304] 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:9/849: dread dc/de/d2d/d79/f41 [0,4194304] 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:9/850: fsync dc/de/d6f/dae/de1/d38/d90/f100 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:7/664: creat d5/d10/fce x:0 0 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:3/839: mknod d3/d25/d1b/d1f/d82/d83/d99/c122 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:6/894: link db/d11/d6d/db9/d1c/d36/d83/ddd/f6c db/d11/d1e/d11b/d112/f13b 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:0/767: link d1/d6/dc/f6c d1/d6/dc/d4d/d4a/d52/d5c/f124 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:8/662: symlink d2/d2d/d96/db0/lcb 0 2024-09-13T21:45:02.795 INFO:tasks.workunit.client.1.smithi155.stdout:6/895: truncate db/d11/d2b/d35/fdf 81608 0 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:9/851: rename dc/de/d2d/fc9 to dc/de/d2d/d79/d43/f12b 0 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:2/641: dwrite d2/dd/d21/f32 [0,4194304] 0 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:7/665: unlink d5/d10/f18 0 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:8/663: readlink d2/l38 0 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:0/768: fdatasync d1/d6/dc/d4d/d4a/d52/f56 0 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:4/701: sync 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:7/666: chown d5/d13/c67 181935 1 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:6/896: chown db/d11/d6d/db9/de6/d5f/d67/f9e 4647361 1 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:3/840: link d3/d21/f53 d3/d21/d2c/f123 0 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:8/664: mkdir d2/d2d/d96/dcc 0 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:8/665: readlink d2/d2d/d96/db0/lcb 0 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:0/769: fdatasync d1/d6/d97/fe3 0 2024-09-13T21:45:02.796 INFO:tasks.workunit.client.1.smithi155.stdout:3/841: write d3/d25/d17/d52/fac [1832002,55968] 0 2024-09-13T21:45:02.829 INFO:tasks.workunit.client.1.smithi155.stdout:2/642: rename d2/dd/d21/d39/d84/db0 to d2/dd/de6 0 2024-09-13T21:45:02.835 INFO:tasks.workunit.client.1.smithi155.stdout:9/852: rename dc/de/d2d/d79/c8a to dc/de/d6f/c12c 0 2024-09-13T21:45:02.839 INFO:tasks.workunit.client.1.smithi155.stdout:4/702: dwrite d1/d7/de/d72/f50 [0,4194304] 0 2024-09-13T21:45:02.839 INFO:tasks.workunit.client.1.smithi155.stdout:0/770: symlink d1/d6/dc/d4d/d4a/d4e/d61/d118/l125 0 2024-09-13T21:45:02.839 INFO:tasks.workunit.client.1.smithi155.stdout:6/897: dwrite db/d11/d1e/d11b/f101 [0,4194304] 0 2024-09-13T21:45:02.840 INFO:tasks.workunit.client.1.smithi155.stdout:5/735: dread d5/d16/d33/d1b/d28/f60 [0,4194304] 0 2024-09-13T21:45:02.846 INFO:tasks.workunit.client.1.smithi155.stdout:8/666: getdents d2/d6 0 2024-09-13T21:45:02.846 INFO:tasks.workunit.client.1.smithi155.stdout:4/703: mknod d1/d7/de/cd2 0 2024-09-13T21:45:02.849 INFO:tasks.workunit.client.1.smithi155.stdout:5/736: creat d5/d16/d33/d1b/d1e/fee x:0 0 0 2024-09-13T21:45:02.849 INFO:tasks.workunit.client.1.smithi155.stdout:4/704: rename d1 to d1/d7/de/d15/d55/d5e/d66/d7e/dd3 22 2024-09-13T21:45:02.851 INFO:tasks.workunit.client.1.smithi155.stdout:3/842: truncate d3/d25/d1b/d1f/f30 1513136 0 2024-09-13T21:45:02.851 INFO:tasks.workunit.client.1.smithi155.stdout:5/737: write d5/f6 [4509445,75813] 0 2024-09-13T21:45:02.853 INFO:tasks.workunit.client.1.smithi155.stdout:0/771: creat d1/d6/f126 x:0 0 0 2024-09-13T21:45:02.854 INFO:tasks.workunit.client.1.smithi155.stdout:5/738: fsync d5/d16/d33/d1b/d2f/d3c/fa7 0 2024-09-13T21:45:02.855 INFO:tasks.workunit.client.1.smithi155.stdout:6/898: rmdir db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d12f 0 2024-09-13T21:45:02.856 INFO:tasks.workunit.client.1.smithi155.stdout:3/843: write d3/d21/d4a/ff9 [791364,107538] 0 2024-09-13T21:45:02.858 INFO:tasks.workunit.client.1.smithi155.stdout:8/667: truncate d2/d6/dd/d12/f73 280997 0 2024-09-13T21:45:02.860 INFO:tasks.workunit.client.1.smithi155.stdout:3/844: write d3/d25/d1b/d1f/d36/d5c/d66/f108 [41666,32946] 0 2024-09-13T21:45:02.861 INFO:tasks.workunit.client.1.smithi155.stdout:4/705: unlink d1/d7/de/d15/d55/d5e/d66/d7e/l9d 0 2024-09-13T21:45:02.862 INFO:tasks.workunit.client.1.smithi155.stdout:0/772: mkdir d1/d6/dc/d4d/d4a/d127 0 2024-09-13T21:45:02.868 INFO:tasks.workunit.client.1.smithi155.stdout:4/706: creat d1/d7/d5a/fd4 x:0 0 0 2024-09-13T21:45:02.869 INFO:tasks.workunit.client.1.smithi155.stdout:2/643: dread d2/db/d6b/f6e [0,4194304] 0 2024-09-13T21:45:02.869 INFO:tasks.workunit.client.1.smithi155.stdout:4/707: chown d1/d7/de/c4f 226 1 2024-09-13T21:45:02.869 INFO:tasks.workunit.client.1.smithi155.stdout:0/773: mkdir d1/d6/dc/d90/d128 0 2024-09-13T21:45:02.869 INFO:tasks.workunit.client.1.smithi155.stdout:3/845: write d3/d25/f1c [1731904,20281] 0 2024-09-13T21:45:02.869 INFO:tasks.workunit.client.1.smithi155.stdout:4/708: chown d1/d7/d21/c9f 44378 1 2024-09-13T21:45:02.871 INFO:tasks.workunit.client.1.smithi155.stdout:3/846: chown d3/d21/d4a/dcd/dd8/cfe 142185873 1 2024-09-13T21:45:02.872 INFO:tasks.workunit.client.1.smithi155.stdout:2/644: creat d2/dd/d21/d39/dc1/d66/fe7 x:0 0 0 2024-09-13T21:45:02.875 INFO:tasks.workunit.client.1.smithi155.stdout:0/774: read d1/d6/dc/d4d/d4a/d52/fa8 [415809,25821] 0 2024-09-13T21:45:02.877 INFO:tasks.workunit.client.1.smithi155.stdout:5/739: write d5/fa [720677,16262] 0 2024-09-13T21:45:02.878 INFO:tasks.workunit.client.1.smithi155.stdout:2/645: mknod d2/dd/d21/d39/dc1/d66/ce8 0 2024-09-13T21:45:02.879 INFO:tasks.workunit.client.1.smithi155.stdout:2/646: readlink d2/dd/de/d15/l29 0 2024-09-13T21:45:02.880 INFO:tasks.workunit.client.1.smithi155.stdout:3/847: unlink d3/d25/d1b/d1f/d36/d5c/dba/lce 0 2024-09-13T21:45:02.881 INFO:tasks.workunit.client.1.smithi155.stdout:0/775: rmdir d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/df0/df6 39 2024-09-13T21:45:02.881 INFO:tasks.workunit.client.1.smithi155.stdout:1/750: sync 2024-09-13T21:45:02.884 INFO:tasks.workunit.client.1.smithi155.stdout:3/848: dread d3/d21/d4a/fb4 [0,4194304] 0 2024-09-13T21:45:02.885 INFO:tasks.workunit.client.1.smithi155.stdout:8/668: dread d2/d6/dd/d12/f97 [0,4194304] 0 2024-09-13T21:45:02.885 INFO:tasks.workunit.client.1.smithi155.stdout:3/849: chown d3/d21/d2c/l11a 15634 1 2024-09-13T21:45:02.887 INFO:tasks.workunit.client.1.smithi155.stdout:2/647: chown d2/dd/d21/d39/dc1/d66/d6f/c9f 197 1 2024-09-13T21:45:02.887 INFO:tasks.workunit.client.1.smithi155.stdout:4/709: getdents d1/d7/d21/d69 0 2024-09-13T21:45:02.888 INFO:tasks.workunit.client.1.smithi155.stdout:2/648: write d2/dd/d3d/f7f [1351569,51313] 0 2024-09-13T21:45:02.891 INFO:tasks.workunit.client.1.smithi155.stdout:5/740: mkdir d5/d16/d33/d1b/d2f/d3c/def 0 2024-09-13T21:45:02.895 INFO:tasks.workunit.client.1.smithi155.stdout:0/776: mknod d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/df0/df6/c129 0 2024-09-13T21:45:02.895 INFO:tasks.workunit.client.1.smithi155.stdout:4/710: symlink d1/d7/de/dc/ld5 0 2024-09-13T21:45:02.897 INFO:tasks.workunit.client.1.smithi155.stdout:4/711: chown d1/d7/de/c4f 3 1 2024-09-13T21:45:02.897 INFO:tasks.workunit.client.1.smithi155.stdout:0/777: truncate d1/d6/dc/d4d/d4a/d9e/fbc 5242780 0 2024-09-13T21:45:02.899 INFO:tasks.workunit.client.1.smithi155.stdout:5/741: fdatasync d5/d16/d81/d98/f4b 0 2024-09-13T21:45:02.900 INFO:tasks.workunit.client.1.smithi155.stdout:4/712: readlink d1/d7/de/d15/d55/d5e/d66/la0 0 2024-09-13T21:45:02.900 INFO:tasks.workunit.client.1.smithi155.stdout:8/669: dread d2/d1f/fb3 [0,4194304] 0 2024-09-13T21:45:02.902 INFO:tasks.workunit.client.1.smithi155.stdout:1/751: getdents d6/d15 0 2024-09-13T21:45:02.906 INFO:tasks.workunit.client.1.smithi155.stdout:8/670: creat d2/d8/d5e/d60/fcd x:0 0 0 2024-09-13T21:45:02.906 INFO:tasks.workunit.client.1.smithi155.stdout:5/742: symlink d5/d16/d33/d1b/d2f/d3c/def/lf0 0 2024-09-13T21:45:02.907 INFO:tasks.workunit.client.1.smithi155.stdout:3/850: write d3/d25/d1b/d1f/d36/d7c/f9f [298890,87027] 0 2024-09-13T21:45:02.908 INFO:tasks.workunit.client.1.smithi155.stdout:1/752: mknod d6/d7/d89/dd6/dee/cfe 0 2024-09-13T21:45:02.915 INFO:tasks.workunit.client.1.smithi155.stdout:0/778: dwrite d1/d10b/f10f [0,4194304] 0 2024-09-13T21:45:02.917 INFO:tasks.workunit.client.1.smithi155.stdout:1/753: truncate d6/d7/f8 4541536 0 2024-09-13T21:45:02.917 INFO:tasks.workunit.client.1.smithi155.stdout:3/851: symlink d3/d25/d1b/d1f/dc8/l124 0 2024-09-13T21:45:02.917 INFO:tasks.workunit.client.1.smithi155.stdout:2/649: dwrite d2/dd/f65 [0,4194304] 0 2024-09-13T21:45:02.918 INFO:tasks.workunit.client.1.smithi155.stdout:4/713: dwrite d1/d7/d21/f57 [0,4194304] 0 2024-09-13T21:45:02.921 INFO:tasks.workunit.client.1.smithi155.stdout:4/714: dread - d1/d7/de/d15/d55/f84 zero size 2024-09-13T21:45:02.921 INFO:tasks.workunit.client.1.smithi155.stdout:8/671: rename d2/d2d/c5c to d2/d6/cce 0 2024-09-13T21:45:02.922 INFO:tasks.workunit.client.1.smithi155.stdout:1/754: fdatasync d6/d15/f18 0 2024-09-13T21:45:02.923 INFO:tasks.workunit.client.1.smithi155.stdout:8/672: chown d2/d1f/l35 17468 1 2024-09-13T21:45:02.925 INFO:tasks.workunit.client.1.smithi155.stdout:2/650: dread - d2/f69 zero size 2024-09-13T21:45:02.925 INFO:tasks.workunit.client.1.smithi155.stdout:1/755: dread - d6/d82/d90/fca zero size 2024-09-13T21:45:02.926 INFO:tasks.workunit.client.1.smithi155.stdout:2/651: chown d2/db/d6b/f6e 72043 1 2024-09-13T21:45:02.926 INFO:tasks.workunit.client.1.smithi155.stdout:2/652: readlink d2/lab 0 2024-09-13T21:45:02.927 INFO:tasks.workunit.client.1.smithi155.stdout:5/743: truncate d5/d16/d4e/f58 3909938 0 2024-09-13T21:45:02.928 INFO:tasks.workunit.client.1.smithi155.stdout:1/756: rmdir d6/d7/d48/dab 39 2024-09-13T21:45:02.930 INFO:tasks.workunit.client.1.smithi155.stdout:5/744: chown d5/d16/d33/d1f/fa5 13 1 2024-09-13T21:45:02.930 INFO:tasks.workunit.client.1.smithi155.stdout:2/653: chown d2/c9 3179334 1 2024-09-13T21:45:02.935 INFO:tasks.workunit.client.1.smithi155.stdout:4/715: mknod d1/d7/de/dc/d4a/dd1/cd6 0 2024-09-13T21:45:02.937 INFO:tasks.workunit.client.1.smithi155.stdout:2/654: mkdir d2/dd/d21/d39/dc1/d66/de9 0 2024-09-13T21:45:02.937 INFO:tasks.workunit.client.1.smithi155.stdout:5/745: truncate d5/f9 3671331 0 2024-09-13T21:45:02.938 INFO:tasks.workunit.client.1.smithi155.stdout:3/852: link d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/lda d3/d21/d4a/l125 0 2024-09-13T21:45:02.939 INFO:tasks.workunit.client.1.smithi155.stdout:3/853: fsync d3/d25/d1b/d1f/d82/d83/fa5 0 2024-09-13T21:45:02.940 INFO:tasks.workunit.client.1.smithi155.stdout:4/716: creat d1/d7/de/dc/d4a/dd1/fd7 x:0 0 0 2024-09-13T21:45:02.941 INFO:tasks.workunit.client.1.smithi155.stdout:5/746: creat d5/d16/d33/d1b/d59/ff1 x:0 0 0 2024-09-13T21:45:02.941 INFO:tasks.workunit.client.1.smithi155.stdout:3/854: chown d3/d25/d1b/d1f/d82/d83/f121 154 1 2024-09-13T21:45:02.943 INFO:tasks.workunit.client.1.smithi155.stdout:2/655: getdents d2/dd/d21/d39/dc1/da3 0 2024-09-13T21:45:02.944 INFO:tasks.workunit.client.1.smithi155.stdout:4/717: mkdir d1/d7/de/d15/dce/dd8 0 2024-09-13T21:45:02.945 INFO:tasks.workunit.client.1.smithi155.stdout:5/747: creat d5/d16/d33/d1b/d2f/d3c/d44/ff2 x:0 0 0 2024-09-13T21:45:02.946 INFO:tasks.workunit.client.1.smithi155.stdout:3/855: write d3/d25/d17/d3b/f77 [2961377,70272] 0 2024-09-13T21:45:02.947 INFO:tasks.workunit.client.1.smithi155.stdout:2/656: mkdir d2/dd/d21/d39/dc1/da3/dea 0 2024-09-13T21:45:02.953 INFO:tasks.workunit.client.1.smithi155.stdout:1/757: dread d6/d15/d57/d5d/fd0 [0,4194304] 0 2024-09-13T21:45:02.953 INFO:tasks.workunit.client.1.smithi155.stdout:0/779: truncate d1/d6/dc/d4d/d4a/d4e/d61/f89 339572 0 2024-09-13T21:45:02.957 INFO:tasks.workunit.client.1.smithi155.stdout:3/856: dwrite d3/fa [4194304,4194304] 0 2024-09-13T21:45:02.958 INFO:tasks.workunit.client.1.smithi155.stdout:0/780: symlink d1/d6/d97/db2/l12a 0 2024-09-13T21:45:02.963 INFO:tasks.workunit.client.1.smithi155.stdout:3/857: unlink d3/d25/d1b/ffa 0 2024-09-13T21:45:02.964 INFO:tasks.workunit.client.1.smithi155.stdout:1/758: dwrite d6/d15/f58 [4194304,4194304] 0 2024-09-13T21:45:02.964 INFO:tasks.workunit.client.1.smithi155.stdout:0/781: read - d1/fc1 zero size 2024-09-13T21:45:02.967 INFO:tasks.workunit.client.1.smithi155.stdout:4/718: rmdir d1 39 2024-09-13T21:45:02.969 INFO:tasks.workunit.client.1.smithi155.stdout:3/858: dread d3/d21/f41 [0,4194304] 0 2024-09-13T21:45:02.969 INFO:tasks.workunit.client.1.smithi155.stdout:5/748: dread d5/fb7 [0,4194304] 0 2024-09-13T21:45:02.971 INFO:tasks.workunit.client.1.smithi155.stdout:5/749: chown d5/d16/d33/d1b/d2f/d3c/d6c/f79 684206288 1 2024-09-13T21:45:02.973 INFO:tasks.workunit.client.1.smithi155.stdout:0/782: rename d1/d6/dc/d4d/f71 to d1/d6/dc/d4d/d4a/d52/da5/f12b 0 2024-09-13T21:45:02.976 INFO:tasks.workunit.client.1.smithi155.stdout:0/783: dread - d1/d6/dc/f11b zero size 2024-09-13T21:45:02.979 INFO:tasks.workunit.client.1.smithi155.stdout:2/657: write d2/dd/d21/d39/dc1/d66/f7b [767425,120856] 0 2024-09-13T21:45:02.980 INFO:tasks.workunit.client.1.smithi155.stdout:4/719: rename d1/d7/de/d72/da6/lb4 to d1/d7/de/d1a/ld9 0 2024-09-13T21:45:02.982 INFO:tasks.workunit.client.1.smithi155.stdout:5/750: dwrite d5/d16/f2a [8388608,4194304] 0 2024-09-13T21:45:02.986 INFO:tasks.workunit.client.1.smithi155.stdout:2/658: mkdir d2/dd/d21/dc6/dd6/deb 0 2024-09-13T21:45:02.995 INFO:tasks.workunit.client.1.smithi155.stdout:3/859: write d3/d21/d2c/f123 [3086492,34496] 0 2024-09-13T21:45:02.996 INFO:tasks.workunit.client.1.smithi155.stdout:2/659: read d2/db/f63 [433910,122846] 0 2024-09-13T21:45:02.998 INFO:tasks.workunit.client.1.smithi155.stdout:1/759: dwrite d6/d15/f4e [0,4194304] 0 2024-09-13T21:45:03.004 INFO:tasks.workunit.client.1.smithi155.stdout:4/720: truncate d1/d7/fa1 801201 0 2024-09-13T21:45:03.005 INFO:tasks.workunit.client.1.smithi155.stdout:0/784: dwrite d1/d6/dc/d4d/f85 [0,4194304] 0 2024-09-13T21:45:03.006 INFO:tasks.workunit.client.1.smithi155.stdout:2/660: creat d2/dd/d21/d39/dc1/d31/d5d/fec x:0 0 0 2024-09-13T21:45:03.013 INFO:tasks.workunit.client.1.smithi155.stdout:2/661: mkdir d2/dd/de/d15/d38/ded 0 2024-09-13T21:45:03.013 INFO:tasks.workunit.client.1.smithi155.stdout:5/751: dwrite d5/d16/d33/d1b/d28/d52/f7b [0,4194304] 0 2024-09-13T21:45:03.014 INFO:tasks.workunit.client.1.smithi155.stdout:4/721: rename d1/d7/de/d15/f37 to d1/d7/de/dc/d4a/fda 0 2024-09-13T21:45:03.017 INFO:tasks.workunit.client.1.smithi155.stdout:4/722: fdatasync d1/d7/f58 0 2024-09-13T21:45:03.019 INFO:tasks.workunit.client.1.smithi155.stdout:3/860: dread d3/d21/f11d [0,4194304] 0 2024-09-13T21:45:03.024 INFO:tasks.workunit.client.1.smithi155.stdout:3/861: chown d3/d25/d1b/d1f/d36/d5c/ddb/dfd/fff 507967 1 2024-09-13T21:45:03.025 INFO:tasks.workunit.client.1.smithi155.stdout:5/752: link d5/f49 d5/d16/d33/d1b/d92/dca/ff3 0 2024-09-13T21:45:03.028 INFO:tasks.workunit.client.1.smithi155.stdout:0/785: dwrite d1/d6/dc/d4d/d4a/d52/fa8 [0,4194304] 0 2024-09-13T21:45:03.031 INFO:tasks.workunit.client.1.smithi155.stdout:2/662: getdents d2/db/d6b/dd9 0 2024-09-13T21:45:03.035 INFO:tasks.workunit.client.1.smithi155.stdout:3/862: mkdir d3/d25/d1b/d1f/d82/d126 0 2024-09-13T21:45:03.036 INFO:tasks.workunit.client.1.smithi155.stdout:4/723: getdents d1/d7/de/d15/d55/d5e/d66 0 2024-09-13T21:45:03.037 INFO:tasks.workunit.client.1.smithi155.stdout:1/760: dread d6/d82/d90/f6c [4194304,4194304] 0 2024-09-13T21:45:03.037 INFO:tasks.workunit.client.1.smithi155.stdout:5/753: unlink d5/d16/d33/f6f 0 2024-09-13T21:45:03.038 INFO:tasks.workunit.client.1.smithi155.stdout:0/786: dread d1/d6/dc/d4d/d4a/d52/d5c/f124 [0,4194304] 0 2024-09-13T21:45:03.038 INFO:tasks.workunit.client.1.smithi155.stdout:2/663: symlink d2/dd/d21/d39/dc1/dc3/lee 0 2024-09-13T21:45:03.040 INFO:tasks.workunit.client.1.smithi155.stdout:3/863: write d3/d25/d1b/d1f/d36/d7c/f9f [1341282,77420] 0 2024-09-13T21:45:03.040 INFO:tasks.workunit.client.1.smithi155.stdout:1/761: rmdir d6/d82 39 2024-09-13T21:45:03.040 INFO:tasks.workunit.client.1.smithi155.stdout:5/754: fdatasync d5/d16/d4e/fa8 0 2024-09-13T21:45:03.042 INFO:tasks.workunit.client.1.smithi155.stdout:2/664: mkdir d2/dd/d37/d4e/def 0 2024-09-13T21:45:03.043 INFO:tasks.workunit.client.1.smithi155.stdout:3/864: chown d3/d25/d1b/d1f/d36/d5c/ddb/f119 9591 1 2024-09-13T21:45:03.044 INFO:tasks.workunit.client.1.smithi155.stdout:2/665: mknod d2/dd/d21/dc6/cf0 0 2024-09-13T21:45:03.045 INFO:tasks.workunit.client.1.smithi155.stdout:5/755: mkdir d5/d16/d33/d1b/d59/dd1/ddb/df4 0 2024-09-13T21:45:03.047 INFO:tasks.workunit.client.1.smithi155.stdout:3/865: write d3/d25/d17/d52/fd2 [1052952,52619] 0 2024-09-13T21:45:03.047 INFO:tasks.workunit.client.1.smithi155.stdout:2/666: mknod d2/dd/de/d15/d38/cf1 0 2024-09-13T21:45:03.050 INFO:tasks.workunit.client.1.smithi155.stdout:2/667: symlink d2/dd/d21/d8d/lf2 0 2024-09-13T21:45:03.054 INFO:tasks.workunit.client.1.smithi155.stdout:2/668: write d2/dd/d21/d39/dc1/d66/d7c/fb4 [780129,15933] 0 2024-09-13T21:45:03.055 INFO:tasks.workunit.client.1.smithi155.stdout:3/866: dwrite d3/d25/fa0 [4194304,4194304] 0 2024-09-13T21:45:03.056 INFO:tasks.workunit.client.1.smithi155.stdout:2/669: read - d2/dd/d37/f77 zero size 2024-09-13T21:45:03.058 INFO:tasks.workunit.client.1.smithi155.stdout:5/756: truncate d5/d16/d33/f53 2199125 0 2024-09-13T21:45:03.059 INFO:tasks.workunit.client.1.smithi155.stdout:7/667: sync 2024-09-13T21:45:03.066 INFO:tasks.workunit.client.1.smithi155.stdout:0/787: dread d1/d6/dc/d90/f9f [0,4194304] 0 2024-09-13T21:45:03.067 INFO:tasks.workunit.client.1.smithi155.stdout:2/670: rename d2/c7 to d2/dd/d21/d39/dc1/da3/dea/cf3 0 2024-09-13T21:45:03.067 INFO:tasks.workunit.client.1.smithi155.stdout:5/757: truncate d5/d16/d81/d98/f4b 1171850 0 2024-09-13T21:45:03.068 INFO:tasks.workunit.client.1.smithi155.stdout:7/668: creat d5/d13/d99/fcf x:0 0 0 2024-09-13T21:45:03.069 INFO:tasks.workunit.client.1.smithi155.stdout:3/867: link d3/d25/f1c d3/d25/d1b/d1f/d36/d5c/d66/f127 0 2024-09-13T21:45:03.072 INFO:tasks.workunit.client.1.smithi155.stdout:5/758: chown d5/d16/d33/d1b/d28/f37 0 1 2024-09-13T21:45:03.074 INFO:tasks.workunit.client.1.smithi155.stdout:0/788: rename d1/d6/dc/d4d/d4a/f4b to d1/f12c 0 2024-09-13T21:45:03.076 INFO:tasks.workunit.client.1.smithi155.stdout:1/762: dread d6/d7/d89/dd6/dee/f97 [0,4194304] 0 2024-09-13T21:45:03.078 INFO:tasks.workunit.client.1.smithi155.stdout:7/669: dwrite d5/d10/d3e/d40/fac [0,4194304] 0 2024-09-13T21:45:03.079 INFO:tasks.workunit.client.1.smithi155.stdout:1/763: stat d6/d7/d89/dd6/dee/f97 0 2024-09-13T21:45:03.081 INFO:tasks.workunit.client.1.smithi155.stdout:5/759: mkdir d5/d16/d81/df5 0 2024-09-13T21:45:03.082 INFO:tasks.workunit.client.1.smithi155.stdout:3/868: mkdir d3/d25/d1b/d1f/d36/d5c/d66/d128 0 2024-09-13T21:45:03.084 INFO:tasks.workunit.client.1.smithi155.stdout:0/789: creat d1/d6/d97/f12d x:0 0 0 2024-09-13T21:45:03.085 INFO:tasks.workunit.client.1.smithi155.stdout:2/671: write d2/dd/f17 [2052782,78117] 0 2024-09-13T21:45:03.087 INFO:tasks.workunit.client.1.smithi155.stdout:1/764: readlink d6/d15/d57/d99/lb3 0 2024-09-13T21:45:03.088 INFO:tasks.workunit.client.1.smithi155.stdout:2/672: fsync d2/dd/d37/d94/fb8 0 2024-09-13T21:45:03.089 INFO:tasks.workunit.client.1.smithi155.stdout:3/869: dread d3/fa [4194304,4194304] 0 2024-09-13T21:45:03.089 INFO:tasks.workunit.client.1.smithi155.stdout:0/790: fsync d1/d6/dc/f27 0 2024-09-13T21:45:03.091 INFO:tasks.workunit.client.1.smithi155.stdout:3/870: truncate d3/fd6 975042 0 2024-09-13T21:45:03.091 INFO:tasks.workunit.client.1.smithi155.stdout:7/670: mknod d5/df/d15/d33/cd0 0 2024-09-13T21:45:03.092 INFO:tasks.workunit.client.1.smithi155.stdout:2/673: chown d2/dd/d21/d39/dc1/d66 243 1 2024-09-13T21:45:03.092 INFO:tasks.workunit.client.1.smithi155.stdout:5/760: link d5/d16/d81/d98/d84/fe2 d5/d16/d4e/d85/ff6 0 2024-09-13T21:45:03.094 INFO:tasks.workunit.client.1.smithi155.stdout:1/765: unlink d6/f32 0 2024-09-13T21:45:03.098 INFO:tasks.workunit.client.1.smithi155.stdout:2/674: stat d2/db/l1f 0 2024-09-13T21:45:03.100 INFO:tasks.workunit.client.1.smithi155.stdout:7/671: stat d5/df/d15/d33/d55/d97/dc8/fcb 0 2024-09-13T21:45:03.101 INFO:tasks.workunit.client.1.smithi155.stdout:1/766: creat d6/d7/d89/dd6/fff x:0 0 0 2024-09-13T21:45:03.102 INFO:tasks.workunit.client.1.smithi155.stdout:1/767: chown d6/ff 30930 1 2024-09-13T21:45:03.103 INFO:tasks.workunit.client.1.smithi155.stdout:2/675: creat d2/dd/d37/ff4 x:0 0 0 2024-09-13T21:45:03.105 INFO:tasks.workunit.client.1.smithi155.stdout:5/761: link d5/d16/d33/d1b/d2f/d3c/d6c/f77 d5/d16/d81/ff7 0 2024-09-13T21:45:03.107 INFO:tasks.workunit.client.1.smithi155.stdout:2/676: fdatasync d2/dd/de/d15/f64 0 2024-09-13T21:45:03.108 INFO:tasks.workunit.client.1.smithi155.stdout:0/791: getdents d1/d6/dc/d4d/d4a/d52/d5c/d6a 0 2024-09-13T21:45:03.108 INFO:tasks.workunit.client.1.smithi155.stdout:5/762: rmdir d5/d16/d4e 39 2024-09-13T21:45:03.109 INFO:tasks.workunit.client.1.smithi155.stdout:0/792: fdatasync d1/f6e 0 2024-09-13T21:45:03.109 INFO:tasks.workunit.client.1.smithi155.stdout:1/768: symlink d6/d7/l100 0 2024-09-13T21:45:03.110 INFO:tasks.workunit.client.1.smithi155.stdout:7/672: creat d5/df/d15/fd1 x:0 0 0 2024-09-13T21:45:03.111 INFO:tasks.workunit.client.1.smithi155.stdout:3/871: dread d3/d25/d17/d3b/f50 [0,4194304] 0 2024-09-13T21:45:03.113 INFO:tasks.workunit.client.1.smithi155.stdout:5/763: creat d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/ff8 x:0 0 0 2024-09-13T21:45:03.118 INFO:tasks.workunit.client.1.smithi155.stdout:7/673: mkdir d5/d10/d3e/dd2 0 2024-09-13T21:45:03.119 INFO:tasks.workunit.client.1.smithi155.stdout:0/793: mknod d1/d6/dc/d4d/d4a/d4e/d61/d118/c12e 0 2024-09-13T21:45:03.121 INFO:tasks.workunit.client.1.smithi155.stdout:2/677: link d2/db/f4b d2/dd/d21/dc6/dd6/ff5 0 2024-09-13T21:45:03.121 INFO:tasks.workunit.client.1.smithi155.stdout:3/872: dwrite d3/d21/d4a/f10b [0,4194304] 0 2024-09-13T21:45:03.123 INFO:tasks.workunit.client.1.smithi155.stdout:0/794: read d1/f1f [3836483,22097] 0 2024-09-13T21:45:03.123 INFO:tasks.workunit.client.1.smithi155.stdout:5/764: dread d5/d16/d33/d1b/d28/d52/f7b [0,4194304] 0 2024-09-13T21:45:03.125 INFO:tasks.workunit.client.1.smithi155.stdout:0/795: chown d1/d6/dc/d4d/d4a/d52/d5c/f60 517309931 1 2024-09-13T21:45:03.125 INFO:tasks.workunit.client.1.smithi155.stdout:3/873: dread - d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9/ffc zero size 2024-09-13T21:45:03.129 INFO:tasks.workunit.client.1.smithi155.stdout:2/678: creat d2/dd/d21/d39/dc1/dc3/ff6 x:0 0 0 2024-09-13T21:45:03.130 INFO:tasks.workunit.client.1.smithi155.stdout:2/679: readlink d2/dd/de/d15/d38/la5 0 2024-09-13T21:45:03.131 INFO:tasks.workunit.client.1.smithi155.stdout:0/796: stat d1/cab 0 2024-09-13T21:45:03.132 INFO:tasks.workunit.client.1.smithi155.stdout:0/797: write d1/d6/d97/f12d [196049,4560] 0 2024-09-13T21:45:03.133 INFO:tasks.workunit.client.1.smithi155.stdout:3/874: symlink d3/d21/d4a/dcd/l129 0 2024-09-13T21:45:03.134 INFO:tasks.workunit.client.1.smithi155.stdout:0/798: dread - d1/fc1 zero size 2024-09-13T21:45:03.137 INFO:tasks.workunit.client.1.smithi155.stdout:7/674: getdents d5/d3b/d8e 0 2024-09-13T21:45:03.137 INFO:tasks.workunit.client.1.smithi155.stdout:5/765: dread d5/d16/d33/d1b/d2f/d3c/f7f [0,4194304] 0 2024-09-13T21:45:03.139 INFO:tasks.workunit.client.1.smithi155.stdout:1/769: write d6/d15/d23/d55/d6e/dbb/f9d [1250120,97190] 0 2024-09-13T21:45:03.141 INFO:tasks.workunit.client.1.smithi155.stdout:2/680: dwrite d2/dd/d21/f32 [4194304,4194304] 0 2024-09-13T21:45:03.142 INFO:tasks.workunit.client.1.smithi155.stdout:0/799: write d1/d6/dc/d4d/d4a/d52/da5/f12b [7274546,39208] 0 2024-09-13T21:45:03.143 INFO:tasks.workunit.client.1.smithi155.stdout:7/675: write d5/df/f11 [2202376,108713] 0 2024-09-13T21:45:03.144 INFO:tasks.workunit.client.1.smithi155.stdout:2/681: fdatasync d2/dd/d3d/f7f 0 2024-09-13T21:45:03.148 INFO:tasks.workunit.client.1.smithi155.stdout:1/770: creat d6/d15/d57/d99/f101 x:0 0 0 2024-09-13T21:45:03.150 INFO:tasks.workunit.client.1.smithi155.stdout:5/766: rename d5/f8 to d5/d16/d33/d1b/d59/dd1/ddb/ff9 0 2024-09-13T21:45:03.150 INFO:tasks.workunit.client.1.smithi155.stdout:1/771: read d6/d15/f18 [212015,7181] 0 2024-09-13T21:45:03.150 INFO:tasks.workunit.client.1.smithi155.stdout:3/875: link d3/d25/d1b/d1f/d36/d5c/d66/f6f d3/d21/d4a/dcd/dd8/f12a 0 2024-09-13T21:45:03.180 INFO:tasks.workunit.client.1.smithi155.stdout:2/682: mknod d2/dd/d21/d8d/da0/de3/cf7 0 2024-09-13T21:45:03.181 INFO:tasks.workunit.client.1.smithi155.stdout:5/767: mknod d5/d16/d33/d1b/d1e/da1/cfa 0 2024-09-13T21:45:03.182 INFO:tasks.workunit.client.1.smithi155.stdout:7/676: dwrite d5/df/d15/d33/d55/f9b [0,4194304] 0 2024-09-13T21:45:03.183 INFO:tasks.workunit.client.1.smithi155.stdout:1/772: dread d6/d15/d23/fb8 [0,4194304] 0 2024-09-13T21:45:03.185 INFO:tasks.workunit.client.1.smithi155.stdout:3/876: rename d3/d25/d1b/d1f/d82/d83/d99/ff5 to d3/d25/d1b/d90/f12b 0 2024-09-13T21:45:03.186 INFO:tasks.workunit.client.1.smithi155.stdout:2/683: creat d2/dd/d21/dc6/dd6/ff8 x:0 0 0 2024-09-13T21:45:03.188 INFO:tasks.workunit.client.1.smithi155.stdout:5/768: symlink d5/d16/lfb 0 2024-09-13T21:45:03.188 INFO:tasks.workunit.client.1.smithi155.stdout:7/677: write d5/d10/fae [293203,100488] 0 2024-09-13T21:45:03.190 INFO:tasks.workunit.client.1.smithi155.stdout:1/773: symlink d6/d7/d48/dab/l102 0 2024-09-13T21:45:03.190 INFO:tasks.workunit.client.1.smithi155.stdout:0/800: dread d1/d6/dc/d4d/d4a/d9e/fbc [0,4194304] 0 2024-09-13T21:45:03.193 INFO:tasks.workunit.client.1.smithi155.stdout:0/801: write d1/d6/dc/d4d/d4a/d52/f119 [413685,112584] 0 2024-09-13T21:45:03.194 INFO:tasks.workunit.client.1.smithi155.stdout:5/769: rmdir d5/d16/d33/d1b/d2f 39 2024-09-13T21:45:03.195 INFO:tasks.workunit.client.1.smithi155.stdout:2/684: symlink d2/dd/d21/d39/dc1/d66/dd7/lf9 0 2024-09-13T21:45:03.197 INFO:tasks.workunit.client.1.smithi155.stdout:3/877: unlink d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9/ffc 0 2024-09-13T21:45:03.202 INFO:tasks.workunit.client.1.smithi155.stdout:2/685: mkdir d2/dd/de/d15/d38/d41/d5f/d70/dfa 0 2024-09-13T21:45:03.203 INFO:tasks.workunit.client.1.smithi155.stdout:3/878: mknod d3/d25/d1b/d1f/dc8/c12c 0 2024-09-13T21:45:03.204 INFO:tasks.workunit.client.1.smithi155.stdout:0/802: mkdir d1/d6/dc/d12f 0 2024-09-13T21:45:03.204 INFO:tasks.workunit.client.1.smithi155.stdout:2/686: stat d2/dd/d21/l76 0 2024-09-13T21:45:03.208 INFO:tasks.workunit.client.1.smithi155.stdout:1/774: dwrite d6/d82/d91/fa4 [0,4194304] 0 2024-09-13T21:45:03.209 INFO:tasks.workunit.client.1.smithi155.stdout:3/879: mknod d3/d25/d1b/d90/c12d 0 2024-09-13T21:45:03.210 INFO:tasks.workunit.client.1.smithi155.stdout:0/803: chown d1/d6/dc/d8c/f116 2 1 2024-09-13T21:45:03.215 INFO:tasks.workunit.client.1.smithi155.stdout:7/678: dwrite d5/d10/d3e/d40/f70 [0,4194304] 0 2024-09-13T21:45:03.218 INFO:tasks.workunit.client.1.smithi155.stdout:7/679: fdatasync d5/f1e 0 2024-09-13T21:45:03.220 INFO:tasks.workunit.client.1.smithi155.stdout:5/770: dwrite d5/d16/d33/d1b/d59/f88 [0,4194304] 0 2024-09-13T21:45:03.221 INFO:tasks.workunit.client.1.smithi155.stdout:3/880: symlink d3/d25/d1b/d1f/d36/d5c/d66/l12e 0 2024-09-13T21:45:03.221 INFO:tasks.workunit.client.1.smithi155.stdout:0/804: write d1/d6/dc/d8c/f116 [409054,1149] 0 2024-09-13T21:45:03.222 INFO:tasks.workunit.client.1.smithi155.stdout:1/775: read d6/d15/d23/d87/f2a [787244,24070] 0 2024-09-13T21:45:03.223 INFO:tasks.workunit.client.1.smithi155.stdout:2/687: dwrite d2/fc [0,4194304] 0 2024-09-13T21:45:03.231 INFO:tasks.workunit.client.1.smithi155.stdout:7/680: link f3 d5/d3b/fd3 0 2024-09-13T21:45:03.232 INFO:tasks.workunit.client.1.smithi155.stdout:2/688: rename d2/dd/de/d15/d3f/c7a to d2/dd/d21/d39/dc1/d96/cfb 0 2024-09-13T21:45:03.234 INFO:tasks.workunit.client.1.smithi155.stdout:2/689: dread - d2/f69 zero size 2024-09-13T21:45:03.236 INFO:tasks.workunit.client.1.smithi155.stdout:0/805: truncate d1/d6/dc/d4d/d4a/d52/d5c/d6a/fc8 4414722 0 2024-09-13T21:45:03.237 INFO:tasks.workunit.client.1.smithi155.stdout:1/776: rename d6/d82/lc0 to d6/d82/d91/daf/l103 0 2024-09-13T21:45:03.242 INFO:tasks.workunit.client.1.smithi155.stdout:0/806: mknod d1/c130 0 2024-09-13T21:45:03.243 INFO:tasks.workunit.client.1.smithi155.stdout:3/881: dwrite d3/d21/f106 [0,4194304] 0 2024-09-13T21:45:03.243 INFO:tasks.workunit.client.1.smithi155.stdout:5/771: dwrite d5/d16/d81/d98/fc3 [0,4194304] 0 2024-09-13T21:45:03.246 INFO:tasks.workunit.client.1.smithi155.stdout:3/882: write d3/d25/d1b/d1f/d36/d7c/f109 [101840,53425] 0 2024-09-13T21:45:03.249 INFO:tasks.workunit.client.1.smithi155.stdout:0/807: creat d1/d6/dc/d4d/d4a/d4e/d61/f131 x:0 0 0 2024-09-13T21:45:03.251 INFO:tasks.workunit.client.1.smithi155.stdout:3/883: read - d3/d25/d1b/d1f/d82/d83/fa5 zero size 2024-09-13T21:45:03.254 INFO:tasks.workunit.client.1.smithi155.stdout:1/777: dwrite d6/d15/d23/d55/d6e/dbb/f83 [0,4194304] 0 2024-09-13T21:45:03.259 INFO:tasks.workunit.client.1.smithi155.stdout:3/884: creat d3/d25/d1b/d1f/d82/d83/f12f x:0 0 0 2024-09-13T21:45:03.259 INFO:tasks.workunit.client.1.smithi155.stdout:0/808: dread d1/d6/dc/f84 [0,4194304] 0 2024-09-13T21:45:03.261 INFO:tasks.workunit.client.1.smithi155.stdout:9/853: sync 2024-09-13T21:45:03.267 INFO:tasks.workunit.client.1.smithi155.stdout:0/809: chown d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/df0/df6/c129 1 1 2024-09-13T21:45:03.267 INFO:tasks.workunit.client.1.smithi155.stdout:1/778: dwrite d6/d7/d48/f96 [0,4194304] 0 2024-09-13T21:45:03.272 INFO:tasks.workunit.client.1.smithi155.stdout:7/681: dwrite d5/d13/fa4 [0,4194304] 0 2024-09-13T21:45:03.278 INFO:tasks.workunit.client.1.smithi155.stdout:3/885: dwrite d3/d25/d1b/d1f/d36/d5c/ddb/f119 [0,4194304] 0 2024-09-13T21:45:03.278 INFO:tasks.workunit.client.1.smithi155.stdout:0/810: symlink d1/l132 0 2024-09-13T21:45:03.280 INFO:tasks.workunit.client.1.smithi155.stdout:9/854: dwrite dc/de/d6f/dae/de1/f4a [0,4194304] 0 2024-09-13T21:45:03.280 INFO:tasks.workunit.client.1.smithi155.stdout:7/682: chown d5/d13/f21 104 1 2024-09-13T21:45:03.281 INFO:tasks.workunit.client.1.smithi155.stdout:0/811: chown d1/d6/dc/d4d/d4a/d52/da5 1 1 2024-09-13T21:45:03.287 INFO:tasks.workunit.client.1.smithi155.stdout:9/855: mkdir dc/de/d15/d10d/d12d 0 2024-09-13T21:45:03.287 INFO:tasks.workunit.client.1.smithi155.stdout:7/683: dread - d5/df/f75 zero size 2024-09-13T21:45:03.289 INFO:tasks.workunit.client.1.smithi155.stdout:0/812: unlink d1/d6/dc/d4d/d4a/d4e/d61/f6b 0 2024-09-13T21:45:03.289 INFO:tasks.workunit.client.1.smithi155.stdout:5/772: truncate d5/d16/d33/d1b/d28/fa4 1833539 0 2024-09-13T21:45:03.290 INFO:tasks.workunit.client.1.smithi155.stdout:7/684: write d5/d10/d3e/f6b [4489490,55135] 0 2024-09-13T21:45:03.292 INFO:tasks.workunit.client.1.smithi155.stdout:3/886: dread d3/d25/d1b/d1f/d82/f9d [0,4194304] 0 2024-09-13T21:45:03.292 INFO:tasks.workunit.client.1.smithi155.stdout:9/856: mkdir dc/de/d6f/da3/d12e 0 2024-09-13T21:45:03.293 INFO:tasks.workunit.client.1.smithi155.stdout:3/887: readlink d3/d25/d1b/d1f/d36/d5c/l81 0 2024-09-13T21:45:03.298 INFO:tasks.workunit.client.1.smithi155.stdout:1/779: link d6/d15/d23/d55/d6e/dbb/f75 d6/d15/d23/f104 0 2024-09-13T21:45:03.299 INFO:tasks.workunit.client.1.smithi155.stdout:3/888: symlink d3/d25/d1b/d1f/d82/d83/d99/da6/l130 0 2024-09-13T21:45:03.300 INFO:tasks.workunit.client.1.smithi155.stdout:5/773: fdatasync d5/d16/d81/d98/f36 0 2024-09-13T21:45:03.301 INFO:tasks.workunit.client.1.smithi155.stdout:9/857: dread dc/f125 [0,4194304] 0 2024-09-13T21:45:03.301 INFO:tasks.workunit.client.1.smithi155.stdout:7/685: dwrite d5/df/d60/d6d/f7a [0,4194304] 0 2024-09-13T21:45:03.303 INFO:tasks.workunit.client.1.smithi155.stdout:3/889: chown d3/d21/d4a/dcd/dd8/cec 50488978 1 2024-09-13T21:45:03.303 INFO:tasks.workunit.client.1.smithi155.stdout:1/780: mknod d6/d82/c105 0 2024-09-13T21:45:03.309 INFO:tasks.workunit.client.1.smithi155.stdout:7/686: getdents d5/df/d15/d33/d8f 0 2024-09-13T21:45:03.310 INFO:tasks.workunit.client.1.smithi155.stdout:9/858: dread dc/de/d6f/dae/ddb/fbd [0,4194304] 0 2024-09-13T21:45:03.313 INFO:tasks.workunit.client.1.smithi155.stdout:9/859: write dc/de/d6f/dae/df0/d128/faf [2281626,59871] 0 2024-09-13T21:45:03.315 INFO:tasks.workunit.client.1.smithi155.stdout:9/860: chown dc/de/d2d/d79 1599112 1 2024-09-13T21:45:03.318 INFO:tasks.workunit.client.1.smithi155.stdout:7/687: creat d5/df/fd4 x:0 0 0 2024-09-13T21:45:03.320 INFO:tasks.workunit.client.1.smithi155.stdout:9/861: rename dc/de/d15/f11c to dc/de/d2d/d79/d43/f12f 0 2024-09-13T21:45:03.323 INFO:tasks.workunit.client.1.smithi155.stdout:7/688: read d5/df/d15/d33/d55/f87 [2736167,109856] 0 2024-09-13T21:45:03.323 INFO:tasks.workunit.client.1.smithi155.stdout:9/862: write dc/d18/d1e/fa4 [2386702,40842] 0 2024-09-13T21:45:03.326 INFO:tasks.workunit.client.1.smithi155.stdout:0/813: dread d1/d6/dc/f11 [4194304,4194304] 0 2024-09-13T21:45:03.328 INFO:tasks.workunit.client.1.smithi155.stdout:9/863: mknod dc/de/c130 0 2024-09-13T21:45:03.333 INFO:tasks.workunit.client.1.smithi155.stdout:9/864: mknod dc/de/d15/c131 0 2024-09-13T21:45:03.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:03 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:03.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:03 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:03.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:03 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:03 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:03 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:03 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:03 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:03 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:03 smithi155 ceph-mon[34732]: Adjusting osd_memory_target on smithi119 to 1557M 2024-09-13T21:45:03.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:03 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:03.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:03 smithi155 ceph-mon[34732]: pgmap v16: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 111 MiB/s rd, 296 MiB/s wr, 618 op/s 2024-09-13T21:45:03.335 INFO:tasks.workunit.client.1.smithi155.stdout:3/890: dread d3/d25/d1b/d1f/d36/d5c/d66/db3/fe2 [0,4194304] 0 2024-09-13T21:45:03.335 INFO:tasks.workunit.client.1.smithi155.stdout:9/865: rmdir dc 39 2024-09-13T21:45:03.335 INFO:tasks.workunit.client.1.smithi155.stdout:1/781: dwrite d6/d15/d23/d87/f29 [4194304,4194304] 0 2024-09-13T21:45:03.336 INFO:tasks.workunit.client.1.smithi155.stdout:7/689: dwrite d5/df/fd4 [0,4194304] 0 2024-09-13T21:45:03.339 INFO:tasks.workunit.client.1.smithi155.stdout:7/690: chown d5/d10/da7 90132058 1 2024-09-13T21:45:03.339 INFO:tasks.workunit.client.1.smithi155.stdout:0/814: truncate d1/d6/dc/d4d/d4a/d52/d5c/d6a/fa9 4729947 0 2024-09-13T21:45:03.339 INFO:tasks.workunit.client.1.smithi155.stdout:9/866: chown dc/de/d2d/d79/f11f 80986 1 2024-09-13T21:45:03.341 INFO:tasks.workunit.client.1.smithi155.stdout:0/815: chown d1/d6/dc/d4d/d4a/d4e/f53 78793118 1 2024-09-13T21:45:03.343 INFO:tasks.workunit.client.1.smithi155.stdout:1/782: dwrite d6/d82/d91/fa4 [0,4194304] 0 2024-09-13T21:45:03.344 INFO:tasks.workunit.client.1.smithi155.stdout:3/891: rename d3/d21/fa3 to d3/d21/d2c/d115/f131 0 2024-09-13T21:45:03.345 INFO:tasks.workunit.client.1.smithi155.stdout:9/867: fdatasync dc/de/d6f/dae/df0/d128/d67/f84 0 2024-09-13T21:45:03.347 INFO:tasks.workunit.client.1.smithi155.stdout:7/691: mknod d5/cd5 0 2024-09-13T21:45:03.350 INFO:tasks.workunit.client.1.smithi155.stdout:0/816: mkdir d1/d6/dc/d4d/d133 0 2024-09-13T21:45:03.350 INFO:tasks.workunit.client.1.smithi155.stdout:1/783: truncate d6/d15/d23/fae 860859 0 2024-09-13T21:45:03.351 INFO:tasks.workunit.client.1.smithi155.stdout:9/868: mknod dc/de/d6f/d71/c132 0 2024-09-13T21:45:03.353 INFO:tasks.workunit.client.1.smithi155.stdout:7/692: creat d5/d10/dbf/fd6 x:0 0 0 2024-09-13T21:45:03.357 INFO:tasks.workunit.client.1.smithi155.stdout:0/817: stat d1/d6/dc/ce7 0 2024-09-13T21:45:03.357 INFO:tasks.workunit.client.1.smithi155.stdout:3/892: dread d3/d25/d17/d52/fd2 [0,4194304] 0 2024-09-13T21:45:03.365 INFO:tasks.workunit.client.1.smithi155.stdout:7/693: mknod d5/da6/dca/cd7 0 2024-09-13T21:45:03.369 INFO:tasks.workunit.client.1.smithi155.stdout:1/784: dwrite d6/d7/d89/dd6/dee/fdb [4194304,4194304] 0 2024-09-13T21:45:03.376 INFO:tasks.workunit.client.1.smithi155.stdout:3/893: dread d3/d25/d1b/d1f/d36/d7c/f9e [0,4194304] 0 2024-09-13T21:45:03.383 INFO:tasks.workunit.client.1.smithi155.stdout:0/818: symlink d1/d10b/l134 0 2024-09-13T21:45:03.387 INFO:tasks.workunit.client.1.smithi155.stdout:0/819: truncate d1/d6/dc/d4d/d4a/d52/d5c/fe5 933788 0 2024-09-13T21:45:03.388 INFO:tasks.workunit.client.1.smithi155.stdout:0/820: write d1/d6/f10e [64841,2458] 0 2024-09-13T21:45:03.388 INFO:tasks.workunit.client.1.smithi155.stdout:1/785: creat d6/f106 x:0 0 0 2024-09-13T21:45:03.389 INFO:tasks.workunit.client.1.smithi155.stdout:0/821: fsync d1/d6/dc/d4d/d4a/f8d 0 2024-09-13T21:45:03.390 INFO:tasks.workunit.client.1.smithi155.stdout:3/894: rename d3/d25/d17/d52/lae to d3/d25/d1b/d1f/l132 0 2024-09-13T21:45:03.393 INFO:tasks.workunit.client.1.smithi155.stdout:0/822: mkdir d1/d6/dc/d4d/d4a/d52/d5c/d6a/d135 0 2024-09-13T21:45:03.397 INFO:tasks.workunit.client.1.smithi155.stdout:0/823: dread d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/fdd [0,4194304] 0 2024-09-13T21:45:03.401 INFO:tasks.workunit.client.1.smithi155.stdout:0/824: creat d1/d6/f136 x:0 0 0 2024-09-13T21:45:03.404 INFO:tasks.workunit.client.1.smithi155.stdout:0/825: rename d1/d6/dc/d4d/d4a/d9e/fc4 to d1/d10b/d111/f137 0 2024-09-13T21:45:03.406 INFO:tasks.workunit.client.1.smithi155.stdout:0/826: creat d1/d6/dc/d4d/d4a/d9e/de0/f138 x:0 0 0 2024-09-13T21:45:03.407 INFO:tasks.workunit.client.1.smithi155.stdout:0/827: write d1/d6/dc/d4d/d4a/d52/f119 [1553940,28926] 0 2024-09-13T21:45:03.408 INFO:tasks.workunit.client.1.smithi155.stdout:9/869: truncate dc/de/d2d/d79/f62 2968663 0 2024-09-13T21:45:03.409 INFO:tasks.workunit.client.1.smithi155.stdout:0/828: fsync d1/fc1 0 2024-09-13T21:45:03.411 INFO:tasks.workunit.client.1.smithi155.stdout:0/829: dread - d1/d6/d81/df7/f10a zero size 2024-09-13T21:45:03.414 INFO:tasks.workunit.client.1.smithi155.stdout:7/694: dwrite d5/d13/f8b [0,4194304] 0 2024-09-13T21:45:03.414 INFO:tasks.workunit.client.1.smithi155.stdout:9/870: rename dc/de/d6f/dae/de1/d38/d90/l91 to dc/d18/d1e/d86/l133 0 2024-09-13T21:45:03.416 INFO:tasks.workunit.client.1.smithi155.stdout:3/895: truncate d3/d21/f53 2763379 0 2024-09-13T21:45:03.418 INFO:tasks.workunit.client.1.smithi155.stdout:7/695: fsync d5/d3b/fd3 0 2024-09-13T21:45:03.421 INFO:tasks.workunit.client.1.smithi155.stdout:0/830: fdatasync d1/d6/dc/d4d/f80 0 2024-09-13T21:45:03.422 INFO:tasks.workunit.client.1.smithi155.stdout:0/831: readlink d1/d6/l41 0 2024-09-13T21:45:03.425 INFO:tasks.workunit.client.1.smithi155.stdout:9/871: getdents dc/de/d6f/da3/d12e 0 2024-09-13T21:45:03.466 INFO:tasks.workunit.client.1.smithi155.stdout:3/896: mknod d3/d25/d1b/d1f/d36/d5c/dbc/d117/c133 0 2024-09-13T21:45:03.467 INFO:tasks.workunit.client.1.smithi155.stdout:7/696: mkdir d5/d10/d3e/dd2/dd8 0 2024-09-13T21:45:03.468 INFO:tasks.workunit.client.1.smithi155.stdout:7/697: chown d5/df/d79/lab 172 1 2024-09-13T21:45:03.469 INFO:tasks.workunit.client.1.smithi155.stdout:0/832: truncate d1/f19 400600 0 2024-09-13T21:45:03.473 INFO:tasks.workunit.client.1.smithi155.stdout:3/897: dwrite d3/d25/d1b/d1f/d36/d5c/dba/fde [0,4194304] 0 2024-09-13T21:45:03.534 INFO:tasks.workunit.client.1.smithi155.stdout:7/698: fdatasync d5/d13/f3d 0 2024-09-13T21:45:03.537 INFO:tasks.workunit.client.1.smithi155.stdout:0/833: creat d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/f139 x:0 0 0 2024-09-13T21:45:03.538 INFO:tasks.workunit.client.1.smithi155.stdout:3/898: unlink d3/d25/d1b/d90/l10a 0 2024-09-13T21:45:03.541 INFO:tasks.workunit.client.1.smithi155.stdout:9/872: write fa [3749474,76972] 0 2024-09-13T21:45:03.543 INFO:tasks.workunit.client.1.smithi155.stdout:0/834: symlink d1/d6/dc/d4d/d4a/d9e/l13a 0 2024-09-13T21:45:03.543 INFO:tasks.workunit.client.1.smithi155.stdout:9/873: dread - dc/de/d6f/dae/de1/d38/d90/f100 zero size 2024-09-13T21:45:03.554 INFO:tasks.workunit.client.1.smithi155.stdout:3/899: link d3/d25/d17/d3b/c75 d3/d25/d1b/d1f/d36/d5c/dba/c134 0 2024-09-13T21:45:03.555 INFO:tasks.workunit.client.1.smithi155.stdout:3/900: chown d3/d25/d1b/c71 3708 1 2024-09-13T21:45:03.556 INFO:tasks.workunit.client.1.smithi155.stdout:9/874: getdents dc 0 2024-09-13T21:45:03.561 INFO:tasks.workunit.client.1.smithi155.stdout:7/699: dwrite d5/d13/fa3 [0,4194304] 0 2024-09-13T21:45:03.564 INFO:tasks.workunit.client.1.smithi155.stdout:3/901: rmdir d3/d25/d1b 39 2024-09-13T21:45:03.565 INFO:tasks.workunit.client.1.smithi155.stdout:0/835: dread d1/d6/dc/d4d/d4a/d52/d5b/f8f [0,4194304] 0 2024-09-13T21:45:03.565 INFO:tasks.workunit.client.1.smithi155.stdout:3/902: write d3/d21/d4a/ff9 [399243,59900] 0 2024-09-13T21:45:03.567 INFO:tasks.workunit.client.1.smithi155.stdout:9/875: dread dc/d19/f118 [0,4194304] 0 2024-09-13T21:45:03.568 INFO:tasks.workunit.client.1.smithi155.stdout:7/700: read d5/d13/fa5 [489050,14214] 0 2024-09-13T21:45:03.569 INFO:tasks.workunit.client.1.smithi155.stdout:7/701: chown d5/df/d15/d33 56454674 1 2024-09-13T21:45:03.569 INFO:tasks.workunit.client.1.smithi155.stdout:3/903: chown d3/d25/d1b/d1f/f49 627435 1 2024-09-13T21:45:03.570 INFO:tasks.workunit.client.1.smithi155.stdout:3/904: fdatasync d3/d25/f61 0 2024-09-13T21:45:03.570 INFO:tasks.workunit.client.1.smithi155.stdout:9/876: fsync dc/de/d5c/f5e 0 2024-09-13T21:45:03.570 INFO:tasks.workunit.client.1.smithi155.stdout:7/702: rmdir d5/dcd 39 2024-09-13T21:45:03.572 INFO:tasks.workunit.client.1.smithi155.stdout:3/905: symlink d3/d25/d17/d52/l135 0 2024-09-13T21:45:03.573 INFO:tasks.workunit.client.1.smithi155.stdout:9/877: mknod dc/de/d6f/dae/df0/d128/d67/c134 0 2024-09-13T21:45:03.574 INFO:tasks.workunit.client.1.smithi155.stdout:7/703: truncate d5/d10/d3e/d3f/f9a 848034 0 2024-09-13T21:45:03.575 INFO:tasks.workunit.client.1.smithi155.stdout:3/906: mknod d3/d21/d2c/c136 0 2024-09-13T21:45:03.577 INFO:tasks.workunit.client.1.smithi155.stdout:9/878: mkdir dc/de/d2d/d79/d43/d135 0 2024-09-13T21:45:03.578 INFO:tasks.workunit.client.1.smithi155.stdout:9/879: readlink dc/de/d6f/dae/de1/d38/la8 0 2024-09-13T21:45:03.580 INFO:tasks.workunit.client.1.smithi155.stdout:3/907: rmdir d3/d25/d1b/d1f/d82/d126 0 2024-09-13T21:45:03.580 INFO:tasks.workunit.client.1.smithi155.stdout:7/704: dwrite d5/d10/d3e/f6b [0,4194304] 0 2024-09-13T21:45:03.582 INFO:tasks.workunit.client.1.smithi155.stdout:3/908: chown d3/d25/d1b/d1f/d36/d5c/f63 23 1 2024-09-13T21:45:03.584 INFO:tasks.workunit.client.1.smithi155.stdout:7/705: write d5/df/d15/d33/d55/f9b [5186761,112936] 0 2024-09-13T21:45:03.595 INFO:tasks.workunit.client.1.smithi155.stdout:7/706: write d5/df/f75 [918326,104134] 0 2024-09-13T21:45:03.595 INFO:tasks.workunit.client.1.smithi155.stdout:9/880: dwrite dc/de/d2d/d79/d43/f5d [0,4194304] 0 2024-09-13T21:45:03.596 INFO:tasks.workunit.client.1.smithi155.stdout:0/836: dread d1/d6/dc/d4d/d4a/f8d [0,4194304] 0 2024-09-13T21:45:03.598 INFO:tasks.workunit.client.1.smithi155.stdout:9/881: chown dc/de/d6f/dae/de1/d38/d90/f11b 7457150 1 2024-09-13T21:45:03.599 INFO:tasks.workunit.client.1.smithi155.stdout:7/707: mkdir d5/d10/d3e/d3f/d61/dd9 0 2024-09-13T21:45:03.600 INFO:tasks.workunit.client.1.smithi155.stdout:9/882: stat dc/d18/d50/c6d 0 2024-09-13T21:45:03.602 INFO:tasks.workunit.client.1.smithi155.stdout:7/708: symlink d5/df/d15/d33/d55/d97/lda 0 2024-09-13T21:45:03.604 INFO:tasks.workunit.client.1.smithi155.stdout:0/837: link d1/d6/dc/d4d/d4a/d4e/f53 d1/d6/dc/f13b 0 2024-09-13T21:45:03.607 INFO:tasks.workunit.client.1.smithi155.stdout:0/838: mkdir d1/d6/dc/d4d/d13c 0 2024-09-13T21:45:03.608 INFO:tasks.workunit.client.1.smithi155.stdout:0/839: fsync d1/d6/dc/d8c/f93 0 2024-09-13T21:45:03.611 INFO:tasks.workunit.client.1.smithi155.stdout:0/840: mkdir d1/d6/dc/d4d/d4a/d52/da5/d13d 0 2024-09-13T21:45:03.615 INFO:tasks.workunit.client.1.smithi155.stdout:3/909: dread d3/d25/d17/f1e [4194304,4194304] 0 2024-09-13T21:45:03.615 INFO:tasks.workunit.client.1.smithi155.stdout:0/841: write d1/d6/dc/d90/ffa [1308619,46613] 0 2024-09-13T21:45:03.615 INFO:tasks.workunit.client.1.smithi155.stdout:7/709: truncate d5/d10/d3e/d40/f70 1225317 0 2024-09-13T21:45:03.617 INFO:tasks.workunit.client.1.smithi155.stdout:3/910: chown d3/d25/d1b/d1f/d82/d83/d99/da6/lc1 110 1 2024-09-13T21:45:03.619 INFO:tasks.workunit.client.1.smithi155.stdout:0/842: symlink d1/d6/dc/d4d/d4a/d52/d5c/d6a/l13e 0 2024-09-13T21:45:03.620 INFO:tasks.workunit.client.1.smithi155.stdout:3/911: creat d3/dbb/f137 x:0 0 0 2024-09-13T21:45:03.622 INFO:tasks.workunit.client.1.smithi155.stdout:3/912: symlink d3/l138 0 2024-09-13T21:45:03.624 INFO:tasks.workunit.client.1.smithi155.stdout:7/710: dwrite d5/df/d60/f86 [0,4194304] 0 2024-09-13T21:45:03.629 INFO:tasks.workunit.client.1.smithi155.stdout:7/711: link d5/d10/d3e/d3f/d61/l71 d5/da6/dca/ldb 0 2024-09-13T21:45:03.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:03 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:03.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:03 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:03.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:03 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:03 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:03 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:03 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:03 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:03 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:03.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:03 smithi119 ceph-mon[27653]: Adjusting osd_memory_target on smithi119 to 1557M 2024-09-13T21:45:03.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:03 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:03.633 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:03 smithi119 ceph-mon[27653]: pgmap v16: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 111 MiB/s rd, 296 MiB/s wr, 618 op/s 2024-09-13T21:45:03.633 INFO:tasks.workunit.client.1.smithi155.stdout:3/913: symlink d3/dbb/l139 0 2024-09-13T21:45:03.634 INFO:tasks.workunit.client.1.smithi155.stdout:0/843: dwrite d1/d6/dc/f27 [4194304,4194304] 0 2024-09-13T21:45:03.638 INFO:tasks.workunit.client.1.smithi155.stdout:0/844: chown d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/df0/df6/c122 104 1 2024-09-13T21:45:03.639 INFO:tasks.workunit.client.1.smithi155.stdout:0/845: write d1/d6/dc/d4d/d4a/f8d [3242976,113604] 0 2024-09-13T21:45:03.641 INFO:tasks.workunit.client.1.smithi155.stdout:0/846: chown d1/d6/dc/d4d/d4a/d4e/d61/f131 53 1 2024-09-13T21:45:03.643 INFO:tasks.workunit.client.1.smithi155.stdout:0/847: mkdir d1/d6/dc/d4d/d4a/d9e/de0/d13f 0 2024-09-13T21:45:03.643 INFO:tasks.workunit.client.1.smithi155.stdout:0/848: stat d1/d6/d97/db2/f11d 0 2024-09-13T21:45:03.644 INFO:tasks.workunit.client.1.smithi155.stdout:0/849: fsync d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/d82/f11e 0 2024-09-13T21:45:03.647 INFO:tasks.workunit.client.1.smithi155.stdout:0/850: unlink d1/d6/d81/df7/f10a 0 2024-09-13T21:45:03.649 INFO:tasks.workunit.client.1.smithi155.stdout:7/712: write d5/df/d15/d33/d55/d97/dc8/fcb [238524,111039] 0 2024-09-13T21:45:03.651 INFO:tasks.workunit.client.1.smithi155.stdout:0/851: rename d1/d6/dc/d4d/d4a/d127 to d1/d6/d97/d140 0 2024-09-13T21:45:03.655 INFO:tasks.workunit.client.1.smithi155.stdout:3/914: dwrite d3/d25/d1b/d1f/d36/f6c [0,4194304] 0 2024-09-13T21:45:03.655 INFO:tasks.workunit.client.1.smithi155.stdout:0/852: symlink d1/d6/dc/d90/d128/l141 0 2024-09-13T21:45:03.656 INFO:tasks.workunit.client.1.smithi155.stdout:3/915: chown d3/d25/d1b/cf7 3 1 2024-09-13T21:45:03.659 INFO:tasks.workunit.client.1.smithi155.stdout:0/853: creat d1/d6/d81/df7/f142 x:0 0 0 2024-09-13T21:45:03.661 INFO:tasks.workunit.client.1.smithi155.stdout:7/713: truncate d5/df/fd4 1502282 0 2024-09-13T21:45:03.661 INFO:tasks.workunit.client.1.smithi155.stdout:0/854: read d1/d6/dc/d8c/f93 [912896,114098] 0 2024-09-13T21:45:03.662 INFO:tasks.workunit.client.1.smithi155.stdout:7/714: readlink d5/l2f 0 2024-09-13T21:45:03.663 INFO:tasks.workunit.client.1.smithi155.stdout:7/715: chown d5/df/d15 164638 1 2024-09-13T21:45:03.664 INFO:tasks.workunit.client.1.smithi155.stdout:3/916: dread d3/d25/d17/f1e [4194304,4194304] 0 2024-09-13T21:45:03.664 INFO:tasks.workunit.client.1.smithi155.stdout:3/917: readlink d3/l138 0 2024-09-13T21:45:03.665 INFO:tasks.workunit.client.1.smithi155.stdout:7/716: creat d5/d10/d48/fdc x:0 0 0 2024-09-13T21:45:03.667 INFO:tasks.workunit.client.1.smithi155.stdout:0/855: getdents d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/df0/df6 0 2024-09-13T21:45:03.670 INFO:tasks.workunit.client.1.smithi155.stdout:3/918: rename d3/d25/d17/d3b/l96 to d3/d25/d1b/d1f/d82/d83/l13a 0 2024-09-13T21:45:03.670 INFO:tasks.workunit.client.1.smithi155.stdout:0/856: read d1/d6/dc/d90/f92 [1653180,14882] 0 2024-09-13T21:45:03.671 INFO:tasks.workunit.client.1.smithi155.stdout:0/857: chown d1/d6/dc/d4d/d4a/d9e/de0 360 1 2024-09-13T21:45:03.672 INFO:tasks.workunit.client.1.smithi155.stdout:3/919: rmdir d3/d25/d1b/d1f/d36/d5c/dbc 39 2024-09-13T21:45:03.674 INFO:tasks.workunit.client.1.smithi155.stdout:3/920: unlink d3/d21/ld3 0 2024-09-13T21:45:03.675 INFO:tasks.workunit.client.1.smithi155.stdout:7/717: dread d5/d10/d48/faf [0,4194304] 0 2024-09-13T21:45:03.676 INFO:tasks.workunit.client.1.smithi155.stdout:3/921: symlink d3/d21/d4a/l13b 0 2024-09-13T21:45:03.676 INFO:tasks.workunit.client.1.smithi155.stdout:7/718: stat d5/df/d15/d33/d55/d97/f9e 0 2024-09-13T21:45:03.678 INFO:tasks.workunit.client.1.smithi155.stdout:3/922: symlink d3/d25/d1b/l13c 0 2024-09-13T21:45:03.679 INFO:tasks.workunit.client.1.smithi155.stdout:3/923: readlink d3/d25/d1b/l55 0 2024-09-13T21:45:03.679 INFO:tasks.workunit.client.1.smithi155.stdout:7/719: symlink d5/df/d60/ldd 0 2024-09-13T21:45:03.683 INFO:tasks.workunit.client.1.smithi155.stdout:7/720: dread d5/df/f19 [0,4194304] 0 2024-09-13T21:45:03.687 INFO:tasks.workunit.client.1.smithi155.stdout:0/858: dwrite d1/d6/dc/d4d/d105/f107 [0,4194304] 0 2024-09-13T21:45:03.687 INFO:tasks.workunit.client.1.smithi155.stdout:7/721: dread d5/d10/d3e/d40/f70 [0,4194304] 0 2024-09-13T21:45:03.690 INFO:tasks.workunit.client.1.smithi155.stdout:7/722: unlink d5/df/d15/d33/d55/d97/lda 0 2024-09-13T21:45:03.691 INFO:tasks.workunit.client.1.smithi155.stdout:0/859: mknod d1/d6/dc/d4d/d4a/c143 0 2024-09-13T21:45:03.693 INFO:tasks.workunit.client.1.smithi155.stdout:0/860: dread d1/d6/d97/f9b [0,4194304] 0 2024-09-13T21:45:03.694 INFO:tasks.workunit.client.1.smithi155.stdout:7/723: rename d5/df/d15/d33/d55/d97/fc7 to d5/df/fde 0 2024-09-13T21:45:03.696 INFO:tasks.workunit.client.1.smithi155.stdout:7/724: rename d5/d10/d3e/d3f to d5/d10/d3e/d3f/ddf 22 2024-09-13T21:45:03.696 INFO:tasks.workunit.client.1.smithi155.stdout:0/861: symlink d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/l144 0 2024-09-13T21:45:03.698 INFO:tasks.workunit.client.1.smithi155.stdout:0/862: creat d1/d6/dc/d8c/f145 x:0 0 0 2024-09-13T21:45:03.701 INFO:tasks.workunit.client.1.smithi155.stdout:0/863: rename d1/d6/dc/d8c/f116 to d1/d6/dc/d4d/d4a/d52/d5b/f146 0 2024-09-13T21:45:03.703 INFO:tasks.workunit.client.1.smithi155.stdout:0/864: creat d1/d6/dc/d90/d128/f147 x:0 0 0 2024-09-13T21:45:03.708 INFO:tasks.workunit.client.1.smithi155.stdout:7/725: write d5/df/d15/d33/d55/f87 [2097982,124627] 0 2024-09-13T21:45:03.709 INFO:tasks.workunit.client.1.smithi155.stdout:0/865: dwrite d1/d6/dc/d4d/d4a/d52/f56 [0,4194304] 0 2024-09-13T21:45:03.710 INFO:tasks.workunit.client.1.smithi155.stdout:7/726: chown d5/df/d15/d33/d55/f5e 3272958 1 2024-09-13T21:45:03.714 INFO:tasks.workunit.client.1.smithi155.stdout:7/727: chown d5/df/d60/f86 1480 1 2024-09-13T21:45:03.719 INFO:tasks.workunit.client.1.smithi155.stdout:0/866: link d1/d6/d97/lfd d1/d6/dc/d4d/d133/l148 0 2024-09-13T21:45:03.721 INFO:tasks.workunit.client.1.smithi155.stdout:7/728: unlink d5/d10/dbf/fd6 0 2024-09-13T21:45:03.723 INFO:tasks.workunit.client.1.smithi155.stdout:0/867: rename d1/d6/dc/d4d/d4a/d52/da5/lb3 to d1/d6/dc/d8c/l149 0 2024-09-13T21:45:03.725 INFO:tasks.workunit.client.1.smithi155.stdout:7/729: rename d5/d13/f8b to d5/d3b/fe0 0 2024-09-13T21:45:03.729 INFO:tasks.workunit.client.1.smithi155.stdout:0/868: read d1/d6/dc/d4d/f50 [63172,126850] 0 2024-09-13T21:45:03.730 INFO:tasks.workunit.client.1.smithi155.stdout:0/869: rmdir d1 39 2024-09-13T21:45:03.740 INFO:tasks.workunit.client.1.smithi155.stdout:0/870: dwrite d1/d6/d81/f115 [0,4194304] 0 2024-09-13T21:45:03.744 INFO:tasks.workunit.client.1.smithi155.stdout:7/730: truncate d5/df/d15/f28 786277 0 2024-09-13T21:45:03.746 INFO:tasks.workunit.client.1.smithi155.stdout:0/871: mkdir d1/d6/dc/d4d/d4a/d52/d5c/d6a/d135/d14a 0 2024-09-13T21:45:03.749 INFO:tasks.workunit.client.1.smithi155.stdout:7/731: creat d5/df/fe1 x:0 0 0 2024-09-13T21:45:03.749 INFO:tasks.workunit.client.1.smithi155.stdout:0/872: readlink d1/d6/dc/d4d/l67 0 2024-09-13T21:45:03.750 INFO:tasks.workunit.client.1.smithi155.stdout:7/732: truncate d5/df/fe1 517595 0 2024-09-13T21:45:03.751 INFO:tasks.workunit.client.1.smithi155.stdout:6/899: sync 2024-09-13T21:45:03.754 INFO:tasks.workunit.client.1.smithi155.stdout:7/733: creat d5/fe2 x:0 0 0 2024-09-13T21:45:03.756 INFO:tasks.workunit.client.1.smithi155.stdout:0/873: dwrite d1/fc2 [0,4194304] 0 2024-09-13T21:45:03.775 INFO:tasks.workunit.client.1.smithi155.stdout:7/734: write d5/df/d15/d33/d55/f9b [4095475,16243] 0 2024-09-13T21:45:03.778 INFO:tasks.workunit.client.1.smithi155.stdout:6/900: dwrite db/d11/d6d/db9/de6/f116 [0,4194304] 0 2024-09-13T21:45:03.778 INFO:tasks.workunit.client.1.smithi155.stdout:0/874: mknod d1/d6/dc/d4d/d4a/d52/d5c/c14b 0 2024-09-13T21:45:03.780 INFO:tasks.workunit.client.1.smithi155.stdout:0/875: readlink d1/d6/d97/lfd 0 2024-09-13T21:45:03.781 INFO:tasks.workunit.client.1.smithi155.stdout:6/901: truncate db/d11/d1e/fce 4942823 0 2024-09-13T21:45:03.903 INFO:tasks.workunit.client.1.smithi155.stdout:7/735: link d5/d10/d3e/d3f/lb3 d5/d13/le3 0 2024-09-13T21:45:03.905 INFO:tasks.workunit.client.1.smithi155.stdout:6/902: rename db/d11/d6d/db9/de6/d5f/f127 to db/d11/d1e/d21/d44/f13c 0 2024-09-13T21:45:03.906 INFO:tasks.workunit.client.1.smithi155.stdout:7/736: mknod d5/df/d60/ce4 0 2024-09-13T21:45:03.907 INFO:tasks.workunit.client.1.smithi155.stdout:0/876: rename d1/d6/dc/d4d/d4a/d4e/d61/fc6 to d1/d6/dc/d4d/d4a/d52/d5c/d6a/d135/f14c 0 2024-09-13T21:45:03.908 INFO:tasks.workunit.client.1.smithi155.stdout:6/903: mknod db/d11/d1e/d21/d44/daa/c13d 0 2024-09-13T21:45:03.909 INFO:tasks.workunit.client.1.smithi155.stdout:0/877: chown d1/d6/dc/d4d/d4a/d4e/d61/fd3 354261832 1 2024-09-13T21:45:03.910 INFO:tasks.workunit.client.1.smithi155.stdout:0/878: read - d1/f103 zero size 2024-09-13T21:45:03.911 INFO:tasks.workunit.client.1.smithi155.stdout:7/737: rename d5/df/d15/d33/d8f to d5/df/d60/de5 0 2024-09-13T21:45:03.912 INFO:tasks.workunit.client.1.smithi155.stdout:7/738: fdatasync d5/df/d15/fa8 0 2024-09-13T21:45:03.912 INFO:tasks.workunit.client.1.smithi155.stdout:6/904: mkdir db/d2c/d13e 0 2024-09-13T21:45:03.913 INFO:tasks.workunit.client.1.smithi155.stdout:6/905: fsync db/d11/d6d/f6f 0 2024-09-13T21:45:03.915 INFO:tasks.workunit.client.1.smithi155.stdout:7/739: mknod d5/d10/d3e/dd2/dd8/ce6 0 2024-09-13T21:45:03.916 INFO:tasks.workunit.client.1.smithi155.stdout:6/906: write db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/d93/f100 [989011,14082] 0 2024-09-13T21:45:03.917 INFO:tasks.workunit.client.1.smithi155.stdout:6/907: chown db/d11/d2b/d35/fdf 1091971500 1 2024-09-13T21:45:03.920 INFO:tasks.workunit.client.1.smithi155.stdout:7/740: creat d5/df/d15/d33/d55/d97/fe7 x:0 0 0 2024-09-13T21:45:03.923 INFO:tasks.workunit.client.1.smithi155.stdout:0/879: dread d1/d6/dc/f7a [0,4194304] 0 2024-09-13T21:45:03.925 INFO:tasks.workunit.client.1.smithi155.stdout:7/741: readlink d5/df/d60/d6d/lc6 0 2024-09-13T21:45:03.928 INFO:tasks.workunit.client.1.smithi155.stdout:0/880: symlink d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/l14d 0 2024-09-13T21:45:03.932 INFO:tasks.workunit.client.1.smithi155.stdout:6/908: dwrite db/d11/d6d/db9/f17 [12582912,4194304] 0 2024-09-13T21:45:03.933 INFO:tasks.workunit.client.1.smithi155.stdout:7/742: dwrite d5/d13/fa3 [0,4194304] 0 2024-09-13T21:45:03.933 INFO:tasks.workunit.client.1.smithi155.stdout:0/881: unlink d1/d6/dc/d4d/d4a/d4e/d61/d118/l125 0 2024-09-13T21:45:03.934 INFO:tasks.workunit.client.1.smithi155.stdout:6/909: stat db/d11/d1e/d11b 0 2024-09-13T21:45:03.936 INFO:tasks.workunit.client.1.smithi155.stdout:7/743: fsync d5/d10/d48/faf 0 2024-09-13T21:45:03.937 INFO:tasks.workunit.client.1.smithi155.stdout:6/910: truncate db/d11/d6d/db9/f23 1122088 0 2024-09-13T21:45:03.942 INFO:tasks.workunit.client.1.smithi155.stdout:7/744: rename d5/l78 to d5/d10/d3e/d40/da2/le8 0 2024-09-13T21:45:03.945 INFO:tasks.workunit.client.1.smithi155.stdout:0/882: dread d1/d6/dc/d90/f92 [0,4194304] 0 2024-09-13T21:45:03.945 INFO:tasks.workunit.client.1.smithi155.stdout:7/745: mknod d5/da6/ce9 0 2024-09-13T21:45:03.946 INFO:tasks.workunit.client.1.smithi155.stdout:6/911: dwrite db/d11/d2b/d35/dfc/f104 [0,4194304] 0 2024-09-13T21:45:03.949 INFO:tasks.workunit.client.1.smithi155.stdout:0/883: write d1/d6/dc/d4d/d4a/d52/f119 [2397553,118204] 0 2024-09-13T21:45:03.949 INFO:tasks.workunit.client.1.smithi155.stdout:7/746: chown d5/d13/f24 6076 1 2024-09-13T21:45:03.953 INFO:tasks.workunit.client.1.smithi155.stdout:6/912: creat db/d11/d6d/db9/d1c/d36/d131/f13f x:0 0 0 2024-09-13T21:45:03.972 INFO:tasks.workunit.client.1.smithi155.stdout:0/884: write d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/fe8 [1005286,55607] 0 2024-09-13T21:45:03.972 INFO:tasks.workunit.client.1.smithi155.stdout:6/913: write db/d11/d1e/d21/d44/f4b [1666257,92580] 0 2024-09-13T21:45:03.977 INFO:tasks.workunit.client.1.smithi155.stdout:7/747: dwrite d5/d3b/f83 [0,4194304] 0 2024-09-13T21:45:03.979 INFO:tasks.workunit.client.1.smithi155.stdout:0/885: rename d1/d6/l95 to d1/d6/dc/l14e 0 2024-09-13T21:45:03.981 INFO:tasks.workunit.client.1.smithi155.stdout:7/748: write d5/df/d15/d33/d55/d97/fcc [4405901,64853] 0 2024-09-13T21:45:03.982 INFO:tasks.workunit.client.1.smithi155.stdout:6/914: dwrite db/f10 [8388608,4194304] 0 2024-09-13T21:45:03.982 INFO:tasks.workunit.client.1.smithi155.stdout:0/886: chown d1/d6/dc/d4d/d4a/d9e/de0/ce1 188891463 1 2024-09-13T21:45:03.984 INFO:tasks.workunit.client.1.smithi155.stdout:6/915: read db/f22 [3456364,83597] 0 2024-09-13T21:45:03.986 INFO:tasks.workunit.client.1.smithi155.stdout:7/749: mknod d5/df/d15/d33/d55/d97/cea 0 2024-09-13T21:45:03.988 INFO:tasks.workunit.client.1.smithi155.stdout:6/916: dread db/d11/d86/fcc [0,4194304] 0 2024-09-13T21:45:03.988 INFO:tasks.workunit.client.1.smithi155.stdout:0/887: unlink d1/d6/dc/d4d/d4a/d52/f113 0 2024-09-13T21:45:03.990 INFO:tasks.workunit.client.1.smithi155.stdout:0/888: write d1/d6/dc/d8c/f145 [881349,50945] 0 2024-09-13T21:45:03.994 INFO:tasks.workunit.client.1.smithi155.stdout:7/750: truncate d5/d10/f90 2360187 0 2024-09-13T21:45:03.997 INFO:tasks.workunit.client.1.smithi155.stdout:0/889: getdents d1/d6/d81 0 2024-09-13T21:45:03.998 INFO:tasks.workunit.client.1.smithi155.stdout:0/890: truncate d1/d6/dc/faa 1089596 0 2024-09-13T21:45:03.999 INFO:tasks.workunit.client.1.smithi155.stdout:0/891: readlink d1/d6/dc/d8c/l149 0 2024-09-13T21:45:04.003 INFO:tasks.workunit.client.1.smithi155.stdout:0/892: rename d1/d6/dc/d90/df1 to d1/d6/d97/d14f 0 2024-09-13T21:45:04.004 INFO:tasks.workunit.client.1.smithi155.stdout:6/917: write db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/fb8 [695420,110417] 0 2024-09-13T21:45:04.004 INFO:tasks.workunit.client.1.smithi155.stdout:0/893: readlink d1/d6/dc/d4d/l67 0 2024-09-13T21:45:04.006 INFO:tasks.workunit.client.1.smithi155.stdout:6/918: fsync db/d11/d6d/db9/de6/d5f/de4/f10a 0 2024-09-13T21:45:04.007 INFO:tasks.workunit.client.1.smithi155.stdout:6/919: write db/d11/d1e/d21/d44/f10b [58991,93809] 0 2024-09-13T21:45:04.007 INFO:tasks.workunit.client.1.smithi155.stdout:0/894: creat d1/d6/dc/d4d/d4a/d4e/f150 x:0 0 0 2024-09-13T21:45:04.010 INFO:tasks.workunit.client.1.smithi155.stdout:8/673: sync 2024-09-13T21:45:04.011 INFO:tasks.workunit.client.1.smithi155.stdout:6/920: symlink db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d88/l140 0 2024-09-13T21:45:04.013 INFO:tasks.workunit.client.1.smithi155.stdout:6/921: dread - db/d11/d6d/db9/d1c/d36/d83/fd6 zero size 2024-09-13T21:45:04.014 INFO:tasks.workunit.client.1.smithi155.stdout:8/674: rename d2/d1f/d77/fbc to d2/d8/d65/da8/fcf 0 2024-09-13T21:45:04.015 INFO:tasks.workunit.client.1.smithi155.stdout:6/922: write db/d11/d6d/db9/d1c/d36/d83/f12e [459583,63027] 0 2024-09-13T21:45:04.017 INFO:tasks.workunit.client.1.smithi155.stdout:8/675: mknod d2/d1f/d87/cd0 0 2024-09-13T21:45:04.018 INFO:tasks.workunit.client.1.smithi155.stdout:7/751: dread d5/df/f6e [0,4194304] 0 2024-09-13T21:45:04.018 INFO:tasks.workunit.client.1.smithi155.stdout:6/923: mknod db/d11/d6d/db9/d1c/d36/d37/c141 0 2024-09-13T21:45:04.019 INFO:tasks.workunit.client.1.smithi155.stdout:8/676: rmdir d2/d8/d5e/d60/db2 39 2024-09-13T21:45:04.019 INFO:tasks.workunit.client.1.smithi155.stdout:7/752: fsync d5/d13/d99/fa9 0 2024-09-13T21:45:04.020 INFO:tasks.workunit.client.1.smithi155.stdout:6/924: truncate db/d11/d1e/d21/d44/f13c 809299 0 2024-09-13T21:45:04.021 INFO:tasks.workunit.client.1.smithi155.stdout:7/753: mknod d5/d10/d48/ceb 0 2024-09-13T21:45:04.022 INFO:tasks.workunit.client.1.smithi155.stdout:6/925: symlink db/d11/d2b/df6/l142 0 2024-09-13T21:45:04.023 INFO:tasks.workunit.client.1.smithi155.stdout:8/677: creat d2/d8/fd1 x:0 0 0 2024-09-13T21:45:04.024 INFO:tasks.workunit.client.1.smithi155.stdout:7/754: read d5/df/d15/d33/d55/f5e [1044382,79304] 0 2024-09-13T21:45:04.024 INFO:tasks.workunit.client.1.smithi155.stdout:8/678: dread - d2/d2d/f6c zero size 2024-09-13T21:45:04.024 INFO:tasks.workunit.client.1.smithi155.stdout:6/926: rmdir db/d11/d1e/dca 39 2024-09-13T21:45:04.026 INFO:tasks.workunit.client.1.smithi155.stdout:7/755: mknod d5/d3b/cec 0 2024-09-13T21:45:04.027 INFO:tasks.workunit.client.1.smithi155.stdout:8/679: creat d2/d2d/d96/dcc/fd2 x:0 0 0 2024-09-13T21:45:04.028 INFO:tasks.workunit.client.1.smithi155.stdout:7/756: creat d5/d10/d3e/dd2/fed x:0 0 0 2024-09-13T21:45:04.029 INFO:tasks.workunit.client.1.smithi155.stdout:8/680: chown d2/d6/dd/d12/f46 1615 1 2024-09-13T21:45:04.030 INFO:tasks.workunit.client.1.smithi155.stdout:6/927: truncate db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/dda/f11e 521354 0 2024-09-13T21:45:04.032 INFO:tasks.workunit.client.1.smithi155.stdout:8/681: creat d2/d8/d5e/d60/db2/fd3 x:0 0 0 2024-09-13T21:45:04.032 INFO:tasks.workunit.client.1.smithi155.stdout:7/757: read d5/d10/d3e/d3f/f66 [2178462,26537] 0 2024-09-13T21:45:04.033 INFO:tasks.workunit.client.1.smithi155.stdout:8/682: write d2/d6/dd/fa3 [5532487,56459] 0 2024-09-13T21:45:04.035 INFO:tasks.workunit.client.1.smithi155.stdout:7/758: stat d5/df/d60/l9f 0 2024-09-13T21:45:04.036 INFO:tasks.workunit.client.1.smithi155.stdout:7/759: chown d5/df/f58 71 1 2024-09-13T21:45:04.036 INFO:tasks.workunit.client.1.smithi155.stdout:6/928: dread db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/f8c [0,4194304] 0 2024-09-13T21:45:04.036 INFO:tasks.workunit.client.1.smithi155.stdout:7/760: stat d5/d3b 0 2024-09-13T21:45:04.040 INFO:tasks.workunit.client.1.smithi155.stdout:8/683: link d2/d6/dd/d12/l51 d2/ld4 0 2024-09-13T21:45:04.044 INFO:tasks.workunit.client.1.smithi155.stdout:8/684: write d2/d2d/f5a [1450774,3672] 0 2024-09-13T21:45:04.044 INFO:tasks.workunit.client.1.smithi155.stdout:8/685: fdatasync d2/d8/d5e/d60/db2/fd3 0 2024-09-13T21:45:04.047 INFO:tasks.workunit.client.1.smithi155.stdout:8/686: creat d2/dae/dbe/fd5 x:0 0 0 2024-09-13T21:45:04.048 INFO:tasks.workunit.client.1.smithi155.stdout:8/687: mkdir d2/d8/d75/d82/dd6 0 2024-09-13T21:45:04.052 INFO:tasks.workunit.client.1.smithi155.stdout:6/929: dread db/d11/d1e/f56 [0,4194304] 0 2024-09-13T21:45:04.054 INFO:tasks.workunit.client.1.smithi155.stdout:8/688: dwrite d2/d8/d65/f68 [0,4194304] 0 2024-09-13T21:45:04.055 INFO:tasks.workunit.client.1.smithi155.stdout:6/930: write db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/fae [5836616,39314] 0 2024-09-13T21:45:04.057 INFO:tasks.workunit.client.1.smithi155.stdout:6/931: mknod db/d11/d1e/dca/c143 0 2024-09-13T21:45:04.059 INFO:tasks.workunit.client.1.smithi155.stdout:8/689: truncate d2/d2d/f59 3028802 0 2024-09-13T21:45:04.062 INFO:tasks.workunit.client.1.smithi155.stdout:8/690: link d2/d8/d5e/d60/cc3 d2/d6/dd/d12/cd7 0 2024-09-13T21:45:04.065 INFO:tasks.workunit.client.1.smithi155.stdout:8/691: getdents d2/d2d/d96/db8 0 2024-09-13T21:45:04.066 INFO:tasks.workunit.client.1.smithi155.stdout:8/692: write d2/d6/dd/d12/f1b [349249,74640] 0 2024-09-13T21:45:04.070 INFO:tasks.workunit.client.1.smithi155.stdout:6/932: dread db/f22 [0,4194304] 0 2024-09-13T21:45:04.079 INFO:tasks.workunit.client.1.smithi155.stdout:6/933: write f3 [305008,118822] 0 2024-09-13T21:45:04.082 INFO:tasks.workunit.client.1.smithi155.stdout:6/934: symlink db/d11/d2b/d35/l144 0 2024-09-13T21:45:04.083 INFO:tasks.workunit.client.1.smithi155.stdout:6/935: chown db/d2c/l4e 405037 1 2024-09-13T21:45:04.084 INFO:tasks.workunit.client.1.smithi155.stdout:8/693: dwrite d2/d8/d65/f41 [0,4194304] 0 2024-09-13T21:45:04.089 INFO:tasks.workunit.client.1.smithi155.stdout:6/936: creat db/d11/d6d/db9/d1c/d36/f145 x:0 0 0 2024-09-13T21:45:04.090 INFO:tasks.workunit.client.1.smithi155.stdout:8/694: rmdir d2/d6/dd/d25/dc5 0 2024-09-13T21:45:04.094 INFO:tasks.workunit.client.1.smithi155.stdout:8/695: rmdir d2/d8/d5e/d60/db2 39 2024-09-13T21:45:04.096 INFO:tasks.workunit.client.1.smithi155.stdout:8/696: rmdir d2/d8/d65/da8 39 2024-09-13T21:45:04.097 INFO:tasks.workunit.client.1.smithi155.stdout:6/937: dwrite db/d11/d1e/fce [4194304,4194304] 0 2024-09-13T21:45:04.101 INFO:tasks.workunit.client.1.smithi155.stdout:6/938: fsync db/d11/d2b/f9b 0 2024-09-13T21:45:04.101 INFO:tasks.workunit.client.1.smithi155.stdout:8/697: truncate d2/d8/fb1 817555 0 2024-09-13T21:45:04.101 INFO:tasks.workunit.client.1.smithi155.stdout:8/698: stat d2/d6/dd/l72 0 2024-09-13T21:45:04.102 INFO:tasks.workunit.client.1.smithi155.stdout:6/939: unlink db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/d8e/d110/c11a 0 2024-09-13T21:45:04.103 INFO:tasks.workunit.client.1.smithi155.stdout:6/940: chown db/d2c/dbc/cfd 3281464 1 2024-09-13T21:45:04.106 INFO:tasks.workunit.client.1.smithi155.stdout:8/699: write d2/d6/dd/d12/f66 [5049335,26453] 0 2024-09-13T21:45:04.108 INFO:tasks.workunit.client.1.smithi155.stdout:8/700: chown d2/d6/dd/d12/l51 816220 1 2024-09-13T21:45:04.111 INFO:tasks.workunit.client.1.smithi155.stdout:8/701: symlink d2/d8/d5e/d60/db2/ld8 0 2024-09-13T21:45:04.115 INFO:tasks.workunit.client.1.smithi155.stdout:8/702: truncate d2/d8/d65/f41 2590743 0 2024-09-13T21:45:04.116 INFO:tasks.workunit.client.1.smithi155.stdout:8/703: write d2/d6/dd/d12/f1e [2754063,111672] 0 2024-09-13T21:45:04.131 INFO:tasks.workunit.client.1.smithi155.stdout:8/704: dread d2/d6/dd/fa3 [4194304,4194304] 0 2024-09-13T21:45:04.133 INFO:tasks.workunit.client.1.smithi155.stdout:8/705: symlink d2/d8/d75/d82/ld9 0 2024-09-13T21:45:04.137 INFO:tasks.workunit.client.1.smithi155.stdout:8/706: link d2/d8/d65/f5b d2/d8/d5e/d60/fda 0 2024-09-13T21:45:04.138 INFO:tasks.workunit.client.1.smithi155.stdout:8/707: write d2/d8/f10 [10081869,2210] 0 2024-09-13T21:45:04.139 INFO:tasks.workunit.client.1.smithi155.stdout:8/708: chown d2 118 1 2024-09-13T21:45:04.141 INFO:tasks.workunit.client.1.smithi155.stdout:8/709: symlink d2/d8/d65/da8/ldb 0 2024-09-13T21:45:04.142 INFO:tasks.workunit.client.1.smithi155.stdout:8/710: mknod d2/d91/cdc 0 2024-09-13T21:45:04.144 INFO:tasks.workunit.client.1.smithi155.stdout:8/711: unlink d2/d2d/f59 0 2024-09-13T21:45:04.244 INFO:tasks.workunit.client.1.smithi155.stdout:4/724: sync 2024-09-13T21:45:04.244 INFO:tasks.workunit.client.1.smithi155.stdout:5/774: sync 2024-09-13T21:45:04.245 INFO:tasks.workunit.client.1.smithi155.stdout:1/786: sync 2024-09-13T21:45:04.245 INFO:tasks.workunit.client.1.smithi155.stdout:2/690: sync 2024-09-13T21:45:04.245 INFO:tasks.workunit.client.1.smithi155.stdout:3/924: sync 2024-09-13T21:45:04.245 INFO:tasks.workunit.client.1.smithi155.stdout:9/883: sync 2024-09-13T21:45:04.246 INFO:tasks.workunit.client.1.smithi155.stdout:4/725: dread - d1/d7/d5a/fbd zero size 2024-09-13T21:45:04.247 INFO:tasks.workunit.client.1.smithi155.stdout:3/925: read d3/d21/fc6 [4557001,26009] 0 2024-09-13T21:45:04.247 INFO:tasks.workunit.client.1.smithi155.stdout:1/787: read - d6/d15/d23/d55/d6e/dbb/fce zero size 2024-09-13T21:45:04.248 INFO:tasks.workunit.client.1.smithi155.stdout:5/775: chown d5/d16/d33/d1b/d2f/d3c/d5b/d5f/dc8 7 1 2024-09-13T21:45:04.248 INFO:tasks.workunit.client.1.smithi155.stdout:1/788: stat d6/d7 0 2024-09-13T21:45:04.251 INFO:tasks.workunit.client.1.smithi155.stdout:1/789: stat d6/d7/d89/dd6/fd9 0 2024-09-13T21:45:04.252 INFO:tasks.workunit.client.1.smithi155.stdout:3/926: unlink d3/d21/d4a/l13b 0 2024-09-13T21:45:04.253 INFO:tasks.workunit.client.1.smithi155.stdout:2/691: dread d2/dd/d21/d39/dc1/d66/d7c/fae [0,4194304] 0 2024-09-13T21:45:04.253 INFO:tasks.workunit.client.1.smithi155.stdout:5/776: stat d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/db8/cc4 0 2024-09-13T21:45:04.254 INFO:tasks.workunit.client.1.smithi155.stdout:1/790: creat d6/d82/d91/f107 x:0 0 0 2024-09-13T21:45:04.256 INFO:tasks.workunit.client.1.smithi155.stdout:5/777: write d5/d16/d33/d1b/d2f/d3c/d5b/fbd [918187,119990] 0 2024-09-13T21:45:04.257 INFO:tasks.workunit.client.1.smithi155.stdout:2/692: stat d2/dd/d21/d39/dc1/d31/d5d/caf 0 2024-09-13T21:45:04.258 INFO:tasks.workunit.client.1.smithi155.stdout:5/778: dread - d5/d16/d33/d1b/d2f/d3c/d44/ff2 zero size 2024-09-13T21:45:04.264 INFO:tasks.workunit.client.1.smithi155.stdout:2/693: symlink d2/dd/lfc 0 2024-09-13T21:45:04.267 INFO:tasks.workunit.client.1.smithi155.stdout:4/726: write d1/f3b [935421,71388] 0 2024-09-13T21:45:04.268 INFO:tasks.workunit.client.1.smithi155.stdout:9/884: truncate dc/de/d6f/f7e 48813 0 2024-09-13T21:45:04.272 INFO:tasks.workunit.client.1.smithi155.stdout:5/779: dwrite d5/d16/d33/d1b/d2f/fcb [0,4194304] 0 2024-09-13T21:45:04.272 INFO:tasks.workunit.client.1.smithi155.stdout:3/927: dread d3/d25/d17/f5b [0,4194304] 0 2024-09-13T21:45:04.273 INFO:tasks.workunit.client.1.smithi155.stdout:4/727: write d1/d7/d21/d2d/d42/fb0 [719411,68826] 0 2024-09-13T21:45:04.273 INFO:tasks.workunit.client.1.smithi155.stdout:1/791: write d6/d15/d23/f3c [744986,42582] 0 2024-09-13T21:45:04.283 INFO:tasks.workunit.client.1.smithi155.stdout:9/885: link dc/de/d6f/d71/fdd dc/de/d6f/dae/de1/d38/d90/d74/f136 0 2024-09-13T21:45:04.284 INFO:tasks.workunit.client.1.smithi155.stdout:2/694: write d2/db/f27 [101507,99127] 0 2024-09-13T21:45:04.287 INFO:tasks.workunit.client.1.smithi155.stdout:5/780: dread d5/d16/d81/d98/f8b [0,4194304] 0 2024-09-13T21:45:04.287 INFO:tasks.workunit.client.1.smithi155.stdout:1/792: rmdir d6/d82 39 2024-09-13T21:45:04.288 INFO:tasks.workunit.client.1.smithi155.stdout:4/728: mkdir d1/d7/d21/dc6/ddb 0 2024-09-13T21:45:04.289 INFO:tasks.workunit.client.1.smithi155.stdout:9/886: mknod dc/de/d15/c137 0 2024-09-13T21:45:04.291 INFO:tasks.workunit.client.1.smithi155.stdout:3/928: dwrite d3/d25/d1b/d1f/d82/d83/f12f [0,4194304] 0 2024-09-13T21:45:04.292 INFO:tasks.workunit.client.1.smithi155.stdout:1/793: readlink d6/d82/lf6 0 2024-09-13T21:45:04.294 INFO:tasks.workunit.client.1.smithi155.stdout:5/781: mkdir d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/dfc 0 2024-09-13T21:45:04.298 INFO:tasks.workunit.client.1.smithi155.stdout:4/729: truncate d1/d7/d21/f2b 88842 0 2024-09-13T21:45:04.299 INFO:tasks.workunit.client.1.smithi155.stdout:3/929: fdatasync d3/d10/fe0 0 2024-09-13T21:45:04.306 INFO:tasks.workunit.client.1.smithi155.stdout:5/782: creat d5/d16/d33/d1b/d2f/d3c/d5b/d5f/ffd x:0 0 0 2024-09-13T21:45:04.306 INFO:tasks.workunit.client.1.smithi155.stdout:3/930: fdatasync d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9/f11b 0 2024-09-13T21:45:04.306 INFO:tasks.workunit.client.1.smithi155.stdout:4/730: rmdir d1/d7/de/d15/d55 39 2024-09-13T21:45:04.307 INFO:tasks.workunit.client.1.smithi155.stdout:5/783: symlink d5/d16/d33/d1b/d28/d52/lfe 0 2024-09-13T21:45:04.307 INFO:tasks.workunit.client.1.smithi155.stdout:2/695: write d2/db/f1d [1267352,2247] 0 2024-09-13T21:45:04.308 INFO:tasks.workunit.client.1.smithi155.stdout:9/887: dread dc/ff1 [0,4194304] 0 2024-09-13T21:45:04.310 INFO:tasks.workunit.client.1.smithi155.stdout:3/931: symlink d3/d25/d17/d3b/l13d 0 2024-09-13T21:45:04.310 INFO:tasks.workunit.client.1.smithi155.stdout:2/696: creat d2/dd/de6/ffd x:0 0 0 2024-09-13T21:45:04.312 INFO:tasks.workunit.client.1.smithi155.stdout:5/784: mkdir d5/d16/d33/d1f/dff 0 2024-09-13T21:45:04.313 INFO:tasks.workunit.client.1.smithi155.stdout:3/932: mkdir d3/dbb/d13e 0 2024-09-13T21:45:04.314 INFO:tasks.workunit.client.1.smithi155.stdout:2/697: rmdir d2/dd 39 2024-09-13T21:45:04.314 INFO:tasks.workunit.client.1.smithi155.stdout:5/785: write d5/d16/d33/d1b/d2f/fcb [3152769,79090] 0 2024-09-13T21:45:04.315 INFO:tasks.workunit.client.1.smithi155.stdout:9/888: mknod dc/de/d6f/dae/de1/d38/d90/c138 0 2024-09-13T21:45:04.316 INFO:tasks.workunit.client.1.smithi155.stdout:5/786: chown d5/d16/d33/d1b/d2f/d3c/d5b/d5f/c83 5 1 2024-09-13T21:45:04.318 INFO:tasks.workunit.client.1.smithi155.stdout:3/933: mknod d3/dbb/c13f 0 2024-09-13T21:45:04.322 INFO:tasks.workunit.client.1.smithi155.stdout:3/934: symlink d3/d21/d2c/d115/l140 0 2024-09-13T21:45:04.324 INFO:tasks.workunit.client.1.smithi155.stdout:2/698: fsync d2/dd/d37/d4e/f87 0 2024-09-13T21:45:04.328 INFO:tasks.workunit.client.1.smithi155.stdout:5/787: dwrite d5/d16/d33/d1b/d1e/fee [0,4194304] 0 2024-09-13T21:45:04.328 INFO:tasks.workunit.client.1.smithi155.stdout:4/731: dread d1/d7/de/d1a/f68 [0,4194304] 0 2024-09-13T21:45:04.329 INFO:tasks.workunit.client.1.smithi155.stdout:2/699: creat d2/dd/d21/ffe x:0 0 0 2024-09-13T21:45:04.329 INFO:tasks.workunit.client.1.smithi155.stdout:9/889: write dc/d18/fb7 [321544,19143] 0 2024-09-13T21:45:04.331 INFO:tasks.workunit.client.1.smithi155.stdout:3/935: fdatasync d3/d25/f58 0 2024-09-13T21:45:04.332 INFO:tasks.workunit.client.1.smithi155.stdout:9/890: chown dc/de/d6f/dae/ddb/cc2 508 1 2024-09-13T21:45:04.336 INFO:tasks.workunit.client.1.smithi155.stdout:2/700: rename d2/dd/d21/la7 to d2/dd/d37/d4e/def/lff 0 2024-09-13T21:45:04.340 INFO:tasks.workunit.client.1.smithi155.stdout:4/732: getdents d1/d7/d21/d2d/d42 0 2024-09-13T21:45:04.342 INFO:tasks.workunit.client.1.smithi155.stdout:2/701: rename d2/dd/de/d15/d38/d41/f7e to d2/dd/d37/d94/f100 0 2024-09-13T21:45:04.349 INFO:tasks.workunit.client.1.smithi155.stdout:4/733: dread d1/d7/de/d15/d55/f62 [0,4194304] 0 2024-09-13T21:45:04.356 INFO:tasks.workunit.client.1.smithi155.stdout:9/891: dwrite dc/de/d6f/f7e [0,4194304] 0 2024-09-13T21:45:04.356 INFO:tasks.workunit.client.1.smithi155.stdout:4/734: creat d1/d7/de/d15/d55/d5e/d66/fdc x:0 0 0 2024-09-13T21:45:04.357 INFO:tasks.workunit.client.1.smithi155.stdout:2/702: dwrite d2/dd/d21/d39/d84/fbc [0,4194304] 0 2024-09-13T21:45:04.357 INFO:tasks.workunit.client.1.smithi155.stdout:3/936: dread d3/d21/f53 [0,4194304] 0 2024-09-13T21:45:04.358 INFO:tasks.workunit.client.1.smithi155.stdout:2/703: stat d2/dd/d21/d8d/fb9 0 2024-09-13T21:45:04.361 INFO:tasks.workunit.client.1.smithi155.stdout:3/937: truncate d3/d25/d1b/d90/fe1 1456126 0 2024-09-13T21:45:04.362 INFO:tasks.workunit.client.1.smithi155.stdout:9/892: write dc/de/d2d/d79/d43/f12b [645851,77067] 0 2024-09-13T21:45:04.372 INFO:tasks.workunit.client.1.smithi155.stdout:9/893: write dc/de/d2d/f40 [896300,34570] 0 2024-09-13T21:45:04.379 INFO:tasks.workunit.client.1.smithi155.stdout:2/704: truncate d2/dd/f17 84474 0 2024-09-13T21:45:04.380 INFO:tasks.workunit.client.1.smithi155.stdout:3/938: write d3/d25/d17/d52/fe5 [744681,9983] 0 2024-09-13T21:45:04.391 INFO:tasks.workunit.client.1.smithi155.stdout:9/894: fdatasync dc/de/d2d/d79/d43/f9c 0 2024-09-13T21:45:04.393 INFO:tasks.workunit.client.1.smithi155.stdout:2/705: unlink d2/dd/de/d15/d38/lc5 0 2024-09-13T21:45:04.397 INFO:tasks.workunit.client.1.smithi155.stdout:9/895: unlink dc/de/d6f/dae/de1/d38/d90/d74/fb9 0 2024-09-13T21:45:04.401 INFO:tasks.workunit.client.1.smithi155.stdout:3/939: dread d3/d25/d1b/d1f/d36/f5d [0,4194304] 0 2024-09-13T21:45:04.401 INFO:tasks.workunit.client.1.smithi155.stdout:2/706: rename d2/dd/lfc to d2/db/l101 0 2024-09-13T21:45:04.408 INFO:tasks.workunit.client.1.smithi155.stdout:9/896: dwrite dc/de/d2d/d79/d43/f9c [0,4194304] 0 2024-09-13T21:45:04.408 INFO:tasks.workunit.client.1.smithi155.stdout:3/940: symlink d3/d25/d1b/d1f/d36/d5c/ddb/dfd/l141 0 2024-09-13T21:45:04.408 INFO:tasks.workunit.client.1.smithi155.stdout:9/897: fsync dc/de/d6f/dae/de1/f2b 0 2024-09-13T21:45:04.417 INFO:tasks.workunit.client.1.smithi155.stdout:3/941: write d3/d21/d2c/d115/f131 [576329,127952] 0 2024-09-13T21:45:04.419 INFO:tasks.workunit.client.1.smithi155.stdout:2/707: dwrite d2/dd/d21/d39/dc1/f3e [4194304,4194304] 0 2024-09-13T21:45:04.422 INFO:tasks.workunit.client.1.smithi155.stdout:3/942: fdatasync d3/d21/d4a/f102 0 2024-09-13T21:45:04.423 INFO:tasks.workunit.client.1.smithi155.stdout:3/943: chown d3/d25/d1b/d1f/dc8/l124 0 1 2024-09-13T21:45:04.426 INFO:tasks.workunit.client.1.smithi155.stdout:3/944: rmdir d3/d25/d17/d52 39 2024-09-13T21:45:04.430 INFO:tasks.workunit.client.1.smithi155.stdout:9/898: rename dc/de/d6f/dae/de1/d38/d90/f98 to dc/de/f139 0 2024-09-13T21:45:04.431 INFO:tasks.workunit.client.1.smithi155.stdout:2/708: link d2/dd/de/d15/lb3 d2/dd/d21/d39/d84/l102 0 2024-09-13T21:45:04.434 INFO:tasks.workunit.client.1.smithi155.stdout:2/709: truncate d2/dd/d21/d39/dc1/d66/f78 3062665 0 2024-09-13T21:45:04.441 INFO:tasks.workunit.client.1.smithi155.stdout:2/710: write d2/dd/de/fc7 [696535,61578] 0 2024-09-13T21:45:04.443 INFO:tasks.workunit.client.1.smithi155.stdout:9/899: dread dc/de/ff [8388608,4194304] 0 2024-09-13T21:45:04.445 INFO:tasks.workunit.client.1.smithi155.stdout:9/900: creat dc/d18/d1e/dcc/f13a x:0 0 0 2024-09-13T21:45:04.447 INFO:tasks.workunit.client.1.smithi155.stdout:9/901: creat dc/de/d6f/dae/de1/d38/d90/f13b x:0 0 0 2024-09-13T21:45:04.454 INFO:tasks.workunit.client.1.smithi155.stdout:2/711: dread d2/db/f1d [0,4194304] 0 2024-09-13T21:45:04.455 INFO:tasks.workunit.client.1.smithi155.stdout:2/712: fdatasync f0 0 2024-09-13T21:45:04.460 INFO:tasks.workunit.client.1.smithi155.stdout:2/713: write d2/db/f4b [4063024,62011] 0 2024-09-13T21:45:04.461 INFO:tasks.workunit.client.1.smithi155.stdout:2/714: chown d2/dd/d21/d39/f48 40 1 2024-09-13T21:45:04.461 INFO:tasks.workunit.client.1.smithi155.stdout:2/715: chown d2/dd/de/d15/f64 44870 1 2024-09-13T21:45:04.464 INFO:tasks.workunit.client.1.smithi155.stdout:2/716: symlink d2/dd/d21/dc6/dd6/deb/l103 0 2024-09-13T21:45:04.508 INFO:tasks.workunit.client.1.smithi155.stdout:0/895: sync 2024-09-13T21:45:04.511 INFO:tasks.workunit.client.1.smithi155.stdout:0/896: dwrite d1/d6/dc/d4d/d4a/d52/d5c/fcf [0,4194304] 0 2024-09-13T21:45:04.519 INFO:tasks.workunit.client.1.smithi155.stdout:0/897: dwrite d1/d6/f2d [0,4194304] 0 2024-09-13T21:45:04.520 INFO:tasks.workunit.client.1.smithi155.stdout:0/898: fsync d1/d6/d97/f12d 0 2024-09-13T21:45:04.523 INFO:tasks.workunit.client.1.smithi155.stdout:0/899: mkdir d1/d6/d97/d140/d151 0 2024-09-13T21:45:04.676 INFO:tasks.workunit.client.1.smithi155.stdout:7/761: sync 2024-09-13T21:45:04.676 INFO:tasks.workunit.client.1.smithi155.stdout:6/941: sync 2024-09-13T21:45:04.677 INFO:tasks.workunit.client.1.smithi155.stdout:6/942: readlink db/d11/d2b/df6/l11c 0 2024-09-13T21:45:04.678 INFO:tasks.workunit.client.1.smithi155.stdout:7/762: mkdir d5/df/d15/d33/d55/d97/dee 0 2024-09-13T21:45:04.679 INFO:tasks.workunit.client.1.smithi155.stdout:7/763: mkdir d5/d3b/d8e/def 0 2024-09-13T21:45:04.681 INFO:tasks.workunit.client.1.smithi155.stdout:7/764: mkdir d5/da6/dca/df0 0 2024-09-13T21:45:04.682 INFO:tasks.workunit.client.1.smithi155.stdout:7/765: symlink d5/df/d60/lf1 0 2024-09-13T21:45:04.683 INFO:tasks.workunit.client.1.smithi155.stdout:7/766: mknod d5/df/dad/cf2 0 2024-09-13T21:45:04.685 INFO:tasks.workunit.client.1.smithi155.stdout:7/767: creat d5/d10/d48/ff3 x:0 0 0 2024-09-13T21:45:04.685 INFO:tasks.workunit.client.1.smithi155.stdout:7/768: chown d5/df/d15/d33/cc4 10 1 2024-09-13T21:45:04.688 INFO:tasks.workunit.client.1.smithi155.stdout:7/769: dread d5/d10/d3e/d3f/f9a [0,4194304] 0 2024-09-13T21:45:04.695 INFO:tasks.workunit.client.1.smithi155.stdout:7/770: rename d5/d10/d48 to d5/df/d15/d33/d55/d97/dc8/df4 0 2024-09-13T21:45:04.696 INFO:tasks.workunit.client.1.smithi155.stdout:7/771: mknod d5/d3b/d8e/cf5 0 2024-09-13T21:45:04.697 INFO:tasks.workunit.client.1.smithi155.stdout:7/772: readlink d5/df/d15/d33/d43/lb5 0 2024-09-13T21:45:04.699 INFO:tasks.workunit.client.1.smithi155.stdout:7/773: dread d5/df/d15/d33/d55/f9b [4194304,4194304] 0 2024-09-13T21:45:04.710 INFO:tasks.workunit.client.1.smithi155.stdout:7/774: dread d5/df/d15/f53 [0,4194304] 0 2024-09-13T21:45:04.712 INFO:tasks.workunit.client.1.smithi155.stdout:7/775: mkdir d5/df/d79/df6 0 2024-09-13T21:45:04.713 INFO:tasks.workunit.client.1.smithi155.stdout:7/776: fsync d5/df/f80 0 2024-09-13T21:45:04.716 INFO:tasks.workunit.client.1.smithi155.stdout:7/777: creat d5/da6/dca/df0/ff7 x:0 0 0 2024-09-13T21:45:04.717 INFO:tasks.workunit.client.1.smithi155.stdout:7/778: read - d5/fe2 zero size 2024-09-13T21:45:04.718 INFO:tasks.workunit.client.1.smithi155.stdout:7/779: mknod d5/d10/d3e/d3f/d61/cf8 0 2024-09-13T21:45:04.720 INFO:tasks.workunit.client.1.smithi155.stdout:7/780: unlink d5/df/d15/c68 0 2024-09-13T21:45:04.723 INFO:tasks.workunit.client.1.smithi155.stdout:7/781: dread d5/d10/fae [0,4194304] 0 2024-09-13T21:45:04.723 INFO:tasks.workunit.client.1.smithi155.stdout:7/782: chown d5/d10/d3e/d40/da2 15831458 1 2024-09-13T21:45:04.724 INFO:tasks.workunit.client.1.smithi155.stdout:7/783: write d5/d13/fa4 [2032847,54137] 0 2024-09-13T21:45:04.725 INFO:tasks.workunit.client.1.smithi155.stdout:7/784: write d5/d10/d3e/dd2/fed [562054,70039] 0 2024-09-13T21:45:04.726 INFO:tasks.workunit.client.1.smithi155.stdout:7/785: readlink d5/df/d60/lf1 0 2024-09-13T21:45:04.727 INFO:tasks.workunit.client.1.smithi155.stdout:7/786: write d5/d3b/d8e/fc5 [486837,55585] 0 2024-09-13T21:45:04.729 INFO:tasks.workunit.client.1.smithi155.stdout:7/787: chown d5/d10/d3e/dd2/dd8/ce6 38833123 1 2024-09-13T21:45:04.730 INFO:tasks.workunit.client.1.smithi155.stdout:7/788: read d5/df/d15/d33/d55/fbd [2882525,55925] 0 2024-09-13T21:45:04.734 INFO:tasks.workunit.client.1.smithi155.stdout:7/789: write d5/df/d15/d33/d43/f64 [962888,93297] 0 2024-09-13T21:45:04.736 INFO:tasks.workunit.client.1.smithi155.stdout:7/790: truncate d5/df/f6e 1806967 0 2024-09-13T21:45:04.744 INFO:tasks.workunit.client.1.smithi155.stdout:7/791: dwrite d5/df/f4f [0,4194304] 0 2024-09-13T21:45:04.747 INFO:tasks.workunit.client.1.smithi155.stdout:7/792: mkdir d5/df/d15/df9 0 2024-09-13T21:45:04.749 INFO:tasks.workunit.client.1.smithi155.stdout:7/793: mknod d5/d10/d3e/cfa 0 2024-09-13T21:45:04.751 INFO:tasks.workunit.client.1.smithi155.stdout:7/794: mkdir d5/da6/dfb 0 2024-09-13T21:45:04.752 INFO:tasks.workunit.client.1.smithi155.stdout:7/795: chown d5/d13/c17 23965 1 2024-09-13T21:45:04.753 INFO:tasks.workunit.client.1.smithi155.stdout:7/796: dread - d5/df/fde zero size 2024-09-13T21:45:04.755 INFO:tasks.workunit.client.1.smithi155.stdout:7/797: symlink d5/d13/d5f/lfc 0 2024-09-13T21:45:04.763 INFO:tasks.workunit.client.1.smithi155.stdout:7/798: read d5/d10/f90 [1010911,100944] 0 2024-09-13T21:45:04.763 INFO:tasks.workunit.client.1.smithi155.stdout:7/799: chown d5/df/d15/d33/d43/l65 2039 1 2024-09-13T21:45:04.773 INFO:tasks.workunit.client.1.smithi155.stdout:7/800: dwrite d5/d10/f2a [0,4194304] 0 2024-09-13T21:45:04.775 INFO:tasks.workunit.client.1.smithi155.stdout:7/801: chown d5/df/d15/d33/d43/l65 104303 1 2024-09-13T21:45:04.778 INFO:tasks.workunit.client.1.smithi155.stdout:7/802: fsync d5/df/d15/d33/d43/f64 0 2024-09-13T21:45:04.779 INFO:tasks.workunit.client.1.smithi155.stdout:7/803: truncate d5/d13/f24 1517016 0 2024-09-13T21:45:04.782 INFO:tasks.workunit.client.1.smithi155.stdout:7/804: rmdir d5/df/d79 39 2024-09-13T21:45:04.785 INFO:tasks.workunit.client.1.smithi155.stdout:7/805: creat d5/d10/d3e/d40/da2/ffd x:0 0 0 2024-09-13T21:45:04.788 INFO:tasks.workunit.client.1.smithi155.stdout:7/806: fdatasync d5/d13/f29 0 2024-09-13T21:45:04.790 INFO:tasks.workunit.client.1.smithi155.stdout:7/807: chown d5/df/d15/d33/d55/d97/dc8 1648 1 2024-09-13T21:45:04.792 INFO:tasks.workunit.client.1.smithi155.stdout:7/808: dread d5/d10/d3e/d3f/f9a [0,4194304] 0 2024-09-13T21:45:04.808 INFO:tasks.workunit.client.1.smithi155.stdout:7/809: dwrite d5/d13/f3d [0,4194304] 0 2024-09-13T21:45:04.811 INFO:tasks.workunit.client.1.smithi155.stdout:7/810: readlink d5/da6/dca/ldb 0 2024-09-13T21:45:04.814 INFO:tasks.workunit.client.1.smithi155.stdout:7/811: link d5/cd5 d5/df/d60/d6d/cfe 0 2024-09-13T21:45:04.815 INFO:tasks.workunit.client.1.smithi155.stdout:7/812: write d5/d10/d3e/d3f/f8c [4099346,15251] 0 2024-09-13T21:45:04.819 INFO:tasks.workunit.client.1.smithi155.stdout:7/813: write d5/df/d15/d33/d55/d97/f9e [1241597,121653] 0 2024-09-13T21:45:04.845 INFO:tasks.workunit.client.1.smithi155.stdout:8/712: sync 2024-09-13T21:45:04.848 INFO:tasks.workunit.client.1.smithi155.stdout:8/713: mkdir d2/d2d/d96/dcc/ddd 0 2024-09-13T21:45:04.850 INFO:tasks.workunit.client.1.smithi155.stdout:8/714: write d2/d91/f9f [599336,95501] 0 2024-09-13T21:45:04.861 INFO:tasks.workunit.client.1.smithi155.stdout:7/814: dwrite d5/df/d60/d6d/f93 [0,4194304] 0 2024-09-13T21:45:04.862 INFO:tasks.workunit.client.1.smithi155.stdout:7/815: readlink d5/df/d15/d33/lb6 0 2024-09-13T21:45:04.870 INFO:tasks.workunit.client.1.smithi155.stdout:7/816: dwrite d5/d10/fce [0,4194304] 0 2024-09-13T21:45:04.872 INFO:tasks.workunit.client.1.smithi155.stdout:7/817: stat d5/d13/f14 0 2024-09-13T21:45:04.879 INFO:tasks.workunit.client.1.smithi155.stdout:7/818: dwrite d5/df/f75 [0,4194304] 0 2024-09-13T21:45:04.892 INFO:tasks.workunit.client.1.smithi155.stdout:8/715: dread d2/f5 [0,4194304] 0 2024-09-13T21:45:04.895 INFO:tasks.workunit.client.1.smithi155.stdout:8/716: creat d2/d2d/d96/dcc/fde x:0 0 0 2024-09-13T21:45:04.896 INFO:tasks.workunit.client.1.smithi155.stdout:7/819: dwrite d5/d13/f14 [0,4194304] 0 2024-09-13T21:45:04.897 INFO:tasks.workunit.client.1.smithi155.stdout:8/717: chown d2/d8/d5e/d60/db2/ld8 493581307 1 2024-09-13T21:45:04.899 INFO:tasks.workunit.client.1.smithi155.stdout:8/718: symlink d2/dae/dbe/ldf 0 2024-09-13T21:45:04.900 INFO:tasks.workunit.client.1.smithi155.stdout:7/820: truncate d5/d10/f6a 1559624 0 2024-09-13T21:45:04.909 INFO:tasks.workunit.client.1.smithi155.stdout:7/821: dwrite d5/df/d15/fa8 [0,4194304] 0 2024-09-13T21:45:04.920 INFO:tasks.workunit.client.1.smithi155.stdout:8/719: dread d2/d6/dd/d12/f97 [0,4194304] 0 2024-09-13T21:45:04.921 INFO:tasks.workunit.client.1.smithi155.stdout:8/720: chown d2/d91/cc9 35096 1 2024-09-13T21:45:04.923 INFO:tasks.workunit.client.1.smithi155.stdout:8/721: write d2/d6/f94 [4529034,14194] 0 2024-09-13T21:45:04.926 INFO:tasks.workunit.client.1.smithi155.stdout:8/722: mkdir d2/de0 0 2024-09-13T21:45:04.929 INFO:tasks.workunit.client.1.smithi155.stdout:8/723: link d2/f5 d2/d8/d75/d82/dd6/fe1 0 2024-09-13T21:45:04.939 INFO:tasks.workunit.client.1.smithi155.stdout:8/724: dread d2/d91/f8e [0,4194304] 0 2024-09-13T21:45:04.948 INFO:tasks.workunit.client.1.smithi155.stdout:8/725: write d2/d2d/f6c [853167,69104] 0 2024-09-13T21:45:04.948 INFO:tasks.workunit.client.1.smithi155.stdout:7/822: dread d5/df/d15/d33/d55/d97/dc8/fcb [0,4194304] 0 2024-09-13T21:45:04.953 INFO:tasks.workunit.client.1.smithi155.stdout:7/823: unlink d5/df/d60/c81 0 2024-09-13T21:45:04.953 INFO:tasks.workunit.client.1.smithi155.stdout:8/726: truncate d2/d8/d5e/d60/fda 287645 0 2024-09-13T21:45:04.955 INFO:tasks.workunit.client.1.smithi155.stdout:7/824: write d5/d10/d3e/d40/da2/fc0 [1755451,53471] 0 2024-09-13T21:45:04.958 INFO:tasks.workunit.client.1.smithi155.stdout:5/788: sync 2024-09-13T21:45:04.958 INFO:tasks.workunit.client.1.smithi155.stdout:1/794: sync 2024-09-13T21:45:04.958 INFO:tasks.workunit.client.1.smithi155.stdout:8/727: fsync d2/d6/dd/d12/f73 0 2024-09-13T21:45:04.962 INFO:tasks.workunit.client.1.smithi155.stdout:5/789: creat d5/d16/d33/d1b/d59/f100 x:0 0 0 2024-09-13T21:45:04.963 INFO:tasks.workunit.client.1.smithi155.stdout:1/795: mknod d6/d15/d23/d55/dfd/c108 0 2024-09-13T21:45:04.964 INFO:tasks.workunit.client.1.smithi155.stdout:7/825: dwrite d5/d13/fa4 [0,4194304] 0 2024-09-13T21:45:04.965 INFO:tasks.workunit.client.1.smithi155.stdout:1/796: fdatasync d6/d82/fbc 0 2024-09-13T21:45:04.966 INFO:tasks.workunit.client.1.smithi155.stdout:7/826: write d5/df/d15/fa8 [2774282,38808] 0 2024-09-13T21:45:04.968 INFO:tasks.workunit.client.1.smithi155.stdout:1/797: dread - d6/d15/d23/d55/d6e/dbb/fe4 zero size 2024-09-13T21:45:04.973 INFO:tasks.workunit.client.1.smithi155.stdout:5/790: creat d5/d16/d33/d1b/d2f/d3c/d5b/f101 x:0 0 0 2024-09-13T21:45:04.973 INFO:tasks.workunit.client.1.smithi155.stdout:8/728: getdents d2/d8/d65 0 2024-09-13T21:45:04.974 INFO:tasks.workunit.client.1.smithi155.stdout:7/827: creat d5/df/d15/d33/d55/d97/dc8/df4/fff x:0 0 0 2024-09-13T21:45:04.975 INFO:tasks.workunit.client.1.smithi155.stdout:1/798: creat d6/d7/d89/f109 x:0 0 0 2024-09-13T21:45:04.976 INFO:tasks.workunit.client.1.smithi155.stdout:7/828: chown d5/d10/d3e/d40/da2/fc0 0 1 2024-09-13T21:45:04.978 INFO:tasks.workunit.client.1.smithi155.stdout:8/729: creat d2/d8/d65/fe2 x:0 0 0 2024-09-13T21:45:04.979 INFO:tasks.workunit.client.1.smithi155.stdout:1/799: mknod d6/d15/d23/d55/dfd/c10a 0 2024-09-13T21:45:04.981 INFO:tasks.workunit.client.1.smithi155.stdout:8/730: stat d2/d6/fb9 0 2024-09-13T21:45:04.984 INFO:tasks.workunit.client.1.smithi155.stdout:7/829: creat d5/d10/d3e/d3f/d61/dd9/f100 x:0 0 0 2024-09-13T21:45:04.985 INFO:tasks.workunit.client.1.smithi155.stdout:0/900: sync 2024-09-13T21:45:04.985 INFO:tasks.workunit.client.1.smithi155.stdout:6/943: sync 2024-09-13T21:45:04.986 INFO:tasks.workunit.client.1.smithi155.stdout:9/902: sync 2024-09-13T21:45:04.986 INFO:tasks.workunit.client.1.smithi155.stdout:2/717: sync 2024-09-13T21:45:04.986 INFO:tasks.workunit.client.1.smithi155.stdout:4/735: sync 2024-09-13T21:45:04.986 INFO:tasks.workunit.client.1.smithi155.stdout:5/791: dwrite d5/d16/d33/d1b/d92/dca/fdc [0,4194304] 0 2024-09-13T21:45:04.986 INFO:tasks.workunit.client.1.smithi155.stdout:3/945: sync 2024-09-13T21:45:04.995 INFO:tasks.workunit.client.1.smithi155.stdout:6/944: stat db/d11/d6d/db9/d1c/d36/d83/ddd/cea 0 2024-09-13T21:45:04.995 INFO:tasks.workunit.client.1.smithi155.stdout:8/731: creat d2/d6/dd/d12/fe3 x:0 0 0 2024-09-13T21:45:04.996 INFO:tasks.workunit.client.1.smithi155.stdout:0/901: truncate d1/d6/faf 4726481 0 2024-09-13T21:45:05.001 INFO:tasks.workunit.client.1.smithi155.stdout:6/945: write db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/f103 [501608,33787] 0 2024-09-13T21:45:05.009 INFO:tasks.workunit.client.1.smithi155.stdout:5/792: dwrite d5/d16/d33/d1b/d2f/d3c/d44/fcf [0,4194304] 0 2024-09-13T21:45:05.009 INFO:tasks.workunit.client.1.smithi155.stdout:2/718: mkdir d2/dd/de/d15/d38/d41/d5f/d104 0 2024-09-13T21:45:05.014 INFO:tasks.workunit.client.1.smithi155.stdout:3/946: chown d3/d25/d17/d52/c7b 38 1 2024-09-13T21:45:05.014 INFO:tasks.workunit.client.1.smithi155.stdout:1/800: dread d6/d82/d90/f6c [4194304,4194304] 0 2024-09-13T21:45:05.014 INFO:tasks.workunit.client.1.smithi155.stdout:6/946: chown db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/db4/dd8 82766 1 2024-09-13T21:45:05.014 INFO:tasks.workunit.client.1.smithi155.stdout:9/903: link dc/de/d6f/dae/df0/f123 dc/de/d6f/d71/f13c 0 2024-09-13T21:45:05.017 INFO:tasks.workunit.client.1.smithi155.stdout:4/736: dwrite d1/d7/d21/d69/fb6 [0,4194304] 0 2024-09-13T21:45:05.019 INFO:tasks.workunit.client.1.smithi155.stdout:7/830: dread d5/d10/f6a [0,4194304] 0 2024-09-13T21:45:05.020 INFO:tasks.workunit.client.1.smithi155.stdout:5/793: creat d5/d16/d33/d1b/d92/f102 x:0 0 0 2024-09-13T21:45:05.022 INFO:tasks.workunit.client.1.smithi155.stdout:6/947: creat db/d11/d2b/df6/f146 x:0 0 0 2024-09-13T21:45:05.025 INFO:tasks.workunit.client.1.smithi155.stdout:3/947: dread d3/d21/f53 [0,4194304] 0 2024-09-13T21:45:05.026 INFO:tasks.workunit.client.1.smithi155.stdout:2/719: mknod d2/dd/d21/d39/dc1/d31/d5d/c105 0 2024-09-13T21:45:05.026 INFO:tasks.workunit.client.1.smithi155.stdout:7/831: chown d5/df/d15/d33/cc4 858712 1 2024-09-13T21:45:05.027 INFO:tasks.workunit.client.1.smithi155.stdout:4/737: readlink d1/d7/de/d15/d55/d5e/d66/d7e/l9e 0 2024-09-13T21:45:05.030 INFO:tasks.workunit.client.1.smithi155.stdout:8/732: write d2/f5 [2181350,94087] 0 2024-09-13T21:45:05.033 INFO:tasks.workunit.client.1.smithi155.stdout:9/904: rename dc/de/l44 to dc/de/d2d/d79/d43/d135/l13d 0 2024-09-13T21:45:05.033 INFO:tasks.workunit.client.1.smithi155.stdout:9/905: chown dc/de/d6f/d71/c132 82 1 2024-09-13T21:45:05.036 INFO:tasks.workunit.client.1.smithi155.stdout:8/733: chown d2/c4 126238 1 2024-09-13T21:45:05.036 INFO:tasks.workunit.client.1.smithi155.stdout:4/738: creat d1/d7/de/dc/fdd x:0 0 0 2024-09-13T21:45:05.037 INFO:tasks.workunit.client.1.smithi155.stdout:8/734: dread - d2/dae/dbe/fd5 zero size 2024-09-13T21:45:05.037 INFO:tasks.workunit.client.1.smithi155.stdout:4/739: chown d1/d48 1978 1 2024-09-13T21:45:05.038 INFO:tasks.workunit.client.1.smithi155.stdout:3/948: mknod d3/d25/d17/c142 0 2024-09-13T21:45:05.039 INFO:tasks.workunit.client.1.smithi155.stdout:1/801: dread d6/d15/f4c [0,4194304] 0 2024-09-13T21:45:05.039 INFO:tasks.workunit.client.1.smithi155.stdout:4/740: fdatasync d1/d7/d5a/fd4 0 2024-09-13T21:45:05.039 INFO:tasks.workunit.client.1.smithi155.stdout:9/906: mkdir dc/d13e 0 2024-09-13T21:45:05.040 INFO:tasks.workunit.client.1.smithi155.stdout:2/720: mkdir d2/dd/d21/d39/dc1/d96/dba/d106 0 2024-09-13T21:45:05.040 INFO:tasks.workunit.client.1.smithi155.stdout:1/802: chown d6/d7/d48/c53 210 1 2024-09-13T21:45:05.044 INFO:tasks.workunit.client.1.smithi155.stdout:4/741: chown d1/d7/de/l6a 325114844 1 2024-09-13T21:45:05.044 INFO:tasks.workunit.client.1.smithi155.stdout:3/949: stat d3/d25/d1b/d1f/d36/d5c/dbc 0 2024-09-13T21:45:05.044 INFO:tasks.workunit.client.1.smithi155.stdout:8/735: rename d2/d8/d5e/d60/c9e to d2/d8/d5e/d60/db2/ce4 0 2024-09-13T21:45:05.045 INFO:tasks.workunit.client.1.smithi155.stdout:5/794: link d5/d16/d33/d1b/d92/l9a d5/d16/db4/l103 0 2024-09-13T21:45:05.046 INFO:tasks.workunit.client.1.smithi155.stdout:3/950: write d3/d25/d1b/d90/fc3 [1159835,129916] 0 2024-09-13T21:45:05.049 INFO:tasks.workunit.client.1.smithi155.stdout:4/742: truncate d1/d7/d83/f9c 4451771 0 2024-09-13T21:45:05.054 INFO:tasks.workunit.client.1.smithi155.stdout:8/736: read d2/d6/dd/fa7 [145256,123423] 0 2024-09-13T21:45:05.065 INFO:tasks.workunit.client.1.smithi155.stdout:3/951: rename d3/d25/d1b/d1f/d82/d83/fbe to d3/d21/d2c/f143 0 2024-09-13T21:45:05.065 INFO:tasks.workunit.client.1.smithi155.stdout:5/795: write d5/d16/d33/d1b/d59/fae [686094,121025] 0 2024-09-13T21:45:05.066 INFO:tasks.workunit.client.1.smithi155.stdout:8/737: creat d2/d1f/d77/fe5 x:0 0 0 2024-09-13T21:45:05.066 INFO:tasks.workunit.client.1.smithi155.stdout:1/803: dwrite d6/d15/d23/d55/d6e/dbb/fe4 [0,4194304] 0 2024-09-13T21:45:05.070 INFO:tasks.workunit.client.1.smithi155.stdout:6/948: dwrite db/d11/d1e/dca/de1/ff2 [0,4194304] 0 2024-09-13T21:45:05.070 INFO:tasks.workunit.client.1.smithi155.stdout:9/907: creat dc/de/d6f/f13f x:0 0 0 2024-09-13T21:45:05.080 INFO:tasks.workunit.client.1.smithi155.stdout:5/796: chown d5/d16/d33/d1b/d2f/d3c/d44/c63 3 1 2024-09-13T21:45:05.080 INFO:tasks.workunit.client.1.smithi155.stdout:7/832: dread d5/d3b/fd3 [4194304,4194304] 0 2024-09-13T21:45:05.081 INFO:tasks.workunit.client.1.smithi155.stdout:4/743: dwrite d1/d7/d21/d69/d98/fa8 [0,4194304] 0 2024-09-13T21:45:05.081 INFO:tasks.workunit.client.1.smithi155.stdout:3/952: symlink d3/d25/d1b/d1f/d82/l144 0 2024-09-13T21:45:05.082 INFO:tasks.workunit.client.1.smithi155.stdout:9/908: write dc/de/d15/fff [975481,9728] 0 2024-09-13T21:45:05.085 INFO:tasks.workunit.client.1.smithi155.stdout:1/804: write d6/d15/d57/d5d/fb1 [1255542,34005] 0 2024-09-13T21:45:05.089 INFO:tasks.workunit.client.1.smithi155.stdout:6/949: chown db/d11/c18 3 1 2024-09-13T21:45:05.090 INFO:tasks.workunit.client.1.smithi155.stdout:6/950: write db/d11/d1e/dca/de1/ff2 [3551763,93273] 0 2024-09-13T21:45:05.091 INFO:tasks.workunit.client.1.smithi155.stdout:4/744: symlink d1/d7/de/dc/d4a/dd1/lde 0 2024-09-13T21:45:05.091 INFO:tasks.workunit.client.1.smithi155.stdout:5/797: write d5/d16/d33/d1b/d92/f102 [444158,58840] 0 2024-09-13T21:45:05.092 INFO:tasks.workunit.client.1.smithi155.stdout:3/953: truncate d3/dbb/fbd 200143 0 2024-09-13T21:45:05.097 INFO:tasks.workunit.client.1.smithi155.stdout:1/805: truncate d6/d15/d23/d55/d6e/dbb/f50 175481 0 2024-09-13T21:45:05.100 INFO:tasks.workunit.client.1.smithi155.stdout:4/745: symlink d1/d7/d21/ldf 0 2024-09-13T21:45:05.100 INFO:tasks.workunit.client.1.smithi155.stdout:5/798: creat d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/dfc/f104 x:0 0 0 2024-09-13T21:45:05.103 INFO:tasks.workunit.client.1.smithi155.stdout:1/806: fdatasync d6/d15/d23/d55/d6e/dbb/d4b/fde 0 2024-09-13T21:45:05.103 INFO:tasks.workunit.client.1.smithi155.stdout:2/721: dread d2/db/f63 [0,4194304] 0 2024-09-13T21:45:05.104 INFO:tasks.workunit.client.1.smithi155.stdout:4/746: symlink d1/d7/de/d1a/le0 0 2024-09-13T21:45:05.105 INFO:tasks.workunit.client.1.smithi155.stdout:6/951: dread db/d11/d6d/db9/d1c/d36/d37/f91 [0,4194304] 0 2024-09-13T21:45:05.107 INFO:tasks.workunit.client.1.smithi155.stdout:2/722: symlink d2/dd/d21/d39/dc1/d96/l107 0 2024-09-13T21:45:05.107 INFO:tasks.workunit.client.1.smithi155.stdout:1/807: creat d6/d15/f10b x:0 0 0 2024-09-13T21:45:05.112 INFO:tasks.workunit.client.1.smithi155.stdout:4/747: rename d1/d7/d21/f2b to d1/d7/de/d15/d55/d5e/d66/dc2/fe1 0 2024-09-13T21:45:05.114 INFO:tasks.workunit.client.1.smithi155.stdout:1/808: symlink d6/d15/d23/d55/d6e/l10c 0 2024-09-13T21:45:05.117 INFO:tasks.workunit.client.1.smithi155.stdout:4/748: rename d1/d7/de/l6a to d1/d7/d21/dc6/le2 0 2024-09-13T21:45:05.122 INFO:tasks.workunit.client.1.smithi155.stdout:8/738: dwrite d2/d6/f1a [0,4194304] 0 2024-09-13T21:45:05.126 INFO:tasks.workunit.client.1.smithi155.stdout:6/952: link db/d11/d6d/db9/d1c/d36/d37/f92 db/d11/d2b/d35/dfc/f147 0 2024-09-13T21:45:05.126 INFO:tasks.workunit.client.1.smithi155.stdout:7/833: dread d5/df/d15/d33/d43/f64 [0,4194304] 0 2024-09-13T21:45:05.127 INFO:tasks.workunit.client.1.smithi155.stdout:4/749: fdatasync d1/d7/de/d15/d55/d5e/d66/dc2/f80 0 2024-09-13T21:45:05.129 INFO:tasks.workunit.client.1.smithi155.stdout:9/909: dwrite dc/de/f10 [0,4194304] 0 2024-09-13T21:45:05.133 INFO:tasks.workunit.client.1.smithi155.stdout:8/739: creat d2/d2d/d96/db0/fe6 x:0 0 0 2024-09-13T21:45:05.134 INFO:tasks.workunit.client.1.smithi155.stdout:1/809: link d6/d15/d23/d55/d6e/c8b d6/d15/d57/d5d/d72/c10d 0 2024-09-13T21:45:05.136 INFO:tasks.workunit.client.1.smithi155.stdout:8/740: stat d2/d2d/d96/db0/lcb 0 2024-09-13T21:45:05.136 INFO:tasks.workunit.client.1.smithi155.stdout:5/799: write d5/d16/d33/d1b/d2f/d3c/d6c/f76 [976160,77684] 0 2024-09-13T21:45:05.136 INFO:tasks.workunit.client.1.smithi155.stdout:7/834: mknod d5/d10/d3e/d40/c101 0 2024-09-13T21:45:05.136 INFO:tasks.workunit.client.1.smithi155.stdout:2/723: write d2/dd/de/d15/d38/f4f [1638336,78171] 0 2024-09-13T21:45:05.139 INFO:tasks.workunit.client.1.smithi155.stdout:4/750: unlink d1/d7/d5a/fbd 0 2024-09-13T21:45:05.144 INFO:tasks.workunit.client.1.smithi155.stdout:8/741: stat d2/d2d/d96/dcc 0 2024-09-13T21:45:05.146 INFO:tasks.workunit.client.1.smithi155.stdout:6/953: dwrite db/d11/d6d/db9/de6/d5f/ff3 [0,4194304] 0 2024-09-13T21:45:05.146 INFO:tasks.workunit.client.1.smithi155.stdout:2/724: rmdir d2/dd/d21/d39/dc1/d66/d6f 39 2024-09-13T21:45:05.149 INFO:tasks.workunit.client.1.smithi155.stdout:5/800: mknod d5/d16/d33/d1b/d2f/d3c/d6c/c105 0 2024-09-13T21:45:05.149 INFO:tasks.workunit.client.1.smithi155.stdout:9/910: dread dc/de/d6f/fd8 [0,4194304] 0 2024-09-13T21:45:05.152 INFO:tasks.workunit.client.1.smithi155.stdout:5/801: write d5/d16/d33/fc9 [1888521,111528] 0 2024-09-13T21:45:05.153 INFO:tasks.workunit.client.1.smithi155.stdout:8/742: mkdir d2/d6/dd/de7 0 2024-09-13T21:45:05.156 INFO:tasks.workunit.client.1.smithi155.stdout:1/810: mkdir d6/d15/d57/d99/d10e 0 2024-09-13T21:45:05.157 INFO:tasks.workunit.client.1.smithi155.stdout:7/835: creat d5/da6/dfb/f102 x:0 0 0 2024-09-13T21:45:05.159 INFO:tasks.workunit.client.1.smithi155.stdout:9/911: mknod dc/de/d6f/da3/c140 0 2024-09-13T21:45:05.161 INFO:tasks.workunit.client.1.smithi155.stdout:4/751: mkdir d1/d7/de/d15/d55/de3 0 2024-09-13T21:45:05.162 INFO:tasks.workunit.client.1.smithi155.stdout:1/811: mkdir d6/d82/d91/d10f 0 2024-09-13T21:45:05.163 INFO:tasks.workunit.client.1.smithi155.stdout:4/752: chown d1/d7/de 7 1 2024-09-13T21:45:05.164 INFO:tasks.workunit.client.1.smithi155.stdout:1/812: write d6/d15/f4e [9036537,109622] 0 2024-09-13T21:45:05.167 INFO:tasks.workunit.client.1.smithi155.stdout:5/802: dwrite d5/d16/d33/d1b/d92/fe1 [0,4194304] 0 2024-09-13T21:45:05.179 INFO:tasks.workunit.client.1.smithi155.stdout:9/912: dread dc/de/d6f/d71/fb8 [0,4194304] 0 2024-09-13T21:45:05.179 INFO:tasks.workunit.client.1.smithi155.stdout:7/836: rename d5/d13/lc9 to d5/df/d60/l103 0 2024-09-13T21:45:05.182 INFO:tasks.workunit.client.1.smithi155.stdout:7/837: fdatasync d5/df/d15/d33/d55/d97/dc8/df4/fdc 0 2024-09-13T21:45:05.182 INFO:tasks.workunit.client.1.smithi155.stdout:4/753: creat d1/d7/de/d15/d55/de3/fe4 x:0 0 0 2024-09-13T21:45:05.183 INFO:tasks.workunit.client.1.smithi155.stdout:7/838: fsync d5/df/f11 0 2024-09-13T21:45:05.185 INFO:tasks.workunit.client.1.smithi155.stdout:1/813: creat d6/d7/f110 x:0 0 0 2024-09-13T21:45:05.188 INFO:tasks.workunit.client.1.smithi155.stdout:5/803: rmdir d5/d16/d33/d1b/d59/dd1/ddb/df4 0 2024-09-13T21:45:05.189 INFO:tasks.workunit.client.1.smithi155.stdout:2/725: dwrite d2/dd/de/d15/d38/d41/fb2 [0,4194304] 0 2024-09-13T21:45:05.190 INFO:tasks.workunit.client.1.smithi155.stdout:6/954: dread db/d11/d6d/db9/de6/f116 [0,4194304] 0 2024-09-13T21:45:05.191 INFO:tasks.workunit.client.1.smithi155.stdout:2/726: chown d2/dd/d21/d39/dc1/d96/lcd 0 1 2024-09-13T21:45:05.191 INFO:tasks.workunit.client.1.smithi155.stdout:7/839: creat d5/da6/f104 x:0 0 0 2024-09-13T21:45:05.192 INFO:tasks.workunit.client.1.smithi155.stdout:1/814: mknod d6/d82/d90/c111 0 2024-09-13T21:45:05.196 INFO:tasks.workunit.client.1.smithi155.stdout:4/754: creat d1/d7/de/d15/fe5 x:0 0 0 2024-09-13T21:45:05.197 INFO:tasks.workunit.client.1.smithi155.stdout:7/840: write d5/d13/d99/fcf [589205,51515] 0 2024-09-13T21:45:05.199 INFO:tasks.workunit.client.1.smithi155.stdout:8/743: truncate d2/d8/d65/f56 482189 0 2024-09-13T21:45:05.200 INFO:tasks.workunit.client.1.smithi155.stdout:7/841: readlink d5/df/l2b 0 2024-09-13T21:45:05.201 INFO:tasks.workunit.client.1.smithi155.stdout:8/744: dread - d2/d8/d5e/d60/fcd zero size 2024-09-13T21:45:05.203 INFO:tasks.workunit.client.1.smithi155.stdout:6/955: mkdir db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d148 0 2024-09-13T21:45:05.204 INFO:tasks.workunit.client.1.smithi155.stdout:6/956: chown db/d2c/l4e 7081763 1 2024-09-13T21:45:05.209 INFO:tasks.workunit.client.1.smithi155.stdout:4/755: symlink d1/d7/de/d15/dce/dd8/le6 0 2024-09-13T21:45:05.213 INFO:tasks.workunit.client.1.smithi155.stdout:7/842: mknod d5/df/d15/d33/c105 0 2024-09-13T21:45:05.214 INFO:tasks.workunit.client.1.smithi155.stdout:5/804: getdents d5/d16/d33/d1b 0 2024-09-13T21:45:05.214 INFO:tasks.workunit.client.1.smithi155.stdout:4/756: mknod d1/d7/ce7 0 2024-09-13T21:45:05.215 INFO:tasks.workunit.client.1.smithi155.stdout:2/727: dwrite d2/dd/de/f9a [0,4194304] 0 2024-09-13T21:45:05.219 INFO:tasks.workunit.client.1.smithi155.stdout:7/843: mknod d5/df/d15/d33/d55/c106 0 2024-09-13T21:45:05.220 INFO:tasks.workunit.client.1.smithi155.stdout:2/728: truncate d2/dd/d21/d39/dc1/dc3/fd8 630931 0 2024-09-13T21:45:05.227 INFO:tasks.workunit.client.1.smithi155.stdout:1/815: dwrite d6/d15/d23/d55/d6e/dbb/f5b [0,4194304] 0 2024-09-13T21:45:05.230 INFO:tasks.workunit.client.1.smithi155.stdout:2/729: truncate d2/dd/d21/d39/d84/fa4 234800 0 2024-09-13T21:45:05.231 INFO:tasks.workunit.client.1.smithi155.stdout:7/844: write d5/d10/d3e/d40/f70 [886009,43748] 0 2024-09-13T21:45:05.231 INFO:tasks.workunit.client.1.smithi155.stdout:1/816: unlink d6/d7/d48/c52 0 2024-09-13T21:45:05.234 INFO:tasks.workunit.client.1.smithi155.stdout:6/957: dread db/d11/d1e/d11b/f101 [0,4194304] 0 2024-09-13T21:45:05.235 INFO:tasks.workunit.client.1.smithi155.stdout:1/817: chown d6/d15/d23/d87/f9a 3 1 2024-09-13T21:45:05.236 INFO:tasks.workunit.client.1.smithi155.stdout:7/845: mknod d5/da6/dca/c107 0 2024-09-13T21:45:05.238 INFO:tasks.workunit.client.1.smithi155.stdout:4/757: dwrite d1/d7/de/d15/f5b [4194304,4194304] 0 2024-09-13T21:45:05.239 INFO:tasks.workunit.client.1.smithi155.stdout:6/958: write db/d2c/f59 [654855,25288] 0 2024-09-13T21:45:05.240 INFO:tasks.workunit.client.1.smithi155.stdout:2/730: getdents d2/dd/de/d15/d38/d41/d5f/d70 0 2024-09-13T21:45:05.241 INFO:tasks.workunit.client.1.smithi155.stdout:7/846: chown d5/d10/c41 19928324 1 2024-09-13T21:45:05.248 INFO:tasks.workunit.client.1.smithi155.stdout:6/959: symlink db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/d8b/db4/l149 0 2024-09-13T21:45:05.249 INFO:tasks.workunit.client.1.smithi155.stdout:1/818: dwrite d6/d7/f24 [0,4194304] 0 2024-09-13T21:45:05.251 INFO:tasks.workunit.client.1.smithi155.stdout:4/758: rename d1/d7/de/d15/f2c to d1/d7/d21/dc6/ddb/fe8 0 2024-09-13T21:45:05.255 INFO:tasks.workunit.client.1.smithi155.stdout:4/759: readlink d1/d7/de/d72/da6/la9 0 2024-09-13T21:45:05.258 INFO:tasks.workunit.client.1.smithi155.stdout:4/760: stat d1/d7/d21/d69/d98 0 2024-09-13T21:45:05.261 INFO:tasks.workunit.client.1.smithi155.stdout:5/805: dread d5/d16/d33/d1b/d2f/d3c/d5b/f67 [4194304,4194304] 0 2024-09-13T21:45:05.261 INFO:tasks.workunit.client.1.smithi155.stdout:6/960: dread db/d11/d6d/db9/de6/d5f/ff3 [0,4194304] 0 2024-09-13T21:45:05.263 INFO:tasks.workunit.client.1.smithi155.stdout:4/761: mknod d1/d7/de/d15/dce/dd8/ce9 0 2024-09-13T21:45:05.263 INFO:tasks.workunit.client.1.smithi155.stdout:1/819: dwrite d6/d15/d23/d55/d6e/dbb/f9d [0,4194304] 0 2024-09-13T21:45:05.265 INFO:tasks.workunit.client.1.smithi155.stdout:6/961: chown db/d11/d5b/c7d 12222 1 2024-09-13T21:45:05.267 INFO:tasks.workunit.client.1.smithi155.stdout:5/806: stat d5/d16/d4e/d85/fa2 0 2024-09-13T21:45:05.268 INFO:tasks.workunit.client.1.smithi155.stdout:4/762: creat d1/d7/d21/d69/fea x:0 0 0 2024-09-13T21:45:05.271 INFO:tasks.workunit.client.1.smithi155.stdout:6/962: mknod db/d11/d6d/c14a 0 2024-09-13T21:45:05.272 INFO:tasks.workunit.client.1.smithi155.stdout:2/731: dwrite d2/dd/d21/d39/dc1/d66/f78 [0,4194304] 0 2024-09-13T21:45:05.278 INFO:tasks.workunit.client.1.smithi155.stdout:4/763: rename d1/d7/de/d15/d55/f84 to d1/d7/d21/dc6/feb 0 2024-09-13T21:45:05.279 INFO:tasks.workunit.client.1.smithi155.stdout:1/820: link d6/d15/la8 d6/d15/d57/d99/l112 0 2024-09-13T21:45:05.279 INFO:tasks.workunit.client.1.smithi155.stdout:1/821: fdatasync d6/d7/d89/dd6/fff 0 2024-09-13T21:45:05.282 INFO:tasks.workunit.client.1.smithi155.stdout:2/732: write d2/f69 [499681,70563] 0 2024-09-13T21:45:05.283 INFO:tasks.workunit.client.1.smithi155.stdout:4/764: stat d1/d7/d21/dc6/le2 0 2024-09-13T21:45:05.286 INFO:tasks.workunit.client.1.smithi155.stdout:2/733: symlink d2/dd/de/d15/d38/l108 0 2024-09-13T21:45:05.287 INFO:tasks.workunit.client.1.smithi155.stdout:5/807: dwrite d5/d16/d33/d1b/d2f/d3c/f62 [4194304,4194304] 0 2024-09-13T21:45:05.294 INFO:tasks.workunit.client.1.smithi155.stdout:5/808: symlink d5/d16/d81/d98/d84/de7/l106 0 2024-09-13T21:45:05.297 INFO:tasks.workunit.client.1.smithi155.stdout:2/734: getdents d2/dd/d21/d39/dc1/d66/de9 0 2024-09-13T21:45:05.299 INFO:tasks.workunit.client.1.smithi155.stdout:6/963: dwrite db/d11/d6d/db9/d1c/d36/f3c [0,4194304] 0 2024-09-13T21:45:05.299 INFO:tasks.workunit.client.1.smithi155.stdout:1/822: dwrite d6/d82/d91/daf/f9b [4194304,4194304] 0 2024-09-13T21:45:05.305 INFO:tasks.workunit.client.1.smithi155.stdout:2/735: creat d2/dd/d21/d39/d84/f109 x:0 0 0 2024-09-13T21:45:05.306 INFO:tasks.workunit.client.1.smithi155.stdout:6/964: dread - db/d11/d5b/f78 zero size 2024-09-13T21:45:05.307 INFO:tasks.workunit.client.1.smithi155.stdout:1/823: mknod d6/d15/d57/d99/d10e/c113 0 2024-09-13T21:45:05.308 INFO:tasks.workunit.client.1.smithi155.stdout:4/765: dwrite d1/f6 [0,4194304] 0 2024-09-13T21:45:05.308 INFO:tasks.workunit.client.1.smithi155.stdout:2/736: stat d2/dd/d21/d39/dc1/d31/d5d 0 2024-09-13T21:45:05.309 INFO:tasks.workunit.client.1.smithi155.stdout:1/824: fsync d6/d7/f24 0 2024-09-13T21:45:05.311 INFO:tasks.workunit.client.1.smithi155.stdout:4/766: readlink d1/d7/de/dc/d4a/dd1/lde 0 2024-09-13T21:45:05.311 INFO:tasks.workunit.client.1.smithi155.stdout:6/965: stat db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d88/ca4 0 2024-09-13T21:45:05.312 INFO:tasks.workunit.client.1.smithi155.stdout:2/737: fsync d2/dd/d21/d39/dc1/d66/d7c/fb4 0 2024-09-13T21:45:05.320 INFO:tasks.workunit.client.1.smithi155.stdout:5/809: dwrite d5/d16/d81/d98/d84/fe2 [0,4194304] 0 2024-09-13T21:45:05.321 INFO:tasks.workunit.client.1.smithi155.stdout:4/767: dread d1/d7/d21/d69/d98/fa8 [0,4194304] 0 2024-09-13T21:45:05.322 INFO:tasks.workunit.client.1.smithi155.stdout:5/810: chown d5/d16/d33/lce 134011 1 2024-09-13T21:45:05.404 INFO:tasks.workunit.client.1.smithi155.stdout:4/768: fdatasync d1/d7/d21/dc6/ddb/fe8 0 2024-09-13T21:45:05.405 INFO:tasks.workunit.client.1.smithi155.stdout:5/811: symlink d5/d16/d33/d1b/d59/dd1/ddb/l107 0 2024-09-13T21:45:05.410 INFO:tasks.workunit.client.1.smithi155.stdout:2/738: dwrite d2/dd/de/d15/f2d [0,4194304] 0 2024-09-13T21:45:05.410 INFO:tasks.workunit.client.1.smithi155.stdout:2/739: stat d2/dd/dd3 0 2024-09-13T21:45:05.471 INFO:tasks.workunit.client.1.smithi155.stdout:6/966: getdents db/d11/d6d/db9/d1c/d36/d37/db7 0 2024-09-13T21:45:05.473 INFO:tasks.workunit.client.1.smithi155.stdout:2/740: creat d2/dd/d21/d39/dc1/f10a x:0 0 0 2024-09-13T21:45:05.475 INFO:tasks.workunit.client.1.smithi155.stdout:5/812: mkdir d5/d16/d33/d1b/d2f/d3c/d5b/d5f/daf/d108 0 2024-09-13T21:45:05.475 INFO:tasks.workunit.client.1.smithi155.stdout:6/967: rmdir db/d11/d1e/d21/d44/daa 39 2024-09-13T21:45:05.477 INFO:tasks.workunit.client.1.smithi155.stdout:4/769: creat d1/d7/d21/fec x:0 0 0 2024-09-13T21:45:05.478 INFO:tasks.workunit.client.1.smithi155.stdout:4/770: write d1/d7/de/d15/d55/d5e/d66/f6c [4761745,31062] 0 2024-09-13T21:45:05.480 INFO:tasks.workunit.client.1.smithi155.stdout:5/813: unlink d5/d16/d81/d98/d84/fe2 0 2024-09-13T21:45:05.481 INFO:tasks.workunit.client.1.smithi155.stdout:6/968: mknod db/d11/d6d/db9/de6/d5f/c14b 0 2024-09-13T21:45:05.484 INFO:tasks.workunit.client.1.smithi155.stdout:4/771: write d1/d48/f95 [87418,23203] 0 2024-09-13T21:45:05.485 INFO:tasks.workunit.client.1.smithi155.stdout:4/772: stat d1/d7/de/d72/lba 0 2024-09-13T21:45:05.486 INFO:tasks.workunit.client.1.smithi155.stdout:6/969: mknod db/d11/c14c 0 2024-09-13T21:45:05.487 INFO:tasks.workunit.client.1.smithi155.stdout:4/773: rmdir d1/d7/d21/dc6 39 2024-09-13T21:45:05.488 INFO:tasks.workunit.client.1.smithi155.stdout:6/970: truncate db/d11/d1e/d21/d44/f10b 734651 0 2024-09-13T21:45:05.490 INFO:tasks.workunit.client.1.smithi155.stdout:6/971: readlink db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/l125 0 2024-09-13T21:45:05.490 INFO:tasks.workunit.client.1.smithi155.stdout:4/774: creat d1/d7/d83/fed x:0 0 0 2024-09-13T21:45:05.491 INFO:tasks.workunit.client.1.smithi155.stdout:4/775: fsync d1/d7/d21/f57 0 2024-09-13T21:45:05.492 INFO:tasks.workunit.client.1.smithi155.stdout:6/972: chown db/d11/d1e/f2e 600 1 2024-09-13T21:45:05.492 INFO:tasks.workunit.client.1.smithi155.stdout:4/776: dread - d1/d7/de/dc/fdd zero size 2024-09-13T21:45:05.493 INFO:tasks.workunit.client.1.smithi155.stdout:6/973: write db/d11/d6d/db9/f17 [13480462,7003] 0 2024-09-13T21:45:05.498 INFO:tasks.workunit.client.1.smithi155.stdout:4/777: rename d1/d7/de/d15/d55/d5e/d66/la0 to d1/d7/lee 0 2024-09-13T21:45:05.500 INFO:tasks.workunit.client.1.smithi155.stdout:4/778: dread d1/d7/f9a [0,4194304] 0 2024-09-13T21:45:05.501 INFO:tasks.workunit.client.1.smithi155.stdout:6/974: link db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/d93/fa2 db/d11/d2b/f14d 0 2024-09-13T21:45:05.502 INFO:tasks.workunit.client.1.smithi155.stdout:6/975: write db/d2c/f59 [1821269,74583] 0 2024-09-13T21:45:05.504 INFO:tasks.workunit.client.1.smithi155.stdout:6/976: rmdir db/d2c/dbc 39 2024-09-13T21:45:05.505 INFO:tasks.workunit.client.1.smithi155.stdout:6/977: write db/f124 [13451,8871] 0 2024-09-13T21:45:05.505 INFO:tasks.workunit.client.1.smithi155.stdout:4/779: creat d1/d7/d21/d69/fef x:0 0 0 2024-09-13T21:45:05.509 INFO:tasks.workunit.client.1.smithi155.stdout:4/780: mkdir d1/d7/de/d15/dce/dd8/df0 0 2024-09-13T21:45:05.513 INFO:tasks.workunit.client.1.smithi155.stdout:4/781: creat d1/d7/de/d15/ff1 x:0 0 0 2024-09-13T21:45:05.514 INFO:tasks.workunit.client.1.smithi155.stdout:6/978: dwrite db/d11/d6d/db9/de6/d5f/de4/f133 [4194304,4194304] 0 2024-09-13T21:45:05.518 INFO:tasks.workunit.client.1.smithi155.stdout:6/979: creat db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/f14e x:0 0 0 2024-09-13T21:45:05.521 INFO:tasks.workunit.client.1.smithi155.stdout:2/741: dwrite f0 [0,4194304] 0 2024-09-13T21:45:05.523 INFO:tasks.workunit.client.1.smithi155.stdout:4/782: unlink d1/d7/d83/f9c 0 2024-09-13T21:45:05.523 INFO:tasks.workunit.client.1.smithi155.stdout:6/980: rmdir db/d2c/dc0 39 2024-09-13T21:45:05.529 INFO:tasks.workunit.client.1.smithi155.stdout:2/742: creat d2/dd/d21/d8d/da0/de3/f10b x:0 0 0 2024-09-13T21:45:05.530 INFO:tasks.workunit.client.1.smithi155.stdout:4/783: mkdir d1/d7/de/d15/d55/d5e/df2 0 2024-09-13T21:45:05.531 INFO:tasks.workunit.client.1.smithi155.stdout:5/814: dwrite d5/d16/d33/d1f/f20 [0,4194304] 0 2024-09-13T21:45:05.532 INFO:tasks.workunit.client.1.smithi155.stdout:6/981: mknod db/d11/d6d/db9/d1c/d36/d83/ddd/d64/c14f 0 2024-09-13T21:45:05.536 INFO:tasks.workunit.client.1.smithi155.stdout:2/743: dread d2/dd/f72 [0,4194304] 0 2024-09-13T21:45:05.538 INFO:tasks.workunit.client.1.smithi155.stdout:5/815: creat d5/d16/d33/d1b/d1e/da1/f109 x:0 0 0 2024-09-13T21:45:05.540 INFO:tasks.workunit.client.1.smithi155.stdout:4/784: creat d1/d7/ff3 x:0 0 0 2024-09-13T21:45:05.631 INFO:tasks.workunit.client.1.smithi155.stdout:0/902: sync 2024-09-13T21:45:05.637 INFO:tasks.workunit.client.1.smithi155.stdout:6/982: rmdir db/d2c/d13e 0 2024-09-13T21:45:05.639 INFO:tasks.workunit.client.1.smithi155.stdout:4/785: chown d1/d7/de/d1a/ld9 6640298 1 2024-09-13T21:45:05.645 INFO:tasks.workunit.client.1.smithi155.stdout:2/744: dwrite d2/dd/de/d15/d38/d41/fb6 [0,4194304] 0 2024-09-13T21:45:05.647 INFO:tasks.workunit.client.1.smithi155.stdout:6/983: link db/d2c/f79 db/d11/d6d/db9/d1c/d36/d83/ddd/d64/f150 0 2024-09-13T21:45:05.648 INFO:tasks.workunit.client.1.smithi155.stdout:4/786: getdents d1/d7/de/d72 0 2024-09-13T21:45:05.651 INFO:tasks.workunit.client.1.smithi155.stdout:2/745: mknod d2/dd/d21/d8d/da0/de3/c10c 0 2024-09-13T21:45:05.652 INFO:tasks.workunit.client.1.smithi155.stdout:0/903: dwrite d1/d6/dc/d4d/d4a/d52/d5c/f5d [4194304,4194304] 0 2024-09-13T21:45:05.654 INFO:tasks.workunit.client.1.smithi155.stdout:5/816: dread d5/d16/d33/d1b/d2f/d3c/d6c/f35 [0,4194304] 0 2024-09-13T21:45:05.654 INFO:tasks.workunit.client.1.smithi155.stdout:6/984: write db/d11/d6d/db9/d1c/d36/d83/ddd/d64/f77 [5046948,92495] 0 2024-09-13T21:45:05.655 INFO:tasks.workunit.client.1.smithi155.stdout:4/787: creat d1/d7/de/d15/dce/dd8/df0/ff4 x:0 0 0 2024-09-13T21:45:05.656 INFO:tasks.workunit.client.1.smithi155.stdout:2/746: mknod d2/dd/de/d15/d38/d41/c10d 0 2024-09-13T21:45:05.657 INFO:tasks.workunit.client.1.smithi155.stdout:0/904: mknod d1/d6/dc/d4d/d105/c152 0 2024-09-13T21:45:05.659 INFO:tasks.workunit.client.1.smithi155.stdout:6/985: rmdir db/d11/d6d/db9/d1c/d36 39 2024-09-13T21:45:05.662 INFO:tasks.workunit.client.1.smithi155.stdout:2/747: mkdir d2/dd/d37/d10e 0 2024-09-13T21:45:05.663 INFO:tasks.workunit.client.1.smithi155.stdout:4/788: rename d1/cc1 to d1/d7/de/d72/cf5 0 2024-09-13T21:45:05.663 INFO:tasks.workunit.client.1.smithi155.stdout:4/789: chown d1 94585 1 2024-09-13T21:45:05.663 INFO:tasks.workunit.client.1.smithi155.stdout:2/748: readlink d2/dd/d21/d39/dc1/d31/d5d/l98 0 2024-09-13T21:45:05.663 INFO:tasks.workunit.client.1.smithi155.stdout:5/817: creat d5/d16/d33/d1b/d59/dd1/f10a x:0 0 0 2024-09-13T21:45:05.664 INFO:tasks.workunit.client.1.smithi155.stdout:6/986: symlink db/d11/d1e/dca/l151 0 2024-09-13T21:45:05.666 INFO:tasks.workunit.client.1.smithi155.stdout:4/790: chown d1/d7/de/d15/f71 148 1 2024-09-13T21:45:05.666 INFO:tasks.workunit.client.1.smithi155.stdout:2/749: write d2/dd/d21/d39/dc1/dc3/fd8 [1235900,31432] 0 2024-09-13T21:45:05.666 INFO:tasks.workunit.client.1.smithi155.stdout:5/818: chown d5/d16/d33/d1b/d2f/d3c/f7f 1243624 1 2024-09-13T21:45:05.669 INFO:tasks.workunit.client.1.smithi155.stdout:0/905: getdents d1/d6/dc/d4d/d4a/d52/da5 0 2024-09-13T21:45:05.669 INFO:tasks.workunit.client.1.smithi155.stdout:2/750: rmdir d2/dd/d21/dc6 39 2024-09-13T21:45:05.670 INFO:tasks.workunit.client.1.smithi155.stdout:0/906: chown d1/d6/dc/d4d/d4a/dbe 28752 1 2024-09-13T21:45:05.670 INFO:tasks.workunit.client.1.smithi155.stdout:4/791: truncate d1/d48/fbb 101778 0 2024-09-13T21:45:05.672 INFO:tasks.workunit.client.1.smithi155.stdout:6/987: symlink db/d11/d6d/db9/d1c/d36/d37/l152 0 2024-09-13T21:45:05.673 INFO:tasks.workunit.client.1.smithi155.stdout:4/792: write d1/d7/d21/d69/fbe [1025257,25012] 0 2024-09-13T21:45:05.676 INFO:tasks.workunit.client.1.smithi155.stdout:6/988: truncate db/d11/d6d/db9/d1c/f12c 1036598 0 2024-09-13T21:45:05.678 INFO:tasks.workunit.client.1.smithi155.stdout:4/793: creat d1/d7/d21/dc6/ddb/ff6 x:0 0 0 2024-09-13T21:45:05.678 INFO:tasks.workunit.client.1.smithi155.stdout:0/907: truncate d1/d6/dc/d4d/d4a/d52/d5c/d6a/fa9 1108981 0 2024-09-13T21:45:05.684 INFO:tasks.workunit.client.1.smithi155.stdout:6/989: mknod db/d2c/dbc/dc2/c153 0 2024-09-13T21:45:05.690 INFO:tasks.workunit.client.1.smithi155.stdout:6/990: symlink db/d11/d1e/d21/l154 0 2024-09-13T21:45:05.692 INFO:tasks.workunit.client.1.smithi155.stdout:5/819: dwrite d5/d16/d33/d1b/d59/f8a [0,4194304] 0 2024-09-13T21:45:05.696 INFO:tasks.workunit.client.1.smithi155.stdout:0/908: dread d1/d6/dc/faa [0,4194304] 0 2024-09-13T21:45:05.697 INFO:tasks.workunit.client.1.smithi155.stdout:2/751: dwrite d2/f92 [0,4194304] 0 2024-09-13T21:45:05.700 INFO:tasks.workunit.client.1.smithi155.stdout:4/794: dwrite d1/d7/de/d15/d55/d5e/d66/dc2/f80 [0,4194304] 0 2024-09-13T21:45:05.700 INFO:tasks.workunit.client.1.smithi155.stdout:5/820: chown d5/d16/d33/d1b/d92/fe1 16123 1 2024-09-13T21:45:05.706 INFO:tasks.workunit.client.1.smithi155.stdout:5/821: mknod d5/d16/d33/d1b/d2f/d3c/d6c/c10b 0 2024-09-13T21:45:05.708 INFO:tasks.workunit.client.1.smithi155.stdout:0/909: truncate d1/d6/dc/f13b 6208312 0 2024-09-13T21:45:05.709 INFO:tasks.workunit.client.1.smithi155.stdout:6/991: getdents db/d11/d6d/db9/d1c/d36/d83/ddd/d7c 0 2024-09-13T21:45:05.711 INFO:tasks.workunit.client.1.smithi155.stdout:5/822: creat d5/d16/d33/d1b/d59/f10c x:0 0 0 2024-09-13T21:45:05.714 INFO:tasks.workunit.client.1.smithi155.stdout:6/992: mknod db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/c155 0 2024-09-13T21:45:05.716 INFO:tasks.workunit.client.1.smithi155.stdout:6/993: mknod db/d11/d6d/db9/de6/d5f/d67/c156 0 2024-09-13T21:45:05.717 INFO:tasks.workunit.client.1.smithi155.stdout:0/910: dwrite d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/d82/f11e [0,4194304] 0 2024-09-13T21:45:05.788 INFO:tasks.workunit.client.1.smithi155.stdout:6/994: fsync db/d11/d1e/d21/d44/f4b 0 2024-09-13T21:45:05.789 INFO:tasks.workunit.client.1.smithi155.stdout:2/752: write d2/dd/d37/d4e/fad [3629250,110307] 0 2024-09-13T21:45:05.791 INFO:tasks.workunit.client.1.smithi155.stdout:0/911: rmdir d1/d6/d97/db2/db5 39 2024-09-13T21:45:05.792 INFO:tasks.workunit.client.1.smithi155.stdout:6/995: dread - db/d11/d86/f11d zero size 2024-09-13T21:45:05.800 INFO:tasks.workunit.client.1.smithi155.stdout:4/795: dread d1/d7/de/d15/f71 [0,4194304] 0 2024-09-13T21:45:05.801 INFO:tasks.workunit.client.1.smithi155.stdout:6/996: rename db/d11/d6d/db9/d1c/d36/lf8 to db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/d107/l157 0 2024-09-13T21:45:05.801 INFO:tasks.workunit.client.1.smithi155.stdout:0/912: dwrite d1/d6/dc/d4d/d4a/d4e/d61/fd3 [0,4194304] 0 2024-09-13T21:45:05.803 INFO:tasks.workunit.client.1.smithi155.stdout:2/753: truncate d2/dd/de/d15/d38/d41/fb2 2775930 0 2024-09-13T21:45:05.804 INFO:tasks.workunit.client.1.smithi155.stdout:0/913: chown d1/d6/dc/d4d/d4a/cc7 327638992 1 2024-09-13T21:45:05.806 INFO:tasks.workunit.client.1.smithi155.stdout:0/914: stat d1/d6/dc/f10 0 2024-09-13T21:45:05.806 INFO:tasks.workunit.client.1.smithi155.stdout:2/754: chown d2/dd/d37/f67 4456722 1 2024-09-13T21:45:05.807 INFO:tasks.workunit.client.1.smithi155.stdout:6/997: creat db/d11/d2b/df6/f158 x:0 0 0 2024-09-13T21:45:05.807 INFO:tasks.workunit.client.1.smithi155.stdout:4/796: truncate d1/d7/de/d15/d55/d5e/d66/dc2/f80 5008251 0 2024-09-13T21:45:05.809 INFO:tasks.workunit.client.1.smithi155.stdout:0/915: symlink d1/l153 0 2024-09-13T21:45:05.812 INFO:tasks.workunit.client.1.smithi155.stdout:2/755: rename d2/db/d6b/c93 to d2/dd/d21/d8d/da0/de3/c10f 0 2024-09-13T21:45:05.812 INFO:tasks.workunit.client.1.smithi155.stdout:6/998: read db/d11/d6d/db9/d1c/d36/d83/ddd/d64/d5e/fae [5736825,84807] 0 2024-09-13T21:45:05.813 INFO:tasks.workunit.client.1.smithi155.stdout:4/797: mkdir d1/d7/d83/df7 0 2024-09-13T21:45:05.815 INFO:tasks.workunit.client.1.smithi155.stdout:2/756: dread - d2/dd/d21/d39/dc1/dc3/ff6 zero size 2024-09-13T21:45:05.815 INFO:tasks.workunit.client.1.smithi155.stdout:6/999: fsync db/d11/d6d/db9/d1c/d36/d83/ddd/d7c/db0/dee/dda/f11e 0 2024-09-13T21:45:05.821 INFO:tasks.workunit.client.1.smithi155.stdout:4/798: write d1/d7/de/dc/d4a/f38 [1032457,57359] 0 2024-09-13T21:45:05.822 INFO:tasks.workunit.client.1.smithi155.stdout:2/757: creat d2/dd/d21/d39/dc1/d66/d7c/f110 x:0 0 0 2024-09-13T21:45:05.823 INFO:tasks.workunit.client.1.smithi155.stdout:0/916: link d1/c7f d1/d6/d97/d140/d151/c154 0 2024-09-13T21:45:05.825 INFO:tasks.workunit.client.1.smithi155.stdout:0/917: chown d1/d6/dc/f10 41162183 1 2024-09-13T21:45:05.827 INFO:tasks.workunit.client.1.smithi155.stdout:4/799: rename d1/d7/d83 to d1/d7/d21/d2d/d42/df8 0 2024-09-13T21:45:05.828 INFO:tasks.workunit.client.1.smithi155.stdout:2/758: readlink d2/dd/d37/d4e/def/lff 0 2024-09-13T21:45:05.829 INFO:tasks.workunit.client.1.smithi155.stdout:0/918: symlink d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/l155 0 2024-09-13T21:45:05.831 INFO:tasks.workunit.client.1.smithi155.stdout:0/919: chown d1/d6/dc/d90/ffa 7646 1 2024-09-13T21:45:05.832 INFO:tasks.workunit.client.1.smithi155.stdout:4/800: mknod d1/d7/de/d72/cf9 0 2024-09-13T21:45:05.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:05 smithi155 ceph-mon[34732]: pgmap v17: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 105 MiB/s rd, 256 MiB/s wr, 581 op/s 2024-09-13T21:45:05.834 INFO:tasks.workunit.client.1.smithi155.stdout:0/920: write d1/d6/dc/f11 [5086175,1689] 0 2024-09-13T21:45:05.836 INFO:tasks.workunit.client.1.smithi155.stdout:2/759: dwrite d2/dd/d37/ff4 [0,4194304] 0 2024-09-13T21:45:05.840 INFO:tasks.workunit.client.1.smithi155.stdout:0/921: fdatasync d1/d6/dc/d4d/d4a/d52/da5/f12b 0 2024-09-13T21:45:05.841 INFO:tasks.workunit.client.1.smithi155.stdout:2/760: unlink d2/dd/d37/fc0 0 2024-09-13T21:45:05.844 INFO:tasks.workunit.client.1.smithi155.stdout:4/801: dwrite d1/d7/de/d15/ff1 [0,4194304] 0 2024-09-13T21:45:05.844 INFO:tasks.workunit.client.1.smithi155.stdout:0/922: dread - d1/d6/dc/d4d/d4a/d4e/d61/f131 zero size 2024-09-13T21:45:05.845 INFO:tasks.workunit.client.1.smithi155.stdout:4/802: readlink d1/d7/de/d15/dce/dd8/le6 0 2024-09-13T21:45:05.850 INFO:tasks.workunit.client.1.smithi155.stdout:4/803: mknod d1/d7/de/d15/dce/dd8/df0/cfa 0 2024-09-13T21:45:05.851 INFO:tasks.workunit.client.1.smithi155.stdout:4/804: readlink d1/d7/l65 0 2024-09-13T21:45:05.862 INFO:tasks.workunit.client.1.smithi155.stdout:4/805: truncate d1/f6 1354877 0 2024-09-13T21:45:05.867 INFO:tasks.workunit.client.1.smithi155.stdout:4/806: rename d1/d7/f6b to d1/d7/de/d15/ffb 0 2024-09-13T21:45:05.868 INFO:tasks.workunit.client.1.smithi155.stdout:2/761: dread d2/dd/d21/f32 [4194304,4194304] 0 2024-09-13T21:45:05.868 INFO:tasks.workunit.client.1.smithi155.stdout:4/807: write d1/d7/de/d15/d55/d5e/f5f [5120151,44547] 0 2024-09-13T21:45:05.869 INFO:tasks.workunit.client.1.smithi155.stdout:2/762: write d2/f69 [1162736,7154] 0 2024-09-13T21:45:05.870 INFO:tasks.workunit.client.1.smithi155.stdout:0/923: dread d1/d6/d81/f115 [0,4194304] 0 2024-09-13T21:45:05.871 INFO:tasks.workunit.client.1.smithi155.stdout:4/808: creat d1/d7/de/d1a/ffc x:0 0 0 2024-09-13T21:45:05.871 INFO:tasks.workunit.client.1.smithi155.stdout:0/924: chown d1/d6/dc/d11c 7301000 1 2024-09-13T21:45:05.872 INFO:tasks.workunit.client.1.smithi155.stdout:2/763: mkdir d2/dd/d21/d39/dc1/da3/dea/d111 0 2024-09-13T21:45:05.872 INFO:tasks.workunit.client.1.smithi155.stdout:0/925: readlink d1/d6/d97/db2/l12a 0 2024-09-13T21:45:05.874 INFO:tasks.workunit.client.1.smithi155.stdout:4/809: creat d1/d7/d5a/ffd x:0 0 0 2024-09-13T21:45:05.877 INFO:tasks.workunit.client.1.smithi155.stdout:2/764: creat d2/dd/d21/d39/dc1/d31/f112 x:0 0 0 2024-09-13T21:45:05.877 INFO:tasks.workunit.client.1.smithi155.stdout:4/810: rmdir d1/d7/de/d15/d55/d5e/d66/dc2 39 2024-09-13T21:45:05.879 INFO:tasks.workunit.client.1.smithi155.stdout:4/811: creat d1/d7/d21/d2d/d42/df8/ffe x:0 0 0 2024-09-13T21:45:05.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:05 smithi119 ceph-mon[27653]: pgmap v17: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 105 MiB/s rd, 256 MiB/s wr, 581 op/s 2024-09-13T21:45:05.885 INFO:tasks.workunit.client.1.smithi155.stdout:8/745: sync 2024-09-13T21:45:05.885 INFO:tasks.workunit.client.1.smithi155.stdout:9/913: sync 2024-09-13T21:45:05.886 INFO:tasks.workunit.client.1.smithi155.stdout:3/954: sync 2024-09-13T21:45:05.889 INFO:tasks.workunit.client.1.smithi155.stdout:3/955: mkdir d3/d25/d1b/d90/d145 0 2024-09-13T21:45:05.890 INFO:tasks.workunit.client.1.smithi155.stdout:9/914: write dc/de/d6f/dae/df0/d128/ffe [149287,56297] 0 2024-09-13T21:45:05.891 INFO:tasks.workunit.client.1.smithi155.stdout:2/765: dwrite d2/f53 [0,4194304] 0 2024-09-13T21:45:05.895 INFO:tasks.workunit.client.1.smithi155.stdout:3/956: mknod d3/d25/d1b/d1f/d36/c146 0 2024-09-13T21:45:05.897 INFO:tasks.workunit.client.1.smithi155.stdout:2/766: read d2/f92 [3602904,105167] 0 2024-09-13T21:45:05.899 INFO:tasks.workunit.client.1.smithi155.stdout:0/926: dread d1/d6/dc/d4d/d4a/d52/d5c/fcf [0,4194304] 0 2024-09-13T21:45:05.903 INFO:tasks.workunit.client.1.smithi155.stdout:8/746: dwrite d2/d8/d65/da8/fcf [4194304,4194304] 0 2024-09-13T21:45:05.905 INFO:tasks.workunit.client.1.smithi155.stdout:2/767: getdents d2/dd/d21/d39/dc1/d66/de9 0 2024-09-13T21:45:05.906 INFO:tasks.workunit.client.1.smithi155.stdout:0/927: creat d1/f156 x:0 0 0 2024-09-13T21:45:05.907 INFO:tasks.workunit.client.1.smithi155.stdout:4/812: dread d1/d7/d21/f3a [0,4194304] 0 2024-09-13T21:45:05.908 INFO:tasks.workunit.client.1.smithi155.stdout:8/747: creat d2/dae/fe8 x:0 0 0 2024-09-13T21:45:05.912 INFO:tasks.workunit.client.1.smithi155.stdout:2/768: read d2/dd/d21/d39/dc1/dc3/fd8 [188545,104144] 0 2024-09-13T21:45:05.913 INFO:tasks.workunit.client.1.smithi155.stdout:4/813: creat d1/d7/d21/d69/fff x:0 0 0 2024-09-13T21:45:05.914 INFO:tasks.workunit.client.1.smithi155.stdout:8/748: truncate d2/dae/dbe/fd5 1022487 0 2024-09-13T21:45:05.915 INFO:tasks.workunit.client.1.smithi155.stdout:9/915: dwrite dc/de/d6f/dae/de1/d38/fd5 [0,4194304] 0 2024-09-13T21:45:05.915 INFO:tasks.workunit.client.1.smithi155.stdout:4/814: chown d1/fcd 15 1 2024-09-13T21:45:05.921 INFO:tasks.workunit.client.1.smithi155.stdout:4/815: creat d1/d7/de/d15/dce/dd8/f100 x:0 0 0 2024-09-13T21:45:05.923 INFO:tasks.workunit.client.1.smithi155.stdout:8/749: link d2/d2d/d96/dcc/fde d2/d91/fe9 0 2024-09-13T21:45:05.924 INFO:tasks.workunit.client.1.smithi155.stdout:4/816: truncate d1/d7/de/d1a/fb1 410727 0 2024-09-13T21:45:05.928 INFO:tasks.workunit.client.1.smithi155.stdout:4/817: write d1/d7/d21/d2d/d42/df8/fed [872788,26463] 0 2024-09-13T21:45:05.928 INFO:tasks.workunit.client.1.smithi155.stdout:2/769: dread d2/dd/d21/d39/d84/fa4 [0,4194304] 0 2024-09-13T21:45:05.928 INFO:tasks.workunit.client.1.smithi155.stdout:8/750: creat d2/d6/fea x:0 0 0 2024-09-13T21:45:05.930 INFO:tasks.workunit.client.1.smithi155.stdout:0/928: dread d1/d6/dc/d4d/d4a/d4e/f53 [4194304,4194304] 0 2024-09-13T21:45:05.931 INFO:tasks.workunit.client.1.smithi155.stdout:9/916: dwrite dc/de/d15/f97 [0,4194304] 0 2024-09-13T21:45:05.934 INFO:tasks.workunit.client.1.smithi155.stdout:9/917: write dc/de/d6f/dae/df0/d128/f55 [4159594,114636] 0 2024-09-13T21:45:05.938 INFO:tasks.workunit.client.1.smithi155.stdout:4/818: rename d1/d7/d21/d69/d98/f85 to d1/d48/f101 0 2024-09-13T21:45:05.939 INFO:tasks.workunit.client.1.smithi155.stdout:0/929: chown d1/d6/d97/db2/db5/fca 37946 1 2024-09-13T21:45:05.940 INFO:tasks.workunit.client.1.smithi155.stdout:0/930: chown d1/d6/dc/d4d/d4a/cb6 14140864 1 2024-09-13T21:45:05.941 INFO:tasks.workunit.client.1.smithi155.stdout:9/918: creat dc/de/d6f/f141 x:0 0 0 2024-09-13T21:45:05.943 INFO:tasks.workunit.client.1.smithi155.stdout:4/819: mkdir d1/d7/d21/d2d/d42/d102 0 2024-09-13T21:45:05.946 INFO:tasks.workunit.client.1.smithi155.stdout:9/919: rename dc/de/d6f/dae/de1/d38/le7 to dc/de/d6f/da3/l142 0 2024-09-13T21:45:05.947 INFO:tasks.workunit.client.1.smithi155.stdout:8/751: link d2/d91/l93 d2/d8/d5e/leb 0 2024-09-13T21:45:05.949 INFO:tasks.workunit.client.1.smithi155.stdout:0/931: mkdir d1/d6/dc/d90/d157 0 2024-09-13T21:45:05.950 INFO:tasks.workunit.client.1.smithi155.stdout:8/752: dread - d2/d2d/d96/dcc/fd2 zero size 2024-09-13T21:45:05.950 INFO:tasks.workunit.client.1.smithi155.stdout:9/920: rmdir dc/de/d6f/dae/df0 39 2024-09-13T21:45:05.950 INFO:tasks.workunit.client.1.smithi155.stdout:2/770: dwrite d2/dd/d21/d39/dc1/d31/f9e [0,4194304] 0 2024-09-13T21:45:05.959 INFO:tasks.workunit.client.1.smithi155.stdout:9/921: dwrite dc/de/d6f/fb6 [0,4194304] 0 2024-09-13T21:45:05.960 INFO:tasks.workunit.client.1.smithi155.stdout:4/820: getdents d1/d7/de/d15/d55/d5e 0 2024-09-13T21:45:05.961 INFO:tasks.workunit.client.1.smithi155.stdout:2/771: mkdir d2/dd/d21/d39/dc1/d96/dba/d106/d113 0 2024-09-13T21:45:05.964 INFO:tasks.workunit.client.1.smithi155.stdout:9/922: mkdir dc/de/d2d/d79/d43/d143 0 2024-09-13T21:45:05.966 INFO:tasks.workunit.client.1.smithi155.stdout:4/821: rmdir d1/d7/de/d15/d55/d5e 39 2024-09-13T21:45:05.967 INFO:tasks.workunit.client.1.smithi155.stdout:8/753: link d2/d6/dd/l72 d2/lec 0 2024-09-13T21:45:05.968 INFO:tasks.workunit.client.1.smithi155.stdout:0/932: link d1/d6/faf d1/d6/d97/db2/f158 0 2024-09-13T21:45:05.969 INFO:tasks.workunit.client.1.smithi155.stdout:4/822: symlink d1/d7/de/l103 0 2024-09-13T21:45:05.969 INFO:tasks.workunit.client.1.smithi155.stdout:8/754: stat d2/d6/c42 0 2024-09-13T21:45:05.970 INFO:tasks.workunit.client.1.smithi155.stdout:2/772: getdents d2/dd/d21/d39/dc1/da3/dea/d111 0 2024-09-13T21:45:05.971 INFO:tasks.workunit.client.1.smithi155.stdout:0/933: mkdir d1/d6/dc/d90/d128/d159 0 2024-09-13T21:45:05.973 INFO:tasks.workunit.client.1.smithi155.stdout:4/823: dread d1/f24 [0,4194304] 0 2024-09-13T21:45:05.974 INFO:tasks.workunit.client.1.smithi155.stdout:4/824: chown d1/d7/d21/d2d/d42/df8/ffe 17 1 2024-09-13T21:45:05.975 INFO:tasks.workunit.client.1.smithi155.stdout:9/923: rename dc/de/d2d/d79/f41 to dc/d18/f144 0 2024-09-13T21:45:05.976 INFO:tasks.workunit.client.1.smithi155.stdout:4/825: chown d1/d7/de/d72/cf9 8 1 2024-09-13T21:45:05.976 INFO:tasks.workunit.client.1.smithi155.stdout:8/755: creat d2/d8/d75/d82/dd6/fed x:0 0 0 2024-09-13T21:45:05.980 INFO:tasks.workunit.client.1.smithi155.stdout:4/826: symlink d1/d7/d21/dc6/ddb/l104 0 2024-09-13T21:45:05.982 INFO:tasks.workunit.client.1.smithi155.stdout:0/934: creat d1/d6/d97/db2/f15a x:0 0 0 2024-09-13T21:45:05.983 INFO:tasks.workunit.client.1.smithi155.stdout:0/935: stat d1/d6/dc/d4d/d4a/d52/d5b 0 2024-09-13T21:45:05.983 INFO:tasks.workunit.client.1.smithi155.stdout:0/936: stat d1/f103 0 2024-09-13T21:45:05.984 INFO:tasks.workunit.client.1.smithi155.stdout:8/756: dread d2/d6/dd/d12/f46 [0,4194304] 0 2024-09-13T21:45:05.984 INFO:tasks.workunit.client.1.smithi155.stdout:9/924: creat dc/de/d6f/dae/de1/d38/f145 x:0 0 0 2024-09-13T21:45:05.987 INFO:tasks.workunit.client.1.smithi155.stdout:4/827: truncate d1/d7/f58 2672044 0 2024-09-13T21:45:05.988 INFO:tasks.workunit.client.1.smithi155.stdout:8/757: rmdir d2/d6/dd/d12 39 2024-09-13T21:45:05.991 INFO:tasks.workunit.client.1.smithi155.stdout:2/773: dwrite d2/dd/d37/d4e/f73 [0,4194304] 0 2024-09-13T21:45:05.995 INFO:tasks.workunit.client.1.smithi155.stdout:4/828: unlink d1/d7/de/d72/f50 0 2024-09-13T21:45:05.998 INFO:tasks.workunit.client.1.smithi155.stdout:8/758: mknod d2/d8/d75/d82/dd6/cee 0 2024-09-13T21:45:05.999 INFO:tasks.workunit.client.1.smithi155.stdout:9/925: dwrite dc/de/d2d/d79/d43/f12b [0,4194304] 0 2024-09-13T21:45:06.002 INFO:tasks.workunit.client.1.smithi155.stdout:2/774: read - d2/dd/d21/d39/dc1/f9b zero size 2024-09-13T21:45:06.002 INFO:tasks.workunit.client.1.smithi155.stdout:4/829: stat d1/d7/de/d15/d55/d5e/d66/fdc 0 2024-09-13T21:45:06.004 INFO:tasks.workunit.client.1.smithi155.stdout:8/759: mkdir d2/def 0 2024-09-13T21:45:06.005 INFO:tasks.workunit.client.1.smithi155.stdout:4/830: creat d1/d7/de/d15/d55/de3/f105 x:0 0 0 2024-09-13T21:45:06.006 INFO:tasks.workunit.client.1.smithi155.stdout:2/775: creat d2/dd/de/d15/d38/d41/d5f/d70/dfa/f114 x:0 0 0 2024-09-13T21:45:06.008 INFO:tasks.workunit.client.1.smithi155.stdout:9/926: creat dc/d18/f146 x:0 0 0 2024-09-13T21:45:06.010 INFO:tasks.workunit.client.1.smithi155.stdout:8/760: symlink d2/d8/lf0 0 2024-09-13T21:45:06.011 INFO:tasks.workunit.client.1.smithi155.stdout:8/761: write d2/f5 [1423991,22788] 0 2024-09-13T21:45:06.011 INFO:tasks.workunit.client.1.smithi155.stdout:0/937: dread d1/d6/dc/d4d/d4a/d52/da5/f12b [0,4194304] 0 2024-09-13T21:45:06.011 INFO:tasks.workunit.client.1.smithi155.stdout:4/831: unlink d1/d7/de/d1a/fb1 0 2024-09-13T21:45:06.014 INFO:tasks.workunit.client.1.smithi155.stdout:8/762: symlink d2/d1f/lf1 0 2024-09-13T21:45:06.015 INFO:tasks.workunit.client.1.smithi155.stdout:4/832: write d1/d7/de/dc/d4a/fda [5179272,119506] 0 2024-09-13T21:45:06.016 INFO:tasks.workunit.client.1.smithi155.stdout:4/833: readlink d1/l61 0 2024-09-13T21:45:06.016 INFO:tasks.workunit.client.1.smithi155.stdout:8/763: write d2/d8/d65/fe2 [174966,15043] 0 2024-09-13T21:45:06.018 INFO:tasks.workunit.client.1.smithi155.stdout:4/834: readlink d1/d7/de/d72/lbc 0 2024-09-13T21:45:06.019 INFO:tasks.workunit.client.1.smithi155.stdout:8/764: stat d2/l45 0 2024-09-13T21:45:06.019 INFO:tasks.workunit.client.1.smithi155.stdout:2/776: dread d2/dd/d3d/f7f [0,4194304] 0 2024-09-13T21:45:06.020 INFO:tasks.workunit.client.1.smithi155.stdout:0/938: dread d1/d6/f13 [0,4194304] 0 2024-09-13T21:45:06.022 INFO:tasks.workunit.client.1.smithi155.stdout:2/777: chown d2/dd/d21/d39/dc1/da3/cac 7 1 2024-09-13T21:45:06.024 INFO:tasks.workunit.client.1.smithi155.stdout:4/835: rename d1/d7/d21/d69/d98/f90 to d1/d7/de/d15/dce/dd8/f106 0 2024-09-13T21:45:06.026 INFO:tasks.workunit.client.1.smithi155.stdout:9/927: write dc/d18/d1e/f64 [4461693,31587] 0 2024-09-13T21:45:06.026 INFO:tasks.workunit.client.1.smithi155.stdout:8/765: truncate d2/d6/dd/d12/f21 975529 0 2024-09-13T21:45:06.027 INFO:tasks.workunit.client.1.smithi155.stdout:0/939: creat d1/d6/dc/d4d/f15b x:0 0 0 2024-09-13T21:45:06.029 INFO:tasks.workunit.client.1.smithi155.stdout:2/778: creat d2/dd/dd3/f115 x:0 0 0 2024-09-13T21:45:06.030 INFO:tasks.workunit.client.1.smithi155.stdout:9/928: mknod dc/de/d6f/c147 0 2024-09-13T21:45:06.032 INFO:tasks.workunit.client.1.smithi155.stdout:4/836: fsync d1/d7/f30 0 2024-09-13T21:45:06.032 INFO:tasks.workunit.client.1.smithi155.stdout:2/779: fsync d2/dd/d21/d39/dc1/f3e 0 2024-09-13T21:45:06.036 INFO:tasks.workunit.client.1.smithi155.stdout:9/929: dread dc/de/d2d/d79/fed [0,4194304] 0 2024-09-13T21:45:06.036 INFO:tasks.workunit.client.1.smithi155.stdout:8/766: dwrite d2/d6/dd/d25/f85 [0,4194304] 0 2024-09-13T21:45:06.037 INFO:tasks.workunit.client.1.smithi155.stdout:8/767: fdatasync d2/dae/dbe/fd5 0 2024-09-13T21:45:06.040 INFO:tasks.workunit.client.1.smithi155.stdout:2/780: write d2/dd/d21/f32 [1428996,113063] 0 2024-09-13T21:45:06.043 INFO:tasks.workunit.client.1.smithi155.stdout:8/768: creat d2/d6/dd/d12/ff2 x:0 0 0 2024-09-13T21:45:06.044 INFO:tasks.workunit.client.1.smithi155.stdout:8/769: chown d2/de0 30 1 2024-09-13T21:45:06.044 INFO:tasks.workunit.client.1.smithi155.stdout:4/837: mknod d1/d7/d21/c107 0 2024-09-13T21:45:06.046 INFO:tasks.workunit.client.1.smithi155.stdout:0/940: rename d1/d6/dc/d4d/d4a/d9e/lb4 to d1/d6/dc/d4d/d4a/d52/d5c/l15c 0 2024-09-13T21:45:06.046 INFO:tasks.workunit.client.1.smithi155.stdout:0/941: write d1/fc2 [1962556,82192] 0 2024-09-13T21:45:06.046 INFO:tasks.workunit.client.1.smithi155.stdout:9/930: mkdir dc/de/d148 0 2024-09-13T21:45:06.048 INFO:tasks.workunit.client.1.smithi155.stdout:4/838: symlink d1/d7/d21/d2d/d42/l108 0 2024-09-13T21:45:06.049 INFO:tasks.workunit.client.1.smithi155.stdout:9/931: chown dc/de/d6f/dae/ddb/ca9 16 1 2024-09-13T21:45:06.050 INFO:tasks.workunit.client.1.smithi155.stdout:0/942: fdatasync d1/d6/dc/d4d/d4a/dbe/fd5 0 2024-09-13T21:45:06.050 INFO:tasks.workunit.client.1.smithi155.stdout:4/839: readlink d1/d7/de/dc/d4a/dd1/lde 0 2024-09-13T21:45:06.051 INFO:tasks.workunit.client.1.smithi155.stdout:2/781: creat d2/dd/de/f116 x:0 0 0 2024-09-13T21:45:06.052 INFO:tasks.workunit.client.1.smithi155.stdout:9/932: stat dc/de/d6f/dae/df0 0 2024-09-13T21:45:06.052 INFO:tasks.workunit.client.1.smithi155.stdout:1/825: sync 2024-09-13T21:45:06.052 INFO:tasks.workunit.client.1.smithi155.stdout:7/847: sync 2024-09-13T21:45:06.052 INFO:tasks.workunit.client.1.smithi155.stdout:8/770: truncate d2/d6/dd/d12/f1e 417863 0 2024-09-13T21:45:06.055 INFO:tasks.workunit.client.1.smithi155.stdout:4/840: symlink d1/d7/de/d15/d55/d5e/d66/d7e/l109 0 2024-09-13T21:45:06.056 INFO:tasks.workunit.client.1.smithi155.stdout:9/933: mkdir dc/de/d5c/d149 0 2024-09-13T21:45:06.058 INFO:tasks.workunit.client.1.smithi155.stdout:2/782: symlink d2/dd/d21/d39/dc1/da3/l117 0 2024-09-13T21:45:06.061 INFO:tasks.workunit.client.1.smithi155.stdout:7/848: rename d5/d10/dbf/lc2 to d5/d10/da7/l108 0 2024-09-13T21:45:06.062 INFO:tasks.workunit.client.1.smithi155.stdout:4/841: fsync d1/d7/f30 0 2024-09-13T21:45:06.063 INFO:tasks.workunit.client.1.smithi155.stdout:9/934: dwrite dc/de/d6f/dae/de1/f4a [0,4194304] 0 2024-09-13T21:45:06.065 INFO:tasks.workunit.client.1.smithi155.stdout:7/849: chown d5/df/d15/d33/d55/d97/dc8/df4/ff3 0 1 2024-09-13T21:45:06.065 INFO:tasks.workunit.client.1.smithi155.stdout:2/783: fdatasync d2/dd/d37/d4e/f87 0 2024-09-13T21:45:06.066 INFO:tasks.workunit.client.1.smithi155.stdout:7/850: chown f3 89726 1 2024-09-13T21:45:06.067 INFO:tasks.workunit.client.1.smithi155.stdout:8/771: creat d2/d6/dd/de7/ff3 x:0 0 0 2024-09-13T21:45:06.068 INFO:tasks.workunit.client.1.smithi155.stdout:2/784: write d2/dd/d21/d39/dc1/d31/d5d/fec [100361,24292] 0 2024-09-13T21:45:06.070 INFO:tasks.workunit.client.1.smithi155.stdout:2/785: readlink d2/dd/d21/d39/dc1/l35 0 2024-09-13T21:45:06.072 INFO:tasks.workunit.client.1.smithi155.stdout:8/772: mkdir d2/d2d/d96/dcc/df4 0 2024-09-13T21:45:06.075 INFO:tasks.workunit.client.1.smithi155.stdout:4/842: rename d1/d7/ca3 to d1/d7/de/dc/d4a/dd1/c10a 0 2024-09-13T21:45:06.078 INFO:tasks.workunit.client.1.smithi155.stdout:0/943: getdents d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0 0 2024-09-13T21:45:06.079 INFO:tasks.workunit.client.1.smithi155.stdout:7/851: symlink d5/df/d15/d33/l109 0 2024-09-13T21:45:06.081 INFO:tasks.workunit.client.1.smithi155.stdout:4/843: mkdir d1/d7/de/d15/dce/d10b 0 2024-09-13T21:45:06.082 INFO:tasks.workunit.client.1.smithi155.stdout:9/935: link dc/de/d6f/da3/c140 dc/de/d6f/dae/df0/c14a 0 2024-09-13T21:45:06.088 INFO:tasks.workunit.client.1.smithi155.stdout:2/786: rename d2/dd/d21/d39/dc1/d66/d6f/c9f to d2/dd/d21/dc6/dd6/c118 0 2024-09-13T21:45:06.089 INFO:tasks.workunit.client.1.smithi155.stdout:0/944: link d1/d6/dc/f7a d1/d6/dc/d4d/d4a/d52/da5/d13d/f15d 0 2024-09-13T21:45:06.090 INFO:tasks.workunit.client.1.smithi155.stdout:0/945: write d1/d6/dc/d8c/f145 [940023,9381] 0 2024-09-13T21:45:06.091 INFO:tasks.workunit.client.1.smithi155.stdout:9/936: truncate dc/de/d6f/dae/de1/d38/fb1 921038 0 2024-09-13T21:45:06.095 INFO:tasks.workunit.client.1.smithi155.stdout:2/787: rename d2/dd/d21/d39/d84/fa4 to d2/dd/de/d15/d3f/de2/f119 0 2024-09-13T21:45:06.099 INFO:tasks.workunit.client.1.smithi155.stdout:4/844: getdents d1/d7/de/d15/d55/de3 0 2024-09-13T21:45:06.101 INFO:tasks.workunit.client.1.smithi155.stdout:0/946: creat d1/d6/dc/d4d/d4a/d52/d5c/f15e x:0 0 0 2024-09-13T21:45:06.103 INFO:tasks.workunit.client.1.smithi155.stdout:2/788: mknod d2/dd/d21/d39/dc1/d96/c11a 0 2024-09-13T21:45:06.104 INFO:tasks.workunit.client.1.smithi155.stdout:9/937: dwrite dc/de/d6f/dae/df0/d128/fca [0,4194304] 0 2024-09-13T21:45:06.108 INFO:tasks.workunit.client.1.smithi155.stdout:7/852: dwrite d5/d10/d3e/d3f/d61/f7d [4194304,4194304] 0 2024-09-13T21:45:06.109 INFO:tasks.workunit.client.1.smithi155.stdout:4/845: dread - d1/d7/de/d15/d55/d5e/d66/d7e/fb2 zero size 2024-09-13T21:45:06.109 INFO:tasks.workunit.client.1.smithi155.stdout:8/773: dwrite d2/d6/f6a [4194304,4194304] 0 2024-09-13T21:45:06.114 INFO:tasks.workunit.client.1.smithi155.stdout:9/938: readlink dc/de/d2d/d79/d43/d135/l13d 0 2024-09-13T21:45:06.119 INFO:tasks.workunit.client.1.smithi155.stdout:7/853: fdatasync d5/f30 0 2024-09-13T21:45:06.120 INFO:tasks.workunit.client.1.smithi155.stdout:0/947: rename d1/c96 to d1/d6/dc/d4d/d4a/d52/da5/c15f 0 2024-09-13T21:45:06.122 INFO:tasks.workunit.client.1.smithi155.stdout:4/846: getdents d1/d7/de/dc/d4a 0 2024-09-13T21:45:06.125 INFO:tasks.workunit.client.1.smithi155.stdout:8/774: dwrite d2/d6/dd/f8c [0,4194304] 0 2024-09-13T21:45:06.126 INFO:tasks.workunit.client.1.smithi155.stdout:7/854: mkdir d5/d10/d3e/dd2/dd8/d10a 0 2024-09-13T21:45:06.128 INFO:tasks.workunit.client.1.smithi155.stdout:0/948: mknod d1/d6/d97/db2/db5/c160 0 2024-09-13T21:45:06.128 INFO:tasks.workunit.client.1.smithi155.stdout:7/855: dread - d5/df/d15/fd1 zero size 2024-09-13T21:45:06.130 INFO:tasks.workunit.client.1.smithi155.stdout:7/856: readlink d5/df/d60/d6d/lc6 0 2024-09-13T21:45:06.132 INFO:tasks.workunit.client.1.smithi155.stdout:8/775: rename d2/d1f/lf1 to d2/d8/d5e/lf5 0 2024-09-13T21:45:06.134 INFO:tasks.workunit.client.1.smithi155.stdout:7/857: mknod d5/df/d60/de5/c10b 0 2024-09-13T21:45:06.138 INFO:tasks.workunit.client.1.smithi155.stdout:9/939: dread dc/de/d6f/dae/df0/d128/d67/f10a [0,4194304] 0 2024-09-13T21:45:06.140 INFO:tasks.workunit.client.1.smithi155.stdout:9/940: readlink dc/de/d6f/dae/de1/d38/l80 0 2024-09-13T21:45:06.141 INFO:tasks.workunit.client.1.smithi155.stdout:8/776: dwrite d2/d6/dd/d12/ff2 [0,4194304] 0 2024-09-13T21:45:06.143 INFO:tasks.workunit.client.1.smithi155.stdout:7/858: link d5/df/d15/d33/lb6 d5/d10/d3e/d40/l10c 0 2024-09-13T21:45:06.148 INFO:tasks.workunit.client.1.smithi155.stdout:9/941: truncate dc/de/d6f/dae/de1/d38/d90/f13b 818925 0 2024-09-13T21:45:06.150 INFO:tasks.workunit.client.1.smithi155.stdout:9/942: mkdir dc/de/d5c/d14b 0 2024-09-13T21:45:06.152 INFO:tasks.workunit.client.1.smithi155.stdout:7/859: dwrite d5/d10/d3e/f6b [0,4194304] 0 2024-09-13T21:45:06.152 INFO:tasks.workunit.client.1.smithi155.stdout:8/777: getdents d2/d6/dd/d12 0 2024-09-13T21:45:06.153 INFO:tasks.workunit.client.1.smithi155.stdout:0/949: write d1/d6/d97/f9b [739000,64104] 0 2024-09-13T21:45:06.153 INFO:tasks.workunit.client.1.smithi155.stdout:4/847: truncate d1/d7/d21/d2d/d42/df8/fed 662301 0 2024-09-13T21:45:06.156 INFO:tasks.workunit.client.1.smithi155.stdout:7/860: creat d5/df/dad/f10d x:0 0 0 2024-09-13T21:45:06.157 INFO:tasks.workunit.client.1.smithi155.stdout:8/778: unlink d2/d1f/d77/l8d 0 2024-09-13T21:45:06.159 INFO:tasks.workunit.client.1.smithi155.stdout:7/861: write d5/d3b/f4b [3215116,45075] 0 2024-09-13T21:45:06.161 INFO:tasks.workunit.client.1.smithi155.stdout:4/848: write d1/d7/de/d15/d55/d5e/d66/dc2/fad [4022182,55025] 0 2024-09-13T21:45:06.163 INFO:tasks.workunit.client.1.smithi155.stdout:8/779: mknod d2/d6/dd/cf6 0 2024-09-13T21:45:06.165 INFO:tasks.workunit.client.1.smithi155.stdout:0/950: dwrite d1/d6/f126 [0,4194304] 0 2024-09-13T21:45:06.166 INFO:tasks.workunit.client.1.smithi155.stdout:4/849: fdatasync d1/d7/d21/d2d/d42/f4d 0 2024-09-13T21:45:06.167 INFO:tasks.workunit.client.1.smithi155.stdout:0/951: write d1/d6/f136 [430532,53904] 0 2024-09-13T21:45:06.167 INFO:tasks.workunit.client.1.smithi155.stdout:7/862: rename d5/df/d15/d33/d43/c47 to d5/d3b/c10e 0 2024-09-13T21:45:06.172 INFO:tasks.workunit.client.1.smithi155.stdout:8/780: mknod d2/def/cf7 0 2024-09-13T21:45:06.176 INFO:tasks.workunit.client.1.smithi155.stdout:0/952: mknod d1/d6/dc/d90/c161 0 2024-09-13T21:45:06.177 INFO:tasks.workunit.client.1.smithi155.stdout:4/850: dwrite d1/d7/de/dc/d4a/f38 [4194304,4194304] 0 2024-09-13T21:45:06.179 INFO:tasks.workunit.client.1.smithi155.stdout:4/851: readlink d1/l3e 0 2024-09-13T21:45:06.182 INFO:tasks.workunit.client.1.smithi155.stdout:8/781: creat d2/d6/dd/d25/ff8 x:0 0 0 2024-09-13T21:45:06.182 INFO:tasks.workunit.client.1.smithi155.stdout:7/863: dwrite d5/df/d15/d33/d55/d97/dc8/df4/faf [0,4194304] 0 2024-09-13T21:45:06.185 INFO:tasks.workunit.client.1.smithi155.stdout:0/953: truncate d1/d6/dc/d4d/d4a/d4e/f53 3211286 0 2024-09-13T21:45:06.185 INFO:tasks.workunit.client.1.smithi155.stdout:4/852: creat d1/d7/de/f10c x:0 0 0 2024-09-13T21:45:06.188 INFO:tasks.workunit.client.1.smithi155.stdout:8/782: symlink d2/d8/d5e/d60/db2/lf9 0 2024-09-13T21:45:06.191 INFO:tasks.workunit.client.1.smithi155.stdout:4/853: unlink d1/d7/de/d15/d55/d5e/d66/dc2/c9b 0 2024-09-13T21:45:06.192 INFO:tasks.workunit.client.1.smithi155.stdout:8/783: symlink d2/d2d/d96/db0/lfa 0 2024-09-13T21:45:06.193 INFO:tasks.workunit.client.1.smithi155.stdout:7/864: dwrite d5/f1e [0,4194304] 0 2024-09-13T21:45:06.195 INFO:tasks.workunit.client.1.smithi155.stdout:0/954: unlink d1/c88 0 2024-09-13T21:45:06.197 INFO:tasks.workunit.client.1.smithi155.stdout:4/854: creat d1/d7/d5a/f10d x:0 0 0 2024-09-13T21:45:06.198 INFO:tasks.workunit.client.1.smithi155.stdout:7/865: creat d5/d10/d3e/d3f/d61/dd9/f10f x:0 0 0 2024-09-13T21:45:06.199 INFO:tasks.workunit.client.1.smithi155.stdout:7/866: write d5/df/f85 [1096614,71437] 0 2024-09-13T21:45:06.200 INFO:tasks.workunit.client.1.smithi155.stdout:7/867: fsync d5/d10/f2a 0 2024-09-13T21:45:06.207 INFO:tasks.workunit.client.1.smithi155.stdout:4/855: symlink d1/d7/l10e 0 2024-09-13T21:45:06.209 INFO:tasks.workunit.client.1.smithi155.stdout:4/856: write d1/d7/d5a/fc9 [6970059,107622] 0 2024-09-13T21:45:06.210 INFO:tasks.workunit.client.1.smithi155.stdout:0/955: rmdir d1 39 2024-09-13T21:45:06.213 INFO:tasks.workunit.client.1.smithi155.stdout:4/857: rename d1/d7/d21/d69/fb6 to d1/d7/de/dc/d4a/dd1/f10f 0 2024-09-13T21:45:06.220 INFO:tasks.workunit.client.1.smithi155.stdout:4/858: dwrite d1/d7/de/d15/d55/d5e/d66/dc2/fad [8388608,4194304] 0 2024-09-13T21:45:06.222 INFO:tasks.workunit.client.1.smithi155.stdout:7/868: dread d5/df/d15/f53 [0,4194304] 0 2024-09-13T21:45:06.224 INFO:tasks.workunit.client.1.smithi155.stdout:7/869: truncate d5/df/d60/d6d/f7a 4760142 0 2024-09-13T21:45:06.224 INFO:tasks.workunit.client.1.smithi155.stdout:7/870: chown d5/d13/f14 163021549 1 2024-09-13T21:45:06.229 INFO:tasks.workunit.client.1.smithi155.stdout:7/871: write d5/d10/f90 [2818012,78526] 0 2024-09-13T21:45:06.231 INFO:tasks.workunit.client.1.smithi155.stdout:7/872: write d5/d10/d3e/d3f/f7c [647833,112533] 0 2024-09-13T21:45:06.234 INFO:tasks.workunit.client.1.smithi155.stdout:7/873: creat d5/d10/d3e/d40/f110 x:0 0 0 2024-09-13T21:45:06.235 INFO:tasks.workunit.client.1.smithi155.stdout:4/859: dwrite d1/d48/f51 [0,4194304] 0 2024-09-13T21:45:06.239 INFO:tasks.workunit.client.1.smithi155.stdout:7/874: mkdir d5/da6/dfb/d111 0 2024-09-13T21:45:06.240 INFO:tasks.workunit.client.1.smithi155.stdout:7/875: chown d5/da6/dca/c107 14 1 2024-09-13T21:45:06.241 INFO:tasks.workunit.client.1.smithi155.stdout:7/876: write d5/df/d15/d33/d55/d97/f9e [388402,24982] 0 2024-09-13T21:45:06.242 INFO:tasks.workunit.client.1.smithi155.stdout:4/860: getdents d1/d7/de/d15/dce 0 2024-09-13T21:45:06.243 INFO:tasks.workunit.client.1.smithi155.stdout:4/861: write d1/d7/d5a/ffd [221469,121407] 0 2024-09-13T21:45:06.244 INFO:tasks.workunit.client.1.smithi155.stdout:7/877: mknod d5/df/c112 0 2024-09-13T21:45:06.246 INFO:tasks.workunit.client.1.smithi155.stdout:4/862: unlink d1/d7/de/d15/d55/de3/f105 0 2024-09-13T21:45:06.248 INFO:tasks.workunit.client.1.smithi155.stdout:4/863: creat d1/d7/de/d15/f110 x:0 0 0 2024-09-13T21:45:06.249 INFO:tasks.workunit.client.1.smithi155.stdout:4/864: readlink d1/d7/de/l14 0 2024-09-13T21:45:06.250 INFO:tasks.workunit.client.1.smithi155.stdout:4/865: chown d1/d7/de/d15/d55/d5e/l60 2 1 2024-09-13T21:45:06.250 INFO:tasks.workunit.client.1.smithi155.stdout:7/878: dread d5/d10/fae [0,4194304] 0 2024-09-13T21:45:06.250 INFO:tasks.workunit.client.1.smithi155.stdout:4/866: chown d1/ccf 20040786 1 2024-09-13T21:45:06.251 INFO:tasks.workunit.client.1.smithi155.stdout:7/879: chown d5/d10/d3e/d40/f110 1 1 2024-09-13T21:45:06.252 INFO:tasks.workunit.client.1.smithi155.stdout:4/867: fsync d1/d7/de/dc/d4a/f76 0 2024-09-13T21:45:06.256 INFO:tasks.workunit.client.1.smithi155.stdout:5/823: sync 2024-09-13T21:45:06.257 INFO:tasks.workunit.client.1.smithi155.stdout:3/957: sync 2024-09-13T21:45:06.258 INFO:tasks.workunit.client.1.smithi155.stdout:7/880: dwrite d5/d10/d3e/dd2/fed [0,4194304] 0 2024-09-13T21:45:06.258 INFO:tasks.workunit.client.1.smithi155.stdout:4/868: rename d1/f24 to d1/d7/de/d15/d55/d5e/d66/f111 0 2024-09-13T21:45:06.261 INFO:tasks.workunit.client.1.smithi155.stdout:4/869: stat d1/d7/de/dc/d4a/f76 0 2024-09-13T21:45:06.263 INFO:tasks.workunit.client.1.smithi155.stdout:3/958: creat d3/d25/d1b/d1f/d36/d5c/ddb/f147 x:0 0 0 2024-09-13T21:45:06.267 INFO:tasks.workunit.client.1.smithi155.stdout:5/824: dwrite d5/d16/d81/d98/fc3 [0,4194304] 0 2024-09-13T21:45:06.268 INFO:tasks.workunit.client.1.smithi155.stdout:7/881: dread d5/df/f85 [0,4194304] 0 2024-09-13T21:45:06.271 INFO:tasks.workunit.client.1.smithi155.stdout:4/870: rename d1/d7/caa to d1/d7/de/d15/d55/d5e/d66/dc2/c112 0 2024-09-13T21:45:06.273 INFO:tasks.workunit.client.1.smithi155.stdout:7/882: dread d5/d13/d99/fcf [0,4194304] 0 2024-09-13T21:45:06.274 INFO:tasks.workunit.client.1.smithi155.stdout:3/959: rename d3/d25/d17/d52/fe5 to d3/d21/d4a/dcd/f148 0 2024-09-13T21:45:06.275 INFO:tasks.workunit.client.1.smithi155.stdout:4/871: truncate d1/d7/de/d1a/f68 1263195 0 2024-09-13T21:45:06.277 INFO:tasks.workunit.client.1.smithi155.stdout:4/872: write d1/d48/f99 [2101538,11283] 0 2024-09-13T21:45:06.278 INFO:tasks.workunit.client.1.smithi155.stdout:5/825: rename d5/d16/d33/d1b/d92/dca/fdc to d5/d16/d33/d1b/d2f/d3c/d44/f10d 0 2024-09-13T21:45:06.282 INFO:tasks.workunit.client.1.smithi155.stdout:7/883: dwrite d5/d3b/d8e/fc5 [0,4194304] 0 2024-09-13T21:45:06.283 INFO:tasks.workunit.client.1.smithi155.stdout:7/884: fdatasync d5/fc 0 2024-09-13T21:45:06.284 INFO:tasks.workunit.client.1.smithi155.stdout:5/826: unlink d5/d16/d33/d1b/d59/dd1/ddb/l107 0 2024-09-13T21:45:06.286 INFO:tasks.workunit.client.1.smithi155.stdout:7/885: readlink d5/d13/l2e 0 2024-09-13T21:45:06.288 INFO:tasks.workunit.client.1.smithi155.stdout:4/873: dwrite d1/d7/de/dc/d4a/fda [4194304,4194304] 0 2024-09-13T21:45:06.288 INFO:tasks.workunit.client.1.smithi155.stdout:5/827: chown d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/cab 107464 1 2024-09-13T21:45:06.292 INFO:tasks.workunit.client.1.smithi155.stdout:4/874: write d1/d7/d21/d2d/d42/df8/ffe [870436,71836] 0 2024-09-13T21:45:06.292 INFO:tasks.workunit.client.1.smithi155.stdout:7/886: creat d5/d10/d3e/dd2/f113 x:0 0 0 2024-09-13T21:45:06.292 INFO:tasks.workunit.client.1.smithi155.stdout:5/828: write d5/d16/d33/d1b/d2f/d3c/d44/f2e [139716,33536] 0 2024-09-13T21:45:06.293 INFO:tasks.workunit.client.1.smithi155.stdout:7/887: chown d5/d13 7473 1 2024-09-13T21:45:06.294 INFO:tasks.workunit.client.1.smithi155.stdout:7/888: stat d5/df/d15/f53 0 2024-09-13T21:45:06.296 INFO:tasks.workunit.client.1.smithi155.stdout:4/875: creat d1/d7/de/d15/dce/dd8/f113 x:0 0 0 2024-09-13T21:45:06.298 INFO:tasks.workunit.client.1.smithi155.stdout:5/829: symlink d5/d16/d81/l10e 0 2024-09-13T21:45:06.300 INFO:tasks.workunit.client.1.smithi155.stdout:7/889: rename d5/d13/d5f to d5/da6/dca/d114 0 2024-09-13T21:45:06.303 INFO:tasks.workunit.client.1.smithi155.stdout:4/876: dread d1/d7/d21/d69/fbe [0,4194304] 0 2024-09-13T21:45:06.304 INFO:tasks.workunit.client.1.smithi155.stdout:4/877: fsync d1/f59 0 2024-09-13T21:45:06.304 INFO:tasks.workunit.client.1.smithi155.stdout:4/878: stat d1/f4 0 2024-09-13T21:45:06.306 INFO:tasks.workunit.client.1.smithi155.stdout:4/879: dread - d1/d7/de/d15/dce/dd8/f113 zero size 2024-09-13T21:45:06.308 INFO:tasks.workunit.client.1.smithi155.stdout:7/890: dwrite d5/df/f19 [0,4194304] 0 2024-09-13T21:45:06.310 INFO:tasks.workunit.client.1.smithi155.stdout:4/880: unlink d1/d7/de/d15/dce/dd8/df0/cfa 0 2024-09-13T21:45:06.311 INFO:tasks.workunit.client.1.smithi155.stdout:5/830: truncate d5/d16/d33/d1b/d1e/fe4 959685 0 2024-09-13T21:45:06.312 INFO:tasks.workunit.client.1.smithi155.stdout:7/891: mkdir d5/df/d15/d115 0 2024-09-13T21:45:06.313 INFO:tasks.workunit.client.1.smithi155.stdout:5/831: readlink d5/d16/db4/l103 0 2024-09-13T21:45:06.314 INFO:tasks.workunit.client.1.smithi155.stdout:7/892: write d5/df/d15/d33/d55/d97/dc8/df4/faf [5077244,66168] 0 2024-09-13T21:45:06.316 INFO:tasks.workunit.client.1.smithi155.stdout:5/832: creat d5/d16/d81/df5/f10f x:0 0 0 2024-09-13T21:45:06.317 INFO:tasks.workunit.client.1.smithi155.stdout:7/893: symlink d5/df/d15/d33/d55/d97/dc8/l116 0 2024-09-13T21:45:06.318 INFO:tasks.workunit.client.1.smithi155.stdout:4/881: dread d1/d48/f63 [4194304,4194304] 0 2024-09-13T21:45:06.322 INFO:tasks.workunit.client.1.smithi155.stdout:7/894: creat d5/f117 x:0 0 0 2024-09-13T21:45:06.322 INFO:tasks.workunit.client.1.smithi155.stdout:7/895: stat d5/d13/fa4 0 2024-09-13T21:45:06.323 INFO:tasks.workunit.client.1.smithi155.stdout:5/833: link d5/d16/d81/d98/d84/fc0 d5/d16/d33/d1b/d2f/d3c/def/f110 0 2024-09-13T21:45:06.323 INFO:tasks.workunit.client.1.smithi155.stdout:7/896: chown d5/df/d15/c89 17 1 2024-09-13T21:45:06.324 INFO:tasks.workunit.client.1.smithi155.stdout:4/882: creat d1/f114 x:0 0 0 2024-09-13T21:45:06.325 INFO:tasks.workunit.client.1.smithi155.stdout:4/883: read - d1/fcd zero size 2024-09-13T21:45:06.326 INFO:tasks.workunit.client.1.smithi155.stdout:7/897: rename d5/d10/c41 to d5/da6/c118 0 2024-09-13T21:45:06.330 INFO:tasks.workunit.client.1.smithi155.stdout:7/898: fdatasync d5/df/fd4 0 2024-09-13T21:45:06.331 INFO:tasks.workunit.client.1.smithi155.stdout:4/884: getdents d1/d7/d21/d2d 0 2024-09-13T21:45:06.332 INFO:tasks.workunit.client.1.smithi155.stdout:7/899: read - d5/da6/dca/d114/f6c zero size 2024-09-13T21:45:06.337 INFO:tasks.workunit.client.1.smithi155.stdout:4/885: symlink d1/d7/d21/d2d/d42/d102/l115 0 2024-09-13T21:45:06.337 INFO:tasks.workunit.client.1.smithi155.stdout:5/834: dread d5/d16/d33/d1b/d2f/d3c/d44/f10d [0,4194304] 0 2024-09-13T21:45:06.337 INFO:tasks.workunit.client.1.smithi155.stdout:4/886: fsync d1/d7/de/d15/d55/d5e/d66/fdc 0 2024-09-13T21:45:06.339 INFO:tasks.workunit.client.1.smithi155.stdout:4/887: chown d1/d7/fa1 10850892 1 2024-09-13T21:45:06.340 INFO:tasks.workunit.client.1.smithi155.stdout:4/888: dread - d1/d7/de/d15/d55/d5e/d66/fdc zero size 2024-09-13T21:45:06.353 INFO:tasks.workunit.client.1.smithi155.stdout:4/889: dwrite d1/d7/de/d15/d55/d5e/d66/d7e/fb2 [0,4194304] 0 2024-09-13T21:45:06.353 INFO:tasks.workunit.client.1.smithi155.stdout:4/890: readlink d1/d7/l65 0 2024-09-13T21:45:06.353 INFO:tasks.workunit.client.1.smithi155.stdout:4/891: rmdir d1/d7/de/dc/d4a 39 2024-09-13T21:45:06.353 INFO:tasks.workunit.client.1.smithi155.stdout:4/892: chown d1/d7/de/d15/d55/c89 5116444 1 2024-09-13T21:45:06.355 INFO:tasks.workunit.client.1.smithi155.stdout:7/900: dread d5/df/d15/d33/d55/f87 [0,4194304] 0 2024-09-13T21:45:06.359 INFO:tasks.workunit.client.1.smithi155.stdout:4/893: dread d1/d7/de/d15/d55/f62 [0,4194304] 0 2024-09-13T21:45:06.360 INFO:tasks.workunit.client.1.smithi155.stdout:4/894: dread - d1/d7/d21/dc6/ddb/ff6 zero size 2024-09-13T21:45:06.363 INFO:tasks.workunit.client.1.smithi155.stdout:7/901: truncate d5/df/d79/f92 3326652 0 2024-09-13T21:45:06.365 INFO:tasks.workunit.client.1.smithi155.stdout:4/895: rename d1/d7/d21/d69/fff to d1/d7/de/d15/d55/d5e/d66/f116 0 2024-09-13T21:45:06.367 INFO:tasks.workunit.client.1.smithi155.stdout:7/902: unlink d5/d10/da7/l108 0 2024-09-13T21:45:06.369 INFO:tasks.workunit.client.1.smithi155.stdout:7/903: mkdir d5/df/d79/d119 0 2024-09-13T21:45:06.370 INFO:tasks.workunit.client.1.smithi155.stdout:7/904: chown d5/d10/d3e/d3f/d61/l71 700252 1 2024-09-13T21:45:06.372 INFO:tasks.workunit.client.1.smithi155.stdout:7/905: mkdir d5/df/d15/d33/d55/d97/dee/d11a 0 2024-09-13T21:45:06.373 INFO:tasks.workunit.client.1.smithi155.stdout:7/906: fsync d5/d10/f2a 0 2024-09-13T21:45:06.373 INFO:tasks.workunit.client.1.smithi155.stdout:7/907: readlink d5/df/dad/lb8 0 2024-09-13T21:45:06.374 INFO:tasks.workunit.client.1.smithi155.stdout:7/908: symlink d5/d10/d3e/dd2/dd8/l11b 0 2024-09-13T21:45:06.382 INFO:tasks.workunit.client.1.smithi155.stdout:7/909: chown d5/d10/d3e/d3f/f9a 9 1 2024-09-13T21:45:06.400 INFO:tasks.workunit.client.1.smithi155.stdout:7/910: creat d5/da6/dfb/f11c x:0 0 0 2024-09-13T21:45:06.419 INFO:tasks.workunit.client.1.smithi155.stdout:7/911: write d5/df/d15/f28 [621761,22985] 0 2024-09-13T21:45:06.424 INFO:tasks.workunit.client.1.smithi155.stdout:7/912: truncate d5/d13/fa4 1392916 0 2024-09-13T21:45:06.434 INFO:tasks.workunit.client.1.smithi155.stdout:7/913: dread d5/df/d15/d33/d55/f5e [0,4194304] 0 2024-09-13T21:45:06.442 INFO:tasks.workunit.client.1.smithi155.stdout:7/914: dwrite d5/df/f58 [0,4194304] 0 2024-09-13T21:45:06.473 INFO:tasks.workunit.client.1.smithi155.stdout:1/826: sync 2024-09-13T21:45:06.473 INFO:tasks.workunit.client.1.smithi155.stdout:1/827: chown d6/d15/d23/d55/f60 850 1 2024-09-13T21:45:06.477 INFO:tasks.workunit.client.1.smithi155.stdout:1/828: write d6/d15/d23/d87/fdd [1049159,63432] 0 2024-09-13T21:45:06.478 INFO:tasks.workunit.client.1.smithi155.stdout:1/829: readlink d6/d7/l42 0 2024-09-13T21:45:06.744 INFO:tasks.workunit.client.1.smithi155.stdout:2/789: sync 2024-09-13T21:45:06.745 INFO:tasks.workunit.client.1.smithi155.stdout:2/790: fdatasync d2/dd/d21/d39/dc1/f88 0 2024-09-13T21:45:06.746 INFO:tasks.workunit.client.1.smithi155.stdout:2/791: chown d2/dd/d21/d8d/da0/fa1 395717 1 2024-09-13T21:45:06.747 INFO:tasks.workunit.client.1.smithi155.stdout:2/792: fdatasync d2/dd/de/d15/f64 0 2024-09-13T21:45:06.758 INFO:tasks.workunit.client.1.smithi155.stdout:2/793: dread d2/dd/d21/d39/dc1/f3e [0,4194304] 0 2024-09-13T21:45:06.767 INFO:tasks.workunit.client.1.smithi155.stdout:2/794: dwrite d2/dd/d21/d39/dc1/d96/f99 [0,4194304] 0 2024-09-13T21:45:06.769 INFO:tasks.workunit.client.1.smithi155.stdout:2/795: mkdir d2/dd/de/d15/d3f/de2/d11b 0 2024-09-13T21:45:06.770 INFO:tasks.workunit.client.1.smithi155.stdout:2/796: stat d2/dd/d21/d8d/lf2 0 2024-09-13T21:45:06.771 INFO:tasks.workunit.client.1.smithi155.stdout:2/797: read d2/dd/d21/f32 [4150681,95012] 0 2024-09-13T21:45:06.773 INFO:tasks.workunit.client.1.smithi155.stdout:2/798: truncate d2/dd/d37/d94/fb8 496847 0 2024-09-13T21:45:06.773 INFO:tasks.workunit.client.1.smithi155.stdout:2/799: stat d2/db/d6b/dd9/fe4 0 2024-09-13T21:45:06.774 INFO:tasks.workunit.client.1.smithi155.stdout:2/800: chown d2/dd/d21/d8d/da0/de3/f10b 897571 1 2024-09-13T21:45:06.774 INFO:tasks.workunit.client.1.smithi155.stdout:2/801: write d2/dd/de/f116 [54861,63616] 0 2024-09-13T21:45:06.779 INFO:tasks.workunit.client.1.smithi155.stdout:2/802: link d2/dd/d21/d39/dc1/dc3/lee d2/db/d6b/dd9/l11c 0 2024-09-13T21:45:06.781 INFO:tasks.workunit.client.1.smithi155.stdout:2/803: mkdir d2/dd/d21/d39/dc1/d66/d6f/d11d 0 2024-09-13T21:45:06.800 INFO:tasks.workunit.client.1.smithi155.stdout:2/804: dread d2/db/f1e [0,4194304] 0 2024-09-13T21:45:06.802 INFO:tasks.workunit.client.1.smithi155.stdout:2/805: truncate d2/dd/d21/d39/dc1/d31/d5d/fec 821158 0 2024-09-13T21:45:06.803 INFO:tasks.workunit.client.1.smithi155.stdout:2/806: creat d2/dd/d37/f11e x:0 0 0 2024-09-13T21:45:06.805 INFO:tasks.workunit.client.1.smithi155.stdout:2/807: write d2/db/f1e [5126436,36918] 0 2024-09-13T21:45:06.806 INFO:tasks.workunit.client.1.smithi155.stdout:0/956: sync 2024-09-13T21:45:06.806 INFO:tasks.workunit.client.1.smithi155.stdout:3/960: sync 2024-09-13T21:45:06.806 INFO:tasks.workunit.client.1.smithi155.stdout:7/915: sync 2024-09-13T21:45:06.806 INFO:tasks.workunit.client.1.smithi155.stdout:8/784: sync 2024-09-13T21:45:06.806 INFO:tasks.workunit.client.1.smithi155.stdout:4/896: sync 2024-09-13T21:45:06.806 INFO:tasks.workunit.client.1.smithi155.stdout:5/835: sync 2024-09-13T21:45:06.806 INFO:tasks.workunit.client.1.smithi155.stdout:9/943: sync 2024-09-13T21:45:06.806 INFO:tasks.workunit.client.1.smithi155.stdout:1/830: sync 2024-09-13T21:45:06.808 INFO:tasks.workunit.client.1.smithi155.stdout:2/808: mknod d2/dd/de/d15/d3f/c11f 0 2024-09-13T21:45:06.811 INFO:tasks.workunit.client.1.smithi155.stdout:1/831: creat d6/d7/d89/dd6/f114 x:0 0 0 2024-09-13T21:45:06.813 INFO:tasks.workunit.client.1.smithi155.stdout:7/916: truncate d5/d10/d3e/d3f/d61/dd9/f100 469381 0 2024-09-13T21:45:06.816 INFO:tasks.workunit.client.1.smithi155.stdout:4/897: creat d1/d7/de/d15/dce/d10b/f117 x:0 0 0 2024-09-13T21:45:06.817 INFO:tasks.workunit.client.1.smithi155.stdout:0/957: creat d1/d6/dc/d4d/d133/f162 x:0 0 0 2024-09-13T21:45:06.817 INFO:tasks.workunit.client.1.smithi155.stdout:1/832: truncate d6/d82/fbc 4530286 0 2024-09-13T21:45:06.818 INFO:tasks.workunit.client.1.smithi155.stdout:5/836: dread d5/d16/d81/d98/f4b [0,4194304] 0 2024-09-13T21:45:06.819 INFO:tasks.workunit.client.1.smithi155.stdout:8/785: dwrite d2/d6/dd/d12/f1b [0,4194304] 0 2024-09-13T21:45:06.819 INFO:tasks.workunit.client.1.smithi155.stdout:7/917: chown d5/df/d15/d33/d55/d97/dc8/df4/fff 5582 1 2024-09-13T21:45:06.821 INFO:tasks.workunit.client.1.smithi155.stdout:1/833: rmdir d6/d82/d90 39 2024-09-13T21:45:06.821 INFO:tasks.workunit.client.1.smithi155.stdout:7/918: write d5/d13/f3d [2759144,1507] 0 2024-09-13T21:45:06.823 INFO:tasks.workunit.client.1.smithi155.stdout:7/919: chown d5/d10/d3e/d3f/fa0 3 1 2024-09-13T21:45:06.824 INFO:tasks.workunit.client.1.smithi155.stdout:8/786: truncate d2/d6/dd/d12/fe3 477833 0 2024-09-13T21:45:06.824 INFO:tasks.workunit.client.1.smithi155.stdout:7/920: write d5/d10/fce [4253810,52119] 0 2024-09-13T21:45:06.825 INFO:tasks.workunit.client.1.smithi155.stdout:0/958: rename d1/d6/ce4 to d1/d6/dc/d4d/d4a/d52/da5/d13d/c163 0 2024-09-13T21:45:06.827 INFO:tasks.workunit.client.1.smithi155.stdout:3/961: write d3/d25/d1b/d1f/d36/d5c/d66/f10c [620835,84985] 0 2024-09-13T21:45:06.829 INFO:tasks.workunit.client.1.smithi155.stdout:2/809: write d2/dd/d37/f77 [278668,36593] 0 2024-09-13T21:45:06.834 INFO:tasks.workunit.client.1.smithi155.stdout:3/962: write d3/d25/d17/d3b/f50 [4548474,125195] 0 2024-09-13T21:45:06.838 INFO:tasks.workunit.client.1.smithi155.stdout:8/787: dwrite d2/f5 [0,4194304] 0 2024-09-13T21:45:06.840 INFO:tasks.workunit.client.1.smithi155.stdout:7/921: dwrite d5/d10/fce [4194304,4194304] 0 2024-09-13T21:45:06.840 INFO:tasks.workunit.client.1.smithi155.stdout:2/810: rename d2/f53 to d2/db/f120 0 2024-09-13T21:45:06.843 INFO:tasks.workunit.client.1.smithi155.stdout:9/944: dwrite dc/de/d6f/dae/de1/d38/fd4 [0,4194304] 0 2024-09-13T21:45:06.848 INFO:tasks.workunit.client.1.smithi155.stdout:2/811: truncate d2/dd/d21/d39/dc1/d66/f7b 1262274 0 2024-09-13T21:45:06.853 INFO:tasks.workunit.client.1.smithi155.stdout:3/963: read d3/d25/d1b/d1f/d82/d83/f12f [327299,46472] 0 2024-09-13T21:45:06.853 INFO:tasks.workunit.client.1.smithi155.stdout:8/788: rename d2/d8/d75/d82/ld9 to d2/d8/d75/lfb 0 2024-09-13T21:45:06.853 INFO:tasks.workunit.client.1.smithi155.stdout:9/945: rmdir dc/d18/d50 39 2024-09-13T21:45:06.854 INFO:tasks.workunit.client.1.smithi155.stdout:2/812: unlink d2/dd/d21/d39/f48 0 2024-09-13T21:45:06.854 INFO:tasks.workunit.client.1.smithi155.stdout:7/922: dwrite d5/df/f11 [0,4194304] 0 2024-09-13T21:45:06.855 INFO:tasks.workunit.client.1.smithi155.stdout:9/946: chown dc/de/d15/d10d/d12d 52122191 1 2024-09-13T21:45:06.858 INFO:tasks.workunit.client.1.smithi155.stdout:9/947: dread - dc/de/d6f/dae/de1/d38/d90/f100 zero size 2024-09-13T21:45:06.860 INFO:tasks.workunit.client.1.smithi155.stdout:7/923: mknod d5/dcd/c11d 0 2024-09-13T21:45:06.863 INFO:tasks.workunit.client.1.smithi155.stdout:9/948: write dc/d18/f7a [4716943,111736] 0 2024-09-13T21:45:06.864 INFO:tasks.workunit.client.1.smithi155.stdout:2/813: rename d2/dd/d21/d39/dc1/da3/dea to d2/dd/de/d15/d121 0 2024-09-13T21:45:06.864 INFO:tasks.workunit.client.1.smithi155.stdout:7/924: truncate d5/d10/fae 1216992 0 2024-09-13T21:45:06.865 INFO:tasks.workunit.client.1.smithi155.stdout:3/964: dwrite d3/d25/d1b/d1f/d36/d7c/f109 [0,4194304] 0 2024-09-13T21:45:06.866 INFO:tasks.workunit.client.1.smithi155.stdout:7/925: readlink d5/da6/dca/d114/l77 0 2024-09-13T21:45:06.867 INFO:tasks.workunit.client.1.smithi155.stdout:9/949: readlink dc/d19/lf3 0 2024-09-13T21:45:06.867 INFO:tasks.workunit.client.1.smithi155.stdout:2/814: write d2/db/f1e [3241768,48783] 0 2024-09-13T21:45:06.868 INFO:tasks.workunit.client.1.smithi155.stdout:9/950: dread - dc/de/d2d/f115 zero size 2024-09-13T21:45:06.868 INFO:tasks.workunit.client.1.smithi155.stdout:2/815: chown d2/dd/de6 46621411 1 2024-09-13T21:45:06.869 INFO:tasks.workunit.client.1.smithi155.stdout:7/926: chown d5/df/d15/d33/d55/d97/lbc 0 1 2024-09-13T21:45:06.870 INFO:tasks.workunit.client.1.smithi155.stdout:3/965: creat d3/d25/d1b/d90/f149 x:0 0 0 2024-09-13T21:45:06.873 INFO:tasks.workunit.client.1.smithi155.stdout:3/966: stat d3/d21/d4a/dcd/dd8/f12a 0 2024-09-13T21:45:06.877 INFO:tasks.workunit.client.1.smithi155.stdout:3/967: readlink d3/d25/l18 0 2024-09-13T21:45:06.879 INFO:tasks.workunit.client.1.smithi155.stdout:9/951: creat dc/d18/d1e/f14c x:0 0 0 2024-09-13T21:45:06.880 INFO:tasks.workunit.client.1.smithi155.stdout:3/968: dread - d3/d25/d1b/d1f/d36/d5c/d66/fd7 zero size 2024-09-13T21:45:06.886 INFO:tasks.workunit.client.1.smithi155.stdout:2/816: dwrite d2/db/f25 [0,4194304] 0 2024-09-13T21:45:06.886 INFO:tasks.workunit.client.1.smithi155.stdout:3/969: getdents d3/d25/d1b/d1f/d36/d5c/d66/db3 0 2024-09-13T21:45:06.892 INFO:tasks.workunit.client.1.smithi155.stdout:3/970: chown d3/d21/d4a/dcd/dd8/lfb 956600 1 2024-09-13T21:45:06.893 INFO:tasks.workunit.client.1.smithi155.stdout:9/952: dwrite dc/de/d6f/dae/de1/d38/d90/f100 [0,4194304] 0 2024-09-13T21:45:06.895 INFO:tasks.workunit.client.1.smithi155.stdout:9/953: readlink dc/d18/l76 0 2024-09-13T21:45:06.895 INFO:tasks.workunit.client.1.smithi155.stdout:0/959: write d1/d6/dc/d4d/d4a/d52/f6d [1801012,129571] 0 2024-09-13T21:45:06.896 INFO:tasks.workunit.client.1.smithi155.stdout:3/971: fdatasync d3/d25/fa0 0 2024-09-13T21:45:06.900 INFO:tasks.workunit.client.1.smithi155.stdout:0/960: write d1/d6/dc/d4d/d4a/f8d [11008,103504] 0 2024-09-13T21:45:06.901 INFO:tasks.workunit.client.1.smithi155.stdout:8/789: write d2/d8/d65/f56 [18337,106472] 0 2024-09-13T21:45:06.902 INFO:tasks.workunit.client.1.smithi155.stdout:0/961: stat d1/d6/dc/d4d/d4a/d9e/fbc 0 2024-09-13T21:45:06.904 INFO:tasks.workunit.client.1.smithi155.stdout:8/790: write d2/d6/f6a [3668684,58844] 0 2024-09-13T21:45:06.904 INFO:tasks.workunit.client.1.smithi155.stdout:9/954: rmdir dc/de/d6f/da3/d12e 0 2024-09-13T21:45:06.905 INFO:tasks.workunit.client.1.smithi155.stdout:9/955: chown dc/de/d2d/f115 1279 1 2024-09-13T21:45:06.907 INFO:tasks.workunit.client.1.smithi155.stdout:3/972: rename d3/d21/d4a/f10f to d3/d25/d1b/d1f/d36/d5c/d66/f14a 0 2024-09-13T21:45:06.909 INFO:tasks.workunit.client.1.smithi155.stdout:0/962: creat d1/d6/dc/d90/d157/f164 x:0 0 0 2024-09-13T21:45:06.910 INFO:tasks.workunit.client.1.smithi155.stdout:8/791: creat d2/d8/d75/ffc x:0 0 0 2024-09-13T21:45:06.916 INFO:tasks.workunit.client.1.smithi155.stdout:0/963: write d1/d6/dc/d4d/d4a/d9e/fbc [864758,93123] 0 2024-09-13T21:45:06.918 INFO:tasks.workunit.client.1.smithi155.stdout:9/956: dwrite dc/de/d6f/dae/df0/d128/fca [0,4194304] 0 2024-09-13T21:45:06.924 INFO:tasks.workunit.client.1.smithi155.stdout:7/927: dwrite d5/f50 [0,4194304] 0 2024-09-13T21:45:06.928 INFO:tasks.workunit.client.1.smithi155.stdout:2/817: dwrite d2/db/f40 [0,4194304] 0 2024-09-13T21:45:06.929 INFO:tasks.workunit.client.1.smithi155.stdout:8/792: write d2/d8/d75/fbf [507976,94776] 0 2024-09-13T21:45:06.930 INFO:tasks.workunit.client.1.smithi155.stdout:9/957: creat dc/d18/d50/f14d x:0 0 0 2024-09-13T21:45:06.932 INFO:tasks.workunit.client.1.smithi155.stdout:0/964: creat d1/d6/dc/f165 x:0 0 0 2024-09-13T21:45:06.937 INFO:tasks.workunit.client.1.smithi155.stdout:3/973: dwrite d3/d25/d1b/d1f/d82/d83/f8a [0,4194304] 0 2024-09-13T21:45:06.938 INFO:tasks.workunit.client.1.smithi155.stdout:9/958: creat dc/de/d6f/f14e x:0 0 0 2024-09-13T21:45:06.940 INFO:tasks.workunit.client.1.smithi155.stdout:8/793: mkdir d2/d2d/d96/dcc/df4/dfd 0 2024-09-13T21:45:06.942 INFO:tasks.workunit.client.1.smithi155.stdout:8/794: write d2/d6/f94 [1187141,70547] 0 2024-09-13T21:45:06.949 INFO:tasks.workunit.client.1.smithi155.stdout:9/959: creat dc/de/d6f/dae/de1/f14f x:0 0 0 2024-09-13T21:45:06.951 INFO:tasks.workunit.client.1.smithi155.stdout:3/974: dwrite d3/d25/d17/f5b [0,4194304] 0 2024-09-13T21:45:06.953 INFO:tasks.workunit.client.1.smithi155.stdout:0/965: write d1/d6/dc/d8c/fda [623734,79743] 0 2024-09-13T21:45:06.955 INFO:tasks.workunit.client.1.smithi155.stdout:8/795: dread d2/d6/dd/d12/f7d [0,4194304] 0 2024-09-13T21:45:06.961 INFO:tasks.workunit.client.1.smithi155.stdout:7/928: dwrite d5/df/fd4 [0,4194304] 0 2024-09-13T21:45:06.965 INFO:tasks.workunit.client.1.smithi155.stdout:9/960: dwrite dc/de/d6f/f14e [0,4194304] 0 2024-09-13T21:45:06.967 INFO:tasks.workunit.client.1.smithi155.stdout:7/929: dread - d5/df/dad/f10d zero size 2024-09-13T21:45:06.967 INFO:tasks.workunit.client.1.smithi155.stdout:0/966: creat d1/d6/dc/d4d/d4a/d52/d5c/f166 x:0 0 0 2024-09-13T21:45:06.969 INFO:tasks.workunit.client.1.smithi155.stdout:0/967: chown d1/d6/d97/f12d 18114 1 2024-09-13T21:45:06.970 INFO:tasks.workunit.client.1.smithi155.stdout:7/930: rmdir d5/da6/dca/df0 39 2024-09-13T21:45:06.973 INFO:tasks.workunit.client.1.smithi155.stdout:7/931: chown d5/d10/d3e/f6b 110 1 2024-09-13T21:45:06.974 INFO:tasks.workunit.client.1.smithi155.stdout:7/932: fdatasync d5/df/d15/fd1 0 2024-09-13T21:45:06.978 INFO:tasks.workunit.client.1.smithi155.stdout:7/933: fdatasync d5/d10/d3e/d40/da2/fc0 0 2024-09-13T21:45:06.978 INFO:tasks.workunit.client.1.smithi155.stdout:3/975: dwrite d3/d25/d1b/d1f/f30 [0,4194304] 0 2024-09-13T21:45:06.979 INFO:tasks.workunit.client.1.smithi155.stdout:0/968: rename d1/d6/dc/f27 to d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/f167 0 2024-09-13T21:45:06.980 INFO:tasks.workunit.client.1.smithi155.stdout:2/818: dread d2/dd/d37/ff4 [0,4194304] 0 2024-09-13T21:45:06.985 INFO:tasks.workunit.client.1.smithi155.stdout:8/796: write d2/d8/f8b [468924,129099] 0 2024-09-13T21:45:06.985 INFO:tasks.workunit.client.1.smithi155.stdout:7/934: creat d5/da6/dca/df0/f11e x:0 0 0 2024-09-13T21:45:06.986 INFO:tasks.workunit.client.1.smithi155.stdout:3/976: dread d3/dbb/fbd [0,4194304] 0 2024-09-13T21:45:06.987 INFO:tasks.workunit.client.1.smithi155.stdout:7/935: chown d5/df/d60/d6d/f7a 4835 1 2024-09-13T21:45:06.988 INFO:tasks.workunit.client.1.smithi155.stdout:8/797: creat d2/d2d/d96/dcc/ddd/ffe x:0 0 0 2024-09-13T21:45:06.988 INFO:tasks.workunit.client.1.smithi155.stdout:7/936: chown d5/d13/l2e 1138317 1 2024-09-13T21:45:06.989 INFO:tasks.workunit.client.1.smithi155.stdout:8/798: chown d2/d6/dd/d12/f7d 1 1 2024-09-13T21:45:06.989 INFO:tasks.workunit.client.1.smithi155.stdout:2/819: creat d2/dd/d21/d39/dc1/d66/dd7/f122 x:0 0 0 2024-09-13T21:45:06.990 INFO:tasks.workunit.client.1.smithi155.stdout:0/969: getdents d1/d6/dc/d4d/d4a/d4e/d61 0 2024-09-13T21:45:06.990 INFO:tasks.workunit.client.1.smithi155.stdout:3/977: creat d3/d25/d1b/d1f/d36/d5c/ddb/f14b x:0 0 0 2024-09-13T21:45:06.992 INFO:tasks.workunit.client.1.smithi155.stdout:8/799: rmdir d2/d91 39 2024-09-13T21:45:06.995 INFO:tasks.workunit.client.1.smithi155.stdout:2/820: dread d2/dd/de/f9a [0,4194304] 0 2024-09-13T21:45:06.996 INFO:tasks.workunit.client.1.smithi155.stdout:3/978: truncate d3/d25/d17/fab 3739114 0 2024-09-13T21:45:06.998 INFO:tasks.workunit.client.1.smithi155.stdout:8/800: rmdir d2/d1f/d87/d9a 39 2024-09-13T21:45:06.998 INFO:tasks.workunit.client.1.smithi155.stdout:3/979: readlink d3/d25/d17/d3b/l13d 0 2024-09-13T21:45:07.001 INFO:tasks.workunit.client.1.smithi155.stdout:9/961: dwrite dc/d18/d1e/d86/f9e [0,4194304] 0 2024-09-13T21:45:07.004 INFO:tasks.workunit.client.1.smithi155.stdout:9/962: mknod dc/de/d5c/c150 0 2024-09-13T21:45:07.005 INFO:tasks.workunit.client.1.smithi155.stdout:7/937: write d5/d13/f21 [3275246,59756] 0 2024-09-13T21:45:07.009 INFO:tasks.workunit.client.1.smithi155.stdout:8/801: getdents d2/d6/dd 0 2024-09-13T21:45:07.011 INFO:tasks.workunit.client.1.smithi155.stdout:8/802: chown d2/d6/dd/f62 838806 1 2024-09-13T21:45:07.012 INFO:tasks.workunit.client.1.smithi155.stdout:7/938: mkdir d5/df/d15/d33/d11f 0 2024-09-13T21:45:07.012 INFO:tasks.workunit.client.1.smithi155.stdout:3/980: getdents d3/d25/d1b/d1f/d36/d5c/d66/db3/db2/dc9 0 2024-09-13T21:45:07.014 INFO:tasks.workunit.client.1.smithi155.stdout:7/939: chown d5/d3b/fd3 690401170 1 2024-09-13T21:45:07.017 INFO:tasks.workunit.client.1.smithi155.stdout:7/940: readlink d5/df/d15/l4d 0 2024-09-13T21:45:07.018 INFO:tasks.workunit.client.1.smithi155.stdout:0/970: dwrite d1/d6/dc/d4d/f50 [0,4194304] 0 2024-09-13T21:45:07.018 INFO:tasks.workunit.client.1.smithi155.stdout:9/963: link dc/de/d6f/dae/de1/d38/d90/d74/fce dc/de/d2d/d79/d43/d135/f151 0 2024-09-13T21:45:07.019 INFO:tasks.workunit.client.1.smithi155.stdout:3/981: creat d3/d25/d1b/d1f/d36/d5c/dbc/d117/f14c x:0 0 0 2024-09-13T21:45:07.022 INFO:tasks.workunit.client.1.smithi155.stdout:0/971: read d1/d6/dc/d4d/d4a/d52/d5c/f124 [429300,21809] 0 2024-09-13T21:45:07.022 INFO:tasks.workunit.client.1.smithi155.stdout:7/941: creat d5/d10/dbf/f120 x:0 0 0 2024-09-13T21:45:07.023 INFO:tasks.workunit.client.1.smithi155.stdout:7/942: rename d5 to d5/d10/d3e/d3f/d61/dd9/d121 22 2024-09-13T21:45:07.026 INFO:tasks.workunit.client.1.smithi155.stdout:3/982: unlink d3/d10/f8d 0 2024-09-13T21:45:07.028 INFO:tasks.workunit.client.1.smithi155.stdout:2/821: dread d2/dd/d21/d39/dc1/d66/f78 [0,4194304] 0 2024-09-13T21:45:07.029 INFO:tasks.workunit.client.1.smithi155.stdout:0/972: unlink d1/d6/dc/d4d/d4a/d52/d5b/l87 0 2024-09-13T21:45:07.031 INFO:tasks.workunit.client.1.smithi155.stdout:3/983: symlink d3/d21/d2c/d115/l14d 0 2024-09-13T21:45:07.032 INFO:tasks.workunit.client.1.smithi155.stdout:7/943: link d5/df/d15/c89 d5/df/d15/df9/c122 0 2024-09-13T21:45:07.032 INFO:tasks.workunit.client.1.smithi155.stdout:8/803: dwrite d2/d6/fb9 [0,4194304] 0 2024-09-13T21:45:07.034 INFO:tasks.workunit.client.1.smithi155.stdout:2/822: creat d2/dd/de/d15/d121/f123 x:0 0 0 2024-09-13T21:45:07.035 INFO:tasks.workunit.client.1.smithi155.stdout:2/823: readlink d2/db/ld5 0 2024-09-13T21:45:07.035 INFO:tasks.workunit.client.1.smithi155.stdout:4/898: sync 2024-09-13T21:45:07.036 INFO:tasks.workunit.client.1.smithi155.stdout:5/837: sync 2024-09-13T21:45:07.036 INFO:tasks.workunit.client.1.smithi155.stdout:1/834: sync 2024-09-13T21:45:07.036 INFO:tasks.workunit.client.1.smithi155.stdout:8/804: mkdir d2/d8/d75/d82/dd6/dff 0 2024-09-13T21:45:07.039 INFO:tasks.workunit.client.1.smithi155.stdout:0/973: mkdir d1/d6/d81/df7/d168 0 2024-09-13T21:45:07.039 INFO:tasks.workunit.client.1.smithi155.stdout:7/944: mknod d5/da6/dca/d114/c123 0 2024-09-13T21:45:07.041 INFO:tasks.workunit.client.1.smithi155.stdout:5/838: unlink d5/d16/ce5 0 2024-09-13T21:45:07.043 INFO:tasks.workunit.client.1.smithi155.stdout:4/899: mkdir d1/d7/de/d15/dce/d118 0 2024-09-13T21:45:07.044 INFO:tasks.workunit.client.1.smithi155.stdout:1/835: chown d6/d15/d23/d55/lda 4494 1 2024-09-13T21:45:07.046 INFO:tasks.workunit.client.1.smithi155.stdout:8/805: rename d2/d8/d75/fc1 to d2/d8/f100 0 2024-09-13T21:45:07.048 INFO:tasks.workunit.client.1.smithi155.stdout:5/839: write d5/d16/d33/d1b/d1e/da1/fe6 [963388,118491] 0 2024-09-13T21:45:07.048 INFO:tasks.workunit.client.1.smithi155.stdout:7/945: symlink d5/df/d15/d115/l124 0 2024-09-13T21:45:07.051 INFO:tasks.workunit.client.1.smithi155.stdout:4/900: creat d1/d7/de/dc/f119 x:0 0 0 2024-09-13T21:45:07.052 INFO:tasks.workunit.client.1.smithi155.stdout:1/836: symlink d6/d7/d89/dd6/de0/l115 0 2024-09-13T21:45:07.052 INFO:tasks.workunit.client.1.smithi155.stdout:9/964: dwrite dc/de/d6f/dae/df0/d128/f9f [0,4194304] 0 2024-09-13T21:45:07.055 INFO:tasks.workunit.client.1.smithi155.stdout:5/840: read d5/fe [319987,16718] 0 2024-09-13T21:45:07.059 INFO:tasks.workunit.client.1.smithi155.stdout:0/974: dwrite d1/d6/dc/d4d/d4a/d52/d5c/d6a/fc8 [0,4194304] 0 2024-09-13T21:45:07.060 INFO:tasks.workunit.client.1.smithi155.stdout:3/984: truncate d3/d21/fc6 1498515 0 2024-09-13T21:45:07.062 INFO:tasks.workunit.client.1.smithi155.stdout:8/806: rename d2/d6/dd/d12/f7d to d2/d8/d5e/f101 0 2024-09-13T21:45:07.065 INFO:tasks.workunit.client.1.smithi155.stdout:2/824: write d2/dd/de/d15/d3f/de2/f119 [521656,42238] 0 2024-09-13T21:45:07.067 INFO:tasks.workunit.client.1.smithi155.stdout:5/841: creat d5/d16/d33/d1b/d59/f111 x:0 0 0 2024-09-13T21:45:07.070 INFO:tasks.workunit.client.1.smithi155.stdout:4/901: write d1/d7/fa1 [347128,122691] 0 2024-09-13T21:45:07.074 INFO:tasks.workunit.client.1.smithi155.stdout:0/975: rename d1/d6/dc/d4d/d105/f107 to d1/d6/d81/df7/f169 0 2024-09-13T21:45:07.075 INFO:tasks.workunit.client.1.smithi155.stdout:8/807: dwrite d2/dae/fe8 [0,4194304] 0 2024-09-13T21:45:07.078 INFO:tasks.workunit.client.1.smithi155.stdout:9/965: read dc/de/d15/f1c [2466150,97441] 0 2024-09-13T21:45:07.080 INFO:tasks.workunit.client.1.smithi155.stdout:9/966: chown dc/d18/d1e 532 1 2024-09-13T21:45:07.084 INFO:tasks.workunit.client.1.smithi155.stdout:3/985: link d3/d10/l33 d3/d25/d1b/d1f/d36/d5c/dba/l14e 0 2024-09-13T21:45:07.085 INFO:tasks.workunit.client.1.smithi155.stdout:0/976: fdatasync d1/d6/dc/d4d/d4a/dbe/fd5 0 2024-09-13T21:45:07.087 INFO:tasks.workunit.client.1.smithi155.stdout:8/808: symlink d2/d2d/d96/db8/l102 0 2024-09-13T21:45:07.090 INFO:tasks.workunit.client.1.smithi155.stdout:7/946: dwrite d5/df/d15/d33/d55/fb2 [0,4194304] 0 2024-09-13T21:45:07.092 INFO:tasks.workunit.client.1.smithi155.stdout:3/986: chown d3/d21/f53 79534824 1 2024-09-13T21:45:07.095 INFO:tasks.workunit.client.1.smithi155.stdout:5/842: write d5/d16/d33/d1b/d2f/d3c/d6c/d45/f54 [1333023,59022] 0 2024-09-13T21:45:07.096 INFO:tasks.workunit.client.1.smithi155.stdout:7/947: readlink d5/df/d15/d33/d43/l9d 0 2024-09-13T21:45:07.096 INFO:tasks.workunit.client.1.smithi155.stdout:9/967: creat dc/de/d6f/dae/f152 x:0 0 0 2024-09-13T21:45:07.097 INFO:tasks.workunit.client.1.smithi155.stdout:8/809: link d2/d2d/d96/dcc/ddd/ffe d2/d2d/d96/db8/f103 0 2024-09-13T21:45:07.100 INFO:tasks.workunit.client.1.smithi155.stdout:9/968: fsync fb 0 2024-09-13T21:45:07.101 INFO:tasks.workunit.client.1.smithi155.stdout:3/987: mknod d3/d21/d4a/c14f 0 2024-09-13T21:45:07.101 INFO:tasks.workunit.client.1.smithi155.stdout:1/837: dwrite d6/d15/f18 [0,4194304] 0 2024-09-13T21:45:07.108 INFO:tasks.workunit.client.1.smithi155.stdout:2/825: dwrite d2/dd/d21/d39/dc1/d66/fe0 [0,4194304] 0 2024-09-13T21:45:07.109 INFO:tasks.workunit.client.1.smithi155.stdout:7/948: mkdir d5/df/d15/d33/d55/d97/d125 0 2024-09-13T21:45:07.110 INFO:tasks.workunit.client.1.smithi155.stdout:3/988: write d3/d21/f106 [3578007,37052] 0 2024-09-13T21:45:07.113 INFO:tasks.workunit.client.1.smithi155.stdout:4/902: dwrite d1/d7/de/dc/d4a/f56 [0,4194304] 0 2024-09-13T21:45:07.115 INFO:tasks.workunit.client.1.smithi155.stdout:0/977: link d1/c130 d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/d82/c16a 0 2024-09-13T21:45:07.119 INFO:tasks.workunit.client.1.smithi155.stdout:3/989: dread - d3/d25/d1b/d1f/d36/d5c/d66/f14a zero size 2024-09-13T21:45:07.123 INFO:tasks.workunit.client.1.smithi155.stdout:8/810: truncate d2/d8/d65/f3e 875200 0 2024-09-13T21:45:07.125 INFO:tasks.workunit.client.1.smithi155.stdout:9/969: mknod dc/df7/c153 0 2024-09-13T21:45:07.127 INFO:tasks.workunit.client.1.smithi155.stdout:7/949: symlink d5/df/d60/de5/l126 0 2024-09-13T21:45:07.129 INFO:tasks.workunit.client.1.smithi155.stdout:2/826: fsync d2/dd/de/d15/d38/d41/fb2 0 2024-09-13T21:45:07.129 INFO:tasks.workunit.client.1.smithi155.stdout:4/903: write d1/d7/d21/dc6/ddb/ff6 [964486,114926] 0 2024-09-13T21:45:07.130 INFO:tasks.workunit.client.1.smithi155.stdout:3/990: dread - d3/d25/d1b/d1f/fb1 zero size 2024-09-13T21:45:07.131 INFO:tasks.workunit.client.1.smithi155.stdout:1/838: dwrite d6/d82/fbc [0,4194304] 0 2024-09-13T21:45:07.131 INFO:tasks.workunit.client.1.smithi155.stdout:9/970: dread - dc/de/d6f/dae/de1/f14f zero size 2024-09-13T21:45:07.132 INFO:tasks.workunit.client.1.smithi155.stdout:0/978: creat d1/d6/dc/f16b x:0 0 0 2024-09-13T21:45:07.133 INFO:tasks.workunit.client.1.smithi155.stdout:5/843: dwrite d5/d16/d33/d1b/d92/f102 [0,4194304] 0 2024-09-13T21:45:07.135 INFO:tasks.workunit.client.1.smithi155.stdout:8/811: creat d2/d6/dd/d25/f104 x:0 0 0 2024-09-13T21:45:07.135 INFO:tasks.workunit.client.1.smithi155.stdout:2/827: dread - d2/dd/de/f55 zero size 2024-09-13T21:45:07.139 INFO:tasks.workunit.client.1.smithi155.stdout:9/971: write dc/de/d6f/da3/ff5 [711738,84899] 0 2024-09-13T21:45:07.140 INFO:tasks.workunit.client.1.smithi155.stdout:5/844: read - d5/d16/d33/d1b/d2f/d3c/d44/ff2 zero size 2024-09-13T21:45:07.143 INFO:tasks.workunit.client.1.smithi155.stdout:5/845: write d5/d16/d81/d98/f8b [1592416,51932] 0 2024-09-13T21:45:07.145 INFO:tasks.workunit.client.1.smithi155.stdout:4/904: truncate d1/d7/d21/dc6/feb 919954 0 2024-09-13T21:45:07.147 INFO:tasks.workunit.client.1.smithi155.stdout:2/828: symlink d2/dd/d21/d39/l124 0 2024-09-13T21:45:07.148 INFO:tasks.workunit.client.1.smithi155.stdout:0/979: mknod d1/d6/dc/d4d/d4a/d52/d5c/c16c 0 2024-09-13T21:45:07.152 INFO:tasks.workunit.client.1.smithi155.stdout:1/839: rename d6/d15/d57/d5d/fcb to d6/d82/f116 0 2024-09-13T21:45:07.155 INFO:tasks.workunit.client.1.smithi155.stdout:0/980: symlink d1/d6/d81/l16d 0 2024-09-13T21:45:07.155 INFO:tasks.workunit.client.1.smithi155.stdout:3/991: link d3/d25/d1b/d1f/dc8/l111 d3/d25/d1b/d1f/d36/d5c/ddb/l150 0 2024-09-13T21:45:07.156 INFO:tasks.workunit.client.1.smithi155.stdout:2/829: rename d2/db/f27 to d2/dd/d21/d39/dc1/d66/d6f/d11d/f125 0 2024-09-13T21:45:07.158 INFO:tasks.workunit.client.1.smithi155.stdout:3/992: chown d3/d25/d1b/d1f/d36/l98 9949 1 2024-09-13T21:45:07.159 INFO:tasks.workunit.client.1.smithi155.stdout:3/993: readlink d3/d21/d2c/d115/l140 0 2024-09-13T21:45:07.159 INFO:tasks.workunit.client.1.smithi155.stdout:0/981: mknod d1/d6/dc/d4d/d4a/d4e/c16e 0 2024-09-13T21:45:07.160 INFO:tasks.workunit.client.1.smithi155.stdout:7/950: truncate d5/d3b/fe0 578721 0 2024-09-13T21:45:07.162 INFO:tasks.workunit.client.1.smithi155.stdout:7/951: write d5/d3b/f42 [507673,75541] 0 2024-09-13T21:45:07.162 INFO:tasks.workunit.client.1.smithi155.stdout:2/830: rename d2/dd/de/d15/d38/d41/d5f/d70/cc8 to d2/dd/d21/d39/dc1/d66/d7c/c126 0 2024-09-13T21:45:07.165 INFO:tasks.workunit.client.1.smithi155.stdout:2/831: read d2/dd/d37/d4e/fad [1142516,11650] 0 2024-09-13T21:45:07.168 INFO:tasks.workunit.client.1.smithi155.stdout:9/972: truncate dc/de/d6f/dae/df0/d128/faf 1049067 0 2024-09-13T21:45:07.176 INFO:tasks.workunit.client.1.smithi155.stdout:7/952: dwrite d5/df/d15/d33/d55/d97/dc8/df4/fff [0,4194304] 0 2024-09-13T21:45:07.177 INFO:tasks.workunit.client.1.smithi155.stdout:5/846: dread d5/d16/d33/d1b/d2f/d3c/d6c/f77 [0,4194304] 0 2024-09-13T21:45:07.178 INFO:tasks.workunit.client.1.smithi155.stdout:8/812: dread d2/d2d/d96/db8/fba [0,4194304] 0 2024-09-13T21:45:07.180 INFO:tasks.workunit.client.1.smithi155.stdout:9/973: dwrite dc/d18/f7a [0,4194304] 0 2024-09-13T21:45:07.183 INFO:tasks.workunit.client.1.smithi155.stdout:9/974: read - dc/de/d2d/f116 zero size 2024-09-13T21:45:07.243 INFO:tasks.workunit.client.1.smithi155.stdout:9/975: mkdir dc/de/d6f/dae/df0/d154 0 2024-09-13T21:45:07.245 INFO:tasks.workunit.client.1.smithi155.stdout:5/847: symlink d5/d16/l112 0 2024-09-13T21:45:07.246 INFO:tasks.workunit.client.1.smithi155.stdout:8/813: unlink d2/d8/d65/da8/lca 0 2024-09-13T21:45:07.250 INFO:tasks.workunit.client.1.smithi155.stdout:3/994: dwrite d3/d25/d1b/d1f/d36/d5c/d66/fd7 [0,4194304] 0 2024-09-13T21:45:07.252 INFO:tasks.workunit.client.1.smithi155.stdout:5/848: rmdir d5/d16/d81/d98 39 2024-09-13T21:45:07.254 INFO:tasks.workunit.client.1.smithi155.stdout:5/849: readlink d5/d16/d33/d1b/d2f/d3c/d44/l8f 0 2024-09-13T21:45:07.255 INFO:tasks.workunit.client.1.smithi155.stdout:5/850: stat d5/d16/d33/d1b/d59/f111 0 2024-09-13T21:45:07.258 INFO:tasks.workunit.client.1.smithi155.stdout:3/995: creat d3/d25/d1b/f151 x:0 0 0 2024-09-13T21:45:07.259 INFO:tasks.workunit.client.1.smithi155.stdout:9/976: dread dc/de/d6f/dae/de1/f30 [0,4194304] 0 2024-09-13T21:45:07.261 INFO:tasks.workunit.client.1.smithi155.stdout:5/851: unlink d5/d16/d33/d1b/d28/d52/cb9 0 2024-09-13T21:45:07.263 INFO:tasks.workunit.client.1.smithi155.stdout:3/996: write d3/d25/d1b/d1f/d36/d7c/f9f [1059687,94791] 0 2024-09-13T21:45:07.265 INFO:tasks.workunit.client.1.smithi155.stdout:5/852: dread - d5/d16/d33/d1b/d2f/d3c/d5b/d5f/ffd zero size 2024-09-13T21:45:07.265 INFO:tasks.workunit.client.1.smithi155.stdout:9/977: dread dc/de/d6f/dae/df0/d128/f9f [0,4194304] 0 2024-09-13T21:45:07.267 INFO:tasks.workunit.client.1.smithi155.stdout:9/978: chown dc/d18/l76 14 1 2024-09-13T21:45:07.267 INFO:tasks.workunit.client.1.smithi155.stdout:3/997: truncate d3/d25/d1b/d1f/d36/d5c/ddb/f147 638351 0 2024-09-13T21:45:07.270 INFO:tasks.workunit.client.1.smithi155.stdout:5/853: creat d5/d16/db4/f113 x:0 0 0 2024-09-13T21:45:07.270 INFO:tasks.workunit.client.1.smithi155.stdout:9/979: chown dc/de/f139 13868 1 2024-09-13T21:45:07.271 INFO:tasks.workunit.client.1.smithi155.stdout:5/854: readlink d5/d16/d33/d1b/d92/dca/lec 0 2024-09-13T21:45:07.275 INFO:tasks.workunit.client.1.smithi155.stdout:9/980: stat dc/d19/c10b 0 2024-09-13T21:45:07.276 INFO:tasks.workunit.client.1.smithi155.stdout:5/855: creat d5/d16/d33/d1b/d2f/d3c/d5b/d5f/f114 x:0 0 0 2024-09-13T21:45:07.280 INFO:tasks.workunit.client.1.smithi155.stdout:5/856: creat d5/d16/d81/de8/f115 x:0 0 0 2024-09-13T21:45:07.284 INFO:tasks.workunit.client.1.smithi155.stdout:5/857: unlink d5/d16/d33/d1b/d2f/d3c/d44/l24 0 2024-09-13T21:45:07.288 INFO:tasks.workunit.client.1.smithi155.stdout:5/858: link f0 d5/d16/d33/d1f/f116 0 2024-09-13T21:45:07.295 INFO:tasks.workunit.client.1.smithi155.stdout:5/859: rmdir d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/db8 39 2024-09-13T21:45:07.297 INFO:tasks.workunit.client.1.smithi155.stdout:0/982: creat d1/d6/dc/d90/f16f x:0 0 0 2024-09-13T21:45:07.301 INFO:tasks.workunit.client.1.smithi155.stdout:0/983: truncate d1/d6/dc/d4d/d4a/dbe/fd5 668532 0 2024-09-13T21:45:07.301 INFO:tasks.workunit.client.1.smithi155.stdout:5/860: dread d5/d16/d33/d1f/fa5 [0,4194304] 0 2024-09-13T21:45:07.305 INFO:tasks.workunit.client.1.smithi155.stdout:5/861: truncate d5/d16/d33/d1b/d2f/d3c/d5b/d5f/f114 614093 0 2024-09-13T21:45:07.315 INFO:tasks.workunit.client.1.smithi155.stdout:5/862: dwrite d5/d16/d33/d1b/d2f/d3c/f82 [0,4194304] 0 2024-09-13T21:45:07.318 INFO:tasks.workunit.client.1.smithi155.stdout:0/984: dread d1/d6/d81/df7/f169 [0,4194304] 0 2024-09-13T21:45:07.320 INFO:tasks.workunit.client.1.smithi155.stdout:0/985: write d1/fc2 [331134,34773] 0 2024-09-13T21:45:07.326 INFO:tasks.workunit.client.1.smithi155.stdout:0/986: creat d1/d6/dc/d8c/f170 x:0 0 0 2024-09-13T21:45:07.328 INFO:tasks.workunit.client.1.smithi155.stdout:0/987: readlink d1/d6/dc/d4d/d4a/ld7 0 2024-09-13T21:45:07.334 INFO:tasks.workunit.client.1.smithi155.stdout:0/988: link d1/d6/dc/d4d/f10c d1/d6/dc/d4d/f171 0 2024-09-13T21:45:07.336 INFO:tasks.workunit.client.1.smithi155.stdout:0/989: truncate d1/d6/dc/d8c/f93 1704775 0 2024-09-13T21:45:07.340 INFO:tasks.workunit.client.1.smithi155.stdout:0/990: symlink d1/d6/dc/d4d/d4a/d52/l172 0 2024-09-13T21:45:07.342 INFO:tasks.workunit.client.1.smithi155.stdout:0/991: mkdir d1/d6/d97/db2/db5/d173 0 2024-09-13T21:45:07.344 INFO:tasks.workunit.client.1.smithi155.stdout:7/953: creat d5/df/d15/d33/f127 x:0 0 0 2024-09-13T21:45:07.345 INFO:tasks.workunit.client.1.smithi155.stdout:0/992: creat d1/d6/dc/d4d/d4a/d52/d5c/d6a/dd8/d11f/f174 x:0 0 0 2024-09-13T21:45:07.346 INFO:tasks.workunit.client.1.smithi155.stdout:0/993: dread - d1/d6/d81/fbb zero size 2024-09-13T21:45:07.349 INFO:tasks.workunit.client.1.smithi155.stdout:7/954: creat d5/df/d79/d119/f128 x:0 0 0 2024-09-13T21:45:07.351 INFO:tasks.workunit.client.1.smithi155.stdout:3/998: dwrite d3/d21/fc6 [0,4194304] 0 2024-09-13T21:45:07.352 INFO:tasks.workunit.client.1.smithi155.stdout:0/994: mkdir d1/d6/dc/d4d/d4a/d9e/de0/d175 0 2024-09-13T21:45:07.356 INFO:tasks.workunit.client.1.smithi155.stdout:0/995: symlink d1/d6/d97/db2/db5/l176 0 2024-09-13T21:45:07.358 INFO:tasks.workunit.client.1.smithi155.stdout:7/955: dwrite d5/df/f19 [0,4194304] 0 2024-09-13T21:45:07.360 INFO:tasks.workunit.client.1.smithi155.stdout:0/996: write d1/d6/dc/d4d/d4a/d52/d5c/f5d [6365024,104698] 0 2024-09-13T21:45:07.361 INFO:tasks.workunit.client.1.smithi155.stdout:3/999: creat d3/d25/d1b/d1f/d36/f152 x:0 0 0 2024-09-13T21:45:07.363 INFO:tasks.workunit.client.1.smithi155.stdout:7/956: mkdir d5/df/d15/d33/d55/d97/dee/d129 0 2024-09-13T21:45:07.366 INFO:tasks.workunit.client.1.smithi155.stdout:8/814: rename d2/d6/dd/d12 to d2/d8/d65/d105 0 2024-09-13T21:45:07.368 INFO:tasks.workunit.client.1.smithi155.stdout:7/957: mkdir d5/d10/d3e/d3f/d61/dd9/d12a 0 2024-09-13T21:45:07.370 INFO:tasks.workunit.client.1.smithi155.stdout:9/981: rename dc/de/d5c/f8c to dc/de/d15/d10d/d12d/f155 0 2024-09-13T21:45:07.371 INFO:tasks.workunit.client.1.smithi155.stdout:7/958: mkdir d5/df/d15/d33/d55/d97/dc8/d12b 0 2024-09-13T21:45:07.377 INFO:tasks.workunit.client.1.smithi155.stdout:7/959: getdents d5/df/d15/d33/d55/d97/dc8/df4 0 2024-09-13T21:45:07.380 INFO:tasks.workunit.client.1.smithi155.stdout:5/863: truncate d5/d16/d81/d98/fc3 1734056 0 2024-09-13T21:45:07.380 INFO:tasks.workunit.client.1.smithi155.stdout:0/997: dread d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/f167 [0,4194304] 0 2024-09-13T21:45:07.381 INFO:tasks.workunit.client.1.smithi155.stdout:7/960: symlink d5/d3b/d8e/def/l12c 0 2024-09-13T21:45:07.389 INFO:tasks.workunit.client.1.smithi155.stdout:5/864: read d5/d16/d33/d1b/d2f/d3c/d6c/f35 [1787127,108720] 0 2024-09-13T21:45:07.390 INFO:tasks.workunit.client.1.smithi155.stdout:5/865: chown d5/d16/d33/d1b/d59/dd1 9412 1 2024-09-13T21:45:07.400 INFO:tasks.workunit.client.1.smithi155.stdout:9/982: write dc/de/d6f/dae/de1/f47 [260239,114053] 0 2024-09-13T21:45:07.409 INFO:tasks.workunit.client.1.smithi155.stdout:7/961: fdatasync d5/df/f85 0 2024-09-13T21:45:07.410 INFO:tasks.workunit.client.1.smithi155.stdout:0/998: unlink d1/d6/dc/d4d/d4a/d52/d5c/d6a/db0/db8/fdd 0 2024-09-13T21:45:07.412 INFO:tasks.workunit.client.1.smithi155.stdout:5/866: unlink d5/fe 0 2024-09-13T21:45:07.412 INFO:tasks.workunit.client.1.smithi155.stdout:9/983: symlink dc/d18/d1e/dcc/l156 0 2024-09-13T21:45:07.415 INFO:tasks.workunit.client.1.smithi155.stdout:7/962: rename d5/df/d15/d33/d55/d97/cb9 to d5/dcd/c12d 0 2024-09-13T21:45:07.416 INFO:tasks.workunit.client.1.smithi155.stdout:9/984: chown dc/de/d6f/dae/de1/d38/d90/d74/l8f 165 1 2024-09-13T21:45:07.417 INFO:tasks.workunit.client.1.smithi155.stdout:5/867: unlink d5/d16/d33/d1b/d2f/d3c/fa7 0 2024-09-13T21:45:07.419 INFO:tasks.workunit.client.1.smithi155.stdout:0/999: dwrite d1/d6/dc/d4d/d4a/f8d [0,4194304] 0 2024-09-13T21:45:07.419 INFO:tasks.workunit.client.1.smithi155.stdout:7/963: chown d5/df/d15/f28 81190037 1 2024-09-13T21:45:07.421 INFO:tasks.workunit.client.1.smithi155.stdout:5/868: symlink d5/d16/l117 0 2024-09-13T21:45:07.426 INFO:tasks.workunit.client.1.smithi155.stdout:7/964: dwrite d5/df/f4f [0,4194304] 0 2024-09-13T21:45:07.428 INFO:tasks.workunit.client.1.smithi155.stdout:5/869: getdents d5/d16/d33/d1b/d92 0 2024-09-13T21:45:07.433 INFO:tasks.workunit.client.1.smithi155.stdout:7/965: rename d5/d10/d3e/cfa to d5/df/d15/d33/d55/d97/dee/c12e 0 2024-09-13T21:45:07.436 INFO:tasks.workunit.client.1.smithi155.stdout:7/966: symlink d5/l12f 0 2024-09-13T21:45:07.438 INFO:tasks.workunit.client.1.smithi155.stdout:7/967: write d5/d10/d3e/f6b [3583134,36746] 0 2024-09-13T21:45:07.440 INFO:tasks.workunit.client.1.smithi155.stdout:5/870: link d5/d16/d33/d1b/d2f/d3c/d6c/c105 d5/d16/d81/d98/c118 0 2024-09-13T21:45:07.441 INFO:tasks.workunit.client.1.smithi155.stdout:7/968: mknod d5/d3b/c130 0 2024-09-13T21:45:07.442 INFO:tasks.workunit.client.1.smithi155.stdout:7/969: write d5/d10/d3e/f6b [4815226,70134] 0 2024-09-13T21:45:07.456 INFO:tasks.workunit.client.1.smithi155.stdout:9/985: truncate dc/de/d6f/dae/df0/d128/fca 3744222 0 2024-09-13T21:45:07.457 INFO:tasks.workunit.client.1.smithi155.stdout:7/970: dread d5/d10/d3e/d3f/f8c [0,4194304] 0 2024-09-13T21:45:07.458 INFO:tasks.workunit.client.1.smithi155.stdout:7/971: truncate d5/df/f58 4689891 0 2024-09-13T21:45:07.459 INFO:tasks.workunit.client.1.smithi155.stdout:9/986: mkdir dc/de/d6f/d71/d157 0 2024-09-13T21:45:07.460 INFO:tasks.workunit.client.1.smithi155.stdout:9/987: readlink dc/de/d6f/dae/de1/d38/l5a 0 2024-09-13T21:45:07.461 INFO:tasks.workunit.client.1.smithi155.stdout:7/972: symlink d5/da6/dca/l131 0 2024-09-13T21:45:07.463 INFO:tasks.workunit.client.1.smithi155.stdout:5/871: write d5/d16/d4e/d85/ff6 [4270913,575] 0 2024-09-13T21:45:07.464 INFO:tasks.workunit.client.1.smithi155.stdout:7/973: chown d5/d10/c1c 0 1 2024-09-13T21:45:07.466 INFO:tasks.workunit.client.1.smithi155.stdout:7/974: stat d5/df/d15/d33/d55/d97/dc8/l116 0 2024-09-13T21:45:07.469 INFO:tasks.workunit.client.1.smithi155.stdout:9/988: write dc/de/d6f/dae/df0/d128/f6b [4559055,71549] 0 2024-09-13T21:45:07.473 INFO:tasks.workunit.client.1.smithi155.stdout:9/989: rename dc/d18/d1e to dc/de/d5c/d14b/d158 0 2024-09-13T21:45:07.474 INFO:tasks.workunit.client.1.smithi155.stdout:9/990: chown dc/de/d2d/d79/d43/la5 21 1 2024-09-13T21:45:07.475 INFO:tasks.workunit.client.1.smithi155.stdout:5/872: write d5/d16/d33/d1b/d2f/d3c/d6c/f8e [1654897,75394] 0 2024-09-13T21:45:07.481 INFO:tasks.workunit.client.1.smithi155.stdout:5/873: dwrite d5/d16/d33/d1b/d59/f88 [4194304,4194304] 0 2024-09-13T21:45:07.489 INFO:tasks.workunit.client.1.smithi155.stdout:5/874: dwrite d5/d16/d33/d1b/d2f/d3c/d6c/d45/f7c [0,4194304] 0 2024-09-13T21:45:07.490 INFO:tasks.workunit.client.1.smithi155.stdout:5/875: readlink d5/d16/d33/lce 0 2024-09-13T21:45:07.490 INFO:tasks.workunit.client.1.smithi155.stdout:5/876: readlink d5/l34 0 2024-09-13T21:45:07.491 INFO:tasks.workunit.client.1.smithi155.stdout:5/877: chown d5/d16/d33/d1b/d59/f100 1358 1 2024-09-13T21:45:07.495 INFO:tasks.workunit.client.1.smithi155.stdout:5/878: symlink d5/d16/l119 0 2024-09-13T21:45:07.496 INFO:tasks.workunit.client.1.smithi155.stdout:5/879: fdatasync d5/d16/d33/d1b/d2f/d3c/d44/fcf 0 2024-09-13T21:45:07.505 INFO:tasks.workunit.client.1.smithi155.stdout:5/880: truncate d5/d16/d33/d1b/d2f/d3c/f75 1693990 0 2024-09-13T21:45:07.505 INFO:tasks.workunit.client.1.smithi155.stdout:5/881: chown d5/d16/d33/d1f/fa5 2070 1 2024-09-13T21:45:07.506 INFO:tasks.workunit.client.1.smithi155.stdout:5/882: chown d5/d16/d33/d1b/d59 1491300 1 2024-09-13T21:45:07.511 INFO:tasks.workunit.client.1.smithi155.stdout:5/883: dwrite d5/f6 [4194304,4194304] 0 2024-09-13T21:45:07.512 INFO:tasks.workunit.client.1.smithi155.stdout:5/884: chown d5/d16/d33/d1b/d2f/d3c/d6c/d45/cb1 108777056 1 2024-09-13T21:45:07.513 INFO:tasks.workunit.client.1.smithi155.stdout:5/885: write d5/f6 [3380519,97691] 0 2024-09-13T21:45:07.517 INFO:tasks.workunit.client.1.smithi155.stdout:5/886: creat d5/d16/d33/d1b/d2f/d3c/d5b/dc1/f11a x:0 0 0 2024-09-13T21:45:07.518 INFO:tasks.workunit.client.1.smithi155.stdout:5/887: stat d5/d16/d81/d98/d84 0 2024-09-13T21:45:07.521 INFO:tasks.workunit.client.1.smithi155.stdout:5/888: getdents d5/d16/d33/d1b/d2f/d3c/d5b 0 2024-09-13T21:45:07.524 INFO:tasks.workunit.client.1.smithi155.stdout:5/889: unlink d5/d16/d33/d1b/d1e/fe4 0 2024-09-13T21:45:07.526 INFO:tasks.workunit.client.1.smithi155.stdout:5/890: mknod d5/d16/d33/d1b/d1e/c11b 0 2024-09-13T21:45:07.527 INFO:tasks.workunit.client.1.smithi155.stdout:5/891: creat d5/d16/d81/df5/f11c x:0 0 0 2024-09-13T21:45:07.529 INFO:tasks.workunit.client.1.smithi155.stdout:5/892: symlink d5/d16/d33/d1b/d2f/d3c/d44/l11d 0 2024-09-13T21:45:07.530 INFO:tasks.workunit.client.1.smithi155.stdout:5/893: chown d5/d16/d33/d1b/d59/dd1/leb 236 1 2024-09-13T21:45:07.533 INFO:tasks.workunit.client.1.smithi155.stdout:5/894: getdents d5/d16/d81/de8 0 2024-09-13T21:45:07.537 INFO:tasks.workunit.client.1.smithi155.stdout:5/895: rmdir d5/d16/d33/d1b/db6 0 2024-09-13T21:45:07.542 INFO:tasks.workunit.client.1.smithi155.stdout:5/896: write d5/d16/d33/d1b/d2f/d3c/d6c/d45/f65 [4668662,54663] 0 2024-09-13T21:45:07.546 INFO:tasks.workunit.client.1.smithi155.stdout:5/897: getdents d5/d16/d33/d1b/d2f/d3c 0 2024-09-13T21:45:07.561 INFO:tasks.workunit.client.1.smithi155.stdout:5/898: write d5/d16/d33/d1b/d2f/d3c/d6c/d45/f6d [9434307,54256] 0 2024-09-13T21:45:07.564 INFO:tasks.workunit.client.1.smithi155.stdout:5/899: rename d5/c21 to d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/c11e 0 2024-09-13T21:45:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:07 smithi155 ceph-mon[34732]: pgmap v18: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 90 MiB/s rd, 217 MiB/s wr, 489 op/s 2024-09-13T21:45:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:07 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:07.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:07 smithi119 ceph-mon[27653]: pgmap v18: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 90 MiB/s rd, 217 MiB/s wr, 489 op/s 2024-09-13T21:45:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:07 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:07.946 INFO:tasks.workunit.client.1.smithi155.stdout:4/905: sync 2024-09-13T21:45:07.947 INFO:tasks.workunit.client.1.smithi155.stdout:4/906: chown d1/d7/de/d15/ffb 295619 1 2024-09-13T21:45:07.980 INFO:tasks.workunit.client.1.smithi155.stdout:7/975: sync 2024-09-13T21:45:07.980 INFO:tasks.workunit.client.1.smithi155.stdout:1/840: sync 2024-09-13T21:45:07.980 INFO:tasks.workunit.client.1.smithi155.stdout:2/832: sync 2024-09-13T21:45:07.980 INFO:tasks.workunit.client.1.smithi155.stdout:8/815: sync 2024-09-13T21:45:07.981 INFO:tasks.workunit.client.1.smithi155.stdout:9/991: sync 2024-09-13T21:45:07.981 INFO:tasks.workunit.client.1.smithi155.stdout:5/900: sync 2024-09-13T21:45:07.982 INFO:tasks.workunit.client.1.smithi155.stdout:1/841: dread d6/d15/d23/fb8 [0,4194304] 0 2024-09-13T21:45:07.989 INFO:tasks.workunit.client.1.smithi155.stdout:1/842: mknod d6/d7/d48/dab/c117 0 2024-09-13T21:45:07.989 INFO:tasks.workunit.client.1.smithi155.stdout:8/816: getdents d2/d8/d65/d105 0 2024-09-13T21:45:07.990 INFO:tasks.workunit.client.1.smithi155.stdout:2/833: dwrite d2/dd/d21/d39/dc1/d66/dd7/f122 [0,4194304] 0 2024-09-13T21:45:07.992 INFO:tasks.workunit.client.1.smithi155.stdout:1/843: creat d6/d15/d23/d87/de2/f118 x:0 0 0 2024-09-13T21:45:07.994 INFO:tasks.workunit.client.1.smithi155.stdout:8/817: chown d2/d8/d5e/leb 56 1 2024-09-13T21:45:07.995 INFO:tasks.workunit.client.1.smithi155.stdout:2/834: creat d2/dd/d37/d4e/def/f127 x:0 0 0 2024-09-13T21:45:07.998 INFO:tasks.workunit.client.1.smithi155.stdout:5/901: dwrite d5/d16/d33/d1b/d2f/d3c/f41 [0,4194304] 0 2024-09-13T21:45:08.002 INFO:tasks.workunit.client.1.smithi155.stdout:2/835: mknod d2/dd/d3d/c128 0 2024-09-13T21:45:08.004 INFO:tasks.workunit.client.1.smithi155.stdout:1/844: dwrite d6/f106 [0,4194304] 0 2024-09-13T21:45:08.004 INFO:tasks.workunit.client.1.smithi155.stdout:9/992: dread dc/de/d6f/dae/df0/d128/fb4 [0,4194304] 0 2024-09-13T21:45:08.005 INFO:tasks.workunit.client.1.smithi155.stdout:5/902: getdents d5/d16/d33/d1f/dff 0 2024-09-13T21:45:08.008 INFO:tasks.workunit.client.1.smithi155.stdout:8/818: rename d2/d2d to d2/d6/dd/d106 0 2024-09-13T21:45:08.011 INFO:tasks.workunit.client.1.smithi155.stdout:9/993: rmdir dc/de/d5c/d14b/d158/d86 39 2024-09-13T21:45:08.016 INFO:tasks.workunit.client.1.smithi155.stdout:1/845: creat d6/f119 x:0 0 0 2024-09-13T21:45:08.018 INFO:tasks.workunit.client.1.smithi155.stdout:9/994: creat dc/de/d5c/d14b/f159 x:0 0 0 2024-09-13T21:45:08.020 INFO:tasks.workunit.client.1.smithi155.stdout:5/903: dwrite d5/d16/d33/d1b/d59/f8a [4194304,4194304] 0 2024-09-13T21:45:08.020 INFO:tasks.workunit.client.1.smithi155.stdout:2/836: dwrite d2/dd/d21/d39/dc1/d66/f78 [4194304,4194304] 0 2024-09-13T21:45:08.024 INFO:tasks.workunit.client.1.smithi155.stdout:1/846: creat d6/d7/d48/f11a x:0 0 0 2024-09-13T21:45:08.028 INFO:tasks.workunit.client.1.smithi155.stdout:2/837: chown d2/l2a 15841 1 2024-09-13T21:45:08.028 INFO:tasks.workunit.client.1.smithi155.stdout:1/847: chown d6/d15/d23/d55/d6e/dbb/d4b/fde 33 1 2024-09-13T21:45:08.028 INFO:tasks.workunit.client.1.smithi155.stdout:2/838: readlink d2/db/ld5 0 2024-09-13T21:45:08.033 INFO:tasks.workunit.client.1.smithi155.stdout:2/839: rename d2/db/d6b/f6e to d2/dd/d21/d39/dc1/d66/dd7/f129 0 2024-09-13T21:45:08.034 INFO:tasks.workunit.client.1.smithi155.stdout:9/995: link dc/de/d6f/dae/df0/f123 dc/d19/f15a 0 2024-09-13T21:45:08.034 INFO:tasks.workunit.client.1.smithi155.stdout:2/840: fsync d2/dd/de/f55 0 2024-09-13T21:45:08.036 INFO:tasks.workunit.client.1.smithi155.stdout:9/996: creat dc/de/d6f/dae/df0/f15b x:0 0 0 2024-09-13T21:45:08.037 INFO:tasks.workunit.client.1.smithi155.stdout:2/841: truncate d2/dd/d21/d8d/fb9 1332842 0 2024-09-13T21:45:08.039 INFO:tasks.workunit.client.1.smithi155.stdout:9/997: truncate dc/de/d15/f24 3964049 0 2024-09-13T21:45:08.041 INFO:tasks.workunit.client.1.smithi155.stdout:9/998: mkdir dc/d18/d50/d15c 0 2024-09-13T21:45:08.043 INFO:tasks.workunit.client.1.smithi155.stdout:1/848: write d6/d15/fba [1909132,104791] 0 2024-09-13T21:45:08.046 INFO:tasks.workunit.client.1.smithi155.stdout:1/849: stat d6/d15/d57/d5d/d72 0 2024-09-13T21:45:08.046 INFO:tasks.workunit.client.1.smithi155.stdout:8/819: dwrite d2/d6/dd/d106/d96/db8/fba [4194304,4194304] 0 2024-09-13T21:45:08.049 INFO:tasks.workunit.client.1.smithi155.stdout:9/999: dwrite dc/f1a [0,4194304] 0 2024-09-13T21:45:08.054 INFO:tasks.workunit.client.1.smithi155.stdout:8/820: symlink d2/l107 0 2024-09-13T21:45:08.060 INFO:tasks.workunit.client.1.smithi155.stdout:1/850: write d6/d15/d23/fae [1338779,57249] 0 2024-09-13T21:45:08.062 INFO:tasks.workunit.client.1.smithi155.stdout:8/821: mknod d2/d6/dd/d25/c108 0 2024-09-13T21:45:08.062 INFO:tasks.workunit.client.1.smithi155.stdout:1/851: readlink d6/d7/l100 0 2024-09-13T21:45:08.063 INFO:tasks.workunit.client.1.smithi155.stdout:8/822: chown d2/d8/c5f 15007 1 2024-09-13T21:45:08.064 INFO:tasks.workunit.client.1.smithi155.stdout:1/852: mknod d6/d15/d57/c11b 0 2024-09-13T21:45:08.066 INFO:tasks.workunit.client.1.smithi155.stdout:8/823: creat d2/d8/d65/f109 x:0 0 0 2024-09-13T21:45:08.068 INFO:tasks.workunit.client.1.smithi155.stdout:8/824: write d2/d6/dd/d106/d96/db0/fe6 [339899,25194] 0 2024-09-13T21:45:08.079 INFO:tasks.workunit.client.1.smithi155.stdout:8/825: dwrite d2/f47 [4194304,4194304] 0 2024-09-13T21:45:08.080 INFO:tasks.workunit.client.1.smithi155.stdout:8/826: write d2/dae/dbe/fd5 [65901,112169] 0 2024-09-13T21:45:08.089 INFO:tasks.workunit.client.1.smithi155.stdout:8/827: dwrite d2/d8/d65/d105/f2c [0,4194304] 0 2024-09-13T21:45:08.090 INFO:tasks.workunit.client.1.smithi155.stdout:1/853: dread d6/d15/f58 [0,4194304] 0 2024-09-13T21:45:08.092 INFO:tasks.workunit.client.1.smithi155.stdout:8/828: rename d2/dae/fbd to d2/d1f/d77/f10a 0 2024-09-13T21:45:08.093 INFO:tasks.workunit.client.1.smithi155.stdout:8/829: dread - d2/d6/dd/de7/ff3 zero size 2024-09-13T21:45:08.095 INFO:tasks.workunit.client.1.smithi155.stdout:8/830: creat d2/dae/f10b x:0 0 0 2024-09-13T21:45:08.102 INFO:tasks.workunit.client.1.smithi155.stdout:8/831: dwrite d2/d6/dd/d25/ff8 [0,4194304] 0 2024-09-13T21:45:08.106 INFO:tasks.workunit.client.1.smithi155.stdout:8/832: dread - d2/d8/f100 zero size 2024-09-13T21:45:08.109 INFO:tasks.workunit.client.1.smithi155.stdout:1/854: dwrite d6/d15/d57/d5d/d72/dc7/fd5 [0,4194304] 0 2024-09-13T21:45:08.114 INFO:tasks.workunit.client.1.smithi155.stdout:1/855: fsync d6/f49 0 2024-09-13T21:45:08.117 INFO:tasks.workunit.client.1.smithi155.stdout:1/856: rmdir d6/d82/d91 39 2024-09-13T21:45:08.118 INFO:tasks.workunit.client.1.smithi155.stdout:1/857: readlink d6/d7/d89/dd6/de0/l115 0 2024-09-13T21:45:08.124 INFO:tasks.workunit.client.1.smithi155.stdout:8/833: write d2/d6/dd/d106/d96/dcc/fde [1034884,112432] 0 2024-09-13T21:45:08.127 INFO:tasks.workunit.client.1.smithi155.stdout:8/834: dread d2/d8/fb1 [0,4194304] 0 2024-09-13T21:45:08.132 INFO:tasks.workunit.client.1.smithi155.stdout:1/858: dwrite d6/d15/d57/d99/ff5 [4194304,4194304] 0 2024-09-13T21:45:08.135 INFO:tasks.workunit.client.1.smithi155.stdout:1/859: mknod d6/d7/d89/dd6/dee/c11c 0 2024-09-13T21:45:08.139 INFO:tasks.workunit.client.1.smithi155.stdout:1/860: rename d6/d7/d48/c68 to d6/c11d 0 2024-09-13T21:45:08.141 INFO:tasks.workunit.client.1.smithi155.stdout:1/861: fsync d6/d15/d23/d55/db9/fd3 0 2024-09-13T21:45:08.143 INFO:tasks.workunit.client.1.smithi155.stdout:1/862: truncate d6/d7/fb2 2092684 0 2024-09-13T21:45:08.149 INFO:tasks.workunit.client.1.smithi155.stdout:1/863: dread d6/d15/d23/d87/fdd [0,4194304] 0 2024-09-13T21:45:08.150 INFO:tasks.workunit.client.1.smithi155.stdout:1/864: write d6/d82/fbc [268286,78487] 0 2024-09-13T21:45:08.155 INFO:tasks.workunit.client.1.smithi155.stdout:1/865: dread d6/d15/d23/d55/d6e/dbb/f75 [0,4194304] 0 2024-09-13T21:45:08.156 INFO:tasks.workunit.client.1.smithi155.stdout:1/866: rmdir d6/d15/d57/d99/d10e 39 2024-09-13T21:45:08.172 INFO:tasks.workunit.client.1.smithi155.stdout:1/867: dread d6/d15/d23/d87/f29 [4194304,4194304] 0 2024-09-13T21:45:08.174 INFO:tasks.workunit.client.1.smithi155.stdout:1/868: symlink d6/d15/d57/d5d/l11e 0 2024-09-13T21:45:08.178 INFO:tasks.workunit.client.1.smithi155.stdout:1/869: write d6/d82/d90/f84 [272934,121487] 0 2024-09-13T21:45:08.179 INFO:tasks.workunit.client.1.smithi155.stdout:1/870: chown d6/d7/d89/dd6/cf9 52465885 1 2024-09-13T21:45:08.197 INFO:tasks.workunit.client.1.smithi155.stdout:1/871: dread d6/d7/d48/dab/fcc [0,4194304] 0 2024-09-13T21:45:08.303 INFO:tasks.workunit.client.1.smithi155.stdout:4/907: sync 2024-09-13T21:45:08.305 INFO:tasks.workunit.client.1.smithi155.stdout:4/908: mkdir d1/d7/d21/dc6/d11a 0 2024-09-13T21:45:08.308 INFO:tasks.workunit.client.1.smithi155.stdout:4/909: rename d1/d7/d21/d2d/lac to d1/d48/l11b 0 2024-09-13T21:45:08.313 INFO:tasks.workunit.client.1.smithi155.stdout:4/910: dwrite d1/d7/d21/d69/fea [0,4194304] 0 2024-09-13T21:45:08.314 INFO:tasks.workunit.client.1.smithi155.stdout:4/911: fsync d1/d7/de/d1a/ffc 0 2024-09-13T21:45:08.317 INFO:tasks.workunit.client.1.smithi155.stdout:4/912: mknod d1/d7/de/dc/d4a/c11c 0 2024-09-13T21:45:08.318 INFO:tasks.workunit.client.1.smithi155.stdout:4/913: write d1/d48/f51 [4784090,107258] 0 2024-09-13T21:45:08.319 INFO:tasks.workunit.client.1.smithi155.stdout:4/914: write d1/d7/de/d15/dce/dd8/f100 [77456,66530] 0 2024-09-13T21:45:08.323 INFO:tasks.workunit.client.1.smithi155.stdout:4/915: rename d1/d7/de/d15/ffb to d1/d7/de/d72/da6/f11d 0 2024-09-13T21:45:08.325 INFO:tasks.workunit.client.1.smithi155.stdout:4/916: symlink d1/d7/de/d15/dce/d118/l11e 0 2024-09-13T21:45:08.331 INFO:tasks.workunit.client.1.smithi155.stdout:4/917: dwrite d1/d7/d21/d2d/fc8 [0,4194304] 0 2024-09-13T21:45:08.340 INFO:tasks.workunit.client.1.smithi155.stdout:4/918: truncate d1/d7/de/d15/d55/d5e/d66/dc2/fad 1594652 0 2024-09-13T21:45:08.342 INFO:tasks.workunit.client.1.smithi155.stdout:4/919: dread d1/d7/de/d15/dce/dd8/f100 [0,4194304] 0 2024-09-13T21:45:08.344 INFO:tasks.workunit.client.1.smithi155.stdout:4/920: mkdir d1/d7/d21/dc6/ddb/d11f 0 2024-09-13T21:45:08.345 INFO:tasks.workunit.client.1.smithi155.stdout:2/842: sync 2024-09-13T21:45:08.345 INFO:tasks.workunit.client.1.smithi155.stdout:7/976: sync 2024-09-13T21:45:08.345 INFO:tasks.workunit.client.1.smithi155.stdout:5/904: sync 2024-09-13T21:45:08.345 INFO:tasks.workunit.client.1.smithi155.stdout:8/835: sync 2024-09-13T21:45:08.345 INFO:tasks.workunit.client.1.smithi155.stdout:8/836: stat d2/d8 0 2024-09-13T21:45:08.346 INFO:tasks.workunit.client.1.smithi155.stdout:5/905: read - d5/d16/d33/d1b/f9c zero size 2024-09-13T21:45:08.346 INFO:tasks.workunit.client.1.smithi155.stdout:2/843: chown d2/dd/d37/d4e/f87 23892 1 2024-09-13T21:45:08.347 INFO:tasks.workunit.client.1.smithi155.stdout:4/921: unlink d1/d7/de/d1a/ld9 0 2024-09-13T21:45:08.348 INFO:tasks.workunit.client.1.smithi155.stdout:5/906: chown d5/d16/d33/d1b/d28/d52/lc5 3580563 1 2024-09-13T21:45:08.349 INFO:tasks.workunit.client.1.smithi155.stdout:7/977: creat d5/f132 x:0 0 0 2024-09-13T21:45:08.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/922: creat d1/d7/d21/d69/d98/f120 x:0 0 0 2024-09-13T21:45:08.350 INFO:tasks.workunit.client.1.smithi155.stdout:5/907: write d5/d16/d33/d1b/d59/dd1/ddb/ff9 [5563991,60023] 0 2024-09-13T21:45:08.355 INFO:tasks.workunit.client.1.smithi155.stdout:4/923: mknod d1/d7/d21/dc6/c121 0 2024-09-13T21:45:08.355 INFO:tasks.workunit.client.1.smithi155.stdout:5/908: truncate d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/ff8 339798 0 2024-09-13T21:45:08.356 INFO:tasks.workunit.client.1.smithi155.stdout:4/924: fsync d1/d7/de/d1a/ffc 0 2024-09-13T21:45:08.356 INFO:tasks.workunit.client.1.smithi155.stdout:7/978: rename d5/d10/d3e/d3f/lb3 to d5/da6/dfb/l133 0 2024-09-13T21:45:08.358 INFO:tasks.workunit.client.1.smithi155.stdout:7/979: stat d5/df/d15/d33/d55/d97/cea 0 2024-09-13T21:45:08.358 INFO:tasks.workunit.client.1.smithi155.stdout:8/837: write d2/d1f/f84 [246224,61223] 0 2024-09-13T21:45:08.359 INFO:tasks.workunit.client.1.smithi155.stdout:4/925: creat d1/d7/de/d72/da6/f122 x:0 0 0 2024-09-13T21:45:08.361 INFO:tasks.workunit.client.1.smithi155.stdout:5/909: creat d5/d16/f11f x:0 0 0 2024-09-13T21:45:08.364 INFO:tasks.workunit.client.1.smithi155.stdout:8/838: mknod d2/d6/dd/d106/d96/dcc/df4/dfd/c10c 0 2024-09-13T21:45:08.365 INFO:tasks.workunit.client.1.smithi155.stdout:7/980: link d5/d10/d3e/dd2/dd8/l11b d5/d10/l134 0 2024-09-13T21:45:08.367 INFO:tasks.workunit.client.1.smithi155.stdout:7/981: chown d5/df/d60/d6d/lc6 702788339 1 2024-09-13T21:45:08.371 INFO:tasks.workunit.client.1.smithi155.stdout:8/839: dwrite d2/d8/d75/d82/dd6/fe1 [0,4194304] 0 2024-09-13T21:45:08.374 INFO:tasks.workunit.client.1.smithi155.stdout:4/926: dread d1/d7/d21/d2d/d42/fb0 [0,4194304] 0 2024-09-13T21:45:08.379 INFO:tasks.workunit.client.1.smithi155.stdout:2/844: dread d2/db/f1e [0,4194304] 0 2024-09-13T21:45:08.411 INFO:tasks.workunit.client.1.smithi155.stdout:7/982: rename d5/d10/d3e/d3f/f66 to d5/d10/d3e/d3f/d61/dd9/d12a/f135 0 2024-09-13T21:45:08.412 INFO:tasks.workunit.client.1.smithi155.stdout:8/840: creat d2/d6/dd/d106/d96/db8/f10d x:0 0 0 2024-09-13T21:45:08.413 INFO:tasks.workunit.client.1.smithi155.stdout:4/927: unlink d1/d7/d21/c43 0 2024-09-13T21:45:08.414 INFO:tasks.workunit.client.1.smithi155.stdout:2/845: fsync d2/db/f1d 0 2024-09-13T21:45:08.421 INFO:tasks.workunit.client.1.smithi155.stdout:2/846: dwrite d2/dd/d21/ffe [0,4194304] 0 2024-09-13T21:45:08.428 INFO:tasks.workunit.client.1.smithi155.stdout:4/928: dread d1/d7/de/d15/f71 [0,4194304] 0 2024-09-13T21:45:08.429 INFO:tasks.workunit.client.1.smithi155.stdout:4/929: fsync d1/d7/d21/d2d/d42/df8/ffe 0 2024-09-13T21:45:08.441 INFO:tasks.workunit.client.1.smithi155.stdout:7/983: mkdir d5/d10/d3e/d136 0 2024-09-13T21:45:08.441 INFO:tasks.workunit.client.1.smithi155.stdout:8/841: creat d2/def/f10e x:0 0 0 2024-09-13T21:45:08.443 INFO:tasks.workunit.client.1.smithi155.stdout:2/847: truncate d2/dd/d37/d4e/f87 4597531 0 2024-09-13T21:45:08.447 INFO:tasks.workunit.client.1.smithi155.stdout:2/848: rename f1 to d2/dd/d21/d39/dc1/d66/d6f/d11d/f12a 0 2024-09-13T21:45:08.448 INFO:tasks.workunit.client.1.smithi155.stdout:8/842: unlink d2/d8/d65/f41 0 2024-09-13T21:45:08.451 INFO:tasks.workunit.client.1.smithi155.stdout:4/930: dwrite d1/d7/de/d1a/fcc [0,4194304] 0 2024-09-13T21:45:08.456 INFO:tasks.workunit.client.1.smithi155.stdout:2/849: symlink d2/db/l12b 0 2024-09-13T21:45:08.456 INFO:tasks.workunit.client.1.smithi155.stdout:4/931: dread - d1/d7/d21/d69/fc0 zero size 2024-09-13T21:45:08.459 INFO:tasks.workunit.client.1.smithi155.stdout:8/843: rename d2/d6/dd/d106/l31 to d2/d91/l10f 0 2024-09-13T21:45:08.461 INFO:tasks.workunit.client.1.smithi155.stdout:7/984: dread d5/df/d60/f86 [0,4194304] 0 2024-09-13T21:45:08.461 INFO:tasks.workunit.client.1.smithi155.stdout:2/850: creat d2/dd/de/d15/d38/d41/d5f/d70/f12c x:0 0 0 2024-09-13T21:45:08.462 INFO:tasks.workunit.client.1.smithi155.stdout:7/985: readlink d5/df/d60/d6d/lc6 0 2024-09-13T21:45:08.463 INFO:tasks.workunit.client.1.smithi155.stdout:2/851: write d2/dd/d21/d39/d84/f109 [769663,44163] 0 2024-09-13T21:45:08.464 INFO:tasks.workunit.client.1.smithi155.stdout:4/932: rename d1/f3b to d1/d7/de/d72/da6/f123 0 2024-09-13T21:45:08.464 INFO:tasks.workunit.client.1.smithi155.stdout:7/986: write d5/d10/d3e/d40/f70 [353454,128658] 0 2024-09-13T21:45:08.464 INFO:tasks.workunit.client.1.smithi155.stdout:4/933: fsync d1/f114 0 2024-09-13T21:45:08.468 INFO:tasks.workunit.client.1.smithi155.stdout:2/852: fsync d2/f92 0 2024-09-13T21:45:08.469 INFO:tasks.workunit.client.1.smithi155.stdout:4/934: write d1/d7/de/d15/d55/d5e/d66/f116 [176270,60203] 0 2024-09-13T21:45:08.472 INFO:tasks.workunit.client.1.smithi155.stdout:4/935: mknod d1/d7/d21/dc6/c124 0 2024-09-13T21:45:08.472 INFO:tasks.workunit.client.1.smithi155.stdout:8/844: link d2/d1f/c3b d2/d8/c110 0 2024-09-13T21:45:08.474 INFO:tasks.workunit.client.1.smithi155.stdout:8/845: write d2/d6/dd/d106/d96/dcc/fd2 [527144,25460] 0 2024-09-13T21:45:08.474 INFO:tasks.workunit.client.1.smithi155.stdout:4/936: creat d1/d7/de/d15/d55/d5e/f125 x:0 0 0 2024-09-13T21:45:08.475 INFO:tasks.workunit.client.1.smithi155.stdout:8/846: stat d2/d8/f100 0 2024-09-13T21:45:08.476 INFO:tasks.workunit.client.1.smithi155.stdout:4/937: chown d1/d7/de/d15/d55/d5e/d66/l92 1439291 1 2024-09-13T21:45:08.477 INFO:tasks.workunit.client.1.smithi155.stdout:8/847: write d2/d8/d65/d105/f97 [494953,110232] 0 2024-09-13T21:45:08.477 INFO:tasks.workunit.client.1.smithi155.stdout:4/938: chown d1/d7/d21/d2d/f6d 1697097 1 2024-09-13T21:45:08.479 INFO:tasks.workunit.client.1.smithi155.stdout:8/848: symlink d2/d1f/d77/l111 0 2024-09-13T21:45:08.480 INFO:tasks.workunit.client.1.smithi155.stdout:4/939: creat d1/d7/de/d1a/f126 x:0 0 0 2024-09-13T21:45:08.482 INFO:tasks.workunit.client.1.smithi155.stdout:8/849: creat d2/d6/dd/d106/d96/dcc/df4/dfd/f112 x:0 0 0 2024-09-13T21:45:08.483 INFO:tasks.workunit.client.1.smithi155.stdout:4/940: creat d1/d7/de/dc/d4a/dd1/f127 x:0 0 0 2024-09-13T21:45:08.483 INFO:tasks.workunit.client.1.smithi155.stdout:4/941: chown d1/d7/f9a 80 1 2024-09-13T21:45:08.484 INFO:tasks.workunit.client.1.smithi155.stdout:8/850: unlink d2/dae/dbe/fd5 0 2024-09-13T21:45:08.485 INFO:tasks.workunit.client.1.smithi155.stdout:4/942: mknod d1/d7/d21/dc6/ddb/c128 0 2024-09-13T21:45:08.487 INFO:tasks.workunit.client.1.smithi155.stdout:8/851: creat d2/d8/d75/d82/dd6/f113 x:0 0 0 2024-09-13T21:45:08.490 INFO:tasks.workunit.client.1.smithi155.stdout:8/852: symlink d2/d6/dd/d106/d96/dcc/df4/dfd/l114 0 2024-09-13T21:45:08.493 INFO:tasks.workunit.client.1.smithi155.stdout:1/872: sync 2024-09-13T21:45:08.494 INFO:tasks.workunit.client.1.smithi155.stdout:8/853: read d2/d6/dd/d25/f29 [153243,130785] 0 2024-09-13T21:45:08.494 INFO:tasks.workunit.client.1.smithi155.stdout:1/873: truncate d6/d7/f110 189752 0 2024-09-13T21:45:08.495 INFO:tasks.workunit.client.1.smithi155.stdout:8/854: write d2/d91/fe9 [688986,115842] 0 2024-09-13T21:45:08.496 INFO:tasks.workunit.client.1.smithi155.stdout:1/874: mknod d6/d7/d89/c11f 0 2024-09-13T21:45:08.501 INFO:tasks.workunit.client.1.smithi155.stdout:8/855: creat d2/d1f/d87/f115 x:0 0 0 2024-09-13T21:45:08.502 INFO:tasks.workunit.client.1.smithi155.stdout:1/875: creat d6/d7/d48/f120 x:0 0 0 2024-09-13T21:45:08.503 INFO:tasks.workunit.client.1.smithi155.stdout:8/856: mknod d2/def/c116 0 2024-09-13T21:45:08.504 INFO:tasks.workunit.client.1.smithi155.stdout:1/876: creat d6/d7/d89/dd6/de0/f121 x:0 0 0 2024-09-13T21:45:08.505 INFO:tasks.workunit.client.1.smithi155.stdout:4/943: write d1/d7/de/d15/fd0 [998977,74991] 0 2024-09-13T21:45:08.508 INFO:tasks.workunit.client.1.smithi155.stdout:4/944: mkdir d1/d7/d21/d69/d129 0 2024-09-13T21:45:08.508 INFO:tasks.workunit.client.1.smithi155.stdout:8/857: link d2/d6/dd/d106/d96/la6 d2/d8/d75/d82/dd6/dff/l117 0 2024-09-13T21:45:08.509 INFO:tasks.workunit.client.1.smithi155.stdout:4/945: fdatasync d1/d7/fa1 0 2024-09-13T21:45:08.511 INFO:tasks.workunit.client.1.smithi155.stdout:8/858: stat d2/d6/dd/fa3 0 2024-09-13T21:45:08.511 INFO:tasks.workunit.client.1.smithi155.stdout:4/946: write d1/f114 [729808,68012] 0 2024-09-13T21:45:08.513 INFO:tasks.workunit.client.1.smithi155.stdout:1/877: dwrite d6/d15/d23/d55/d6e/dbb/fce [0,4194304] 0 2024-09-13T21:45:08.514 INFO:tasks.workunit.client.1.smithi155.stdout:8/859: write d2/d8/d75/ffc [524126,118136] 0 2024-09-13T21:45:08.520 INFO:tasks.workunit.client.1.smithi155.stdout:4/947: symlink d1/d7/d21/dc6/d11a/l12a 0 2024-09-13T21:45:08.522 INFO:tasks.workunit.client.1.smithi155.stdout:8/860: mknod d2/d8/d5e/d60/c118 0 2024-09-13T21:45:08.523 INFO:tasks.workunit.client.1.smithi155.stdout:4/948: mknod d1/d7/de/d72/c12b 0 2024-09-13T21:45:08.523 INFO:tasks.workunit.client.1.smithi155.stdout:8/861: fsync d2/d8/d75/d82/dd6/f113 0 2024-09-13T21:45:08.524 INFO:tasks.workunit.client.1.smithi155.stdout:8/862: dread - d2/d8/f80 zero size 2024-09-13T21:45:08.524 INFO:tasks.workunit.client.1.smithi155.stdout:1/878: write d6/d82/d90/fcd [104323,65808] 0 2024-09-13T21:45:08.525 INFO:tasks.workunit.client.1.smithi155.stdout:4/949: mkdir d1/d7/de/dc/d4a/d12c 0 2024-09-13T21:45:08.528 INFO:tasks.workunit.client.1.smithi155.stdout:1/879: mknod d6/d15/d23/c122 0 2024-09-13T21:45:08.529 INFO:tasks.workunit.client.1.smithi155.stdout:4/950: unlink d1/d48/l11b 0 2024-09-13T21:45:08.534 INFO:tasks.workunit.client.1.smithi155.stdout:4/951: truncate d1/d7/de/d72/da6/f11d 51066 0 2024-09-13T21:45:08.534 INFO:tasks.workunit.client.1.smithi155.stdout:1/880: dwrite d6/d15/d23/d87/f71 [0,4194304] 0 2024-09-13T21:45:08.537 INFO:tasks.workunit.client.1.smithi155.stdout:4/952: mknod d1/d7/de/d15/d55/de3/c12d 0 2024-09-13T21:45:08.538 INFO:tasks.workunit.client.1.smithi155.stdout:1/881: creat d6/d82/d91/f123 x:0 0 0 2024-09-13T21:45:08.540 INFO:tasks.workunit.client.1.smithi155.stdout:4/953: rmdir d1/d7/de/dc 39 2024-09-13T21:45:08.541 INFO:tasks.workunit.client.1.smithi155.stdout:1/882: mkdir d6/d7/d89/dd6/dee/d124 0 2024-09-13T21:45:08.542 INFO:tasks.workunit.client.1.smithi155.stdout:4/954: mkdir d1/d7/d21/d2d/d42/d102/d12e 0 2024-09-13T21:45:08.544 INFO:tasks.workunit.client.1.smithi155.stdout:8/863: dread d2/d8/d65/f68 [0,4194304] 0 2024-09-13T21:45:08.547 INFO:tasks.workunit.client.1.smithi155.stdout:8/864: rename d2/d8/d65/d105/f1e to d2/d8/f119 0 2024-09-13T21:45:08.548 INFO:tasks.workunit.client.1.smithi155.stdout:8/865: fdatasync d2/d1f/d77/fe5 0 2024-09-13T21:45:08.551 INFO:tasks.workunit.client.1.smithi155.stdout:8/866: write d2/d8/d65/f56 [599455,96404] 0 2024-09-13T21:45:08.555 INFO:tasks.workunit.client.1.smithi155.stdout:8/867: mkdir d2/d8/d75/d82/dd6/dff/d11a 0 2024-09-13T21:45:08.556 INFO:tasks.workunit.client.1.smithi155.stdout:8/868: write d2/dae/f10b [61165,63859] 0 2024-09-13T21:45:08.558 INFO:tasks.workunit.client.1.smithi155.stdout:8/869: write d2/d8/f119 [1627531,89339] 0 2024-09-13T21:45:08.559 INFO:tasks.workunit.client.1.smithi155.stdout:1/883: write d6/d15/d23/fb8 [824861,73113] 0 2024-09-13T21:45:08.563 INFO:tasks.workunit.client.1.smithi155.stdout:8/870: symlink d2/d8/d75/d82/dd6/dff/l11b 0 2024-09-13T21:45:08.567 INFO:tasks.workunit.client.1.smithi155.stdout:8/871: getdents d2/d95 0 2024-09-13T21:45:08.568 INFO:tasks.workunit.client.1.smithi155.stdout:1/884: getdents d6/d7/d89/dd6/de0 0 2024-09-13T21:45:08.569 INFO:tasks.workunit.client.1.smithi155.stdout:8/872: fdatasync d2/d8/d65/d105/f2c 0 2024-09-13T21:45:08.571 INFO:tasks.workunit.client.1.smithi155.stdout:4/955: dread d1/d7/d21/dc6/ddb/fe8 [0,4194304] 0 2024-09-13T21:45:08.572 INFO:tasks.workunit.client.1.smithi155.stdout:4/956: chown d1/d7/d21/dc6/ddb/d11f 1 1 2024-09-13T21:45:08.574 INFO:tasks.workunit.client.1.smithi155.stdout:8/873: mknod d2/d8/d5e/d60/c11c 0 2024-09-13T21:45:08.575 INFO:tasks.workunit.client.1.smithi155.stdout:1/885: write d6/d15/f45 [2113241,65817] 0 2024-09-13T21:45:08.577 INFO:tasks.workunit.client.1.smithi155.stdout:8/874: fdatasync d2/d6/dd/f4e 0 2024-09-13T21:45:08.579 INFO:tasks.workunit.client.1.smithi155.stdout:4/957: creat d1/d7/de/f12f x:0 0 0 2024-09-13T21:45:08.580 INFO:tasks.workunit.client.1.smithi155.stdout:1/886: creat d6/d7/d48/dab/f125 x:0 0 0 2024-09-13T21:45:08.580 INFO:tasks.workunit.client.1.smithi155.stdout:4/958: chown d1/fcd 3246 1 2024-09-13T21:45:08.582 INFO:tasks.workunit.client.1.smithi155.stdout:8/875: dread d2/d91/f8e [0,4194304] 0 2024-09-13T21:45:08.582 INFO:tasks.workunit.client.1.smithi155.stdout:4/959: creat d1/d7/de/d15/d55/de3/f130 x:0 0 0 2024-09-13T21:45:08.584 INFO:tasks.workunit.client.1.smithi155.stdout:1/887: creat d6/d15/d23/d55/d6e/dbb/f126 x:0 0 0 2024-09-13T21:45:08.584 INFO:tasks.workunit.client.1.smithi155.stdout:4/960: dread - d1/d7/d21/d69/d98/f120 zero size 2024-09-13T21:45:08.584 INFO:tasks.workunit.client.1.smithi155.stdout:8/876: symlink d2/dae/l11d 0 2024-09-13T21:45:08.585 INFO:tasks.workunit.client.1.smithi155.stdout:1/888: write d6/d15/d23/d87/f71 [753376,124813] 0 2024-09-13T21:45:08.586 INFO:tasks.workunit.client.1.smithi155.stdout:8/877: dread - d2/d1f/d77/f10a zero size 2024-09-13T21:45:08.587 INFO:tasks.workunit.client.1.smithi155.stdout:4/961: mknod d1/d7/de/d15/d55/d5e/df2/c131 0 2024-09-13T21:45:08.589 INFO:tasks.workunit.client.1.smithi155.stdout:1/889: unlink d6/d15/d57/d5d/f7f 0 2024-09-13T21:45:08.589 INFO:tasks.workunit.client.1.smithi155.stdout:4/962: chown d1/d7/de/d15/d55/d5e/d66/d7e/l109 2041678 1 2024-09-13T21:45:08.591 INFO:tasks.workunit.client.1.smithi155.stdout:1/890: dread d6/d15/d23/f104 [0,4194304] 0 2024-09-13T21:45:08.593 INFO:tasks.workunit.client.1.smithi155.stdout:4/963: mkdir d1/d7/de/d15/dce/dd8/d132 0 2024-09-13T21:45:08.593 INFO:tasks.workunit.client.1.smithi155.stdout:8/878: dwrite d2/d1f/d87/f115 [0,4194304] 0 2024-09-13T21:45:08.596 INFO:tasks.workunit.client.1.smithi155.stdout:4/964: readlink d1/d7/de/d15/d55/d5e/d66/dc2/l8c 0 2024-09-13T21:45:08.597 INFO:tasks.workunit.client.1.smithi155.stdout:8/879: rmdir d2/d6/dd/de7 39 2024-09-13T21:45:08.598 INFO:tasks.workunit.client.1.smithi155.stdout:8/880: chown d2/dae 522599 1 2024-09-13T21:45:08.600 INFO:tasks.workunit.client.1.smithi155.stdout:1/891: rename d6/d15/d23/d55/dfd/c10a to d6/d15/d23/d87/de2/c127 0 2024-09-13T21:45:08.605 INFO:tasks.workunit.client.1.smithi155.stdout:4/965: write d1/d7/de/dc/d4a/fda [9160912,100323] 0 2024-09-13T21:45:08.605 INFO:tasks.workunit.client.1.smithi155.stdout:8/881: chown d2/d6/dd/d106/d96/la6 155941583 1 2024-09-13T21:45:08.607 INFO:tasks.workunit.client.1.smithi155.stdout:8/882: dread d2/d1f/f53 [0,4194304] 0 2024-09-13T21:45:08.610 INFO:tasks.workunit.client.1.smithi155.stdout:8/883: creat d2/def/f11e x:0 0 0 2024-09-13T21:45:08.612 INFO:tasks.workunit.client.1.smithi155.stdout:4/966: dread d1/d7/de/d1a/f68 [0,4194304] 0 2024-09-13T21:45:08.614 INFO:tasks.workunit.client.1.smithi155.stdout:8/884: write d2/d6/dd/d25/f4c [2933856,35464] 0 2024-09-13T21:45:08.614 INFO:tasks.workunit.client.1.smithi155.stdout:1/892: dwrite d6/d15/d57/d99/f4a [0,4194304] 0 2024-09-13T21:45:08.637 INFO:tasks.workunit.client.1.smithi155.stdout:1/893: creat d6/d15/d23/d87/de2/f128 x:0 0 0 2024-09-13T21:45:08.637 INFO:tasks.workunit.client.1.smithi155.stdout:4/967: link d1/l3e d1/d7/de/d15/dce/dd8/df0/l133 0 2024-09-13T21:45:08.640 INFO:tasks.workunit.client.1.smithi155.stdout:8/885: dread d2/d6/dd/d106/d96/dcc/fde [0,4194304] 0 2024-09-13T21:45:08.641 INFO:tasks.workunit.client.1.smithi155.stdout:1/894: creat d6/d15/d23/f129 x:0 0 0 2024-09-13T21:45:08.641 INFO:tasks.workunit.client.1.smithi155.stdout:1/895: stat d6/d15/d23/fb8 0 2024-09-13T21:45:08.642 INFO:tasks.workunit.client.1.smithi155.stdout:8/886: mkdir d2/d8/d11f 0 2024-09-13T21:45:08.643 INFO:tasks.workunit.client.1.smithi155.stdout:4/968: dread d1/d7/d21/d2d/d42/df8/ffe [0,4194304] 0 2024-09-13T21:45:08.643 INFO:tasks.workunit.client.1.smithi155.stdout:1/896: write d6/d15/d57/d5d/f5f [2099153,56340] 0 2024-09-13T21:45:08.647 INFO:tasks.workunit.client.1.smithi155.stdout:8/887: getdents d2/d6 0 2024-09-13T21:45:08.647 INFO:tasks.workunit.client.1.smithi155.stdout:4/969: creat d1/d7/d21/d2d/d42/df8/f134 x:0 0 0 2024-09-13T21:45:08.649 INFO:tasks.workunit.client.1.smithi155.stdout:4/970: write d1/d7/de/d15/fd0 [1659161,36678] 0 2024-09-13T21:45:08.654 INFO:tasks.workunit.client.1.smithi155.stdout:4/971: rename d1/d7/de/d72/f34 to d1/d7/de/d15/d55/d5e/f135 0 2024-09-13T21:45:08.657 INFO:tasks.workunit.client.1.smithi155.stdout:4/972: chown d1/d7/de/d15/dce/dd8/f100 0 1 2024-09-13T21:45:08.657 INFO:tasks.workunit.client.1.smithi155.stdout:1/897: dwrite d6/d82/d90/f6c [4194304,4194304] 0 2024-09-13T21:45:08.660 INFO:tasks.workunit.client.1.smithi155.stdout:8/888: dwrite d2/d1f/d87/d9a/f9c [0,4194304] 0 2024-09-13T21:45:08.662 INFO:tasks.workunit.client.1.smithi155.stdout:1/898: read d6/d15/d23/d87/f71 [4423621,75662] 0 2024-09-13T21:45:08.663 INFO:tasks.workunit.client.1.smithi155.stdout:4/973: unlink d1/d7/de/d15/d55/d5e/f5f 0 2024-09-13T21:45:08.664 INFO:tasks.workunit.client.1.smithi155.stdout:1/899: write d6/d15/d23/d55/d6e/dbb/fce [3776319,101739] 0 2024-09-13T21:45:08.667 INFO:tasks.workunit.client.1.smithi155.stdout:8/889: fdatasync d2/d6/dd/d25/fc2 0 2024-09-13T21:45:08.670 INFO:tasks.workunit.client.1.smithi155.stdout:4/974: unlink d1/d7/de/d15/d55/d5e/d66/f111 0 2024-09-13T21:45:08.671 INFO:tasks.workunit.client.1.smithi155.stdout:1/900: mkdir d6/d15/d23/d55/db9/d12a 0 2024-09-13T21:45:08.672 INFO:tasks.workunit.client.1.smithi155.stdout:1/901: dread - d6/d82/d91/f123 zero size 2024-09-13T21:45:08.673 INFO:tasks.workunit.client.1.smithi155.stdout:8/890: creat d2/d8/f120 x:0 0 0 2024-09-13T21:45:08.673 INFO:tasks.workunit.client.1.smithi155.stdout:4/975: mknod d1/d7/de/d15/dce/dd8/d132/c136 0 2024-09-13T21:45:08.675 INFO:tasks.workunit.client.1.smithi155.stdout:4/976: write d1/d7/d21/fec [518310,110852] 0 2024-09-13T21:45:08.675 INFO:tasks.workunit.client.1.smithi155.stdout:8/891: fdatasync d2/d8/d65/da8/fcf 0 2024-09-13T21:45:08.676 INFO:tasks.workunit.client.1.smithi155.stdout:8/892: stat d2/l38 0 2024-09-13T21:45:08.678 INFO:tasks.workunit.client.1.smithi155.stdout:4/977: unlink d1/d7/d21/d2d/d42/fb0 0 2024-09-13T21:45:08.679 INFO:tasks.workunit.client.1.smithi155.stdout:5/910: sync 2024-09-13T21:45:08.680 INFO:tasks.workunit.client.1.smithi155.stdout:5/911: chown d5 148302449 1 2024-09-13T21:45:08.682 INFO:tasks.workunit.client.1.smithi155.stdout:5/912: fsync d5/d16/d33/d1b/d2f/d3c/d6c/f79 0 2024-09-13T21:45:08.684 INFO:tasks.workunit.client.1.smithi155.stdout:5/913: write d5/d16/d4e/d85/ff6 [460682,74649] 0 2024-09-13T21:45:08.688 INFO:tasks.workunit.client.1.smithi155.stdout:5/914: read d5/d16/d81/d98/d84/fc0 [27782,92208] 0 2024-09-13T21:45:08.691 INFO:tasks.workunit.client.1.smithi155.stdout:1/902: write d6/d15/d57/d5d/fd0 [276067,449] 0 2024-09-13T21:45:08.692 INFO:tasks.workunit.client.1.smithi155.stdout:1/903: readlink d6/d15/d23/d55/d6e/le3 0 2024-09-13T21:45:08.693 INFO:tasks.workunit.client.1.smithi155.stdout:1/904: dread - d6/d7/d48/f11a zero size 2024-09-13T21:45:08.694 INFO:tasks.workunit.client.1.smithi155.stdout:8/893: write d2/d8/d5e/d60/fc4 [318742,37447] 0 2024-09-13T21:45:08.695 INFO:tasks.workunit.client.1.smithi155.stdout:1/905: truncate d6/d7/f24 4930438 0 2024-09-13T21:45:08.699 INFO:tasks.workunit.client.1.smithi155.stdout:8/894: mkdir d2/d8/d5e/d60/db2/d121 0 2024-09-13T21:45:08.699 INFO:tasks.workunit.client.1.smithi155.stdout:4/978: dread d1/d7/d21/f57 [0,4194304] 0 2024-09-13T21:45:08.699 INFO:tasks.workunit.client.1.smithi155.stdout:1/906: truncate d6/d7/fb2 1139417 0 2024-09-13T21:45:08.700 INFO:tasks.workunit.client.1.smithi155.stdout:1/907: readlink d6/d15/d23/d55/d6e/le3 0 2024-09-13T21:45:08.705 INFO:tasks.workunit.client.1.smithi155.stdout:8/895: rename d2/d6/dd/d106/l58 to d2/d8/d75/d82/dd6/dff/l122 0 2024-09-13T21:45:08.705 INFO:tasks.workunit.client.1.smithi155.stdout:1/908: read - d6/d15/d23/d55/d6e/dbb/f5e zero size 2024-09-13T21:45:08.705 INFO:tasks.workunit.client.1.smithi155.stdout:4/979: creat d1/d7/de/d15/dce/f137 x:0 0 0 2024-09-13T21:45:08.706 INFO:tasks.workunit.client.1.smithi155.stdout:8/896: mknod d2/d8/d65/da8/c123 0 2024-09-13T21:45:08.706 INFO:tasks.workunit.client.1.smithi155.stdout:5/915: dread d5/d16/d81/d98/f4d [0,4194304] 0 2024-09-13T21:45:08.706 INFO:tasks.workunit.client.1.smithi155.stdout:1/909: mkdir d6/d82/d91/d10f/d12b 0 2024-09-13T21:45:08.710 INFO:tasks.workunit.client.1.smithi155.stdout:4/980: mkdir d1/d7/de/d15/d55/d138 0 2024-09-13T21:45:08.712 INFO:tasks.workunit.client.1.smithi155.stdout:4/981: stat d1/d7/de/d1a/fcc 0 2024-09-13T21:45:08.714 INFO:tasks.workunit.client.1.smithi155.stdout:8/897: dwrite d2/d8/d75/ffc [0,4194304] 0 2024-09-13T21:45:08.714 INFO:tasks.workunit.client.1.smithi155.stdout:1/910: getdents d6/d15/d23/d87 0 2024-09-13T21:45:08.717 INFO:tasks.workunit.client.1.smithi155.stdout:8/898: dread - d2/d6/dd/d106/d96/db8/f10d zero size 2024-09-13T21:45:08.717 INFO:tasks.workunit.client.1.smithi155.stdout:5/916: write d5/d16/d33/d1f/f4f [591332,31263] 0 2024-09-13T21:45:08.717 INFO:tasks.workunit.client.1.smithi155.stdout:1/911: symlink d6/d7/d89/dd6/de0/l12c 0 2024-09-13T21:45:08.719 INFO:tasks.workunit.client.1.smithi155.stdout:5/917: readlink d5/d16/d33/d1b/l69 0 2024-09-13T21:45:08.722 INFO:tasks.workunit.client.1.smithi155.stdout:8/899: write d2/d8/f80 [954430,77078] 0 2024-09-13T21:45:08.724 INFO:tasks.workunit.client.1.smithi155.stdout:4/982: dwrite d1/d48/f95 [0,4194304] 0 2024-09-13T21:45:08.725 INFO:tasks.workunit.client.1.smithi155.stdout:8/900: chown d2/d8/d5e/d60/c118 4839128 1 2024-09-13T21:45:08.728 INFO:tasks.workunit.client.1.smithi155.stdout:4/983: mknod d1/d7/d21/d69/c139 0 2024-09-13T21:45:08.731 INFO:tasks.workunit.client.1.smithi155.stdout:5/918: rename d5/d16/d33/d1b/d2f/d3c/d6c/c87 to d5/d16/d81/df5/c120 0 2024-09-13T21:45:08.732 INFO:tasks.workunit.client.1.smithi155.stdout:8/901: creat d2/d6/dd/d106/d96/db8/f124 x:0 0 0 2024-09-13T21:45:08.733 INFO:tasks.workunit.client.1.smithi155.stdout:4/984: fsync d1/d7/d21/f8d 0 2024-09-13T21:45:08.735 INFO:tasks.workunit.client.1.smithi155.stdout:5/919: symlink d5/d16/d33/d1b/l121 0 2024-09-13T21:45:08.739 INFO:tasks.workunit.client.1.smithi155.stdout:4/985: read d1/f6 [304873,119728] 0 2024-09-13T21:45:08.741 INFO:tasks.workunit.client.1.smithi155.stdout:4/986: dread - d1/d7/de/dc/d4a/fb5 zero size 2024-09-13T21:45:08.742 INFO:tasks.workunit.client.1.smithi155.stdout:8/902: dread d2/d8/d75/fbf [0,4194304] 0 2024-09-13T21:45:08.744 INFO:tasks.workunit.client.1.smithi155.stdout:7/987: sync 2024-09-13T21:45:08.744 INFO:tasks.workunit.client.1.smithi155.stdout:2/853: sync 2024-09-13T21:45:08.744 INFO:tasks.workunit.client.1.smithi155.stdout:4/987: rename d1/d7/d21/fec to d1/d7/de/d15/dce/dd8/df0/f13a 0 2024-09-13T21:45:08.745 INFO:tasks.workunit.client.1.smithi155.stdout:7/988: dread - d5/d10/dbf/f120 zero size 2024-09-13T21:45:08.746 INFO:tasks.workunit.client.1.smithi155.stdout:8/903: mknod d2/d6/dd/d106/d96/c125 0 2024-09-13T21:45:08.751 INFO:tasks.workunit.client.1.smithi155.stdout:1/912: dread d6/d15/d57/d99/f4f [0,4194304] 0 2024-09-13T21:45:08.751 INFO:tasks.workunit.client.1.smithi155.stdout:7/989: fdatasync d5/df/d15/d33/d55/f9b 0 2024-09-13T21:45:08.753 INFO:tasks.workunit.client.1.smithi155.stdout:2/854: symlink d2/dd/de/d15/d38/d41/d5f/d104/l12d 0 2024-09-13T21:45:08.753 INFO:tasks.workunit.client.1.smithi155.stdout:5/920: write d5/d16/d81/d98/d84/fc0 [880301,50624] 0 2024-09-13T21:45:08.757 INFO:tasks.workunit.client.1.smithi155.stdout:4/988: rmdir d1/d7/de/d15/dce 39 2024-09-13T21:45:08.757 INFO:tasks.workunit.client.1.smithi155.stdout:8/904: rmdir d2/d6/dd/d106/d96/dcc 39 2024-09-13T21:45:08.762 INFO:tasks.workunit.client.1.smithi155.stdout:1/913: creat d6/d15/d23/d55/db9/d12a/f12d x:0 0 0 2024-09-13T21:45:08.762 INFO:tasks.workunit.client.1.smithi155.stdout:4/989: truncate d1/f6 2265789 0 2024-09-13T21:45:08.766 INFO:tasks.workunit.client.1.smithi155.stdout:8/905: rmdir d2/d8/d65 39 2024-09-13T21:45:08.766 INFO:tasks.workunit.client.1.smithi155.stdout:2/855: creat d2/dd/d37/d94/f12e x:0 0 0 2024-09-13T21:45:08.768 INFO:tasks.workunit.client.1.smithi155.stdout:7/990: dwrite d5/d10/d3e/d40/f110 [0,4194304] 0 2024-09-13T21:45:08.770 INFO:tasks.workunit.client.1.smithi155.stdout:1/914: creat d6/d82/d91/daf/f12e x:0 0 0 2024-09-13T21:45:08.771 INFO:tasks.workunit.client.1.smithi155.stdout:4/990: stat d1/d7/de/d15/f5b 0 2024-09-13T21:45:08.771 INFO:tasks.workunit.client.1.smithi155.stdout:8/906: mknod d2/d6/c126 0 2024-09-13T21:45:08.775 INFO:tasks.workunit.client.1.smithi155.stdout:2/856: creat d2/dd/de/d15/d3f/de2/f12f x:0 0 0 2024-09-13T21:45:08.777 INFO:tasks.workunit.client.1.smithi155.stdout:8/907: write d2/d8/f119 [1355124,102606] 0 2024-09-13T21:45:08.777 INFO:tasks.workunit.client.1.smithi155.stdout:4/991: getdents d1/d7/d21/d69/d129 0 2024-09-13T21:45:08.782 INFO:tasks.workunit.client.1.smithi155.stdout:8/908: chown d2/ld4 105599 1 2024-09-13T21:45:08.782 INFO:tasks.workunit.client.1.smithi155.stdout:2/857: creat d2/dd/d21/dc6/dd6/f130 x:0 0 0 2024-09-13T21:45:08.785 INFO:tasks.workunit.client.1.smithi155.stdout:4/992: chown d1/d7/de/l103 4 1 2024-09-13T21:45:08.785 INFO:tasks.workunit.client.1.smithi155.stdout:1/915: creat d6/d15/d23/d55/d6e/dbb/d4b/f12f x:0 0 0 2024-09-13T21:45:08.787 INFO:tasks.workunit.client.1.smithi155.stdout:7/991: dwrite d5/d13/fa5 [0,4194304] 0 2024-09-13T21:45:08.789 INFO:tasks.workunit.client.1.smithi155.stdout:4/993: write d1/d7/d5a/fd4 [85828,85282] 0 2024-09-13T21:45:08.790 INFO:tasks.workunit.client.1.smithi155.stdout:1/916: fdatasync d6/d82/d91/f123 0 2024-09-13T21:45:08.793 INFO:tasks.workunit.client.1.smithi155.stdout:5/921: dwrite d5/d16/d33/d1b/d1e/f4c [0,4194304] 0 2024-09-13T21:45:08.802 INFO:tasks.workunit.client.1.smithi155.stdout:8/909: mknod d2/d8/d11f/c127 0 2024-09-13T21:45:08.804 INFO:tasks.workunit.client.1.smithi155.stdout:5/922: dwrite d5/d16/d33/d1f/f4f [4194304,4194304] 0 2024-09-13T21:45:08.809 INFO:tasks.workunit.client.1.smithi155.stdout:8/910: creat d2/d8/d5e/d60/db2/f128 x:0 0 0 2024-09-13T21:45:08.812 INFO:tasks.workunit.client.1.smithi155.stdout:5/923: truncate d5/d16/d33/d1b/d2f/d3c/d5b/d5f/ffd 751693 0 2024-09-13T21:45:08.812 INFO:tasks.workunit.client.1.smithi155.stdout:2/858: dwrite d2/db/f18 [0,4194304] 0 2024-09-13T21:45:08.816 INFO:tasks.workunit.client.1.smithi155.stdout:2/859: read d2/dd/d21/d39/dc1/d96/dba/fbf [139283,53749] 0 2024-09-13T21:45:08.818 INFO:tasks.workunit.client.1.smithi155.stdout:2/860: stat d2/dd/d21/d39/dc1/dc3/fd8 0 2024-09-13T21:45:08.820 INFO:tasks.workunit.client.1.smithi155.stdout:8/911: rename d2/d6/f94 to d2/d8/d65/f129 0 2024-09-13T21:45:08.825 INFO:tasks.workunit.client.1.smithi155.stdout:2/861: rename d2/dd/d21/d39/dc1/d66/f78 to d2/dd/de/d15/d38/f131 0 2024-09-13T21:45:08.826 INFO:tasks.workunit.client.1.smithi155.stdout:8/912: mkdir d2/d8/d12a 0 2024-09-13T21:45:08.830 INFO:tasks.workunit.client.1.smithi155.stdout:7/992: truncate d5/df/d60/f86 2158153 0 2024-09-13T21:45:08.834 INFO:tasks.workunit.client.1.smithi155.stdout:7/993: write d5/f50 [3189708,79537] 0 2024-09-13T21:45:08.835 INFO:tasks.workunit.client.1.smithi155.stdout:8/913: stat d2/d8/d75/lfb 0 2024-09-13T21:45:08.835 INFO:tasks.workunit.client.1.smithi155.stdout:2/862: symlink d2/dd/d21/dc6/dd6/deb/l132 0 2024-09-13T21:45:08.838 INFO:tasks.workunit.client.1.smithi155.stdout:4/994: dwrite d1/d7/d21/dc6/ddb/fe8 [0,4194304] 0 2024-09-13T21:45:08.840 INFO:tasks.workunit.client.1.smithi155.stdout:8/914: chown d2/d8/d65/d105/ff2 25 1 2024-09-13T21:45:08.846 INFO:tasks.workunit.client.1.smithi155.stdout:8/915: truncate d2/d8/d75/d82/dd6/fed 86413 0 2024-09-13T21:45:08.849 INFO:tasks.workunit.client.1.smithi155.stdout:4/995: rename d1/d7/d21/d69/d129 to d1/d7/de/dc/d4a/dd1/d13b 0 2024-09-13T21:45:08.849 INFO:tasks.workunit.client.1.smithi155.stdout:1/917: dread d6/d82/d91/fa4 [0,4194304] 0 2024-09-13T21:45:08.850 INFO:tasks.workunit.client.1.smithi155.stdout:1/918: write d6/d15/fba [2201440,22867] 0 2024-09-13T21:45:08.851 INFO:tasks.workunit.client.1.smithi155.stdout:4/996: readlink d1/d7/de/d72/lbc 0 2024-09-13T21:45:08.851 INFO:tasks.workunit.client.1.smithi155.stdout:1/919: chown d6/d82/lf6 34842 1 2024-09-13T21:45:08.852 INFO:tasks.workunit.client.1.smithi155.stdout:1/920: dread - d6/d15/d23/d55/db9/fd3 zero size 2024-09-13T21:45:08.854 INFO:tasks.workunit.client.1.smithi155.stdout:7/994: creat d5/df/d15/df9/f137 x:0 0 0 2024-09-13T21:45:08.855 INFO:tasks.workunit.client.1.smithi155.stdout:2/863: write d2/dd/d21/dc6/dd6/ff8 [234159,96572] 0 2024-09-13T21:45:08.855 INFO:tasks.workunit.client.1.smithi155.stdout:4/997: write d1/d7/de/dc/d4a/fda [5871537,101838] 0 2024-09-13T21:45:08.857 INFO:tasks.workunit.client.1.smithi155.stdout:8/916: symlink d2/d8/d75/l12b 0 2024-09-13T21:45:08.858 INFO:tasks.workunit.client.1.smithi155.stdout:7/995: readlink d5/l36 0 2024-09-13T21:45:08.859 INFO:tasks.workunit.client.1.smithi155.stdout:7/996: mkdir d5/dcd/d138 0 2024-09-13T21:45:08.861 INFO:tasks.workunit.client.1.smithi155.stdout:4/998: fsync d1/d7/de/d15/ff1 0 2024-09-13T21:45:08.863 INFO:tasks.workunit.client.1.smithi155.stdout:7/997: read d5/df/d15/fa8 [3804955,104740] 0 2024-09-13T21:45:08.863 INFO:tasks.workunit.client.1.smithi155.stdout:8/917: rmdir d2/d8/d65 39 2024-09-13T21:45:08.865 INFO:tasks.workunit.client.1.smithi155.stdout:2/864: getdents d2/dd/d21/d39/dc1/da3 0 2024-09-13T21:45:08.871 INFO:tasks.workunit.client.1.smithi155.stdout:7/998: symlink d5/df/d15/d33/d11f/l139 0 2024-09-13T21:45:08.874 INFO:tasks.workunit.client.1.smithi155.stdout:2/865: dwrite d2/dd/d37/d94/f12e [0,4194304] 0 2024-09-13T21:45:08.876 INFO:tasks.workunit.client.1.smithi155.stdout:4/999: rename d1/d7/de/d72/lbc to d1/d7/de/dc/l13c 0 2024-09-13T21:45:08.882 INFO:tasks.workunit.client.1.smithi155.stdout:1/921: truncate d6/d15/d57/d5d/fd0 2676902 0 2024-09-13T21:45:08.886 INFO:tasks.workunit.client.1.smithi155.stdout:2/866: readlink d2/dd/d21/d39/d84/l102 0 2024-09-13T21:45:08.888 INFO:tasks.workunit.client.1.smithi155.stdout:7/999: dwrite d5/d10/d3e/d3f/d61/dd9/f10f [0,4194304] 0 2024-09-13T21:45:08.890 INFO:tasks.workunit.client.1.smithi155.stdout:1/922: truncate d6/d82/f116 931294 0 2024-09-13T21:45:08.895 INFO:tasks.workunit.client.1.smithi155.stdout:8/918: truncate d2/d6/dd/fa3 3425498 0 2024-09-13T21:45:08.899 INFO:tasks.workunit.client.1.smithi155.stdout:1/923: rename d6/d7/d48/dab/fcc to d6/d15/d57/d99/f130 0 2024-09-13T21:45:08.902 INFO:tasks.workunit.client.1.smithi155.stdout:8/919: fsync d2/d8/d65/da8/fbb 0 2024-09-13T21:45:08.905 INFO:tasks.workunit.client.1.smithi155.stdout:2/867: dread d2/dd/d21/d39/dc1/d66/f7b [0,4194304] 0 2024-09-13T21:45:08.908 INFO:tasks.workunit.client.1.smithi155.stdout:2/868: read d2/db/f4b [2219624,12027] 0 2024-09-13T21:45:08.910 INFO:tasks.workunit.client.1.smithi155.stdout:2/869: symlink d2/dd/d21/d8d/da0/l133 0 2024-09-13T21:45:08.914 INFO:tasks.workunit.client.1.smithi155.stdout:1/924: getdents d6/d7/d48/dab 0 2024-09-13T21:45:08.918 INFO:tasks.workunit.client.1.smithi155.stdout:2/870: mkdir d2/dd/d21/d39/d84/d134 0 2024-09-13T21:45:08.919 INFO:tasks.workunit.client.1.smithi155.stdout:1/925: mkdir d6/d15/d57/d99/d10e/d131 0 2024-09-13T21:45:08.919 INFO:tasks.workunit.client.1.smithi155.stdout:2/871: rename d2 to d2/dd/d21/d39/dc1/d66/de9/d135 22 2024-09-13T21:45:08.922 INFO:tasks.workunit.client.1.smithi155.stdout:1/926: dread - d6/d15/d23/d55/d6e/ff8 zero size 2024-09-13T21:45:08.923 INFO:tasks.workunit.client.1.smithi155.stdout:2/872: creat d2/dd/de/d15/d3f/de2/f136 x:0 0 0 2024-09-13T21:45:08.926 INFO:tasks.workunit.client.1.smithi155.stdout:2/873: symlink d2/dd/d21/dc6/l137 0 2024-09-13T21:45:08.934 INFO:tasks.workunit.client.1.smithi155.stdout:2/874: write d2/dd/d21/d8d/fb9 [1565063,24428] 0 2024-09-13T21:45:08.937 INFO:tasks.workunit.client.1.smithi155.stdout:2/875: fsync d2/dd/de/d15/d38/d41/fb6 0 2024-09-13T21:45:08.937 INFO:tasks.workunit.client.1.smithi155.stdout:2/876: fsync f0 0 2024-09-13T21:45:08.939 INFO:tasks.workunit.client.1.smithi155.stdout:2/877: mknod d2/dd/d21/d39/dc1/dc3/c138 0 2024-09-13T21:45:08.940 INFO:tasks.workunit.client.1.smithi155.stdout:2/878: readlink d2/dd/d21/d39/l91 0 2024-09-13T21:45:08.943 INFO:tasks.workunit.client.1.smithi155.stdout:2/879: write d2/dd/f72 [331512,28453] 0 2024-09-13T21:45:08.945 INFO:tasks.workunit.client.1.smithi155.stdout:2/880: symlink d2/dd/d21/d39/d84/l139 0 2024-09-13T21:45:08.950 INFO:tasks.workunit.client.1.smithi155.stdout:2/881: dwrite d2/db/f63 [0,4194304] 0 2024-09-13T21:45:08.956 INFO:tasks.workunit.client.1.smithi155.stdout:2/882: link d2/dd/d21/d39/dc1/d66/d6f/fa9 d2/dd/d21/d39/dc1/dc3/f13a 0 2024-09-13T21:45:08.958 INFO:tasks.workunit.client.1.smithi155.stdout:2/883: getdents d2 0 2024-09-13T21:45:08.964 INFO:tasks.workunit.client.1.smithi155.stdout:2/884: dwrite d2/db/fdb [0,4194304] 0 2024-09-13T21:45:08.970 INFO:tasks.workunit.client.1.smithi155.stdout:2/885: rename d2/db/d6b/dd9/l11c to d2/dd/de/d15/d121/d111/l13b 0 2024-09-13T21:45:08.971 INFO:tasks.workunit.client.1.smithi155.stdout:2/886: chown d2/db/c6a 20855513 1 2024-09-13T21:45:09.056 INFO:tasks.workunit.client.1.smithi155.stdout:2/887: unlink d2/dd/d37/d4e/fad 0 2024-09-13T21:45:09.058 INFO:tasks.workunit.client.1.smithi155.stdout:2/888: mknod d2/dd/de/d15/d3f/d97/da2/c13c 0 2024-09-13T21:45:09.069 INFO:tasks.workunit.client.1.smithi155.stdout:2/889: dread d2/db/f16 [0,4194304] 0 2024-09-13T21:45:09.073 INFO:tasks.workunit.client.1.smithi155.stdout:2/890: rename d2/dd/dd3 to d2/dd/d21/d39/dc1/d96/dba/d13d 0 2024-09-13T21:45:09.080 INFO:tasks.workunit.client.1.smithi155.stdout:2/891: mknod d2/dd/c13e 0 2024-09-13T21:45:09.082 INFO:tasks.workunit.client.1.smithi155.stdout:2/892: rmdir d2/dd/de/d15/d38/d41/d5f/d70 39 2024-09-13T21:45:09.087 INFO:tasks.workunit.client.1.smithi155.stdout:2/893: rename d2/dd/d21/d39/faa to d2/dd/de/d15/d38/d41/d5f/d70/f13f 0 2024-09-13T21:45:09.087 INFO:tasks.workunit.client.1.smithi155.stdout:2/894: chown d2/dd/de/f55 165489 1 2024-09-13T21:45:09.091 INFO:tasks.workunit.client.1.smithi155.stdout:2/895: write d2/db/d6b/dd9/fe4 [958336,120321] 0 2024-09-13T21:45:09.093 INFO:tasks.workunit.client.1.smithi155.stdout:2/896: fsync d2/dd/d21/d39/dc1/f9b 0 2024-09-13T21:45:09.094 INFO:tasks.workunit.client.1.smithi155.stdout:2/897: chown d2/dd/c5a 1734387334 1 2024-09-13T21:45:09.098 INFO:tasks.workunit.client.1.smithi155.stdout:2/898: write d2/dd/d21/d39/dc1/d66/dd7/f129 [20271,45602] 0 2024-09-13T21:45:09.105 INFO:tasks.workunit.client.1.smithi155.stdout:2/899: dwrite d2/dd/de/d15/d38/d41/fb2 [0,4194304] 0 2024-09-13T21:45:09.110 INFO:tasks.workunit.client.1.smithi155.stdout:2/900: rename d2/dd/de/d15/ce5 to d2/dd/d21/c140 0 2024-09-13T21:45:09.110 INFO:tasks.workunit.client.1.smithi155.stdout:2/901: chown d2/dd/d21/dc6/dd6/deb 57551 1 2024-09-13T21:45:09.110 INFO:tasks.workunit.client.1.smithi155.stdout:2/902: fsync f0 0 2024-09-13T21:45:09.112 INFO:tasks.workunit.client.1.smithi155.stdout:2/903: write d2/dd/d21/f32 [7041808,9301] 0 2024-09-13T21:45:09.114 INFO:tasks.workunit.client.1.smithi155.stdout:2/904: write d2/dd/d21/d39/dc1/d66/f7b [738490,70807] 0 2024-09-13T21:45:09.115 INFO:tasks.workunit.client.1.smithi155.stdout:2/905: chown d2/dd/d21/d39/dc1 441779 1 2024-09-13T21:45:09.117 INFO:tasks.workunit.client.1.smithi155.stdout:2/906: truncate d2/dd/d21/d39/dc1/d66/d7c/fae 527843 0 2024-09-13T21:45:09.119 INFO:tasks.workunit.client.1.smithi155.stdout:2/907: symlink d2/dd/d37/d4e/l141 0 2024-09-13T21:45:09.119 INFO:tasks.workunit.client.1.smithi155.stdout:2/908: chown d2/dd/de/d15/d3f/de2/d11b 809087 1 2024-09-13T21:45:09.120 INFO:tasks.workunit.client.1.smithi155.stdout:2/909: fdatasync d2/dd/d21/d39/dc1/f10a 0 2024-09-13T21:45:09.134 INFO:tasks.workunit.client.1.smithi155.stdout:2/910: dread d2/f92 [0,4194304] 0 2024-09-13T21:45:09.135 INFO:tasks.workunit.client.1.smithi155.stdout:2/911: mknod d2/db/c142 0 2024-09-13T21:45:09.140 INFO:tasks.workunit.client.1.smithi155.stdout:2/912: dwrite d2/dd/de/d15/d38/f131 [0,4194304] 0 2024-09-13T21:45:09.144 INFO:tasks.workunit.client.1.smithi155.stdout:2/913: creat d2/dd/d21/d39/dc1/da3/f143 x:0 0 0 2024-09-13T21:45:09.145 INFO:tasks.workunit.client.1.smithi155.stdout:2/914: chown d2/f92 271151 1 2024-09-13T21:45:09.147 INFO:tasks.workunit.client.1.smithi155.stdout:2/915: mknod d2/dd/d21/d39/dc1/da3/c144 0 2024-09-13T21:45:09.147 INFO:tasks.workunit.client.1.smithi155.stdout:2/916: stat d2/dd/de6 0 2024-09-13T21:45:09.149 INFO:tasks.workunit.client.1.smithi155.stdout:2/917: mknod d2/dd/d21/d8d/da0/c145 0 2024-09-13T21:45:09.151 INFO:tasks.workunit.client.1.smithi155.stdout:2/918: symlink d2/dd/de/d15/d3f/de2/l146 0 2024-09-13T21:45:09.154 INFO:tasks.workunit.client.1.smithi155.stdout:2/919: rename d2/dd/d21/d39/dc1/d96/cbb to d2/dd/d21/d39/dc1/d96/dba/c147 0 2024-09-13T21:45:09.155 INFO:tasks.workunit.client.1.smithi155.stdout:2/920: rmdir d2/dd/d21/d39/dc1 39 2024-09-13T21:45:09.156 INFO:tasks.workunit.client.1.smithi155.stdout:2/921: chown d2/dd/de/d15/d38 8915057 1 2024-09-13T21:45:09.158 INFO:tasks.workunit.client.1.smithi155.stdout:2/922: mkdir d2/dd/d21/d39/dc1/dc3/d148 0 2024-09-13T21:45:09.161 INFO:tasks.workunit.client.1.smithi155.stdout:2/923: dread d2/dd/de/d15/d38/d41/fb2 [0,4194304] 0 2024-09-13T21:45:09.168 INFO:tasks.workunit.client.1.smithi155.stdout:2/924: dwrite d2/dd/d21/d39/dc1/d66/dd7/f122 [0,4194304] 0 2024-09-13T21:45:09.172 INFO:tasks.workunit.client.1.smithi155.stdout:2/925: symlink d2/dd/d21/d8d/da0/de3/l149 0 2024-09-13T21:45:09.193 INFO:tasks.workunit.client.1.smithi155.stdout:2/926: dread d2/db/f40 [0,4194304] 0 2024-09-13T21:45:09.201 INFO:tasks.workunit.client.1.smithi155.stdout:2/927: dwrite d2/dd/de/d15/f46 [0,4194304] 0 2024-09-13T21:45:09.211 INFO:tasks.workunit.client.1.smithi155.stdout:2/928: dwrite d2/dd/d21/d39/dc1/f9b [0,4194304] 0 2024-09-13T21:45:09.212 INFO:tasks.workunit.client.1.smithi155.stdout:2/929: fsync d2/dd/d21/d39/dc1/d66/dd7/f129 0 2024-09-13T21:45:09.215 INFO:tasks.workunit.client.1.smithi155.stdout:2/930: dread - d2/dd/d21/d39/dc1/f10a zero size 2024-09-13T21:45:09.216 INFO:tasks.workunit.client.1.smithi155.stdout:2/931: write d2/db/f1d [1401961,95997] 0 2024-09-13T21:45:09.223 INFO:tasks.workunit.client.1.smithi155.stdout:2/932: dwrite d2/dd/de/d15/d121/f123 [0,4194304] 0 2024-09-13T21:45:09.230 INFO:tasks.workunit.client.1.smithi155.stdout:2/933: getdents d2/dd/de/d15/d38 0 2024-09-13T21:45:09.231 INFO:tasks.workunit.client.1.smithi155.stdout:2/934: truncate d2/db/fcb 432055 0 2024-09-13T21:45:09.232 INFO:tasks.workunit.client.1.smithi155.stdout:2/935: mkdir d2/d14a 0 2024-09-13T21:45:09.242 INFO:tasks.workunit.client.1.smithi155.stdout:8/920: sync 2024-09-13T21:45:09.242 INFO:tasks.workunit.client.1.smithi155.stdout:1/927: sync 2024-09-13T21:45:09.243 INFO:tasks.workunit.client.1.smithi155.stdout:5/924: sync 2024-09-13T21:45:09.245 INFO:tasks.workunit.client.1.smithi155.stdout:5/925: chown d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/cab 95 1 2024-09-13T21:45:09.247 INFO:tasks.workunit.client.1.smithi155.stdout:8/921: rename d2/d6/dd/d106/d96/db8/l102 to d2/d8/d75/d82/dd6/dff/l12c 0 2024-09-13T21:45:09.249 INFO:tasks.workunit.client.1.smithi155.stdout:5/926: symlink d5/d16/d81/d98/d84/de7/l122 0 2024-09-13T21:45:09.253 INFO:tasks.workunit.client.1.smithi155.stdout:2/936: mkdir d2/dd/de/d15/d38/ded/d14b 0 2024-09-13T21:45:09.254 INFO:tasks.workunit.client.1.smithi155.stdout:8/922: dwrite d2/d1f/d87/d9a/f9c [0,4194304] 0 2024-09-13T21:45:09.261 INFO:tasks.workunit.client.1.smithi155.stdout:2/937: write d2/db/f40 [2678206,110141] 0 2024-09-13T21:45:09.263 INFO:tasks.workunit.client.1.smithi155.stdout:8/923: getdents d2/dae 0 2024-09-13T21:45:09.263 INFO:tasks.workunit.client.1.smithi155.stdout:2/938: fsync d2/dd/d21/d39/dc1/d96/dba/d13d/f115 0 2024-09-13T21:45:09.264 INFO:tasks.workunit.client.1.smithi155.stdout:1/928: dread d6/d82/fbc [0,4194304] 0 2024-09-13T21:45:09.265 INFO:tasks.workunit.client.1.smithi155.stdout:8/924: chown d2/d8/d5e/d60/c79 20246 1 2024-09-13T21:45:09.266 INFO:tasks.workunit.client.1.smithi155.stdout:2/939: creat d2/db/d6b/f14c x:0 0 0 2024-09-13T21:45:09.267 INFO:tasks.workunit.client.1.smithi155.stdout:1/929: fsync d6/d82/d90/fc5 0 2024-09-13T21:45:09.269 INFO:tasks.workunit.client.1.smithi155.stdout:8/925: rename d2/d8/l64 to d2/d8/d75/d82/dd6/l12d 0 2024-09-13T21:45:09.270 INFO:tasks.workunit.client.1.smithi155.stdout:2/940: mkdir d2/d14d 0 2024-09-13T21:45:09.272 INFO:tasks.workunit.client.1.smithi155.stdout:8/926: unlink d2/f4b 0 2024-09-13T21:45:09.273 INFO:tasks.workunit.client.1.smithi155.stdout:5/927: dread d5/d16/d81/d98/d84/fd0 [0,4194304] 0 2024-09-13T21:45:09.276 INFO:tasks.workunit.client.1.smithi155.stdout:8/927: rename d2/d1f/d87/d9a/lb5 to d2/dae/dbe/l12e 0 2024-09-13T21:45:09.277 INFO:tasks.workunit.client.1.smithi155.stdout:5/928: chown d5/d16/d4e/d85/fa2 0 1 2024-09-13T21:45:09.281 INFO:tasks.workunit.client.1.smithi155.stdout:2/941: mknod d2/dd/de/d15/d38/d41/d5f/d70/dce/c14e 0 2024-09-13T21:45:09.282 INFO:tasks.workunit.client.1.smithi155.stdout:2/942: fdatasync d2/dd/d21/d39/dc1/da3/f143 0 2024-09-13T21:45:09.284 INFO:tasks.workunit.client.1.smithi155.stdout:5/929: creat d5/d16/d33/d1b/d28/f123 x:0 0 0 2024-09-13T21:45:09.285 INFO:tasks.workunit.client.1.smithi155.stdout:5/930: chown d5/l34 499205987 1 2024-09-13T21:45:09.285 INFO:tasks.workunit.client.1.smithi155.stdout:2/943: truncate d2/dd/d21/d8d/da0/fa1 1194365 0 2024-09-13T21:45:09.286 INFO:tasks.workunit.client.1.smithi155.stdout:1/930: dread d6/d82/d90/fc5 [0,4194304] 0 2024-09-13T21:45:09.289 INFO:tasks.workunit.client.1.smithi155.stdout:5/931: stat d5/d16/d33/d1b/d2f/d3c/f75 0 2024-09-13T21:45:09.297 INFO:tasks.workunit.client.1.smithi155.stdout:5/932: chown d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/cab 4 1 2024-09-13T21:45:09.298 INFO:tasks.workunit.client.1.smithi155.stdout:2/944: dwrite d2/dd/de/d15/d121/f123 [0,4194304] 0 2024-09-13T21:45:09.299 INFO:tasks.workunit.client.1.smithi155.stdout:1/931: dwrite d6/d82/d91/f123 [0,4194304] 0 2024-09-13T21:45:09.301 INFO:tasks.workunit.client.1.smithi155.stdout:8/928: dwrite d2/d6/dd/d106/f69 [0,4194304] 0 2024-09-13T21:45:09.305 INFO:tasks.workunit.client.1.smithi155.stdout:1/932: unlink d6/d15/d23/d87/f21 0 2024-09-13T21:45:09.306 INFO:tasks.workunit.client.1.smithi155.stdout:5/933: creat d5/f124 x:0 0 0 2024-09-13T21:45:09.307 INFO:tasks.workunit.client.1.smithi155.stdout:8/929: readlink d2/d6/dd/d106/l3d 0 2024-09-13T21:45:09.309 INFO:tasks.workunit.client.1.smithi155.stdout:1/933: mknod d6/d7/d89/dd6/dee/c132 0 2024-09-13T21:45:09.311 INFO:tasks.workunit.client.1.smithi155.stdout:8/930: mkdir d2/d95/d12f 0 2024-09-13T21:45:09.312 INFO:tasks.workunit.client.1.smithi155.stdout:8/931: chown d2/d8/d5e/d60/db2 78888326 1 2024-09-13T21:45:09.314 INFO:tasks.workunit.client.1.smithi155.stdout:1/934: mknod d6/d82/d91/d10f/d12b/c133 0 2024-09-13T21:45:09.316 INFO:tasks.workunit.client.1.smithi155.stdout:5/934: link d5/d16/d33/d1b/d1e/c3f d5/d16/d81/df5/c125 0 2024-09-13T21:45:09.319 INFO:tasks.workunit.client.1.smithi155.stdout:1/935: rename d6/f33 to d6/d15/f134 0 2024-09-13T21:45:09.319 INFO:tasks.workunit.client.1.smithi155.stdout:2/945: truncate d2/dd/de/d15/f46 831046 0 2024-09-13T21:45:09.320 INFO:tasks.workunit.client.1.smithi155.stdout:1/936: chown d6/d7/d89/dd6/de0/l115 133770 1 2024-09-13T21:45:09.321 INFO:tasks.workunit.client.1.smithi155.stdout:8/932: creat d2/d6/dd/de7/f130 x:0 0 0 2024-09-13T21:45:09.322 INFO:tasks.workunit.client.1.smithi155.stdout:2/946: unlink d2/dd/d21/d39/l45 0 2024-09-13T21:45:09.323 INFO:tasks.workunit.client.1.smithi155.stdout:5/935: symlink d5/d16/d4e/l126 0 2024-09-13T21:45:09.324 INFO:tasks.workunit.client.1.smithi155.stdout:8/933: read d2/d8/d65/fe2 [125507,88232] 0 2024-09-13T21:45:09.325 INFO:tasks.workunit.client.1.smithi155.stdout:8/934: stat d2/def/c116 0 2024-09-13T21:45:09.325 INFO:tasks.workunit.client.1.smithi155.stdout:8/935: dread - d2/d1f/d77/f10a zero size 2024-09-13T21:45:09.325 INFO:tasks.workunit.client.1.smithi155.stdout:1/937: rename d6/d15/d23/f3c to d6/d15/d23/d55/db9/f135 0 2024-09-13T21:45:09.326 INFO:tasks.workunit.client.1.smithi155.stdout:8/936: chown d2/d6/dd/d106/d96 97267 1 2024-09-13T21:45:09.327 INFO:tasks.workunit.client.1.smithi155.stdout:5/936: unlink d5/d16/d33/d1b/l69 0 2024-09-13T21:45:09.331 INFO:tasks.workunit.client.1.smithi155.stdout:5/937: rename d5/d16/d33/d1b/f9c to d5/d16/d33/d1b/d2f/d3c/d5b/d5f/daf/d108/f127 0 2024-09-13T21:45:09.332 INFO:tasks.workunit.client.1.smithi155.stdout:2/947: getdents d2/dd/de/d15/d3f 0 2024-09-13T21:45:09.334 INFO:tasks.workunit.client.1.smithi155.stdout:1/938: creat d6/d7/d48/f136 x:0 0 0 2024-09-13T21:45:09.337 INFO:tasks.workunit.client.1.smithi155.stdout:5/938: read d5/d16/d81/d98/fc3 [1149589,27070] 0 2024-09-13T21:45:09.337 INFO:tasks.workunit.client.1.smithi155.stdout:2/948: read d2/db/f40 [1266965,7595] 0 2024-09-13T21:45:09.339 INFO:tasks.workunit.client.1.smithi155.stdout:1/939: creat d6/d15/d23/d55/d6e/dbb/d4b/dc3/f137 x:0 0 0 2024-09-13T21:45:09.340 INFO:tasks.workunit.client.1.smithi155.stdout:2/949: fsync d2/db/f16 0 2024-09-13T21:45:09.342 INFO:tasks.workunit.client.1.smithi155.stdout:5/939: creat d5/d16/d33/d1b/d2f/d3c/d44/d80/f128 x:0 0 0 2024-09-13T21:45:09.343 INFO:tasks.workunit.client.1.smithi155.stdout:8/937: write d2/d1f/d77/f10a [159735,106902] 0 2024-09-13T21:45:09.344 INFO:tasks.workunit.client.1.smithi155.stdout:1/940: dread - d6/d15/d57/d99/f101 zero size 2024-09-13T21:45:09.345 INFO:tasks.workunit.client.1.smithi155.stdout:1/941: dread - d6/f119 zero size 2024-09-13T21:45:09.347 INFO:tasks.workunit.client.1.smithi155.stdout:2/950: rename d2/dd/d37/ff4 to d2/dd/d21/d39/dc1/d66/d6f/f14f 0 2024-09-13T21:45:09.348 INFO:tasks.workunit.client.1.smithi155.stdout:2/951: write f0 [1388540,5577] 0 2024-09-13T21:45:09.350 INFO:tasks.workunit.client.1.smithi155.stdout:5/940: rename d5/d16/d81/d98/d84/de7/l106 to d5/d16/d33/d1b/d2f/d3c/d5b/d5f/daf/d108/l129 0 2024-09-13T21:45:09.352 INFO:tasks.workunit.client.1.smithi155.stdout:1/942: link d6/d15/d23/d55/db9/d12a/f12d d6/d15/d23/d55/f138 0 2024-09-13T21:45:09.353 INFO:tasks.workunit.client.1.smithi155.stdout:2/952: creat d2/dd/d21/d39/d84/f150 x:0 0 0 2024-09-13T21:45:09.354 INFO:tasks.workunit.client.1.smithi155.stdout:5/941: mknod d5/d16/d33/d1b/d2f/d3c/d5b/dc1/c12a 0 2024-09-13T21:45:09.355 INFO:tasks.workunit.client.1.smithi155.stdout:5/942: chown d5/d16/d33/d1f/f116 1760093 1 2024-09-13T21:45:09.355 INFO:tasks.workunit.client.1.smithi155.stdout:1/943: mknod d6/d15/d23/d55/d6e/dbb/c139 0 2024-09-13T21:45:09.356 INFO:tasks.workunit.client.1.smithi155.stdout:2/953: mkdir d2/dd/d21/d8d/da0/de3/d151 0 2024-09-13T21:45:09.357 INFO:tasks.workunit.client.1.smithi155.stdout:1/944: creat d6/d7/d89/dd6/dee/da9/f13a x:0 0 0 2024-09-13T21:45:09.358 INFO:tasks.workunit.client.1.smithi155.stdout:2/954: write d2/f69 [1488035,93008] 0 2024-09-13T21:45:09.358 INFO:tasks.workunit.client.1.smithi155.stdout:5/943: creat d5/d16/d4e/f12b x:0 0 0 2024-09-13T21:45:09.359 INFO:tasks.workunit.client.1.smithi155.stdout:1/945: truncate d6/d7/d89/dd6/de0/f121 611376 0 2024-09-13T21:45:09.365 INFO:tasks.workunit.client.1.smithi155.stdout:5/944: link d5/d16/d81/df5/f10f d5/d16/d33/d1b/d1e/da1/f12c 0 2024-09-13T21:45:09.365 INFO:tasks.workunit.client.1.smithi155.stdout:2/955: dwrite d2/dd/de6/ffd [0,4194304] 0 2024-09-13T21:45:09.368 INFO:tasks.workunit.client.1.smithi155.stdout:2/956: fsync d2/dd/d37/d4e/f73 0 2024-09-13T21:45:09.370 INFO:tasks.workunit.client.1.smithi155.stdout:2/957: truncate d2/dd/d21/d8d/fb9 1717772 0 2024-09-13T21:45:09.374 INFO:tasks.workunit.client.1.smithi155.stdout:2/958: mknod d2/dd/d21/dc6/dd6/c152 0 2024-09-13T21:45:09.374 INFO:tasks.workunit.client.1.smithi155.stdout:5/945: dwrite d5/d16/d33/d1b/d59/f88 [4194304,4194304] 0 2024-09-13T21:45:09.375 INFO:tasks.workunit.client.1.smithi155.stdout:2/959: chown d2/dd/d21/dc6/dd6/deb/l103 16789084 1 2024-09-13T21:45:09.378 INFO:tasks.workunit.client.1.smithi155.stdout:5/946: mkdir d5/d16/db4/d12d 0 2024-09-13T21:45:09.382 INFO:tasks.workunit.client.1.smithi155.stdout:1/946: dwrite d6/d82/d90/fca [0,4194304] 0 2024-09-13T21:45:09.385 INFO:tasks.workunit.client.1.smithi155.stdout:1/947: mkdir d6/d7/d89/dd6/dee/d124/d13b 0 2024-09-13T21:45:09.386 INFO:tasks.workunit.client.1.smithi155.stdout:5/947: write d5/d16/d81/d98/fc3 [1673249,58872] 0 2024-09-13T21:45:09.387 INFO:tasks.workunit.client.1.smithi155.stdout:1/948: unlink d6/d15/d57/d99/lb3 0 2024-09-13T21:45:09.388 INFO:tasks.workunit.client.1.smithi155.stdout:1/949: rmdir d6/d15/d57 39 2024-09-13T21:45:09.390 INFO:tasks.workunit.client.1.smithi155.stdout:1/950: stat d6/d15/d23/d55/d6e/dbb/d4b 0 2024-09-13T21:45:09.390 INFO:tasks.workunit.client.1.smithi155.stdout:5/948: rename d5/d16/d33/d1b/d1e/c11b to d5/d16/d81/c12e 0 2024-09-13T21:45:09.415 INFO:tasks.workunit.client.1.smithi155.stdout:1/951: creat d6/d15/d23/f13c x:0 0 0 2024-09-13T21:45:09.415 INFO:tasks.workunit.client.1.smithi155.stdout:5/949: mkdir d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/dfc/d12f 0 2024-09-13T21:45:09.418 INFO:tasks.workunit.client.1.smithi155.stdout:5/950: fsync d5/d16/d33/d1b/d2f/f9b 0 2024-09-13T21:45:09.419 INFO:tasks.workunit.client.1.smithi155.stdout:5/951: readlink d5/d16/d4e/ld9 0 2024-09-13T21:45:09.430 INFO:tasks.workunit.client.1.smithi155.stdout:1/952: dread d6/d15/d57/d5d/fbf [0,4194304] 0 2024-09-13T21:45:09.432 INFO:tasks.workunit.client.1.smithi155.stdout:1/953: chown d6/d7/cdc 146521 1 2024-09-13T21:45:09.444 INFO:tasks.workunit.client.1.smithi155.stdout:5/952: truncate d5/d16/d33/d1b/d2f/d3c/d6c/d45/f7c 3137829 0 2024-09-13T21:45:09.446 INFO:tasks.workunit.client.1.smithi155.stdout:1/954: dread d6/d15/f45 [0,4194304] 0 2024-09-13T21:45:09.447 INFO:tasks.workunit.client.1.smithi155.stdout:5/953: symlink d5/d16/d33/d1b/d2f/d3c/d5b/d5f/l130 0 2024-09-13T21:45:09.448 INFO:tasks.workunit.client.1.smithi155.stdout:1/955: fdatasync d6/d82/d90/fcd 0 2024-09-13T21:45:09.449 INFO:tasks.workunit.client.1.smithi155.stdout:5/954: write d5/d16/d81/df5/f11c [544578,111151] 0 2024-09-13T21:45:09.449 INFO:tasks.workunit.client.1.smithi155.stdout:1/956: write d6/d7/d89/dd6/dee/fdb [7273941,34766] 0 2024-09-13T21:45:09.453 INFO:tasks.workunit.client.1.smithi155.stdout:5/955: mkdir d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/dfc/d12f/d131 0 2024-09-13T21:45:09.454 INFO:tasks.workunit.client.1.smithi155.stdout:1/957: dread d6/d15/d57/d5d/fbf [0,4194304] 0 2024-09-13T21:45:09.455 INFO:tasks.workunit.client.1.smithi155.stdout:1/958: chown d6/d15/d23/d87/de2/f128 624109 1 2024-09-13T21:45:09.456 INFO:tasks.workunit.client.1.smithi155.stdout:1/959: dread - d6/d15/d57/d99/f101 zero size 2024-09-13T21:45:09.459 INFO:tasks.workunit.client.1.smithi155.stdout:1/960: write d6/d15/d23/d55/db9/f135 [2922092,69605] 0 2024-09-13T21:45:09.463 INFO:tasks.workunit.client.1.smithi155.stdout:1/961: getdents d6/d15/d23/d55/dfd 0 2024-09-13T21:45:09.466 INFO:tasks.workunit.client.1.smithi155.stdout:5/956: dwrite d5/d16/d33/d1b/d59/dd1/fdd [0,4194304] 0 2024-09-13T21:45:09.471 INFO:tasks.workunit.client.1.smithi155.stdout:1/962: dwrite d6/d15/fba [0,4194304] 0 2024-09-13T21:45:09.475 INFO:tasks.workunit.client.1.smithi155.stdout:1/963: symlink d6/d7/d48/dab/l13d 0 2024-09-13T21:45:09.476 INFO:tasks.workunit.client.1.smithi155.stdout:5/957: dwrite d5/d16/d33/d1b/d28/f37 [0,4194304] 0 2024-09-13T21:45:09.479 INFO:tasks.workunit.client.1.smithi155.stdout:1/964: rename d6/d15/d57/cc2 to d6/d15/d23/d55/d6e/dbb/d4b/c13e 0 2024-09-13T21:45:09.482 INFO:tasks.workunit.client.1.smithi155.stdout:5/958: dread d5/d16/d33/d1b/d2f/d3c/d6c/f35 [4194304,4194304] 0 2024-09-13T21:45:09.484 INFO:tasks.workunit.client.1.smithi155.stdout:5/959: read d5/d16/d4e/d85/ff6 [4106451,92371] 0 2024-09-13T21:45:09.485 INFO:tasks.workunit.client.1.smithi155.stdout:1/965: write d6/d15/d23/d55/d6e/dbb/d4b/fde [2167922,36546] 0 2024-09-13T21:45:09.487 INFO:tasks.workunit.client.1.smithi155.stdout:5/960: creat d5/d16/d33/f132 x:0 0 0 2024-09-13T21:45:09.488 INFO:tasks.workunit.client.1.smithi155.stdout:5/961: chown d5/f6 54733244 1 2024-09-13T21:45:09.490 INFO:tasks.workunit.client.1.smithi155.stdout:5/962: rmdir d5/d16/d33/d1b/d59/dd1 39 2024-09-13T21:45:09.496 INFO:tasks.workunit.client.1.smithi155.stdout:1/966: dwrite d6/d15/d57/d5d/f9c [0,4194304] 0 2024-09-13T21:45:09.541 INFO:tasks.workunit.client.1.smithi155.stdout:1/967: dread d6/d15/f34 [0,4194304] 0 2024-09-13T21:45:09.543 INFO:tasks.workunit.client.1.smithi155.stdout:5/963: dread d5/d16/d33/d1f/f116 [4194304,4194304] 0 2024-09-13T21:45:09.545 INFO:tasks.workunit.client.1.smithi155.stdout:5/964: write d5/d16/d33/d1b/d2f/d3c/f41 [1390532,126343] 0 2024-09-13T21:45:09.545 INFO:tasks.workunit.client.1.smithi155.stdout:1/968: link d6/d15/d57/d99/c8f d6/d82/d91/c13f 0 2024-09-13T21:45:09.546 INFO:tasks.workunit.client.1.smithi155.stdout:1/969: readlink d6/d15/d23/d55/d6e/l10c 0 2024-09-13T21:45:09.548 INFO:tasks.workunit.client.1.smithi155.stdout:1/970: write d6/d15/f10b [369986,113208] 0 2024-09-13T21:45:09.549 INFO:tasks.workunit.client.1.smithi155.stdout:5/965: write d5/d16/d33/d1b/d2f/d3c/f82 [6412200,23760] 0 2024-09-13T21:45:09.550 INFO:tasks.workunit.client.1.smithi155.stdout:5/966: chown d5/d16/d81/df5/f11c 7547 1 2024-09-13T21:45:09.553 INFO:tasks.workunit.client.1.smithi155.stdout:1/971: unlink d6/d82/d91/daf/f9f 0 2024-09-13T21:45:09.554 INFO:tasks.workunit.client.1.smithi155.stdout:5/967: read d5/d16/d33/d1b/d2f/d3c/f82 [3319014,60297] 0 2024-09-13T21:45:09.557 INFO:tasks.workunit.client.1.smithi155.stdout:5/968: mknod d5/d16/c133 0 2024-09-13T21:45:09.558 INFO:tasks.workunit.client.1.smithi155.stdout:1/972: write d6/d15/d57/d5d/fd0 [1921627,1420] 0 2024-09-13T21:45:09.559 INFO:tasks.workunit.client.1.smithi155.stdout:5/969: mknod d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/dfc/c134 0 2024-09-13T21:45:09.562 INFO:tasks.workunit.client.1.smithi155.stdout:1/973: rename d6/d15/d23/d55/d6e/l8e to d6/d7/d48/dab/l140 0 2024-09-13T21:45:09.563 INFO:tasks.workunit.client.1.smithi155.stdout:1/974: dread - d6/d15/d23/f13c zero size 2024-09-13T21:45:09.565 INFO:tasks.workunit.client.1.smithi155.stdout:5/970: dwrite d5/d16/d33/d1b/d2f/d3c/d44/fcf [0,4194304] 0 2024-09-13T21:45:09.565 INFO:tasks.workunit.client.1.smithi155.stdout:1/975: mkdir d6/d15/d57/d99/d141 0 2024-09-13T21:45:09.568 INFO:tasks.workunit.client.1.smithi155.stdout:5/971: mkdir d5/d16/d33/d1b/d2f/d3c/d44/d29/d135 0 2024-09-13T21:45:09.570 INFO:tasks.workunit.client.1.smithi155.stdout:5/972: mkdir d5/d16/d33/d1b/d92/d136 0 2024-09-13T21:45:09.571 INFO:tasks.workunit.client.1.smithi155.stdout:1/976: link d6/d15/d57/l81 d6/d15/d57/d5d/d72/l142 0 2024-09-13T21:45:09.573 INFO:tasks.workunit.client.1.smithi155.stdout:1/977: creat d6/d7/d89/f143 x:0 0 0 2024-09-13T21:45:09.576 INFO:tasks.workunit.client.1.smithi155.stdout:5/973: getdents d5/d16/d81/d98/d84 0 2024-09-13T21:45:09.577 INFO:tasks.workunit.client.1.smithi155.stdout:5/974: mknod d5/d16/db4/d12d/c137 0 2024-09-13T21:45:09.580 INFO:tasks.workunit.client.1.smithi155.stdout:5/975: mknod d5/d16/d33/d1b/d2f/d3c/d44/d80/c138 0 2024-09-13T21:45:09.582 INFO:tasks.workunit.client.1.smithi155.stdout:5/976: symlink d5/d16/d81/df5/l139 0 2024-09-13T21:45:09.583 INFO:tasks.workunit.client.1.smithi155.stdout:5/977: symlink d5/d16/d33/d1b/d92/dca/l13a 0 2024-09-13T21:45:09.586 INFO:tasks.workunit.client.1.smithi155.stdout:5/978: creat d5/d16/d33/d1b/d59/dd1/ddb/f13b x:0 0 0 2024-09-13T21:45:09.587 INFO:tasks.workunit.client.1.smithi155.stdout:5/979: chown d5/d16/d33/d1b/d2f/d3c/d5b/f67 992 1 2024-09-13T21:45:09.587 INFO:tasks.workunit.client.1.smithi155.stdout:5/980: stat d5/d16/d33/d1b/d92/fbc 0 2024-09-13T21:45:09.589 INFO:tasks.workunit.client.1.smithi155.stdout:5/981: chown d5/d16/d33/d1b/d2f/d3c/cbe 3 1 2024-09-13T21:45:09.592 INFO:tasks.workunit.client.1.smithi155.stdout:1/978: dread d6/d15/d57/d99/ff5 [4194304,4194304] 0 2024-09-13T21:45:09.596 INFO:tasks.workunit.client.1.smithi155.stdout:1/979: creat d6/d15/d57/f144 x:0 0 0 2024-09-13T21:45:09.597 INFO:tasks.workunit.client.1.smithi155.stdout:5/982: rmdir d5/d16 39 2024-09-13T21:45:09.599 INFO:tasks.workunit.client.1.smithi155.stdout:1/980: creat d6/d7/d89/dd6/dee/d124/f145 x:0 0 0 2024-09-13T21:45:09.601 INFO:tasks.workunit.client.1.smithi155.stdout:1/981: fdatasync d6/d82/d91/fa4 0 2024-09-13T21:45:09.601 INFO:tasks.workunit.client.1.smithi155.stdout:1/982: fdatasync d6/d15/d57/d5d/f9c 0 2024-09-13T21:45:09.602 INFO:tasks.workunit.client.1.smithi155.stdout:5/983: unlink d5/d16/d33/d1b/d59/f10c 0 2024-09-13T21:45:09.604 INFO:tasks.workunit.client.1.smithi155.stdout:5/984: write d5/d16/d33/d1b/d59/f8a [8010130,28046] 0 2024-09-13T21:45:09.605 INFO:tasks.workunit.client.1.smithi155.stdout:5/985: stat d5/d16/d33/d1b/d2f/d3c/d6c/d45/f65 0 2024-09-13T21:45:09.608 INFO:tasks.workunit.client.1.smithi155.stdout:1/983: truncate d6/d82/d90/fcd 520382 0 2024-09-13T21:45:09.610 INFO:tasks.workunit.client.1.smithi155.stdout:1/984: creat d6/d15/d23/d55/d6e/dbb/d4b/dc3/f146 x:0 0 0 2024-09-13T21:45:09.610 INFO:tasks.workunit.client.1.smithi155.stdout:1/985: read - d6/d15/d23/f129 zero size 2024-09-13T21:45:09.611 INFO:tasks.workunit.client.1.smithi155.stdout:5/986: rename d5/d16/l117 to d5/l13c 0 2024-09-13T21:45:09.614 INFO:tasks.workunit.client.1.smithi155.stdout:5/987: creat d5/d16/d4e/f13d x:0 0 0 2024-09-13T21:45:09.615 INFO:tasks.workunit.client.1.smithi155.stdout:1/986: getdents d6/d15/d57/d99 0 2024-09-13T21:45:09.616 INFO:tasks.workunit.client.1.smithi155.stdout:5/988: chown d5/d16/d81/de8/f115 208629 1 2024-09-13T21:45:09.619 INFO:tasks.workunit.client.1.smithi155.stdout:5/989: truncate d5/d16/d33/d1b/d92/fd7 704827 0 2024-09-13T21:45:09.620 INFO:tasks.workunit.client.1.smithi155.stdout:1/987: write d6/d7/d89/dd6/dee/f97 [1764631,66288] 0 2024-09-13T21:45:09.621 INFO:tasks.workunit.client.1.smithi155.stdout:5/990: write d5/d16/d33/d1b/d2f/d3c/d44/f10d [5067863,13699] 0 2024-09-13T21:45:09.622 INFO:tasks.workunit.client.1.smithi155.stdout:1/988: chown d6/d82/cd8 100899026 1 2024-09-13T21:45:09.624 INFO:tasks.workunit.client.1.smithi155.stdout:1/989: creat d6/d15/d23/d55/f147 x:0 0 0 2024-09-13T21:45:09.625 INFO:tasks.workunit.client.1.smithi155.stdout:5/991: write d5/d16/d81/d98/f48 [1537257,102664] 0 2024-09-13T21:45:09.626 INFO:tasks.workunit.client.1.smithi155.stdout:5/992: truncate d5/d16/f11f 431838 0 2024-09-13T21:45:09.629 INFO:tasks.workunit.client.1.smithi155.stdout:5/993: mkdir d5/d16/d33/d1b/d2f/d3c/def/d13e 0 2024-09-13T21:45:09.633 INFO:tasks.workunit.client.1.smithi155.stdout:5/994: stat d5/d16/d33/d1b/d2f/d3c/d5b 0 2024-09-13T21:45:09.635 INFO:tasks.workunit.client.1.smithi155.stdout:1/990: dwrite d6/d15/d23/d87/f9a [0,4194304] 0 2024-09-13T21:45:09.638 INFO:tasks.workunit.client.1.smithi155.stdout:5/995: dwrite f0 [4194304,4194304] 0 2024-09-13T21:45:09.641 INFO:tasks.workunit.client.1.smithi155.stdout:1/991: rename d6/d15/l61 to d6/d15/d23/d55/db9/d12a/l148 0 2024-09-13T21:45:09.641 INFO:tasks.workunit.client.1.smithi155.stdout:5/996: dread - d5/d16/d33/d1b/d2f/d3c/fd2 zero size 2024-09-13T21:45:09.642 INFO:tasks.workunit.client.1.smithi155.stdout:1/992: chown d6/d15/d23/d55/f147 2407706 1 2024-09-13T21:45:09.644 INFO:tasks.workunit.client.1.smithi155.stdout:5/997: creat d5/d16/d33/d1b/d2f/d3c/d6c/d45/d7e/dfc/d12f/d131/f13f x:0 0 0 2024-09-13T21:45:09.648 INFO:tasks.workunit.client.1.smithi155.stdout:1/993: rename d6/d15/d23/d55/d6e/dbb/f50 to d6/d15/d23/f149 0 2024-09-13T21:45:09.693 INFO:tasks.workunit.client.1.smithi155.stdout:8/938: sync 2024-09-13T21:45:09.696 INFO:tasks.workunit.client.1.smithi155.stdout:1/994: dread d6/d15/d57/d5d/d72/dc7/fd5 [0,4194304] 0 2024-09-13T21:45:09.700 INFO:tasks.workunit.client.1.smithi155.stdout:8/939: getdents d2/d6/dd/d25 0 2024-09-13T21:45:09.703 INFO:tasks.workunit.client.1.smithi155.stdout:8/940: mkdir d2/d8/d12a/d131 0 2024-09-13T21:45:09.703 INFO:tasks.workunit.client.1.smithi155.stdout:1/995: dwrite d6/d15/f4e [8388608,4194304] 0 2024-09-13T21:45:09.714 INFO:tasks.workunit.client.1.smithi155.stdout:1/996: dwrite d6/d15/d57/d5d/fbf [0,4194304] 0 2024-09-13T21:45:09.718 INFO:tasks.workunit.client.1.smithi155.stdout:1/997: fdatasync d6/d15/d57/d5d/d72/fad 0 2024-09-13T21:45:09.732 INFO:tasks.workunit.client.1.smithi155.stdout:8/941: dread d2/f47 [4194304,4194304] 0 2024-09-13T21:45:09.733 INFO:tasks.workunit.client.1.smithi155.stdout:1/998: dwrite d6/d82/f116 [0,4194304] 0 2024-09-13T21:45:09.734 INFO:tasks.workunit.client.1.smithi155.stdout:8/942: chown d2/d8/d75/d82/dd6/fe1 9854336 1 2024-09-13T21:45:09.737 INFO:tasks.workunit.client.1.smithi155.stdout:8/943: mknod d2/d1f/d87/c132 0 2024-09-13T21:45:09.738 INFO:tasks.workunit.client.1.smithi155.stdout:8/944: chown d2/ld4 91140220 1 2024-09-13T21:45:09.739 INFO:tasks.workunit.client.1.smithi155.stdout:1/999: getdents d6/d15/d23/d55/d6e 0 2024-09-13T21:45:09.740 INFO:tasks.workunit.client.1.smithi155.stdout:8/945: fdatasync d2/d6/f6a 0 2024-09-13T21:45:09.742 INFO:tasks.workunit.client.1.smithi155.stdout:8/946: mkdir d2/d6/dd/d25/d133 0 2024-09-13T21:45:09.743 INFO:tasks.workunit.client.1.smithi155.stdout:8/947: mknod d2/d6/dd/d106/d96/db8/c134 0 2024-09-13T21:45:09.744 INFO:tasks.workunit.client.1.smithi155.stdout:8/948: readlink d2/d6/dd/l2f 0 2024-09-13T21:45:09.746 INFO:tasks.workunit.client.1.smithi155.stdout:8/949: mkdir d2/d6/d135 0 2024-09-13T21:45:09.747 INFO:tasks.workunit.client.1.smithi155.stdout:8/950: fsync d2/d1f/d87/d9a/f9c 0 2024-09-13T21:45:09.748 INFO:tasks.workunit.client.1.smithi155.stdout:8/951: symlink d2/d8/d75/d82/l136 0 2024-09-13T21:45:09.752 INFO:tasks.workunit.client.1.smithi155.stdout:8/952: link d2/d8/d65/da8/fcf d2/d6/dd/d106/d96/f137 0 2024-09-13T21:45:09.752 INFO:tasks.workunit.client.1.smithi155.stdout:8/953: chown d2/d8/d65/d105/f66 117 1 2024-09-13T21:45:09.754 INFO:tasks.workunit.client.1.smithi155.stdout:8/954: symlink d2/d8/d75/d82/dd6/l138 0 2024-09-13T21:45:09.754 INFO:tasks.workunit.client.1.smithi155.stdout:8/955: chown d2/d8/d65/d105/f2c 1685 1 2024-09-13T21:45:09.756 INFO:tasks.workunit.client.1.smithi155.stdout:8/956: unlink d2/d8/d75/l81 0 2024-09-13T21:45:09.757 INFO:tasks.workunit.client.1.smithi155.stdout:8/957: creat d2/dae/f139 x:0 0 0 2024-09-13T21:45:09.760 INFO:tasks.workunit.client.1.smithi155.stdout:2/960: sync 2024-09-13T21:45:09.761 INFO:tasks.workunit.client.1.smithi155.stdout:8/958: dread d2/d6/dd/d106/d96/dcc/fd2 [0,4194304] 0 2024-09-13T21:45:09.762 INFO:tasks.workunit.client.1.smithi155.stdout:2/961: creat d2/d14d/f153 x:0 0 0 2024-09-13T21:45:09.763 INFO:tasks.workunit.client.1.smithi155.stdout:8/959: mkdir d2/d95/d13a 0 2024-09-13T21:45:09.765 INFO:tasks.workunit.client.1.smithi155.stdout:8/960: write d2/d8/d5e/d60/fc4 [1268061,36163] 0 2024-09-13T21:45:09.766 INFO:tasks.workunit.client.1.smithi155.stdout:2/962: mknod d2/dd/de/d15/d3f/d97/c154 0 2024-09-13T21:45:09.777 INFO:tasks.workunit.client.1.smithi155.stdout:8/961: link d2/d8/d75/d82/dd6/dff/l12c d2/d8/d5e/d60/db2/d121/l13b 0 2024-09-13T21:45:09.779 INFO:tasks.workunit.client.1.smithi155.stdout:8/962: mkdir d2/d8/d75/d82/dd6/d13c 0 2024-09-13T21:45:09.787 INFO:tasks.workunit.client.1.smithi155.stdout:2/963: write d2/dd/d21/d39/dc1/dc3/f13a [7095,94574] 0 2024-09-13T21:45:09.789 INFO:tasks.workunit.client.1.smithi155.stdout:8/963: write d2/d8/fd1 [888246,47718] 0 2024-09-13T21:45:09.790 INFO:tasks.workunit.client.1.smithi155.stdout:2/964: fdatasync d2/dd/de/d15/d38/d41/d5f/d70/dfa/f114 0 2024-09-13T21:45:09.793 INFO:tasks.workunit.client.1.smithi155.stdout:2/965: unlink d2/dd/d21/d39/l91 0 2024-09-13T21:45:09.797 INFO:tasks.workunit.client.1.smithi155.stdout:8/964: link d2/d6/dd/d25/f4c d2/d95/d13a/f13d 0 2024-09-13T21:45:09.805 INFO:tasks.workunit.client.1.smithi155.stdout:8/965: write d2/d8/d65/d105/f21 [2390268,50297] 0 2024-09-13T21:45:09.809 INFO:tasks.workunit.client.1.smithi155.stdout:8/966: symlink d2/d6/dd/d106/d96/dcc/df4/l13e 0 2024-09-13T21:45:09.810 INFO:tasks.workunit.client.1.smithi155.stdout:8/967: fdatasync d2/d91/f88 0 2024-09-13T21:45:09.818 INFO:tasks.workunit.client.1.smithi155.stdout:8/968: dwrite d2/d1f/d77/fe5 [0,4194304] 0 2024-09-13T21:45:09.824 INFO:tasks.workunit.client.1.smithi155.stdout:8/969: write d2/f74 [1481498,67037] 0 2024-09-13T21:45:09.832 INFO:tasks.workunit.client.1.smithi155.stdout:8/970: dread d2/d6/dd/d106/d96/dcc/fde [0,4194304] 0 2024-09-13T21:45:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:09 smithi155 ceph-mon[34732]: pgmap v19: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 116 MiB/s rd, 279 MiB/s wr, 677 op/s 2024-09-13T21:45:09.835 INFO:tasks.workunit.client.1.smithi155.stdout:8/971: write d2/d6/dd/d106/d96/fc0 [969747,14147] 0 2024-09-13T21:45:09.836 INFO:tasks.workunit.client.1.smithi155.stdout:8/972: fdatasync d2/d91/f8a 0 2024-09-13T21:45:09.848 INFO:tasks.workunit.client.1.smithi155.stdout:8/973: dwrite d2/d6/dd/d25/f5d [0,4194304] 0 2024-09-13T21:45:09.851 INFO:tasks.workunit.client.1.smithi155.stdout:8/974: mknod d2/d95/c13f 0 2024-09-13T21:45:09.853 INFO:tasks.workunit.client.1.smithi155.stdout:8/975: write d2/d8/d65/d105/f1b [2441456,117642] 0 2024-09-13T21:45:09.856 INFO:tasks.workunit.client.1.smithi155.stdout:8/976: symlink d2/dae/l140 0 2024-09-13T21:45:09.856 INFO:tasks.workunit.client.1.smithi155.stdout:8/977: fsync d2/d91/f9f 0 2024-09-13T21:45:09.858 INFO:tasks.workunit.client.1.smithi155.stdout:8/978: mkdir d2/d8/d65/da8/d141 0 2024-09-13T21:45:09.871 INFO:tasks.workunit.client.1.smithi155.stdout:8/979: truncate d2/d6/dd/d106/f69 1348393 0 2024-09-13T21:45:09.874 INFO:tasks.workunit.client.1.smithi155.stdout:8/980: creat d2/d95/d12f/f142 x:0 0 0 2024-09-13T21:45:09.875 INFO:tasks.workunit.client.1.smithi155.stdout:8/981: dread - d2/d8/d5e/d60/fcd zero size 2024-09-13T21:45:09.877 INFO:tasks.workunit.client.1.smithi155.stdout:8/982: mkdir d2/de0/d143 0 2024-09-13T21:45:09.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:09 smithi119 ceph-mon[27653]: pgmap v19: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 116 MiB/s rd, 279 MiB/s wr, 677 op/s 2024-09-13T21:45:09.880 INFO:tasks.workunit.client.1.smithi155.stdout:8/983: creat d2/d6/dd/d106/f144 x:0 0 0 2024-09-13T21:45:09.886 INFO:tasks.workunit.client.1.smithi155.stdout:8/984: dread d2/d8/d65/d105/f3a [0,4194304] 0 2024-09-13T21:45:10.065 INFO:tasks.workunit.client.1.smithi155.stdout:5/998: sync 2024-09-13T21:45:10.065 INFO:tasks.workunit.client.1.smithi155.stdout:5/999: fsync d5/fb7 0 2024-09-13T21:45:10.099 INFO:tasks.workunit.client.1.smithi155.stdout:2/966: sync 2024-09-13T21:45:10.099 INFO:tasks.workunit.client.1.smithi155.stdout:8/985: sync 2024-09-13T21:45:10.100 INFO:tasks.workunit.client.1.smithi155.stdout:8/986: symlink d2/d8/d5e/l145 0 2024-09-13T21:45:10.101 INFO:tasks.workunit.client.1.smithi155.stdout:8/987: chown d2/d8/d5e/d60/db2 16992 1 2024-09-13T21:45:10.102 INFO:tasks.workunit.client.1.smithi155.stdout:2/967: rename d2/dd/d21/d39/dc1/d31/d5d/fec to d2/dd/de/d15/d38/d41/d5f/d70/f155 0 2024-09-13T21:45:10.103 INFO:tasks.workunit.client.1.smithi155.stdout:2/968: write d2/dd/de/d15/d38/d41/fb6 [955332,1928] 0 2024-09-13T21:45:10.104 INFO:tasks.workunit.client.1.smithi155.stdout:2/969: chown d2/dd/de/d15/d121/d111 208 1 2024-09-13T21:45:10.108 INFO:tasks.workunit.client.1.smithi155.stdout:2/970: creat d2/dd/d21/d39/dc1/d66/de9/f156 x:0 0 0 2024-09-13T21:45:10.110 INFO:tasks.workunit.client.1.smithi155.stdout:2/971: getdents d2/dd/d21/d39/d84/d134 0 2024-09-13T21:45:10.111 INFO:tasks.workunit.client.1.smithi155.stdout:8/988: dread d2/d6/dd/d106/f71 [0,4194304] 0 2024-09-13T21:45:10.113 INFO:tasks.workunit.client.1.smithi155.stdout:8/989: stat d2/d6/dd/fa7 0 2024-09-13T21:45:10.114 INFO:tasks.workunit.client.1.smithi155.stdout:8/990: write d2/d1f/f70 [1294970,78633] 0 2024-09-13T21:45:10.114 INFO:tasks.workunit.client.1.smithi155.stdout:2/972: rename d2/dd/d21/d39/dc1/dc3/lee to d2/dd/de/d15/d3f/d97/l157 0 2024-09-13T21:45:10.115 INFO:tasks.workunit.client.1.smithi155.stdout:8/991: chown d2/d8/f119 51271 1 2024-09-13T21:45:10.115 INFO:tasks.workunit.client.1.smithi155.stdout:2/973: readlink d2/dd/d21/dc6/dd6/deb/l132 0 2024-09-13T21:45:10.117 INFO:tasks.workunit.client.1.smithi155.stdout:8/992: symlink d2/d95/l146 0 2024-09-13T21:45:10.117 INFO:tasks.workunit.client.1.smithi155.stdout:2/974: write d2/dd/d21/d39/dc1/d31/f112 [746747,70453] 0 2024-09-13T21:45:10.119 INFO:tasks.workunit.client.1.smithi155.stdout:8/993: symlink d2/d6/dd/d106/d96/dcc/df4/l147 0 2024-09-13T21:45:10.121 INFO:tasks.workunit.client.1.smithi155.stdout:8/994: mknod d2/def/c148 0 2024-09-13T21:45:10.122 INFO:tasks.workunit.client.1.smithi155.stdout:2/975: dread d2/db/f1e [4194304,4194304] 0 2024-09-13T21:45:10.124 INFO:tasks.workunit.client.1.smithi155.stdout:2/976: mkdir d2/dd/d21/d158 0 2024-09-13T21:45:10.125 INFO:tasks.workunit.client.1.smithi155.stdout:8/995: write d2/d6/dd/fa7 [28480,76848] 0 2024-09-13T21:45:10.127 INFO:tasks.workunit.client.1.smithi155.stdout:2/977: symlink d2/dd/d21/d39/dc1/d96/dba/d106/d113/l159 0 2024-09-13T21:45:10.128 INFO:tasks.workunit.client.1.smithi155.stdout:8/996: dread d2/d1f/d77/f10a [0,4194304] 0 2024-09-13T21:45:10.128 INFO:tasks.workunit.client.1.smithi155.stdout:2/978: dread - d2/dd/de/d15/d3f/de2/f136 zero size 2024-09-13T21:45:10.130 INFO:tasks.workunit.client.1.smithi155.stdout:8/997: rename d2/d8/d65/d105/f73 to d2/d8/d12a/f149 0 2024-09-13T21:45:10.132 INFO:tasks.workunit.client.1.smithi155.stdout:8/998: write d2/d8/d75/fbf [231537,6733] 0 2024-09-13T21:45:10.134 INFO:tasks.workunit.client.1.smithi155.stdout:2/979: dwrite d2/d14d/f153 [0,4194304] 0 2024-09-13T21:45:10.134 INFO:tasks.workunit.client.1.smithi155.stdout:8/999: rmdir d2/d6/dd/d25 39 2024-09-13T21:45:10.139 INFO:tasks.workunit.client.1.smithi155.stdout:2/980: truncate f0 820187 0 2024-09-13T21:45:10.141 INFO:tasks.workunit.client.1.smithi155.stdout:2/981: dread - d2/dd/d21/d8d/da0/de3/f10b zero size 2024-09-13T21:45:10.143 INFO:tasks.workunit.client.1.smithi155.stdout:2/982: dread d2/dd/de/f116 [0,4194304] 0 2024-09-13T21:45:10.154 INFO:tasks.workunit.client.1.smithi155.stdout:2/983: dread d2/dd/d21/d39/dc1/f7d [0,4194304] 0 2024-09-13T21:45:10.155 INFO:tasks.workunit.client.1.smithi155.stdout:2/984: rmdir d2/dd/de/d15/d121/d111 39 2024-09-13T21:45:10.159 INFO:tasks.workunit.client.1.smithi155.stdout:2/985: getdents d2/dd/d21/d39/dc1/dc3 0 2024-09-13T21:45:10.166 INFO:tasks.workunit.client.1.smithi155.stdout:2/986: dwrite d2/dd/d21/d39/dc1/d31/f9e [0,4194304] 0 2024-09-13T21:45:10.169 INFO:tasks.workunit.client.1.smithi155.stdout:2/987: unlink d2/dd/d21/d39/d84/l102 0 2024-09-13T21:45:10.170 INFO:tasks.workunit.client.1.smithi155.stdout:2/988: chown d2/dd/d21/d39/dc1/d96/dba/d106 11 1 2024-09-13T21:45:10.173 INFO:tasks.workunit.client.1.smithi155.stdout:2/989: unlink d2/dd/d21/d8d/ldc 0 2024-09-13T21:45:10.178 INFO:tasks.workunit.client.1.smithi155.stdout:2/990: dwrite d2/dd/de/f9a [0,4194304] 0 2024-09-13T21:45:10.180 INFO:tasks.workunit.client.1.smithi155.stdout:2/991: chown d2/dd/d21/d39/dc1/d66/d7c/l85 24 1 2024-09-13T21:45:10.183 INFO:tasks.workunit.client.1.smithi155.stdout:2/992: mkdir d2/dd/de/d15/d38/d41/d5f/d70/dfa/d15a 0 2024-09-13T21:45:10.185 INFO:tasks.workunit.client.1.smithi155.stdout:2/993: creat d2/dd/f15b x:0 0 0 2024-09-13T21:45:10.191 INFO:tasks.workunit.client.1.smithi155.stdout:2/994: write d2/dd/d21/d39/dc1/d66/fe7 [541282,127586] 0 2024-09-13T21:45:10.193 INFO:tasks.workunit.client.1.smithi155.stdout:2/995: write d2/dd/de/d15/d3f/de2/f119 [1150011,23736] 0 2024-09-13T21:45:10.195 INFO:tasks.workunit.client.1.smithi155.stdout:2/996: creat d2/dd/d37/d94/f15c x:0 0 0 2024-09-13T21:45:10.213 INFO:tasks.workunit.client.1.smithi155.stdout:2/997: dread d2/dd/d37/f67 [0,4194304] 0 2024-09-13T21:45:10.215 INFO:tasks.workunit.client.1.smithi155.stdout:2/998: truncate d2/db/f16 8218594 0 2024-09-13T21:45:10.218 INFO:tasks.workunit.client.1.smithi155.stdout:2/999: link d2/dd/d21/d39/dc1/d66/fe7 d2/dd/d21/d39/dc1/da3/f15d 0 2024-09-13T21:45:10.221 INFO:tasks.workunit.client.1.smithi155.stderr:+ rm -rf -- ./tmp.6e4fg9Jauw 2024-09-13T21:45:11.151 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T21:45:11.151 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T21:45:11.694 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:11 smithi155 ceph-mon[34732]: pgmap v20: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 61 MiB/s rd, 156 MiB/s wr, 407 op/s 2024-09-13T21:45:11.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:11 smithi119 ceph-mon[27653]: pgmap v20: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 61 MiB/s rd, 156 MiB/s wr, 407 op/s 2024-09-13T21:45:13.302 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:13.302 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:13.302 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: Adjusting osd_memory_target on smithi155 to 2581M 2024-09-13T21:45:13.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:13.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:13.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:45:13.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-13T21:45:13.303 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-13T21:45:13.304 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:45:13.304 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:45:13.304 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: pgmap v21: 65 pgs: 65 active+clean; 2.8 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 66 MiB/s rd, 166 MiB/s wr, 473 op/s 2024-09-13T21:45:13.304 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:45:13.304 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:13 smithi155 ceph-mon[34732]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:45:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T21:45:13.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: Adjusting osd_memory_target on smithi155 to 2581M 2024-09-13T21:45:13.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:13.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:13.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:45:13.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-13T21:45:13.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-13T21:45:13.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:45:13.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:45:13.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: pgmap v21: 65 pgs: 65 active+clean; 2.8 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 66 MiB/s rd, 166 MiB/s wr, 473 op/s 2024-09-13T21:45:13.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:45:13.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:13 smithi119 ceph-mon[27653]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:45:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:45:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:45:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: Reconfiguring node-exporter.smithi119 (dependencies changed)... 2024-09-13T21:45:14.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:14 smithi155 ceph-mon[34732]: Deploying daemon node-exporter.smithi119 on smithi119 2024-09-13T21:45:14.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:45:14.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:45:14.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:14.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: Reconfiguring node-exporter.smithi119 (dependencies changed)... 2024-09-13T21:45:14.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:14 smithi119 ceph-mon[27653]: Deploying daemon node-exporter.smithi119 on smithi119 2024-09-13T21:45:15.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:15 smithi119 ceph-mon[27653]: pgmap v22: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 156 MiB/s wr, 484 op/s 2024-09-13T21:45:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:15 smithi155 ceph-mon[34732]: pgmap v22: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 156 MiB/s wr, 484 op/s 2024-09-13T21:45:17.520 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:17 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:17.520 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:17 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:17.520 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:17 smithi119 ceph-mon[27653]: Reconfiguring alertmanager.smithi119 (dependencies changed)... 2024-09-13T21:45:17.520 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:17 smithi119 ceph-mon[27653]: Deploying daemon alertmanager.smithi119 on smithi119 2024-09-13T21:45:17.520 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:17 smithi119 ceph-mon[27653]: pgmap v23: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 37 MiB/s rd, 85 MiB/s wr, 334 op/s 2024-09-13T21:45:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:17 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:17 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:17 smithi155 ceph-mon[34732]: Reconfiguring alertmanager.smithi119 (dependencies changed)... 2024-09-13T21:45:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:17 smithi155 ceph-mon[34732]: Deploying daemon alertmanager.smithi119 on smithi119 2024-09-13T21:45:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:17 smithi155 ceph-mon[34732]: pgmap v23: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 37 MiB/s rd, 85 MiB/s wr, 334 op/s 2024-09-13T21:45:18.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.336+0000 7fd8170a7640 1 -- 172.21.15.119:0/2244619231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8100fb430 msgr2=0x7fd8100fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:18.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.336+0000 7fd8170a7640 1 --2- 172.21.15.119:0/2244619231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8100fb430 0x7fd8100fb840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd8040048d0 tx=0x7fd804009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:18.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.337+0000 7fd8170a7640 1 -- 172.21.15.119:0/2244619231 shutdown_connections 2024-09-13T21:45:18.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.337+0000 7fd8170a7640 1 --2- 172.21.15.119:0/2244619231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8100fc700 0x7fd8100fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:18.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.337+0000 7fd8170a7640 1 --2- 172.21.15.119:0/2244619231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8100fb430 0x7fd8100fb840 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:18.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.337+0000 7fd8170a7640 1 -- 172.21.15.119:0/2244619231 >> 172.21.15.119:0/2244619231 conn(0x7fd8100f6c10 msgr2=0x7fd8100f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:18.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.337+0000 7fd8170a7640 1 -- 172.21.15.119:0/2244619231 shutdown_connections 2024-09-13T21:45:18.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.337+0000 7fd8170a7640 1 -- 172.21.15.119:0/2244619231 wait complete. 2024-09-13T21:45:18.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.337+0000 7fd8170a7640 1 Processor -- start 2024-09-13T21:45:18.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.337+0000 7fd8170a7640 1 -- start start 2024-09-13T21:45:18.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd8170a7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8100fb430 0x7fd81010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:18.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd8170a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8100fc700 0x7fd81010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:18.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd8170a7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81010dbf0 con 0x7fd8100fc700 2024-09-13T21:45:18.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd8170a7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81010e410 con 0x7fd8100fb430 2024-09-13T21:45:18.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd80ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8100fc700 0x7fd81010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:18.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd814e43640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8100fb430 0x7fd81010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:18.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd80ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8100fc700 0x7fd81010d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39206/0 (socket says 172.21.15.119:39206) 2024-09-13T21:45:18.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd80ffff640 1 -- 172.21.15.119:0/4247951897 learned_addr learned my addr 172.21.15.119:0/4247951897 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:18.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd814e43640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8100fb430 0x7fd81010d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:36108/0 (socket says 172.21.15.119:36108) 2024-09-13T21:45:18.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd80ffff640 1 -- 172.21.15.119:0/4247951897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8100fb430 msgr2=0x7fd81010d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:18.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd80ffff640 1 --2- 172.21.15.119:0/4247951897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8100fb430 0x7fd81010d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:18.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd80ffff640 1 -- 172.21.15.119:0/4247951897 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd804005040 con 0x7fd8100fc700 2024-09-13T21:45:18.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd80ffff640 1 --2- 172.21.15.119:0/4247951897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8100fc700 0x7fd81010d5a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00eb70 tx=0x7fd7fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:18.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.338+0000 7fd80d7fa640 1 -- 172.21.15.119:0/4247951897 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7fc007c30 con 0x7fd8100fc700 2024-09-13T21:45:18.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.339+0000 7fd8170a7640 1 -- 172.21.15.119:0/4247951897 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81010e640 con 0x7fd8100fc700 2024-09-13T21:45:18.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.339+0000 7fd80d7fa640 1 -- 172.21.15.119:0/4247951897 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd7fc00f040 con 0x7fd8100fc700 2024-09-13T21:45:18.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.339+0000 7fd80d7fa640 1 -- 172.21.15.119:0/4247951897 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7fc00c950 con 0x7fd8100fc700 2024-09-13T21:45:18.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.339+0000 7fd8170a7640 1 -- 172.21.15.119:0/4247951897 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81010eb60 con 0x7fd8100fc700 2024-09-13T21:45:18.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.340+0000 7fd8170a7640 1 -- 172.21.15.119:0/4247951897 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8100fa890 con 0x7fd8100fc700 2024-09-13T21:45:18.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.340+0000 7fd80d7fa640 1 -- 172.21.15.119:0/4247951897 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd7fc00cad0 con 0x7fd8100fc700 2024-09-13T21:45:18.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.341+0000 7fd80d7fa640 1 --2- 172.21.15.119:0/4247951897 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd80006e7b0 0x7fd800070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:18.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.341+0000 7fd80d7fa640 1 -- 172.21.15.119:0/4247951897 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd7fc08db00 con 0x7fd8100fc700 2024-09-13T21:45:18.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.341+0000 7fd814e43640 1 --2- 172.21.15.119:0/4247951897 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd80006e7b0 0x7fd800070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:18.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.342+0000 7fd814e43640 1 --2- 172.21.15.119:0/4247951897 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd80006e7b0 0x7fd800070c60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd80400b020 tx=0x7fd804035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:18.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.346+0000 7fd80d7fa640 1 -- 172.21.15.119:0/4247951897 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd7fc050670 con 0x7fd8100fc700 2024-09-13T21:45:18.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.592+0000 7fd8170a7640 1 -- 172.21.15.119:0/4247951897 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd810103fc0 con 0x7fd80006e7b0 2024-09-13T21:45:18.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.594+0000 7fd80d7fa640 1 -- 172.21.15.119:0/4247951897 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fd810103fc0 con 0x7fd80006e7b0 2024-09-13T21:45:18.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.596+0000 7fd8170a7640 1 -- 172.21.15.119:0/4247951897 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd80006e7b0 msgr2=0x7fd800070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:18.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.596+0000 7fd8170a7640 1 --2- 172.21.15.119:0/4247951897 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd80006e7b0 0x7fd800070c60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd80400b020 tx=0x7fd804035040 comp rx=0 tx=0).stop 2024-09-13T21:45:18.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.596+0000 7fd8170a7640 1 -- 172.21.15.119:0/4247951897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8100fc700 msgr2=0x7fd81010d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:18.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.596+0000 7fd8170a7640 1 --2- 172.21.15.119:0/4247951897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8100fc700 0x7fd81010d5a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00eb70 tx=0x7fd7fc00b040 comp rx=0 tx=0).stop 2024-09-13T21:45:18.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.596+0000 7fd8170a7640 1 -- 172.21.15.119:0/4247951897 shutdown_connections 2024-09-13T21:45:18.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.596+0000 7fd8170a7640 1 --2- 172.21.15.119:0/4247951897 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fd80006e7b0 0x7fd800070c60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:18.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.596+0000 7fd8170a7640 1 --2- 172.21.15.119:0/4247951897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8100fc700 0x7fd81010d5a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:18.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.596+0000 7fd8170a7640 1 --2- 172.21.15.119:0/4247951897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8100fb430 0x7fd81010d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:18.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.596+0000 7fd8170a7640 1 -- 172.21.15.119:0/4247951897 >> 172.21.15.119:0/4247951897 conn(0x7fd8100f6c10 msgr2=0x7fd8100656a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:18.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.596+0000 7fd8170a7640 1 -- 172.21.15.119:0/4247951897 shutdown_connections 2024-09-13T21:45:18.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.597+0000 7fd8170a7640 1 -- 172.21.15.119:0/4247951897 wait complete. 2024-09-13T21:45:18.608 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:45:18.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.714+0000 7fa57219b640 1 -- 172.21.15.119:0/150630666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa56c103e30 msgr2=0x7fa56c1042a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:18.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.714+0000 7fa57219b640 1 --2- 172.21.15.119:0/150630666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa56c103e30 0x7fa56c1042a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa5540048d0 tx=0x7fa554009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:18.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.715+0000 7fa57219b640 1 -- 172.21.15.119:0/150630666 shutdown_connections 2024-09-13T21:45:18.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.715+0000 7fa57219b640 1 --2- 172.21.15.119:0/150630666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa56c103e30 0x7fa56c1042a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:18.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.715+0000 7fa57219b640 1 --2- 172.21.15.119:0/150630666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa56c102b60 0x7fa56c102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:18.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.715+0000 7fa57219b640 1 -- 172.21.15.119:0/150630666 >> 172.21.15.119:0/150630666 conn(0x7fa56c071dc0 msgr2=0x7fa56c0741f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:18.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.715+0000 7fa57219b640 1 -- 172.21.15.119:0/150630666 shutdown_connections 2024-09-13T21:45:18.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.715+0000 7fa57219b640 1 -- 172.21.15.119:0/150630666 wait complete. 2024-09-13T21:45:18.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.716+0000 7fa57219b640 1 Processor -- start 2024-09-13T21:45:18.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.716+0000 7fa57219b640 1 -- start start 2024-09-13T21:45:18.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.716+0000 7fa57219b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa56c102b60 0x7fa56c07c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:18.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.716+0000 7fa57219b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa56c103e30 0x7fa56c07cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:18.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.716+0000 7fa57219b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c07e600 con 0x7fa56c103e30 2024-09-13T21:45:18.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.716+0000 7fa57219b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c07d420 con 0x7fa56c102b60 2024-09-13T21:45:18.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.716+0000 7fa56affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa56c103e30 0x7fa56c07cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:18.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.716+0000 7fa56affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa56c103e30 0x7fa56c07cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39210/0 (socket says 172.21.15.119:39210) 2024-09-13T21:45:18.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.716+0000 7fa56affd640 1 -- 172.21.15.119:0/4012360772 learned_addr learned my addr 172.21.15.119:0/4012360772 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:18.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.716+0000 7fa56b7fe640 1 --2- 172.21.15.119:0/4012360772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa56c102b60 0x7fa56c07c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.717+0000 7fa56affd640 1 -- 172.21.15.119:0/4012360772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa56c102b60 msgr2=0x7fa56c07c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.717+0000 7fa56affd640 1 --2- 172.21.15.119:0/4012360772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa56c102b60 0x7fa56c07c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.717+0000 7fa56affd640 1 -- 172.21.15.119:0/4012360772 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554005040 con 0x7fa56c103e30 2024-09-13T21:45:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.717+0000 7fa56affd640 1 --2- 172.21.15.119:0/4012360772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa56c103e30 0x7fa56c07cee0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa554003080 tx=0x7fa554009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.718+0000 7fa563fff640 1 -- 172.21.15.119:0/4012360772 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa554038070 con 0x7fa56c103e30 2024-09-13T21:45:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.718+0000 7fa563fff640 1 -- 172.21.15.119:0/4012360772 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa55402abd0 con 0x7fa56c103e30 2024-09-13T21:45:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.718+0000 7fa563fff640 1 -- 172.21.15.119:0/4012360772 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa554033660 con 0x7fa56c103e30 2024-09-13T21:45:18.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.718+0000 7fa57219b640 1 -- 172.21.15.119:0/4012360772 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c07d6a0 con 0x7fa56c103e30 2024-09-13T21:45:18.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.719+0000 7fa57219b640 1 -- 172.21.15.119:0/4012360772 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c121c20 con 0x7fa56c103e30 2024-09-13T21:45:18.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.725+0000 7fa563fff640 1 -- 172.21.15.119:0/4012360772 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fa554030020 con 0x7fa56c103e30 2024-09-13T21:45:18.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.726+0000 7fa563fff640 1 --2- 172.21.15.119:0/4012360772 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa55806e7b0 0x7fa558070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:18.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.726+0000 7fa57219b640 1 -- 172.21.15.119:0/4012360772 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c0759f0 con 0x7fa56c103e30 2024-09-13T21:45:18.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.726+0000 7fa56b7fe640 1 --2- 172.21.15.119:0/4012360772 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa55806e7b0 0x7fa558070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:18.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.726+0000 7fa563fff640 1 -- 172.21.15.119:0/4012360772 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa554080a30 con 0x7fa56c103e30 2024-09-13T21:45:18.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.728+0000 7fa56b7fe640 1 --2- 172.21.15.119:0/4012360772 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa55806e7b0 0x7fa558070c60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa56c07e260 tx=0x7fa564009780 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:18.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:18.741+0000 7fa563fff640 1 -- 172.21.15.119:0/4012360772 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa5540789d0 con 0x7fa56c103e30 2024-09-13T21:45:19.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.055+0000 7fa57219b640 1 -- 172.21.15.119:0/4012360772 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa56c108170 con 0x7fa55806e7b0 2024-09-13T21:45:19.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.056+0000 7fa563fff640 1 -- 172.21.15.119:0/4012360772 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa56c108170 con 0x7fa55806e7b0 2024-09-13T21:45:19.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.058+0000 7fa57219b640 1 -- 172.21.15.119:0/4012360772 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa55806e7b0 msgr2=0x7fa558070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.058+0000 7fa57219b640 1 --2- 172.21.15.119:0/4012360772 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa55806e7b0 0x7fa558070c60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa56c07e260 tx=0x7fa564009780 comp rx=0 tx=0).stop 2024-09-13T21:45:19.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.058+0000 7fa57219b640 1 -- 172.21.15.119:0/4012360772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa56c103e30 msgr2=0x7fa56c07cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.058+0000 7fa57219b640 1 --2- 172.21.15.119:0/4012360772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa56c103e30 0x7fa56c07cee0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa554003080 tx=0x7fa554009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.059+0000 7fa57219b640 1 -- 172.21.15.119:0/4012360772 shutdown_connections 2024-09-13T21:45:19.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.059+0000 7fa57219b640 1 --2- 172.21.15.119:0/4012360772 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa55806e7b0 0x7fa558070c60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.059+0000 7fa57219b640 1 --2- 172.21.15.119:0/4012360772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa56c103e30 0x7fa56c07cee0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.059+0000 7fa57219b640 1 --2- 172.21.15.119:0/4012360772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa56c102b60 0x7fa56c07c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.059+0000 7fa57219b640 1 -- 172.21.15.119:0/4012360772 >> 172.21.15.119:0/4012360772 conn(0x7fa56c071dc0 msgr2=0x7fa56c073540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:19.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.059+0000 7fa57219b640 1 -- 172.21.15.119:0/4012360772 shutdown_connections 2024-09-13T21:45:19.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.059+0000 7fa57219b640 1 -- 172.21.15.119:0/4012360772 wait complete. 2024-09-13T21:45:19.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.144+0000 7f484238b640 1 -- 172.21.15.119:0/3130340149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f483c0fc700 msgr2=0x7f483c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.144+0000 7f484238b640 1 --2- 172.21.15.119:0/3130340149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f483c0fc700 0x7f483c0fcb70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f48300048d0 tx=0x7f4830009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.145+0000 7f484238b640 1 -- 172.21.15.119:0/3130340149 shutdown_connections 2024-09-13T21:45:19.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.145+0000 7f484238b640 1 --2- 172.21.15.119:0/3130340149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f483c0fc700 0x7f483c0fcb70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.145+0000 7f484238b640 1 --2- 172.21.15.119:0/3130340149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f483c0fb430 0x7f483c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.145+0000 7f484238b640 1 -- 172.21.15.119:0/3130340149 >> 172.21.15.119:0/3130340149 conn(0x7f483c0f6c10 msgr2=0x7f483c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:19.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.145+0000 7f484238b640 1 -- 172.21.15.119:0/3130340149 shutdown_connections 2024-09-13T21:45:19.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.145+0000 7f484238b640 1 -- 172.21.15.119:0/3130340149 wait complete. 2024-09-13T21:45:19.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.145+0000 7f484238b640 1 Processor -- start 2024-09-13T21:45:19.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f484238b640 1 -- start start 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f484238b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f483c0fb430 0x7f483c10fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f484238b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f483c0fc700 0x7f483c1122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f484238b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c065cc0 con 0x7f483c0fc700 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f484238b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c065e30 con 0x7f483c0fb430 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f483bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f483c0fb430 0x7f483c10fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f483b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f483c0fc700 0x7f483c1122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f483b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f483c0fc700 0x7f483c1122b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39226/0 (socket says 172.21.15.119:39226) 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f483b7fe640 1 -- 172.21.15.119:0/663873305 learned_addr learned my addr 172.21.15.119:0/663873305 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f483b7fe640 1 -- 172.21.15.119:0/663873305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f483c0fb430 msgr2=0x7f483c10fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f483b7fe640 1 --2- 172.21.15.119:0/663873305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f483c0fb430 0x7f483c10fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.146+0000 7f483b7fe640 1 -- 172.21.15.119:0/663873305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4830005040 con 0x7f483c0fc700 2024-09-13T21:45:19.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.147+0000 7f483b7fe640 1 --2- 172.21.15.119:0/663873305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f483c0fc700 0x7f483c1122b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f48300048a0 tx=0x7f4830009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:19.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.147+0000 7f4838ff9640 1 -- 172.21.15.119:0/663873305 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4830038070 con 0x7f483c0fc700 2024-09-13T21:45:19.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.147+0000 7f484238b640 1 -- 172.21.15.119:0/663873305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c10bb40 con 0x7f483c0fc700 2024-09-13T21:45:19.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.147+0000 7f484238b640 1 -- 172.21.15.119:0/663873305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483c10c0e0 con 0x7f483c0fc700 2024-09-13T21:45:19.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.147+0000 7f4838ff9640 1 -- 172.21.15.119:0/663873305 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4830004290 con 0x7f483c0fc700 2024-09-13T21:45:19.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.147+0000 7f4838ff9640 1 -- 172.21.15.119:0/663873305 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4830033660 con 0x7f483c0fc700 2024-09-13T21:45:19.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.148+0000 7f484238b640 1 -- 172.21.15.119:0/663873305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c0fa890 con 0x7f483c0fc700 2024-09-13T21:45:19.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.149+0000 7f4838ff9640 1 -- 172.21.15.119:0/663873305 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f4830030020 con 0x7f483c0fc700 2024-09-13T21:45:19.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.149+0000 7f4838ff9640 1 --2- 172.21.15.119:0/663873305 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f482406e6e0 0x7f4824070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:19.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.149+0000 7f4838ff9640 1 -- 172.21.15.119:0/663873305 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f48300adf70 con 0x7f483c0fc700 2024-09-13T21:45:19.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.149+0000 7f483bfff640 1 --2- 172.21.15.119:0/663873305 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f482406e6e0 0x7f4824070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:19.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.150+0000 7f483bfff640 1 --2- 172.21.15.119:0/663873305 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f482406e6e0 0x7f4824070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f483c0659b0 tx=0x7f482c00b040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:19.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.154+0000 7f4838ff9640 1 -- 172.21.15.119:0/663873305 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f48300e2670 con 0x7f483c0fc700 2024-09-13T21:45:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.360+0000 7f484238b640 1 -- 172.21.15.119:0/663873305 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f483c100b10 con 0x7f482406e6e0 2024-09-13T21:45:19.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.371+0000 7f4838ff9640 1 -- 172.21.15.119:0/663873305 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f483c100b10 con 0x7f482406e6e0 2024-09-13T21:45:19.373 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:45:19.373 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (7m) 18s ago 8m 23.1M - 0.25.0 c8568f914cd2 d48a0a37f6f5 2024-09-13T21:45:19.373 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (8m) 18s ago 8m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 c6a79bd22109 2024-09-13T21:45:19.373 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (7m) 20s ago 7m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 1bccd1b9bda0 2024-09-13T21:45:19.373 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (7m) 18s ago 8m 85.2M - 9.4.7 954c08fa6188 b9b173631489 2024-09-13T21:45:19.373 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (3m) 18s ago 3m 11.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:45:19.373 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (2m) 18s ago 2m 121M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:45:19.373 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (2m) 20s ago 2m 15.0M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:45:19.373 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (3m) 20s ago 3m 111M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:45:19.373 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:9283,8765,8443 running (9m) 18s ago 9m 261M - 17.2.7-1629-geb16b97b ab51d1bebd12 b7b1f8308caa 2024-09-13T21:45:19.373 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283 running (72s) 20s ago 7m 479M - 19.1.1-324-gecab7be5 0652ff2b5d78 3869f6b2a429 2024-09-13T21:45:19.374 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (9m) 18s ago 9m 47.4M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 f49a62e4f3c3 2024-09-13T21:45:19.374 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (7m) 20s ago 7m 37.0M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 66c9116315ae 2024-09-13T21:45:19.374 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 starting - - - - 2024-09-13T21:45:19.374 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (7m) 20s ago 7m 15.7M - 1.5.0 0da6a335fe13 513bc6bacbbd 2024-09-13T21:45:19.374 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (6m) 18s ago 6m 167M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 6e0bbff1ac3f 2024-09-13T21:45:19.374 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (6m) 18s ago 6m 175M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:45:19.374 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (5m) 18s ago 5m 143M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:45:19.374 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (5m) 20s ago 5m 179M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:45:19.374 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (4m) 20s ago 4m 172M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:45:19.374 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (4m) 20s ago 4m 170M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:45:19.374 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (6m) 18s ago 7m 53.7M - 2.43.0 a07b618ecd1d 5d5878bd99c5 2024-09-13T21:45:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.373+0000 7f484238b640 1 -- 172.21.15.119:0/663873305 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f482406e6e0 msgr2=0x7f4824070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.373+0000 7f484238b640 1 --2- 172.21.15.119:0/663873305 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f482406e6e0 0x7f4824070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f483c0659b0 tx=0x7f482c00b040 comp rx=0 tx=0).stop 2024-09-13T21:45:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.373+0000 7f484238b640 1 -- 172.21.15.119:0/663873305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f483c0fc700 msgr2=0x7f483c1122b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.373+0000 7f484238b640 1 --2- 172.21.15.119:0/663873305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f483c0fc700 0x7f483c1122b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f48300048a0 tx=0x7f4830009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.374+0000 7f484238b640 1 -- 172.21.15.119:0/663873305 shutdown_connections 2024-09-13T21:45:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.374+0000 7f484238b640 1 --2- 172.21.15.119:0/663873305 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f482406e6e0 0x7f4824070b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.374+0000 7f484238b640 1 --2- 172.21.15.119:0/663873305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f483c0fc700 0x7f483c1122b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.374+0000 7f484238b640 1 --2- 172.21.15.119:0/663873305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f483c0fb430 0x7f483c10fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.374+0000 7f484238b640 1 -- 172.21.15.119:0/663873305 >> 172.21.15.119:0/663873305 conn(0x7f483c0f6c10 msgr2=0x7f483c0f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.374+0000 7f484238b640 1 -- 172.21.15.119:0/663873305 shutdown_connections 2024-09-13T21:45:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.374+0000 7f484238b640 1 -- 172.21.15.119:0/663873305 wait complete. 2024-09-13T21:45:19.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.460+0000 7f489ca07640 1 -- 172.21.15.119:0/1090511048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48980ff6e0 msgr2=0x7f4898101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.460+0000 7f489ca07640 1 --2- 172.21.15.119:0/1090511048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48980ff6e0 0x7f4898101ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f488c0048d0 tx=0x7f488c009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.460+0000 7f489ca07640 1 -- 172.21.15.119:0/1090511048 shutdown_connections 2024-09-13T21:45:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.460+0000 7f489ca07640 1 --2- 172.21.15.119:0/1090511048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48980ff6e0 0x7f4898101ac0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.460+0000 7f489ca07640 1 --2- 172.21.15.119:0/1090511048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4898065be0 0x7f48980ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.460+0000 7f489ca07640 1 -- 172.21.15.119:0/1090511048 >> 172.21.15.119:0/1090511048 conn(0x7f48980f6c10 msgr2=0x7f48980f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.460+0000 7f489ca07640 1 -- 172.21.15.119:0/1090511048 shutdown_connections 2024-09-13T21:45:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.460+0000 7f489ca07640 1 -- 172.21.15.119:0/1090511048 wait complete. 2024-09-13T21:45:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489ca07640 1 Processor -- start 2024-09-13T21:45:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489ca07640 1 -- start start 2024-09-13T21:45:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489ca07640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4898065be0 0x7f489810d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489ca07640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48980ff6e0 0x7f489810d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489ca07640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489810dbe0 con 0x7f4898065be0 2024-09-13T21:45:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489ca07640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489810e400 con 0x7f48980ff6e0 2024-09-13T21:45:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4898065be0 0x7f489810d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4898065be0 0x7f489810d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39248/0 (socket says 172.21.15.119:39248) 2024-09-13T21:45:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489659c640 1 -- 172.21.15.119:0/2631161659 learned_addr learned my addr 172.21.15.119:0/2631161659 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f4895d9b640 1 --2- 172.21.15.119:0/2631161659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48980ff6e0 0x7f489810d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489659c640 1 -- 172.21.15.119:0/2631161659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48980ff6e0 msgr2=0x7f489810d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489659c640 1 --2- 172.21.15.119:0/2631161659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48980ff6e0 0x7f489810d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.461+0000 7f489659c640 1 -- 172.21.15.119:0/2631161659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c005040 con 0x7f4898065be0 2024-09-13T21:45:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.462+0000 7f489659c640 1 --2- 172.21.15.119:0/2631161659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4898065be0 0x7f489810d050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f488800eb70 tx=0x7f488800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.462+0000 7f4886ffd640 1 -- 172.21.15.119:0/2631161659 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4888007c30 con 0x7f4898065be0 2024-09-13T21:45:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.462+0000 7f4886ffd640 1 -- 172.21.15.119:0/2631161659 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f488800f040 con 0x7f4898065be0 2024-09-13T21:45:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.462+0000 7f4886ffd640 1 -- 172.21.15.119:0/2631161659 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f488800caa0 con 0x7f4898065be0 2024-09-13T21:45:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.462+0000 7f489ca07640 1 -- 172.21.15.119:0/2631161659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489810e690 con 0x7f4898065be0 2024-09-13T21:45:19.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.462+0000 7f489ca07640 1 -- 172.21.15.119:0/2631161659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489810ec00 con 0x7f4898065be0 2024-09-13T21:45:19.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.463+0000 7f489ca07640 1 -- 172.21.15.119:0/2631161659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4898105770 con 0x7f4898065be0 2024-09-13T21:45:19.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.464+0000 7f4886ffd640 1 -- 172.21.15.119:0/2631161659 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f4888009110 con 0x7f4898065be0 2024-09-13T21:45:19.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.464+0000 7f4886ffd640 1 --2- 172.21.15.119:0/2631161659 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f488006e6e0 0x7f4880070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:19.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.464+0000 7f4886ffd640 1 -- 172.21.15.119:0/2631161659 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f488808e150 con 0x7f4898065be0 2024-09-13T21:45:19.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.465+0000 7f4895d9b640 1 --2- 172.21.15.119:0/2631161659 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f488006e6e0 0x7f4880070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:19.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.465+0000 7f4895d9b640 1 --2- 172.21.15.119:0/2631161659 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f488006e6e0 0x7f4880070b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f488c009ac0 tx=0x7f488c035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:19.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.472+0000 7f4886ffd640 1 -- 172.21.15.119:0/2631161659 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f48880579d0 con 0x7f4898065be0 2024-09-13T21:45:19.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:19 smithi119 ceph-mon[27653]: pgmap v24: 65 pgs: 65 active+clean; 1.3 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 37 MiB/s rd, 86 MiB/s wr, 516 op/s 2024-09-13T21:45:19.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:19 smithi119 ceph-mon[27653]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:19.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.809+0000 7f489ca07640 1 -- 172.21.15.119:0/2631161659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f489804b750 con 0x7f4898065be0 2024-09-13T21:45:19.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.810+0000 7f4886ffd640 1 -- 172.21.15.119:0/2631161659 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f488805b090 con 0x7f4898065be0 2024-09-13T21:45:19.812 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:45:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:45:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T21:45:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:45:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:45:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 1, 2024-09-13T21:45:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:45:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:45:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:45:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T21:45:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:45:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:45:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:45:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:45:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:45:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 13, 2024-09-13T21:45:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:45:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:45:19.813 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:45:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.812+0000 7f489ca07640 1 -- 172.21.15.119:0/2631161659 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f488006e6e0 msgr2=0x7f4880070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.812+0000 7f489ca07640 1 --2- 172.21.15.119:0/2631161659 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f488006e6e0 0x7f4880070b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f488c009ac0 tx=0x7f488c035040 comp rx=0 tx=0).stop 2024-09-13T21:45:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.812+0000 7f489ca07640 1 -- 172.21.15.119:0/2631161659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4898065be0 msgr2=0x7f489810d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.812+0000 7f489ca07640 1 --2- 172.21.15.119:0/2631161659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4898065be0 0x7f489810d050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f488800eb70 tx=0x7f488800b040 comp rx=0 tx=0).stop 2024-09-13T21:45:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.812+0000 7f489ca07640 1 -- 172.21.15.119:0/2631161659 shutdown_connections 2024-09-13T21:45:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.812+0000 7f489ca07640 1 --2- 172.21.15.119:0/2631161659 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f488006e6e0 0x7f4880070b90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.812+0000 7f489ca07640 1 --2- 172.21.15.119:0/2631161659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48980ff6e0 0x7f489810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.812+0000 7f489ca07640 1 --2- 172.21.15.119:0/2631161659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4898065be0 0x7f489810d050 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.812+0000 7f489ca07640 1 -- 172.21.15.119:0/2631161659 >> 172.21.15.119:0/2631161659 conn(0x7f48980f6c10 msgr2=0x7f48980f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:19.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.812+0000 7f489ca07640 1 -- 172.21.15.119:0/2631161659 shutdown_connections 2024-09-13T21:45:19.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.812+0000 7f489ca07640 1 -- 172.21.15.119:0/2631161659 wait complete. 2024-09-13T21:45:19.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:19 smithi155 ceph-mon[34732]: pgmap v24: 65 pgs: 65 active+clean; 1.3 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 37 MiB/s rd, 86 MiB/s wr, 516 op/s 2024-09-13T21:45:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:19 smithi155 ceph-mon[34732]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.926+0000 7fe03f89d640 1 -- 172.21.15.119:0/3400530771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0380fabb0 msgr2=0x7fe0380fafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.926+0000 7fe03f89d640 1 --2- 172.21.15.119:0/3400530771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0380fabb0 0x7fe0380fafc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0048d0 tx=0x7fe02c009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.926+0000 7fe03f89d640 1 -- 172.21.15.119:0/3400530771 shutdown_connections 2024-09-13T21:45:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.926+0000 7fe03f89d640 1 --2- 172.21.15.119:0/3400530771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380fbe80 0x7fe0380fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.926+0000 7fe03f89d640 1 --2- 172.21.15.119:0/3400530771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0380fabb0 0x7fe0380fafc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.926+0000 7fe03f89d640 1 -- 172.21.15.119:0/3400530771 >> 172.21.15.119:0/3400530771 conn(0x7fe0380f6390 msgr2=0x7fe0380f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.926+0000 7fe03f89d640 1 -- 172.21.15.119:0/3400530771 shutdown_connections 2024-09-13T21:45:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.926+0000 7fe03f89d640 1 -- 172.21.15.119:0/3400530771 wait complete. 2024-09-13T21:45:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.927+0000 7fe03f89d640 1 Processor -- start 2024-09-13T21:45:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.927+0000 7fe03f89d640 1 -- start start 2024-09-13T21:45:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.928+0000 7fe03f89d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0380fabb0 0x7fe038116230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.928+0000 7fe03f89d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380fbe80 0x7fe038118780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.928+0000 7fe03f89d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03806f720 con 0x7fe0380fabb0 2024-09-13T21:45:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.928+0000 7fe03f89d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe038118cc0 con 0x7fe0380fbe80 2024-09-13T21:45:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.928+0000 7fe03ce38640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380fbe80 0x7fe038118780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.928+0000 7fe03ce38640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380fbe80 0x7fe038118780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:36158/0 (socket says 172.21.15.119:36158) 2024-09-13T21:45:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.928+0000 7fe03ce38640 1 -- 172.21.15.119:0/691377679 learned_addr learned my addr 172.21.15.119:0/691377679 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.928+0000 7fe03d639640 1 --2- 172.21.15.119:0/691377679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0380fabb0 0x7fe038116230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.929+0000 7fe03ce38640 1 -- 172.21.15.119:0/691377679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0380fabb0 msgr2=0x7fe038116230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:19.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.929+0000 7fe03ce38640 1 --2- 172.21.15.119:0/691377679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0380fabb0 0x7fe038116230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:19.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.929+0000 7fe03ce38640 1 -- 172.21.15.119:0/691377679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c005040 con 0x7fe0380fbe80 2024-09-13T21:45:19.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.929+0000 7fe03ce38640 1 --2- 172.21.15.119:0/691377679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380fbe80 0x7fe038118780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe034002a50 tx=0x7fe034004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:19.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.930+0000 7fe029ffb640 1 -- 172.21.15.119:0/691377679 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe034007c30 con 0x7fe0380fbe80 2024-09-13T21:45:19.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.930+0000 7fe029ffb640 1 -- 172.21.15.119:0/691377679 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe03400f040 con 0x7fe0380fbe80 2024-09-13T21:45:19.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.930+0000 7fe029ffb640 1 -- 172.21.15.119:0/691377679 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe03400da10 con 0x7fe0380fbe80 2024-09-13T21:45:19.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.930+0000 7fe03f89d640 1 -- 172.21.15.119:0/691377679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe038118fa0 con 0x7fe0380fbe80 2024-09-13T21:45:19.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.931+0000 7fe03f89d640 1 -- 172.21.15.119:0/691377679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe038119540 con 0x7fe0380fbe80 2024-09-13T21:45:19.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.933+0000 7fe029ffb640 1 -- 172.21.15.119:0/691377679 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fe03400db70 con 0x7fe0380fbe80 2024-09-13T21:45:19.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.933+0000 7fe03f89d640 1 -- 172.21.15.119:0/691377679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c005240 con 0x7fe0380fbe80 2024-09-13T21:45:19.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.934+0000 7fe029ffb640 1 --2- 172.21.15.119:0/691377679 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fe02406e7b0 0x7fe024070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:19.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.934+0000 7fe029ffb640 1 -- 172.21.15.119:0/691377679 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe03400de20 con 0x7fe0380fbe80 2024-09-13T21:45:19.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.934+0000 7fe03d639640 1 --2- 172.21.15.119:0/691377679 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fe02406e7b0 0x7fe024070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:19.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.936+0000 7fe03d639640 1 --2- 172.21.15.119:0/691377679 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fe02406e7b0 0x7fe024070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe02c000c00 tx=0x7fe02c035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:19.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:19.943+0000 7fe029ffb640 1 -- 172.21.15.119:0/691377679 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe0340576e0 con 0x7fe0380fbe80 2024-09-13T21:45:20.248 INFO:teuthology.orchestra.run.smithi119.stdout:e19 2024-09-13T21:45:20.248 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 19 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:44:07.446483+0000 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:45:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:45:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:45:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:45:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:45:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:45:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:45:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:45:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:45:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:45:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:45:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:45:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:45:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:45:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:45:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:45:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:45:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:45:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:20.252 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:45:20.252 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:45:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:45:20.252 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:45:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:20.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.245+0000 7fe03f89d640 1 -- 172.21.15.119:0/691377679 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe01c0057c0 con 0x7fe0380fbe80 2024-09-13T21:45:20.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.246+0000 7fe029ffb640 1 -- 172.21.15.119:0/691377679 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1837 (secure 0 0 0) 0x7fe034017020 con 0x7fe0380fbe80 2024-09-13T21:45:20.253 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 19 2024-09-13T21:45:20.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.249+0000 7fe03f89d640 1 -- 172.21.15.119:0/691377679 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fe02406e7b0 msgr2=0x7fe024070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:20.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.249+0000 7fe03f89d640 1 --2- 172.21.15.119:0/691377679 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fe02406e7b0 0x7fe024070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe02c000c00 tx=0x7fe02c035040 comp rx=0 tx=0).stop 2024-09-13T21:45:20.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.249+0000 7fe03f89d640 1 -- 172.21.15.119:0/691377679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380fbe80 msgr2=0x7fe038118780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:20.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.249+0000 7fe03f89d640 1 --2- 172.21.15.119:0/691377679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380fbe80 0x7fe038118780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe034002a50 tx=0x7fe034004600 comp rx=0 tx=0).stop 2024-09-13T21:45:20.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.249+0000 7fe03f89d640 1 -- 172.21.15.119:0/691377679 shutdown_connections 2024-09-13T21:45:20.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.249+0000 7fe03f89d640 1 --2- 172.21.15.119:0/691377679 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fe02406e7b0 0x7fe024070c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.249+0000 7fe03f89d640 1 --2- 172.21.15.119:0/691377679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380fbe80 0x7fe038118780 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.249+0000 7fe03f89d640 1 --2- 172.21.15.119:0/691377679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0380fabb0 0x7fe038116230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.249+0000 7fe03f89d640 1 -- 172.21.15.119:0/691377679 >> 172.21.15.119:0/691377679 conn(0x7fe0380f6390 msgr2=0x7fe0380f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:20.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.249+0000 7fe03f89d640 1 -- 172.21.15.119:0/691377679 shutdown_connections 2024-09-13T21:45:20.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.249+0000 7fe03f89d640 1 -- 172.21.15.119:0/691377679 wait complete. 2024-09-13T21:45:20.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.349+0000 7f2b51241640 1 -- 172.21.15.119:0/763248781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4c066650 msgr2=0x7f2b4c0ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:20.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.349+0000 7f2b51241640 1 --2- 172.21.15.119:0/763248781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4c066650 0x7f2b4c0ff1b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0048d0 tx=0x7f2b3c009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.349+0000 7f2b51241640 1 -- 172.21.15.119:0/763248781 shutdown_connections 2024-09-13T21:45:20.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.349+0000 7f2b51241640 1 --2- 172.21.15.119:0/763248781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b4c0ff6f0 0x7f2b4c101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.349+0000 7f2b51241640 1 --2- 172.21.15.119:0/763248781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4c066650 0x7f2b4c0ff1b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.349+0000 7f2b51241640 1 -- 172.21.15.119:0/763248781 >> 172.21.15.119:0/763248781 conn(0x7f2b4c0f6c20 msgr2=0x7f2b4c0f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:20.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.349+0000 7f2b51241640 1 -- 172.21.15.119:0/763248781 shutdown_connections 2024-09-13T21:45:20.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.349+0000 7f2b51241640 1 -- 172.21.15.119:0/763248781 wait complete. 2024-09-13T21:45:20.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.350+0000 7f2b51241640 1 Processor -- start 2024-09-13T21:45:20.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.350+0000 7f2b51241640 1 -- start start 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.351+0000 7f2b51241640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4c066650 0x7f2b4c0fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.351+0000 7f2b51241640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b4c0ff6f0 0x7f2b4c0fb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.351+0000 7f2b51241640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0fb640 con 0x7f2b4c066650 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.351+0000 7f2b51241640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0fb780 con 0x7f2b4c0ff6f0 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.351+0000 7f2b4ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4c066650 0x7f2b4c0fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.351+0000 7f2b4ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4c066650 0x7f2b4c0fcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39290/0 (socket says 172.21.15.119:39290) 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.351+0000 7f2b4ad9d640 1 -- 172.21.15.119:0/1607158570 learned_addr learned my addr 172.21.15.119:0/1607158570 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.351+0000 7f2b4a59c640 1 --2- 172.21.15.119:0/1607158570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b4c0ff6f0 0x7f2b4c0fb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.351+0000 7f2b4ad9d640 1 -- 172.21.15.119:0/1607158570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b4c0ff6f0 msgr2=0x7f2b4c0fb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.351+0000 7f2b4ad9d640 1 --2- 172.21.15.119:0/1607158570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b4c0ff6f0 0x7f2b4c0fb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.351+0000 7f2b4ad9d640 1 -- 172.21.15.119:0/1607158570 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c005040 con 0x7f2b4c066650 2024-09-13T21:45:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.352+0000 7f2b4ad9d640 1 --2- 172.21.15.119:0/1607158570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4c066650 0x7f2b4c0fcbc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009ac0 tx=0x7f2b3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:20.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.352+0000 7f2b337fe640 1 -- 172.21.15.119:0/1607158570 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b3c038070 con 0x7f2b4c066650 2024-09-13T21:45:20.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.352+0000 7f2b337fe640 1 -- 172.21.15.119:0/1607158570 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2b3c009740 con 0x7f2b4c066650 2024-09-13T21:45:20.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.352+0000 7f2b51241640 1 -- 172.21.15.119:0/1607158570 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c0fba00 con 0x7f2b4c066650 2024-09-13T21:45:20.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.352+0000 7f2b337fe640 1 -- 172.21.15.119:0/1607158570 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b3c03eb30 con 0x7f2b4c066650 2024-09-13T21:45:20.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.352+0000 7f2b51241640 1 -- 172.21.15.119:0/1607158570 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c115190 con 0x7f2b4c066650 2024-09-13T21:45:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.354+0000 7f2b51241640 1 -- 172.21.15.119:0/1607158570 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c0fa8a0 con 0x7f2b4c066650 2024-09-13T21:45:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.354+0000 7f2b337fe640 1 -- 172.21.15.119:0/1607158570 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f2b3c030020 con 0x7f2b4c066650 2024-09-13T21:45:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.355+0000 7f2b337fe640 1 --2- 172.21.15.119:0/1607158570 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f2b3406e6e0 0x7f2b34070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.355+0000 7f2b337fe640 1 -- 172.21.15.119:0/1607158570 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2b3c0ae330 con 0x7f2b4c066650 2024-09-13T21:45:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.355+0000 7f2b4a59c640 1 --2- 172.21.15.119:0/1607158570 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f2b3406e6e0 0x7f2b34070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.356+0000 7f2b4a59c640 1 --2- 172.21.15.119:0/1607158570 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f2b3406e6e0 0x7f2b34070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2b40004a70 tx=0x7f2b4000b040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:20.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.360+0000 7f2b337fe640 1 -- 172.21.15.119:0/1607158570 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2b3c077cc0 con 0x7f2b4c066650 2024-09-13T21:45:20.424 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T21:45:20.425 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-13T21:45:20.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.601+0000 7f2b51241640 1 -- 172.21.15.119:0/1607158570 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b4c0f8710 con 0x7f2b3406e6e0 2024-09-13T21:45:20.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.603+0000 7f2b337fe640 1 -- 172.21.15.119:0/1607158570 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f2b4c0f8710 con 0x7f2b3406e6e0 2024-09-13T21:45:20.604 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:45:20.604 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:45:20.604 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:45:20.604 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:45:20.604 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [], 2024-09-13T21:45:20.605 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T21:45:20.605 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "", 2024-09-13T21:45:20.605 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:45:20.605 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:45:20.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.605+0000 7f2b51241640 1 -- 172.21.15.119:0/1607158570 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f2b3406e6e0 msgr2=0x7f2b34070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:20.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.605+0000 7f2b51241640 1 --2- 172.21.15.119:0/1607158570 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f2b3406e6e0 0x7f2b34070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2b40004a70 tx=0x7f2b4000b040 comp rx=0 tx=0).stop 2024-09-13T21:45:20.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.605+0000 7f2b51241640 1 -- 172.21.15.119:0/1607158570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4c066650 msgr2=0x7f2b4c0fcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:20.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.605+0000 7f2b51241640 1 --2- 172.21.15.119:0/1607158570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4c066650 0x7f2b4c0fcbc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009ac0 tx=0x7f2b3c009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.605+0000 7f2b51241640 1 -- 172.21.15.119:0/1607158570 shutdown_connections 2024-09-13T21:45:20.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.605+0000 7f2b51241640 1 --2- 172.21.15.119:0/1607158570 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f2b3406e6e0 0x7f2b34070b90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.605+0000 7f2b51241640 1 --2- 172.21.15.119:0/1607158570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b4c0ff6f0 0x7f2b4c0fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.606+0000 7f2b51241640 1 --2- 172.21.15.119:0/1607158570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4c066650 0x7f2b4c0fcbc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.606+0000 7f2b51241640 1 -- 172.21.15.119:0/1607158570 >> 172.21.15.119:0/1607158570 conn(0x7f2b4c0f6c20 msgr2=0x7f2b4c0f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:20.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.606+0000 7f2b51241640 1 -- 172.21.15.119:0/1607158570 shutdown_connections 2024-09-13T21:45:20.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.606+0000 7f2b51241640 1 -- 172.21.15.119:0/1607158570 wait complete. 2024-09-13T21:45:20.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.702+0000 7f1541ef4640 1 -- 172.21.15.119:0/1144141741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f153c0fd7f0 msgr2=0x7f153c0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:20.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.702+0000 7f1541ef4640 1 --2- 172.21.15.119:0/1144141741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f153c0fd7f0 0x7f153c0fdc60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f15300048d0 tx=0x7f1530009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.702+0000 7f1541ef4640 1 -- 172.21.15.119:0/1144141741 shutdown_connections 2024-09-13T21:45:20.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.702+0000 7f1541ef4640 1 --2- 172.21.15.119:0/1144141741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f153c0fd7f0 0x7f153c0fdc60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.702+0000 7f1541ef4640 1 --2- 172.21.15.119:0/1144141741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f153c0fc520 0x7f153c0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.702+0000 7f1541ef4640 1 -- 172.21.15.119:0/1144141741 >> 172.21.15.119:0/1144141741 conn(0x7f153c0f7ce0 msgr2=0x7f153c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:20.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.702+0000 7f1541ef4640 1 -- 172.21.15.119:0/1144141741 shutdown_connections 2024-09-13T21:45:20.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.702+0000 7f1541ef4640 1 -- 172.21.15.119:0/1144141741 wait complete. 2024-09-13T21:45:20.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.702+0000 7f1541ef4640 1 Processor -- start 2024-09-13T21:45:20.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f1541ef4640 1 -- start start 2024-09-13T21:45:20.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f1541ef4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f153c0fc520 0x7f153c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:20.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f1541ef4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f153c0fd7f0 0x7f153c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:20.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f1541ef4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c06fff0 con 0x7f153c0fd7f0 2024-09-13T21:45:20.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f1541ef4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c070130 con 0x7f153c0fc520 2024-09-13T21:45:20.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f153affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f153c0fd7f0 0x7f153c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:20.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f153affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f153c0fd7f0 0x7f153c06fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39306/0 (socket says 172.21.15.119:39306) 2024-09-13T21:45:20.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f153affd640 1 -- 172.21.15.119:0/95870887 learned_addr learned my addr 172.21.15.119:0/95870887 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:20.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f153b7fe640 1 --2- 172.21.15.119:0/95870887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f153c0fc520 0x7f153c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:20.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f153affd640 1 -- 172.21.15.119:0/95870887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f153c0fc520 msgr2=0x7f153c071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:20.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f153affd640 1 --2- 172.21.15.119:0/95870887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f153c0fc520 0x7f153c071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:20.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f153affd640 1 -- 172.21.15.119:0/95870887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1530005040 con 0x7f153c0fd7f0 2024-09-13T21:45:20.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f153affd640 1 --2- 172.21.15.119:0/95870887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f153c0fd7f0 0x7f153c06fa60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f15300043d0 tx=0x7f1530009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:20.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f1523fff640 1 -- 172.21.15.119:0/95870887 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1530038070 con 0x7f153c0fd7f0 2024-09-13T21:45:20.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f1523fff640 1 -- 172.21.15.119:0/95870887 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f153002ae90 con 0x7f153c0fd7f0 2024-09-13T21:45:20.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.703+0000 7f1541ef4640 1 -- 172.21.15.119:0/95870887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c0703b0 con 0x7f153c0fd7f0 2024-09-13T21:45:20.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.704+0000 7f1523fff640 1 -- 172.21.15.119:0/95870887 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f153003e670 con 0x7f153c0fd7f0 2024-09-13T21:45:20.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.704+0000 7f1541ef4640 1 -- 172.21.15.119:0/95870887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c1150d0 con 0x7f153c0fd7f0 2024-09-13T21:45:20.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.705+0000 7f1541ef4640 1 -- 172.21.15.119:0/95870887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153c0fb980 con 0x7f153c0fd7f0 2024-09-13T21:45:20.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.705+0000 7f1523fff640 1 -- 172.21.15.119:0/95870887 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f1530030020 con 0x7f153c0fd7f0 2024-09-13T21:45:20.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.706+0000 7f1523fff640 1 --2- 172.21.15.119:0/95870887 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f152406e6e0 0x7f1524070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:20.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.706+0000 7f1523fff640 1 -- 172.21.15.119:0/95870887 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f15300adf30 con 0x7f153c0fd7f0 2024-09-13T21:45:20.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.706+0000 7f153b7fe640 1 --2- 172.21.15.119:0/95870887 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f152406e6e0 0x7f1524070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:20.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.707+0000 7f153b7fe640 1 --2- 172.21.15.119:0/95870887 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f152406e6e0 0x7f1524070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f153c071320 tx=0x7f152c00b040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:20.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:20.710+0000 7f1523fff640 1 -- 172.21.15.119:0/95870887 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f15300779f0 con 0x7f153c0fd7f0 2024-09-13T21:45:20.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:20 smithi155 ceph-mon[34732]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:20.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:20 smithi155 ceph-mon[34732]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:20.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:20 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/2631161659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:20.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:20 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/691377679' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:45:20.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:20 smithi119 ceph-mon[27653]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:20.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:20 smithi119 ceph-mon[27653]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:20.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:20 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/2631161659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:20.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:20 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/691377679' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:45:21.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.036+0000 7f1541ef4640 1 -- 172.21.15.119:0/95870887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f153c104f50 con 0x7f153c0fd7f0 2024-09-13T21:45:21.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.037+0000 7f1523fff640 1 -- 172.21.15.119:0/95870887 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f153007b0b0 con 0x7f153c0fd7f0 2024-09-13T21:45:21.038 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:45:21.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.039+0000 7f1541ef4640 1 -- 172.21.15.119:0/95870887 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f152406e6e0 msgr2=0x7f1524070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:21.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.039+0000 7f1541ef4640 1 --2- 172.21.15.119:0/95870887 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f152406e6e0 0x7f1524070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f153c071320 tx=0x7f152c00b040 comp rx=0 tx=0).stop 2024-09-13T21:45:21.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.039+0000 7f1541ef4640 1 -- 172.21.15.119:0/95870887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f153c0fd7f0 msgr2=0x7f153c06fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:21.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.039+0000 7f1541ef4640 1 --2- 172.21.15.119:0/95870887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f153c0fd7f0 0x7f153c06fa60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f15300043d0 tx=0x7f1530009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:21.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.039+0000 7f1541ef4640 1 -- 172.21.15.119:0/95870887 shutdown_connections 2024-09-13T21:45:21.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.039+0000 7f1541ef4640 1 --2- 172.21.15.119:0/95870887 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f152406e6e0 0x7f1524070b90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:21.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.039+0000 7f1541ef4640 1 --2- 172.21.15.119:0/95870887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f153c0fd7f0 0x7f153c06fa60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:21.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.039+0000 7f1541ef4640 1 --2- 172.21.15.119:0/95870887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f153c0fc520 0x7f153c071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:21.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.039+0000 7f1541ef4640 1 -- 172.21.15.119:0/95870887 >> 172.21.15.119:0/95870887 conn(0x7f153c0f7ce0 msgr2=0x7f153c0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:21.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.039+0000 7f1541ef4640 1 -- 172.21.15.119:0/95870887 shutdown_connections 2024-09-13T21:45:21.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:21.039+0000 7f1541ef4640 1 -- 172.21.15.119:0/95870887 wait complete. 2024-09-13T21:45:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:21 smithi155 ceph-mon[34732]: pgmap v25: 65 pgs: 65 active+clean; 1.3 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 11 MiB/s rd, 24 MiB/s wr, 328 op/s 2024-09-13T21:45:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:21 smithi155 ceph-mon[34732]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:21 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/95870887' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:45:21.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:21 smithi119 ceph-mon[27653]: pgmap v25: 65 pgs: 65 active+clean; 1.3 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 11 MiB/s rd, 24 MiB/s wr, 328 op/s 2024-09-13T21:45:21.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:21 smithi119 ceph-mon[27653]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:21.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:21 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/95870887' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:45:22.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:22 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:22.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:22 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:23.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:23 smithi155 ceph-mon[34732]: pgmap v26: 65 pgs: 65 active+clean; 617 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 11 MiB/s rd, 24 MiB/s wr, 453 op/s 2024-09-13T21:45:23.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:23 smithi119 ceph-mon[27653]: pgmap v26: 65 pgs: 65 active+clean; 617 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 11 MiB/s rd, 24 MiB/s wr, 453 op/s 2024-09-13T21:45:25.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:25 smithi119 ceph-mon[27653]: pgmap v27: 65 pgs: 65 active+clean; 293 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s rd, 15 MiB/s wr, 448 op/s 2024-09-13T21:45:26.082 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:25 smithi155 ceph-mon[34732]: pgmap v27: 65 pgs: 65 active+clean; 293 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s rd, 15 MiB/s wr, 448 op/s 2024-09-13T21:45:27.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:27 smithi119 ceph-mon[27653]: pgmap v28: 65 pgs: 65 active+clean; 293 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.0 MiB/s wr, 369 op/s 2024-09-13T21:45:28.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:27 smithi155 ceph-mon[34732]: pgmap v28: 65 pgs: 65 active+clean; 293 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.0 MiB/s wr, 369 op/s 2024-09-13T21:45:29.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:29 smithi119 ceph-mon[27653]: pgmap v29: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 72 KiB/s rd, 3.0 MiB/s wr, 659 op/s 2024-09-13T21:45:30.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:29 smithi155 ceph-mon[34732]: pgmap v29: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 72 KiB/s rd, 3.0 MiB/s wr, 659 op/s 2024-09-13T21:45:31.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:31 smithi119 ceph-mon[27653]: pgmap v30: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.0 MiB/s wr, 477 op/s 2024-09-13T21:45:32.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:31 smithi155 ceph-mon[34732]: pgmap v30: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.0 MiB/s wr, 477 op/s 2024-09-13T21:45:33.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:33 smithi119 ceph-mon[27653]: pgmap v31: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 67 KiB/s rd, 2.8 MiB/s wr, 678 op/s 2024-09-13T21:45:34.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:33 smithi155 ceph-mon[34732]: pgmap v31: 65 pgs: 65 active+clean; 282 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 67 KiB/s rd, 2.8 MiB/s wr, 678 op/s 2024-09-13T21:45:35.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:35 smithi119 ceph-mon[27653]: pgmap v32: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 2.5 MiB/s wr, 639 op/s 2024-09-13T21:45:36.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:35 smithi155 ceph-mon[34732]: pgmap v32: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 2.5 MiB/s wr, 639 op/s 2024-09-13T21:45:37.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:37 smithi119 ceph-mon[27653]: pgmap v33: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 2.0 MiB/s wr, 578 op/s 2024-09-13T21:45:37.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:37 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:37.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:37 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:37.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:37 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:38.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:37 smithi155 ceph-mon[34732]: pgmap v33: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 2.0 MiB/s wr, 578 op/s 2024-09-13T21:45:38.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:37 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:38.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:37 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:38.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:37 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:38.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:38 smithi119 ceph-mon[27653]: Reconfiguring grafana.smithi119 (dependencies changed)... 2024-09-13T21:45:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:38 smithi119 ceph-mon[27653]: Reconfiguring daemon grafana.smithi119 on smithi119 2024-09-13T21:45:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:38 smithi119 ceph-mon[27653]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:45:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:38 smithi155 ceph-mon[34732]: Reconfiguring grafana.smithi119 (dependencies changed)... 2024-09-13T21:45:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:38 smithi155 ceph-mon[34732]: Reconfiguring daemon grafana.smithi119 on smithi119 2024-09-13T21:45:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:38 smithi155 ceph-mon[34732]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:45:39.825 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:39 smithi119 ceph-mon[27653]: pgmap v34: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 79 KiB/s rd, 2.9 MiB/s wr, 814 op/s 2024-09-13T21:45:40.082 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:39 smithi155 ceph-mon[34732]: pgmap v34: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 79 KiB/s rd, 2.9 MiB/s wr, 814 op/s 2024-09-13T21:45:41.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:41 smithi119 ceph-mon[27653]: pgmap v35: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.9 MiB/s wr, 524 op/s 2024-09-13T21:45:42.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:41 smithi155 ceph-mon[34732]: pgmap v35: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.9 MiB/s wr, 524 op/s 2024-09-13T21:45:44.041 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:43 smithi119 ceph-mon[27653]: pgmap v36: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 67 KiB/s rd, 2.3 MiB/s wr, 693 op/s 2024-09-13T21:45:44.041 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:43 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:44.041 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:43 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:44.041 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:43 smithi119 ceph-mon[27653]: Reconfiguring prometheus.smithi119 (dependencies changed)... 2024-09-13T21:45:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:43 smithi155 ceph-mon[34732]: pgmap v36: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 67 KiB/s rd, 2.3 MiB/s wr, 693 op/s 2024-09-13T21:45:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:43 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:43 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:44.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:43 smithi155 ceph-mon[34732]: Reconfiguring prometheus.smithi119 (dependencies changed)... 2024-09-13T21:45:44.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:44 smithi119 ceph-mon[27653]: Deploying daemon prometheus.smithi119 on smithi119 2024-09-13T21:45:45.082 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:44 smithi155 ceph-mon[34732]: Deploying daemon prometheus.smithi119 on smithi119 2024-09-13T21:45:45.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:45 smithi119 ceph-mon[27653]: pgmap v37: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 1.9 MiB/s wr, 598 op/s 2024-09-13T21:45:46.082 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:45 smithi155 ceph-mon[34732]: pgmap v37: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 1.9 MiB/s wr, 598 op/s 2024-09-13T21:45:48.060 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:47 smithi119 ceph-mon[27653]: pgmap v38: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 511 op/s 2024-09-13T21:45:48.082 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:47 smithi155 ceph-mon[34732]: pgmap v38: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 511 op/s 2024-09-13T21:45:50.020 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:49 smithi155 ceph-mon[34732]: pgmap v39: 65 pgs: 65 active+clean; 266 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 2.6 MiB/s wr, 747 op/s 2024-09-13T21:45:50.020 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:49 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:50.020 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:49 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:50.070 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:49 smithi119 ceph-mon[27653]: pgmap v39: 65 pgs: 65 active+clean; 266 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 2.6 MiB/s wr, 747 op/s 2024-09-13T21:45:50.070 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:49 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:50.070 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:49 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:50.966 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:50 smithi155 ceph-mon[34732]: Reconfiguring node-exporter.smithi155 (dependencies changed)... 2024-09-13T21:45:50.966 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:50 smithi155 ceph-mon[34732]: Deploying daemon node-exporter.smithi155 on smithi155 2024-09-13T21:45:51.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:50 smithi119 ceph-mon[27653]: Reconfiguring node-exporter.smithi155 (dependencies changed)... 2024-09-13T21:45:51.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:50 smithi119 ceph-mon[27653]: Deploying daemon node-exporter.smithi155 on smithi155 2024-09-13T21:45:51.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.162+0000 7fa10e7fc640 1 -- 172.21.15.119:0/1070749957 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa104032610 con 0x7fa11006e540 2024-09-13T21:45:51.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.163+0000 7fa115fa0640 1 -- 172.21.15.119:0/1070749957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa11006e540 msgr2=0x7fa11010a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:51.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.163+0000 7fa115fa0640 1 --2- 172.21.15.119:0/1070749957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa11006e540 0x7fa11010a940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa1040048d0 tx=0x7fa104009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:51.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.163+0000 7fa115fa0640 1 -- 172.21.15.119:0/1070749957 shutdown_connections 2024-09-13T21:45:51.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.163+0000 7fa115fa0640 1 --2- 172.21.15.119:0/1070749957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa11006e540 0x7fa11010a940 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:51.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.163+0000 7fa115fa0640 1 --2- 172.21.15.119:0/1070749957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa11006dbf0 0x7fa11006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:51.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.163+0000 7fa115fa0640 1 -- 172.21.15.119:0/1070749957 >> 172.21.15.119:0/1070749957 conn(0x7fa110069560 msgr2=0x7fa11006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:51.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.164+0000 7fa115fa0640 1 -- 172.21.15.119:0/1070749957 shutdown_connections 2024-09-13T21:45:51.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.165+0000 7fa115fa0640 1 -- 172.21.15.119:0/1070749957 wait complete. 2024-09-13T21:45:51.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.166+0000 7fa115fa0640 1 Processor -- start 2024-09-13T21:45:51.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.166+0000 7fa115fa0640 1 -- start start 2024-09-13T21:45:51.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.167+0000 7fa115fa0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa11006dbf0 0x7fa110113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:51.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.167+0000 7fa115fa0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa11006e540 0x7fa110113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:51.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.167+0000 7fa115fa0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa110114200 con 0x7fa11006dbf0 2024-09-13T21:45:51.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.167+0000 7fa10f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa11006dbf0 0x7fa110113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:51.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.168+0000 7fa10f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa11006dbf0 0x7fa110113670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58578/0 (socket says 172.21.15.119:58578) 2024-09-13T21:45:51.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.168+0000 7fa10f7fe640 1 -- 172.21.15.119:0/1585041210 learned_addr learned my addr 172.21.15.119:0/1585041210 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:51.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.168+0000 7fa115fa0640 1 -- 172.21.15.119:0/1585041210 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa110114a20 con 0x7fa11006e540 2024-09-13T21:45:51.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.168+0000 7fa10effd640 1 --2- 172.21.15.119:0/1585041210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa11006e540 0x7fa110113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:51.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.169+0000 7fa10f7fe640 1 -- 172.21.15.119:0/1585041210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa11006e540 msgr2=0x7fa110113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:51.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.169+0000 7fa10f7fe640 1 --2- 172.21.15.119:0/1585041210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa11006e540 0x7fa110113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:51.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.169+0000 7fa10f7fe640 1 -- 172.21.15.119:0/1585041210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa104005040 con 0x7fa11006dbf0 2024-09-13T21:45:51.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.169+0000 7fa10f7fe640 1 --2- 172.21.15.119:0/1585041210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa11006dbf0 0x7fa110113670 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa100004f50 tx=0x7fa100004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:51.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.170+0000 7fa0f7fff640 1 -- 172.21.15.119:0/1585041210 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa100011e00 con 0x7fa11006dbf0 2024-09-13T21:45:51.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.170+0000 7fa0f7fff640 1 -- 172.21.15.119:0/1585041210 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa100013040 con 0x7fa11006dbf0 2024-09-13T21:45:51.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.170+0000 7fa0f7fff640 1 -- 172.21.15.119:0/1585041210 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa100016790 con 0x7fa11006dbf0 2024-09-13T21:45:51.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.170+0000 7fa115fa0640 1 -- 172.21.15.119:0/1585041210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa110114cb0 con 0x7fa11006dbf0 2024-09-13T21:45:51.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.170+0000 7fa115fa0640 1 -- 172.21.15.119:0/1585041210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa110115250 con 0x7fa11006dbf0 2024-09-13T21:45:51.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.172+0000 7fa115fa0640 1 -- 172.21.15.119:0/1585041210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11006d1b0 con 0x7fa11006dbf0 2024-09-13T21:45:51.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.173+0000 7fa0f7fff640 1 -- 172.21.15.119:0/1585041210 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fa1000168f0 con 0x7fa11006dbf0 2024-09-13T21:45:51.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.174+0000 7fa0f7fff640 1 --2- 172.21.15.119:0/1585041210 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa0f806e7b0 0x7fa0f8070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:51.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.174+0000 7fa0f7fff640 1 -- 172.21.15.119:0/1585041210 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa1000921a0 con 0x7fa11006dbf0 2024-09-13T21:45:51.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.174+0000 7fa10effd640 1 --2- 172.21.15.119:0/1585041210 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa0f806e7b0 0x7fa0f8070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:51.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.175+0000 7fa10effd640 1 --2- 172.21.15.119:0/1585041210 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa0f806e7b0 0x7fa0f8070c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa104007ac0 tx=0x7fa104035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:51.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.180+0000 7fa0f7fff640 1 -- 172.21.15.119:0/1585041210 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa10005bb60 con 0x7fa11006dbf0 2024-09-13T21:45:51.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.560+0000 7fa115fa0640 1 -- 172.21.15.119:0/1585041210 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1101155d0 con 0x7fa0f806e7b0 2024-09-13T21:45:51.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.562+0000 7fa0f7fff640 1 -- 172.21.15.119:0/1585041210 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa1101155d0 con 0x7fa0f806e7b0 2024-09-13T21:45:51.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.566+0000 7fa115fa0640 1 -- 172.21.15.119:0/1585041210 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa0f806e7b0 msgr2=0x7fa0f8070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:51.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.566+0000 7fa115fa0640 1 --2- 172.21.15.119:0/1585041210 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa0f806e7b0 0x7fa0f8070c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa104007ac0 tx=0x7fa104035040 comp rx=0 tx=0).stop 2024-09-13T21:45:51.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.566+0000 7fa115fa0640 1 -- 172.21.15.119:0/1585041210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa11006dbf0 msgr2=0x7fa110113670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:51.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.566+0000 7fa115fa0640 1 --2- 172.21.15.119:0/1585041210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa11006dbf0 0x7fa110113670 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa100004f50 tx=0x7fa100004b80 comp rx=0 tx=0).stop 2024-09-13T21:45:51.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.566+0000 7fa115fa0640 1 -- 172.21.15.119:0/1585041210 shutdown_connections 2024-09-13T21:45:51.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.566+0000 7fa115fa0640 1 --2- 172.21.15.119:0/1585041210 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa0f806e7b0 0x7fa0f8070c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:51.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.566+0000 7fa115fa0640 1 --2- 172.21.15.119:0/1585041210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa11006e540 0x7fa110113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:51.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.566+0000 7fa115fa0640 1 --2- 172.21.15.119:0/1585041210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa11006dbf0 0x7fa110113670 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:51.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.566+0000 7fa115fa0640 1 -- 172.21.15.119:0/1585041210 >> 172.21.15.119:0/1585041210 conn(0x7fa110069560 msgr2=0x7fa110108aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:51.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.566+0000 7fa115fa0640 1 -- 172.21.15.119:0/1585041210 shutdown_connections 2024-09-13T21:45:51.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.566+0000 7fa115fa0640 1 -- 172.21.15.119:0/1585041210 wait complete. 2024-09-13T21:45:51.579 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:45:51.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.676+0000 7fc161b05640 1 -- 172.21.15.119:0/427408234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c065be0 msgr2=0x7fc15c1015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:51.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.676+0000 7fc161b05640 1 --2- 172.21.15.119:0/427408234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c065be0 0x7fc15c1015a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0048d0 tx=0x7fc14c009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:51.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.676+0000 7fc161b05640 1 -- 172.21.15.119:0/427408234 shutdown_connections 2024-09-13T21:45:51.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.676+0000 7fc161b05640 1 --2- 172.21.15.119:0/427408234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15c101ae0 0x7fc15c103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:51.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.676+0000 7fc161b05640 1 --2- 172.21.15.119:0/427408234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c065be0 0x7fc15c1015a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:51.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.676+0000 7fc161b05640 1 -- 172.21.15.119:0/427408234 >> 172.21.15.119:0/427408234 conn(0x7fc15c0f6c10 msgr2=0x7fc15c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:51.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.676+0000 7fc161b05640 1 -- 172.21.15.119:0/427408234 shutdown_connections 2024-09-13T21:45:51.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.676+0000 7fc161b05640 1 -- 172.21.15.119:0/427408234 wait complete. 2024-09-13T21:45:51.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.677+0000 7fc161b05640 1 Processor -- start 2024-09-13T21:45:51.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.677+0000 7fc161b05640 1 -- start start 2024-09-13T21:45:51.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.677+0000 7fc161b05640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c065be0 0x7fc15c10f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:51.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.678+0000 7fc161b05640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15c101ae0 0x7fc15c10f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.678+0000 7fc161b05640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c10feb0 con 0x7fc15c065be0 2024-09-13T21:45:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.678+0000 7fc161b05640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c110610 con 0x7fc15c101ae0 2024-09-13T21:45:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.678+0000 7fc15b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c065be0 0x7fc15c10f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.678+0000 7fc15affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15c101ae0 0x7fc15c10f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.678+0000 7fc15b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c065be0 0x7fc15c10f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58600/0 (socket says 172.21.15.119:58600) 2024-09-13T21:45:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.678+0000 7fc15b7fe640 1 -- 172.21.15.119:0/3922911941 learned_addr learned my addr 172.21.15.119:0/3922911941 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.678+0000 7fc15affd640 1 -- 172.21.15.119:0/3922911941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c065be0 msgr2=0x7fc15c10f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.678+0000 7fc15affd640 1 --2- 172.21.15.119:0/3922911941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c065be0 0x7fc15c10f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.678+0000 7fc15affd640 1 -- 172.21.15.119:0/3922911941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c005040 con 0x7fc15c101ae0 2024-09-13T21:45:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.678+0000 7fc15affd640 1 --2- 172.21.15.119:0/3922911941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15c101ae0 0x7fc15c10f860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c7e0 tx=0x7fc150007f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.679+0000 7fc143fff640 1 -- 172.21.15.119:0/3922911941 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc15000a7a0 con 0x7fc15c101ae0 2024-09-13T21:45:51.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.679+0000 7fc143fff640 1 -- 172.21.15.119:0/3922911941 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc15000ada0 con 0x7fc15c101ae0 2024-09-13T21:45:51.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.679+0000 7fc161b05640 1 -- 172.21.15.119:0/3922911941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15c1108a0 con 0x7fc15c101ae0 2024-09-13T21:45:51.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.679+0000 7fc143fff640 1 -- 172.21.15.119:0/3922911941 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1500113a0 con 0x7fc15c101ae0 2024-09-13T21:45:51.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.679+0000 7fc161b05640 1 -- 172.21.15.119:0/3922911941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15c110df0 con 0x7fc15c101ae0 2024-09-13T21:45:51.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.681+0000 7fc143fff640 1 -- 172.21.15.119:0/3922911941 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fc15000a900 con 0x7fc15c101ae0 2024-09-13T21:45:51.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.681+0000 7fc161b05640 1 -- 172.21.15.119:0/3922911941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15c0fa890 con 0x7fc15c101ae0 2024-09-13T21:45:51.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.681+0000 7fc143fff640 1 --2- 172.21.15.119:0/3922911941 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fc14406e730 0x7fc144070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:51.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.681+0000 7fc143fff640 1 -- 172.21.15.119:0/3922911941 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc15008df40 con 0x7fc15c101ae0 2024-09-13T21:45:51.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.682+0000 7fc15b7fe640 1 --2- 172.21.15.119:0/3922911941 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fc14406e730 0x7fc144070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:51.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.682+0000 7fc15b7fe640 1 --2- 172.21.15.119:0/3922911941 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fc14406e730 0x7fc144070be0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc14c003080 tx=0x7fc14c035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:51.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:51.686+0000 7fc143fff640 1 -- 172.21.15.119:0/3922911941 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc15005b400 con 0x7fc15c101ae0 2024-09-13T21:45:51.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:51 smithi119 ceph-mon[27653]: pgmap v40: 65 pgs: 65 active+clean; 266 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.7 MiB/s wr, 511 op/s 2024-09-13T21:45:52.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.003+0000 7fc161b05640 1 -- 172.21.15.119:0/3922911941 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc15c111100 con 0x7fc14406e730 2024-09-13T21:45:52.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.004+0000 7fc143fff640 1 -- 172.21.15.119:0/3922911941 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc15c111100 con 0x7fc14406e730 2024-09-13T21:45:52.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.007+0000 7fc161b05640 1 -- 172.21.15.119:0/3922911941 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fc14406e730 msgr2=0x7fc144070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.007+0000 7fc161b05640 1 --2- 172.21.15.119:0/3922911941 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fc14406e730 0x7fc144070be0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc14c003080 tx=0x7fc14c035040 comp rx=0 tx=0).stop 2024-09-13T21:45:52.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.007+0000 7fc161b05640 1 -- 172.21.15.119:0/3922911941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15c101ae0 msgr2=0x7fc15c10f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.007+0000 7fc161b05640 1 --2- 172.21.15.119:0/3922911941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15c101ae0 0x7fc15c10f860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c7e0 tx=0x7fc150007f20 comp rx=0 tx=0).stop 2024-09-13T21:45:52.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.007+0000 7fc161b05640 1 -- 172.21.15.119:0/3922911941 shutdown_connections 2024-09-13T21:45:52.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.007+0000 7fc161b05640 1 --2- 172.21.15.119:0/3922911941 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fc14406e730 0x7fc144070be0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.007+0000 7fc161b05640 1 --2- 172.21.15.119:0/3922911941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15c101ae0 0x7fc15c10f860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.007+0000 7fc161b05640 1 --2- 172.21.15.119:0/3922911941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc15c065be0 0x7fc15c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.007+0000 7fc161b05640 1 -- 172.21.15.119:0/3922911941 >> 172.21.15.119:0/3922911941 conn(0x7fc15c0f6c10 msgr2=0x7fc15c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:52.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.008+0000 7fc161b05640 1 -- 172.21.15.119:0/3922911941 shutdown_connections 2024-09-13T21:45:52.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.008+0000 7fc161b05640 1 -- 172.21.15.119:0/3922911941 wait complete. 2024-09-13T21:45:52.020 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:51 smithi155 ceph-mon[34732]: pgmap v40: 65 pgs: 65 active+clean; 266 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.7 MiB/s wr, 511 op/s 2024-09-13T21:45:52.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.102+0000 7fa8aace2640 1 -- 172.21.15.119:0/3585587866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4103e50 msgr2=0x7fa8a41042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.102+0000 7fa8aace2640 1 --2- 172.21.15.119:0/3585587866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4103e50 0x7fa8a41042c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa8900048d0 tx=0x7fa890009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.102+0000 7fa8aace2640 1 -- 172.21.15.119:0/3585587866 shutdown_connections 2024-09-13T21:45:52.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.102+0000 7fa8aace2640 1 --2- 172.21.15.119:0/3585587866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4103e50 0x7fa8a41042c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.102+0000 7fa8aace2640 1 --2- 172.21.15.119:0/3585587866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a4102b80 0x7fa8a4102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.102+0000 7fa8aace2640 1 -- 172.21.15.119:0/3585587866 >> 172.21.15.119:0/3585587866 conn(0x7fa8a4071d90 msgr2=0x7fa8a40741a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:52.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.102+0000 7fa8aace2640 1 -- 172.21.15.119:0/3585587866 shutdown_connections 2024-09-13T21:45:52.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.102+0000 7fa8aace2640 1 -- 172.21.15.119:0/3585587866 wait complete. 2024-09-13T21:45:52.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.103+0000 7fa8aace2640 1 Processor -- start 2024-09-13T21:45:52.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.103+0000 7fa8aace2640 1 -- start start 2024-09-13T21:45:52.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.103+0000 7fa8aace2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4102b80 0x7fa8a4113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:52.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.103+0000 7fa8aace2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a4103e50 0x7fa8a4113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:52.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.103+0000 7fa8aace2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a4114210 con 0x7fa8a4102b80 2024-09-13T21:45:52.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.103+0000 7fa8aace2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a4114a30 con 0x7fa8a4103e50 2024-09-13T21:45:52.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.104+0000 7fa8a8a7e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4102b80 0x7fa8a4113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:52.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.104+0000 7fa8a8a7e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4102b80 0x7fa8a4113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58614/0 (socket says 172.21.15.119:58614) 2024-09-13T21:45:52.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.104+0000 7fa8a8a7e640 1 -- 172.21.15.119:0/1509013240 learned_addr learned my addr 172.21.15.119:0/1509013240 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:52.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.104+0000 7fa8a3fff640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a4103e50 0x7fa8a4113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:52.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.104+0000 7fa8a8a7e640 1 -- 172.21.15.119:0/1509013240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a4103e50 msgr2=0x7fa8a4113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.104+0000 7fa8a8a7e640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a4103e50 0x7fa8a4113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.104+0000 7fa8a8a7e640 1 -- 172.21.15.119:0/1509013240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890005040 con 0x7fa8a4102b80 2024-09-13T21:45:52.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.104+0000 7fa8a3fff640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a4103e50 0x7fa8a4113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:45:52.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.104+0000 7fa8a8a7e640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4102b80 0x7fa8a4113680 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa89800eb70 tx=0x7fa89800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:52.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.105+0000 7fa8a17fa640 1 -- 172.21.15.119:0/1509013240 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa898007c30 con 0x7fa8a4102b80 2024-09-13T21:45:52.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.105+0000 7fa8a17fa640 1 -- 172.21.15.119:0/1509013240 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa89800f040 con 0x7fa8a4102b80 2024-09-13T21:45:52.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.105+0000 7fa8aace2640 1 -- 172.21.15.119:0/1509013240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a4114c60 con 0x7fa8a4102b80 2024-09-13T21:45:52.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.105+0000 7fa8a17fa640 1 -- 172.21.15.119:0/1509013240 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa898009420 con 0x7fa8a4102b80 2024-09-13T21:45:52.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.105+0000 7fa8aace2640 1 -- 172.21.15.119:0/1509013240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a4115200 con 0x7fa8a4102b80 2024-09-13T21:45:52.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.106+0000 7fa8aace2640 1 -- 172.21.15.119:0/1509013240 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa888005240 con 0x7fa8a4102b80 2024-09-13T21:45:52.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.107+0000 7fa8a17fa640 1 -- 172.21.15.119:0/1509013240 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fa8980095a0 con 0x7fa8a4102b80 2024-09-13T21:45:52.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.108+0000 7fa8a17fa640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa89406e6e0 0x7fa894070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:52.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.108+0000 7fa8a17fa640 1 -- 172.21.15.119:0/1509013240 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa89808db20 con 0x7fa8a4102b80 2024-09-13T21:45:52.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.108+0000 7fa8a3fff640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa89406e6e0 0x7fa894070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:52.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.109+0000 7fa8a3fff640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa89406e6e0 0x7fa894070b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4113430 tx=0x7fa890035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:52.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.113+0000 7fa8a17fa640 1 -- 172.21.15.119:0/1509013240 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa898057590 con 0x7fa8a4102b80 2024-09-13T21:45:52.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.356+0000 7fa8aace2640 1 -- 172.21.15.119:0/1509013240 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa888000bf0 con 0x7fa89406e6e0 2024-09-13T21:45:52.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.365+0000 7fa8a17fa640 1 -- 172.21.15.119:0/1509013240 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa888000bf0 con 0x7fa89406e6e0 2024-09-13T21:45:52.366 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:45:52.366 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 starting - - - - 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (9m) 51s ago 9m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 c6a79bd22109 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (8m) 53s ago 8m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 1bccd1b9bda0 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 starting - - - - 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (3m) 51s ago 3m 11.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (3m) 51s ago 3m 121M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (3m) 53s ago 3m 15.0M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (3m) 53s ago 3m 111M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:9283,8765,8443 running (10m) 51s ago 10m 261M - 17.2.7-1629-geb16b97b ab51d1bebd12 b7b1f8308caa 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283 running (105s) 53s ago 8m 479M - 19.1.1-324-gecab7be5 0652ff2b5d78 3869f6b2a429 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (10m) 51s ago 10m 47.4M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 f49a62e4f3c3 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (7m) 53s ago 7m 37.0M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 66c9116315ae 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 starting - - - - 2024-09-13T21:45:52.367 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (8m) 53s ago 8m 15.7M - 1.5.0 0da6a335fe13 513bc6bacbbd 2024-09-13T21:45:52.368 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (7m) 51s ago 7m 167M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 6e0bbff1ac3f 2024-09-13T21:45:52.368 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (6m) 51s ago 6m 175M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:45:52.368 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (6m) 51s ago 6m 143M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:45:52.368 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (5m) 53s ago 5m 179M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:45:52.368 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (5m) 53s ago 5m 172M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:45:52.368 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (5m) 53s ago 5m 170M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:45:52.368 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 starting - - - - 2024-09-13T21:45:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.367+0000 7fa8aace2640 1 -- 172.21.15.119:0/1509013240 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa89406e6e0 msgr2=0x7fa894070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.367+0000 7fa8aace2640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa89406e6e0 0x7fa894070b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4113430 tx=0x7fa890035040 comp rx=0 tx=0).stop 2024-09-13T21:45:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.367+0000 7fa8aace2640 1 -- 172.21.15.119:0/1509013240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4102b80 msgr2=0x7fa8a4113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.367+0000 7fa8aace2640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4102b80 0x7fa8a4113680 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa89800eb70 tx=0x7fa89800b040 comp rx=0 tx=0).stop 2024-09-13T21:45:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.367+0000 7fa8aace2640 1 -- 172.21.15.119:0/1509013240 shutdown_connections 2024-09-13T21:45:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.367+0000 7fa8aace2640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7fa89406e6e0 0x7fa894070b90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.367+0000 7fa8aace2640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8a4103e50 0x7fa8a4113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.367+0000 7fa8aace2640 1 --2- 172.21.15.119:0/1509013240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8a4102b80 0x7fa8a4113680 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.367+0000 7fa8aace2640 1 -- 172.21.15.119:0/1509013240 >> 172.21.15.119:0/1509013240 conn(0x7fa8a4071d90 msgr2=0x7fa8a40734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.367+0000 7fa8aace2640 1 -- 172.21.15.119:0/1509013240 shutdown_connections 2024-09-13T21:45:52.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.367+0000 7fa8aace2640 1 -- 172.21.15.119:0/1509013240 wait complete. 2024-09-13T21:45:52.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.455+0000 7f348029a640 1 -- 172.21.15.119:0/4085827301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34780fc520 msgr2=0x7f34780fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.455+0000 7f348029a640 1 --2- 172.21.15.119:0/4085827301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34780fc520 0x7f34780fc930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3474009c50 tx=0x7f3474004d10 comp rx=0 tx=0).stop 2024-09-13T21:45:52.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.455+0000 7f348029a640 1 -- 172.21.15.119:0/4085827301 shutdown_connections 2024-09-13T21:45:52.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.455+0000 7f348029a640 1 --2- 172.21.15.119:0/4085827301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34780fd7f0 0x7f34780fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.455+0000 7f348029a640 1 --2- 172.21.15.119:0/4085827301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34780fc520 0x7f34780fc930 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.455+0000 7f348029a640 1 -- 172.21.15.119:0/4085827301 >> 172.21.15.119:0/4085827301 conn(0x7f34780f7ce0 msgr2=0x7f34780fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:52.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.455+0000 7f348029a640 1 -- 172.21.15.119:0/4085827301 shutdown_connections 2024-09-13T21:45:52.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.455+0000 7f348029a640 1 -- 172.21.15.119:0/4085827301 wait complete. 2024-09-13T21:45:52.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.456+0000 7f348029a640 1 Processor -- start 2024-09-13T21:45:52.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.456+0000 7f348029a640 1 -- start start 2024-09-13T21:45:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.456+0000 7f348029a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34780fc520 0x7f347810f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:52.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.456+0000 7f348029a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34780fd7f0 0x7f347810f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.456+0000 7f348029a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347810fe10 con 0x7f34780fd7f0 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.456+0000 7f348029a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3478110630 con 0x7f34780fc520 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.456+0000 7f347d835640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34780fd7f0 0x7f347810f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.456+0000 7f347e036640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34780fc520 0x7f347810f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.456+0000 7f347e036640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34780fc520 0x7f347810f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:47790/0 (socket says 172.21.15.119:47790) 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.456+0000 7f347e036640 1 -- 172.21.15.119:0/933836908 learned_addr learned my addr 172.21.15.119:0/933836908 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.457+0000 7f347d835640 1 -- 172.21.15.119:0/933836908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34780fc520 msgr2=0x7f347810f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.457+0000 7f347d835640 1 --2- 172.21.15.119:0/933836908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34780fc520 0x7f347810f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.457+0000 7f347d835640 1 -- 172.21.15.119:0/933836908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34740098b0 con 0x7f34780fd7f0 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.457+0000 7f347e036640 1 --2- 172.21.15.119:0/933836908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34780fc520 0x7f347810f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.457+0000 7f347d835640 1 --2- 172.21.15.119:0/933836908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34780fd7f0 0x7f347810f7c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f346800e910 tx=0x7f346800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:52.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.457+0000 7f346effd640 1 -- 172.21.15.119:0/933836908 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3468007c30 con 0x7f34780fd7f0 2024-09-13T21:45:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.457+0000 7f346effd640 1 -- 172.21.15.119:0/933836908 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f346800f040 con 0x7f34780fd7f0 2024-09-13T21:45:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.457+0000 7f348029a640 1 -- 172.21.15.119:0/933836908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3478110860 con 0x7f34780fd7f0 2024-09-13T21:45:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.457+0000 7f346effd640 1 -- 172.21.15.119:0/933836908 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34680094a0 con 0x7f34780fd7f0 2024-09-13T21:45:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.457+0000 7f348029a640 1 -- 172.21.15.119:0/933836908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3478110e00 con 0x7f34780fd7f0 2024-09-13T21:45:52.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.458+0000 7f348029a640 1 -- 172.21.15.119:0/933836908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34780fb980 con 0x7f34780fd7f0 2024-09-13T21:45:52.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.459+0000 7f346effd640 1 -- 172.21.15.119:0/933836908 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f3468009600 con 0x7f34780fd7f0 2024-09-13T21:45:52.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.460+0000 7f346effd640 1 --2- 172.21.15.119:0/933836908 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f346406e6e0 0x7f3464070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:52.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.460+0000 7f346effd640 1 -- 172.21.15.119:0/933836908 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f346808dab0 con 0x7f34780fd7f0 2024-09-13T21:45:52.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.460+0000 7f347e036640 1 --2- 172.21.15.119:0/933836908 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f346406e6e0 0x7f3464070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:52.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.461+0000 7f347e036640 1 --2- 172.21.15.119:0/933836908 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f346406e6e0 0x7f3464070b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f34740048c0 tx=0x7f3474004d10 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:52.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.467+0000 7f346effd640 1 -- 172.21.15.119:0/933836908 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3468050670 con 0x7f34780fd7f0 2024-09-13T21:45:52.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.789+0000 7f348029a640 1 -- 172.21.15.119:0/933836908 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3478070e40 con 0x7f34780fd7f0 2024-09-13T21:45:52.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.789+0000 7f346effd640 1 -- 172.21.15.119:0/933836908 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f34680573a0 con 0x7f34780fd7f0 2024-09-13T21:45:52.791 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:45:52.791 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:45:52.791 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T21:45:52.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:45:52.791 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 1, 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 13, 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:45:52.792 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:45:52.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.793+0000 7f348029a640 1 -- 172.21.15.119:0/933836908 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f346406e6e0 msgr2=0x7f3464070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.793+0000 7f348029a640 1 --2- 172.21.15.119:0/933836908 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f346406e6e0 0x7f3464070b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f34740048c0 tx=0x7f3474004d10 comp rx=0 tx=0).stop 2024-09-13T21:45:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.793+0000 7f348029a640 1 -- 172.21.15.119:0/933836908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34780fd7f0 msgr2=0x7f347810f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.793+0000 7f348029a640 1 --2- 172.21.15.119:0/933836908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34780fd7f0 0x7f347810f7c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f346800e910 tx=0x7f346800b040 comp rx=0 tx=0).stop 2024-09-13T21:45:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.793+0000 7f348029a640 1 -- 172.21.15.119:0/933836908 shutdown_connections 2024-09-13T21:45:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.793+0000 7f348029a640 1 --2- 172.21.15.119:0/933836908 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f346406e6e0 0x7f3464070b90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.793+0000 7f348029a640 1 --2- 172.21.15.119:0/933836908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34780fd7f0 0x7f347810f7c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.793+0000 7f348029a640 1 --2- 172.21.15.119:0/933836908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34780fc520 0x7f347810f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.793+0000 7f348029a640 1 -- 172.21.15.119:0/933836908 >> 172.21.15.119:0/933836908 conn(0x7f34780f7ce0 msgr2=0x7f34780f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.793+0000 7f348029a640 1 -- 172.21.15.119:0/933836908 shutdown_connections 2024-09-13T21:45:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.793+0000 7f348029a640 1 -- 172.21.15.119:0/933836908 wait complete. 2024-09-13T21:45:52.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.890+0000 7ff2f7776640 1 -- 172.21.15.119:0/2660732319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f00ff680 msgr2=0x7ff2f0101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.890+0000 7ff2f7776640 1 --2- 172.21.15.119:0/2660732319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f00ff680 0x7ff2f0101a60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00048d0 tx=0x7ff2e0009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.890+0000 7ff2f7776640 1 -- 172.21.15.119:0/2660732319 shutdown_connections 2024-09-13T21:45:52.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.890+0000 7ff2f7776640 1 --2- 172.21.15.119:0/2660732319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f00ff680 0x7ff2f0101a60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.890+0000 7ff2f7776640 1 --2- 172.21.15.119:0/2660732319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f0065c40 0x7ff2f00ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.890+0000 7ff2f7776640 1 -- 172.21.15.119:0/2660732319 >> 172.21.15.119:0/2660732319 conn(0x7ff2f00f6c10 msgr2=0x7ff2f00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:52.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.890+0000 7ff2f7776640 1 -- 172.21.15.119:0/2660732319 shutdown_connections 2024-09-13T21:45:52.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.890+0000 7ff2f7776640 1 -- 172.21.15.119:0/2660732319 wait complete. 2024-09-13T21:45:52.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f7776640 1 Processor -- start 2024-09-13T21:45:52.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f7776640 1 -- start start 2024-09-13T21:45:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f7776640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f0065c40 0x7ff2f00fcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f7776640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f00ff680 0x7ff2f00fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f7776640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00fb5d0 con 0x7ff2f0065c40 2024-09-13T21:45:52.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f7776640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00fb710 con 0x7ff2f00ff680 2024-09-13T21:45:52.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f5512640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f0065c40 0x7ff2f00fcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:52.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f5512640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f0065c40 0x7ff2f00fcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58644/0 (socket says 172.21.15.119:58644) 2024-09-13T21:45:52.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f5512640 1 -- 172.21.15.119:0/1897292518 learned_addr learned my addr 172.21.15.119:0/1897292518 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:52.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f4d11640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f00ff680 0x7ff2f00fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:52.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f5512640 1 -- 172.21.15.119:0/1897292518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f00ff680 msgr2=0x7ff2f00fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:52.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f5512640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f00ff680 0x7ff2f00fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:52.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f5512640 1 -- 172.21.15.119:0/1897292518 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0005040 con 0x7ff2f0065c40 2024-09-13T21:45:52.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.891+0000 7ff2f4d11640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f00ff680 0x7ff2f00fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:45:52.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.892+0000 7ff2f5512640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f0065c40 0x7ff2f00fcb50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00eb70 tx=0x7ff2ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:52.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.892+0000 7ff2e5ffb640 1 -- 172.21.15.119:0/1897292518 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ec007c30 con 0x7ff2f0065c40 2024-09-13T21:45:52.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.892+0000 7ff2f7776640 1 -- 172.21.15.119:0/1897292518 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f00fb9f0 con 0x7ff2f0065c40 2024-09-13T21:45:52.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.892+0000 7ff2e5ffb640 1 -- 172.21.15.119:0/1897292518 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff2ec00f040 con 0x7ff2f0065c40 2024-09-13T21:45:52.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.892+0000 7ff2e5ffb640 1 -- 172.21.15.119:0/1897292518 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ec00cb00 con 0x7ff2f0065c40 2024-09-13T21:45:52.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.892+0000 7ff2f7776640 1 -- 172.21.15.119:0/1897292518 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f01150c0 con 0x7ff2f0065c40 2024-09-13T21:45:52.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.893+0000 7ff2f7776640 1 -- 172.21.15.119:0/1897292518 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f00fa890 con 0x7ff2f0065c40 2024-09-13T21:45:52.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.894+0000 7ff2e5ffb640 1 -- 172.21.15.119:0/1897292518 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7ff2ec00cd40 con 0x7ff2f0065c40 2024-09-13T21:45:52.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.894+0000 7ff2e5ffb640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7ff2dc06e6e0 0x7ff2dc070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:52.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.895+0000 7ff2e5ffb640 1 -- 172.21.15.119:0/1897292518 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff2ec08e0b0 con 0x7ff2f0065c40 2024-09-13T21:45:52.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.895+0000 7ff2f4d11640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7ff2dc06e6e0 0x7ff2dc070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:52.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.895+0000 7ff2f4d11640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7ff2dc06e6e0 0x7ff2dc070b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0000c00 tx=0x7ff2e0035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:52.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:52.900+0000 7ff2e5ffb640 1 -- 172.21.15.119:0/1897292518 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff2ec0579b0 con 0x7ff2f0065c40 2024-09-13T21:45:53.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:52 smithi155 ceph-mon[34732]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:53.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:52 smithi155 ceph-mon[34732]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:53.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:52 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:53.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:52 smithi119 ceph-mon[27653]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:53.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:52 smithi119 ceph-mon[27653]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:53.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:52 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:45:53.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.240+0000 7ff2f7776640 1 -- 172.21.15.119:0/1897292518 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff2f0104f50 con 0x7ff2f0065c40 2024-09-13T21:45:53.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.241+0000 7ff2e5ffb640 1 -- 172.21.15.119:0/1897292518 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1854 (secure 0 0 0) 0x7ff2ec05b070 con 0x7ff2f0065c40 2024-09-13T21:45:53.244 INFO:teuthology.orchestra.run.smithi119.stdout:e20 2024-09-13T21:45:53.245 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:45:53.245 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:45:53.245 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:45:53.245 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:45:53.245 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:45:53.245 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:45:53.245 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 20 2024-09-13T21:45:53.245 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:45:53.245 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:45:53.245 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:45:37.594101+0000 2024-09-13T21:45:53.245 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:45:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:45:53.247 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:53.248 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:45:53.248 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 20 2024-09-13T21:45:53.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.244+0000 7ff2f7776640 1 -- 172.21.15.119:0/1897292518 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7ff2dc06e6e0 msgr2=0x7ff2dc070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:53.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.244+0000 7ff2f7776640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7ff2dc06e6e0 0x7ff2dc070b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0000c00 tx=0x7ff2e0035040 comp rx=0 tx=0).stop 2024-09-13T21:45:53.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.244+0000 7ff2f7776640 1 -- 172.21.15.119:0/1897292518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f0065c40 msgr2=0x7ff2f00fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:53.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.244+0000 7ff2f7776640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f0065c40 0x7ff2f00fcb50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00eb70 tx=0x7ff2ec00b040 comp rx=0 tx=0).stop 2024-09-13T21:45:53.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.244+0000 7ff2f7776640 1 -- 172.21.15.119:0/1897292518 shutdown_connections 2024-09-13T21:45:53.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.244+0000 7ff2f7776640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7ff2dc06e6e0 0x7ff2dc070b90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.244+0000 7ff2f7776640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2f00ff680 0x7ff2f00fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.244+0000 7ff2f7776640 1 --2- 172.21.15.119:0/1897292518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f0065c40 0x7ff2f00fcb50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.244+0000 7ff2f7776640 1 -- 172.21.15.119:0/1897292518 >> 172.21.15.119:0/1897292518 conn(0x7ff2f00f6c10 msgr2=0x7ff2f00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:53.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.245+0000 7ff2f7776640 1 -- 172.21.15.119:0/1897292518 shutdown_connections 2024-09-13T21:45:53.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.245+0000 7ff2f7776640 1 -- 172.21.15.119:0/1897292518 wait complete. 2024-09-13T21:45:53.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.356+0000 7f496113b640 1 -- 172.21.15.119:0/2871148197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495c0ffa40 msgr2=0x7f495c0ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:53.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.356+0000 7f496113b640 1 --2- 172.21.15.119:0/2871148197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495c0ffa40 0x7f495c0ffeb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f494c009c50 tx=0x7f494c004d10 comp rx=0 tx=0).stop 2024-09-13T21:45:53.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.356+0000 7f496113b640 1 -- 172.21.15.119:0/2871148197 shutdown_connections 2024-09-13T21:45:53.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.356+0000 7f496113b640 1 --2- 172.21.15.119:0/2871148197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495c0ffa40 0x7f495c0ffeb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.356+0000 7f496113b640 1 --2- 172.21.15.119:0/2871148197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f495c0fe7c0 0x7f495c0febd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.356+0000 7f496113b640 1 -- 172.21.15.119:0/2871148197 >> 172.21.15.119:0/2871148197 conn(0x7f495c0fa200 msgr2=0x7f495c0fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:53.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.356+0000 7f496113b640 1 -- 172.21.15.119:0/2871148197 shutdown_connections 2024-09-13T21:45:53.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.356+0000 7f496113b640 1 -- 172.21.15.119:0/2871148197 wait complete. 2024-09-13T21:45:53.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.357+0000 7f496113b640 1 Processor -- start 2024-09-13T21:45:53.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.357+0000 7f496113b640 1 -- start start 2024-09-13T21:45:53.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.357+0000 7f496113b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495c0fe7c0 0x7f495c10f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:53.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.357+0000 7f496113b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f495c0ffa40 0x7f495c10f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:53.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.357+0000 7f496113b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c10fdf0 con 0x7f495c0fe7c0 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.357+0000 7f496113b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c110610 con 0x7f495c0ffa40 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f495ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495c0fe7c0 0x7f495c10f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f495a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f495c0ffa40 0x7f495c10f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f495ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495c0fe7c0 0x7f495c10f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58668/0 (socket says 172.21.15.119:58668) 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f495ad9d640 1 -- 172.21.15.119:0/278730291 learned_addr learned my addr 172.21.15.119:0/278730291 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f495ad9d640 1 -- 172.21.15.119:0/278730291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f495c0ffa40 msgr2=0x7f495c10f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f495ad9d640 1 --2- 172.21.15.119:0/278730291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f495c0ffa40 0x7f495c10f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f495ad9d640 1 -- 172.21.15.119:0/278730291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0098b0 con 0x7f495c0fe7c0 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f495ad9d640 1 --2- 172.21.15.119:0/278730291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495c0fe7c0 0x7f495c10f260 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4950002a50 tx=0x7f4950004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f49437fe640 1 -- 172.21.15.119:0/278730291 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4950007c30 con 0x7f495c0fe7c0 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f496113b640 1 -- 172.21.15.119:0/278730291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495c1108a0 con 0x7f495c0fe7c0 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f496113b640 1 -- 172.21.15.119:0/278730291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495c110d90 con 0x7f495c0fe7c0 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f49437fe640 1 -- 172.21.15.119:0/278730291 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f495000f040 con 0x7f495c0fe7c0 2024-09-13T21:45:53.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.358+0000 7f49437fe640 1 -- 172.21.15.119:0/278730291 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f495000da90 con 0x7f495c0fe7c0 2024-09-13T21:45:53.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.360+0000 7f496113b640 1 -- 172.21.15.119:0/278730291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495c0fdd00 con 0x7f495c0fe7c0 2024-09-13T21:45:53.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.361+0000 7f49437fe640 1 -- 172.21.15.119:0/278730291 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f495000dd00 con 0x7f495c0fe7c0 2024-09-13T21:45:53.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.361+0000 7f49437fe640 1 --2- 172.21.15.119:0/278730291 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f494406e6e0 0x7f4944070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:53.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.361+0000 7f49437fe640 1 -- 172.21.15.119:0/278730291 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f495008d970 con 0x7f495c0fe7c0 2024-09-13T21:45:53.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.361+0000 7f495a59c640 1 --2- 172.21.15.119:0/278730291 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f494406e6e0 0x7f4944070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:53.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.362+0000 7f495a59c640 1 --2- 172.21.15.119:0/278730291 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f494406e6e0 0x7f4944070b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f494c004a30 tx=0x7f494c004d10 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:53.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.367+0000 7f49437fe640 1 -- 172.21.15.119:0/278730291 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f4950057320 con 0x7f495c0fe7c0 2024-09-13T21:45:53.372 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-13T21:45:53.372 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T21:45:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.626+0000 7f496113b640 1 -- 172.21.15.119:0/278730291 --> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f495c111180 con 0x7f494406e6e0 2024-09-13T21:45:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.628+0000 7f49437fe640 1 -- 172.21.15.119:0/278730291 <== mgr.24357 v2:172.21.15.155:6828/1626670445 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f495c111180 con 0x7f494406e6e0 2024-09-13T21:45:53.630 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:45:53.630 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:45:53.630 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:45:53.630 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:45:53.630 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [], 2024-09-13T21:45:53.630 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T21:45:53.630 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T21:45:53.630 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:45:53.630 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:45:53.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.630+0000 7f496113b640 1 -- 172.21.15.119:0/278730291 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f494406e6e0 msgr2=0x7f4944070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:53.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.630+0000 7f496113b640 1 --2- 172.21.15.119:0/278730291 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f494406e6e0 0x7f4944070b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f494c004a30 tx=0x7f494c004d10 comp rx=0 tx=0).stop 2024-09-13T21:45:53.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.630+0000 7f496113b640 1 -- 172.21.15.119:0/278730291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495c0fe7c0 msgr2=0x7f495c10f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:53.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.630+0000 7f496113b640 1 --2- 172.21.15.119:0/278730291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495c0fe7c0 0x7f495c10f260 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4950002a50 tx=0x7f4950004600 comp rx=0 tx=0).stop 2024-09-13T21:45:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.630+0000 7f496113b640 1 -- 172.21.15.119:0/278730291 shutdown_connections 2024-09-13T21:45:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.630+0000 7f496113b640 1 --2- 172.21.15.119:0/278730291 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f494406e6e0 0x7f4944070b90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.630+0000 7f496113b640 1 --2- 172.21.15.119:0/278730291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f495c0ffa40 0x7f495c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.630+0000 7f496113b640 1 --2- 172.21.15.119:0/278730291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f495c0fe7c0 0x7f495c10f260 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.630+0000 7f496113b640 1 -- 172.21.15.119:0/278730291 >> 172.21.15.119:0/278730291 conn(0x7f495c0fa200 msgr2=0x7f495c0fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.630+0000 7f496113b640 1 -- 172.21.15.119:0/278730291 shutdown_connections 2024-09-13T21:45:53.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.630+0000 7f496113b640 1 -- 172.21.15.119:0/278730291 wait complete. 2024-09-13T21:45:53.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.713+0000 7f61b01c7640 1 -- 172.21.15.119:0/3679116866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a80fb430 msgr2=0x7f61a80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:53.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.713+0000 7f61b01c7640 1 --2- 172.21.15.119:0/3679116866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a80fb430 0x7f61a80fb840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f61a40048d0 tx=0x7f61a4009da0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.713+0000 7f61b01c7640 1 -- 172.21.15.119:0/3679116866 shutdown_connections 2024-09-13T21:45:53.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.713+0000 7f61b01c7640 1 --2- 172.21.15.119:0/3679116866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80fc700 0x7f61a80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.713+0000 7f61b01c7640 1 --2- 172.21.15.119:0/3679116866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a80fb430 0x7f61a80fb840 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.713+0000 7f61b01c7640 1 -- 172.21.15.119:0/3679116866 >> 172.21.15.119:0/3679116866 conn(0x7f61a80f6c10 msgr2=0x7f61a80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:53.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.713+0000 7f61b01c7640 1 -- 172.21.15.119:0/3679116866 shutdown_connections 2024-09-13T21:45:53.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.713+0000 7f61b01c7640 1 -- 172.21.15.119:0/3679116866 wait complete. 2024-09-13T21:45:53.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.713+0000 7f61b01c7640 1 Processor -- start 2024-09-13T21:45:53.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.713+0000 7f61b01c7640 1 -- start start 2024-09-13T21:45:53.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61b01c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80fb430 0x7f61a810f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:53.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61b01c7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a80fc700 0x7f61a810f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:53.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61b01c7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a810fe20 con 0x7f61a80fc700 2024-09-13T21:45:53.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61b01c7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a8110640 con 0x7f61a80fb430 2024-09-13T21:45:53.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61ad762640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a80fc700 0x7f61a810f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:53.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61ad762640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a80fc700 0x7f61a810f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58692/0 (socket says 172.21.15.119:58692) 2024-09-13T21:45:53.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61ad762640 1 -- 172.21.15.119:0/893138973 learned_addr learned my addr 172.21.15.119:0/893138973 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:45:53.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61adf63640 1 --2- 172.21.15.119:0/893138973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80fb430 0x7f61a810f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:53.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61ad762640 1 -- 172.21.15.119:0/893138973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80fb430 msgr2=0x7f61a810f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:53.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61ad762640 1 --2- 172.21.15.119:0/893138973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80fb430 0x7f61a810f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61ad762640 1 -- 172.21.15.119:0/893138973 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4005040 con 0x7f61a80fc700 2024-09-13T21:45:53.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f61ad762640 1 --2- 172.21.15.119:0/893138973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a80fc700 0x7f61a810f7d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6198002a50 tx=0x7f6198004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:53.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f619e7fc640 1 -- 172.21.15.119:0/893138973 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6198007c30 con 0x7f61a80fc700 2024-09-13T21:45:53.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f619e7fc640 1 -- 172.21.15.119:0/893138973 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f619800f040 con 0x7f61a80fc700 2024-09-13T21:45:53.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.714+0000 7f619e7fc640 1 -- 172.21.15.119:0/893138973 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f619800da10 con 0x7f61a80fc700 2024-09-13T21:45:53.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.715+0000 7f61b01c7640 1 -- 172.21.15.119:0/893138973 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a81108d0 con 0x7f61a80fc700 2024-09-13T21:45:53.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.715+0000 7f61b01c7640 1 -- 172.21.15.119:0/893138973 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a8110e70 con 0x7f61a80fc700 2024-09-13T21:45:53.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.716+0000 7f61b01c7640 1 -- 172.21.15.119:0/893138973 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a80fa890 con 0x7f61a80fc700 2024-09-13T21:45:53.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.716+0000 7f619e7fc640 1 -- 172.21.15.119:0/893138973 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f619800dbb0 con 0x7f61a80fc700 2024-09-13T21:45:53.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.717+0000 7f619e7fc640 1 --2- 172.21.15.119:0/893138973 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f619406e6e0 0x7f6194070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:45:53.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.717+0000 7f619e7fc640 1 -- 172.21.15.119:0/893138973 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f619808d630 con 0x7f61a80fc700 2024-09-13T21:45:53.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.717+0000 7f61adf63640 1 --2- 172.21.15.119:0/893138973 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f619406e6e0 0x7f6194070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:45:53.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.718+0000 7f61adf63640 1 --2- 172.21.15.119:0/893138973 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f619406e6e0 0x7f6194070b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f61a400b020 tx=0x7f61a4035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:45:53.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.722+0000 7f619e7fc640 1 -- 172.21.15.119:0/893138973 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f619804f670 con 0x7f61a80fc700 2024-09-13T21:45:53.763 DEBUG:teuthology.parallel:result is None 2024-09-13T21:45:53.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:53.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: pgmap v41: 65 pgs: 65 active+clean; 264 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 60 KiB/s rd, 2.3 MiB/s wr, 712 op/s 2024-09-13T21:45:53.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/933836908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:53.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:53.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:53.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:45:53.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:45:53.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:45:53.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:45:53.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:45:53.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:45:53.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:53.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: Upgrade: Need to upgrade myself (mgr.smithi155.wuuxfd) 2024-09-13T21:45:53.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: Upgrade: Need to upgrade myself (mgr.smithi155.wuuxfd) 2024-09-13T21:45:53.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:53 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/1897292518' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:45:53.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.982+0000 7f61b01c7640 1 -- 172.21.15.119:0/893138973 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f61a8101000 con 0x7f61a80fc700 2024-09-13T21:45:53.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.983+0000 7f619e7fc640 1 -- 172.21.15.119:0/893138973 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f61980570a0 con 0x7f61a80fc700 2024-09-13T21:45:53.986 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:45:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.986+0000 7f61b01c7640 1 -- 172.21.15.119:0/893138973 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f619406e6e0 msgr2=0x7f6194070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.986+0000 7f61b01c7640 1 --2- 172.21.15.119:0/893138973 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f619406e6e0 0x7f6194070b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f61a400b020 tx=0x7f61a4035040 comp rx=0 tx=0).stop 2024-09-13T21:45:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.986+0000 7f61b01c7640 1 -- 172.21.15.119:0/893138973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a80fc700 msgr2=0x7f61a810f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:45:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.986+0000 7f61b01c7640 1 --2- 172.21.15.119:0/893138973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a80fc700 0x7f61a810f7d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6198002a50 tx=0x7f6198004600 comp rx=0 tx=0).stop 2024-09-13T21:45:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.986+0000 7f61b01c7640 1 -- 172.21.15.119:0/893138973 shutdown_connections 2024-09-13T21:45:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.986+0000 7f61b01c7640 1 --2- 172.21.15.119:0/893138973 >> [v2:172.21.15.155:6828/1626670445,v1:172.21.15.155:6829/1626670445] conn(0x7f619406e6e0 0x7f6194070b90 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f61a400b020 tx=0x7f61a4035040 comp rx=0 tx=0).stop 2024-09-13T21:45:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.986+0000 7f61b01c7640 1 --2- 172.21.15.119:0/893138973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61a80fc700 0x7f61a810f7d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.986+0000 7f61b01c7640 1 --2- 172.21.15.119:0/893138973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a80fb430 0x7f61a810f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:45:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.986+0000 7f61b01c7640 1 -- 172.21.15.119:0/893138973 >> 172.21.15.119:0/893138973 conn(0x7f61a80f6c10 msgr2=0x7f61a80655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:45:53.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.987+0000 7f61b01c7640 1 -- 172.21.15.119:0/893138973 shutdown_connections 2024-09-13T21:45:53.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:45:53.987+0000 7f61b01c7640 1 -- 172.21.15.119:0/893138973 wait complete. 2024-09-13T21:45:54.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:54.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: pgmap v41: 65 pgs: 65 active+clean; 264 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 60 KiB/s rd, 2.3 MiB/s wr, 712 op/s 2024-09-13T21:45:54.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/933836908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: Upgrade: Need to upgrade myself (mgr.smithi155.wuuxfd) 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: Upgrade: Need to upgrade myself (mgr.smithi155.wuuxfd) 2024-09-13T21:45:54.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:53 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/1897292518' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:45:55.043 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:54 smithi119 ceph-mon[27653]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:55.043 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:54 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/893138973' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:45:55.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:54 smithi155 ceph-mon[34732]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:45:55.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:54 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/893138973' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:45:56.047 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:55 smithi119 ceph-mon[27653]: pgmap v42: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.2 MiB/s wr, 592 op/s 2024-09-13T21:45:56.047 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:55 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:56.047 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:55 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.gwjxmq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:45:56.047 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:55 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.gwjxmq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:45:56.047 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:55 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:45:56.047 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:55 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:56.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:55 smithi155 ceph-mon[34732]: pgmap v42: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.2 MiB/s wr, 592 op/s 2024-09-13T21:45:56.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:55 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:45:56.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:55 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.gwjxmq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:45:56.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:55 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.gwjxmq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:45:56.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:55 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:45:56.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:55 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:45:57.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:56 smithi155 ceph-mon[34732]: Upgrade: Updating mgr.smithi119.gwjxmq 2024-09-13T21:45:57.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:56 smithi155 ceph-mon[34732]: Deploying daemon mgr.smithi119.gwjxmq on smithi119 2024-09-13T21:45:57.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:56 smithi119 ceph-mon[27653]: Upgrade: Updating mgr.smithi119.gwjxmq 2024-09-13T21:45:57.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:56 smithi119 ceph-mon[27653]: Deploying daemon mgr.smithi119.gwjxmq on smithi119 2024-09-13T21:45:58.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:57 smithi155 ceph-mon[34732]: pgmap v43: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 1.7 MiB/s wr, 486 op/s 2024-09-13T21:45:58.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:57 smithi119 ceph-mon[27653]: pgmap v43: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 1.7 MiB/s wr, 486 op/s 2024-09-13T21:46:00.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:45:59 smithi155 ceph-mon[34732]: pgmap v44: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 2.3 MiB/s wr, 689 op/s 2024-09-13T21:46:00.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:45:59 smithi119 ceph-mon[27653]: pgmap v44: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 2.3 MiB/s wr, 689 op/s 2024-09-13T21:46:01.763 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-13T21:46:01.763 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-13T21:46:02.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:01 smithi155 ceph-mon[34732]: pgmap v45: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.5 MiB/s wr, 453 op/s 2024-09-13T21:46:02.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:01 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:02.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:01 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:02.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:01 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:02.128 DEBUG:teuthology.parallel:result is None 2024-09-13T21:46:02.129 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T21:46:02.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:01 smithi119 ceph-mon[27653]: pgmap v45: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.5 MiB/s wr, 453 op/s 2024-09-13T21:46:02.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:01 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:02.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:01 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:02.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:01 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:02.168 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T21:46:02.169 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T21:46:02.254 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T21:46:02.254 DEBUG:teuthology.parallel:result is None 2024-09-13T21:46:04.056 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:03 smithi119 ceph-mon[27653]: pgmap v46: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 54 KiB/s rd, 1.9 MiB/s wr, 571 op/s 2024-09-13T21:46:04.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:03 smithi155 ceph-mon[34732]: pgmap v46: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 54 KiB/s rd, 1.9 MiB/s wr, 571 op/s 2024-09-13T21:46:06.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:05 smithi155 ceph-mon[34732]: pgmap v47: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.3 MiB/s wr, 384 op/s 2024-09-13T21:46:06.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:05 smithi155 ceph-mon[34732]: Standby manager daemon smithi119.gwjxmq restarted 2024-09-13T21:46:06.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:05 smithi155 ceph-mon[34732]: Standby manager daemon smithi119.gwjxmq started 2024-09-13T21:46:06.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:05 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.gwjxmq/crt"}]: dispatch 2024-09-13T21:46:06.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:05 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:46:06.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:05 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.gwjxmq/key"}]: dispatch 2024-09-13T21:46:06.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:05 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:46:06.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:05 smithi119 ceph-mon[27653]: pgmap v47: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.3 MiB/s wr, 384 op/s 2024-09-13T21:46:06.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:05 smithi119 ceph-mon[27653]: Standby manager daemon smithi119.gwjxmq restarted 2024-09-13T21:46:06.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:05 smithi119 ceph-mon[27653]: Standby manager daemon smithi119.gwjxmq started 2024-09-13T21:46:06.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:05 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.gwjxmq/crt"}]: dispatch 2024-09-13T21:46:06.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:05 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:46:06.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:05 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.gwjxmq/key"}]: dispatch 2024-09-13T21:46:06.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:05 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:46:07.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:06 smithi155 ceph-mon[34732]: mgrmap e26: smithi155.wuuxfd(active, since 89s), standbys: smithi119.gwjxmq 2024-09-13T21:46:07.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:06 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:07.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:06 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:07.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:06 smithi119 ceph-mon[27653]: mgrmap e26: smithi155.wuuxfd(active, since 89s), standbys: smithi119.gwjxmq 2024-09-13T21:46:07.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:06 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:07.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:06 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:08.067 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:07 smithi119 ceph-mon[27653]: pgmap v48: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.0 MiB/s wr, 335 op/s 2024-09-13T21:46:08.067 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:07 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:08.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:07 smithi155 ceph-mon[34732]: pgmap v48: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.0 MiB/s wr, 335 op/s 2024-09-13T21:46:08.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:07 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:10.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:09 smithi155 ceph-mon[34732]: pgmap v49: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.1 MiB/s wr, 370 op/s 2024-09-13T21:46:10.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:09 smithi155 ceph-mon[34732]: mgrmap e27: smithi155.wuuxfd(active, since 92s), standbys: smithi119.gwjxmq 2024-09-13T21:46:10.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:09 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:10.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:09 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:10.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:09 smithi119 ceph-mon[27653]: pgmap v49: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.1 MiB/s wr, 370 op/s 2024-09-13T21:46:10.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:09 smithi119 ceph-mon[27653]: mgrmap e27: smithi155.wuuxfd(active, since 92s), standbys: smithi119.gwjxmq 2024-09-13T21:46:10.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:09 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:10.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:09 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:11.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:10 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:11.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:10 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:11.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:10 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:11.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:10 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:12.317 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:12 smithi119 ceph-mon[27653]: pgmap v50: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 479 KiB/s wr, 167 op/s 2024-09-13T21:46:12.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:12 smithi155 ceph-mon[34732]: pgmap v50: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 479 KiB/s wr, 167 op/s 2024-09-13T21:46:14.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: pgmap v51: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 479 KiB/s wr, 167 op/s 2024-09-13T21:46:14.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:14.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mgr fail", "who": "smithi155.wuuxfd"}]: dispatch 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mgr fail", "who": "smithi155.wuuxfd"}]: dispatch 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: Activating manager daemon smithi119.gwjxmq 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd='[{"prefix": "mgr fail", "who": "smithi155.wuuxfd"}]': finished 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: mgrmap e28: smithi119.gwjxmq(active, starting, since 0.00630359s) 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:46:14.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi119.gwjxmq", "id": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:46:14.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:46:14.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:46:14.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: Manager daemon smithi119.gwjxmq is now available 2024-09-13T21:46:14.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:14.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:14.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:46:14.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:14 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/trash_purge_schedule"}]: dispatch 2024-09-13T21:46:14.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: pgmap v51: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 479 KiB/s wr, 167 op/s 2024-09-13T21:46:14.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:14.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:14.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:14.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:46:14.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' 2024-09-13T21:46:14.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:14.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.24357 172.21.15.155:0/2796134862' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mgr fail", "who": "smithi155.wuuxfd"}]: dispatch 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "mgr fail", "who": "smithi155.wuuxfd"}]: dispatch 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: Activating manager daemon smithi119.gwjxmq 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.24357 ' entity='mgr.smithi155.wuuxfd' cmd='[{"prefix": "mgr fail", "who": "smithi155.wuuxfd"}]': finished 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: mgrmap e28: smithi119.gwjxmq(active, starting, since 0.00630359s) 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi119.gwjxmq", "id": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:46:14.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: Manager daemon smithi119.gwjxmq is now available 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:46:14.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:14 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/trash_purge_schedule"}]: dispatch 2024-09-13T21:46:15.440 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:15 smithi155 ceph-mon[34732]: mgrmap e29: smithi119.gwjxmq(active, since 1.0098s) 2024-09-13T21:46:15.441 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:15 smithi155 ceph-mon[34732]: pgmap v3: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:15.488 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:15 smithi119 ceph-mon[27653]: mgrmap e29: smithi119.gwjxmq(active, since 1.0098s) 2024-09-13T21:46:15.488 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:15 smithi119 ceph-mon[27653]: pgmap v3: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:16.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:16 smithi155 ceph-mon[34732]: [13/Sep/2024:21:46:14] ENGINE Bus STARTING 2024-09-13T21:46:16.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:16 smithi155 ceph-mon[34732]: [13/Sep/2024:21:46:14] ENGINE Serving on https://172.21.15.119:7150 2024-09-13T21:46:16.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:16 smithi155 ceph-mon[34732]: [13/Sep/2024:21:46:14] ENGINE Error in HTTPServer.serve 2024-09-13T21:46:16.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Traceback (most recent call last): 2024-09-13T21:46:16.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:46:16.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self._run(expiration_interval) 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: s = self.context.wrap_socket( 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: return self.sslsocket_class._create( 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self.do_handshake() 2024-09-13T21:46:16.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:46:16.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self._sslobj.do_handshake() 2024-09-13T21:46:16.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:46:16.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:16 smithi155 ceph-mon[34732]: [13/Sep/2024:21:46:15] ENGINE Serving on http://172.21.15.119:8765 2024-09-13T21:46:16.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:16 smithi155 ceph-mon[34732]: [13/Sep/2024:21:46:15] ENGINE Bus STARTED 2024-09-13T21:46:16.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:16 smithi155 ceph-mon[34732]: pgmap v4: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:16.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:16 smithi119 ceph-mon[27653]: [13/Sep/2024:21:46:14] ENGINE Bus STARTING 2024-09-13T21:46:16.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:16 smithi119 ceph-mon[27653]: [13/Sep/2024:21:46:14] ENGINE Serving on https://172.21.15.119:7150 2024-09-13T21:46:16.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:16 smithi119 ceph-mon[27653]: [13/Sep/2024:21:46:14] ENGINE Error in HTTPServer.serve 2024-09-13T21:46:16.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Traceback (most recent call last): 2024-09-13T21:46:16.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:46:16.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:46:16.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:46:16.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._run(expiration_interval) 2024-09-13T21:46:16.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:46:16.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s = self.context.wrap_socket( 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: return self.sslsocket_class._create( 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self.do_handshake() 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._sslobj.do_handshake() 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:16 smithi119 ceph-mon[27653]: [13/Sep/2024:21:46:15] ENGINE Serving on http://172.21.15.119:8765 2024-09-13T21:46:16.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:16 smithi119 ceph-mon[27653]: [13/Sep/2024:21:46:15] ENGINE Bus STARTED 2024-09-13T21:46:16.382 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:16 smithi119 ceph-mon[27653]: pgmap v4: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:17.415 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:17 smithi155 ceph-mon[34732]: mgrmap e30: smithi119.gwjxmq(active, since 3s) 2024-09-13T21:46:17.415 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:17 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:17.415 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:17 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:17.559 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:17 smithi119 ceph-mon[27653]: mgrmap e30: smithi119.gwjxmq(active, since 3s) 2024-09-13T21:46:17.559 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:17 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:17.559 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:17 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:18.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:18 smithi119 ceph-mon[27653]: pgmap v5: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:18.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:18 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:18.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:18 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:18.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:18 smithi155 ceph-mon[34732]: pgmap v5: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:18.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:18 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:18.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:18 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:19.530 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:19 smithi119 ceph-mon[27653]: Standby manager daemon smithi155.wuuxfd started 2024-09-13T21:46:19.531 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:19 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/1994498824' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/crt"}]: dispatch 2024-09-13T21:46:19.531 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:19 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/1994498824' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:46:19.531 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:19 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/1994498824' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/key"}]: dispatch 2024-09-13T21:46:19.531 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:19 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/1994498824' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:46:19.531 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:19 smithi119 ceph-mon[27653]: mgrmap e31: smithi119.gwjxmq(active, since 5s), standbys: smithi155.wuuxfd 2024-09-13T21:46:19.531 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:19 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi155.wuuxfd", "id": "smithi155.wuuxfd"}]: dispatch 2024-09-13T21:46:19.531 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:19 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:19.531 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:19 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:19 smithi155 ceph-mon[34732]: Standby manager daemon smithi155.wuuxfd started 2024-09-13T21:46:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:19 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/1994498824' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/crt"}]: dispatch 2024-09-13T21:46:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:19 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/1994498824' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:46:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:19 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/1994498824' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/key"}]: dispatch 2024-09-13T21:46:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:19 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/1994498824' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:46:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:19 smithi155 ceph-mon[34732]: mgrmap e31: smithi119.gwjxmq(active, since 5s), standbys: smithi155.wuuxfd 2024-09-13T21:46:19.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:19 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi155.wuuxfd", "id": "smithi155.wuuxfd"}]: dispatch 2024-09-13T21:46:19.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:19 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:19.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:19 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:20.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:20 smithi119 ceph-mon[27653]: pgmap v6: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:20.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:20 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:20.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:20 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:20.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:20 smithi155 ceph-mon[34732]: pgmap v6: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:20.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:20 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:20.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:20 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:22.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:22 smithi155 ceph-mon[34732]: pgmap v7: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-13T21:46:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:22 smithi119 ceph-mon[27653]: pgmap v7: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-13T21:46:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:46:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-13T21:46:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-13T21:46:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:46:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:46:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:46:23.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:46:23.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: pgmap v8: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T21:46:23.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:46:23.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:46:23.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:23.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:23.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:23.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:23.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:23 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:24.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.076+0000 7f98bb0ce640 1 -- 172.21.15.119:0/3117160504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98b40fb430 msgr2=0x7f98b40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.076+0000 7f98bb0ce640 1 --2- 172.21.15.119:0/3117160504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98b40fb430 0x7f98b40fb840 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f98a80048d0 tx=0x7f98a8009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.076+0000 7f98bb0ce640 1 -- 172.21.15.119:0/3117160504 shutdown_connections 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.076+0000 7f98bb0ce640 1 --2- 172.21.15.119:0/3117160504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b40fc700 0x7f98b40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.076+0000 7f98bb0ce640 1 --2- 172.21.15.119:0/3117160504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98b40fb430 0x7f98b40fb840 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.076+0000 7f98bb0ce640 1 -- 172.21.15.119:0/3117160504 >> 172.21.15.119:0/3117160504 conn(0x7f98b40f6c10 msgr2=0x7f98b40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.076+0000 7f98bb0ce640 1 -- 172.21.15.119:0/3117160504 shutdown_connections 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.076+0000 7f98bb0ce640 1 -- 172.21.15.119:0/3117160504 wait complete. 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98bb0ce640 1 Processor -- start 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98bb0ce640 1 -- start start 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98bb0ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98b40fb430 0x7f98b40ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98bb0ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b40fc700 0x7f98b40fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98bb0ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40fdfd0 con 0x7f98b40fb430 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98bb0ce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40fe110 con 0x7f98b40fc700 2024-09-13T21:46:24.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98b8e6a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98b40fb430 0x7f98b40ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98b8e6a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98b40fb430 0x7f98b40ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53434/0 (socket says 172.21.15.119:53434) 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98b8e6a640 1 -- 172.21.15.119:0/1485492170 learned_addr learned my addr 172.21.15.119:0/1485492170 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98b3fff640 1 --2- 172.21.15.119:0/1485492170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b40fc700 0x7f98b40fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98b8e6a640 1 -- 172.21.15.119:0/1485492170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b40fc700 msgr2=0x7f98b40fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98b8e6a640 1 --2- 172.21.15.119:0/1485492170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b40fc700 0x7f98b40fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.077+0000 7f98b8e6a640 1 -- 172.21.15.119:0/1485492170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8005040 con 0x7f98b40fb430 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.078+0000 7f98b8e6a640 1 --2- 172.21.15.119:0/1485492170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98b40fb430 0x7f98b40ff550 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f98a8003080 tx=0x7f98a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.078+0000 7f98b17fa640 1 -- 172.21.15.119:0/1485492170 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a8038070 con 0x7f98b40fb430 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.078+0000 7f98b17fa640 1 -- 172.21.15.119:0/1485492170 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f98a802abd0 con 0x7f98b40fb430 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.078+0000 7f98b17fa640 1 -- 172.21.15.119:0/1485492170 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a803e670 con 0x7f98b40fb430 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.078+0000 7f98bb0ce640 1 -- 172.21.15.119:0/1485492170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b40fe390 con 0x7f98b40fb430 2024-09-13T21:46:24.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.078+0000 7f98bb0ce640 1 -- 172.21.15.119:0/1485492170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b41150b0 con 0x7f98b40fb430 2024-09-13T21:46:24.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.079+0000 7f98bb0ce640 1 -- 172.21.15.119:0/1485492170 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b40fa890 con 0x7f98b40fb430 2024-09-13T21:46:24.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.080+0000 7f98b17fa640 1 -- 172.21.15.119:0/1485492170 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f98a8030020 con 0x7f98b40fb430 2024-09-13T21:46:24.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.080+0000 7f98b17fa640 1 --2- 172.21.15.119:0/1485492170 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f98a406df60 0x7f98a4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.080+0000 7f98b17fa640 1 -- 172.21.15.119:0/1485492170 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f98a80add40 con 0x7f98b40fb430 2024-09-13T21:46:24.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.080+0000 7f98b3fff640 1 --2- 172.21.15.119:0/1485492170 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f98a406df60 0x7f98a4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:24.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.081+0000 7f98b3fff640 1 --2- 172.21.15.119:0/1485492170 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f98a406df60 0x7f98a4070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f98a0004bc0 tx=0x7f98a0009040 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:24.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:24.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:24.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:24.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:46:24.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-13T21:46:24.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: pgmap v8: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:24.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:23 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:24.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.085+0000 7f98b17fa640 1 -- 172.21.15.119:0/1485492170 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f98a80775c0 con 0x7f98b40fb430 2024-09-13T21:46:24.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.279+0000 7f98bb0ce640 1 -- 172.21.15.119:0/1485492170 --> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98b4103ea0 con 0x7f98a406df60 2024-09-13T21:46:24.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.280+0000 7f98b17fa640 1 -- 172.21.15.119:0/1485492170 <== mgr.14734 v2:172.21.15.119:6800/4086293592 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f98b4103ea0 con 0x7f98a406df60 2024-09-13T21:46:24.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.282+0000 7f98bb0ce640 1 -- 172.21.15.119:0/1485492170 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f98a406df60 msgr2=0x7f98a4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.282+0000 7f98bb0ce640 1 --2- 172.21.15.119:0/1485492170 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f98a406df60 0x7f98a4070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f98a0004bc0 tx=0x7f98a0009040 comp rx=0 tx=0).stop 2024-09-13T21:46:24.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.282+0000 7f98bb0ce640 1 -- 172.21.15.119:0/1485492170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98b40fb430 msgr2=0x7f98b40ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.282+0000 7f98bb0ce640 1 --2- 172.21.15.119:0/1485492170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98b40fb430 0x7f98b40ff550 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f98a8003080 tx=0x7f98a8009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.282+0000 7f98bb0ce640 1 -- 172.21.15.119:0/1485492170 shutdown_connections 2024-09-13T21:46:24.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.282+0000 7f98bb0ce640 1 --2- 172.21.15.119:0/1485492170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b40fc700 0x7f98b40fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.282+0000 7f98bb0ce640 1 --2- 172.21.15.119:0/1485492170 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f98a406df60 0x7f98a4070410 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.282+0000 7f98bb0ce640 1 --2- 172.21.15.119:0/1485492170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98b40fb430 0x7f98b40ff550 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.282+0000 7f98bb0ce640 1 -- 172.21.15.119:0/1485492170 >> 172.21.15.119:0/1485492170 conn(0x7f98b40f6c10 msgr2=0x7f98b4065620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:24.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.282+0000 7f98bb0ce640 1 -- 172.21.15.119:0/1485492170 shutdown_connections 2024-09-13T21:46:24.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.282+0000 7f98bb0ce640 1 -- 172.21.15.119:0/1485492170 wait complete. 2024-09-13T21:46:24.292 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:46:24.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.362+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/573224475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d680fc550 msgr2=0x7f5d680fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.362+0000 7f5d6e2d2640 1 --2- 172.21.15.119:0/573224475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d680fc550 0x7f5d680fc960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5d580048d0 tx=0x7f5d58009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.362+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/573224475 shutdown_connections 2024-09-13T21:46:24.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.362+0000 7f5d6e2d2640 1 --2- 172.21.15.119:0/573224475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d680fd820 0x7f5d680fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.362+0000 7f5d6e2d2640 1 --2- 172.21.15.119:0/573224475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d680fc550 0x7f5d680fc960 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.362+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/573224475 >> 172.21.15.119:0/573224475 conn(0x7f5d680f7d30 msgr2=0x7f5d680fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:24.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.362+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/573224475 shutdown_connections 2024-09-13T21:46:24.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.362+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/573224475 wait complete. 2024-09-13T21:46:24.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d6e2d2640 1 Processor -- start 2024-09-13T21:46:24.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d6e2d2640 1 -- start start 2024-09-13T21:46:24.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d6e2d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d680fc550 0x7f5d6810d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d6e2d2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d680fd820 0x7f5d6810d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d6e2d2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6810e4e0 con 0x7f5d680fd820 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d6e2d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6810e650 con 0x7f5d680fc550 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d680fd820 0x7f5d6810d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d5ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d680fd820 0x7f5d6810d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53448/0 (socket says 172.21.15.119:53448) 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d5ffff640 1 -- 172.21.15.119:0/2935284698 learned_addr learned my addr 172.21.15.119:0/2935284698 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d5ffff640 1 -- 172.21.15.119:0/2935284698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d680fc550 msgr2=0x7f5d6810d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d67fff640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d680fc550 0x7f5d6810d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d5ffff640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d680fc550 0x7f5d6810d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d5ffff640 1 -- 172.21.15.119:0/2935284698 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d58005040 con 0x7f5d680fd820 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d67fff640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d680fc550 0x7f5d6810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.363+0000 7f5d5ffff640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d680fd820 0x7f5d6810d670 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000b790 tx=0x7f5d500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:24.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.364+0000 7f5d657fa640 1 -- 172.21.15.119:0/2935284698 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d5000c700 con 0x7f5d680fd820 2024-09-13T21:46:24.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.364+0000 7f5d657fa640 1 -- 172.21.15.119:0/2935284698 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5d5000cd00 con 0x7f5d680fd820 2024-09-13T21:46:24.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.364+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/2935284698 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6810e930 con 0x7f5d680fd820 2024-09-13T21:46:24.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.364+0000 7f5d657fa640 1 -- 172.21.15.119:0/2935284698 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d50015e70 con 0x7f5d680fd820 2024-09-13T21:46:24.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.364+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/2935284698 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6810ee50 con 0x7f5d680fd820 2024-09-13T21:46:24.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.365+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/2935284698 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d680fb9b0 con 0x7f5d680fd820 2024-09-13T21:46:24.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.365+0000 7f5d657fa640 1 -- 172.21.15.119:0/2935284698 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f5d50012070 con 0x7f5d680fd820 2024-09-13T21:46:24.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.366+0000 7f5d657fa640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f5d5406df60 0x7f5d54070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.366+0000 7f5d657fa640 1 -- 172.21.15.119:0/2935284698 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5d5008d440 con 0x7f5d680fd820 2024-09-13T21:46:24.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.366+0000 7f5d67fff640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f5d5406df60 0x7f5d54070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:24.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.366+0000 7f5d67fff640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f5d5406df60 0x7f5d54070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800b020 tx=0x7f5d58009da0 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:24.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.370+0000 7f5d657fa640 1 -- 172.21.15.119:0/2935284698 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5d50056d40 con 0x7f5d680fd820 2024-09-13T21:46:24.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.557+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/2935284698 --> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d6810f0d0 con 0x7f5d5406df60 2024-09-13T21:46:24.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.558+0000 7f5d657fa640 1 -- 172.21.15.119:0/2935284698 <== mgr.14734 v2:172.21.15.119:6800/4086293592 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f5d6810f0d0 con 0x7f5d5406df60 2024-09-13T21:46:24.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.561+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/2935284698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f5d5406df60 msgr2=0x7f5d54070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.561+0000 7f5d6e2d2640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f5d5406df60 0x7f5d54070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800b020 tx=0x7f5d58009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.561+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/2935284698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d680fd820 msgr2=0x7f5d6810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.561+0000 7f5d6e2d2640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d680fd820 0x7f5d6810d670 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000b790 tx=0x7f5d500091d0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.561+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/2935284698 shutdown_connections 2024-09-13T21:46:24.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.561+0000 7f5d6e2d2640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f5d5406df60 0x7f5d54070410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.561+0000 7f5d6e2d2640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d680fd820 0x7f5d6810d670 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.561+0000 7f5d6e2d2640 1 --2- 172.21.15.119:0/2935284698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d680fc550 0x7f5d6810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.561+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/2935284698 >> 172.21.15.119:0/2935284698 conn(0x7f5d680f7d30 msgr2=0x7f5d680f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:24.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.561+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/2935284698 shutdown_connections 2024-09-13T21:46:24.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.561+0000 7f5d6e2d2640 1 -- 172.21.15.119:0/2935284698 wait complete. 2024-09-13T21:46:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.644+0000 7f9632892640 1 -- 172.21.15.119:0/617724850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f962c0666b0 msgr2=0x7f962c0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.644+0000 7f9632892640 1 --2- 172.21.15.119:0/617724850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f962c0666b0 0x7f962c0ff1c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f961c0048d0 tx=0x7f961c009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.644+0000 7f9632892640 1 -- 172.21.15.119:0/617724850 shutdown_connections 2024-09-13T21:46:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.644+0000 7f9632892640 1 --2- 172.21.15.119:0/617724850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f962c0ff700 0x7f962c101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.644+0000 7f9632892640 1 --2- 172.21.15.119:0/617724850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f962c0666b0 0x7f962c0ff1c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.644+0000 7f9632892640 1 -- 172.21.15.119:0/617724850 >> 172.21.15.119:0/617724850 conn(0x7f962c0f6c10 msgr2=0x7f962c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.644+0000 7f9632892640 1 -- 172.21.15.119:0/617724850 shutdown_connections 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.644+0000 7f9632892640 1 -- 172.21.15.119:0/617724850 wait complete. 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.644+0000 7f9632892640 1 Processor -- start 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f9632892640 1 -- start start 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f9632892640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f962c0666b0 0x7f962c10d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f9632892640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f962c0ff700 0x7f962c10d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f9632892640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c10e560 con 0x7f962c0666b0 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f9632892640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c10e6d0 con 0x7f962c0ff700 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f962bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f962c0666b0 0x7f962c10d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f962bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f962c0666b0 0x7f962c10d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53470/0 (socket says 172.21.15.119:53470) 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f962bfff640 1 -- 172.21.15.119:0/3771143111 learned_addr learned my addr 172.21.15.119:0/3771143111 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f962bfff640 1 -- 172.21.15.119:0/3771143111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f962c0ff700 msgr2=0x7f962c10d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f962bfff640 1 --2- 172.21.15.119:0/3771143111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f962c0ff700 0x7f962c10d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f962bfff640 1 -- 172.21.15.119:0/3771143111 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c005040 con 0x7f962c0666b0 2024-09-13T21:46:24.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f962bfff640 1 --2- 172.21.15.119:0/3771143111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f962c0666b0 0x7f962c10d200 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f961c000c00 tx=0x7f961c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:24.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f9628ff9640 1 -- 172.21.15.119:0/3771143111 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f961c038070 con 0x7f962c0666b0 2024-09-13T21:46:24.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f9628ff9640 1 -- 172.21.15.119:0/3771143111 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f961c009760 con 0x7f962c0666b0 2024-09-13T21:46:24.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f9628ff9640 1 -- 172.21.15.119:0/3771143111 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f961c03db90 con 0x7f962c0666b0 2024-09-13T21:46:24.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.645+0000 7f9632892640 1 -- 172.21.15.119:0/3771143111 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c10e950 con 0x7f962c0666b0 2024-09-13T21:46:24.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.646+0000 7f9632892640 1 -- 172.21.15.119:0/3771143111 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c10ee10 con 0x7f962c0666b0 2024-09-13T21:46:24.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.646+0000 7f9632892640 1 -- 172.21.15.119:0/3771143111 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c0fa8b0 con 0x7f962c0666b0 2024-09-13T21:46:24.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.647+0000 7f9628ff9640 1 -- 172.21.15.119:0/3771143111 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f961c030020 con 0x7f962c0666b0 2024-09-13T21:46:24.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.647+0000 7f9628ff9640 1 --2- 172.21.15.119:0/3771143111 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f961406df60 0x7f9614070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.647+0000 7f9628ff9640 1 -- 172.21.15.119:0/3771143111 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f961c0ae460 con 0x7f962c0666b0 2024-09-13T21:46:24.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.647+0000 7f962b7fe640 1 --2- 172.21.15.119:0/3771143111 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f961406df60 0x7f9614070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.648+0000 7f962b7fe640 1 --2- 172.21.15.119:0/3771143111 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f961406df60 0x7f9614070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f962c10cfb0 tx=0x7f9620006d20 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:24.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.652+0000 7f9628ff9640 1 -- 172.21.15.119:0/3771143111 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f961c077ce0 con 0x7f962c0666b0 2024-09-13T21:46:24.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.832+0000 7f9632892640 1 -- 172.21.15.119:0/3771143111 --> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f962c10f0f0 con 0x7f961406df60 2024-09-13T21:46:24.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.841+0000 7f9628ff9640 1 -- 172.21.15.119:0/3771143111 <== mgr.14734 v2:172.21.15.119:6800/4086293592 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f962c10f0f0 con 0x7f961406df60 2024-09-13T21:46:24.843 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:46:24.843 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (54s) 6s ago 9m 16.9M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:46:24.843 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (9m) 6s ago 9m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 c6a79bd22109 2024-09-13T21:46:24.843 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (8m) 8s ago 8m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 1bccd1b9bda0 2024-09-13T21:46:24.843 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (42s) 6s ago 9m 77.4M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:46:24.843 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (4m) 6s ago 4m 12.4M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:46:24.843 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (4m) 6s ago 4m 124M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:46:24.843 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (4m) 8s ago 4m 15.7M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:46:24.843 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (4m) 8s ago 4m 111M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (25s) 6s ago 10m 474M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283 running (2m) 8s ago 8m 116M - 19.1.1-324-gecab7be5 0652ff2b5d78 3869f6b2a429 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (10m) 6s ago 10m 53.2M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 f49a62e4f3c3 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (8m) 8s ago 8m 43.1M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 66c9116315ae 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (68s) 6s ago 9m 8086k - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (33s) 8s ago 8m 8358k - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (7m) 6s ago 7m 212M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 6e0bbff1ac3f 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (7m) 6s ago 7m 232M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (6m) 6s ago 6m 191M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (6m) 8s ago 6m 264M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (6m) 8s ago 6m 227M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (5m) 8s ago 5m 225M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:46:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (36s) 6s ago 9m 45.0M - 2.43.0 a07b618ecd1d 7c77f1d3c339 2024-09-13T21:46:24.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.843+0000 7f9632892640 1 -- 172.21.15.119:0/3771143111 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f961406df60 msgr2=0x7f9614070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.843+0000 7f9632892640 1 --2- 172.21.15.119:0/3771143111 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f961406df60 0x7f9614070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f962c10cfb0 tx=0x7f9620006d20 comp rx=0 tx=0).stop 2024-09-13T21:46:24.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.843+0000 7f9632892640 1 -- 172.21.15.119:0/3771143111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f962c0666b0 msgr2=0x7f962c10d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.844+0000 7f9632892640 1 --2- 172.21.15.119:0/3771143111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f962c0666b0 0x7f962c10d200 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f961c000c00 tx=0x7f961c009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.844+0000 7f9632892640 1 -- 172.21.15.119:0/3771143111 shutdown_connections 2024-09-13T21:46:24.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.844+0000 7f9632892640 1 --2- 172.21.15.119:0/3771143111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f962c0ff700 0x7f962c10d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.844+0000 7f9632892640 1 --2- 172.21.15.119:0/3771143111 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f961406df60 0x7f9614070410 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.844+0000 7f9632892640 1 --2- 172.21.15.119:0/3771143111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f962c0666b0 0x7f962c10d200 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.844+0000 7f9632892640 1 -- 172.21.15.119:0/3771143111 >> 172.21.15.119:0/3771143111 conn(0x7f962c0f6c10 msgr2=0x7f962c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:24.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.844+0000 7f9632892640 1 -- 172.21.15.119:0/3771143111 shutdown_connections 2024-09-13T21:46:24.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.844+0000 7f9632892640 1 -- 172.21.15.119:0/3771143111 wait complete. 2024-09-13T21:46:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.920+0000 7f0a29d7f640 1 -- 172.21.15.119:0/169068419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a240fb430 msgr2=0x7f0a240fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.920+0000 7f0a29d7f640 1 --2- 172.21.15.119:0/169068419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a240fb430 0x7f0a240fb840 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0a140048d0 tx=0x7f0a14009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.920+0000 7f0a29d7f640 1 -- 172.21.15.119:0/169068419 shutdown_connections 2024-09-13T21:46:24.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.920+0000 7f0a29d7f640 1 --2- 172.21.15.119:0/169068419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a240fc700 0x7f0a240fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.920+0000 7f0a29d7f640 1 --2- 172.21.15.119:0/169068419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a240fb430 0x7f0a240fb840 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.920+0000 7f0a29d7f640 1 -- 172.21.15.119:0/169068419 >> 172.21.15.119:0/169068419 conn(0x7f0a240f6c10 msgr2=0x7f0a240f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:24.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:24 smithi119 ceph-mon[27653]: Reconfiguring prometheus.smithi119 (dependencies changed)... 2024-09-13T21:46:24.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:24 smithi119 ceph-mon[27653]: Reconfiguring daemon prometheus.smithi119 on smithi119 2024-09-13T21:46:24.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:24 smithi119 ceph-mon[27653]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:24.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.920+0000 7f0a29d7f640 1 -- 172.21.15.119:0/169068419 shutdown_connections 2024-09-13T21:46:24.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.920+0000 7f0a29d7f640 1 -- 172.21.15.119:0/169068419 wait complete. 2024-09-13T21:46:24.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.920+0000 7f0a29d7f640 1 Processor -- start 2024-09-13T21:46:24.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.920+0000 7f0a29d7f640 1 -- start start 2024-09-13T21:46:24.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a29d7f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a240fb430 0x7f0a2410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a29d7f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a240fc700 0x7f0a2410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a29d7f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2410dc10 con 0x7f0a240fb430 2024-09-13T21:46:24.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a29d7f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2410e430 con 0x7f0a240fc700 2024-09-13T21:46:24.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a237fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a240fb430 0x7f0a2410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:24.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a237fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a240fb430 0x7f0a2410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53484/0 (socket says 172.21.15.119:53484) 2024-09-13T21:46:24.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a237fe640 1 -- 172.21.15.119:0/3506895280 learned_addr learned my addr 172.21.15.119:0/3506895280 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:24.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a237fe640 1 -- 172.21.15.119:0/3506895280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a240fc700 msgr2=0x7f0a2410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:24.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a237fe640 1 --2- 172.21.15.119:0/3506895280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a240fc700 0x7f0a2410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:24.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a237fe640 1 -- 172.21.15.119:0/3506895280 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a14005040 con 0x7f0a240fb430 2024-09-13T21:46:24.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a237fe640 1 --2- 172.21.15.119:0/3506895280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a240fb430 0x7f0a2410d080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0a140043d0 tx=0x7f0a14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:24.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a20ff9640 1 -- 172.21.15.119:0/3506895280 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a14038070 con 0x7f0a240fb430 2024-09-13T21:46:24.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a20ff9640 1 -- 172.21.15.119:0/3506895280 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a1402ae90 con 0x7f0a240fb430 2024-09-13T21:46:24.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a29d7f640 1 -- 172.21.15.119:0/3506895280 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2410e660 con 0x7f0a240fb430 2024-09-13T21:46:24.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a20ff9640 1 -- 172.21.15.119:0/3506895280 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a1403e670 con 0x7f0a240fb430 2024-09-13T21:46:24.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.921+0000 7f0a29d7f640 1 -- 172.21.15.119:0/3506895280 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2410ec00 con 0x7f0a240fb430 2024-09-13T21:46:24.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.922+0000 7f0a29d7f640 1 -- 172.21.15.119:0/3506895280 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a240fa890 con 0x7f0a240fb430 2024-09-13T21:46:24.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.923+0000 7f0a20ff9640 1 -- 172.21.15.119:0/3506895280 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f0a14030020 con 0x7f0a240fb430 2024-09-13T21:46:24.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.923+0000 7f0a20ff9640 1 --2- 172.21.15.119:0/3506895280 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f0a1006df60 0x7f0a10070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:24.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.923+0000 7f0a20ff9640 1 -- 172.21.15.119:0/3506895280 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0a140adb60 con 0x7f0a240fb430 2024-09-13T21:46:24.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.923+0000 7f0a1bfff640 1 --2- 172.21.15.119:0/3506895280 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f0a1006df60 0x7f0a10070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:24.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.924+0000 7f0a1bfff640 1 --2- 172.21.15.119:0/3506895280 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f0a1006df60 0x7f0a10070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0a2410ce30 tx=0x7f0a0c009c50 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:24.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:24.927+0000 7f0a20ff9640 1 -- 172.21.15.119:0/3506895280 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f0a14077460 con 0x7f0a240fb430 2024-09-13T21:46:25.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:24 smithi155 ceph-mon[34732]: Reconfiguring prometheus.smithi119 (dependencies changed)... 2024-09-13T21:46:25.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:24 smithi155 ceph-mon[34732]: Reconfiguring daemon prometheus.smithi119 on smithi119 2024-09-13T21:46:25.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:24 smithi155 ceph-mon[34732]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:25.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.161+0000 7f0a29d7f640 1 -- 172.21.15.119:0/3506895280 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0a24103f30 con 0x7f0a240fb430 2024-09-13T21:46:25.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.162+0000 7f0a20ff9640 1 -- 172.21.15.119:0/3506895280 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f0a1407ab20 con 0x7f0a240fb430 2024-09-13T21:46:25.164 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:46:25.164 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:46:25.164 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T21:46:25.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:46:25.164 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:46:25.164 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:46:25.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:46:25.164 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:46:25.165 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T21:46:25.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:46:25.165 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:46:25.165 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:46:25.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:46:25.165 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:46:25.165 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 12, 2024-09-13T21:46:25.165 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:46:25.165 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:46:25.165 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:46:25.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.164+0000 7f0a29d7f640 1 -- 172.21.15.119:0/3506895280 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f0a1006df60 msgr2=0x7f0a10070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.164+0000 7f0a29d7f640 1 --2- 172.21.15.119:0/3506895280 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f0a1006df60 0x7f0a10070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0a2410ce30 tx=0x7f0a0c009c50 comp rx=0 tx=0).stop 2024-09-13T21:46:25.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.164+0000 7f0a29d7f640 1 -- 172.21.15.119:0/3506895280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a240fb430 msgr2=0x7f0a2410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.164+0000 7f0a29d7f640 1 --2- 172.21.15.119:0/3506895280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a240fb430 0x7f0a2410d080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0a140043d0 tx=0x7f0a14009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.164+0000 7f0a29d7f640 1 -- 172.21.15.119:0/3506895280 shutdown_connections 2024-09-13T21:46:25.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.164+0000 7f0a29d7f640 1 --2- 172.21.15.119:0/3506895280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a240fc700 0x7f0a2410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.164+0000 7f0a29d7f640 1 --2- 172.21.15.119:0/3506895280 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f0a1006df60 0x7f0a10070410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.164+0000 7f0a29d7f640 1 --2- 172.21.15.119:0/3506895280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a240fb430 0x7f0a2410d080 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.164+0000 7f0a29d7f640 1 -- 172.21.15.119:0/3506895280 >> 172.21.15.119:0/3506895280 conn(0x7f0a240f6c10 msgr2=0x7f0a240655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:25.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.164+0000 7f0a29d7f640 1 -- 172.21.15.119:0/3506895280 shutdown_connections 2024-09-13T21:46:25.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.164+0000 7f0a29d7f640 1 -- 172.21.15.119:0/3506895280 wait complete. 2024-09-13T21:46:25.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.242+0000 7f77941f3640 1 -- 172.21.15.119:0/3997555912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f778c0fc550 msgr2=0x7f778c0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.242+0000 7f77941f3640 1 --2- 172.21.15.119:0/3997555912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f778c0fc550 0x7f778c0fc960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f77880048d0 tx=0x7f7788009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.242+0000 7f77941f3640 1 -- 172.21.15.119:0/3997555912 shutdown_connections 2024-09-13T21:46:25.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.242+0000 7f77941f3640 1 --2- 172.21.15.119:0/3997555912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f778c0fd820 0x7f778c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.242+0000 7f77941f3640 1 --2- 172.21.15.119:0/3997555912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f778c0fc550 0x7f778c0fc960 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.242+0000 7f77941f3640 1 -- 172.21.15.119:0/3997555912 >> 172.21.15.119:0/3997555912 conn(0x7f778c0f7d30 msgr2=0x7f778c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:25.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.242+0000 7f77941f3640 1 -- 172.21.15.119:0/3997555912 shutdown_connections 2024-09-13T21:46:25.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.242+0000 7f77941f3640 1 -- 172.21.15.119:0/3997555912 wait complete. 2024-09-13T21:46:25.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.243+0000 7f77941f3640 1 Processor -- start 2024-09-13T21:46:25.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.243+0000 7f77941f3640 1 -- start start 2024-09-13T21:46:25.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.243+0000 7f77941f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f778c0fc550 0x7f778c10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:25.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.243+0000 7f77941f3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f778c0fd820 0x7f778c10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:25.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.243+0000 7f77941f3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c10dc10 con 0x7f778c0fc550 2024-09-13T21:46:25.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.243+0000 7f77941f3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c10e430 con 0x7f778c0fd820 2024-09-13T21:46:25.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.243+0000 7f7791f8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f778c0fc550 0x7f778c10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:25.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.243+0000 7f7791f8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f778c0fc550 0x7f778c10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53512/0 (socket says 172.21.15.119:53512) 2024-09-13T21:46:25.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.244+0000 7f7791f8f640 1 -- 172.21.15.119:0/646275291 learned_addr learned my addr 172.21.15.119:0/646275291 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:25.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.244+0000 7f779178e640 1 --2- 172.21.15.119:0/646275291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f778c0fd820 0x7f778c10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:25.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.244+0000 7f7791f8f640 1 -- 172.21.15.119:0/646275291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f778c0fd820 msgr2=0x7f778c10d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.244+0000 7f7791f8f640 1 --2- 172.21.15.119:0/646275291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f778c0fd820 0x7f778c10d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.244+0000 7f7791f8f640 1 -- 172.21.15.119:0/646275291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788005040 con 0x7f778c0fc550 2024-09-13T21:46:25.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.244+0000 7f7791f8f640 1 --2- 172.21.15.119:0/646275291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f778c0fc550 0x7f778c10d080 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f77880043d0 tx=0x7f7788009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:25.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.244+0000 7f77827fc640 1 -- 172.21.15.119:0/646275291 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7788038070 con 0x7f778c0fc550 2024-09-13T21:46:25.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.244+0000 7f77827fc640 1 -- 172.21.15.119:0/646275291 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f778802ae90 con 0x7f778c0fc550 2024-09-13T21:46:25.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.244+0000 7f77941f3640 1 -- 172.21.15.119:0/646275291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c10e660 con 0x7f778c0fc550 2024-09-13T21:46:25.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.244+0000 7f77827fc640 1 -- 172.21.15.119:0/646275291 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f778803e670 con 0x7f778c0fc550 2024-09-13T21:46:25.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.244+0000 7f77941f3640 1 -- 172.21.15.119:0/646275291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c10ec00 con 0x7f778c0fc550 2024-09-13T21:46:25.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.245+0000 7f77941f3640 1 -- 172.21.15.119:0/646275291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778c0fb9b0 con 0x7f778c0fc550 2024-09-13T21:46:25.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.246+0000 7f77827fc640 1 -- 172.21.15.119:0/646275291 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f7788030020 con 0x7f778c0fc550 2024-09-13T21:46:25.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.246+0000 7f77827fc640 1 --2- 172.21.15.119:0/646275291 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f777806df60 0x7f7778070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:25.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.246+0000 7f77827fc640 1 -- 172.21.15.119:0/646275291 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f77880adaf0 con 0x7f778c0fc550 2024-09-13T21:46:25.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.246+0000 7f779178e640 1 --2- 172.21.15.119:0/646275291 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f777806df60 0x7f7778070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:25.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.247+0000 7f779178e640 1 --2- 172.21.15.119:0/646275291 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f777806df60 0x7f7778070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f777c007fd0 tx=0x7f777c009e90 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:25.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.250+0000 7f77827fc640 1 -- 172.21.15.119:0/646275291 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f77880773f0 con 0x7f778c0fc550 2024-09-13T21:46:25.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.452+0000 7f77941f3640 1 -- 172.21.15.119:0/646275291 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f778c10ef30 con 0x7f778c0fc550 2024-09-13T21:46:25.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.452+0000 7f77827fc640 1 -- 172.21.15.119:0/646275291 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f778807aab0 con 0x7f778c0fc550 2024-09-13T21:46:25.454 INFO:teuthology.orchestra.run.smithi119.stdout:e20 2024-09-13T21:46:25.454 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:46:25.454 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:46:25.454 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:46:25.454 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:46:25.454 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:46:25.454 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:46:25.454 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 20 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:45:37.594101+0000 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:46:25.455 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:46:25.456 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:46:25.457 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:46:25.457 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:46:25.457 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:25.457 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:25.457 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 20 2024-09-13T21:46:25.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.454+0000 7f77941f3640 1 -- 172.21.15.119:0/646275291 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f777806df60 msgr2=0x7f7778070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.454+0000 7f77941f3640 1 --2- 172.21.15.119:0/646275291 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f777806df60 0x7f7778070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f777c007fd0 tx=0x7f777c009e90 comp rx=0 tx=0).stop 2024-09-13T21:46:25.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.454+0000 7f77941f3640 1 -- 172.21.15.119:0/646275291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f778c0fc550 msgr2=0x7f778c10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.454+0000 7f77941f3640 1 --2- 172.21.15.119:0/646275291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f778c0fc550 0x7f778c10d080 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f77880043d0 tx=0x7f7788009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.454+0000 7f77941f3640 1 -- 172.21.15.119:0/646275291 shutdown_connections 2024-09-13T21:46:25.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.454+0000 7f77941f3640 1 --2- 172.21.15.119:0/646275291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f778c0fd820 0x7f778c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.454+0000 7f77941f3640 1 --2- 172.21.15.119:0/646275291 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7f777806df60 0x7f7778070410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.454+0000 7f77941f3640 1 --2- 172.21.15.119:0/646275291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f778c0fc550 0x7f778c10d080 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.454+0000 7f77941f3640 1 -- 172.21.15.119:0/646275291 >> 172.21.15.119:0/646275291 conn(0x7f778c0f7d30 msgr2=0x7f778c0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:25.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.454+0000 7f77941f3640 1 -- 172.21.15.119:0/646275291 shutdown_connections 2024-09-13T21:46:25.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.454+0000 7f77941f3640 1 -- 172.21.15.119:0/646275291 wait complete. 2024-09-13T21:46:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.534+0000 7fb1aae79640 1 -- 172.21.15.119:0/3164365884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a4065bc0 msgr2=0x7fb1a40ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.534+0000 7fb1aae79640 1 --2- 172.21.15.119:0/3164365884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a4065bc0 0x7fb1a40ff1c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb1940048d0 tx=0x7fb194009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.534+0000 7fb1aae79640 1 -- 172.21.15.119:0/3164365884 shutdown_connections 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.534+0000 7fb1aae79640 1 --2- 172.21.15.119:0/3164365884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1a40ff700 0x7fb1a4101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.534+0000 7fb1aae79640 1 --2- 172.21.15.119:0/3164365884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a4065bc0 0x7fb1a40ff1c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.534+0000 7fb1aae79640 1 -- 172.21.15.119:0/3164365884 >> 172.21.15.119:0/3164365884 conn(0x7fb1a40f6c10 msgr2=0x7fb1a40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.535+0000 7fb1aae79640 1 -- 172.21.15.119:0/3164365884 shutdown_connections 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.535+0000 7fb1aae79640 1 -- 172.21.15.119:0/3164365884 wait complete. 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.535+0000 7fb1aae79640 1 Processor -- start 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.535+0000 7fb1aae79640 1 -- start start 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.535+0000 7fb1aae79640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a4065bc0 0x7fb1a410d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.535+0000 7fb1aae79640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1a40ff700 0x7fb1a410d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.535+0000 7fb1aae79640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a410dc80 con 0x7fb1a4065bc0 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.535+0000 7fb1aae79640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a410e450 con 0x7fb1a40ff700 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1a8c15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a4065bc0 0x7fb1a410d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:25.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1a8c15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a4065bc0 0x7fb1a410d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53524/0 (socket says 172.21.15.119:53524) 2024-09-13T21:46:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1a8c15640 1 -- 172.21.15.119:0/2123241375 learned_addr learned my addr 172.21.15.119:0/2123241375 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1a3fff640 1 --2- 172.21.15.119:0/2123241375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1a40ff700 0x7fb1a410d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1a8c15640 1 -- 172.21.15.119:0/2123241375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1a40ff700 msgr2=0x7fb1a410d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1a8c15640 1 --2- 172.21.15.119:0/2123241375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1a40ff700 0x7fb1a410d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1a8c15640 1 -- 172.21.15.119:0/2123241375 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb194005040 con 0x7fb1a4065bc0 2024-09-13T21:46:25.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1a8c15640 1 --2- 172.21.15.119:0/2123241375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a4065bc0 0x7fb1a410d0f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb1940048a0 tx=0x7fb194009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:25.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1a17fa640 1 -- 172.21.15.119:0/2123241375 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb194038070 con 0x7fb1a4065bc0 2024-09-13T21:46:25.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1aae79640 1 -- 172.21.15.119:0/2123241375 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a410e680 con 0x7fb1a4065bc0 2024-09-13T21:46:25.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1a17fa640 1 -- 172.21.15.119:0/2123241375 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb19402abd0 con 0x7fb1a4065bc0 2024-09-13T21:46:25.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1a17fa640 1 -- 172.21.15.119:0/2123241375 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb194033640 con 0x7fb1a4065bc0 2024-09-13T21:46:25.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.536+0000 7fb1aae79640 1 -- 172.21.15.119:0/2123241375 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a410ec20 con 0x7fb1a4065bc0 2024-09-13T21:46:25.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.537+0000 7fb1aae79640 1 -- 172.21.15.119:0/2123241375 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a40fa890 con 0x7fb1a4065bc0 2024-09-13T21:46:25.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.538+0000 7fb1a17fa640 1 -- 172.21.15.119:0/2123241375 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fb194030020 con 0x7fb1a4065bc0 2024-09-13T21:46:25.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.538+0000 7fb1a17fa640 1 --2- 172.21.15.119:0/2123241375 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fb18c06df60 0x7fb18c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:25.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.539+0000 7fb1a17fa640 1 -- 172.21.15.119:0/2123241375 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fb1940adc40 con 0x7fb1a4065bc0 2024-09-13T21:46:25.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.539+0000 7fb1a3fff640 1 --2- 172.21.15.119:0/2123241375 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fb18c06df60 0x7fb18c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:25.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.539+0000 7fb1a3fff640 1 --2- 172.21.15.119:0/2123241375 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fb18c06df60 0x7fb18c070410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb1a410cea0 tx=0x7fb198009040 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:25.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.543+0000 7fb1a17fa640 1 -- 172.21.15.119:0/2123241375 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb194077570 con 0x7fb1a4065bc0 2024-09-13T21:46:25.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.738+0000 7fb1aae79640 1 -- 172.21.15.119:0/2123241375 --> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1a410ee90 con 0x7fb18c06df60 2024-09-13T21:46:25.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.739+0000 7fb1a17fa640 1 -- 172.21.15.119:0/2123241375 <== mgr.14734 v2:172.21.15.119:6800/4086293592 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fb1a410ee90 con 0x7fb18c06df60 2024-09-13T21:46:25.741 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:46:25.741 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:46:25.741 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:46:25.741 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:46:25.741 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:46:25.741 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr" 2024-09-13T21:46:25.741 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:46:25.741 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "2/21 daemons upgraded", 2024-09-13T21:46:25.741 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "", 2024-09-13T21:46:25.741 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:46:25.742 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:46:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.741+0000 7fb1aae79640 1 -- 172.21.15.119:0/2123241375 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fb18c06df60 msgr2=0x7fb18c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.741+0000 7fb1aae79640 1 --2- 172.21.15.119:0/2123241375 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fb18c06df60 0x7fb18c070410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb1a410cea0 tx=0x7fb198009040 comp rx=0 tx=0).stop 2024-09-13T21:46:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.741+0000 7fb1aae79640 1 -- 172.21.15.119:0/2123241375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a4065bc0 msgr2=0x7fb1a410d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.741+0000 7fb1aae79640 1 --2- 172.21.15.119:0/2123241375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a4065bc0 0x7fb1a410d0f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb1940048a0 tx=0x7fb194009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.741+0000 7fb1aae79640 1 -- 172.21.15.119:0/2123241375 shutdown_connections 2024-09-13T21:46:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.741+0000 7fb1aae79640 1 --2- 172.21.15.119:0/2123241375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1a40ff700 0x7fb1a410d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.741+0000 7fb1aae79640 1 --2- 172.21.15.119:0/2123241375 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fb18c06df60 0x7fb18c070410 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.741+0000 7fb1aae79640 1 --2- 172.21.15.119:0/2123241375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1a4065bc0 0x7fb1a410d0f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.741+0000 7fb1aae79640 1 -- 172.21.15.119:0/2123241375 >> 172.21.15.119:0/2123241375 conn(0x7fb1a40f6c10 msgr2=0x7fb1a40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.741+0000 7fb1aae79640 1 -- 172.21.15.119:0/2123241375 shutdown_connections 2024-09-13T21:46:25.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.741+0000 7fb1aae79640 1 -- 172.21.15.119:0/2123241375 wait complete. 2024-09-13T21:46:25.815 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:25 smithi119 ceph-mon[27653]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:25.815 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:25 smithi119 ceph-mon[27653]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:25.815 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:25 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3506895280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:25.815 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:25 smithi119 ceph-mon[27653]: pgmap v9: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T21:46:25.815 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:25 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/646275291' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:46:25.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.819+0000 7fd457544640 1 -- 172.21.15.119:0/1433550601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fb430 msgr2=0x7fd4500fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.819+0000 7fd457544640 1 --2- 172.21.15.119:0/1433550601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fb430 0x7fd4500fb840 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd4480048d0 tx=0x7fd448009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 -- 172.21.15.119:0/1433550601 shutdown_connections 2024-09-13T21:46:25.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 --2- 172.21.15.119:0/1433550601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fc700 0x7fd4500fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 --2- 172.21.15.119:0/1433550601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fb430 0x7fd4500fb840 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 -- 172.21.15.119:0/1433550601 >> 172.21.15.119:0/1433550601 conn(0x7fd4500f6c10 msgr2=0x7fd4500f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 -- 172.21.15.119:0/1433550601 shutdown_connections 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 -- 172.21.15.119:0/1433550601 wait complete. 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 Processor -- start 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 -- start start 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fb430 0x7fd45010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc700 0x7fd450112370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd450065cf0 con 0x7fd4500fc700 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd457544640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd450065e60 con 0x7fd4500fb430 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd454adf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc700 0x7fd450112370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:25.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd454adf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc700 0x7fd450112370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53536/0 (socket says 172.21.15.119:53536) 2024-09-13T21:46:25.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.820+0000 7fd454adf640 1 -- 172.21.15.119:0/3140160698 learned_addr learned my addr 172.21.15.119:0/3140160698 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:25.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.821+0000 7fd4552e0640 1 --2- 172.21.15.119:0/3140160698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fb430 0x7fd45010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:25.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.821+0000 7fd454adf640 1 -- 172.21.15.119:0/3140160698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fb430 msgr2=0x7fd45010fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:25.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.821+0000 7fd454adf640 1 --2- 172.21.15.119:0/3140160698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fb430 0x7fd45010fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:25.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.821+0000 7fd454adf640 1 -- 172.21.15.119:0/3140160698 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd448005040 con 0x7fd4500fc700 2024-09-13T21:46:25.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.821+0000 7fd454adf640 1 --2- 172.21.15.119:0/3140160698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc700 0x7fd450112370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd44000b790 tx=0x7fd4400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:25.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.821+0000 7fd445ffb640 1 -- 172.21.15.119:0/3140160698 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd44000c700 con 0x7fd4500fc700 2024-09-13T21:46:25.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.821+0000 7fd445ffb640 1 -- 172.21.15.119:0/3140160698 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd44000cd00 con 0x7fd4500fc700 2024-09-13T21:46:25.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.821+0000 7fd457544640 1 -- 172.21.15.119:0/3140160698 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd450112970 con 0x7fd4500fc700 2024-09-13T21:46:25.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.821+0000 7fd445ffb640 1 -- 172.21.15.119:0/3140160698 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd440015e70 con 0x7fd4500fc700 2024-09-13T21:46:25.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.821+0000 7fd457544640 1 -- 172.21.15.119:0/3140160698 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd450112e90 con 0x7fd4500fc700 2024-09-13T21:46:25.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.822+0000 7fd457544640 1 -- 172.21.15.119:0/3140160698 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4500fa890 con 0x7fd4500fc700 2024-09-13T21:46:25.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.823+0000 7fd445ffb640 1 -- 172.21.15.119:0/3140160698 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fd440012070 con 0x7fd4500fc700 2024-09-13T21:46:25.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.823+0000 7fd445ffb640 1 --2- 172.21.15.119:0/3140160698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fd43c06df60 0x7fd43c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:25.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.823+0000 7fd445ffb640 1 -- 172.21.15.119:0/3140160698 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd44008d490 con 0x7fd4500fc700 2024-09-13T21:46:25.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.823+0000 7fd4552e0640 1 --2- 172.21.15.119:0/3140160698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fd43c06df60 0x7fd43c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:25.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.824+0000 7fd4552e0640 1 --2- 172.21.15.119:0/3140160698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fd43c06df60 0x7fd43c070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd448007ac0 tx=0x7fd448035040 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:25.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:25.827+0000 7fd445ffb640 1 -- 172.21.15.119:0/3140160698 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd440056d90 con 0x7fd4500fc700 2024-09-13T21:46:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:25 smithi155 ceph-mon[34732]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:25 smithi155 ceph-mon[34732]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:25 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3506895280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:25 smithi155 ceph-mon[34732]: pgmap v9: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T21:46:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:25 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/646275291' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:46:26.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.060+0000 7fd457544640 1 -- 172.21.15.119:0/3140160698 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd45004b720 con 0x7fd4500fc700 2024-09-13T21:46:26.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.060+0000 7fd445ffb640 1 -- 172.21.15.119:0/3140160698 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd44005a450 con 0x7fd4500fc700 2024-09-13T21:46:26.062 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:46:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.062+0000 7fd457544640 1 -- 172.21.15.119:0/3140160698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fd43c06df60 msgr2=0x7fd43c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.062+0000 7fd457544640 1 --2- 172.21.15.119:0/3140160698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fd43c06df60 0x7fd43c070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd448007ac0 tx=0x7fd448035040 comp rx=0 tx=0).stop 2024-09-13T21:46:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.062+0000 7fd457544640 1 -- 172.21.15.119:0/3140160698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc700 msgr2=0x7fd450112370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.062+0000 7fd457544640 1 --2- 172.21.15.119:0/3140160698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc700 0x7fd450112370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd44000b790 tx=0x7fd4400091d0 comp rx=0 tx=0).stop 2024-09-13T21:46:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.062+0000 7fd457544640 1 -- 172.21.15.119:0/3140160698 shutdown_connections 2024-09-13T21:46:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.062+0000 7fd457544640 1 --2- 172.21.15.119:0/3140160698 >> [v2:172.21.15.119:6800/4086293592,v1:172.21.15.119:6801/4086293592] conn(0x7fd43c06df60 0x7fd43c070410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:26.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.062+0000 7fd457544640 1 --2- 172.21.15.119:0/3140160698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc700 0x7fd450112370 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:26.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.062+0000 7fd457544640 1 --2- 172.21.15.119:0/3140160698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fb430 0x7fd45010fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:26.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.062+0000 7fd457544640 1 -- 172.21.15.119:0/3140160698 >> 172.21.15.119:0/3140160698 conn(0x7fd4500f6c10 msgr2=0x7fd4500f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:26.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.062+0000 7fd457544640 1 -- 172.21.15.119:0/3140160698 shutdown_connections 2024-09-13T21:46:26.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:26.062+0000 7fd457544640 1 -- 172.21.15.119:0/3140160698 wait complete. 2024-09-13T21:46:27.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:26 smithi155 ceph-mon[34732]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:27.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:26 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3140160698' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:46:27.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:26 smithi119 ceph-mon[27653]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:27.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:26 smithi119 ceph-mon[27653]: from='client.? 172.21.15.119:0/3140160698' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:46:27.977 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:27 smithi119 ceph-mon[27653]: pgmap v10: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:46:28.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:27 smithi155 ceph-mon[34732]: pgmap v10: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:46:29.039 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:28 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:29.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:28 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:30.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:30 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:30.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:30 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:30.578 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:30 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:46:30.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:30 smithi155 ceph-mon[34732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:46:30.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:30 smithi155 ceph-mon[34732]: pgmap v11: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:46:30.579 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:30 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:30 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:30 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:30 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:46:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:30 smithi119 ceph-mon[27653]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T21:46:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:30 smithi119 ceph-mon[27653]: pgmap v11: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:46:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:30 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:31.273 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:31 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.wuuxfd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:46:31.273 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:31 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:46:31.273 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:31 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:31.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:31 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.wuuxfd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:46:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:31 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:46:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:31 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:32.208 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:32 smithi155 ceph-mon[34732]: Upgrade: Updating mgr.smithi155.wuuxfd 2024-09-13T21:46:32.208 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:32 smithi155 ceph-mon[34732]: Deploying daemon mgr.smithi155.wuuxfd on smithi155 2024-09-13T21:46:32.208 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:32 smithi155 ceph-mon[34732]: pgmap v12: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:46:32.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:32 smithi119 ceph-mon[27653]: Upgrade: Updating mgr.smithi155.wuuxfd 2024-09-13T21:46:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:32 smithi119 ceph-mon[27653]: Deploying daemon mgr.smithi155.wuuxfd on smithi155 2024-09-13T21:46:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:32 smithi119 ceph-mon[27653]: pgmap v12: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:46:34.287 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:34 smithi155 ceph-mon[34732]: pgmap v13: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:34.287 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:34 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:34.287 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:34 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:34.287 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:34 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:34.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:34 smithi119 ceph-mon[27653]: pgmap v13: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:34.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:34 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:34.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:34 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:34.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:34 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:35.370 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:35 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:35.370 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:35 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:35.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:35 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:35.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:35 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:36.466 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:36 smithi155 ceph-mon[34732]: pgmap v14: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:36 smithi119 ceph-mon[27653]: pgmap v14: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:38.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:37 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:38.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:37 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:38.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:37 smithi119 ceph-mon[27653]: pgmap v15: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:38.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:37 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:38.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:37 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:38.158 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:37 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:38.158 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:37 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:38.159 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:37 smithi155 ceph-mon[34732]: pgmap v15: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:38.159 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:37 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:38.159 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:37 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:39.238 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:39 smithi155 ceph-mon[34732]: Standby manager daemon smithi155.wuuxfd restarted 2024-09-13T21:46:39.238 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:39 smithi155 ceph-mon[34732]: Standby manager daemon smithi155.wuuxfd started 2024-09-13T21:46:39.238 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:39 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/3857923032' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/crt"}]: dispatch 2024-09-13T21:46:39.238 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:39 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/3857923032' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:46:39.238 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:39 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/3857923032' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/key"}]: dispatch 2024-09-13T21:46:39.238 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:39 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/3857923032' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:46:39.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:39 smithi119 ceph-mon[27653]: Standby manager daemon smithi155.wuuxfd restarted 2024-09-13T21:46:39.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:39 smithi119 ceph-mon[27653]: Standby manager daemon smithi155.wuuxfd started 2024-09-13T21:46:39.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:39 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/3857923032' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/crt"}]: dispatch 2024-09-13T21:46:39.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:39 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/3857923032' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:46:39.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:39 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/3857923032' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/key"}]: dispatch 2024-09-13T21:46:39.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:39 smithi119 ceph-mon[27653]: from='mgr.? 172.21.15.155:0/3857923032' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:46:40.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:40 smithi155 ceph-mon[34732]: mgrmap e32: smithi119.gwjxmq(active, since 25s), standbys: smithi155.wuuxfd 2024-09-13T21:46:40.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:40 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:40.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:40 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:40.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:40 smithi155 ceph-mon[34732]: pgmap v16: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:40.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:40 smithi119 ceph-mon[27653]: mgrmap e32: smithi119.gwjxmq(active, since 25s), standbys: smithi155.wuuxfd 2024-09-13T21:46:40.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:40 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:40.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:40 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:40.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:40 smithi119 ceph-mon[27653]: pgmap v16: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:41.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:41.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:41.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:41.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:46:41.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:41.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:41.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:41.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: Upgrade: Setting container_image for all mgr 2024-09-13T21:46:41.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:41.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi119.gwjxmq"}]: dispatch 2024-09-13T21:46:41.882 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi119.gwjxmq"}]': finished 2024-09-13T21:46:41.882 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi155.wuuxfd"}]: dispatch 2024-09-13T21:46:41.882 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi155.wuuxfd"}]': finished 2024-09-13T21:46:41.882 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T21:46:41.882 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:41 smithi119 ceph-mon[27653]: pgmap v17: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:42.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: Upgrade: Setting container_image for all mgr 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi119.gwjxmq"}]: dispatch 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi119.gwjxmq"}]': finished 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi155.wuuxfd"}]: dispatch 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi155.wuuxfd"}]': finished 2024-09-13T21:46:42.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T21:46:42.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:41 smithi155 ceph-mon[34732]: pgmap v17: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:43 smithi155 ceph-mon[34732]: Upgrade: Updating mon.smithi119 2024-09-13T21:46:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:43 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:43 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:46:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:43 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:46:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:43 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:43 smithi155 ceph-mon[34732]: Deploying daemon mon.smithi119 on smithi119 2024-09-13T21:46:43.624 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:43 smithi119 ceph-mon[27653]: Upgrade: Updating mon.smithi119 2024-09-13T21:46:43.624 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:43 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:43.625 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:43 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:46:43.625 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:43 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:46:43.625 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:43 smithi119 ceph-mon[27653]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:43.625 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:43 smithi119 ceph-mon[27653]: Deploying daemon mon.smithi119 on smithi119 2024-09-13T21:46:44.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:43 smithi119 systemd[1]: Stopping Ceph mon.smithi119 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:46:44.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:44 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119[27649]: 2024-09-13T21:46:44.144+0000 7f92b71b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi119 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:46:44.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:44 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119[27649]: 2024-09-13T21:46:44.144+0000 7f92b71b8640 -1 mon.smithi119@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T21:46:44.454 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:44 smithi119 podman[90729]: 2024-09-13 21:46:44.208058508 +0000 UTC m=+0.167143487 container died f49a62e4f3c30ef7eea1df23c2761db1daf21670d4f5d316030b337502247373 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-eb16b97, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:46:44.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:44 smithi119 podman[90729]: 2024-09-13 21:46:44.578132467 +0000 UTC m=+0.537217442 container cleanup f49a62e4f3c30ef7eea1df23c2761db1daf21670d4f5d316030b337502247373 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=quincy-eb16b97) 2024-09-13T21:46:44.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:44 smithi119 bash[90729]: ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119 2024-09-13T21:46:45.347 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 podman[90741]: 2024-09-13 21:46:45.00509344 +0000 UTC m=+0.797519916 container remove f49a62e4f3c30ef7eea1df23c2761db1daf21670d4f5d316030b337502247373 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-eb16b97, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True) 2024-09-13T21:46:45.347 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi119.service: Deactivated successfully. 2024-09-13T21:46:45.347 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 systemd[1]: Stopped Ceph mon.smithi119 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:46:45.348 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi119.service: Consumed 10.222s CPU time. 2024-09-13T21:46:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 systemd[1]: Starting Ceph mon.smithi119 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:46:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 podman[90877]: 2024-09-13 21:46:45.455087455 +0000 UTC m=+0.015717760 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:46:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 podman[90877]: 2024-09-13 21:46:45.555758564 +0000 UTC m=+0.116388868 container create a7778435eff6df31ca6db10d7c2ccd2e380dcaa08fa6a5a2f0ffd0181d194531 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T21:46:46.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 podman[90877]: 2024-09-13 21:46:45.808435688 +0000 UTC m=+0.369065990 container init a7778435eff6df31ca6db10d7c2ccd2e380dcaa08fa6a5a2f0ffd0181d194531 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T21:46:46.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 podman[90877]: 2024-09-13 21:46:45.811706563 +0000 UTC m=+0.372336866 container start a7778435eff6df31ca6db10d7c2ccd2e380dcaa08fa6a5a2f0ffd0181d194531 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T21:46:46.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T21:46:46.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 2 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: pidfile_write: ignore empty --pid-file 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: load: jerasure load: lrc 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: RocksDB version: 7.9.2 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Git sha 0 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: DB SUMMARY 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: DB Session ID: M7NQ99NUW19BVIWKPD4A 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: CURRENT file: CURRENT 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: MANIFEST file: MANIFEST-000015 size: 971 Bytes 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi119/store.db dir, Total Num: 1, files: 000030.sst 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi119/store.db: 000028.log size: 2323748 ; 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.error_if_exists: 0 2024-09-13T21:46:46.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.create_if_missing: 0 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.paranoid_checks: 1 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.env: 0x5578eb1ed940 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.info_log: 0x5578ec1c18c0 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.statistics: (nil) 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.use_fsync: 0 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_log_file_size: 0 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T21:46:46.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.allow_fallocate: 1 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.use_direct_reads: 0 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.db_log_dir: 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.wal_dir: 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T21:46:46.133 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.write_buffer_manager: 0x5578ec1d0dc0 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.unordered_write: 0 2024-09-13T21:46:46.134 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T21:46:46.135 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T21:46:46.135 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T21:46:46.135 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T21:46:46.135 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.row_cache: None 2024-09-13T21:46:46.135 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.wal_filter: None 2024-09-13T21:46:46.136 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T21:46:46.136 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T21:46:46.136 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.two_write_queues: 0 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.wal_compression: 0 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.atomic_flush: 0 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.log_readahead_size: 0 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T21:46:46.137 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T21:46:46.138 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_background_jobs: 2 2024-09-13T21:46:46.138 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_background_compactions: -1 2024-09-13T21:46:46.138 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_subcompactions: 1 2024-09-13T21:46:46.138 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T21:46:46.138 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T21:46:46.138 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T21:46:46.138 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T21:46:46.138 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T21:46:46.138 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T21:46:46.138 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_open_files: -1 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_background_flushes: -1 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Compression algorithms supported: 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: kZSTD supported: 0 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: kXpressCompression supported: 0 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: kBZip2Compression supported: 0 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: kLZ4Compression supported: 1 2024-09-13T21:46:46.139 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: kZlibCompression supported: 1 2024-09-13T21:46:46.140 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T21:46:46.140 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: kSnappyCompression supported: 1 2024-09-13T21:46:46.140 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T21:46:46.140 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T21:46:46.140 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi119/store.db/MANIFEST-000015 2024-09-13T21:46:46.140 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T21:46:46.140 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T21:46:46.140 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.merge_operator: 2024-09-13T21:46:46.140 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_filter: None 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5578ec1c1520) 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: cache_index_and_filter_blocks: 1 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: pin_top_level_index_and_filter: 1 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_type: 0 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: data_block_index_type: 0 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_shortening: 1 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T21:46:46.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: checksum: 4 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: no_block_cache: 0 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache: 0x5578ec1b51f0 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_name: BinnedLRUCache 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_options: 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: capacity : 536870912 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: num_shard_bits : 4 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: strict_capacity_limit : 0 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: high_pri_pool_ratio: 0.000 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_compressed: (nil) 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: persistent_cache: (nil) 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_size: 4096 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_size_deviation: 10 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_restart_interval: 16 2024-09-13T21:46:46.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_block_restart_interval: 1 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: metadata_block_size: 4096 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: partition_filters: 0 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: use_delta_encoding: 1 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: filter_policy: bloomfilter 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: whole_key_filtering: 1 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: verify_compression: 0 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: read_amp_bytes_per_bit: 0 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: format_version: 5 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: enable_index_compression: 1 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_align: 0 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: max_auto_readahead_size: 262144 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: prepopulate_block_cache: 0 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: initial_auto_readahead_size: 8192 2024-09-13T21:46:46.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compression: NoCompression 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.num_levels: 7 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T21:46:46.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T21:46:46.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T21:46:46.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T21:46:46.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.inplace_update_support: 0 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.bloom_locality: 0 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.max_successive_merges: 0 2024-09-13T21:46:46.148 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.ttl: 2592000 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.enable_blob_files: false 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.min_blob_size: 0 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T21:46:46.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi119/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10362, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 99aa5b0a-b55a-4a01-a665-bf5ed5e49057 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264005837931, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264005844466, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 2115148, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10363, "largest_seqno": 11199, "table_properties": {"data_size": 2110458, "index_size": 2622, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1029, "raw_key_size": 9148, "raw_average_key_size": 23, "raw_value_size": 2101975, "raw_average_value_size": 5389, "num_data_blocks": 120, "num_entries": 390, "num_filter_entries": 390, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726264005, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "99aa5b0a-b55a-4a01-a665-bf5ed5e49057", "db_session_id": "M7NQ99NUW19BVIWKPD4A", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264005844556, "job": 1, "event": "recovery_finished"} 2024-09-13T21:46:46.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi119/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5578ec1e2e00 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: DB pointer 0x5578ec2de000 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** DB Stats ** 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T21:46:46.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: L0 1/0 2.02 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.2 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: L6 1/0 5.37 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Sum 2/0 7.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.2 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 609.2 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 609.2 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T21:46:46.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative compaction: 0.00 GB write, 188.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval compaction: 0.00 GB write, 188.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Block cache BinnedLRUCache@0x5578ec1b51f0#2 capacity: 512.00 MB usage: 3.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-13T21:46:46.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.16 KB,0.000220537%) IndexBlock(1,2.83 KB,0.000539422%) Misc(1,0.00 KB,0%) 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: starting mon.smithi119 rank 0 at public addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] at bind addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi119 fsid f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: mon.smithi119@-1(???) e2 preinit fsid f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: mon.smithi119@-1(???).mds e20 new map 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: mon.smithi119@-1(???).mds e20 print_map 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: e20 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: legacy client fscid: 1 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Filesystem 'cephfs' (1) 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: fs_name cephfs 2024-09-13T21:46:46.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: epoch 20 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: modified 2024-09-13T21:45:37.594101+0000 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: tableserver 0 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: root 0 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: session_timeout 60 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: session_autoclose 300 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: max_file_size 1099511627776 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: max_xattr_size 65536 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: required_client_features {} 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: last_failure 0 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: last_failure_osd_epoch 44 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: max_mds 2 2024-09-13T21:46:46.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: in 0,1 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: up {0=14472,1=24267} 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: failed 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: damaged 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: stopped 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: data_pools [3] 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: metadata_pool 2 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: inline_data disabled 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: balancer 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: bal_rank_mask -1 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: standby_count_wanted 1 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: qdb_cluster leader: 0 members: 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: [mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:46.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: [mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Standby daemons: 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: [mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: [mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: mon.smithi119@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: mon.smithi119@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: mon.smithi119@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: mon.smithi119@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 ceph-mon[90896]: mon.smithi119@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 bash[90877]: a7778435eff6df31ca6db10d7c2ccd2e380dcaa08fa6a5a2f0ffd0181d194531 2024-09-13T21:46:46.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:45 smithi119 systemd[1]: Started Ceph mon.smithi119 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:46:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:46:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:46:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: pgmap v19: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: mon.smithi119 calling monitor election 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: mon.smithi119 is new leader, mons smithi119,smithi155 in quorum (ranks 0,1) 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: monmap epoch 2 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: fsid f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: last_changed 2024-09-13T21:37:53.720836+0000 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: created 2024-09-13T21:35:37.219093+0000 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: min_mon_release 17 (quincy) 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: election_strategy: 1 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: 0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.smithi119 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: 1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.smithi155 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: mgrmap e32: smithi119.gwjxmq(active, since 34s), standbys: smithi155.wuuxfd 2024-09-13T21:46:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: overall HEALTH_OK 2024-09-13T21:46:47.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: from='mgr.14734 ' entity='' 2024-09-13T21:46:47.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:47 smithi155 ceph-mon[34732]: mgrmap e33: smithi119.gwjxmq(active, since 34s), standbys: smithi155.wuuxfd 2024-09-13T21:46:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:46:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: from='mgr.14734 172.21.15.119:0/3633252918' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:46:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: pgmap v19: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: mon.smithi119 calling monitor election 2024-09-13T21:46:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: mon.smithi119 is new leader, mons smithi119,smithi155 in quorum (ranks 0,1) 2024-09-13T21:46:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: monmap epoch 2 2024-09-13T21:46:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: fsid f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:46:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: last_changed 2024-09-13T21:37:53.720836+0000 2024-09-13T21:46:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: created 2024-09-13T21:35:37.219093+0000 2024-09-13T21:46:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: min_mon_release 17 (quincy) 2024-09-13T21:46:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: election_strategy: 1 2024-09-13T21:46:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: 0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.smithi119 2024-09-13T21:46:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: 1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.smithi155 2024-09-13T21:46:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:46:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T21:46:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: mgrmap e32: smithi119.gwjxmq(active, since 34s), standbys: smithi155.wuuxfd 2024-09-13T21:46:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: overall HEALTH_OK 2024-09-13T21:46:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: from='mgr.14734 ' entity='' 2024-09-13T21:46:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:47 smithi119 ceph-mon[90896]: mgrmap e33: smithi119.gwjxmq(active, since 34s), standbys: smithi155.wuuxfd 2024-09-13T21:46:52.349 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: Active manager daemon smithi119.gwjxmq restarted 2024-09-13T21:46:52.349 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: Activating manager daemon smithi119.gwjxmq 2024-09-13T21:46:52.349 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T21:46:52.349 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: Standby manager daemon smithi155.wuuxfd restarted 2024-09-13T21:46:52.349 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: Standby manager daemon smithi155.wuuxfd started 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: mgrmap e34: smithi119.gwjxmq(active, starting, since 0.00689172s), standbys: smithi155.wuuxfd 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.? 172.21.15.155:0/271200474' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/crt"}]: dispatch 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.? 172.21.15.155:0/271200474' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi119.gwjxmq", "id": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi155.wuuxfd", "id": "smithi155.wuuxfd"}]: dispatch 2024-09-13T21:46:52.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.? 172.21.15.155:0/271200474' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/key"}]: dispatch 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.? 172.21.15.155:0/271200474' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: Manager daemon smithi119.gwjxmq is now available 2024-09-13T21:46:52.351 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:52.378 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: Active manager daemon smithi119.gwjxmq restarted 2024-09-13T21:46:52.378 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: Activating manager daemon smithi119.gwjxmq 2024-09-13T21:46:52.378 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T21:46:52.378 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: Standby manager daemon smithi155.wuuxfd restarted 2024-09-13T21:46:52.378 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: Standby manager daemon smithi155.wuuxfd started 2024-09-13T21:46:52.378 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: mgrmap e34: smithi119.gwjxmq(active, starting, since 0.00689172s), standbys: smithi155.wuuxfd 2024-09-13T21:46:52.378 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/271200474' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/crt"}]: dispatch 2024-09-13T21:46:52.378 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/271200474' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi119.gwjxmq", "id": "smithi119.gwjxmq"}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr metadata", "who": "smithi155.wuuxfd", "id": "smithi155.wuuxfd"}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/271200474' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi155.wuuxfd/key"}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:46:52.379 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:46:52.380 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:46:52.380 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.? 172.21.15.155:0/271200474' entity='mgr.smithi155.wuuxfd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T21:46:52.380 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T21:46:52.380 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T21:46:52.380 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T21:46:52.380 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: Manager daemon smithi119.gwjxmq is now available 2024-09-13T21:46:52.380 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:52 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:46:53.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:53.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:46:53.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:53 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:46:53.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/trash_purge_schedule"}]: dispatch 2024-09-13T21:46:53.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:53 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/trash_purge_schedule"}]: dispatch 2024-09-13T21:46:53.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:53 smithi119 ceph-mon[90896]: mgrmap e35: smithi119.gwjxmq(active, since 1.00865s), standbys: smithi155.wuuxfd 2024-09-13T21:46:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:53 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:46:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:53 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:46:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:53 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T21:46:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:53 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/trash_purge_schedule"}]: dispatch 2024-09-13T21:46:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:53 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.gwjxmq/trash_purge_schedule"}]: dispatch 2024-09-13T21:46:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:53 smithi155 ceph-mon[34732]: mgrmap e35: smithi119.gwjxmq(active, since 1.00865s), standbys: smithi155.wuuxfd 2024-09-13T21:46:54.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:54 smithi155 ceph-mon[34732]: [13/Sep/2024:21:46:53] ENGINE Bus STARTING 2024-09-13T21:46:54.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:54 smithi155 ceph-mon[34732]: [13/Sep/2024:21:46:53] ENGINE Serving on https://172.21.15.119:7150 2024-09-13T21:46:54.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:54 smithi155 ceph-mon[34732]: [13/Sep/2024:21:46:53] ENGINE Error in HTTPServer.serve 2024-09-13T21:46:54.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Traceback (most recent call last): 2024-09-13T21:46:54.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:46:54.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:46:54.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self._run(expiration_interval) 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: s = self.context.wrap_socket( 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: return self.sslsocket_class._create( 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self.do_handshake() 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: self._sslobj.do_handshake() 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:46:54.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:54 smithi155 ceph-mon[34732]: [13/Sep/2024:21:46:53] ENGINE Serving on http://172.21.15.119:8765 2024-09-13T21:46:54.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:54 smithi155 ceph-mon[34732]: [13/Sep/2024:21:46:53] ENGINE Bus STARTED 2024-09-13T21:46:54.455 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:54 smithi119 ceph-mon[90896]: [13/Sep/2024:21:46:53] ENGINE Bus STARTING 2024-09-13T21:46:54.455 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:54 smithi119 ceph-mon[90896]: [13/Sep/2024:21:46:53] ENGINE Serving on https://172.21.15.119:7150 2024-09-13T21:46:54.455 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:54 smithi119 ceph-mon[90896]: [13/Sep/2024:21:46:53] ENGINE Error in HTTPServer.serve 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Traceback (most recent call last): 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._connections.run(self.expiration_interval) 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._run(expiration_interval) 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: s = self.context.wrap_socket( 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T21:46:54.456 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: return self.sslsocket_class._create( 2024-09-13T21:46:54.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T21:46:54.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self.do_handshake() 2024-09-13T21:46:54.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T21:46:54.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: self._sslobj.do_handshake() 2024-09-13T21:46:54.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T21:46:54.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:54 smithi119 ceph-mon[90896]: [13/Sep/2024:21:46:53] ENGINE Serving on http://172.21.15.119:8765 2024-09-13T21:46:54.457 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:54 smithi119 ceph-mon[90896]: [13/Sep/2024:21:46:53] ENGINE Bus STARTED 2024-09-13T21:46:55.476 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:55 smithi119 ceph-mon[90896]: pgmap v4: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:55.476 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:55 smithi119 ceph-mon[90896]: mgrmap e36: smithi119.gwjxmq(active, since 2s), standbys: smithi155.wuuxfd 2024-09-13T21:46:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:55 smithi155 ceph-mon[34732]: pgmap v4: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:55 smithi155 ceph-mon[34732]: mgrmap e36: smithi119.gwjxmq(active, since 2s), standbys: smithi155.wuuxfd 2024-09-13T21:46:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.148+0000 7f9d10e4d640 1 -- 172.21.15.119:0/1947684872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d0c0fc700 msgr2=0x7f9d0c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.148+0000 7f9d10e4d640 1 --2- 172.21.15.119:0/1947684872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d0c0fc700 0x7f9d0c0fcb70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9d000048d0 tx=0x7f9d00009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.148+0000 7f9d10e4d640 1 -- 172.21.15.119:0/1947684872 shutdown_connections 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.148+0000 7f9d10e4d640 1 --2- 172.21.15.119:0/1947684872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d0c0fc700 0x7f9d0c0fcb70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.148+0000 7f9d10e4d640 1 --2- 172.21.15.119:0/1947684872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0c0fb430 0x7f9d0c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.148+0000 7f9d10e4d640 1 -- 172.21.15.119:0/1947684872 >> 172.21.15.119:0/1947684872 conn(0x7f9d0c0f6c10 msgr2=0x7f9d0c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.148+0000 7f9d10e4d640 1 -- 172.21.15.119:0/1947684872 shutdown_connections 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.148+0000 7f9d10e4d640 1 -- 172.21.15.119:0/1947684872 wait complete. 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.148+0000 7f9d10e4d640 1 Processor -- start 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d10e4d640 1 -- start start 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d10e4d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d0c0fb430 0x7f9d0c0ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d10e4d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0c0fc700 0x7f9d0c0fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d10e4d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0fdfd0 con 0x7f9d0c0fb430 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d10e4d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0fe110 con 0x7f9d0c0fc700 2024-09-13T21:46:56.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d0a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d0c0fb430 0x7f9d0c0ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d0a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d0c0fb430 0x7f9d0c0ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43294/0 (socket says 172.21.15.119:43294) 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d0a59c640 1 -- 172.21.15.119:0/3572290824 learned_addr learned my addr 172.21.15.119:0/3572290824 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d09d9b640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0c0fc700 0x7f9d0c0fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d0a59c640 1 -- 172.21.15.119:0/3572290824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0c0fc700 msgr2=0x7f9d0c0fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d0a59c640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0c0fc700 0x7f9d0c0fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d0a59c640 1 -- 172.21.15.119:0/3572290824 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d00005040 con 0x7f9d0c0fb430 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d09d9b640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0c0fc700 0x7f9d0c0fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.149+0000 7f9d0a59c640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d0c0fb430 0x7f9d0c0ff550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc002a80 tx=0x7f9cfc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.150+0000 7f9cfaffd640 1 -- 172.21.15.119:0/3572290824 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cfc007c30 con 0x7f9d0c0fb430 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.150+0000 7f9d10e4d640 1 -- 172.21.15.119:0/3572290824 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0c0fe3f0 con 0x7f9d0c0fb430 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.150+0000 7f9d10e4d640 1 -- 172.21.15.119:0/3572290824 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0c115080 con 0x7f9d0c0fb430 2024-09-13T21:46:56.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.150+0000 7f9cfaffd640 1 -- 172.21.15.119:0/3572290824 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9cfc00f040 con 0x7f9d0c0fb430 2024-09-13T21:46:56.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.150+0000 7f9cfaffd640 1 -- 172.21.15.119:0/3572290824 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cfc0095b0 con 0x7f9d0c0fb430 2024-09-13T21:46:56.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.151+0000 7f9d10e4d640 1 -- 172.21.15.119:0/3572290824 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec005240 con 0x7f9d0c0fb430 2024-09-13T21:46:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.151+0000 7f9cfaffd640 1 -- 172.21.15.119:0/3572290824 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 36) v1 ==== 92599+0+0 (secure 0 0 0) 0x7f9cfc009730 con 0x7f9d0c0fb430 2024-09-13T21:46:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.152+0000 7f9cfaffd640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9cf406e5c0 0x7f9cf4070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.152+0000 7f9cfaffd640 1 -- 172.21.15.119:0/3572290824 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9cfc08db90 con 0x7f9d0c0fb430 2024-09-13T21:46:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.152+0000 7f9d09d9b640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9cf406e5c0 0x7f9cf4070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:56.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.152+0000 7f9d09d9b640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9cf406e5c0 0x7f9cf4070a70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9d00000c00 tx=0x7f9d00035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:56.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.157+0000 7f9cfaffd640 1 -- 172.21.15.119:0/3572290824 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9cfc056c40 con 0x7f9d0c0fb430 2024-09-13T21:46:56.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.356+0000 7f9d10e4d640 1 -- 172.21.15.119:0/3572290824 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cec000bf0 con 0x7f9cf406e5c0 2024-09-13T21:46:56.358 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:56 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:56.358 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:56 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:56.358 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:56 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:56.358 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:56 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:56.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.358+0000 7f9cfaffd640 1 -- 172.21.15.119:0/3572290824 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f9cec000bf0 con 0x7f9cf406e5c0 2024-09-13T21:46:56.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.360+0000 7f9d10e4d640 1 -- 172.21.15.119:0/3572290824 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9cf406e5c0 msgr2=0x7f9cf4070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.360+0000 7f9d10e4d640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9cf406e5c0 0x7f9cf4070a70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9d00000c00 tx=0x7f9d00035040 comp rx=0 tx=0).stop 2024-09-13T21:46:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.360+0000 7f9d10e4d640 1 -- 172.21.15.119:0/3572290824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d0c0fb430 msgr2=0x7f9d0c0ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.360+0000 7f9d10e4d640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d0c0fb430 0x7f9d0c0ff550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc002a80 tx=0x7f9cfc004600 comp rx=0 tx=0).stop 2024-09-13T21:46:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.360+0000 7f9d10e4d640 1 -- 172.21.15.119:0/3572290824 shutdown_connections 2024-09-13T21:46:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.360+0000 7f9d10e4d640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9cf406e5c0 0x7f9cf4070a70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.360+0000 7f9d10e4d640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0c0fc700 0x7f9d0c0fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.360+0000 7f9d10e4d640 1 --2- 172.21.15.119:0/3572290824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d0c0fb430 0x7f9d0c0ff550 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.360+0000 7f9d10e4d640 1 -- 172.21.15.119:0/3572290824 >> 172.21.15.119:0/3572290824 conn(0x7f9d0c0f6c10 msgr2=0x7f9d0c0656b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.360+0000 7f9d10e4d640 1 -- 172.21.15.119:0/3572290824 shutdown_connections 2024-09-13T21:46:56.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.360+0000 7f9d10e4d640 1 -- 172.21.15.119:0/3572290824 wait complete. 2024-09-13T21:46:56.370 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:46:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.440+0000 7f4910176640 1 -- 172.21.15.119:0/271773944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080fabe0 msgr2=0x7f49080faff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.440+0000 7f4910176640 1 --2- 172.21.15.119:0/271773944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080fabe0 0x7f49080faff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0048d0 tx=0x7f48fc009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.440+0000 7f4910176640 1 -- 172.21.15.119:0/271773944 shutdown_connections 2024-09-13T21:46:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.440+0000 7f4910176640 1 --2- 172.21.15.119:0/271773944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49080fbeb0 0x7f49080fc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.440+0000 7f4910176640 1 --2- 172.21.15.119:0/271773944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080fabe0 0x7f49080faff0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.440+0000 7f4910176640 1 -- 172.21.15.119:0/271773944 >> 172.21.15.119:0/271773944 conn(0x7f49080f63a0 msgr2=0x7f49080f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.440+0000 7f4910176640 1 -- 172.21.15.119:0/271773944 shutdown_connections 2024-09-13T21:46:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.440+0000 7f4910176640 1 -- 172.21.15.119:0/271773944 wait complete. 2024-09-13T21:46:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.440+0000 7f4910176640 1 Processor -- start 2024-09-13T21:46:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f4910176640 1 -- start start 2024-09-13T21:46:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f4910176640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080fabe0 0x7f490810d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f4910176640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49080fbeb0 0x7f490810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f4910176640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490810dbf0 con 0x7f49080fabe0 2024-09-13T21:46:56.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f4910176640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490810e410 con 0x7f49080fbeb0 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f490df12640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080fabe0 0x7f490810d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f490df12640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080fabe0 0x7f490810d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43300/0 (socket says 172.21.15.119:43300) 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f490df12640 1 -- 172.21.15.119:0/399979750 learned_addr learned my addr 172.21.15.119:0/399979750 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f490d711640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49080fbeb0 0x7f490810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f490df12640 1 -- 172.21.15.119:0/399979750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49080fbeb0 msgr2=0x7f490810d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f490df12640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49080fbeb0 0x7f490810d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f490df12640 1 -- 172.21.15.119:0/399979750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc005040 con 0x7f49080fabe0 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f490d711640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49080fbeb0 0x7f490810d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f490df12640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080fabe0 0x7f490810d060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48fc003080 tx=0x7f48fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f48fa7fc640 1 -- 172.21.15.119:0/399979750 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48fc038070 con 0x7f49080fabe0 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f48fa7fc640 1 -- 172.21.15.119:0/399979750 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f48fc02abd0 con 0x7f49080fabe0 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.441+0000 7f4910176640 1 -- 172.21.15.119:0/399979750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490810e640 con 0x7f49080fabe0 2024-09-13T21:46:56.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.442+0000 7f48fa7fc640 1 -- 172.21.15.119:0/399979750 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48fc03e670 con 0x7f49080fabe0 2024-09-13T21:46:56.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.442+0000 7f4910176640 1 -- 172.21.15.119:0/399979750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490810ebe0 con 0x7f49080fabe0 2024-09-13T21:46:56.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.443+0000 7f4910176640 1 -- 172.21.15.119:0/399979750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49080fa040 con 0x7f49080fabe0 2024-09-13T21:46:56.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.443+0000 7f48fa7fc640 1 -- 172.21.15.119:0/399979750 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 36) v1 ==== 92599+0+0 (secure 0 0 0) 0x7f48fc030020 con 0x7f49080fabe0 2024-09-13T21:46:56.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.443+0000 7f48fa7fc640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48f406e5c0 0x7f48f4070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:56.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.443+0000 7f48fa7fc640 1 -- 172.21.15.119:0/399979750 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f48fc0ae570 con 0x7f49080fabe0 2024-09-13T21:46:56.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.443+0000 7f490d711640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48f406e5c0 0x7f48f4070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:56.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.444+0000 7f490d711640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48f406e5c0 0x7f48f4070a70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f490810ce10 tx=0x7f4904009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:56.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.448+0000 7f48fa7fc640 1 -- 172.21.15.119:0/399979750 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f48fc077680 con 0x7f49080fabe0 2024-09-13T21:46:56.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:56 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:56.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:56 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:56.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:56 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:56.505 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:56 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:56.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.647+0000 7f4910176640 1 -- 172.21.15.119:0/399979750 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f490810ef10 con 0x7f48f406e5c0 2024-09-13T21:46:56.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.648+0000 7f48fa7fc640 1 -- 172.21.15.119:0/399979750 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f490810ef10 con 0x7f48f406e5c0 2024-09-13T21:46:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.650+0000 7f4910176640 1 -- 172.21.15.119:0/399979750 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48f406e5c0 msgr2=0x7f48f4070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.650+0000 7f4910176640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48f406e5c0 0x7f48f4070a70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f490810ce10 tx=0x7f4904009040 comp rx=0 tx=0).stop 2024-09-13T21:46:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.650+0000 7f4910176640 1 -- 172.21.15.119:0/399979750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080fabe0 msgr2=0x7f490810d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.650+0000 7f4910176640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080fabe0 0x7f490810d060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48fc003080 tx=0x7f48fc009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.650+0000 7f4910176640 1 -- 172.21.15.119:0/399979750 shutdown_connections 2024-09-13T21:46:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.650+0000 7f4910176640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48f406e5c0 0x7f48f4070a70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.650+0000 7f4910176640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49080fbeb0 0x7f490810d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.650+0000 7f4910176640 1 --2- 172.21.15.119:0/399979750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080fabe0 0x7f490810d060 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.650+0000 7f4910176640 1 -- 172.21.15.119:0/399979750 >> 172.21.15.119:0/399979750 conn(0x7f49080f63a0 msgr2=0x7f49080f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:56.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.651+0000 7f4910176640 1 -- 172.21.15.119:0/399979750 shutdown_connections 2024-09-13T21:46:56.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.651+0000 7f4910176640 1 -- 172.21.15.119:0/399979750 wait complete. 2024-09-13T21:46:56.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.728+0000 7fb45c669640 1 -- 172.21.15.119:0/42816032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4540fd800 msgr2=0x7fb4540fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.728+0000 7fb45c669640 1 --2- 172.21.15.119:0/42816032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4540fd800 0x7fb4540fdc70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb4440048d0 tx=0x7fb444009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.728+0000 7fb45c669640 1 -- 172.21.15.119:0/42816032 shutdown_connections 2024-09-13T21:46:56.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.728+0000 7fb45c669640 1 --2- 172.21.15.119:0/42816032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4540fd800 0x7fb4540fdc70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.728+0000 7fb45c669640 1 --2- 172.21.15.119:0/42816032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4540fc530 0x7fb4540fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.728+0000 7fb45c669640 1 -- 172.21.15.119:0/42816032 >> 172.21.15.119:0/42816032 conn(0x7fb4540f7d10 msgr2=0x7fb4540fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb45c669640 1 -- 172.21.15.119:0/42816032 shutdown_connections 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb45c669640 1 -- 172.21.15.119:0/42816032 wait complete. 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb45c669640 1 Processor -- start 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb45c669640 1 -- start start 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb45c669640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4540fc530 0x7fb45410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb45c669640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4540fd800 0x7fb45410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb45c669640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45410dc30 con 0x7fb4540fd800 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb45c669640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45410e450 con 0x7fb4540fc530 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb459c04640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4540fd800 0x7fb45410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb459c04640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4540fd800 0x7fb45410d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43312/0 (socket says 172.21.15.119:43312) 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb459c04640 1 -- 172.21.15.119:0/289142633 learned_addr learned my addr 172.21.15.119:0/289142633 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.729+0000 7fb45a405640 1 --2- 172.21.15.119:0/289142633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4540fc530 0x7fb45410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.730+0000 7fb459c04640 1 -- 172.21.15.119:0/289142633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4540fc530 msgr2=0x7fb45410d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.730+0000 7fb459c04640 1 --2- 172.21.15.119:0/289142633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4540fc530 0x7fb45410d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.730+0000 7fb459c04640 1 -- 172.21.15.119:0/289142633 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb444005040 con 0x7fb4540fd800 2024-09-13T21:46:56.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.730+0000 7fb459c04640 1 --2- 172.21.15.119:0/289142633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4540fd800 0x7fb45410d5e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb4440043d0 tx=0x7fb444009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:56.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.730+0000 7fb44affd640 1 -- 172.21.15.119:0/289142633 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb444038070 con 0x7fb4540fd800 2024-09-13T21:46:56.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.730+0000 7fb44affd640 1 -- 172.21.15.119:0/289142633 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb44402ae90 con 0x7fb4540fd800 2024-09-13T21:46:56.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.730+0000 7fb45c669640 1 -- 172.21.15.119:0/289142633 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45410e680 con 0x7fb4540fd800 2024-09-13T21:46:56.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.730+0000 7fb44affd640 1 -- 172.21.15.119:0/289142633 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb44403e670 con 0x7fb4540fd800 2024-09-13T21:46:56.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.730+0000 7fb45c669640 1 -- 172.21.15.119:0/289142633 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45410ec20 con 0x7fb4540fd800 2024-09-13T21:46:56.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.731+0000 7fb45c669640 1 -- 172.21.15.119:0/289142633 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4540fb990 con 0x7fb4540fd800 2024-09-13T21:46:56.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.732+0000 7fb44affd640 1 -- 172.21.15.119:0/289142633 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 36) v1 ==== 92599+0+0 (secure 0 0 0) 0x7fb444030020 con 0x7fb4540fd800 2024-09-13T21:46:56.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.732+0000 7fb44affd640 1 --2- 172.21.15.119:0/289142633 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb44006e690 0x7fb440070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:56.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.732+0000 7fb44affd640 1 -- 172.21.15.119:0/289142633 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb4440ae210 con 0x7fb4540fd800 2024-09-13T21:46:56.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.732+0000 7fb45a405640 1 --2- 172.21.15.119:0/289142633 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb44006e690 0x7fb440070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:56.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.733+0000 7fb45a405640 1 --2- 172.21.15.119:0/289142633 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb44006e690 0x7fb440070b40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb450004ed0 tx=0x7fb45000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:56.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.737+0000 7fb44affd640 1 -- 172.21.15.119:0/289142633 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb4440774d0 con 0x7fb4540fd800 2024-09-13T21:46:56.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.818+0000 7fb44affd640 1 -- 172.21.15.119:0/289142633 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fb44402c3a0 con 0x7fb4540fd800 2024-09-13T21:46:56.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.926+0000 7fb45c669640 1 -- 172.21.15.119:0/289142633 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb45410ee90 con 0x7fb44006e690 2024-09-13T21:46:56.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.935+0000 7fb44affd640 1 -- 172.21.15.119:0/289142633 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb45410ee90 con 0x7fb44006e690 2024-09-13T21:46:56.937 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:46:56.937 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (86s) 17s ago 9m 16.9M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:46:56.937 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (10m) 17s ago 10m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 c6a79bd22109 2024-09-13T21:46:56.937 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (9m) 1s ago 9m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 1bccd1b9bda0 2024-09-13T21:46:56.937 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (74s) 17s ago 9m 82.3M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:46:56.937 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (4m) 17s ago 4m 12.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:46:56.937 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (4m) 17s ago 4m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:46:56.937 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (4m) 1s ago 4m 15.9M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (4m) 1s ago 4m 110M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (57s) 17s ago 11m 491M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (23s) 1s ago 9m 437M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (11m) 17s ago 11m 53.5M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 f49a62e4f3c3 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (9m) 1s ago 9m 47.2M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 66c9116315ae 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (101s) 17s ago 10m 8560k - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (65s) 1s ago 9m 8204k - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (8m) 17s ago 8m 213M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 6e0bbff1ac3f 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (7m) 17s ago 7m 233M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (7m) 17s ago 7m 192M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (7m) 1s ago 7m 265M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (6m) 1s ago 6m 228M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:46:56.938 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (6m) 1s ago 6m 226M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:46:56.939 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (28s) 17s ago 9m 46.2M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:46:56.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.937+0000 7fb45c669640 1 -- 172.21.15.119:0/289142633 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb44006e690 msgr2=0x7fb440070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.937+0000 7fb45c669640 1 --2- 172.21.15.119:0/289142633 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb44006e690 0x7fb440070b40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb450004ed0 tx=0x7fb45000b040 comp rx=0 tx=0).stop 2024-09-13T21:46:56.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.937+0000 7fb45c669640 1 -- 172.21.15.119:0/289142633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4540fd800 msgr2=0x7fb45410d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:56.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.937+0000 7fb45c669640 1 --2- 172.21.15.119:0/289142633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4540fd800 0x7fb45410d5e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb4440043d0 tx=0x7fb444009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.938+0000 7fb45c669640 1 -- 172.21.15.119:0/289142633 shutdown_connections 2024-09-13T21:46:56.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.938+0000 7fb45c669640 1 --2- 172.21.15.119:0/289142633 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb44006e690 0x7fb440070b40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.938+0000 7fb45c669640 1 --2- 172.21.15.119:0/289142633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4540fd800 0x7fb45410d5e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.938+0000 7fb45c669640 1 --2- 172.21.15.119:0/289142633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4540fc530 0x7fb45410d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:56.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.938+0000 7fb45c669640 1 -- 172.21.15.119:0/289142633 >> 172.21.15.119:0/289142633 conn(0x7fb4540f7d10 msgr2=0x7fb4540f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:56.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.938+0000 7fb45c669640 1 -- 172.21.15.119:0/289142633 shutdown_connections 2024-09-13T21:46:56.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:56.938+0000 7fb45c669640 1 -- 172.21.15.119:0/289142633 wait complete. 2024-09-13T21:46:57.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.016+0000 7f735b58e640 1 -- 172.21.15.119:0/3948267661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73540fd840 msgr2=0x7f73540fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.016+0000 7f735b58e640 1 --2- 172.21.15.119:0/3948267661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73540fd840 0x7f73540fdcb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f73480048d0 tx=0x7f7348009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.016+0000 7f735b58e640 1 -- 172.21.15.119:0/3948267661 shutdown_connections 2024-09-13T21:46:57.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.016+0000 7f735b58e640 1 --2- 172.21.15.119:0/3948267661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73540fd840 0x7f73540fdcb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.016+0000 7f735b58e640 1 --2- 172.21.15.119:0/3948267661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73540fc570 0x7f73540fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.016+0000 7f735b58e640 1 -- 172.21.15.119:0/3948267661 >> 172.21.15.119:0/3948267661 conn(0x7f73540f7d30 msgr2=0x7f73540fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:57.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.016+0000 7f735b58e640 1 -- 172.21.15.119:0/3948267661 shutdown_connections 2024-09-13T21:46:57.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.016+0000 7f735b58e640 1 -- 172.21.15.119:0/3948267661 wait complete. 2024-09-13T21:46:57.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735b58e640 1 Processor -- start 2024-09-13T21:46:57.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735b58e640 1 -- start start 2024-09-13T21:46:57.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735b58e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73540fc570 0x7f735410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735b58e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73540fd840 0x7f735410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735b58e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735410dc10 con 0x7f73540fc570 2024-09-13T21:46:57.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735b58e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735410e430 con 0x7f73540fd840 2024-09-13T21:46:57.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735932a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73540fc570 0x7f735410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735932a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73540fc570 0x7f735410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43322/0 (socket says 172.21.15.119:43322) 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735932a640 1 -- 172.21.15.119:0/3845019406 learned_addr learned my addr 172.21.15.119:0/3845019406 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f7358b29640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73540fd840 0x7f735410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735932a640 1 -- 172.21.15.119:0/3845019406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73540fd840 msgr2=0x7f735410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735932a640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73540fd840 0x7f735410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f735932a640 1 -- 172.21.15.119:0/3845019406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348005040 con 0x7f73540fc570 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.017+0000 7f7358b29640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73540fd840 0x7f735410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.018+0000 7f735932a640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73540fc570 0x7f735410d080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f734400ece0 tx=0x7f734400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.018+0000 7f7351ffb640 1 -- 172.21.15.119:0/3845019406 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f734400ee40 con 0x7f73540fc570 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.018+0000 7f7351ffb640 1 -- 172.21.15.119:0/3845019406 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f734400f040 con 0x7f73540fc570 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.018+0000 7f7351ffb640 1 -- 172.21.15.119:0/3845019406 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73440096b0 con 0x7f73540fc570 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.018+0000 7f735b58e640 1 -- 172.21.15.119:0/3845019406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735410e6c0 con 0x7f73540fc570 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.018+0000 7f735b58e640 1 -- 172.21.15.119:0/3845019406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735410ec10 con 0x7f73540fc570 2024-09-13T21:46:57.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.019+0000 7f735b58e640 1 -- 172.21.15.119:0/3845019406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73540fb9d0 con 0x7f73540fc570 2024-09-13T21:46:57.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.019+0000 7f7351ffb640 1 -- 172.21.15.119:0/3845019406 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f7344007890 con 0x7f73540fc570 2024-09-13T21:46:57.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.020+0000 7f7351ffb640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f733c06e660 0x7f733c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.020+0000 7f7351ffb640 1 -- 172.21.15.119:0/3845019406 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f734408ea10 con 0x7f73540fc570 2024-09-13T21:46:57.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.020+0000 7f7358b29640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f733c06e660 0x7f733c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.020+0000 7f7358b29640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f733c06e660 0x7f733c070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f734800b020 tx=0x7f7348009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:57.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.024+0000 7f7351ffb640 1 -- 172.21.15.119:0/3845019406 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f73440579b0 con 0x7f73540fc570 2024-09-13T21:46:57.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.261+0000 7f735b58e640 1 -- 172.21.15.119:0/3845019406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f735410ef80 con 0x7f73540fc570 2024-09-13T21:46:57.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.261+0000 7f7351ffb640 1 -- 172.21.15.119:0/3845019406 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+853 (secure 0 0 0) 0x7f734405b070 con 0x7f73540fc570 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 1, 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:46:57.263 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:46:57.264 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:46:57.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:46:57.264 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:46:57.264 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 11, 2024-09-13T21:46:57.264 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 3 2024-09-13T21:46:57.264 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:46:57.264 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:46:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.263+0000 7f735b58e640 1 -- 172.21.15.119:0/3845019406 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f733c06e660 msgr2=0x7f733c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.263+0000 7f735b58e640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f733c06e660 0x7f733c070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f734800b020 tx=0x7f7348009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.263+0000 7f735b58e640 1 -- 172.21.15.119:0/3845019406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73540fc570 msgr2=0x7f735410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.263+0000 7f735b58e640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73540fc570 0x7f735410d080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f734400ece0 tx=0x7f734400b040 comp rx=0 tx=0).stop 2024-09-13T21:46:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.263+0000 7f735b58e640 1 -- 172.21.15.119:0/3845019406 shutdown_connections 2024-09-13T21:46:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.263+0000 7f735b58e640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f733c06e660 0x7f733c070b10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.263+0000 7f735b58e640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73540fd840 0x7f735410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.263+0000 7f735b58e640 1 --2- 172.21.15.119:0/3845019406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73540fc570 0x7f735410d080 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.263+0000 7f735b58e640 1 -- 172.21.15.119:0/3845019406 >> 172.21.15.119:0/3845019406 conn(0x7f73540f7d30 msgr2=0x7f73540f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.263+0000 7f735b58e640 1 -- 172.21.15.119:0/3845019406 shutdown_connections 2024-09-13T21:46:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.263+0000 7f735b58e640 1 -- 172.21.15.119:0/3845019406 wait complete. 2024-09-13T21:46:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 -- 172.21.15.119:0/324080730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c140ff6a0 msgr2=0x7f1c14101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 --2- 172.21.15.119:0/324080730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c140ff6a0 0x7f1c14101a80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1c080048d0 tx=0x7f1c08009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 -- 172.21.15.119:0/324080730 shutdown_connections 2024-09-13T21:46:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 --2- 172.21.15.119:0/324080730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c140ff6a0 0x7f1c14101a80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 --2- 172.21.15.119:0/324080730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c14066730 0x7f1c140ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 -- 172.21.15.119:0/324080730 >> 172.21.15.119:0/324080730 conn(0x7f1c140f6c10 msgr2=0x7f1c140f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 -- 172.21.15.119:0/324080730 shutdown_connections 2024-09-13T21:46:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 -- 172.21.15.119:0/324080730 wait complete. 2024-09-13T21:46:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 Processor -- start 2024-09-13T21:46:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 -- start start 2024-09-13T21:46:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c14066730 0x7f1c1410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c140ff6a0 0x7f1c1410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.355+0000 7f1c18c82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1410dc30 con 0x7f1c140ff6a0 2024-09-13T21:46:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c18c82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1410e450 con 0x7f1c14066730 2024-09-13T21:46:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c11d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c140ff6a0 0x7f1c1410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c11d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c140ff6a0 0x7f1c1410d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43336/0 (socket says 172.21.15.119:43336) 2024-09-13T21:46:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c11d9b640 1 -- 172.21.15.119:0/3978854158 learned_addr learned my addr 172.21.15.119:0/3978854158 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c1259c640 1 --2- 172.21.15.119:0/3978854158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c14066730 0x7f1c1410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c11d9b640 1 -- 172.21.15.119:0/3978854158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c14066730 msgr2=0x7f1c1410d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c11d9b640 1 --2- 172.21.15.119:0/3978854158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c14066730 0x7f1c1410d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c11d9b640 1 -- 172.21.15.119:0/3978854158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c08005040 con 0x7f1c140ff6a0 2024-09-13T21:46:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c11d9b640 1 --2- 172.21.15.119:0/3978854158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c140ff6a0 0x7f1c1410d5e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1c080048a0 tx=0x7f1c08009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c02ffd640 1 -- 172.21.15.119:0/3978854158 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c08038070 con 0x7f1c140ff6a0 2024-09-13T21:46:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c18c82640 1 -- 172.21.15.119:0/3978854158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1410e680 con 0x7f1c140ff6a0 2024-09-13T21:46:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c18c82640 1 -- 172.21.15.119:0/3978854158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1410ec20 con 0x7f1c140ff6a0 2024-09-13T21:46:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c02ffd640 1 -- 172.21.15.119:0/3978854158 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c08004290 con 0x7f1c140ff6a0 2024-09-13T21:46:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.356+0000 7f1c02ffd640 1 -- 172.21.15.119:0/3978854158 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c08033660 con 0x7f1c140ff6a0 2024-09-13T21:46:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.358+0000 7f1c18c82640 1 -- 172.21.15.119:0/3978854158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c140fa8b0 con 0x7f1c140ff6a0 2024-09-13T21:46:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.358+0000 7f1c02ffd640 1 -- 172.21.15.119:0/3978854158 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f1c08030020 con 0x7f1c140ff6a0 2024-09-13T21:46:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.358+0000 7f1c02ffd640 1 --2- 172.21.15.119:0/3978854158 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f1bfc06e660 0x7f1bfc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.359+0000 7f1c02ffd640 1 -- 172.21.15.119:0/3978854158 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1c080ae3f0 con 0x7f1c140ff6a0 2024-09-13T21:46:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.359+0000 7f1c1259c640 1 --2- 172.21.15.119:0/3978854158 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f1bfc06e660 0x7f1bfc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.359+0000 7f1c1259c640 1 --2- 172.21.15.119:0/3978854158 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f1bfc06e660 0x7f1bfc070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1c14066490 tx=0x7f1c0400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.363+0000 7f1c02ffd640 1 -- 172.21.15.119:0/3978854158 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1c08077440 con 0x7f1c140ff6a0 2024-09-13T21:46:57.558 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:57 smithi155 ceph-mon[34732]: pgmap v5: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:57.558 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:57 smithi155 ceph-mon[34732]: mgrmap e37: smithi119.gwjxmq(active, since 4s), standbys: smithi155.wuuxfd 2024-09-13T21:46:57.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.589+0000 7f1c18c82640 1 -- 172.21.15.119:0/3978854158 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1c14104f70 con 0x7f1c140ff6a0 2024-09-13T21:46:57.591 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:57 smithi119 ceph-mon[90896]: pgmap v5: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:46:57.591 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:57 smithi119 ceph-mon[90896]: mgrmap e37: smithi119.gwjxmq(active, since 4s), standbys: smithi155.wuuxfd 2024-09-13T21:46:57.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.590+0000 7f1c02ffd640 1 -- 172.21.15.119:0/3978854158 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1962 (secure 0 0 0) 0x7f1c0807ab00 con 0x7f1c140ff6a0 2024-09-13T21:46:57.592 INFO:teuthology.orchestra.run.smithi119.stdout:e20 2024-09-13T21:46:57.592 INFO:teuthology.orchestra.run.smithi119.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:46:57.592 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:46:57.592 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:46:57.592 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:46:57.592 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:46:57.592 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:46:57.592 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:46:57.592 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 20 2024-09-13T21:46:57.592 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:45:37.594101+0000 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:46:57.593 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:57.594 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:57.595 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:46:57.595 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:46:57.595 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:46:57.595 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:46:57.595 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:57.595 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:46:57.595 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 20 2024-09-13T21:46:57.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.593+0000 7f1c18c82640 1 -- 172.21.15.119:0/3978854158 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f1bfc06e660 msgr2=0x7f1bfc070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.593+0000 7f1c18c82640 1 --2- 172.21.15.119:0/3978854158 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f1bfc06e660 0x7f1bfc070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1c14066490 tx=0x7f1c0400b040 comp rx=0 tx=0).stop 2024-09-13T21:46:57.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.593+0000 7f1c18c82640 1 -- 172.21.15.119:0/3978854158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c140ff6a0 msgr2=0x7f1c1410d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.593+0000 7f1c18c82640 1 --2- 172.21.15.119:0/3978854158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c140ff6a0 0x7f1c1410d5e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1c080048a0 tx=0x7f1c08009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.593+0000 7f1c18c82640 1 -- 172.21.15.119:0/3978854158 shutdown_connections 2024-09-13T21:46:57.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.593+0000 7f1c18c82640 1 --2- 172.21.15.119:0/3978854158 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f1bfc06e660 0x7f1bfc070b10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.593+0000 7f1c18c82640 1 --2- 172.21.15.119:0/3978854158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c140ff6a0 0x7f1c1410d5e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.593+0000 7f1c18c82640 1 --2- 172.21.15.119:0/3978854158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c14066730 0x7f1c1410d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.593+0000 7f1c18c82640 1 -- 172.21.15.119:0/3978854158 >> 172.21.15.119:0/3978854158 conn(0x7f1c140f6c10 msgr2=0x7f1c140f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:57.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.593+0000 7f1c18c82640 1 -- 172.21.15.119:0/3978854158 shutdown_connections 2024-09-13T21:46:57.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.593+0000 7f1c18c82640 1 -- 172.21.15.119:0/3978854158 wait complete. 2024-09-13T21:46:57.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.675+0000 7fc4396b1640 1 -- 172.21.15.119:0/2287056746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4340fc720 msgr2=0x7fc4340fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.675+0000 7fc4396b1640 1 --2- 172.21.15.119:0/2287056746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4340fc720 0x7fc4340fcb90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc4280048d0 tx=0x7fc428009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.675+0000 7fc4396b1640 1 -- 172.21.15.119:0/2287056746 shutdown_connections 2024-09-13T21:46:57.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.675+0000 7fc4396b1640 1 --2- 172.21.15.119:0/2287056746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4340fc720 0x7fc4340fcb90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.675+0000 7fc4396b1640 1 --2- 172.21.15.119:0/2287056746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4340fb450 0x7fc4340fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.675+0000 7fc4396b1640 1 -- 172.21.15.119:0/2287056746 >> 172.21.15.119:0/2287056746 conn(0x7fc4340f6c30 msgr2=0x7fc4340f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:57.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.675+0000 7fc4396b1640 1 -- 172.21.15.119:0/2287056746 shutdown_connections 2024-09-13T21:46:57.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.675+0000 7fc4396b1640 1 -- 172.21.15.119:0/2287056746 wait complete. 2024-09-13T21:46:57.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.675+0000 7fc4396b1640 1 Processor -- start 2024-09-13T21:46:57.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc4396b1640 1 -- start start 2024-09-13T21:46:57.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc4396b1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4340fb450 0x7fc43410bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc4396b1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4340fc720 0x7fc43410c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc4396b1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43410cb20 con 0x7fc4340fb450 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc4396b1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43410d2f0 con 0x7fc4340fc720 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc432ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4340fb450 0x7fc43410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc432ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4340fb450 0x7fc43410bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43346/0 (socket says 172.21.15.119:43346) 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc432ffd640 1 -- 172.21.15.119:0/2522609916 learned_addr learned my addr 172.21.15.119:0/2522609916 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc4327fc640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4340fc720 0x7fc43410c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc432ffd640 1 -- 172.21.15.119:0/2522609916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4340fc720 msgr2=0x7fc43410c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc432ffd640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4340fc720 0x7fc43410c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc432ffd640 1 -- 172.21.15.119:0/2522609916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428005040 con 0x7fc4340fb450 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc4327fc640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4340fc720 0x7fc43410c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.676+0000 7fc432ffd640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4340fb450 0x7fc43410bf90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc42400c830 tx=0x7fc424004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.677+0000 7fc41b7fe640 1 -- 172.21.15.119:0/2522609916 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc42400a850 con 0x7fc4340fb450 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.677+0000 7fc41b7fe640 1 -- 172.21.15.119:0/2522609916 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc42400ae50 con 0x7fc4340fb450 2024-09-13T21:46:57.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.677+0000 7fc41b7fe640 1 -- 172.21.15.119:0/2522609916 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4240113a0 con 0x7fc4340fb450 2024-09-13T21:46:57.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.677+0000 7fc4396b1640 1 -- 172.21.15.119:0/2522609916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43410d580 con 0x7fc4340fb450 2024-09-13T21:46:57.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.677+0000 7fc4396b1640 1 -- 172.21.15.119:0/2522609916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43410d9e0 con 0x7fc4340fb450 2024-09-13T21:46:57.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.678+0000 7fc4396b1640 1 -- 172.21.15.119:0/2522609916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4340fa8b0 con 0x7fc4340fb450 2024-09-13T21:46:57.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.679+0000 7fc41b7fe640 1 -- 172.21.15.119:0/2522609916 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fc424012400 con 0x7fc4340fb450 2024-09-13T21:46:57.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.679+0000 7fc41b7fe640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc41c06e660 0x7fc41c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.679+0000 7fc4327fc640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc41c06e660 0x7fc41c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.679+0000 7fc41b7fe640 1 -- 172.21.15.119:0/2522609916 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc42408e4f0 con 0x7fc4340fb450 2024-09-13T21:46:57.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.680+0000 7fc4327fc640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc41c06e660 0x7fc41c070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc42800b020 tx=0x7fc428009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:57.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.684+0000 7fc41b7fe640 1 -- 172.21.15.119:0/2522609916 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc4240575a0 con 0x7fc4340fb450 2024-09-13T21:46:57.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.876+0000 7fc4396b1640 1 -- 172.21.15.119:0/2522609916 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc43410dec0 con 0x7fc41c06e660 2024-09-13T21:46:57.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.890+0000 7fc41b7fe640 1 -- 172.21.15.119:0/2522609916 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fc43410dec0 con 0x7fc41c06e660 2024-09-13T21:46:57.892 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:46:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:46:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:46:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:46:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:46:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr" 2024-09-13T21:46:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:46:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "3/21 daemons upgraded", 2024-09-13T21:46:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "", 2024-09-13T21:46:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:46:57.892 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:46:57.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.893+0000 7fc4396b1640 1 -- 172.21.15.119:0/2522609916 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc41c06e660 msgr2=0x7fc41c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.893+0000 7fc4396b1640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc41c06e660 0x7fc41c070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc42800b020 tx=0x7fc428009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.893+0000 7fc4396b1640 1 -- 172.21.15.119:0/2522609916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4340fb450 msgr2=0x7fc43410bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.893+0000 7fc4396b1640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4340fb450 0x7fc43410bf90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc42400c830 tx=0x7fc424004430 comp rx=0 tx=0).stop 2024-09-13T21:46:57.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.893+0000 7fc4396b1640 1 -- 172.21.15.119:0/2522609916 shutdown_connections 2024-09-13T21:46:57.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.893+0000 7fc4396b1640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc41c06e660 0x7fc41c070b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.893+0000 7fc4396b1640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4340fc720 0x7fc43410c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.893+0000 7fc4396b1640 1 --2- 172.21.15.119:0/2522609916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4340fb450 0x7fc43410bf90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.893+0000 7fc4396b1640 1 -- 172.21.15.119:0/2522609916 >> 172.21.15.119:0/2522609916 conn(0x7fc4340f6c30 msgr2=0x7fc4340f8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:57.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.893+0000 7fc4396b1640 1 -- 172.21.15.119:0/2522609916 shutdown_connections 2024-09-13T21:46:57.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.893+0000 7fc4396b1640 1 -- 172.21.15.119:0/2522609916 wait complete. 2024-09-13T21:46:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.976+0000 7fc5ca174640 1 -- 172.21.15.119:0/435019674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c40ff720 msgr2=0x7fc5c4101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.976+0000 7fc5ca174640 1 --2- 172.21.15.119:0/435019674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c40ff720 0x7fc5c4101b00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80048d0 tx=0x7fc5b8009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.976+0000 7fc5ca174640 1 -- 172.21.15.119:0/435019674 shutdown_connections 2024-09-13T21:46:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.976+0000 7fc5ca174640 1 --2- 172.21.15.119:0/435019674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c40ff720 0x7fc5c4101b00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.976+0000 7fc5ca174640 1 --2- 172.21.15.119:0/435019674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5c4065ba0 0x7fc5c40ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.976+0000 7fc5ca174640 1 -- 172.21.15.119:0/435019674 >> 172.21.15.119:0/435019674 conn(0x7fc5c40f6c10 msgr2=0x7fc5c40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.976+0000 7fc5ca174640 1 -- 172.21.15.119:0/435019674 shutdown_connections 2024-09-13T21:46:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.976+0000 7fc5ca174640 1 -- 172.21.15.119:0/435019674 wait complete. 2024-09-13T21:46:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.976+0000 7fc5ca174640 1 Processor -- start 2024-09-13T21:46:57.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5ca174640 1 -- start start 2024-09-13T21:46:57.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5ca174640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5c4065ba0 0x7fc5c410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5ca174640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c40ff720 0x7fc5c410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5ca174640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c410dc10 con 0x7fc5c40ff720 2024-09-13T21:46:57.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5ca174640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c410e430 con 0x7fc5c4065ba0 2024-09-13T21:46:57.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5c2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c40ff720 0x7fc5c410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5c2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c40ff720 0x7fc5c410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43370/0 (socket says 172.21.15.119:43370) 2024-09-13T21:46:57.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5c2ffd640 1 -- 172.21.15.119:0/382988674 learned_addr learned my addr 172.21.15.119:0/382988674 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:46:57.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5c37fe640 1 --2- 172.21.15.119:0/382988674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5c4065ba0 0x7fc5c410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5c2ffd640 1 -- 172.21.15.119:0/382988674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5c4065ba0 msgr2=0x7fc5c410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:57.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5c2ffd640 1 --2- 172.21.15.119:0/382988674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5c4065ba0 0x7fc5c410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:57.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5c2ffd640 1 -- 172.21.15.119:0/382988674 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b8005040 con 0x7fc5c40ff720 2024-09-13T21:46:57.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.977+0000 7fc5c2ffd640 1 --2- 172.21.15.119:0/382988674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c40ff720 0x7fc5c410d5c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80043d0 tx=0x7fc5b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:57.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.978+0000 7fc5abfff640 1 -- 172.21.15.119:0/382988674 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b8038070 con 0x7fc5c40ff720 2024-09-13T21:46:57.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.978+0000 7fc5abfff640 1 -- 172.21.15.119:0/382988674 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc5b802ae90 con 0x7fc5c40ff720 2024-09-13T21:46:57.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.978+0000 7fc5abfff640 1 -- 172.21.15.119:0/382988674 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b803e670 con 0x7fc5c40ff720 2024-09-13T21:46:57.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.978+0000 7fc5ca174640 1 -- 172.21.15.119:0/382988674 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c410e660 con 0x7fc5c40ff720 2024-09-13T21:46:57.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.978+0000 7fc5ca174640 1 -- 172.21.15.119:0/382988674 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c410ebb0 con 0x7fc5c40ff720 2024-09-13T21:46:57.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.979+0000 7fc5ca174640 1 -- 172.21.15.119:0/382988674 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c40fa890 con 0x7fc5c40ff720 2024-09-13T21:46:57.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.979+0000 7fc5abfff640 1 -- 172.21.15.119:0/382988674 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fc5b8030020 con 0x7fc5c40ff720 2024-09-13T21:46:57.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.980+0000 7fc5abfff640 1 --2- 172.21.15.119:0/382988674 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc5ac06e660 0x7fc5ac070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:46:57.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.980+0000 7fc5abfff640 1 -- 172.21.15.119:0/382988674 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc5b80ae470 con 0x7fc5c40ff720 2024-09-13T21:46:57.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.980+0000 7fc5c37fe640 1 --2- 172.21.15.119:0/382988674 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc5ac06e660 0x7fc5ac070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:46:57.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.980+0000 7fc5c37fe640 1 --2- 172.21.15.119:0/382988674 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc5ac06e660 0x7fc5ac070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4065900 tx=0x7fc5b400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:46:57.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:57.985+0000 7fc5abfff640 1 -- 172.21.15.119:0/382988674 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc5b8077550 con 0x7fc5c40ff720 2024-09-13T21:46:58.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.235+0000 7fc5ca174640 1 -- 172.21.15.119:0/382988674 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc5c4104f40 con 0x7fc5c40ff720 2024-09-13T21:46:58.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.236+0000 7fc5abfff640 1 -- 172.21.15.119:0/382988674 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc5b807ac10 con 0x7fc5c40ff720 2024-09-13T21:46:58.237 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:46:58.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.238+0000 7fc5ca174640 1 -- 172.21.15.119:0/382988674 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc5ac06e660 msgr2=0x7fc5ac070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:58.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.238+0000 7fc5ca174640 1 --2- 172.21.15.119:0/382988674 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc5ac06e660 0x7fc5ac070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4065900 tx=0x7fc5b400b040 comp rx=0 tx=0).stop 2024-09-13T21:46:58.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.238+0000 7fc5ca174640 1 -- 172.21.15.119:0/382988674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c40ff720 msgr2=0x7fc5c410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:46:58.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.238+0000 7fc5ca174640 1 --2- 172.21.15.119:0/382988674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c40ff720 0x7fc5c410d5c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80043d0 tx=0x7fc5b8009da0 comp rx=0 tx=0).stop 2024-09-13T21:46:58.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.238+0000 7fc5ca174640 1 -- 172.21.15.119:0/382988674 shutdown_connections 2024-09-13T21:46:58.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.238+0000 7fc5ca174640 1 --2- 172.21.15.119:0/382988674 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc5ac06e660 0x7fc5ac070b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:58.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.238+0000 7fc5ca174640 1 --2- 172.21.15.119:0/382988674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c40ff720 0x7fc5c410d5c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:58.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.238+0000 7fc5ca174640 1 --2- 172.21.15.119:0/382988674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5c4065ba0 0x7fc5c410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:46:58.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.238+0000 7fc5ca174640 1 -- 172.21.15.119:0/382988674 >> 172.21.15.119:0/382988674 conn(0x7fc5c40f6c10 msgr2=0x7fc5c40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:46:58.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.238+0000 7fc5ca174640 1 -- 172.21.15.119:0/382988674 shutdown_connections 2024-09-13T21:46:58.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:46:58.238+0000 7fc5ca174640 1 -- 172.21.15.119:0/382988674 wait complete. 2024-09-13T21:46:58.476 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:58 smithi155 ceph-mon[34732]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:58.476 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:58 smithi155 ceph-mon[34732]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:58.476 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:58 smithi155 ceph-mon[34732]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:58.476 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:58 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3845019406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:58.476 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:58 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:58.476 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:58 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:58.476 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:58 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/3978854158' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:46:58.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:58 smithi119 ceph-mon[90896]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:58.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:58 smithi119 ceph-mon[90896]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:58.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:58 smithi119 ceph-mon[90896]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:58.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:58 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3845019406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:46:58.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:58 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:58.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:58 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:58.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:58 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3978854158' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:46:59.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:59 smithi155 ceph-mon[34732]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:59.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:59 smithi155 ceph-mon[34732]: pgmap v6: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-13T21:46:59.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:59 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:59.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:59 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:59.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:59 smithi155 ceph-mon[34732]: from='client.? 172.21.15.119:0/382988674' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:46:59.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:59 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:59.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:59 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:59.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:59 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:59.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:46:59 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:46:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:59 smithi119 ceph-mon[90896]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:46:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:59 smithi119 ceph-mon[90896]: pgmap v6: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-13T21:46:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:59 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:59 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:59.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:59 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/382988674' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:46:59.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:59 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:59.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:59 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:46:59.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:59 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:46:59.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:46:59 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:47:00.550 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:00 smithi155 ceph-mon[34732]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-13T21:47:00.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:00 smithi155 ceph-mon[34732]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-13T21:47:00.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:00 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:00.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:00 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:00.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:00 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:00.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:00 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:00.581 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:00 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:00.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:00 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:00.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:00 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:00.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:00 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T21:47:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:00 smithi119 ceph-mon[90896]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-13T21:47:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:00 smithi119 ceph-mon[90896]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-13T21:47:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:00 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:00 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:00 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:00 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:00 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:00 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:00 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:00.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:00 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T21:47:01.511 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:01 smithi155 ceph-mon[34732]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:47:01.511 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:01 smithi155 ceph-mon[34732]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:47:01.511 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:01 smithi155 ceph-mon[34732]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:47:01.511 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:01 smithi155 ceph-mon[34732]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:47:01.511 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:01 smithi155 ceph-mon[34732]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:47:01.511 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:01 smithi155 ceph-mon[34732]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:47:01.512 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:01 smithi155 ceph-mon[34732]: pgmap v7: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-13T21:47:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:01 smithi119 ceph-mon[90896]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:47:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:01 smithi119 ceph-mon[90896]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T21:47:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:01 smithi119 ceph-mon[90896]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:47:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:01 smithi119 ceph-mon[90896]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-13T21:47:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:01 smithi119 ceph-mon[90896]: Updating smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:47:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:01 smithi119 ceph-mon[90896]: Updating smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T21:47:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:01 smithi119 ceph-mon[90896]: pgmap v7: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-13T21:47:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:02 smithi119 ceph-mon[90896]: Upgrade: Updating mon.smithi155 2024-09-13T21:47:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:02 smithi119 ceph-mon[90896]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:47:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:47:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:02 smithi119 ceph-mon[90896]: Deploying daemon mon.smithi155 on smithi155 2024-09-13T21:47:02.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:02 smithi119 ceph-mon[90896]: pgmap v8: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T21:47:02.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:02 smithi155 ceph-mon[34732]: Upgrade: Updating mon.smithi155 2024-09-13T21:47:02.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:02 smithi155 ceph-mon[34732]: from='mgr.34104 ' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:02.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:02 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:47:02.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:02 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:47:02.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:02 smithi155 ceph-mon[34732]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:02.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:02 smithi155 ceph-mon[34732]: Deploying daemon mon.smithi155 on smithi155 2024-09-13T21:47:02.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:02 smithi155 ceph-mon[34732]: pgmap v8: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T21:47:03.485 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:03 smithi155 systemd[1]: Stopping Ceph mon.smithi155 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:47:03.486 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:03 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155[34722]: 2024-09-13T21:47:03.422+0000 7f268251d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi155 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:47:03.486 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:03 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155[34722]: 2024-09-13T21:47:03.422+0000 7f268251d640 -1 mon.smithi155@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T21:47:03.783 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:03 smithi155 podman[79769]: 2024-09-13 21:47:03.484700951 +0000 UTC m=+0.163056823 container died 66c9116315aea69edca33a0b496c7dbb12b56cf0534cb9120bff26d509093b06 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=quincy-eb16b97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:47:04.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:03 smithi155 podman[79769]: 2024-09-13 21:47:03.86459688 +0000 UTC m=+0.542952751 container cleanup 66c9116315aea69edca33a0b496c7dbb12b56cf0534cb9120bff26d509093b06 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=quincy-eb16b97, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T21:47:04.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:03 smithi155 bash[79769]: ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155 2024-09-13T21:47:04.476 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 podman[79781]: 2024-09-13 21:47:04.107628137 +0000 UTC m=+0.623741569 container remove 66c9116315aea69edca33a0b496c7dbb12b56cf0534cb9120bff26d509093b06 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=quincy-eb16b97, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T21:47:04.476 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi155.service: Deactivated successfully. 2024-09-13T21:47:04.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 systemd[1]: Stopped Ceph mon.smithi155 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:47:04.477 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi155.service: Consumed 5.889s CPU time. 2024-09-13T21:47:04.824 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 systemd[1]: Starting Ceph mon.smithi155 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:47:04.824 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 podman[79909]: 2024-09-13 21:47:04.587019051 +0000 UTC m=+0.015722878 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:47:04.824 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 podman[79909]: 2024-09-13 21:47:04.700352353 +0000 UTC m=+0.129056168 container create 4616d5306e8c542bda81f3329a1ecb9d50a90709dabe073ef3be6cfaa6f3a260 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T21:47:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 podman[79909]: 2024-09-13 21:47:04.936711644 +0000 UTC m=+0.365415469 container init 4616d5306e8c542bda81f3329a1ecb9d50a90709dabe073ef3be6cfaa6f3a260 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:47:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 podman[79909]: 2024-09-13 21:47:04.939925136 +0000 UTC m=+0.368628953 container start 4616d5306e8c542bda81f3329a1ecb9d50a90709dabe073ef3be6cfaa6f3a260 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:47:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T21:47:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 2 2024-09-13T21:47:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: pidfile_write: ignore empty --pid-file 2024-09-13T21:47:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: load: jerasure load: lrc 2024-09-13T21:47:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: RocksDB version: 7.9.2 2024-09-13T21:47:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Git sha 0 2024-09-13T21:47:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T21:47:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: DB SUMMARY 2024-09-13T21:47:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: DB Session ID: OCU2HEWEQUHBSTUZZZKM 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: CURRENT file: CURRENT 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: MANIFEST file: MANIFEST-000009 size: 895 Bytes 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi155/store.db dir, Total Num: 1, files: 000024.sst 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi155/store.db: 000022.log size: 6031453 ; 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.error_if_exists: 0 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.create_if_missing: 0 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.paranoid_checks: 1 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.env: 0x55bd69413940 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T21:47:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.info_log: 0x55bd6b9e18c0 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.statistics: (nil) 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.use_fsync: 0 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_log_file_size: 0 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.allow_fallocate: 1 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.use_direct_reads: 0 2024-09-13T21:47:05.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.db_log_dir: 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.wal_dir: 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.write_buffer_manager: 0x55bd6b9f0dc0 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T21:47:05.087 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.unordered_write: 0 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.row_cache: None 2024-09-13T21:47:05.088 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.wal_filter: None 2024-09-13T21:47:05.090 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T21:47:05.090 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T21:47:05.090 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.two_write_queues: 0 2024-09-13T21:47:05.090 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T21:47:05.090 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.wal_compression: 0 2024-09-13T21:47:05.090 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.atomic_flush: 0 2024-09-13T21:47:05.090 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T21:47:05.090 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T21:47:05.090 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T21:47:05.090 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.log_readahead_size: 0 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_background_jobs: 2 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_background_compactions: -1 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_subcompactions: 1 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T21:47:05.091 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_open_files: -1 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_background_flushes: -1 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Compression algorithms supported: 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: kZSTD supported: 0 2024-09-13T21:47:05.092 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: kXpressCompression supported: 0 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: kBZip2Compression supported: 0 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: kLZ4Compression supported: 1 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: kZlibCompression supported: 1 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: kSnappyCompression supported: 1 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi155/store.db/MANIFEST-000009 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.merge_operator: 2024-09-13T21:47:05.093 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_filter: None 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bd6b9e1520) 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: cache_index_and_filter_blocks: 1 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: pin_top_level_index_and_filter: 1 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: index_type: 0 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: data_block_index_type: 0 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: index_shortening: 1 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: checksum: 4 2024-09-13T21:47:05.094 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: no_block_cache: 0 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache: 0x55bd6b9d51f0 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache_name: BinnedLRUCache 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache_options: 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: capacity : 536870912 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: num_shard_bits : 4 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: strict_capacity_limit : 0 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: high_pri_pool_ratio: 0.000 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_cache_compressed: (nil) 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: persistent_cache: (nil) 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_size: 4096 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_size_deviation: 10 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_restart_interval: 16 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: index_block_restart_interval: 1 2024-09-13T21:47:05.095 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: metadata_block_size: 4096 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: partition_filters: 0 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: use_delta_encoding: 1 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: filter_policy: bloomfilter 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: whole_key_filtering: 1 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: verify_compression: 0 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: read_amp_bytes_per_bit: 0 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: format_version: 5 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: enable_index_compression: 1 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: block_align: 0 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: max_auto_readahead_size: 262144 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: prepopulate_block_cache: 0 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: initial_auto_readahead_size: 8192 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T21:47:05.096 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compression: NoCompression 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.num_levels: 7 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T21:47:05.097 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T21:47:05.098 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T21:47:05.099 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T21:47:05.100 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.inplace_update_support: 0 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.bloom_locality: 0 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.max_successive_merges: 0 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T21:47:05.101 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.ttl: 2592000 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.enable_blob_files: false 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.min_blob_size: 0 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T21:47:05.102 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi155/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 10475, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ba1d47a0-a428-4f01-9b83-90f058d1051b 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264024966213, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264024980923, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 3614938, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10480, "largest_seqno": 11859, "table_properties": {"data_size": 3608342, "index_size": 4015, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1541, "raw_key_size": 13925, "raw_average_key_size": 23, "raw_value_size": 3595589, "raw_average_value_size": 6073, "num_data_blocks": 183, "num_entries": 592, "num_filter_entries": 592, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726264024, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ba1d47a0-a428-4f01-9b83-90f058d1051b", "db_session_id": "OCU2HEWEQUHBSTUZZZKM", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726264024981060, "job": 1, "event": "recovery_finished"} 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-09-13T21:47:05.103 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi155/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bd6ba02e00 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: DB pointer 0x55bd6bafe000 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** DB Stats ** 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T21:47:05.104 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** Compaction Stats [default] ** 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: L0 1/0 3.45 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 491.2 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: L6 1/0 5.37 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Sum 2/0 8.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 491.2 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 491.2 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** Compaction Stats [default] ** 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 491.2 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2024-09-13T21:47:05.105 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T21:47:05.106 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2024-09-13T21:47:05.106 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T21:47:05.106 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-13T21:47:05.106 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T21:47:05.106 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T21:47:05.106 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T21:47:05.106 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T21:47:05.106 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Cumulative compaction: 0.00 GB write, 173.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:47:05.106 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Interval compaction: 0.00 GB write, 173.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T21:47:05.106 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Block cache BinnedLRUCache@0x55bd6b9d51f0#2 capacity: 512.00 MB usage: 5.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: starting mon.smithi155 rank 1 at public addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] at bind addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi155 fsid f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: mon.smithi155@-1(???) e2 preinit fsid f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: mon.smithi155@-1(???).mds e20 new map 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: mon.smithi155@-1(???).mds e20 print_map 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: e20 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:47:05.107 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: legacy client fscid: 1 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Filesystem 'cephfs' (1) 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: fs_name cephfs 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: epoch 20 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: modified 2024-09-13T21:45:37.594101+0000 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: tableserver 0 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: root 0 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: session_timeout 60 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: session_autoclose 300 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: max_file_size 1099511627776 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: max_xattr_size 65536 2024-09-13T21:47:05.108 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: required_client_features {} 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: last_failure 0 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: last_failure_osd_epoch 44 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: max_mds 2 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: in 0,1 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: up {0=14472,1=24267} 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: failed 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: damaged 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: stopped 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: data_pools [3] 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: metadata_pool 2 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: inline_data disabled 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: balancer 2024-09-13T21:47:05.109 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: bal_rank_mask -1 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: standby_count_wanted 1 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: qdb_cluster leader: 0 members: 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: [mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: [mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: Standby daemons: 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: [mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout: [mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: mon.smithi155@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: mon.smithi155@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: mon.smithi155@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:47:05.110 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: mon.smithi155@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T21:47:05.111 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:04 smithi155 ceph-mon[79928]: mon.smithi155@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-13T21:47:05.111 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:05 smithi155 bash[79909]: 4616d5306e8c542bda81f3329a1ecb9d50a90709dabe073ef3be6cfaa6f3a260 2024-09-13T21:47:05.111 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:05 smithi155 systemd[1]: Started Ceph mon.smithi155 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:47:06.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:06 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:47:06.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:06 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:47:06.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:06 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:47:06.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:06 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: mon.smithi119 calling monitor election 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: mon.smithi155 calling monitor election 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: mon.smithi119 is new leader, mons smithi119,smithi155 in quorum (ranks 0,1) 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: monmap epoch 3 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: fsid f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: last_changed 2024-09-13T21:47:06.561758+0000 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: created 2024-09-13T21:35:37.219093+0000 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: min_mon_release 19 (squid) 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: election_strategy: 1 2024-09-13T21:47:07.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: 0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.smithi119 2024-09-13T21:47:07.835 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: 1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.smithi155 2024-09-13T21:47:07.835 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:47:07.835 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T21:47:07.835 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: mgrmap e37: smithi119.gwjxmq(active, since 14s), standbys: smithi155.wuuxfd 2024-09-13T21:47:07.835 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: overall HEALTH_OK 2024-09-13T21:47:07.835 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:07.835 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:07.835 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:07.835 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2024-09-13T21:47:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: mon.smithi119 calling monitor election 2024-09-13T21:47:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: mon.smithi155 calling monitor election 2024-09-13T21:47:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mon metadata", "id": "smithi155"}]: dispatch 2024-09-13T21:47:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: mon.smithi119 is new leader, mons smithi119,smithi155 in quorum (ranks 0,1) 2024-09-13T21:47:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: monmap epoch 3 2024-09-13T21:47:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: fsid f9722044-7217-11ef-bceb-c7b262605968 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: last_changed 2024-09-13T21:47:06.561758+0000 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: created 2024-09-13T21:35:37.219093+0000 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: min_mon_release 19 (squid) 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: election_strategy: 1 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: 0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.smithi119 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: 1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.smithi155 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: mgrmap e37: smithi119.gwjxmq(active, since 14s), standbys: smithi155.wuuxfd 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: overall HEALTH_OK 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:07.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:07.882 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:07.882 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:08.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:08 smithi155 ceph-mon[79928]: pgmap v11: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:47:08.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:08 smithi119 ceph-mon[90896]: pgmap v11: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T21:47:10.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:10 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:10.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:10 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:10.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:10 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:10.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:10 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:10.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:10 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:10.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:10 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:10.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:10 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:10.539 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:10 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:11.490 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:11 smithi155 ceph-mon[79928]: pgmap v12: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:11.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:11 smithi119 ceph-mon[90896]: pgmap v12: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:13.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:13 smithi119 ceph-mon[90896]: pgmap v13: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:13.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:13.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:13.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:13.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:47:13.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:13.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:47:13.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:47:13.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:13 smithi155 ceph-mon[79928]: pgmap v13: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:47:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:47:13.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:47:13.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:14 smithi155 ceph-mon[79928]: Reconfiguring mon.smithi119 (monmap changed)... 2024-09-13T21:47:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:14 smithi155 ceph-mon[79928]: Reconfiguring daemon mon.smithi119 on smithi119 2024-09-13T21:47:14.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:14 smithi119 ceph-mon[90896]: Reconfiguring mon.smithi119 (monmap changed)... 2024-09-13T21:47:14.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:14 smithi119 ceph-mon[90896]: Reconfiguring daemon mon.smithi119 on smithi119 2024-09-13T21:47:15.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:15 smithi119 ceph-mon[90896]: pgmap v14: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:15.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:15.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:15.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.gwjxmq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:47:15.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:47:15.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:15 smithi155 ceph-mon[79928]: pgmap v14: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.gwjxmq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:47:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:47:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:16.543 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:16 smithi119 ceph-mon[90896]: Reconfiguring mgr.smithi119.gwjxmq (monmap changed)... 2024-09-13T21:47:16.543 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:16 smithi119 ceph-mon[90896]: Reconfiguring daemon mgr.smithi119.gwjxmq on smithi119 2024-09-13T21:47:16.543 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:16 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:16.543 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:16 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:16.543 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:16 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:47:16.543 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:16 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:16 smithi155 ceph-mon[79928]: Reconfiguring mgr.smithi119.gwjxmq (monmap changed)... 2024-09-13T21:47:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:16 smithi155 ceph-mon[79928]: Reconfiguring daemon mgr.smithi119.gwjxmq on smithi119 2024-09-13T21:47:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:16 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:16 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:16 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:47:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:16 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:17.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:17 smithi155 ceph-mon[79928]: Reconfiguring crash.smithi119 (monmap changed)... 2024-09-13T21:47:17.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:17 smithi155 ceph-mon[79928]: Reconfiguring daemon crash.smithi119 on smithi119 2024-09-13T21:47:17.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:17 smithi155 ceph-mon[79928]: pgmap v15: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:17.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:17 smithi119 ceph-mon[90896]: Reconfiguring crash.smithi119 (monmap changed)... 2024-09-13T21:47:17.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:17 smithi119 ceph-mon[90896]: Reconfiguring daemon crash.smithi119 on smithi119 2024-09-13T21:47:17.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:17 smithi119 ceph-mon[90896]: pgmap v15: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:18.661 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:18 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:18.661 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:18 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:18.661 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:18 smithi119 ceph-mon[90896]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T21:47:18.661 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:18 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:47:18.661 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:18 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:18.661 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:18 smithi119 ceph-mon[90896]: Reconfiguring daemon osd.0 on smithi119 2024-09-13T21:47:18.661 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:18 smithi119 ceph-mon[90896]: pgmap v16: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:18 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:18 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:18 smithi155 ceph-mon[79928]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T21:47:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:18 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:47:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:18 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:18 smithi155 ceph-mon[79928]: Reconfiguring daemon osd.0 on smithi119 2024-09-13T21:47:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:18 smithi155 ceph-mon[79928]: pgmap v16: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:20.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:20 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:20.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:20 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:20.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:20 smithi155 ceph-mon[79928]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T21:47:20.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:20 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:47:20.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:20 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:20.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:20 smithi155 ceph-mon[79928]: Reconfiguring daemon osd.1 on smithi119 2024-09-13T21:47:20.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:20 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:20.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:20 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:20.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:20 smithi119 ceph-mon[90896]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T21:47:20.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:20 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:47:20.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:20 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:20.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:20 smithi119 ceph-mon[90896]: Reconfiguring daemon osd.1 on smithi119 2024-09-13T21:47:21.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:21 smithi155 ceph-mon[79928]: pgmap v17: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:21.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:21.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:21.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:47:21.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:21.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:21 smithi119 ceph-mon[90896]: pgmap v17: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:21.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:21.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:21.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:47:21.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:22.303 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:22 smithi119 ceph-mon[90896]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T21:47:22.304 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:22 smithi119 ceph-mon[90896]: Reconfiguring daemon osd.2 on smithi119 2024-09-13T21:47:22.304 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:22.304 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:22.304 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.rpmijj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:47:22.304 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:22.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:22 smithi155 ceph-mon[79928]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T21:47:22.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:22 smithi155 ceph-mon[79928]: Reconfiguring daemon osd.2 on smithi119 2024-09-13T21:47:22.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:22.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:22.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.rpmijj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:47:22.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:23.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:23 smithi119 ceph-mon[90896]: Reconfiguring mds.cephfs.smithi119.rpmijj (monmap changed)... 2024-09-13T21:47:23.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:23 smithi119 ceph-mon[90896]: Reconfiguring daemon mds.cephfs.smithi119.rpmijj on smithi119 2024-09-13T21:47:23.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:23 smithi119 ceph-mon[90896]: pgmap v18: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:23.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:23 smithi155 ceph-mon[79928]: Reconfiguring mds.cephfs.smithi119.rpmijj (monmap changed)... 2024-09-13T21:47:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:23 smithi155 ceph-mon[79928]: Reconfiguring daemon mds.cephfs.smithi119.rpmijj on smithi119 2024-09-13T21:47:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:23 smithi155 ceph-mon[79928]: pgmap v18: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:24.209 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:24.209 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:24.209 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:24 smithi119 ceph-mon[90896]: Reconfiguring mds.cephfs.smithi119.yydzwt (monmap changed)... 2024-09-13T21:47:24.209 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.yydzwt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:47:24.209 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:24.209 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:24 smithi119 ceph-mon[90896]: Reconfiguring daemon mds.cephfs.smithi119.yydzwt on smithi119 2024-09-13T21:47:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:24 smithi155 ceph-mon[79928]: Reconfiguring mds.cephfs.smithi119.yydzwt (monmap changed)... 2024-09-13T21:47:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.yydzwt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:47:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:24 smithi155 ceph-mon[79928]: Reconfiguring daemon mds.cephfs.smithi119.yydzwt on smithi119 2024-09-13T21:47:25.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:25 smithi155 ceph-mon[79928]: pgmap v19: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:25.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:25.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:25.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:47:25.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:25.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:25 smithi119 ceph-mon[90896]: pgmap v19: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:25.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:25.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:25.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:47:25.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:26.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:26 smithi119 ceph-mon[90896]: Reconfiguring crash.smithi155 (monmap changed)... 2024-09-13T21:47:26.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:26 smithi119 ceph-mon[90896]: Reconfiguring daemon crash.smithi155 on smithi155 2024-09-13T21:47:26.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:26 smithi155 ceph-mon[79928]: Reconfiguring crash.smithi155 (monmap changed)... 2024-09-13T21:47:26.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:26 smithi155 ceph-mon[79928]: Reconfiguring daemon crash.smithi155 on smithi155 2024-09-13T21:47:27.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:27 smithi155 ceph-mon[79928]: pgmap v20: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:27.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:27.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:27.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:27 smithi155 ceph-mon[79928]: Reconfiguring mgr.smithi155.wuuxfd (monmap changed)... 2024-09-13T21:47:27.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.wuuxfd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:47:27.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:47:27.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:27.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:27 smithi155 ceph-mon[79928]: Reconfiguring daemon mgr.smithi155.wuuxfd on smithi155 2024-09-13T21:47:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:27 smithi119 ceph-mon[90896]: pgmap v20: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:27 smithi119 ceph-mon[90896]: Reconfiguring mgr.smithi155.wuuxfd (monmap changed)... 2024-09-13T21:47:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi155.wuuxfd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T21:47:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T21:47:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:27.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:27 smithi119 ceph-mon[90896]: Reconfiguring daemon mgr.smithi155.wuuxfd on smithi155 2024-09-13T21:47:28.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.331+0000 7f6261c4e640 1 -- 172.21.15.119:0/543302929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f625c066670 msgr2=0x7f625c0ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:28.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.331+0000 7f6261c4e640 1 --2- 172.21.15.119:0/543302929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f625c066670 0x7f625c0ff200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f624c009c50 tx=0x7f624c004d10 comp rx=0 tx=0).stop 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.331+0000 7f6261c4e640 1 -- 172.21.15.119:0/543302929 shutdown_connections 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.331+0000 7f6261c4e640 1 --2- 172.21.15.119:0/543302929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625c0ff740 0x7f625c101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.331+0000 7f6261c4e640 1 --2- 172.21.15.119:0/543302929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f625c066670 0x7f625c0ff200 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.331+0000 7f6261c4e640 1 -- 172.21.15.119:0/543302929 >> 172.21.15.119:0/543302929 conn(0x7f625c0f6c10 msgr2=0x7f625c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.331+0000 7f6261c4e640 1 -- 172.21.15.119:0/543302929 shutdown_connections 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.331+0000 7f6261c4e640 1 -- 172.21.15.119:0/543302929 wait complete. 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.331+0000 7f6261c4e640 1 Processor -- start 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f6261c4e640 1 -- start start 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f6261c4e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625c066670 0x7f625c10d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f6261c4e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f625c0ff740 0x7f625c10d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f6261c4e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c10dd00 con 0x7f625c0ff740 2024-09-13T21:47:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f6261c4e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c10e520 con 0x7f625c066670 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f625affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f625c0ff740 0x7f625c10d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f625affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f625c0ff740 0x7f625c10d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43062/0 (socket says 172.21.15.119:43062) 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f625affd640 1 -- 172.21.15.119:0/965797051 learned_addr learned my addr 172.21.15.119:0/965797051 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f625b7fe640 1 --2- 172.21.15.119:0/965797051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625c066670 0x7f625c10d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f625affd640 1 -- 172.21.15.119:0/965797051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625c066670 msgr2=0x7f625c10d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f625affd640 1 --2- 172.21.15.119:0/965797051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625c066670 0x7f625c10d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f625affd640 1 -- 172.21.15.119:0/965797051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0098b0 con 0x7f625c0ff740 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.332+0000 7f625affd640 1 --2- 172.21.15.119:0/965797051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f625c0ff740 0x7f625c10d6b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6250002f40 tx=0x7f625000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.333+0000 7f6243fff640 1 -- 172.21.15.119:0/965797051 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6250007c30 con 0x7f625c0ff740 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.333+0000 7f6261c4e640 1 -- 172.21.15.119:0/965797051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c10e750 con 0x7f625c0ff740 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.333+0000 7f6243fff640 1 -- 172.21.15.119:0/965797051 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f625000f040 con 0x7f625c0ff740 2024-09-13T21:47:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.333+0000 7f6243fff640 1 -- 172.21.15.119:0/965797051 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f625000cbe0 con 0x7f625c0ff740 2024-09-13T21:47:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.333+0000 7f6261c4e640 1 -- 172.21.15.119:0/965797051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c10ecf0 con 0x7f625c0ff740 2024-09-13T21:47:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.334+0000 7f6261c4e640 1 -- 172.21.15.119:0/965797051 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c0fa8b0 con 0x7f625c0ff740 2024-09-13T21:47:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.334+0000 7f6243fff640 1 -- 172.21.15.119:0/965797051 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f625000cd40 con 0x7f625c0ff740 2024-09-13T21:47:28.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.335+0000 7f6243fff640 1 --2- 172.21.15.119:0/965797051 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f624406e660 0x7f6244070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:28.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.335+0000 7f6243fff640 1 -- 172.21.15.119:0/965797051 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f625008e0d0 con 0x7f625c0ff740 2024-09-13T21:47:28.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.335+0000 7f625b7fe640 1 --2- 172.21.15.119:0/965797051 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f624406e660 0x7f6244070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:28.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.335+0000 7f625b7fe640 1 --2- 172.21.15.119:0/965797051 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f624406e660 0x7f6244070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f624c032470 tx=0x7f624c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.340+0000 7f6243fff640 1 -- 172.21.15.119:0/965797051 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6250056ff0 con 0x7f625c0ff740 2024-09-13T21:47:28.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.524+0000 7f6261c4e640 1 -- 172.21.15.119:0/965797051 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f625c10f050 con 0x7f624406e660 2024-09-13T21:47:28.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.526+0000 7f6243fff640 1 -- 172.21.15.119:0/965797051 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f625c10f050 con 0x7f624406e660 2024-09-13T21:47:28.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.528+0000 7f6261c4e640 1 -- 172.21.15.119:0/965797051 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f624406e660 msgr2=0x7f6244070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:28.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.528+0000 7f6261c4e640 1 --2- 172.21.15.119:0/965797051 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f624406e660 0x7f6244070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f624c032470 tx=0x7f624c004d10 comp rx=0 tx=0).stop 2024-09-13T21:47:28.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.528+0000 7f6261c4e640 1 -- 172.21.15.119:0/965797051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f625c0ff740 msgr2=0x7f625c10d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:28.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.528+0000 7f6261c4e640 1 --2- 172.21.15.119:0/965797051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f625c0ff740 0x7f625c10d6b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6250002f40 tx=0x7f625000b040 comp rx=0 tx=0).stop 2024-09-13T21:47:28.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.528+0000 7f6261c4e640 1 -- 172.21.15.119:0/965797051 shutdown_connections 2024-09-13T21:47:28.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.528+0000 7f6261c4e640 1 --2- 172.21.15.119:0/965797051 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f624406e660 0x7f6244070b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.528+0000 7f6261c4e640 1 --2- 172.21.15.119:0/965797051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f625c0ff740 0x7f625c10d6b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.528+0000 7f6261c4e640 1 --2- 172.21.15.119:0/965797051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625c066670 0x7f625c10d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.528+0000 7f6261c4e640 1 -- 172.21.15.119:0/965797051 >> 172.21.15.119:0/965797051 conn(0x7f625c0f6c10 msgr2=0x7f625c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:28.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.528+0000 7f6261c4e640 1 -- 172.21.15.119:0/965797051 shutdown_connections 2024-09-13T21:47:28.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.528+0000 7f6261c4e640 1 -- 172.21.15.119:0/965797051 wait complete. 2024-09-13T21:47:28.538 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:47:28.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.608+0000 7fd5c6fce640 1 -- 172.21.15.119:0/1436548950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c00fc740 msgr2=0x7fd5c00fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:28.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.608+0000 7fd5c6fce640 1 --2- 172.21.15.119:0/1436548950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c00fc740 0x7fd5c00fcbb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac0048d0 tx=0x7fd5ac009da0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.608+0000 7fd5c6fce640 1 -- 172.21.15.119:0/1436548950 shutdown_connections 2024-09-13T21:47:28.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.608+0000 7fd5c6fce640 1 --2- 172.21.15.119:0/1436548950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c00fc740 0x7fd5c00fcbb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.608+0000 7fd5c6fce640 1 --2- 172.21.15.119:0/1436548950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00fb470 0x7fd5c00fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.608+0000 7fd5c6fce640 1 -- 172.21.15.119:0/1436548950 >> 172.21.15.119:0/1436548950 conn(0x7fd5c00f6c30 msgr2=0x7fd5c00f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:28.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.608+0000 7fd5c6fce640 1 -- 172.21.15.119:0/1436548950 shutdown_connections 2024-09-13T21:47:28.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.608+0000 7fd5c6fce640 1 -- 172.21.15.119:0/1436548950 wait complete. 2024-09-13T21:47:28.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.608+0000 7fd5c6fce640 1 Processor -- start 2024-09-13T21:47:28.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.608+0000 7fd5c6fce640 1 -- start start 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5c6fce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00fb470 0x7fd5c010d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5c6fce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c00fc740 0x7fd5c010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5c6fce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c010dbd0 con 0x7fd5c00fc740 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5c6fce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c010e3f0 con 0x7fd5c00fb470 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c00fc740 0x7fd5c010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c00fc740 0x7fd5c010d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43078/0 (socket says 172.21.15.119:43078) 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5bffff640 1 -- 172.21.15.119:0/2033389377 learned_addr learned my addr 172.21.15.119:0/2033389377 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5c4d6a640 1 --2- 172.21.15.119:0/2033389377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00fb470 0x7fd5c010d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5bffff640 1 -- 172.21.15.119:0/2033389377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00fb470 msgr2=0x7fd5c010d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5bffff640 1 --2- 172.21.15.119:0/2033389377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00fb470 0x7fd5c010d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5bffff640 1 -- 172.21.15.119:0/2033389377 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac005040 con 0x7fd5c00fc740 2024-09-13T21:47:28.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.609+0000 7fd5bffff640 1 --2- 172.21.15.119:0/2033389377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c00fc740 0x7fd5c010d580 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac003080 tx=0x7fd5ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:28.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.610+0000 7fd5bd7fa640 1 -- 172.21.15.119:0/2033389377 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5ac038070 con 0x7fd5c00fc740 2024-09-13T21:47:28.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.610+0000 7fd5bd7fa640 1 -- 172.21.15.119:0/2033389377 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd5ac02abd0 con 0x7fd5c00fc740 2024-09-13T21:47:28.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.610+0000 7fd5c6fce640 1 -- 172.21.15.119:0/2033389377 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c010e620 con 0x7fd5c00fc740 2024-09-13T21:47:28.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.610+0000 7fd5bd7fa640 1 -- 172.21.15.119:0/2033389377 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5ac03e670 con 0x7fd5c00fc740 2024-09-13T21:47:28.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.610+0000 7fd5c6fce640 1 -- 172.21.15.119:0/2033389377 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c010ebc0 con 0x7fd5c00fc740 2024-09-13T21:47:28.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.611+0000 7fd5c6fce640 1 -- 172.21.15.119:0/2033389377 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c00fa8d0 con 0x7fd5c00fc740 2024-09-13T21:47:28.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.611+0000 7fd5bd7fa640 1 -- 172.21.15.119:0/2033389377 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fd5ac030020 con 0x7fd5c00fc740 2024-09-13T21:47:28.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.612+0000 7fd5bd7fa640 1 --2- 172.21.15.119:0/2033389377 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5b006e660 0x7fd5b0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:28.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.612+0000 7fd5c4d6a640 1 --2- 172.21.15.119:0/2033389377 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5b006e660 0x7fd5b0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:28.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.612+0000 7fd5bd7fa640 1 -- 172.21.15.119:0/2033389377 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd5ac0ae5f0 con 0x7fd5c00fc740 2024-09-13T21:47:28.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.612+0000 7fd5c4d6a640 1 --2- 172.21.15.119:0/2033389377 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5b006e660 0x7fd5b0070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40041d0 tx=0x7fd5b4004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:28.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.616+0000 7fd5bd7fa640 1 -- 172.21.15.119:0/2033389377 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd5ac0776d0 con 0x7fd5c00fc740 2024-09-13T21:47:28.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.799+0000 7fd5c6fce640 1 -- 172.21.15.119:0/2033389377 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5c0103ee0 con 0x7fd5b006e660 2024-09-13T21:47:28.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.801+0000 7fd5bd7fa640 1 -- 172.21.15.119:0/2033389377 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fd5c0103ee0 con 0x7fd5b006e660 2024-09-13T21:47:28.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.803+0000 7fd5c6fce640 1 -- 172.21.15.119:0/2033389377 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5b006e660 msgr2=0x7fd5b0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:28.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.803+0000 7fd5c6fce640 1 --2- 172.21.15.119:0/2033389377 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5b006e660 0x7fd5b0070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40041d0 tx=0x7fd5b4004330 comp rx=0 tx=0).stop 2024-09-13T21:47:28.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.803+0000 7fd5c6fce640 1 -- 172.21.15.119:0/2033389377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c00fc740 msgr2=0x7fd5c010d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:28.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.803+0000 7fd5c6fce640 1 --2- 172.21.15.119:0/2033389377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c00fc740 0x7fd5c010d580 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac003080 tx=0x7fd5ac009da0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.803+0000 7fd5c6fce640 1 -- 172.21.15.119:0/2033389377 shutdown_connections 2024-09-13T21:47:28.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.803+0000 7fd5c6fce640 1 --2- 172.21.15.119:0/2033389377 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5b006e660 0x7fd5b0070b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.803+0000 7fd5c6fce640 1 --2- 172.21.15.119:0/2033389377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5c00fc740 0x7fd5c010d580 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.803+0000 7fd5c6fce640 1 --2- 172.21.15.119:0/2033389377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00fb470 0x7fd5c010d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.803+0000 7fd5c6fce640 1 -- 172.21.15.119:0/2033389377 >> 172.21.15.119:0/2033389377 conn(0x7fd5c00f6c30 msgr2=0x7fd5c00f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:28.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.803+0000 7fd5c6fce640 1 -- 172.21.15.119:0/2033389377 shutdown_connections 2024-09-13T21:47:28.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.803+0000 7fd5c6fce640 1 -- 172.21.15.119:0/2033389377 wait complete. 2024-09-13T21:47:28.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:28 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:28.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:28 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:28.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:28 smithi119 ceph-mon[90896]: Reconfiguring mon.smithi155 (monmap changed)... 2024-09-13T21:47:28.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:28 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:47:28.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:28 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:47:28.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:28 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:28.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:28 smithi119 ceph-mon[90896]: Reconfiguring daemon mon.smithi155 on smithi155 2024-09-13T21:47:28.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:28 smithi119 ceph-mon[90896]: pgmap v21: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:28.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.881+0000 7fae6c7f2640 1 -- 172.21.15.119:0/82980591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae640fc540 msgr2=0x7fae640fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:28.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.881+0000 7fae6c7f2640 1 --2- 172.21.15.119:0/82980591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae640fc540 0x7fae640fc950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae600048d0 tx=0x7fae60009da0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.881+0000 7fae6c7f2640 1 -- 172.21.15.119:0/82980591 shutdown_connections 2024-09-13T21:47:28.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.881+0000 7fae6c7f2640 1 --2- 172.21.15.119:0/82980591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640fd810 0x7fae640fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.881+0000 7fae6c7f2640 1 --2- 172.21.15.119:0/82980591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae640fc540 0x7fae640fc950 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.881+0000 7fae6c7f2640 1 -- 172.21.15.119:0/82980591 >> 172.21.15.119:0/82980591 conn(0x7fae640f7ce0 msgr2=0x7fae640fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.881+0000 7fae6c7f2640 1 -- 172.21.15.119:0/82980591 shutdown_connections 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.881+0000 7fae6c7f2640 1 -- 172.21.15.119:0/82980591 wait complete. 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6c7f2640 1 Processor -- start 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6c7f2640 1 -- start start 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6c7f2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae640fc540 0x7fae6410d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6c7f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640fd810 0x7fae6410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6c7f2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6410dc00 con 0x7fae640fc540 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6c7f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6410e420 con 0x7fae640fd810 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6a58e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae640fc540 0x7fae6410d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:28.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6a58e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae640fc540 0x7fae6410d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43096/0 (socket says 172.21.15.119:43096) 2024-09-13T21:47:28.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6a58e640 1 -- 172.21.15.119:0/925552526 learned_addr learned my addr 172.21.15.119:0/925552526 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:47:28.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae69d8d640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640fd810 0x7fae6410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:28.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6a58e640 1 -- 172.21.15.119:0/925552526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640fd810 msgr2=0x7fae6410d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:28.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6a58e640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640fd810 0x7fae6410d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:28.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6a58e640 1 -- 172.21.15.119:0/925552526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60005040 con 0x7fae640fc540 2024-09-13T21:47:28.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae69d8d640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640fd810 0x7fae6410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:47:28.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.882+0000 7fae6a58e640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae640fc540 0x7fae6410d070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae600043d0 tx=0x7fae60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:28.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.883+0000 7fae5affd640 1 -- 172.21.15.119:0/925552526 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae60038070 con 0x7fae640fc540 2024-09-13T21:47:28.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.883+0000 7fae5affd640 1 -- 172.21.15.119:0/925552526 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fae6002ae90 con 0x7fae640fc540 2024-09-13T21:47:28.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.883+0000 7fae6c7f2640 1 -- 172.21.15.119:0/925552526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6410e650 con 0x7fae640fc540 2024-09-13T21:47:28.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.883+0000 7fae5affd640 1 -- 172.21.15.119:0/925552526 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae6003e670 con 0x7fae640fc540 2024-09-13T21:47:28.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.883+0000 7fae6c7f2640 1 -- 172.21.15.119:0/925552526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6410ebf0 con 0x7fae640fc540 2024-09-13T21:47:28.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.884+0000 7fae6c7f2640 1 -- 172.21.15.119:0/925552526 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae640fb9a0 con 0x7fae640fc540 2024-09-13T21:47:28.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.884+0000 7fae5affd640 1 -- 172.21.15.119:0/925552526 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fae60030020 con 0x7fae640fc540 2024-09-13T21:47:28.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.885+0000 7fae5affd640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fae5006e660 0x7fae50070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:28.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.885+0000 7fae69d8d640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fae5006e660 0x7fae50070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:28.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.885+0000 7fae5affd640 1 -- 172.21.15.119:0/925552526 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fae600ae450 con 0x7fae640fc540 2024-09-13T21:47:28.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.885+0000 7fae69d8d640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fae5006e660 0x7fae50070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fae54009fd0 tx=0x7fae54009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:28.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:28.889+0000 7fae5affd640 1 -- 172.21.15.119:0/925552526 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fae60077500 con 0x7fae640fc540 2024-09-13T21:47:29.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.060+0000 7fae6c7f2640 1 -- 172.21.15.119:0/925552526 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fae6410ef70 con 0x7fae5006e660 2024-09-13T21:47:29.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.069+0000 7fae5affd640 1 -- 172.21.15.119:0/925552526 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fae6410ef70 con 0x7fae5006e660 2024-09-13T21:47:29.071 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:47:29.071 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (118s) 31s ago 10m 16.9M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:47:29.071 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (10m) 31s ago 10m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 c6a79bd22109 2024-09-13T21:47:29.071 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (9m) 19s ago 9m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 1bccd1b9bda0 2024-09-13T21:47:29.071 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (106s) 31s ago 10m 82.3M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:47:29.071 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (5m) 31s ago 5m 12.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:47:29.071 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (5m) 31s ago 5m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:47:29.071 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (5m) 19s ago 5m 16.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (5m) 19s ago 5m 110M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (90s) 31s ago 11m 473M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (55s) 19s ago 9m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (43s) 31s ago 11m 28.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (24s) 19s ago 9m 23.3M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (2m) 31s ago 10m 8572k - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (97s) 19s ago 9m 8514k - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (8m) 31s ago 8m 214M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 6e0bbff1ac3f 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (8m) 31s ago 8m 233M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (7m) 31s ago 7m 191M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (7m) 19s ago 7m 266M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (7m) 19s ago 7m 228M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:47:29.072 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (6m) 19s ago 6m 226M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:47:29.073 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (60s) 31s ago 10m 46.5M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:47:29.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.071+0000 7fae6c7f2640 1 -- 172.21.15.119:0/925552526 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fae5006e660 msgr2=0x7fae50070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.071+0000 7fae6c7f2640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fae5006e660 0x7fae50070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fae54009fd0 tx=0x7fae54009e50 comp rx=0 tx=0).stop 2024-09-13T21:47:29.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.071+0000 7fae6c7f2640 1 -- 172.21.15.119:0/925552526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae640fc540 msgr2=0x7fae6410d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.071+0000 7fae6c7f2640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae640fc540 0x7fae6410d070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae600043d0 tx=0x7fae60009da0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.071+0000 7fae6c7f2640 1 -- 172.21.15.119:0/925552526 shutdown_connections 2024-09-13T21:47:29.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.071+0000 7fae6c7f2640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fae5006e660 0x7fae50070b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.071+0000 7fae6c7f2640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640fd810 0x7fae6410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.071+0000 7fae6c7f2640 1 --2- 172.21.15.119:0/925552526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae640fc540 0x7fae6410d070 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.071+0000 7fae6c7f2640 1 -- 172.21.15.119:0/925552526 >> 172.21.15.119:0/925552526 conn(0x7fae640f7ce0 msgr2=0x7fae640f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:29.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.071+0000 7fae6c7f2640 1 -- 172.21.15.119:0/925552526 shutdown_connections 2024-09-13T21:47:29.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.071+0000 7fae6c7f2640 1 -- 172.21.15.119:0/925552526 wait complete. 2024-09-13T21:47:29.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:28 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:29.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:28 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:29.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:28 smithi155 ceph-mon[79928]: Reconfiguring mon.smithi155 (monmap changed)... 2024-09-13T21:47:29.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:28 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T21:47:29.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:28 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T21:47:29.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:28 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:29.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:28 smithi155 ceph-mon[79928]: Reconfiguring daemon mon.smithi155 on smithi155 2024-09-13T21:47:29.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:28 smithi155 ceph-mon[79928]: pgmap v21: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.150+0000 7f2be56dd640 1 -- 172.21.15.119:0/2553562323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be00fd7f0 msgr2=0x7f2be00fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.150+0000 7f2be56dd640 1 --2- 172.21.15.119:0/2553562323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be00fd7f0 0x7f2be00fdc60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80048d0 tx=0x7f2bc8009da0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.150+0000 7f2be56dd640 1 -- 172.21.15.119:0/2553562323 shutdown_connections 2024-09-13T21:47:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.150+0000 7f2be56dd640 1 --2- 172.21.15.119:0/2553562323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be00fd7f0 0x7f2be00fdc60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.150+0000 7f2be56dd640 1 --2- 172.21.15.119:0/2553562323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be00fc520 0x7f2be00fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.150+0000 7f2be56dd640 1 -- 172.21.15.119:0/2553562323 >> 172.21.15.119:0/2553562323 conn(0x7f2be00f7ce0 msgr2=0x7f2be00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.150+0000 7f2be56dd640 1 -- 172.21.15.119:0/2553562323 shutdown_connections 2024-09-13T21:47:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.150+0000 7f2be56dd640 1 -- 172.21.15.119:0/2553562323 wait complete. 2024-09-13T21:47:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.151+0000 7f2be56dd640 1 Processor -- start 2024-09-13T21:47:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.151+0000 7f2be56dd640 1 -- start start 2024-09-13T21:47:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.151+0000 7f2be56dd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be00fc520 0x7f2be010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.151+0000 7f2be56dd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be00fd7f0 0x7f2be010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.151+0000 7f2be56dd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be010dbf0 con 0x7f2be00fd7f0 2024-09-13T21:47:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.151+0000 7f2be56dd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be010e410 con 0x7f2be00fc520 2024-09-13T21:47:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.151+0000 7f2bde7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be00fd7f0 0x7f2be010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.151+0000 7f2bde7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be00fd7f0 0x7f2be010d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43122/0 (socket says 172.21.15.119:43122) 2024-09-13T21:47:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.151+0000 7f2bde7fc640 1 -- 172.21.15.119:0/3706186022 learned_addr learned my addr 172.21.15.119:0/3706186022 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:47:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.151+0000 7f2bdeffd640 1 --2- 172.21.15.119:0/3706186022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be00fc520 0x7f2be010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.152+0000 7f2bde7fc640 1 -- 172.21.15.119:0/3706186022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be00fc520 msgr2=0x7f2be010d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.152+0000 7f2bde7fc640 1 --2- 172.21.15.119:0/3706186022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be00fc520 0x7f2be010d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.152+0000 7f2bde7fc640 1 -- 172.21.15.119:0/3706186022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc8005040 con 0x7f2be00fd7f0 2024-09-13T21:47:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.152+0000 7f2bde7fc640 1 --2- 172.21.15.119:0/3706186022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be00fd7f0 0x7f2be010d5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8003080 tx=0x7f2bc8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.157+0000 7f2bd77fe640 1 -- 172.21.15.119:0/3706186022 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bc8038070 con 0x7f2be00fd7f0 2024-09-13T21:47:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.157+0000 7f2bd77fe640 1 -- 172.21.15.119:0/3706186022 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2bc8009800 con 0x7f2be00fd7f0 2024-09-13T21:47:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.158+0000 7f2bd77fe640 1 -- 172.21.15.119:0/3706186022 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bc8033660 con 0x7f2be00fd7f0 2024-09-13T21:47:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.158+0000 7f2be56dd640 1 -- 172.21.15.119:0/3706186022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be010e640 con 0x7f2be00fd7f0 2024-09-13T21:47:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.158+0000 7f2be56dd640 1 -- 172.21.15.119:0/3706186022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be010eac0 con 0x7f2be00fd7f0 2024-09-13T21:47:29.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.159+0000 7f2be56dd640 1 -- 172.21.15.119:0/3706186022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be00fb980 con 0x7f2be00fd7f0 2024-09-13T21:47:29.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.159+0000 7f2bd77fe640 1 -- 172.21.15.119:0/3706186022 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f2bc8030020 con 0x7f2be00fd7f0 2024-09-13T21:47:29.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.160+0000 7f2bd77fe640 1 --2- 172.21.15.119:0/3706186022 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2bcc06e710 0x7f2bcc070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:29.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.160+0000 7f2bd77fe640 1 -- 172.21.15.119:0/3706186022 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2bc80ae1d0 con 0x7f2be00fd7f0 2024-09-13T21:47:29.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.160+0000 7f2bdeffd640 1 --2- 172.21.15.119:0/3706186022 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2bcc06e710 0x7f2bcc070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:29.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.160+0000 7f2bdeffd640 1 --2- 172.21.15.119:0/3706186022 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2bcc06e710 0x7f2bcc070bc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8007fd0 tx=0x7f2bd8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:29.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.164+0000 7f2bd77fe640 1 -- 172.21.15.119:0/3706186022 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2bc80773d0 con 0x7f2be00fd7f0 2024-09-13T21:47:29.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.402+0000 7f2be56dd640 1 -- 172.21.15.119:0/3706186022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2be0104f30 con 0x7f2be00fd7f0 2024-09-13T21:47:29.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.402+0000 7f2bd77fe640 1 -- 172.21.15.119:0/3706186022 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f2bc807aa90 con 0x7f2be00fd7f0 2024-09-13T21:47:29.404 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:47:29.405 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:47:29.405 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:47:29.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:47:29.405 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:47:29.405 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:47:29.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:47:29.405 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:47:29.406 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T21:47:29.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:47:29.406 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:47:29.406 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:47:29.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:47:29.406 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:47:29.407 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 10, 2024-09-13T21:47:29.407 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:47:29.407 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:47:29.407 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:47:29.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.405+0000 7f2be56dd640 1 -- 172.21.15.119:0/3706186022 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2bcc06e710 msgr2=0x7f2bcc070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.405+0000 7f2be56dd640 1 --2- 172.21.15.119:0/3706186022 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2bcc06e710 0x7f2bcc070bc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8007fd0 tx=0x7f2bd8009040 comp rx=0 tx=0).stop 2024-09-13T21:47:29.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.405+0000 7f2be56dd640 1 -- 172.21.15.119:0/3706186022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be00fd7f0 msgr2=0x7f2be010d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.405+0000 7f2be56dd640 1 --2- 172.21.15.119:0/3706186022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be00fd7f0 0x7f2be010d5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8003080 tx=0x7f2bc8009da0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.405+0000 7f2be56dd640 1 -- 172.21.15.119:0/3706186022 shutdown_connections 2024-09-13T21:47:29.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.405+0000 7f2be56dd640 1 --2- 172.21.15.119:0/3706186022 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2bcc06e710 0x7f2bcc070bc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.405+0000 7f2be56dd640 1 --2- 172.21.15.119:0/3706186022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2be00fd7f0 0x7f2be010d5a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.405+0000 7f2be56dd640 1 --2- 172.21.15.119:0/3706186022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be00fc520 0x7f2be010d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.405+0000 7f2be56dd640 1 -- 172.21.15.119:0/3706186022 >> 172.21.15.119:0/3706186022 conn(0x7f2be00f7ce0 msgr2=0x7f2be00f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:29.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.405+0000 7f2be56dd640 1 -- 172.21.15.119:0/3706186022 shutdown_connections 2024-09-13T21:47:29.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.405+0000 7f2be56dd640 1 -- 172.21.15.119:0/3706186022 wait complete. 2024-09-13T21:47:29.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.482+0000 7f79525c9640 1 -- 172.21.15.119:0/1375002577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f794c0fb430 msgr2=0x7f794c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.482+0000 7f79525c9640 1 --2- 172.21.15.119:0/1375002577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f794c0fb430 0x7f794c0fb840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f793c0048d0 tx=0x7f793c009da0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 -- 172.21.15.119:0/1375002577 shutdown_connections 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 --2- 172.21.15.119:0/1375002577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0fc700 0x7f794c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 --2- 172.21.15.119:0/1375002577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f794c0fb430 0x7f794c0fb840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 -- 172.21.15.119:0/1375002577 >> 172.21.15.119:0/1375002577 conn(0x7f794c0f6c10 msgr2=0x7f794c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 -- 172.21.15.119:0/1375002577 shutdown_connections 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 -- 172.21.15.119:0/1375002577 wait complete. 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 Processor -- start 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 -- start start 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0fb430 0x7f794c0ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f794c0fc700 0x7f794c0fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0fdfd0 con 0x7f794c0fc700 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.483+0000 7f79525c9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0fe110 con 0x7f794c0fb430 2024-09-13T21:47:29.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f794c0fc700 0x7f794c0fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f794c0fc700 0x7f794c0fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43152/0 (socket says 172.21.15.119:43152) 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f794b7fe640 1 -- 172.21.15.119:0/1935800701 learned_addr learned my addr 172.21.15.119:0/1935800701 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f794bfff640 1 --2- 172.21.15.119:0/1935800701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0fb430 0x7f794c0ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f794b7fe640 1 -- 172.21.15.119:0/1935800701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0fb430 msgr2=0x7f794c0ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f794b7fe640 1 --2- 172.21.15.119:0/1935800701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0fb430 0x7f794c0ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f794b7fe640 1 -- 172.21.15.119:0/1935800701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c005040 con 0x7f794c0fc700 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f794b7fe640 1 --2- 172.21.15.119:0/1935800701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f794c0fc700 0x7f794c0fda40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7934002a80 tx=0x7f7934004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f7948ff9640 1 -- 172.21.15.119:0/1935800701 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7934007c30 con 0x7f794c0fc700 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f79525c9640 1 -- 172.21.15.119:0/1935800701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c0fe3f0 con 0x7f794c0fc700 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f7948ff9640 1 -- 172.21.15.119:0/1935800701 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f793400f040 con 0x7f794c0fc700 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f7948ff9640 1 -- 172.21.15.119:0/1935800701 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f793400dab0 con 0x7f794c0fc700 2024-09-13T21:47:29.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.484+0000 7f79525c9640 1 -- 172.21.15.119:0/1935800701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c1150f0 con 0x7f794c0fc700 2024-09-13T21:47:29.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.485+0000 7f79525c9640 1 -- 172.21.15.119:0/1935800701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c0fa890 con 0x7f794c0fc700 2024-09-13T21:47:29.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.486+0000 7f7948ff9640 1 -- 172.21.15.119:0/1935800701 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f793400dc10 con 0x7f794c0fc700 2024-09-13T21:47:29.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.486+0000 7f7948ff9640 1 --2- 172.21.15.119:0/1935800701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f793806e660 0x7f7938070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:29.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.486+0000 7f7948ff9640 1 -- 172.21.15.119:0/1935800701 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f793408dc20 con 0x7f794c0fc700 2024-09-13T21:47:29.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.486+0000 7f794bfff640 1 --2- 172.21.15.119:0/1935800701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f793806e660 0x7f7938070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:29.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.487+0000 7f794bfff640 1 --2- 172.21.15.119:0/1935800701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f793806e660 0x7f7938070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f793c000c00 tx=0x7f793c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:29.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.490+0000 7f7948ff9640 1 -- 172.21.15.119:0/1935800701 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7934056bf0 con 0x7f794c0fc700 2024-09-13T21:47:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.690+0000 7f79525c9640 1 -- 172.21.15.119:0/1935800701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f794c103f00 con 0x7f794c0fc700 2024-09-13T21:47:29.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.690+0000 7f7948ff9640 1 -- 172.21.15.119:0/1935800701 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1962 (secure 0 0 0) 0x7f793405a2b0 con 0x7f794c0fc700 2024-09-13T21:47:29.692 INFO:teuthology.orchestra.run.smithi119.stdout:e20 2024-09-13T21:47:29.692 INFO:teuthology.orchestra.run.smithi119.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T21:47:29.692 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:47:29.692 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:47:29.692 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:47:29.692 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 20 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:45:37.594101+0000 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:47:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:47:29.694 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:47:29.695 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:47:29.695 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 0 members: 2024-09-13T21:47:29.695 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:29.695 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:29.695 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:47:29.695 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:47:29.695 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:47:29.695 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:47:29.695 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:29.695 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:47:29.696 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 20 2024-09-13T21:47:29.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.692+0000 7f79525c9640 1 -- 172.21.15.119:0/1935800701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f793806e660 msgr2=0x7f7938070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.692+0000 7f79525c9640 1 --2- 172.21.15.119:0/1935800701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f793806e660 0x7f7938070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f793c000c00 tx=0x7f793c035040 comp rx=0 tx=0).stop 2024-09-13T21:47:29.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.692+0000 7f79525c9640 1 -- 172.21.15.119:0/1935800701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f794c0fc700 msgr2=0x7f794c0fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.692+0000 7f79525c9640 1 --2- 172.21.15.119:0/1935800701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f794c0fc700 0x7f794c0fda40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7934002a80 tx=0x7f7934004600 comp rx=0 tx=0).stop 2024-09-13T21:47:29.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.692+0000 7f79525c9640 1 -- 172.21.15.119:0/1935800701 shutdown_connections 2024-09-13T21:47:29.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.692+0000 7f79525c9640 1 --2- 172.21.15.119:0/1935800701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f793806e660 0x7f7938070b10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.692+0000 7f79525c9640 1 --2- 172.21.15.119:0/1935800701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f794c0fc700 0x7f794c0fda40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.692+0000 7f79525c9640 1 --2- 172.21.15.119:0/1935800701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794c0fb430 0x7f794c0ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.692+0000 7f79525c9640 1 -- 172.21.15.119:0/1935800701 >> 172.21.15.119:0/1935800701 conn(0x7f794c0f6c10 msgr2=0x7f794c065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:29.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.693+0000 7f79525c9640 1 -- 172.21.15.119:0/1935800701 shutdown_connections 2024-09-13T21:47:29.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.693+0000 7f79525c9640 1 -- 172.21.15.119:0/1935800701 wait complete. 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.770+0000 7f767bf4e640 1 -- 172.21.15.119:0/1330732289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7674065c40 msgr2=0x7f76740ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.770+0000 7f767bf4e640 1 --2- 172.21.15.119:0/1330732289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7674065c40 0x7f76740ff140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7664009c50 tx=0x7f7664004d10 comp rx=0 tx=0).stop 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 -- 172.21.15.119:0/1330732289 shutdown_connections 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 --2- 172.21.15.119:0/1330732289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76740ff680 0x7f7674101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 --2- 172.21.15.119:0/1330732289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7674065c40 0x7f76740ff140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 -- 172.21.15.119:0/1330732289 >> 172.21.15.119:0/1330732289 conn(0x7f76740f6c10 msgr2=0x7f76740f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 -- 172.21.15.119:0/1330732289 shutdown_connections 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 -- 172.21.15.119:0/1330732289 wait complete. 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 Processor -- start 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 -- start start 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7674065c40 0x7f767410d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:29.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76740ff680 0x7f767410d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767410dca0 con 0x7f7674065c40 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f767bf4e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767410e470 con 0x7f76740ff680 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f7679cea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7674065c40 0x7f767410d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f7679cea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7674065c40 0x7f767410d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43168/0 (socket says 172.21.15.119:43168) 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.771+0000 7f7679cea640 1 -- 172.21.15.119:0/3020875046 learned_addr learned my addr 172.21.15.119:0/3020875046 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.772+0000 7f76794e9640 1 --2- 172.21.15.119:0/3020875046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76740ff680 0x7f767410d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.772+0000 7f7679cea640 1 -- 172.21.15.119:0/3020875046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76740ff680 msgr2=0x7f767410d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.772+0000 7f7679cea640 1 --2- 172.21.15.119:0/3020875046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76740ff680 0x7f767410d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.772+0000 7f7679cea640 1 -- 172.21.15.119:0/3020875046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76640098b0 con 0x7f7674065c40 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.772+0000 7f7679cea640 1 --2- 172.21.15.119:0/3020875046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7674065c40 0x7f767410d110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7664004a30 tx=0x7f7664004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.772+0000 7f76727fc640 1 -- 172.21.15.119:0/3020875046 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7664009610 con 0x7f7674065c40 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.772+0000 7f76727fc640 1 -- 172.21.15.119:0/3020875046 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7664032b10 con 0x7f7674065c40 2024-09-13T21:47:29.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.772+0000 7f767bf4e640 1 -- 172.21.15.119:0/3020875046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767410e6a0 con 0x7f7674065c40 2024-09-13T21:47:29.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.772+0000 7f76727fc640 1 -- 172.21.15.119:0/3020875046 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f766403dab0 con 0x7f7674065c40 2024-09-13T21:47:29.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.772+0000 7f767bf4e640 1 -- 172.21.15.119:0/3020875046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767410ec40 con 0x7f7674065c40 2024-09-13T21:47:29.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.773+0000 7f767bf4e640 1 -- 172.21.15.119:0/3020875046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76740fa890 con 0x7f7674065c40 2024-09-13T21:47:29.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.774+0000 7f76727fc640 1 -- 172.21.15.119:0/3020875046 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f766402f030 con 0x7f7674065c40 2024-09-13T21:47:29.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.774+0000 7f76727fc640 1 --2- 172.21.15.119:0/3020875046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f765c06e660 0x7f765c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:29.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.774+0000 7f76727fc640 1 -- 172.21.15.119:0/3020875046 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f76640af270 con 0x7f7674065c40 2024-09-13T21:47:29.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.774+0000 7f76794e9640 1 --2- 172.21.15.119:0/3020875046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f765c06e660 0x7f765c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:29.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.775+0000 7f76794e9640 1 --2- 172.21.15.119:0/3020875046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f765c06e660 0x7f765c070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f767410cec0 tx=0x7f766800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.779+0000 7f76727fc640 1 -- 172.21.15.119:0/3020875046 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7664078210 con 0x7f7674065c40 2024-09-13T21:47:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.961+0000 7f767bf4e640 1 -- 172.21.15.119:0/3020875046 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f767410ef70 con 0x7f765c06e660 2024-09-13T21:47:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.962+0000 7f76727fc640 1 -- 172.21.15.119:0/3020875046 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f767410ef70 con 0x7f765c06e660 2024-09-13T21:47:29.963 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:47:29.964 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:47:29.964 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:47:29.964 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:47:29.964 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:47:29.964 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr", 2024-09-13T21:47:29.964 INFO:teuthology.orchestra.run.smithi119.stdout: "mon" 2024-09-13T21:47:29.964 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:47:29.964 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "4/21 daemons upgraded", 2024-09-13T21:47:29.964 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T21:47:29.964 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:47:29.964 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:47:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.964+0000 7f767bf4e640 1 -- 172.21.15.119:0/3020875046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f765c06e660 msgr2=0x7f765c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.964+0000 7f767bf4e640 1 --2- 172.21.15.119:0/3020875046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f765c06e660 0x7f765c070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f767410cec0 tx=0x7f766800b040 comp rx=0 tx=0).stop 2024-09-13T21:47:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.964+0000 7f767bf4e640 1 -- 172.21.15.119:0/3020875046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7674065c40 msgr2=0x7f767410d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.964+0000 7f767bf4e640 1 --2- 172.21.15.119:0/3020875046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7674065c40 0x7f767410d110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7664004a30 tx=0x7f7664004d10 comp rx=0 tx=0).stop 2024-09-13T21:47:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.964+0000 7f767bf4e640 1 -- 172.21.15.119:0/3020875046 shutdown_connections 2024-09-13T21:47:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.964+0000 7f767bf4e640 1 --2- 172.21.15.119:0/3020875046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f765c06e660 0x7f765c070b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.964+0000 7f767bf4e640 1 --2- 172.21.15.119:0/3020875046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76740ff680 0x7f767410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.964+0000 7f767bf4e640 1 --2- 172.21.15.119:0/3020875046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7674065c40 0x7f767410d110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.964+0000 7f767bf4e640 1 -- 172.21.15.119:0/3020875046 >> 172.21.15.119:0/3020875046 conn(0x7f76740f6c10 msgr2=0x7f76740f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.964+0000 7f767bf4e640 1 -- 172.21.15.119:0/3020875046 shutdown_connections 2024-09-13T21:47:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:29.964+0000 7f767bf4e640 1 -- 172.21.15.119:0/3020875046 wait complete. 2024-09-13T21:47:30.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.043+0000 7f9a01a3d640 1 -- 172.21.15.119:0/2142976741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99fc0fd820 msgr2=0x7f99fc0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:30.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.043+0000 7f9a01a3d640 1 --2- 172.21.15.119:0/2142976741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99fc0fd820 0x7f99fc0fdc90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f99e40048d0 tx=0x7f99e4009da0 comp rx=0 tx=0).stop 2024-09-13T21:47:30.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.043+0000 7f9a01a3d640 1 -- 172.21.15.119:0/2142976741 shutdown_connections 2024-09-13T21:47:30.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.043+0000 7f9a01a3d640 1 --2- 172.21.15.119:0/2142976741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99fc0fd820 0x7f99fc0fdc90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:30.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.043+0000 7f9a01a3d640 1 --2- 172.21.15.119:0/2142976741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99fc0fc550 0x7f99fc0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:30.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.043+0000 7f9a01a3d640 1 -- 172.21.15.119:0/2142976741 >> 172.21.15.119:0/2142976741 conn(0x7f99fc0f7d30 msgr2=0x7f99fc0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:30.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.043+0000 7f9a01a3d640 1 -- 172.21.15.119:0/2142976741 shutdown_connections 2024-09-13T21:47:30.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.043+0000 7f9a01a3d640 1 -- 172.21.15.119:0/2142976741 wait complete. 2024-09-13T21:47:30.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.044+0000 7f9a01a3d640 1 Processor -- start 2024-09-13T21:47:30.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.044+0000 7f9a01a3d640 1 -- start start 2024-09-13T21:47:30.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.044+0000 7f9a01a3d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99fc0fc550 0x7f99fc10f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:30.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.044+0000 7f9a01a3d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99fc0fd820 0x7f99fc10f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:30.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.044+0000 7f9a01a3d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc10fe70 con 0x7f99fc0fd820 2024-09-13T21:47:30.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.044+0000 7f9a01a3d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc110690 con 0x7f99fc0fc550 2024-09-13T21:47:30.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.044+0000 7f99f3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99fc0fd820 0x7f99fc10f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:30.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.044+0000 7f99f3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99fc0fd820 0x7f99fc10f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43184/0 (socket says 172.21.15.119:43184) 2024-09-13T21:47:30.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.044+0000 7f99f3fff640 1 -- 172.21.15.119:0/1085955507 learned_addr learned my addr 172.21.15.119:0/1085955507 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:47:30.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.044+0000 7f99faffd640 1 --2- 172.21.15.119:0/1085955507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99fc0fc550 0x7f99fc10f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:30.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.045+0000 7f99f3fff640 1 -- 172.21.15.119:0/1085955507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99fc0fc550 msgr2=0x7f99fc10f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:30.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.045+0000 7f99f3fff640 1 --2- 172.21.15.119:0/1085955507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99fc0fc550 0x7f99fc10f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:30.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.045+0000 7f99f3fff640 1 -- 172.21.15.119:0/1085955507 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e4005040 con 0x7f99fc0fd820 2024-09-13T21:47:30.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.045+0000 7f99f3fff640 1 --2- 172.21.15.119:0/1085955507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99fc0fd820 0x7f99fc10f820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f99e40043d0 tx=0x7f99e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:30.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.045+0000 7f99f37fe640 1 -- 172.21.15.119:0/1085955507 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99e4038070 con 0x7f99fc0fd820 2024-09-13T21:47:30.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.045+0000 7f99f37fe640 1 -- 172.21.15.119:0/1085955507 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f99e402ae90 con 0x7f99fc0fd820 2024-09-13T21:47:30.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.045+0000 7f9a01a3d640 1 -- 172.21.15.119:0/1085955507 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc1108c0 con 0x7f99fc0fd820 2024-09-13T21:47:30.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.045+0000 7f99f37fe640 1 -- 172.21.15.119:0/1085955507 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99e403e670 con 0x7f99fc0fd820 2024-09-13T21:47:30.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.045+0000 7f9a01a3d640 1 -- 172.21.15.119:0/1085955507 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc110e60 con 0x7f99fc0fd820 2024-09-13T21:47:30.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.046+0000 7f99f17fa640 1 -- 172.21.15.119:0/1085955507 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e0005210 con 0x7f99fc0fd820 2024-09-13T21:47:30.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.047+0000 7f99f37fe640 1 -- 172.21.15.119:0/1085955507 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f99e4030020 con 0x7f99fc0fd820 2024-09-13T21:47:30.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.047+0000 7f99f37fe640 1 --2- 172.21.15.119:0/1085955507 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f99e806e660 0x7f99e8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:47:30.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.047+0000 7f99f37fe640 1 -- 172.21.15.119:0/1085955507 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f99e40ae4a0 con 0x7f99fc0fd820 2024-09-13T21:47:30.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.047+0000 7f99faffd640 1 --2- 172.21.15.119:0/1085955507 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f99e806e660 0x7f99e8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:47:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.048+0000 7f99faffd640 1 --2- 172.21.15.119:0/1085955507 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f99e806e660 0x7f99e8070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f99ec004ed0 tx=0x7f99ec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:47:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.051+0000 7f99f37fe640 1 -- 172.21.15.119:0/1085955507 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f99e4077580 con 0x7f99fc0fd820 2024-09-13T21:47:30.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.286+0000 7f99f17fa640 1 -- 172.21.15.119:0/1085955507 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f99e0005790 con 0x7f99fc0fd820 2024-09-13T21:47:30.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.286+0000 7f99f37fe640 1 -- 172.21.15.119:0/1085955507 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f99e407ac40 con 0x7f99fc0fd820 2024-09-13T21:47:30.288 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:47:30.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.289+0000 7f99f17fa640 1 -- 172.21.15.119:0/1085955507 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f99e806e660 msgr2=0x7f99e8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.289+0000 7f99f17fa640 1 --2- 172.21.15.119:0/1085955507 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f99e806e660 0x7f99e8070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f99ec004ed0 tx=0x7f99ec00b040 comp rx=0 tx=0).stop 2024-09-13T21:47:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.289+0000 7f99f17fa640 1 -- 172.21.15.119:0/1085955507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99fc0fd820 msgr2=0x7f99fc10f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:47:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.289+0000 7f99f17fa640 1 --2- 172.21.15.119:0/1085955507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99fc0fd820 0x7f99fc10f820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f99e40043d0 tx=0x7f99e4009da0 comp rx=0 tx=0).stop 2024-09-13T21:47:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.289+0000 7f99f17fa640 1 -- 172.21.15.119:0/1085955507 shutdown_connections 2024-09-13T21:47:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.289+0000 7f99f17fa640 1 --2- 172.21.15.119:0/1085955507 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f99e806e660 0x7f99e8070b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.289+0000 7f99f17fa640 1 --2- 172.21.15.119:0/1085955507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99fc0fd820 0x7f99fc10f820 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.289+0000 7f99f17fa640 1 --2- 172.21.15.119:0/1085955507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99fc0fc550 0x7f99fc10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:47:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.289+0000 7f99f17fa640 1 -- 172.21.15.119:0/1085955507 >> 172.21.15.119:0/1085955507 conn(0x7f99fc0f7d30 msgr2=0x7f99fc0f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:47:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.289+0000 7f99f17fa640 1 -- 172.21.15.119:0/1085955507 shutdown_connections 2024-09-13T21:47:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:47:30.289+0000 7f99f17fa640 1 -- 172.21.15.119:0/1085955507 wait complete. 2024-09-13T21:47:30.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:30.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:30.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:30.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:30.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:30.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T21:47:30.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:47:30.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:30.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: Reconfiguring daemon osd.3 on smithi155 2024-09-13T21:47:30.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3706186022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:30.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1935800701' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:47:30.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:30 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1085955507' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:47:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:30.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:30.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T21:47:30.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:47:30.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:30.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: Reconfiguring daemon osd.3 on smithi155 2024-09-13T21:47:30.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3706186022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:30.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1935800701' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:47:30.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:30 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1085955507' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:47:31.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:31 smithi155 ceph-mon[79928]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:31.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:31 smithi155 ceph-mon[79928]: pgmap v22: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:31.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:31 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:31.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:31 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:31.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:31 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:47:31.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:31 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:31 smithi119 ceph-mon[90896]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:47:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:31 smithi119 ceph-mon[90896]: pgmap v22: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:31 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:31 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:31 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:47:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:31 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:32.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:32 smithi155 ceph-mon[79928]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T21:47:32.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:32 smithi155 ceph-mon[79928]: Reconfiguring daemon osd.4 on smithi155 2024-09-13T21:47:32.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:32 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:32.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:32 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:32.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:32 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:47:32.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:32 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:32 smithi119 ceph-mon[90896]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T21:47:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:32 smithi119 ceph-mon[90896]: Reconfiguring daemon osd.4 on smithi155 2024-09-13T21:47:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:32 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:32 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:32 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:47:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:32 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:33.535 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:33 smithi155 ceph-mon[79928]: pgmap v23: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:33.535 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:33 smithi155 ceph-mon[79928]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T21:47:33.535 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:33 smithi155 ceph-mon[79928]: Reconfiguring daemon osd.5 on smithi155 2024-09-13T21:47:33.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:33 smithi119 ceph-mon[90896]: pgmap v23: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:33.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:33 smithi119 ceph-mon[90896]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T21:47:33.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:33 smithi119 ceph-mon[90896]: Reconfiguring daemon osd.5 on smithi155 2024-09-13T21:47:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:34 smithi119 ceph-mon[90896]: Reconfiguring mds.cephfs.smithi155.yblkxo (monmap changed)... 2024-09-13T21:47:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.yblkxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:47:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:34 smithi119 ceph-mon[90896]: Reconfiguring daemon mds.cephfs.smithi155.yblkxo on smithi155 2024-09-13T21:47:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:34 smithi119 ceph-mon[90896]: pgmap v24: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:35.038 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:35.039 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:35.039 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:34 smithi155 ceph-mon[79928]: Reconfiguring mds.cephfs.smithi155.yblkxo (monmap changed)... 2024-09-13T21:47:35.039 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.yblkxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:47:35.039 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:35.039 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:34 smithi155 ceph-mon[79928]: Reconfiguring daemon mds.cephfs.smithi155.yblkxo on smithi155 2024-09-13T21:47:35.039 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:34 smithi155 ceph-mon[79928]: pgmap v24: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:36.214 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:36.214 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:36.214 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:35 smithi155 ceph-mon[79928]: Reconfiguring mds.cephfs.smithi155.afmavb (monmap changed)... 2024-09-13T21:47:36.214 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.afmavb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:47:36.215 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:36.215 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:35 smithi155 ceph-mon[79928]: Reconfiguring daemon mds.cephfs.smithi155.afmavb on smithi155 2024-09-13T21:47:36.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:36.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:36.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:35 smithi119 ceph-mon[90896]: Reconfiguring mds.cephfs.smithi155.afmavb (monmap changed)... 2024-09-13T21:47:36.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.afmavb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:47:36.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:36.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:35 smithi119 ceph-mon[90896]: Reconfiguring daemon mds.cephfs.smithi155.afmavb on smithi155 2024-09-13T21:47:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: pgmap v25: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: Upgrade: Setting container_image for all mon 2024-09-13T21:47:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi119"}]: dispatch 2024-09-13T21:47:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi119"}]': finished 2024-09-13T21:47:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi155"}]: dispatch 2024-09-13T21:47:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi155"}]': finished 2024-09-13T21:47:37.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: pgmap v25: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: Upgrade: Setting container_image for all mon 2024-09-13T21:47:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi119"}]: dispatch 2024-09-13T21:47:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi119"}]': finished 2024-09-13T21:47:37.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi155"}]: dispatch 2024-09-13T21:47:37.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi155"}]': finished 2024-09-13T21:47:37.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:39.057 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:38 smithi119 ceph-mon[90896]: Upgrade: Updating crash.smithi119 (1/2) 2024-09-13T21:47:39.057 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:38 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:39.057 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:38 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:47:39.057 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:38 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:39.057 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:38 smithi119 ceph-mon[90896]: Deploying daemon crash.smithi119 on smithi119 2024-09-13T21:47:39.057 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:38 smithi119 ceph-mon[90896]: pgmap v26: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:38 smithi155 ceph-mon[79928]: Upgrade: Updating crash.smithi119 (1/2) 2024-09-13T21:47:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:38 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:38 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:47:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:38 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:38 smithi155 ceph-mon[79928]: Deploying daemon crash.smithi119 on smithi119 2024-09-13T21:47:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:38 smithi155 ceph-mon[79928]: pgmap v26: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:41.316 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:41 smithi119 ceph-mon[90896]: pgmap v27: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:41.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:41 smithi155 ceph-mon[79928]: pgmap v27: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:42.606 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:42 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:42.606 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:42 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:42.745 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:42 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:42.746 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:42 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:43.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:43 smithi119 ceph-mon[90896]: pgmap v28: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:43.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:43 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:43.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:43 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:47:43.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:43 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:43 smithi155 ceph-mon[79928]: pgmap v28: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:43 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:43 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi155", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T21:47:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:43 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:44.382 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:44 smithi155 ceph-mon[79928]: Upgrade: Updating crash.smithi155 (2/2) 2024-09-13T21:47:44.382 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:44 smithi155 ceph-mon[79928]: Deploying daemon crash.smithi155 on smithi155 2024-09-13T21:47:44.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:44 smithi119 ceph-mon[90896]: Upgrade: Updating crash.smithi155 (2/2) 2024-09-13T21:47:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:44 smithi119 ceph-mon[90896]: Deploying daemon crash.smithi155 on smithi155 2024-09-13T21:47:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:45 smithi155 ceph-mon[79928]: pgmap v29: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:45 smithi119 ceph-mon[90896]: pgmap v29: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:47.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:47 smithi119 ceph-mon[90896]: pgmap v30: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:47.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:47 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:47.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:47 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:47.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:47 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:47.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:47 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:47.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:47 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:47 smithi155 ceph-mon[79928]: pgmap v30: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:47 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:47 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:47 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:47 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:47 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:49.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:49 smithi155 ceph-mon[79928]: pgmap v31: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:49.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:49 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:49.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:49 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:49.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:49 smithi119 ceph-mon[90896]: pgmap v31: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:49.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:49 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:49.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:49 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:51.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:51.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:51.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:50 smithi155 ceph-mon[79928]: pgmap v32: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:51.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:51.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:51.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:50 smithi119 ceph-mon[90896]: pgmap v32: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:52.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:52.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:52.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:52.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:52.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:52.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:52.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:52.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:53.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:53 smithi155 ceph-mon[79928]: pgmap v33: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:53.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:53.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:53.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:53.422 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:53 smithi119 ceph-mon[90896]: pgmap v33: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:53.422 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:47:53.423 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:53.423 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:55.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: pgmap v34: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:55.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:55.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:55.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:55.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:47:55.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:55.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:55.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:55.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:55.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:55.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:55.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi119"}]: dispatch 2024-09-13T21:47:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: pgmap v34: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:47:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:47:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:47:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi119"}]: dispatch 2024-09-13T21:47:56.522 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:56 smithi119 ceph-mon[90896]: Upgrade: Setting container_image for all crash 2024-09-13T21:47:56.523 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi119"}]': finished 2024-09-13T21:47:56.523 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi155"}]: dispatch 2024-09-13T21:47:56.523 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi155"}]': finished 2024-09-13T21:47:56.523 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T21:47:56.523 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:56 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T21:47:56.523 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:56 smithi119 ceph-mon[90896]: Upgrade: osd.0 is safe to restart 2024-09-13T21:47:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:56 smithi155 ceph-mon[79928]: Upgrade: Setting container_image for all crash 2024-09-13T21:47:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi119"}]': finished 2024-09-13T21:47:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi155"}]: dispatch 2024-09-13T21:47:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi155"}]': finished 2024-09-13T21:47:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T21:47:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:56 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T21:47:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:56 smithi155 ceph-mon[79928]: Upgrade: osd.0 is safe to restart 2024-09-13T21:47:57.226 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:57 smithi119 ceph-mon[90896]: pgmap v35: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:57.226 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:57.226 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:47:57.226 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:57 smithi155 ceph-mon[79928]: pgmap v35: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:47:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T21:47:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:47:58.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:58 smithi119 ceph-mon[90896]: Upgrade: Updating osd.0 2024-09-13T21:47:58.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:58 smithi119 ceph-mon[90896]: Deploying daemon osd.0 on smithi119 2024-09-13T21:47:58.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:58 smithi119 ceph-mon[90896]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:47:58.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:58 smithi155 ceph-mon[79928]: Upgrade: Updating osd.0 2024-09-13T21:47:58.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:58 smithi155 ceph-mon[79928]: Deploying daemon osd.0 on smithi119 2024-09-13T21:47:58.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:58 smithi155 ceph-mon[79928]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:47:59.453 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:47:59 smithi119 ceph-mon[90896]: pgmap v36: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:59.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:47:59 smithi155 ceph-mon[79928]: pgmap v36: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:47:59.880 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:47:59 smithi119 systemd[1]: Stopping Ceph osd.0 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:48:00.172 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:47:59 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0[45726]: 2024-09-13T21:47:59.890+0000 7fb0e3c1b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:48:00.172 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:47:59 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0[45726]: 2024-09-13T21:47:59.890+0000 7fb0e3c1b640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-13T21:48:00.173 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:47:59 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0[45726]: 2024-09-13T21:47:59.890+0000 7fb0e3c1b640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:48:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.369+0000 7fddc7738640 1 -- 172.21.15.119:0/273635742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc00fc720 msgr2=0x7fddc00fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.369+0000 7fddc7738640 1 --2- 172.21.15.119:0/273635742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc00fc720 0x7fddc00fcb90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0048d0 tx=0x7fddbc009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.369+0000 7fddc7738640 1 -- 172.21.15.119:0/273635742 shutdown_connections 2024-09-13T21:48:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.369+0000 7fddc7738640 1 --2- 172.21.15.119:0/273635742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc00fc720 0x7fddc00fcb90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.369+0000 7fddc7738640 1 --2- 172.21.15.119:0/273635742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc00fb450 0x7fddc00fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.369+0000 7fddc7738640 1 -- 172.21.15.119:0/273635742 >> 172.21.15.119:0/273635742 conn(0x7fddc00f6c10 msgr2=0x7fddc00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.369+0000 7fddc7738640 1 -- 172.21.15.119:0/273635742 shutdown_connections 2024-09-13T21:48:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.369+0000 7fddc7738640 1 -- 172.21.15.119:0/273635742 wait complete. 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc7738640 1 Processor -- start 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc7738640 1 -- start start 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc7738640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc00fb450 0x7fddc010fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc7738640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc00fc720 0x7fddc0112390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc7738640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00667e0 con 0x7fddc00fb450 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc7738640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc0066950 con 0x7fddc00fc720 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc54d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc00fb450 0x7fddc010fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc54d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc00fb450 0x7fddc010fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59066/0 (socket says 172.21.15.119:59066) 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc54d4640 1 -- 172.21.15.119:0/997194892 learned_addr learned my addr 172.21.15.119:0/997194892 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc4cd3640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc00fc720 0x7fddc0112390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc54d4640 1 -- 172.21.15.119:0/997194892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc00fc720 msgr2=0x7fddc0112390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc54d4640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc00fc720 0x7fddc0112390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc54d4640 1 -- 172.21.15.119:0/997194892 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc005040 con 0x7fddc00fb450 2024-09-13T21:48:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.370+0000 7fddc4cd3640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc00fc720 0x7fddc0112390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:48:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.371+0000 7fddc54d4640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc00fb450 0x7fddc010fe40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddb000b790 tx=0x7fddb00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.371+0000 7fddb5ffb640 1 -- 172.21.15.119:0/997194892 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddb000c700 con 0x7fddc00fb450 2024-09-13T21:48:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.371+0000 7fddb5ffb640 1 -- 172.21.15.119:0/997194892 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fddb000cd00 con 0x7fddc00fb450 2024-09-13T21:48:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.371+0000 7fddb5ffb640 1 -- 172.21.15.119:0/997194892 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddb0015e70 con 0x7fddc00fb450 2024-09-13T21:48:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.371+0000 7fddc7738640 1 -- 172.21.15.119:0/997194892 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc0112990 con 0x7fddc00fb450 2024-09-13T21:48:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.371+0000 7fddc7738640 1 -- 172.21.15.119:0/997194892 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc0112e60 con 0x7fddc00fb450 2024-09-13T21:48:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.372+0000 7fddc7738640 1 -- 172.21.15.119:0/997194892 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc00fa8b0 con 0x7fddc00fb450 2024-09-13T21:48:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.372+0000 7fddb5ffb640 1 -- 172.21.15.119:0/997194892 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fddb0012070 con 0x7fddc00fb450 2024-09-13T21:48:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.373+0000 7fddb5ffb640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fddac06e660 0x7fddac070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.373+0000 7fddb5ffb640 1 -- 172.21.15.119:0/997194892 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fddb008ddf0 con 0x7fddc00fb450 2024-09-13T21:48:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.373+0000 7fddc4cd3640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fddac06e660 0x7fddac070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.373+0000 7fddc4cd3640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fddac06e660 0x7fddac070b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00b020 tx=0x7fddbc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:00.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.377+0000 7fddb5ffb640 1 -- 172.21.15.119:0/997194892 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fddb0056ea0 con 0x7fddc00fb450 2024-09-13T21:48:00.565 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:00 smithi119 ceph-mon[90896]: osd.0 marked itself down and dead 2024-09-13T21:48:00.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.562+0000 7fddc7738640 1 -- 172.21.15.119:0/997194892 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddc0100b80 con 0x7fddac06e660 2024-09-13T21:48:00.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.564+0000 7fddb5ffb640 1 -- 172.21.15.119:0/997194892 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fddc0100b80 con 0x7fddac06e660 2024-09-13T21:48:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.566+0000 7fddc7738640 1 -- 172.21.15.119:0/997194892 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fddac06e660 msgr2=0x7fddac070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.566+0000 7fddc7738640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fddac06e660 0x7fddac070b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00b020 tx=0x7fddbc009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.566+0000 7fddc7738640 1 -- 172.21.15.119:0/997194892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc00fb450 msgr2=0x7fddc010fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.566+0000 7fddc7738640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc00fb450 0x7fddc010fe40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddb000b790 tx=0x7fddb00091d0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.566+0000 7fddc7738640 1 -- 172.21.15.119:0/997194892 shutdown_connections 2024-09-13T21:48:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.566+0000 7fddc7738640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fddac06e660 0x7fddac070b10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.566+0000 7fddc7738640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddc00fc720 0x7fddc0112390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.566+0000 7fddc7738640 1 --2- 172.21.15.119:0/997194892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddc00fb450 0x7fddc010fe40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.566+0000 7fddc7738640 1 -- 172.21.15.119:0/997194892 >> 172.21.15.119:0/997194892 conn(0x7fddc00f6c10 msgr2=0x7fddc00f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.566+0000 7fddc7738640 1 -- 172.21.15.119:0/997194892 shutdown_connections 2024-09-13T21:48:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.566+0000 7fddc7738640 1 -- 172.21.15.119:0/997194892 wait complete. 2024-09-13T21:48:00.577 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:48:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:00 smithi155 ceph-mon[79928]: osd.0 marked itself down and dead 2024-09-13T21:48:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.646+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3563834150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fa80fc700 msgr2=0x7f8fa80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.646+0000 7f8fac8ee640 1 --2- 172.21.15.119:0/3563834150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fa80fc700 0x7f8fa80fcb70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f900048d0 tx=0x7f8f90009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.646+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3563834150 shutdown_connections 2024-09-13T21:48:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.646+0000 7f8fac8ee640 1 --2- 172.21.15.119:0/3563834150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fa80fc700 0x7f8fa80fcb70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.646+0000 7f8fac8ee640 1 --2- 172.21.15.119:0/3563834150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fb430 0x7f8fa80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.646+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3563834150 >> 172.21.15.119:0/3563834150 conn(0x7f8fa80f6c10 msgr2=0x7f8fa80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.646+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3563834150 shutdown_connections 2024-09-13T21:48:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.646+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3563834150 wait complete. 2024-09-13T21:48:00.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.647+0000 7f8fac8ee640 1 Processor -- start 2024-09-13T21:48:00.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.647+0000 7f8fac8ee640 1 -- start start 2024-09-13T21:48:00.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.647+0000 7f8fac8ee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fa80fb430 0x7f8fa810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:00.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.647+0000 7f8fac8ee640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fc700 0x7f8fa810c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:00.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.647+0000 7f8fac8ee640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa810cb10 con 0x7f8fa80fb430 2024-09-13T21:48:00.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.647+0000 7f8fac8ee640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa810d330 con 0x7f8fa80fc700 2024-09-13T21:48:00.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.647+0000 7f8fa659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fa80fb430 0x7f8fa810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:00.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.647+0000 7f8fa659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fa80fb430 0x7f8fa810bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59082/0 (socket says 172.21.15.119:59082) 2024-09-13T21:48:00.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.647+0000 7f8fa659c640 1 -- 172.21.15.119:0/3397185701 learned_addr learned my addr 172.21.15.119:0/3397185701 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:00.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.647+0000 7f8fa5d9b640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fc700 0x7f8fa810c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:00.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.648+0000 7f8fa659c640 1 -- 172.21.15.119:0/3397185701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fc700 msgr2=0x7f8fa810c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:00.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.648+0000 7f8fa659c640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fc700 0x7f8fa810c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.648+0000 7f8fa659c640 1 -- 172.21.15.119:0/3397185701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90005040 con 0x7f8fa80fb430 2024-09-13T21:48:00.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.648+0000 7f8fa5d9b640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fc700 0x7f8fa810c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:48:00.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.648+0000 7f8fa659c640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fa80fb430 0x7f8fa810bf80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0010ef0 tx=0x7f8fa000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:00.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.648+0000 7f8f9effd640 1 -- 172.21.15.119:0/3397185701 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fa0007890 con 0x7f8fa80fb430 2024-09-13T21:48:00.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.648+0000 7f8f9effd640 1 -- 172.21.15.119:0/3397185701 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8fa0007e90 con 0x7f8fa80fb430 2024-09-13T21:48:00.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.648+0000 7f8f9effd640 1 -- 172.21.15.119:0/3397185701 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fa0012700 con 0x7f8fa80fb430 2024-09-13T21:48:00.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.648+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3397185701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa810d560 con 0x7f8fa80fb430 2024-09-13T21:48:00.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.648+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3397185701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa810db00 con 0x7f8fa80fb430 2024-09-13T21:48:00.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.649+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3397185701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa80fa890 con 0x7f8fa80fb430 2024-09-13T21:48:00.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.650+0000 7f8f9effd640 1 -- 172.21.15.119:0/3397185701 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f8fa00079f0 con 0x7f8fa80fb430 2024-09-13T21:48:00.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.651+0000 7f8f9effd640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f9406e660 0x7f8f94070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:00.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.651+0000 7f8f9effd640 1 -- 172.21.15.119:0/3397185701 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8fa0016070 con 0x7f8fa80fb430 2024-09-13T21:48:00.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.651+0000 7f8fa5d9b640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f9406e660 0x7f8f94070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:00.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.651+0000 7f8fa5d9b640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f9406e660 0x7f8f94070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8fa810bd30 tx=0x7f8f90035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.659+0000 7f8f9effd640 1 -- 172.21.15.119:0/3397185701 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8fa0059bb0 con 0x7f8fa80fb430 2024-09-13T21:48:00.855 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:00 smithi119 podman[98560]: 2024-09-13 21:48:00.728278966 +0000 UTC m=+0.936060879 container died 6e0bbff1ac3f30bafb4fa697b81d09c682948f505e793c78c42e121386426e2d (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-eb16b97, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T21:48:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.852+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3397185701 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fa810de80 con 0x7f8f9406e660 2024-09-13T21:48:00.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.854+0000 7f8f9effd640 1 -- 172.21.15.119:0/3397185701 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8fa810de80 con 0x7f8f9406e660 2024-09-13T21:48:00.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.856+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3397185701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f9406e660 msgr2=0x7f8f94070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.856+0000 7f8fac8ee640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f9406e660 0x7f8f94070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8fa810bd30 tx=0x7f8f90035040 comp rx=0 tx=0).stop 2024-09-13T21:48:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.856+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3397185701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fa80fb430 msgr2=0x7f8fa810bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.856+0000 7f8fac8ee640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fa80fb430 0x7f8fa810bf80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0010ef0 tx=0x7f8fa000b040 comp rx=0 tx=0).stop 2024-09-13T21:48:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.856+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3397185701 shutdown_connections 2024-09-13T21:48:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.856+0000 7f8fac8ee640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f9406e660 0x7f8f94070b10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.856+0000 7f8fac8ee640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fc700 0x7f8fa810c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.856+0000 7f8fac8ee640 1 --2- 172.21.15.119:0/3397185701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fa80fb430 0x7f8fa810bf80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.856+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3397185701 >> 172.21.15.119:0/3397185701 conn(0x7f8fa80f6c10 msgr2=0x7f8fa80f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.856+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3397185701 shutdown_connections 2024-09-13T21:48:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.856+0000 7f8fac8ee640 1 -- 172.21.15.119:0/3397185701 wait complete. 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.936+0000 7f3b9906c640 1 -- 172.21.15.119:0/1987242850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b940fd7f0 msgr2=0x7f3b940fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.936+0000 7f3b9906c640 1 --2- 172.21.15.119:0/1987242850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b940fd7f0 0x7f3b940fdc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0048d0 tx=0x7f3b7c009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 -- 172.21.15.119:0/1987242850 shutdown_connections 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 --2- 172.21.15.119:0/1987242850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b940fd7f0 0x7f3b940fdc60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 --2- 172.21.15.119:0/1987242850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b940fc520 0x7f3b940fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 -- 172.21.15.119:0/1987242850 >> 172.21.15.119:0/1987242850 conn(0x7f3b940f7ce0 msgr2=0x7f3b940fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 -- 172.21.15.119:0/1987242850 shutdown_connections 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 -- 172.21.15.119:0/1987242850 wait complete. 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 Processor -- start 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 -- start start 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b940fc520 0x7f3b9410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:00.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b940fd7f0 0x7f3b9410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9410dc10 con 0x7f3b940fc520 2024-09-13T21:48:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.937+0000 7f3b9906c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9410e430 con 0x7f3b940fd7f0 2024-09-13T21:48:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b92d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b940fc520 0x7f3b9410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b92d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b940fc520 0x7f3b9410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59110/0 (socket says 172.21.15.119:59110) 2024-09-13T21:48:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b92d9d640 1 -- 172.21.15.119:0/1427623144 learned_addr learned my addr 172.21.15.119:0/1427623144 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b8bfff640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b940fd7f0 0x7f3b9410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b92d9d640 1 -- 172.21.15.119:0/1427623144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b940fd7f0 msgr2=0x7f3b9410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b92d9d640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b940fd7f0 0x7f3b9410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b92d9d640 1 -- 172.21.15.119:0/1427623144 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c005040 con 0x7f3b940fc520 2024-09-13T21:48:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b8bfff640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b940fd7f0 0x7f3b9410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:48:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b92d9d640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b940fc520 0x7f3b9410d080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400eb70 tx=0x7f3b8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b8b7fe640 1 -- 172.21.15.119:0/1427623144 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b84007c30 con 0x7f3b940fc520 2024-09-13T21:48:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b8b7fe640 1 -- 172.21.15.119:0/1427623144 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3b8400f040 con 0x7f3b940fc520 2024-09-13T21:48:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b9906c640 1 -- 172.21.15.119:0/1427623144 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9410e660 con 0x7f3b940fc520 2024-09-13T21:48:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b8b7fe640 1 -- 172.21.15.119:0/1427623144 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b840094e0 con 0x7f3b940fc520 2024-09-13T21:48:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.938+0000 7f3b9906c640 1 -- 172.21.15.119:0/1427623144 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9410ec00 con 0x7f3b940fc520 2024-09-13T21:48:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.939+0000 7f3b9906c640 1 -- 172.21.15.119:0/1427623144 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b940fb980 con 0x7f3b940fc520 2024-09-13T21:48:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.940+0000 7f3b8b7fe640 1 -- 172.21.15.119:0/1427623144 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f3b84009640 con 0x7f3b940fc520 2024-09-13T21:48:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.940+0000 7f3b8b7fe640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3b8006e660 0x7f3b80070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.940+0000 7f3b8b7fe640 1 -- 172.21.15.119:0/1427623144 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3b8408e040 con 0x7f3b940fc520 2024-09-13T21:48:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.940+0000 7f3b8bfff640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3b8006e660 0x7f3b80070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.941+0000 7f3b8bfff640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3b8006e660 0x7f3b80070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c007ac0 tx=0x7f3b7c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:00.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:00.945+0000 7f3b8b7fe640 1 -- 172.21.15.119:0/1427623144 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3b84056fe0 con 0x7f3b940fc520 2024-09-13T21:48:01.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.122+0000 7f3b9906c640 1 -- 172.21.15.119:0/1427623144 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b9410ef80 con 0x7f3b8006e660 2024-09-13T21:48:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.131+0000 7f3b8b7fe640 1 -- 172.21.15.119:0/1427623144 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3b9410ef80 con 0x7f3b8006e660 2024-09-13T21:48:01.133 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:48:01.133 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (2m) 9s ago 10m 16.9M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:48:01.133 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (20s) 9s ago 11m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (15s) 11s ago 10m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (2m) 9s ago 10m 80.2M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (5m) 9s ago 5m 13.5M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (5m) 9s ago 5m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (5m) 11s ago 5m 16.3M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (5m) 11s ago 5m 110M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (2m) 9s ago 12m 492M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (87s) 11s ago 10m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (75s) 9s ago 12m 42.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (56s) 11s ago 10m 34.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (2m) 9s ago 11m 8791k - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (2m) 11s ago 10m 15.4M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:48:01.134 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (9m) 9s ago 9m 214M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 6e0bbff1ac3f 2024-09-13T21:48:01.135 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (8m) 9s ago 8m 234M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:48:01.135 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (8m) 9s ago 8m 192M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:48:01.135 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (8m) 11s ago 8m 266M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:48:01.135 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (7m) 11s ago 7m 228M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:48:01.135 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (7m) 11s ago 7m 227M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:48:01.135 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (92s) 9s ago 10m 51.4M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:48:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.133+0000 7f3b9906c640 1 -- 172.21.15.119:0/1427623144 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3b8006e660 msgr2=0x7f3b80070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.134+0000 7f3b9906c640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3b8006e660 0x7f3b80070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c007ac0 tx=0x7f3b7c035040 comp rx=0 tx=0).stop 2024-09-13T21:48:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.134+0000 7f3b9906c640 1 -- 172.21.15.119:0/1427623144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b940fc520 msgr2=0x7f3b9410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.134+0000 7f3b9906c640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b940fc520 0x7f3b9410d080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400eb70 tx=0x7f3b8400b040 comp rx=0 tx=0).stop 2024-09-13T21:48:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.134+0000 7f3b9906c640 1 -- 172.21.15.119:0/1427623144 shutdown_connections 2024-09-13T21:48:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.134+0000 7f3b9906c640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3b8006e660 0x7f3b80070b10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.134+0000 7f3b9906c640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b940fd7f0 0x7f3b9410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.134+0000 7f3b9906c640 1 --2- 172.21.15.119:0/1427623144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b940fc520 0x7f3b9410d080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.134+0000 7f3b9906c640 1 -- 172.21.15.119:0/1427623144 >> 172.21.15.119:0/1427623144 conn(0x7f3b940f7ce0 msgr2=0x7f3b940f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:01.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.134+0000 7f3b9906c640 1 -- 172.21.15.119:0/1427623144 shutdown_connections 2024-09-13T21:48:01.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.134+0000 7f3b9906c640 1 -- 172.21.15.119:0/1427623144 wait complete. 2024-09-13T21:48:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.226+0000 7fe3c95b7640 1 -- 172.21.15.119:0/2134846161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c40fc6f0 msgr2=0x7fe3c40fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.226+0000 7fe3c95b7640 1 --2- 172.21.15.119:0/2134846161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c40fc6f0 0x7fe3c40fcb60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80048d0 tx=0x7fe3b8009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.226+0000 7fe3c95b7640 1 -- 172.21.15.119:0/2134846161 shutdown_connections 2024-09-13T21:48:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.226+0000 7fe3c95b7640 1 --2- 172.21.15.119:0/2134846161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c40fc6f0 0x7fe3c40fcb60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.226+0000 7fe3c95b7640 1 --2- 172.21.15.119:0/2134846161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c40fb420 0x7fe3c40fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.226+0000 7fe3c95b7640 1 -- 172.21.15.119:0/2134846161 >> 172.21.15.119:0/2134846161 conn(0x7fe3c40f6c00 msgr2=0x7fe3c40f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.226+0000 7fe3c95b7640 1 -- 172.21.15.119:0/2134846161 shutdown_connections 2024-09-13T21:48:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.226+0000 7fe3c95b7640 1 -- 172.21.15.119:0/2134846161 wait complete. 2024-09-13T21:48:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c95b7640 1 Processor -- start 2024-09-13T21:48:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c95b7640 1 -- start start 2024-09-13T21:48:01.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c95b7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c40fb420 0x7fe3c410bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c95b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c40fc6f0 0x7fe3c410c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c95b7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c410d380 con 0x7fe3c40fb420 2024-09-13T21:48:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c95b7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c410d4f0 con 0x7fe3c40fc6f0 2024-09-13T21:48:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c40fb420 0x7fe3c410bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c40fb420 0x7fe3c410bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59124/0 (socket says 172.21.15.119:59124) 2024-09-13T21:48:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c2ffd640 1 -- 172.21.15.119:0/487746863 learned_addr learned my addr 172.21.15.119:0/487746863 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c27fc640 1 --2- 172.21.15.119:0/487746863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c40fc6f0 0x7fe3c410c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c2ffd640 1 -- 172.21.15.119:0/487746863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c40fc6f0 msgr2=0x7fe3c410c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c2ffd640 1 --2- 172.21.15.119:0/487746863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c40fc6f0 0x7fe3c410c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.227+0000 7fe3c2ffd640 1 -- 172.21.15.119:0/487746863 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b8005040 con 0x7fe3c40fb420 2024-09-13T21:48:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.228+0000 7fe3c2ffd640 1 --2- 172.21.15.119:0/487746863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c40fb420 0x7fe3c410bfd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400b790 tx=0x7fe3b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.228+0000 7fe3ab7fe640 1 -- 172.21.15.119:0/487746863 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b400c700 con 0x7fe3c40fb420 2024-09-13T21:48:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.228+0000 7fe3c95b7640 1 -- 172.21.15.119:0/487746863 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c410d7d0 con 0x7fe3c40fb420 2024-09-13T21:48:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.228+0000 7fe3ab7fe640 1 -- 172.21.15.119:0/487746863 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe3b400cd00 con 0x7fe3c40fb420 2024-09-13T21:48:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.228+0000 7fe3c95b7640 1 -- 172.21.15.119:0/487746863 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c410dcf0 con 0x7fe3c40fb420 2024-09-13T21:48:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.228+0000 7fe3ab7fe640 1 -- 172.21.15.119:0/487746863 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b4015e20 con 0x7fe3c40fb420 2024-09-13T21:48:01.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.229+0000 7fe3c95b7640 1 -- 172.21.15.119:0/487746863 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c41046b0 con 0x7fe3c40fb420 2024-09-13T21:48:01.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.230+0000 7fe3ab7fe640 1 -- 172.21.15.119:0/487746863 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fe3b4012070 con 0x7fe3c40fb420 2024-09-13T21:48:01.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.230+0000 7fe3ab7fe640 1 --2- 172.21.15.119:0/487746863 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe3ac06e660 0x7fe3ac070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:01.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.230+0000 7fe3ab7fe640 1 -- 172.21.15.119:0/487746863 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe3b408db60 con 0x7fe3c40fb420 2024-09-13T21:48:01.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.231+0000 7fe3c27fc640 1 --2- 172.21.15.119:0/487746863 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe3ac06e660 0x7fe3ac070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:01.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.232+0000 7fe3c27fc640 1 --2- 172.21.15.119:0/487746863 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe3ac06e660 0x7fe3ac070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe3c410bd80 tx=0x7fe3b8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:01.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.235+0000 7fe3ab7fe640 1 -- 172.21.15.119:0/487746863 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe3b4056b30 con 0x7fe3c40fb420 2024-09-13T21:48:01.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:01 smithi119 ceph-mon[90896]: pgmap v37: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:01.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:01 smithi119 ceph-mon[90896]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:48:01.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:01 smithi119 ceph-mon[90896]: osdmap e48: 6 total, 5 up, 6 in 2024-09-13T21:48:01.380 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:01 smithi119 podman[98560]: 2024-09-13 21:48:01.192536931 +0000 UTC m=+1.400318825 container cleanup 6e0bbff1ac3f30bafb4fa697b81d09c682948f505e793c78c42e121386426e2d (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=quincy-eb16b97, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T21:48:01.380 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:01 smithi119 bash[98560]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0 2024-09-13T21:48:01.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.477+0000 7fe3c95b7640 1 -- 172.21.15.119:0/487746863 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe3c410dfc0 con 0x7fe3c40fb420 2024-09-13T21:48:01.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.477+0000 7fe3ab7fe640 1 -- 172.21.15.119:0/487746863 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+744 (secure 0 0 0) 0x7fe3b405a1f0 con 0x7fe3c40fb420 2024-09-13T21:48:01.480 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:48:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:48:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:48:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:48:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:48:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:48:01.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:48:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:48:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 5 2024-09-13T21:48:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:48:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:48:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:48:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:48:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:48:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 9, 2024-09-13T21:48:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:48:01.481 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:48:01.481 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:48:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.480+0000 7fe3c95b7640 1 -- 172.21.15.119:0/487746863 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe3ac06e660 msgr2=0x7fe3ac070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.480+0000 7fe3c95b7640 1 --2- 172.21.15.119:0/487746863 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe3ac06e660 0x7fe3ac070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe3c410bd80 tx=0x7fe3b8035040 comp rx=0 tx=0).stop 2024-09-13T21:48:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.480+0000 7fe3c95b7640 1 -- 172.21.15.119:0/487746863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c40fb420 msgr2=0x7fe3c410bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.480+0000 7fe3c95b7640 1 --2- 172.21.15.119:0/487746863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c40fb420 0x7fe3c410bfd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400b790 tx=0x7fe3b40091d0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.480+0000 7fe3c95b7640 1 -- 172.21.15.119:0/487746863 shutdown_connections 2024-09-13T21:48:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.480+0000 7fe3c95b7640 1 --2- 172.21.15.119:0/487746863 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe3ac06e660 0x7fe3ac070b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.480+0000 7fe3c95b7640 1 --2- 172.21.15.119:0/487746863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c40fc6f0 0x7fe3c410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.480+0000 7fe3c95b7640 1 --2- 172.21.15.119:0/487746863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3c40fb420 0x7fe3c410bfd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.480+0000 7fe3c95b7640 1 -- 172.21.15.119:0/487746863 >> 172.21.15.119:0/487746863 conn(0x7fe3c40f6c00 msgr2=0x7fe3c40f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:01.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.480+0000 7fe3c95b7640 1 -- 172.21.15.119:0/487746863 shutdown_connections 2024-09-13T21:48:01.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.480+0000 7fe3c95b7640 1 -- 172.21.15.119:0/487746863 wait complete. 2024-09-13T21:48:01.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.561+0000 7fc7a1567640 1 -- 172.21.15.119:0/3726124989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc79c0fc6f0 msgr2=0x7fc79c0fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.561+0000 7fc7a1567640 1 --2- 172.21.15.119:0/3726124989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc79c0fc6f0 0x7fc79c0fcb60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc7900048d0 tx=0x7fc790009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.561+0000 7fc7a1567640 1 -- 172.21.15.119:0/3726124989 shutdown_connections 2024-09-13T21:48:01.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.561+0000 7fc7a1567640 1 --2- 172.21.15.119:0/3726124989 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc79c0fc6f0 0x7fc79c0fcb60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.561+0000 7fc7a1567640 1 --2- 172.21.15.119:0/3726124989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc79c0fb420 0x7fc79c0fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.561+0000 7fc7a1567640 1 -- 172.21.15.119:0/3726124989 >> 172.21.15.119:0/3726124989 conn(0x7fc79c0f6c00 msgr2=0x7fc79c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:01.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.561+0000 7fc7a1567640 1 -- 172.21.15.119:0/3726124989 shutdown_connections 2024-09-13T21:48:01.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.561+0000 7fc7a1567640 1 -- 172.21.15.119:0/3726124989 wait complete. 2024-09-13T21:48:01.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.562+0000 7fc7a1567640 1 Processor -- start 2024-09-13T21:48:01.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.562+0000 7fc7a1567640 1 -- start start 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.562+0000 7fc7a1567640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc79c0fb420 0x7fc79c10bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc7a1567640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc79c0fc6f0 0x7fc79c10c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc7a1567640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c10cae0 con 0x7fc79c0fb420 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc7a1567640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c10d300 con 0x7fc79c0fc6f0 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc79affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc79c0fb420 0x7fc79c10bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc79affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc79c0fb420 0x7fc79c10bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59142/0 (socket says 172.21.15.119:59142) 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc79affd640 1 -- 172.21.15.119:0/3785207260 learned_addr learned my addr 172.21.15.119:0/3785207260 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc79a7fc640 1 --2- 172.21.15.119:0/3785207260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc79c0fc6f0 0x7fc79c10c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc79affd640 1 -- 172.21.15.119:0/3785207260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc79c0fc6f0 msgr2=0x7fc79c10c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc79affd640 1 --2- 172.21.15.119:0/3785207260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc79c0fc6f0 0x7fc79c10c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc79affd640 1 -- 172.21.15.119:0/3785207260 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc790005040 con 0x7fc79c0fb420 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc79affd640 1 --2- 172.21.15.119:0/3785207260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc79c0fb420 0x7fc79c10bf50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00fce0 tx=0x7fc78c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:01.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc7837fe640 1 -- 172.21.15.119:0/3785207260 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc78c007a20 con 0x7fc79c0fb420 2024-09-13T21:48:01.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc7837fe640 1 -- 172.21.15.119:0/3785207260 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc78c007b80 con 0x7fc79c0fb420 2024-09-13T21:48:01.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc7a1567640 1 -- 172.21.15.119:0/3785207260 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c10d530 con 0x7fc79c0fb420 2024-09-13T21:48:01.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.563+0000 7fc7837fe640 1 -- 172.21.15.119:0/3785207260 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc78c0126a0 con 0x7fc79c0fb420 2024-09-13T21:48:01.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.564+0000 7fc7a1567640 1 -- 172.21.15.119:0/3785207260 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c10dad0 con 0x7fc79c0fb420 2024-09-13T21:48:01.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.565+0000 7fc7a1567640 1 -- 172.21.15.119:0/3785207260 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c0fa880 con 0x7fc79c0fb420 2024-09-13T21:48:01.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.565+0000 7fc7837fe640 1 -- 172.21.15.119:0/3785207260 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fc78c007cf0 con 0x7fc79c0fb420 2024-09-13T21:48:01.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.566+0000 7fc7837fe640 1 --2- 172.21.15.119:0/3785207260 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc78406e660 0x7fc784070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:01.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.566+0000 7fc7837fe640 1 -- 172.21.15.119:0/3785207260 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc78c090c70 con 0x7fc79c0fb420 2024-09-13T21:48:01.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.566+0000 7fc79a7fc640 1 --2- 172.21.15.119:0/3785207260 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc78406e660 0x7fc784070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:01.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.567+0000 7fc79a7fc640 1 --2- 172.21.15.119:0/3785207260 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc78406e660 0x7fc784070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc790007ac0 tx=0x7fc790035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:01.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.571+0000 7fc7837fe640 1 -- 172.21.15.119:0/3785207260 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc78c059b90 con 0x7fc79c0fb420 2024-09-13T21:48:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:01 smithi155 ceph-mon[79928]: pgmap v37: 65 pgs: 65 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:01 smithi155 ceph-mon[79928]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:48:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:01 smithi155 ceph-mon[79928]: osdmap e48: 6 total, 5 up, 6 in 2024-09-13T21:48:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.808+0000 7fc7a1567640 1 -- 172.21.15.119:0/3785207260 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc79c103e20 con 0x7fc79c0fb420 2024-09-13T21:48:01.811 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:01 smithi119 podman[98621]: 2024-09-13 21:48:01.511138042 +0000 UTC m=+0.779614468 container remove 6e0bbff1ac3f30bafb4fa697b81d09c682948f505e793c78c42e121386426e2d (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=quincy-eb16b97, org.label-schema.vendor=CentOS) 2024-09-13T21:48:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.809+0000 7fc7837fe640 1 -- 172.21.15.119:0/3785207260 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1960 (secure 0 0 0) 0x7fc78c019360 con 0x7fc79c0fb420 2024-09-13T21:48:01.812 INFO:teuthology.orchestra.run.smithi119.stdout:e21 2024-09-13T21:48:01.812 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:47:57:552017+0000 2024-09-13T21:48:01.812 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:48:01.812 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:48:01.812 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:48:01.812 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:48:01.812 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:48:01.812 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:48:01.812 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 21 2024-09-13T21:48:01.812 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:47:57.552013+0000 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:48:01.813 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 14472 members: 14472,24267 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:01.814 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:48:01.815 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:48:01.815 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:48:01.815 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:48:01.815 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:01.815 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 21 2024-09-13T21:48:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.812+0000 7fc7a1567640 1 -- 172.21.15.119:0/3785207260 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc78406e660 msgr2=0x7fc784070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.812+0000 7fc7a1567640 1 --2- 172.21.15.119:0/3785207260 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc78406e660 0x7fc784070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc790007ac0 tx=0x7fc790035040 comp rx=0 tx=0).stop 2024-09-13T21:48:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.813+0000 7fc7a1567640 1 -- 172.21.15.119:0/3785207260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc79c0fb420 msgr2=0x7fc79c10bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.813+0000 7fc7a1567640 1 --2- 172.21.15.119:0/3785207260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc79c0fb420 0x7fc79c10bf50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00fce0 tx=0x7fc78c004600 comp rx=0 tx=0).stop 2024-09-13T21:48:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.813+0000 7fc7a1567640 1 -- 172.21.15.119:0/3785207260 shutdown_connections 2024-09-13T21:48:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.813+0000 7fc7a1567640 1 --2- 172.21.15.119:0/3785207260 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc78406e660 0x7fc784070b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.813+0000 7fc7a1567640 1 --2- 172.21.15.119:0/3785207260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc79c0fc6f0 0x7fc79c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.813+0000 7fc7a1567640 1 --2- 172.21.15.119:0/3785207260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc79c0fb420 0x7fc79c10bf50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.813+0000 7fc7a1567640 1 -- 172.21.15.119:0/3785207260 >> 172.21.15.119:0/3785207260 conn(0x7fc79c0f6c00 msgr2=0x7fc79c0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.813+0000 7fc7a1567640 1 -- 172.21.15.119:0/3785207260 shutdown_connections 2024-09-13T21:48:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.813+0000 7fc7a1567640 1 -- 172.21.15.119:0/3785207260 wait complete. 2024-09-13T21:48:01.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.892+0000 7f59ec3bb640 1 -- 172.21.15.119:0/259393291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59e40ff6e0 msgr2=0x7f59e4101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.892+0000 7f59ec3bb640 1 --2- 172.21.15.119:0/259393291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59e40ff6e0 0x7f59e4101ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59d40048d0 tx=0x7f59d4009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.892+0000 7f59ec3bb640 1 -- 172.21.15.119:0/259393291 shutdown_connections 2024-09-13T21:48:01.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.892+0000 7f59ec3bb640 1 --2- 172.21.15.119:0/259393291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59e40ff6e0 0x7f59e4101ac0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.892+0000 7f59ec3bb640 1 --2- 172.21.15.119:0/259393291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e4065be0 0x7f59e40ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.892+0000 7f59ec3bb640 1 -- 172.21.15.119:0/259393291 >> 172.21.15.119:0/259393291 conn(0x7f59e40f6c10 msgr2=0x7f59e40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.892+0000 7f59ec3bb640 1 -- 172.21.15.119:0/259393291 shutdown_connections 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.892+0000 7f59ec3bb640 1 -- 172.21.15.119:0/259393291 wait complete. 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ec3bb640 1 Processor -- start 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ec3bb640 1 -- start start 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ec3bb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59e4065be0 0x7f59e410d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ec3bb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e40ff6e0 0x7f59e410d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ec3bb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e410dc50 con 0x7f59e4065be0 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ec3bb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e410e420 con 0x7f59e40ff6e0 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ea157640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59e4065be0 0x7f59e410d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ea157640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59e4065be0 0x7f59e410d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59158/0 (socket says 172.21.15.119:59158) 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ea157640 1 -- 172.21.15.119:0/3147523173 learned_addr learned my addr 172.21.15.119:0/3147523173 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ea157640 1 -- 172.21.15.119:0/3147523173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e40ff6e0 msgr2=0x7f59e410d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:01.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59e9956640 1 --2- 172.21.15.119:0/3147523173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e40ff6e0 0x7f59e410d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:01.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ea157640 1 --2- 172.21.15.119:0/3147523173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e40ff6e0 0x7f59e410d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:01.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ea157640 1 -- 172.21.15.119:0/3147523173 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4005040 con 0x7f59e4065be0 2024-09-13T21:48:01.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ea157640 1 --2- 172.21.15.119:0/3147523173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59e4065be0 0x7f59e410d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f59e000eb70 tx=0x7f59e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:01.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59daffd640 1 -- 172.21.15.119:0/3147523173 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59e0007c30 con 0x7f59e4065be0 2024-09-13T21:48:01.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59daffd640 1 -- 172.21.15.119:0/3147523173 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f59e000f040 con 0x7f59e4065be0 2024-09-13T21:48:01.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.893+0000 7f59ec3bb640 1 -- 172.21.15.119:0/3147523173 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e410e6b0 con 0x7f59e4065be0 2024-09-13T21:48:01.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.894+0000 7f59daffd640 1 -- 172.21.15.119:0/3147523173 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59e0009730 con 0x7f59e4065be0 2024-09-13T21:48:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.894+0000 7f59ec3bb640 1 -- 172.21.15.119:0/3147523173 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e410ec50 con 0x7f59e4065be0 2024-09-13T21:48:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.894+0000 7f59ec3bb640 1 -- 172.21.15.119:0/3147523173 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e40fa890 con 0x7f59e4065be0 2024-09-13T21:48:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.895+0000 7f59daffd640 1 -- 172.21.15.119:0/3147523173 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f59e000c710 con 0x7f59e4065be0 2024-09-13T21:48:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.895+0000 7f59daffd640 1 --2- 172.21.15.119:0/3147523173 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f59d006e660 0x7f59d0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.896+0000 7f59daffd640 1 -- 172.21.15.119:0/3147523173 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f59e008e580 con 0x7f59e4065be0 2024-09-13T21:48:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.896+0000 7f59e9956640 1 --2- 172.21.15.119:0/3147523173 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f59d006e660 0x7f59d0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.896+0000 7f59e9956640 1 --2- 172.21.15.119:0/3147523173 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f59d006e660 0x7f59d0070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f59d4003080 tx=0x7f59d4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:01.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:01.900+0000 7f59daffd640 1 -- 172.21.15.119:0/3147523173 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f59e00574a0 con 0x7f59e4065be0 2024-09-13T21:48:02.074 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:01 smithi119 podman[98774]: 2024-09-13 21:48:01.786389828 +0000 UTC m=+0.016216371 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:02.074 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:01 smithi119 podman[98774]: 2024-09-13 21:48:01.963053953 +0000 UTC m=+0.192880493 container create bc4792296fa82a04600023983ae02f2f5e4ee2a809f6b6eff7458cf45f52cf76 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:48:02.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.094+0000 7f59ec3bb640 1 -- 172.21.15.119:0/3147523173 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59e410f0c0 con 0x7f59d006e660 2024-09-13T21:48:02.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.095+0000 7f59daffd640 1 -- 172.21.15.119:0/3147523173 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f59e410f0c0 con 0x7f59d006e660 2024-09-13T21:48:02.097 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:48:02.097 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:48:02.097 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:48:02.097 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:48:02.097 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:48:02.097 INFO:teuthology.orchestra.run.smithi119.stdout: "crash", 2024-09-13T21:48:02.097 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr", 2024-09-13T21:48:02.098 INFO:teuthology.orchestra.run.smithi119.stdout: "mon" 2024-09-13T21:48:02.098 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:48:02.098 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "6/21 daemons upgraded", 2024-09-13T21:48:02.098 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:48:02.098 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:48:02.098 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:48:02.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.097+0000 7f59ec3bb640 1 -- 172.21.15.119:0/3147523173 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f59d006e660 msgr2=0x7f59d0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:02.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.097+0000 7f59ec3bb640 1 --2- 172.21.15.119:0/3147523173 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f59d006e660 0x7f59d0070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f59d4003080 tx=0x7f59d4009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:02.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.097+0000 7f59ec3bb640 1 -- 172.21.15.119:0/3147523173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59e4065be0 msgr2=0x7f59e410d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:02.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.097+0000 7f59ec3bb640 1 --2- 172.21.15.119:0/3147523173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59e4065be0 0x7f59e410d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f59e000eb70 tx=0x7f59e000b040 comp rx=0 tx=0).stop 2024-09-13T21:48:02.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.097+0000 7f59ec3bb640 1 -- 172.21.15.119:0/3147523173 shutdown_connections 2024-09-13T21:48:02.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.097+0000 7f59ec3bb640 1 --2- 172.21.15.119:0/3147523173 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f59d006e660 0x7f59d0070b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:02.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.097+0000 7f59ec3bb640 1 --2- 172.21.15.119:0/3147523173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e40ff6e0 0x7f59e410d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:02.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.097+0000 7f59ec3bb640 1 --2- 172.21.15.119:0/3147523173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59e4065be0 0x7f59e410d0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:02.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.097+0000 7f59ec3bb640 1 -- 172.21.15.119:0/3147523173 >> 172.21.15.119:0/3147523173 conn(0x7f59e40f6c10 msgr2=0x7f59e40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:02.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.098+0000 7f59ec3bb640 1 -- 172.21.15.119:0/3147523173 shutdown_connections 2024-09-13T21:48:02.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.098+0000 7f59ec3bb640 1 -- 172.21.15.119:0/3147523173 wait complete. 2024-09-13T21:48:02.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.181+0000 7f1150dd5640 1 -- 172.21.15.119:0/1114617692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114c066710 msgr2=0x7f114c0ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.181+0000 7f1150dd5640 1 --2- 172.21.15.119:0/1114617692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114c066710 0x7f114c0ff160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f113c0048d0 tx=0x7f113c009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.181+0000 7f1150dd5640 1 -- 172.21.15.119:0/1114617692 shutdown_connections 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.181+0000 7f1150dd5640 1 --2- 172.21.15.119:0/1114617692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f114c0ff6a0 0x7f114c101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.181+0000 7f1150dd5640 1 --2- 172.21.15.119:0/1114617692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114c066710 0x7f114c0ff160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.181+0000 7f1150dd5640 1 -- 172.21.15.119:0/1114617692 >> 172.21.15.119:0/1114617692 conn(0x7f114c0f6c10 msgr2=0x7f114c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.181+0000 7f1150dd5640 1 -- 172.21.15.119:0/1114617692 shutdown_connections 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.181+0000 7f1150dd5640 1 -- 172.21.15.119:0/1114617692 wait complete. 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1150dd5640 1 Processor -- start 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1150dd5640 1 -- start start 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1150dd5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f114c066710 0x7f114c10d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1150dd5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114c0ff6a0 0x7f114c10d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:02.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1150dd5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c10dd00 con 0x7f114c0ff6a0 2024-09-13T21:48:02.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1150dd5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c10e4d0 con 0x7f114c066710 2024-09-13T21:48:02.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1149d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114c0ff6a0 0x7f114c10d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:02.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1149d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114c0ff6a0 0x7f114c10d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:59176/0 (socket says 172.21.15.119:59176) 2024-09-13T21:48:02.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1149d9b640 1 -- 172.21.15.119:0/45372776 learned_addr learned my addr 172.21.15.119:0/45372776 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:02.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f114a59c640 1 --2- 172.21.15.119:0/45372776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f114c066710 0x7f114c10d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:02.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1149d9b640 1 -- 172.21.15.119:0/45372776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f114c066710 msgr2=0x7f114c10d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:02.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1149d9b640 1 --2- 172.21.15.119:0/45372776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f114c066710 0x7f114c10d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:02.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.182+0000 7f1149d9b640 1 -- 172.21.15.119:0/45372776 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c005040 con 0x7f114c0ff6a0 2024-09-13T21:48:02.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.183+0000 7f1149d9b640 1 --2- 172.21.15.119:0/45372776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114c0ff6a0 0x7f114c10d6b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1140002a50 tx=0x7f1140004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:02.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.184+0000 7f113affd640 1 -- 172.21.15.119:0/45372776 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1140007c30 con 0x7f114c0ff6a0 2024-09-13T21:48:02.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.184+0000 7f113affd640 1 -- 172.21.15.119:0/45372776 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f114000f040 con 0x7f114c0ff6a0 2024-09-13T21:48:02.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.184+0000 7f1150dd5640 1 -- 172.21.15.119:0/45372776 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c10e760 con 0x7f114c0ff6a0 2024-09-13T21:48:02.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.184+0000 7f113affd640 1 -- 172.21.15.119:0/45372776 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f114000dad0 con 0x7f114c0ff6a0 2024-09-13T21:48:02.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.184+0000 7f1150dd5640 1 -- 172.21.15.119:0/45372776 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114c10ed00 con 0x7f114c0ff6a0 2024-09-13T21:48:02.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.185+0000 7f1150dd5640 1 -- 172.21.15.119:0/45372776 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114c0fa8b0 con 0x7f114c0ff6a0 2024-09-13T21:48:02.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.185+0000 7f113affd640 1 -- 172.21.15.119:0/45372776 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f114000dc30 con 0x7f114c0ff6a0 2024-09-13T21:48:02.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.186+0000 7f113affd640 1 --2- 172.21.15.119:0/45372776 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f113406e660 0x7f1134070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:02.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.186+0000 7f113affd640 1 -- 172.21.15.119:0/45372776 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f114008e160 con 0x7f114c0ff6a0 2024-09-13T21:48:02.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.186+0000 7f114a59c640 1 --2- 172.21.15.119:0/45372776 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f113406e660 0x7f1134070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:02.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.187+0000 7f114a59c640 1 --2- 172.21.15.119:0/45372776 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f113406e660 0x7f1134070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f113c000c00 tx=0x7f113c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:02.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.190+0000 7f113affd640 1 -- 172.21.15.119:0/45372776 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1140057100 con 0x7f114c0ff6a0 2024-09-13T21:48:02.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:02 smithi119 ceph-mon[90896]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:02.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:02 smithi119 ceph-mon[90896]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:02.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:02 smithi119 ceph-mon[90896]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:02.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:02 smithi119 ceph-mon[90896]: osdmap e49: 6 total, 5 up, 6 in 2024-09-13T21:48:02.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:02 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/487746863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:02.350 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:02 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3785207260' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:48:02.350 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:02 smithi119 podman[98774]: 2024-09-13 21:48:02.241044248 +0000 UTC m=+0.470870801 container init bc4792296fa82a04600023983ae02f2f5e4ee2a809f6b6eff7458cf45f52cf76 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T21:48:02.350 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:02 smithi119 podman[98774]: 2024-09-13 21:48:02.244726557 +0000 UTC m=+0.474553104 container start bc4792296fa82a04600023983ae02f2f5e4ee2a809f6b6eff7458cf45f52cf76 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T21:48:02.351 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:02 smithi119 podman[98774]: 2024-09-13 21:48:02.349239748 +0000 UTC m=+0.579066295 container attach bc4792296fa82a04600023983ae02f2f5e4ee2a809f6b6eff7458cf45f52cf76 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-13T21:48:02.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.432+0000 7f1150dd5640 1 -- 172.21.15.119:0/45372776 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f114c10ef70 con 0x7f114c0ff6a0 2024-09-13T21:48:02.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.433+0000 7f113affd640 1 -- 172.21.15.119:0/45372776 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7f114005a7c0 con 0x7f114c0ff6a0 2024-09-13T21:48:02.434 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_WARN 1 osds down 2024-09-13T21:48:02.435 INFO:teuthology.orchestra.run.smithi119.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T21:48:02.435 INFO:teuthology.orchestra.run.smithi119.stdout: osd.0 (root=default,host=smithi119) is down 2024-09-13T21:48:02.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.435+0000 7f1150dd5640 1 -- 172.21.15.119:0/45372776 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f113406e660 msgr2=0x7f1134070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:02.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.435+0000 7f1150dd5640 1 --2- 172.21.15.119:0/45372776 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f113406e660 0x7f1134070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f113c000c00 tx=0x7f113c035040 comp rx=0 tx=0).stop 2024-09-13T21:48:02.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.435+0000 7f1150dd5640 1 -- 172.21.15.119:0/45372776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114c0ff6a0 msgr2=0x7f114c10d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:02.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.435+0000 7f1150dd5640 1 --2- 172.21.15.119:0/45372776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114c0ff6a0 0x7f114c10d6b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1140002a50 tx=0x7f1140004600 comp rx=0 tx=0).stop 2024-09-13T21:48:02.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.435+0000 7f1150dd5640 1 -- 172.21.15.119:0/45372776 shutdown_connections 2024-09-13T21:48:02.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.435+0000 7f1150dd5640 1 --2- 172.21.15.119:0/45372776 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f113406e660 0x7f1134070b10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:02.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.435+0000 7f1150dd5640 1 --2- 172.21.15.119:0/45372776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114c0ff6a0 0x7f114c10d6b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:02.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.435+0000 7f1150dd5640 1 --2- 172.21.15.119:0/45372776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f114c066710 0x7f114c10d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:02.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.435+0000 7f1150dd5640 1 -- 172.21.15.119:0/45372776 >> 172.21.15.119:0/45372776 conn(0x7f114c0f6c10 msgr2=0x7f114c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:02.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.435+0000 7f1150dd5640 1 -- 172.21.15.119:0/45372776 shutdown_connections 2024-09-13T21:48:02.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:02.435+0000 7f1150dd5640 1 -- 172.21.15.119:0/45372776 wait complete. 2024-09-13T21:48:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:02 smithi155 ceph-mon[79928]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:02 smithi155 ceph-mon[79928]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:02 smithi155 ceph-mon[79928]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:02 smithi155 ceph-mon[79928]: osdmap e49: 6 total, 5 up, 6 in 2024-09-13T21:48:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:02 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/487746863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:02 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3785207260' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:48:02.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:02 smithi119 podman[98774]: 2024-09-13 21:48:02.438570716 +0000 UTC m=+0.668397265 container died bc4792296fa82a04600023983ae02f2f5e4ee2a809f6b6eff7458cf45f52cf76 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T21:48:03.296 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:03 smithi119 ceph-mon[90896]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:03.297 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:03 smithi119 ceph-mon[90896]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:03.297 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:03 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/45372776' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:48:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:03 smithi155 ceph-mon[79928]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:03 smithi155 ceph-mon[79928]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:03 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/45372776' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:48:03.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:03 smithi119 podman[98843]: 2024-09-13 21:48:03.295798951 +0000 UTC m=+0.847819169 container remove bc4792296fa82a04600023983ae02f2f5e4ee2a809f6b6eff7458cf45f52cf76 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True) 2024-09-13T21:48:03.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:03 smithi119 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-13T21:48:03.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:03 smithi119 systemd[1]: Stopped Ceph osd.0 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:48:03.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:03 smithi119 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.0.service: Consumed 56.611s CPU time. 2024-09-13T21:48:03.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:03 smithi119 systemd[1]: Starting Ceph osd.0 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:48:04.068 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:03 smithi119 podman[98943]: 2024-09-13 21:48:03.637979022 +0000 UTC m=+0.015867889 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:04.068 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:03 smithi119 podman[98943]: 2024-09-13 21:48:03.747039138 +0000 UTC m=+0.124927990 container create 7eac4971f19e1cbb7e21e800738ab3a358137251299f630babbda508dc10182a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T21:48:04.068 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:03 smithi119 podman[98943]: 2024-09-13 21:48:03.974704904 +0000 UTC m=+0.352593756 container init 7eac4971f19e1cbb7e21e800738ab3a358137251299f630babbda508dc10182a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be) 2024-09-13T21:48:04.068 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:03 smithi119 podman[98943]: 2024-09-13 21:48:03.978001317 +0000 UTC m=+0.355890180 container start 7eac4971f19e1cbb7e21e800738ab3a358137251299f630babbda508dc10182a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T21:48:04.068 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:04 smithi119 podman[98943]: 2024-09-13 21:48:04.066188247 +0000 UTC m=+0.444077100 container attach 7eac4971f19e1cbb7e21e800738ab3a358137251299f630babbda508dc10182a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T21:48:04.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:04 smithi119 ceph-mon[90896]: Health check failed: Degraded data redundancy: 62/318 objects degraded (19.497%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:04.380 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:04 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate[98958]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:04.380 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:04 smithi119 bash[98943]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:04.380 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:04 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate[98958]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:04.380 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:04 smithi119 bash[98943]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:04.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:04 smithi155 ceph-mon[79928]: Health check failed: Degraded data redundancy: 62/318 objects degraded (19.497%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:05.130 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:04 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate[98958]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T21:48:05.130 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:04 smithi119 bash[98943]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T21:48:05.130 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:04 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate[98958]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T21:48:05.130 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:04 smithi119 bash[98943]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T21:48:05.428 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:05 smithi119 ceph-mon[90896]: pgmap v41: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:05.428 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate[98958]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T21:48:05.428 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 bash[98943]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T21:48:05.429 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate[98958]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T21:48:05.429 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 bash[98943]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T21:48:05.429 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate[98958]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T21:48:05.429 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 bash[98943]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T21:48:05.429 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate[98958]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T21:48:05.429 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 bash[98943]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T21:48:05.429 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate[98958]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T21:48:05.429 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 bash[98943]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T21:48:05.429 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 podman[99107]: 2024-09-13 21:48:05.194975612 +0000 UTC m=+0.017535584 container died 7eac4971f19e1cbb7e21e800738ab3a358137251299f630babbda508dc10182a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731) 2024-09-13T21:48:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:05 smithi155 ceph-mon[79928]: pgmap v41: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:06.124 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:05 smithi119 podman[99107]: 2024-09-13 21:48:05.820733168 +0000 UTC m=+0.643293174 container remove 7eac4971f19e1cbb7e21e800738ab3a358137251299f630babbda508dc10182a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731) 2024-09-13T21:48:06.124 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:06 smithi119 podman[99167]: 2024-09-13 21:48:06.013084251 +0000 UTC m=+0.100529583 container create dd1b263d2276f9c552f6938aab624f1c58d2cedaef024d7c0824038eb73449a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:48:06.125 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:06 smithi119 podman[99167]: 2024-09-13 21:48:05.927917249 +0000 UTC m=+0.015362594 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:06.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:06 smithi119 podman[99167]: 2024-09-13 21:48:06.23234123 +0000 UTC m=+0.319786567 container init dd1b263d2276f9c552f6938aab624f1c58d2cedaef024d7c0824038eb73449a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T21:48:06.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:06 smithi119 podman[99167]: 2024-09-13 21:48:06.235604448 +0000 UTC m=+0.323049782 container start dd1b263d2276f9c552f6938aab624f1c58d2cedaef024d7c0824038eb73449a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T21:48:06.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:06 smithi119 ceph-osd[99186]: -- 172.21.15.119:0/3568899319 <== mon.0 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55649902e1e0 con 0x556499016000 2024-09-13T21:48:06.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:06 smithi119 bash[99167]: dd1b263d2276f9c552f6938aab624f1c58d2cedaef024d7c0824038eb73449a1 2024-09-13T21:48:06.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:06 smithi119 systemd[1]: Started Ceph osd.0 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:48:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:07 smithi119 ceph-mon[90896]: pgmap v42: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:07 smithi155 ceph-mon[79928]: pgmap v42: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:08.379 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:08 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0[99182]: 2024-09-13T21:48:08.110+0000 7f4edde1b640 -1 Falling back to public interface 2024-09-13T21:48:09.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:09 smithi119 ceph-mon[90896]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:09.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:09 smithi155 ceph-mon[79928]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:11 smithi155 ceph-mon[79928]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:11 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:11 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:11 smithi119 ceph-mon[90896]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:11 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:11 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:13.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:12 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:13.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:12 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:13.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:12 smithi155 ceph-mon[79928]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:13.126 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:12 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:13.127 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:12 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:13.127 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:12 smithi119 ceph-mon[90896]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:14.040 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:13 smithi119 ceph-mon[90896]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:48:14.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:13 smithi155 ceph-mon[79928]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:48:14.321 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:14 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0[99182]: 2024-09-13T21:48:14.038+0000 7f4edde1b640 -1 osd.0 47 log_to_monitors true 2024-09-13T21:48:14.955 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:14 smithi119 ceph-mon[90896]: from='osd.0 [v2:172.21.15.119:6802/1128271628,v1:172.21.15.119:6803/1128271628]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T21:48:14.955 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:14 smithi119 ceph-mon[90896]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:15.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:14 smithi155 ceph-mon[79928]: from='osd.0 [v2:172.21.15.119:6802/1128271628,v1:172.21.15.119:6803/1128271628]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T21:48:15.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:14 smithi155 ceph-mon[79928]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:15.880 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0[99182]: 2024-09-13T21:48:15.552+0000 7f4ed1bad640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:48:15.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='osd.0 [v2:172.21.15.119:6802/1128271628,v1:172.21.15.119:6803/1128271628]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T21:48:15.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T21:48:15.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='osd.0 [v2:172.21.15.119:6802/1128271628,v1:172.21.15.119:6803/1128271628]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:48:15.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:15.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:15.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:15.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:48:15.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:15.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:15.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:15.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:15.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:15.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:48:15.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:48:15.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T21:48:15.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:15 smithi119 ceph-mon[90896]: from='osd.0 [v2:172.21.15.119:6802/1128271628,v1:172.21.15.119:6803/1128271628]' entity='osd.0' 2024-09-13T21:48:16.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='osd.0 [v2:172.21.15.119:6802/1128271628,v1:172.21.15.119:6803/1128271628]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T21:48:16.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T21:48:16.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='osd.0 [v2:172.21.15.119:6802/1128271628,v1:172.21.15.119:6803/1128271628]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T21:48:16.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:15 smithi155 ceph-mon[79928]: from='osd.0 [v2:172.21.15.119:6802/1128271628,v1:172.21.15.119:6803/1128271628]' entity='osd.0' 2024-09-13T21:48:17.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:16 smithi155 ceph-mon[79928]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:17.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:16 smithi155 ceph-mon[79928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:48:17.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:16 smithi155 ceph-mon[79928]: osd.0 [v2:172.21.15.119:6802/1128271628,v1:172.21.15.119:6803/1128271628] boot 2024-09-13T21:48:17.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:16 smithi155 ceph-mon[79928]: osdmap e51: 6 total, 6 up, 6 in 2024-09-13T21:48:17.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:16 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:48:17.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:16 smithi119 ceph-mon[90896]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 62/318 objects degraded (19.497%) 2024-09-13T21:48:17.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:16 smithi119 ceph-mon[90896]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:48:17.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:16 smithi119 ceph-mon[90896]: osd.0 [v2:172.21.15.119:6802/1128271628,v1:172.21.15.119:6803/1128271628] boot 2024-09-13T21:48:17.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:16 smithi119 ceph-mon[90896]: osdmap e51: 6 total, 6 up, 6 in 2024-09-13T21:48:17.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:16 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T21:48:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:18 smithi155 ceph-mon[79928]: osdmap e52: 6 total, 6 up, 6 in 2024-09-13T21:48:18.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:18 smithi155 ceph-mon[79928]: pgmap v51: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 11/318 objects degraded (3.459%) 2024-09-13T21:48:18.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:18 smithi119 ceph-mon[90896]: osdmap e52: 6 total, 6 up, 6 in 2024-09-13T21:48:18.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:18 smithi119 ceph-mon[90896]: pgmap v51: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 11/318 objects degraded (3.459%) 2024-09-13T21:48:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:19 smithi155 ceph-mon[79928]: Health check update: Degraded data redundancy: 11/318 objects degraded (3.459%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:19.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:19 smithi119 ceph-mon[90896]: Health check update: Degraded data redundancy: 11/318 objects degraded (3.459%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:20.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:20 smithi155 ceph-mon[79928]: pgmap v52: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:20.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:20 smithi119 ceph-mon[90896]: pgmap v52: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:21 smithi155 ceph-mon[79928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/318 objects degraded (3.459%), 3 pgs degraded) 2024-09-13T21:48:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:21 smithi155 ceph-mon[79928]: Cluster is now healthy 2024-09-13T21:48:21.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:21 smithi119 ceph-mon[90896]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/318 objects degraded (3.459%), 3 pgs degraded) 2024-09-13T21:48:21.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:21 smithi119 ceph-mon[90896]: Cluster is now healthy 2024-09-13T21:48:23.505 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:23 smithi119 ceph-mon[90896]: pgmap v53: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:23.505 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:23.505 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:23 smithi155 ceph-mon[79928]: pgmap v53: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:25 smithi155 ceph-mon[79928]: pgmap v54: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-13T21:48:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:25 smithi155 ceph-mon[79928]: mgrmap e38: smithi119.gwjxmq(active, since 92s), standbys: smithi155.wuuxfd 2024-09-13T21:48:25.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:25 smithi119 ceph-mon[90896]: pgmap v54: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-13T21:48:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:25 smithi119 ceph-mon[90896]: mgrmap e38: smithi119.gwjxmq(active, since 92s), standbys: smithi155.wuuxfd 2024-09-13T21:48:27.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:27 smithi155 ceph-mon[79928]: pgmap v55: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 641 B/s wr, 0 op/s 2024-09-13T21:48:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:27 smithi119 ceph-mon[90896]: pgmap v55: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 641 B/s wr, 0 op/s 2024-09-13T21:48:28.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:28 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:28.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:28 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:29 smithi155 ceph-mon[79928]: pgmap v56: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 581 B/s wr, 0 op/s 2024-09-13T21:48:29.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:29 smithi119 ceph-mon[90896]: pgmap v56: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 581 B/s wr, 0 op/s 2024-09-13T21:48:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:31 smithi155 ceph-mon[79928]: pgmap v57: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:48:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:31 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:48:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:31 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:48:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:31 smithi155 ceph-mon[79928]: Upgrade: osd.1 is safe to restart 2024-09-13T21:48:31.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:31 smithi119 ceph-mon[90896]: pgmap v57: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:48:31.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:31 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:48:31.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:31 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T21:48:31.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:31 smithi119 ceph-mon[90896]: Upgrade: osd.1 is safe to restart 2024-09-13T21:48:32.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.517+0000 7f9d912fc640 1 -- 172.21.15.119:0/167028384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c0fdba0 msgr2=0x7f9d8c0fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:32.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.517+0000 7f9d912fc640 1 --2- 172.21.15.119:0/167028384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c0fdba0 0x7f9d8c0fdfb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0048d0 tx=0x7f9d7c009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.517+0000 7f9d912fc640 1 -- 172.21.15.119:0/167028384 shutdown_connections 2024-09-13T21:48:32.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.517+0000 7f9d912fc640 1 --2- 172.21.15.119:0/167028384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d8c0fe4f0 0x7f9d8c0fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.517+0000 7f9d912fc640 1 --2- 172.21.15.119:0/167028384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c0fdba0 0x7f9d8c0fdfb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.517+0000 7f9d912fc640 1 -- 172.21.15.119:0/167028384 >> 172.21.15.119:0/167028384 conn(0x7f9d8c0f63a0 msgr2=0x7f9d8c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:32.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.517+0000 7f9d912fc640 1 -- 172.21.15.119:0/167028384 shutdown_connections 2024-09-13T21:48:32.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.517+0000 7f9d912fc640 1 -- 172.21.15.119:0/167028384 wait complete. 2024-09-13T21:48:32.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d912fc640 1 Processor -- start 2024-09-13T21:48:32.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d912fc640 1 -- start start 2024-09-13T21:48:32.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d912fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c0fdba0 0x7f9d8c10d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:32.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d912fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d8c0fe4f0 0x7f9d8c10d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:32.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d912fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c10e4a0 con 0x7f9d8c0fdba0 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d912fc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c10e610 con 0x7f9d8c0fe4f0 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d8affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c0fdba0 0x7f9d8c10d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d8affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c0fdba0 0x7f9d8c10d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58126/0 (socket says 172.21.15.119:58126) 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d8affd640 1 -- 172.21.15.119:0/755876700 learned_addr learned my addr 172.21.15.119:0/755876700 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d8a7fc640 1 --2- 172.21.15.119:0/755876700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d8c0fe4f0 0x7f9d8c10d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d8affd640 1 -- 172.21.15.119:0/755876700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d8c0fe4f0 msgr2=0x7f9d8c10d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.518+0000 7f9d8affd640 1 --2- 172.21.15.119:0/755876700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d8c0fe4f0 0x7f9d8c10d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.519+0000 7f9d8affd640 1 -- 172.21.15.119:0/755876700 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c005040 con 0x7f9d8c0fdba0 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.519+0000 7f9d8affd640 1 --2- 172.21.15.119:0/755876700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c0fdba0 0x7f9d8c10d0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c003080 tx=0x7f9d7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.519+0000 7f9d737fe640 1 -- 172.21.15.119:0/755876700 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d7c038070 con 0x7f9d8c0fdba0 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.519+0000 7f9d737fe640 1 -- 172.21.15.119:0/755876700 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9d7c02abd0 con 0x7f9d8c0fdba0 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.519+0000 7f9d912fc640 1 -- 172.21.15.119:0/755876700 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c10e890 con 0x7f9d8c0fdba0 2024-09-13T21:48:32.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.519+0000 7f9d737fe640 1 -- 172.21.15.119:0/755876700 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d7c03e670 con 0x7f9d8c0fdba0 2024-09-13T21:48:32.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.519+0000 7f9d912fc640 1 -- 172.21.15.119:0/755876700 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c10edb0 con 0x7f9d8c0fdba0 2024-09-13T21:48:32.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.520+0000 7f9d912fc640 1 -- 172.21.15.119:0/755876700 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c105820 con 0x7f9d8c0fdba0 2024-09-13T21:48:32.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.520+0000 7f9d737fe640 1 -- 172.21.15.119:0/755876700 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9d7c030020 con 0x7f9d8c0fdba0 2024-09-13T21:48:32.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.521+0000 7f9d737fe640 1 --2- 172.21.15.119:0/755876700 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9d7406e530 0x7f9d740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:32.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.521+0000 7f9d8a7fc640 1 --2- 172.21.15.119:0/755876700 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9d7406e530 0x7f9d740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:32.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.521+0000 7f9d737fe640 1 -- 172.21.15.119:0/755876700 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9d7c0ae560 con 0x7f9d8c0fdba0 2024-09-13T21:48:32.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.521+0000 7f9d8a7fc640 1 --2- 172.21.15.119:0/755876700 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9d7406e530 0x7f9d740709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c10cea0 tx=0x7f9d80008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:32.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.525+0000 7f9d737fe640 1 -- 172.21.15.119:0/755876700 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9d7c0776a0 con 0x7f9d8c0fdba0 2024-09-13T21:48:32.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.714+0000 7f9d912fc640 1 -- 172.21.15.119:0/755876700 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d8c10efd0 con 0x7f9d7406e530 2024-09-13T21:48:32.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.715+0000 7f9d737fe640 1 -- 172.21.15.119:0/755876700 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9d8c10efd0 con 0x7f9d7406e530 2024-09-13T21:48:32.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.717+0000 7f9d912fc640 1 -- 172.21.15.119:0/755876700 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9d7406e530 msgr2=0x7f9d740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.717+0000 7f9d912fc640 1 --2- 172.21.15.119:0/755876700 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9d7406e530 0x7f9d740709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c10cea0 tx=0x7f9d80008040 comp rx=0 tx=0).stop 2024-09-13T21:48:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.717+0000 7f9d912fc640 1 -- 172.21.15.119:0/755876700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c0fdba0 msgr2=0x7f9d8c10d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.717+0000 7f9d912fc640 1 --2- 172.21.15.119:0/755876700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c0fdba0 0x7f9d8c10d0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c003080 tx=0x7f9d7c009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.717+0000 7f9d912fc640 1 -- 172.21.15.119:0/755876700 shutdown_connections 2024-09-13T21:48:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.717+0000 7f9d912fc640 1 --2- 172.21.15.119:0/755876700 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9d7406e530 0x7f9d740709e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.717+0000 7f9d912fc640 1 --2- 172.21.15.119:0/755876700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d8c0fe4f0 0x7f9d8c10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.717+0000 7f9d912fc640 1 --2- 172.21.15.119:0/755876700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d8c0fdba0 0x7f9d8c10d0f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.717+0000 7f9d912fc640 1 -- 172.21.15.119:0/755876700 >> 172.21.15.119:0/755876700 conn(0x7f9d8c0f63a0 msgr2=0x7f9d8c0f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.717+0000 7f9d912fc640 1 -- 172.21.15.119:0/755876700 shutdown_connections 2024-09-13T21:48:32.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.717+0000 7f9d912fc640 1 -- 172.21.15.119:0/755876700 wait complete. 2024-09-13T21:48:32.727 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:48:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.797+0000 7fccc2556640 1 -- 172.21.15.119:0/1265004303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccbc0fd820 msgr2=0x7fccbc0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.797+0000 7fccc2556640 1 --2- 172.21.15.119:0/1265004303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccbc0fd820 0x7fccbc0fdc90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fccb00048d0 tx=0x7fccb0009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.797+0000 7fccc2556640 1 -- 172.21.15.119:0/1265004303 shutdown_connections 2024-09-13T21:48:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.797+0000 7fccc2556640 1 --2- 172.21.15.119:0/1265004303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccbc0fd820 0x7fccbc0fdc90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.797+0000 7fccc2556640 1 --2- 172.21.15.119:0/1265004303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccbc0fc550 0x7fccbc0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.797+0000 7fccc2556640 1 -- 172.21.15.119:0/1265004303 >> 172.21.15.119:0/1265004303 conn(0x7fccbc0f7d30 msgr2=0x7fccbc0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:32.799 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:32 smithi119 ceph-mon[90896]: Upgrade: Updating osd.1 2024-09-13T21:48:32.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:32 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:32.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:32 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:48:32.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:32 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:32.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:32 smithi119 ceph-mon[90896]: Deploying daemon osd.1 on smithi119 2024-09-13T21:48:32.800 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:32 smithi119 ceph-mon[90896]: pgmap v58: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:48:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.798+0000 7fccc2556640 1 -- 172.21.15.119:0/1265004303 shutdown_connections 2024-09-13T21:48:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.798+0000 7fccc2556640 1 -- 172.21.15.119:0/1265004303 wait complete. 2024-09-13T21:48:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.798+0000 7fccc2556640 1 Processor -- start 2024-09-13T21:48:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.798+0000 7fccc2556640 1 -- start start 2024-09-13T21:48:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.798+0000 7fccc2556640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccbc0fc550 0x7fccbc10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.798+0000 7fccc2556640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccbc0fd820 0x7fccbc10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.798+0000 7fccc2556640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc10dc40 con 0x7fccbc0fc550 2024-09-13T21:48:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.798+0000 7fccc2556640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc10e460 con 0x7fccbc0fd820 2024-09-13T21:48:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccbbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccbc0fc550 0x7fccbc10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccbbfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccbc0fc550 0x7fccbc10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58138/0 (socket says 172.21.15.119:58138) 2024-09-13T21:48:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccbbfff640 1 -- 172.21.15.119:0/1314987146 learned_addr learned my addr 172.21.15.119:0/1314987146 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccbb7fe640 1 --2- 172.21.15.119:0/1314987146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccbc0fd820 0x7fccbc10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccbbfff640 1 -- 172.21.15.119:0/1314987146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccbc0fd820 msgr2=0x7fccbc10d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccbbfff640 1 --2- 172.21.15.119:0/1314987146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccbc0fd820 0x7fccbc10d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccbbfff640 1 -- 172.21.15.119:0/1314987146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb0005040 con 0x7fccbc0fc550 2024-09-13T21:48:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccbbfff640 1 --2- 172.21.15.119:0/1314987146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccbc0fc550 0x7fccbc10d0b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fccac002a50 tx=0x7fccac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccb8ff9640 1 -- 172.21.15.119:0/1314987146 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccac007c30 con 0x7fccbc0fc550 2024-09-13T21:48:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccb8ff9640 1 -- 172.21.15.119:0/1314987146 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fccac00f040 con 0x7fccbc0fc550 2024-09-13T21:48:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccc2556640 1 -- 172.21.15.119:0/1314987146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccbc10e6f0 con 0x7fccbc0fc550 2024-09-13T21:48:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccb8ff9640 1 -- 172.21.15.119:0/1314987146 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccac00da10 con 0x7fccbc0fc550 2024-09-13T21:48:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.799+0000 7fccc2556640 1 -- 172.21.15.119:0/1314987146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccbc10ec90 con 0x7fccbc0fc550 2024-09-13T21:48:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.800+0000 7fccc2556640 1 -- 172.21.15.119:0/1314987146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccbc0fb9b0 con 0x7fccbc0fc550 2024-09-13T21:48:32.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.801+0000 7fccb8ff9640 1 -- 172.21.15.119:0/1314987146 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fccac00dc80 con 0x7fccbc0fc550 2024-09-13T21:48:32.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.801+0000 7fccb8ff9640 1 --2- 172.21.15.119:0/1314987146 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcca406e530 0x7fcca40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:32.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.801+0000 7fccb8ff9640 1 -- 172.21.15.119:0/1314987146 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fccac08d990 con 0x7fccbc0fc550 2024-09-13T21:48:32.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.801+0000 7fccbb7fe640 1 --2- 172.21.15.119:0/1314987146 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcca406e530 0x7fcca40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:32.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.802+0000 7fccbb7fe640 1 --2- 172.21.15.119:0/1314987146 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcca406e530 0x7fcca40709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fccb0007ac0 tx=0x7fccb0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:32.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.806+0000 7fccb8ff9640 1 -- 172.21.15.119:0/1314987146 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fccac056ad0 con 0x7fccbc0fc550 2024-09-13T21:48:32.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.990+0000 7fccc2556640 1 -- 172.21.15.119:0/1314987146 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fccbc10eff0 con 0x7fcca406e530 2024-09-13T21:48:32.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.991+0000 7fccb8ff9640 1 -- 172.21.15.119:0/1314987146 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fccbc10eff0 con 0x7fcca406e530 2024-09-13T21:48:32.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.993+0000 7fccc2556640 1 -- 172.21.15.119:0/1314987146 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcca406e530 msgr2=0x7fcca40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:32.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.993+0000 7fccc2556640 1 --2- 172.21.15.119:0/1314987146 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcca406e530 0x7fcca40709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fccb0007ac0 tx=0x7fccb0035040 comp rx=0 tx=0).stop 2024-09-13T21:48:32.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.993+0000 7fccc2556640 1 -- 172.21.15.119:0/1314987146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccbc0fc550 msgr2=0x7fccbc10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:32.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.993+0000 7fccc2556640 1 --2- 172.21.15.119:0/1314987146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccbc0fc550 0x7fccbc10d0b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fccac002a50 tx=0x7fccac004600 comp rx=0 tx=0).stop 2024-09-13T21:48:32.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.993+0000 7fccc2556640 1 -- 172.21.15.119:0/1314987146 shutdown_connections 2024-09-13T21:48:32.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.993+0000 7fccc2556640 1 --2- 172.21.15.119:0/1314987146 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcca406e530 0x7fcca40709e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.993+0000 7fccc2556640 1 --2- 172.21.15.119:0/1314987146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccbc0fd820 0x7fccbc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.993+0000 7fccc2556640 1 --2- 172.21.15.119:0/1314987146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccbc0fc550 0x7fccbc10d0b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:32.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.993+0000 7fccc2556640 1 -- 172.21.15.119:0/1314987146 >> 172.21.15.119:0/1314987146 conn(0x7fccbc0f7d30 msgr2=0x7fccbc0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:32.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.993+0000 7fccc2556640 1 -- 172.21.15.119:0/1314987146 shutdown_connections 2024-09-13T21:48:32.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:32.993+0000 7fccc2556640 1 -- 172.21.15.119:0/1314987146 wait complete. 2024-09-13T21:48:33.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.071+0000 7f68d6d91640 1 -- 172.21.15.119:0/426972234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68d00fc700 msgr2=0x7f68d00fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.071+0000 7f68d6d91640 1 --2- 172.21.15.119:0/426972234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68d00fc700 0x7f68d00fcb70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0048d0 tx=0x7f68bc009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.071+0000 7f68d6d91640 1 -- 172.21.15.119:0/426972234 shutdown_connections 2024-09-13T21:48:33.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.071+0000 7f68d6d91640 1 --2- 172.21.15.119:0/426972234 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68d00fc700 0x7f68d00fcb70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.071+0000 7f68d6d91640 1 --2- 172.21.15.119:0/426972234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d00fb430 0x7f68d00fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.071+0000 7f68d6d91640 1 -- 172.21.15.119:0/426972234 >> 172.21.15.119:0/426972234 conn(0x7f68d00f6c10 msgr2=0x7f68d00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:33.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.072+0000 7f68d6d91640 1 -- 172.21.15.119:0/426972234 shutdown_connections 2024-09-13T21:48:33.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.072+0000 7f68d6d91640 1 -- 172.21.15.119:0/426972234 wait complete. 2024-09-13T21:48:33.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.072+0000 7f68d6d91640 1 Processor -- start 2024-09-13T21:48:33.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.072+0000 7f68d6d91640 1 -- start start 2024-09-13T21:48:33.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.072+0000 7f68d6d91640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d00fb430 0x7f68d00ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.072+0000 7f68d6d91640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68d00fc700 0x7f68d00fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.072+0000 7f68d6d91640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00fe060 con 0x7f68d00fc700 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.072+0000 7f68d6d91640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00fe1a0 con 0x7f68d00fb430 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68cffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68d00fc700 0x7f68d00fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68cffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68d00fc700 0x7f68d00fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58152/0 (socket says 172.21.15.119:58152) 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68cffff640 1 -- 172.21.15.119:0/2205712745 learned_addr learned my addr 172.21.15.119:0/2205712745 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68d4b2d640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d00fb430 0x7f68d00ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68cffff640 1 -- 172.21.15.119:0/2205712745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d00fb430 msgr2=0x7f68d00ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68cffff640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d00fb430 0x7f68d00ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68cffff640 1 -- 172.21.15.119:0/2205712745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc005040 con 0x7f68d00fc700 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68d4b2d640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d00fb430 0x7f68d00ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:48:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68cffff640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68d00fc700 0x7f68d00fda40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68bc003080 tx=0x7f68bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:33.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68cd7fa640 1 -- 172.21.15.119:0/2205712745 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68bc038070 con 0x7f68d00fc700 2024-09-13T21:48:33.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68d6d91640 1 -- 172.21.15.119:0/2205712745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d00fe420 con 0x7f68d00fc700 2024-09-13T21:48:33.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68cd7fa640 1 -- 172.21.15.119:0/2205712745 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f68bc009800 con 0x7f68d00fc700 2024-09-13T21:48:33.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68cd7fa640 1 -- 172.21.15.119:0/2205712745 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68bc033660 con 0x7f68d00fc700 2024-09-13T21:48:33.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.073+0000 7f68d6d91640 1 -- 172.21.15.119:0/2205712745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d0115110 con 0x7f68d00fc700 2024-09-13T21:48:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.075+0000 7f68d6d91640 1 -- 172.21.15.119:0/2205712745 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d00fa890 con 0x7f68d00fc700 2024-09-13T21:48:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.075+0000 7f68cd7fa640 1 -- 172.21.15.119:0/2205712745 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f68bc030020 con 0x7f68d00fc700 2024-09-13T21:48:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.075+0000 7f68cd7fa640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f68c006e530 0x7f68c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.075+0000 7f68cd7fa640 1 -- 172.21.15.119:0/2205712745 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f68bc0ae300 con 0x7f68d00fc700 2024-09-13T21:48:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.075+0000 7f68d4b2d640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f68c006e530 0x7f68c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.076+0000 7f68d4b2d640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f68c006e530 0x7f68c00709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f68d00ff300 tx=0x7f68c4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:33.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.080+0000 7f68cd7fa640 1 -- 172.21.15.119:0/2205712745 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f68bc078350 con 0x7f68d00fc700 2024-09-13T21:48:33.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:32 smithi155 ceph-mon[79928]: Upgrade: Updating osd.1 2024-09-13T21:48:33.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:32 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:33.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:32 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T21:48:33.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:32 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:33.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:32 smithi155 ceph-mon[79928]: Deploying daemon osd.1 on smithi119 2024-09-13T21:48:33.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:32 smithi155 ceph-mon[79928]: pgmap v58: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:48:33.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.268+0000 7f68d6d91640 1 -- 172.21.15.119:0/2205712745 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f68d0103fc0 con 0x7f68c006e530 2024-09-13T21:48:33.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.277+0000 7f68cd7fa640 1 -- 172.21.15.119:0/2205712745 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f68d0103fc0 con 0x7f68c006e530 2024-09-13T21:48:33.278 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:48:33.278 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (3m) 22s ago 11m 16.9M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:48:33.278 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (52s) 22s ago 11m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:48:33.278 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (47s) 44s ago 10m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:48:33.278 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (2m) 22s ago 11m 80.2M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (6m) 22s ago 6m 13.5M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (6m) 22s ago 6m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (6m) 44s ago 6m 16.3M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (6m) 44s ago 6m 110M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (2m) 22s ago 12m 495M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (119s) 44s ago 10m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (107s) 22s ago 12m 43.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (88s) 44s ago 10m 34.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (3m) 22s ago 11m 16.4M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (2m) 44s ago 10m 15.4M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (27s) 22s ago 9m 11.9M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (9m) 22s ago 9m 234M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 654674a31fb7 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (9m) 22s ago 9m 192M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:48:33.279 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (8m) 44s ago 8m 266M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:48:33.280 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (8m) 44s ago 8m 228M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:48:33.280 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (7m) 44s ago 7m 227M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:48:33.280 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (2m) 22s ago 11m 51.5M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:48:33.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.279+0000 7f68d6d91640 1 -- 172.21.15.119:0/2205712745 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f68c006e530 msgr2=0x7f68c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.279+0000 7f68d6d91640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f68c006e530 0x7f68c00709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f68d00ff300 tx=0x7f68c4008040 comp rx=0 tx=0).stop 2024-09-13T21:48:33.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.279+0000 7f68d6d91640 1 -- 172.21.15.119:0/2205712745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68d00fc700 msgr2=0x7f68d00fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.279+0000 7f68d6d91640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68d00fc700 0x7f68d00fda40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68bc003080 tx=0x7f68bc009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.279+0000 7f68d6d91640 1 -- 172.21.15.119:0/2205712745 shutdown_connections 2024-09-13T21:48:33.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.279+0000 7f68d6d91640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f68c006e530 0x7f68c00709e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.279+0000 7f68d6d91640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68d00fc700 0x7f68d00fda40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.279+0000 7f68d6d91640 1 --2- 172.21.15.119:0/2205712745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d00fb430 0x7f68d00ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.279+0000 7f68d6d91640 1 -- 172.21.15.119:0/2205712745 >> 172.21.15.119:0/2205712745 conn(0x7f68d00f6c10 msgr2=0x7f68d0065650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:33.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.279+0000 7f68d6d91640 1 -- 172.21.15.119:0/2205712745 shutdown_connections 2024-09-13T21:48:33.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.279+0000 7f68d6d91640 1 -- 172.21.15.119:0/2205712745 wait complete. 2024-09-13T21:48:33.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.357+0000 7f7aee50a640 1 -- 172.21.15.119:0/4110458818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae80fc6f0 msgr2=0x7f7ae80fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.357+0000 7f7aee50a640 1 --2- 172.21.15.119:0/4110458818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae80fc6f0 0x7f7ae80fcb60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0048d0 tx=0x7f7adc009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.357+0000 7f7aee50a640 1 -- 172.21.15.119:0/4110458818 shutdown_connections 2024-09-13T21:48:33.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.357+0000 7f7aee50a640 1 --2- 172.21.15.119:0/4110458818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae80fc6f0 0x7f7ae80fcb60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.357+0000 7f7aee50a640 1 --2- 172.21.15.119:0/4110458818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ae80fb420 0x7f7ae80fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.357+0000 7f7aee50a640 1 -- 172.21.15.119:0/4110458818 >> 172.21.15.119:0/4110458818 conn(0x7f7ae80f6c00 msgr2=0x7f7ae80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.358+0000 7f7aee50a640 1 -- 172.21.15.119:0/4110458818 shutdown_connections 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.358+0000 7f7aee50a640 1 -- 172.21.15.119:0/4110458818 wait complete. 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.358+0000 7f7aee50a640 1 Processor -- start 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.358+0000 7f7aee50a640 1 -- start start 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.358+0000 7f7aee50a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae80fb420 0x7f7ae80ff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.358+0000 7f7aee50a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ae80fc6f0 0x7f7ae80fda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.358+0000 7f7aee50a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80fdf70 con 0x7f7ae80fb420 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.358+0000 7f7aee50a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80fe0b0 con 0x7f7ae80fc6f0 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae80fb420 0x7f7ae80ff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae80fb420 0x7f7ae80ff4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58170/0 (socket says 172.21.15.119:58170) 2024-09-13T21:48:33.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7ae7fff640 1 -- 172.21.15.119:0/4281491594 learned_addr learned my addr 172.21.15.119:0/4281491594 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:33.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7ae77fe640 1 --2- 172.21.15.119:0/4281491594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ae80fc6f0 0x7f7ae80fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:33.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7ae7fff640 1 -- 172.21.15.119:0/4281491594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ae80fc6f0 msgr2=0x7f7ae80fda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7ae7fff640 1 --2- 172.21.15.119:0/4281491594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ae80fc6f0 0x7f7ae80fda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7ae7fff640 1 -- 172.21.15.119:0/4281491594 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc005040 con 0x7f7ae80fb420 2024-09-13T21:48:33.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7ae7fff640 1 --2- 172.21.15.119:0/4281491594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae80fb420 0x7f7ae80ff4f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8002a50 tx=0x7f7ad8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:33.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7ae4ff9640 1 -- 172.21.15.119:0/4281491594 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad8007c30 con 0x7f7ae80fb420 2024-09-13T21:48:33.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7ae4ff9640 1 -- 172.21.15.119:0/4281491594 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7ad800f040 con 0x7f7ae80fb420 2024-09-13T21:48:33.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7aee50a640 1 -- 172.21.15.119:0/4281491594 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae80fe390 con 0x7f7ae80fb420 2024-09-13T21:48:33.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7ae4ff9640 1 -- 172.21.15.119:0/4281491594 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad800dad0 con 0x7f7ae80fb420 2024-09-13T21:48:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.359+0000 7f7aee50a640 1 -- 172.21.15.119:0/4281491594 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae8115130 con 0x7f7ae80fb420 2024-09-13T21:48:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.360+0000 7f7aee50a640 1 -- 172.21.15.119:0/4281491594 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae80fa880 con 0x7f7ae80fb420 2024-09-13T21:48:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.361+0000 7f7ae4ff9640 1 -- 172.21.15.119:0/4281491594 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7ad800dc30 con 0x7f7ae80fb420 2024-09-13T21:48:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.361+0000 7f7ae4ff9640 1 --2- 172.21.15.119:0/4281491594 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7ad006e530 0x7f7ad00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.361+0000 7f7ae77fe640 1 --2- 172.21.15.119:0/4281491594 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7ad006e530 0x7f7ad00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.361+0000 7f7ae4ff9640 1 -- 172.21.15.119:0/4281491594 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7ad808dfc0 con 0x7f7ae80fb420 2024-09-13T21:48:33.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.362+0000 7f7ae77fe640 1 --2- 172.21.15.119:0/4281491594 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7ad006e530 0x7f7ad00709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00b020 tx=0x7f7adc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:33.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.366+0000 7f7ae4ff9640 1 -- 172.21.15.119:0/4281491594 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7ad8057100 con 0x7f7ae80fb420 2024-09-13T21:48:33.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.629+0000 7f7aee50a640 1 -- 172.21.15.119:0/4281491594 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7ae8103fb0 con 0x7f7ae80fb420 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.632+0000 7f7ae4ff9640 1 -- 172.21.15.119:0/4281491594 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f7ae8103fb0 con 0x7f7ae80fb420 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 5, 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T21:48:33.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:48:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:48:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:48:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:48:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:48:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 9, 2024-09-13T21:48:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 5 2024-09-13T21:48:33.635 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:48:33.635 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:48:33.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.634+0000 7f7aee50a640 1 -- 172.21.15.119:0/4281491594 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7ad006e530 msgr2=0x7f7ad00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.634+0000 7f7aee50a640 1 --2- 172.21.15.119:0/4281491594 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7ad006e530 0x7f7ad00709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00b020 tx=0x7f7adc035040 comp rx=0 tx=0).stop 2024-09-13T21:48:33.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.634+0000 7f7aee50a640 1 -- 172.21.15.119:0/4281491594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae80fb420 msgr2=0x7f7ae80ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.634+0000 7f7aee50a640 1 --2- 172.21.15.119:0/4281491594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae80fb420 0x7f7ae80ff4f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8002a50 tx=0x7f7ad8004600 comp rx=0 tx=0).stop 2024-09-13T21:48:33.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.634+0000 7f7aee50a640 1 -- 172.21.15.119:0/4281491594 shutdown_connections 2024-09-13T21:48:33.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.635+0000 7f7aee50a640 1 --2- 172.21.15.119:0/4281491594 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7ad006e530 0x7f7ad00709e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.635+0000 7f7aee50a640 1 --2- 172.21.15.119:0/4281491594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ae80fc6f0 0x7f7ae80fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.635+0000 7f7aee50a640 1 --2- 172.21.15.119:0/4281491594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ae80fb420 0x7f7ae80ff4f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.635+0000 7f7aee50a640 1 -- 172.21.15.119:0/4281491594 >> 172.21.15.119:0/4281491594 conn(0x7f7ae80f6c00 msgr2=0x7f7ae8065f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:33.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.635+0000 7f7aee50a640 1 -- 172.21.15.119:0/4281491594 shutdown_connections 2024-09-13T21:48:33.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.635+0000 7f7aee50a640 1 -- 172.21.15.119:0/4281491594 wait complete. 2024-09-13T21:48:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.719+0000 7f2a07ba5640 1 -- 172.21.15.119:0/2108694241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a000ff670 msgr2=0x7f2a00101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.719+0000 7f2a07ba5640 1 --2- 172.21.15.119:0/2108694241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a000ff670 0x7f2a00101a50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f29f00048d0 tx=0x7f29f0009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 -- 172.21.15.119:0/2108694241 shutdown_connections 2024-09-13T21:48:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 --2- 172.21.15.119:0/2108694241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a000ff670 0x7f2a00101a50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 --2- 172.21.15.119:0/2108694241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a000664d0 0x7f2a000ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 -- 172.21.15.119:0/2108694241 >> 172.21.15.119:0/2108694241 conn(0x7f2a000f6c00 msgr2=0x7f2a000f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 -- 172.21.15.119:0/2108694241 shutdown_connections 2024-09-13T21:48:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 -- 172.21.15.119:0/2108694241 wait complete. 2024-09-13T21:48:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 Processor -- start 2024-09-13T21:48:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 -- start start 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a000664d0 0x7f2a0010d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a000ff670 0x7f2a0010d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0010e4e0 con 0x7f2a000664d0 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a07ba5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0010e650 con 0x7f2a000ff670 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a05941640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a000664d0 0x7f2a0010d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a05941640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a000664d0 0x7f2a0010d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58180/0 (socket says 172.21.15.119:58180) 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.720+0000 7f2a05941640 1 -- 172.21.15.119:0/3920366324 learned_addr learned my addr 172.21.15.119:0/3920366324 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.721+0000 7f2a05140640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a000ff670 0x7f2a0010d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.721+0000 7f2a05941640 1 -- 172.21.15.119:0/3920366324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a000ff670 msgr2=0x7f2a0010d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.721+0000 7f2a05941640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a000ff670 0x7f2a0010d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.721+0000 7f2a05941640 1 -- 172.21.15.119:0/3920366324 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f0005040 con 0x7f2a000664d0 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.721+0000 7f2a05140640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a000ff670 0x7f2a0010d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:48:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.721+0000 7f2a05941640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a000664d0 0x7f2a0010d180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f29f800bae0 tx=0x7f29f8009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.721+0000 7f29f67fc640 1 -- 172.21.15.119:0/3920366324 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f800cb90 con 0x7f2a000664d0 2024-09-13T21:48:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.721+0000 7f29f67fc640 1 -- 172.21.15.119:0/3920366324 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f29f800ccf0 con 0x7f2a000664d0 2024-09-13T21:48:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.721+0000 7f2a07ba5640 1 -- 172.21.15.119:0/3920366324 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0010e930 con 0x7f2a000664d0 2024-09-13T21:48:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.721+0000 7f29f67fc640 1 -- 172.21.15.119:0/3920366324 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f8007790 con 0x7f2a000664d0 2024-09-13T21:48:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.721+0000 7f2a07ba5640 1 -- 172.21.15.119:0/3920366324 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0010ee50 con 0x7f2a000664d0 2024-09-13T21:48:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.722+0000 7f2a07ba5640 1 -- 172.21.15.119:0/3920366324 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a001057d0 con 0x7f2a000664d0 2024-09-13T21:48:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.723+0000 7f29f67fc640 1 -- 172.21.15.119:0/3920366324 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f29f8007910 con 0x7f2a000664d0 2024-09-13T21:48:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.723+0000 7f29f67fc640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f29ec06e530 0x7f29ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.723+0000 7f29f67fc640 1 -- 172.21.15.119:0/3920366324 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f29f808e580 con 0x7f2a000664d0 2024-09-13T21:48:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.723+0000 7f2a05140640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f29ec06e530 0x7f29ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.724+0000 7f2a05140640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f29ec06e530 0x7f29ec0709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29f000b020 tx=0x7f29f0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.727+0000 7f29f67fc640 1 -- 172.21.15.119:0/3920366324 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f29f80576c0 con 0x7f2a000664d0 2024-09-13T21:48:33.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.929+0000 7f2a07ba5640 1 -- 172.21.15.119:0/3920366324 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2a0004b720 con 0x7f2a000664d0 2024-09-13T21:48:33.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:33 smithi119 ceph-mon[90896]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:33.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:33 smithi119 ceph-mon[90896]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:33.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:33 smithi119 ceph-mon[90896]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:33.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.929+0000 7f29f67fc640 1 -- 172.21.15.119:0/3920366324 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1943 (secure 0 0 0) 0x7f29f805ad80 con 0x7f2a000664d0 2024-09-13T21:48:33.931 INFO:teuthology.orchestra.run.smithi119.stdout:e22 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:48:12:719560+0000 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 22 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:48:12.175306+0000 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:48:33.932 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:48:33.933 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 14472 members: 24267,14472 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:48:33.934 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:33.935 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:48:33.935 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 22 2024-09-13T21:48:33.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.931+0000 7f2a07ba5640 1 -- 172.21.15.119:0/3920366324 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f29ec06e530 msgr2=0x7f29ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.931+0000 7f2a07ba5640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f29ec06e530 0x7f29ec0709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29f000b020 tx=0x7f29f0009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.931+0000 7f2a07ba5640 1 -- 172.21.15.119:0/3920366324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a000664d0 msgr2=0x7f2a0010d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.931+0000 7f2a07ba5640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a000664d0 0x7f2a0010d180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f29f800bae0 tx=0x7f29f8009810 comp rx=0 tx=0).stop 2024-09-13T21:48:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.932+0000 7f2a07ba5640 1 -- 172.21.15.119:0/3920366324 shutdown_connections 2024-09-13T21:48:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.932+0000 7f2a07ba5640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f29ec06e530 0x7f29ec0709e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.932+0000 7f2a07ba5640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a000ff670 0x7f2a0010d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.932+0000 7f2a07ba5640 1 --2- 172.21.15.119:0/3920366324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a000664d0 0x7f2a0010d180 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.932+0000 7f2a07ba5640 1 -- 172.21.15.119:0/3920366324 >> 172.21.15.119:0/3920366324 conn(0x7f2a000f6c00 msgr2=0x7f2a000f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.932+0000 7f2a07ba5640 1 -- 172.21.15.119:0/3920366324 shutdown_connections 2024-09-13T21:48:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:33.932+0000 7f2a07ba5640 1 -- 172.21.15.119:0/3920366324 wait complete. 2024-09-13T21:48:34.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.013+0000 7f4f297e6640 1 -- 172.21.15.119:0/2275256481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f240fb450 msgr2=0x7f4f240fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:34.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.013+0000 7f4f297e6640 1 --2- 172.21.15.119:0/2275256481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f240fb450 0x7f4f240fb860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4f140048d0 tx=0x7f4f14009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.013+0000 7f4f297e6640 1 -- 172.21.15.119:0/2275256481 shutdown_connections 2024-09-13T21:48:34.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.013+0000 7f4f297e6640 1 --2- 172.21.15.119:0/2275256481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f240fc720 0x7f4f240fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.013+0000 7f4f297e6640 1 --2- 172.21.15.119:0/2275256481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f240fb450 0x7f4f240fb860 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.013+0000 7f4f297e6640 1 -- 172.21.15.119:0/2275256481 >> 172.21.15.119:0/2275256481 conn(0x7f4f240f6c30 msgr2=0x7f4f240f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:34.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.013+0000 7f4f297e6640 1 -- 172.21.15.119:0/2275256481 shutdown_connections 2024-09-13T21:48:34.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.013+0000 7f4f297e6640 1 -- 172.21.15.119:0/2275256481 wait complete. 2024-09-13T21:48:34.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f297e6640 1 Processor -- start 2024-09-13T21:48:34.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f297e6640 1 -- start start 2024-09-13T21:48:34.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f297e6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f240fb450 0x7f4f2410bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:34.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f297e6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f240fc720 0x7f4f2410c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:34.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f297e6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2410caf0 con 0x7f4f240fc720 2024-09-13T21:48:34.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f297e6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2410d310 con 0x7f4f240fb450 2024-09-13T21:48:34.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f227fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f240fc720 0x7f4f2410c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:34.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f227fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f240fc720 0x7f4f2410c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60808/0 (socket says 172.21.15.119:60808) 2024-09-13T21:48:34.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f227fc640 1 -- 172.21.15.119:0/2342225954 learned_addr learned my addr 172.21.15.119:0/2342225954 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:34.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f22ffd640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f240fb450 0x7f4f2410bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:34.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f227fc640 1 -- 172.21.15.119:0/2342225954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f240fb450 msgr2=0x7f4f2410bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:34.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f227fc640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f240fb450 0x7f4f2410bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f227fc640 1 -- 172.21.15.119:0/2342225954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f14005040 con 0x7f4f240fc720 2024-09-13T21:48:34.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f22ffd640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f240fb450 0x7f4f2410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:48:34.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.014+0000 7f4f227fc640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f240fc720 0x7f4f2410c4a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800fce0 tx=0x7f4f18004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:34.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.015+0000 7f4f0b7fe640 1 -- 172.21.15.119:0/2342225954 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f18007a20 con 0x7f4f240fc720 2024-09-13T21:48:34.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.015+0000 7f4f0b7fe640 1 -- 172.21.15.119:0/2342225954 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4f18007b80 con 0x7f4f240fc720 2024-09-13T21:48:34.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.015+0000 7f4f297e6640 1 -- 172.21.15.119:0/2342225954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2410d540 con 0x7f4f240fc720 2024-09-13T21:48:34.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.015+0000 7f4f0b7fe640 1 -- 172.21.15.119:0/2342225954 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f180126a0 con 0x7f4f240fc720 2024-09-13T21:48:34.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.015+0000 7f4f297e6640 1 -- 172.21.15.119:0/2342225954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2410dae0 con 0x7f4f240fc720 2024-09-13T21:48:34.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.016+0000 7f4f297e6640 1 -- 172.21.15.119:0/2342225954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f240fa8b0 con 0x7f4f240fc720 2024-09-13T21:48:34.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.016+0000 7f4f0b7fe640 1 -- 172.21.15.119:0/2342225954 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4f18007cf0 con 0x7f4f240fc720 2024-09-13T21:48:34.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.017+0000 7f4f0b7fe640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4f0c06e530 0x7f4f0c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:34.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.017+0000 7f4f0b7fe640 1 -- 172.21.15.119:0/2342225954 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f4f18090910 con 0x7f4f240fc720 2024-09-13T21:48:34.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.017+0000 7f4f22ffd640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4f0c06e530 0x7f4f0c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:34.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.017+0000 7f4f22ffd640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4f0c06e530 0x7f4f0c0709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4f14007ac0 tx=0x7f4f14035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:34.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.021+0000 7f4f0b7fe640 1 -- 172.21.15.119:0/2342225954 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f18059ad0 con 0x7f4f240fc720 2024-09-13T21:48:34.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:33 smithi155 ceph-mon[79928]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:34.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:33 smithi155 ceph-mon[79928]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:34.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:33 smithi155 ceph-mon[79928]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:34.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.210+0000 7f4f297e6640 1 -- 172.21.15.119:0/2342225954 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f2410de30 con 0x7f4f0c06e530 2024-09-13T21:48:34.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.211+0000 7f4f0b7fe640 1 -- 172.21.15.119:0/2342225954 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4f2410de30 con 0x7f4f0c06e530 2024-09-13T21:48:34.212 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:48:34.212 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:48:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:48:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:48:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:48:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "crash", 2024-09-13T21:48:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr", 2024-09-13T21:48:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "mon" 2024-09-13T21:48:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:48:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "7/21 daemons upgraded", 2024-09-13T21:48:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:48:34.213 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:48:34.213 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:48:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.213+0000 7f4f297e6640 1 -- 172.21.15.119:0/2342225954 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4f0c06e530 msgr2=0x7f4f0c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.213+0000 7f4f297e6640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4f0c06e530 0x7f4f0c0709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4f14007ac0 tx=0x7f4f14035040 comp rx=0 tx=0).stop 2024-09-13T21:48:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.213+0000 7f4f297e6640 1 -- 172.21.15.119:0/2342225954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f240fc720 msgr2=0x7f4f2410c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.213+0000 7f4f297e6640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f240fc720 0x7f4f2410c4a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800fce0 tx=0x7f4f18004600 comp rx=0 tx=0).stop 2024-09-13T21:48:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.213+0000 7f4f297e6640 1 -- 172.21.15.119:0/2342225954 shutdown_connections 2024-09-13T21:48:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.213+0000 7f4f297e6640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4f0c06e530 0x7f4f0c0709e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.213+0000 7f4f297e6640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f240fc720 0x7f4f2410c4a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.213+0000 7f4f297e6640 1 --2- 172.21.15.119:0/2342225954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f240fb450 0x7f4f2410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.213+0000 7f4f297e6640 1 -- 172.21.15.119:0/2342225954 >> 172.21.15.119:0/2342225954 conn(0x7f4f240f6c30 msgr2=0x7f4f240f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.214+0000 7f4f297e6640 1 -- 172.21.15.119:0/2342225954 shutdown_connections 2024-09-13T21:48:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.214+0000 7f4f297e6640 1 -- 172.21.15.119:0/2342225954 wait complete. 2024-09-13T21:48:34.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.292+0000 7f8aa782a640 1 -- 172.21.15.119:0/1347785376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8aa00fc720 msgr2=0x7f8aa00fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:34.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.292+0000 7f8aa782a640 1 --2- 172.21.15.119:0/1347785376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8aa00fc720 0x7f8aa00fcb90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0048d0 tx=0x7f8a9c009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.292+0000 7f8aa782a640 1 -- 172.21.15.119:0/1347785376 shutdown_connections 2024-09-13T21:48:34.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.292+0000 7f8aa782a640 1 --2- 172.21.15.119:0/1347785376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8aa00fc720 0x7f8aa00fcb90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.292+0000 7f8aa782a640 1 --2- 172.21.15.119:0/1347785376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa00fb450 0x7f8aa00fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.292+0000 7f8aa782a640 1 -- 172.21.15.119:0/1347785376 >> 172.21.15.119:0/1347785376 conn(0x7f8aa00f6c10 msgr2=0x7f8aa00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:34.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.292+0000 7f8aa782a640 1 -- 172.21.15.119:0/1347785376 shutdown_connections 2024-09-13T21:48:34.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.292+0000 7f8aa782a640 1 -- 172.21.15.119:0/1347785376 wait complete. 2024-09-13T21:48:34.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa782a640 1 Processor -- start 2024-09-13T21:48:34.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa782a640 1 -- start start 2024-09-13T21:48:34.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa782a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8aa00fb450 0x7f8aa010fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:34.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa782a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa00fc720 0x7f8aa0112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:34.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa782a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa0066730 con 0x7f8aa00fb450 2024-09-13T21:48:34.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa782a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00668a0 con 0x7f8aa00fc720 2024-09-13T21:48:34.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa55c6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8aa00fb450 0x7f8aa010fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:34.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa55c6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8aa00fb450 0x7f8aa010fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60822/0 (socket says 172.21.15.119:60822) 2024-09-13T21:48:34.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa55c6640 1 -- 172.21.15.119:0/1559461359 learned_addr learned my addr 172.21.15.119:0/1559461359 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:48:34.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa4dc5640 1 --2- 172.21.15.119:0/1559461359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa00fc720 0x7f8aa0112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:34.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa55c6640 1 -- 172.21.15.119:0/1559461359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa00fc720 msgr2=0x7f8aa0112350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:34.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa55c6640 1 --2- 172.21.15.119:0/1559461359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa00fc720 0x7f8aa0112350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.293+0000 7f8aa55c6640 1 -- 172.21.15.119:0/1559461359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c005040 con 0x7f8aa00fb450 2024-09-13T21:48:34.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.294+0000 7f8aa55c6640 1 --2- 172.21.15.119:0/1559461359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8aa00fb450 0x7f8aa010fe00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000eb70 tx=0x7f8a9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:34.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.294+0000 7f8a95ffb640 1 -- 172.21.15.119:0/1559461359 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a90007c30 con 0x7f8aa00fb450 2024-09-13T21:48:34.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.294+0000 7f8a95ffb640 1 -- 172.21.15.119:0/1559461359 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a9000f040 con 0x7f8aa00fb450 2024-09-13T21:48:34.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.294+0000 7f8aa782a640 1 -- 172.21.15.119:0/1559461359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa0112890 con 0x7f8aa00fb450 2024-09-13T21:48:34.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.294+0000 7f8a95ffb640 1 -- 172.21.15.119:0/1559461359 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a90009550 con 0x7f8aa00fb450 2024-09-13T21:48:34.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.294+0000 7f8aa782a640 1 -- 172.21.15.119:0/1559461359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa0112e00 con 0x7f8aa00fb450 2024-09-13T21:48:34.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.295+0000 7f8aa782a640 1 -- 172.21.15.119:0/1559461359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa00fa8b0 con 0x7f8aa00fb450 2024-09-13T21:48:34.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.295+0000 7f8a95ffb640 1 -- 172.21.15.119:0/1559461359 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8a9000cca0 con 0x7f8aa00fb450 2024-09-13T21:48:34.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.296+0000 7f8a95ffb640 1 --2- 172.21.15.119:0/1559461359 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a8c06e530 0x7f8a8c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:48:34.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.296+0000 7f8a95ffb640 1 -- 172.21.15.119:0/1559461359 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8a9008dde0 con 0x7f8aa00fb450 2024-09-13T21:48:34.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.296+0000 7f8aa4dc5640 1 --2- 172.21.15.119:0/1559461359 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a8c06e530 0x7f8a8c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:48:34.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.296+0000 7f8aa4dc5640 1 --2- 172.21.15.119:0/1559461359 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a8c06e530 0x7f8a8c0709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c007ac0 tx=0x7f8a9c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:48:34.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.300+0000 7f8a95ffb640 1 -- 172.21.15.119:0/1559461359 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8a90056fd0 con 0x7f8aa00fb450 2024-09-13T21:48:34.554 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:48:34.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.552+0000 7f8aa782a640 1 -- 172.21.15.119:0/1559461359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8aa0103e50 con 0x7f8aa00fb450 2024-09-13T21:48:34.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.552+0000 7f8a95ffb640 1 -- 172.21.15.119:0/1559461359 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8a9005a690 con 0x7f8aa00fb450 2024-09-13T21:48:34.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.555+0000 7f8aa782a640 1 -- 172.21.15.119:0/1559461359 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a8c06e530 msgr2=0x7f8a8c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:34.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.555+0000 7f8aa782a640 1 --2- 172.21.15.119:0/1559461359 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a8c06e530 0x7f8a8c0709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c007ac0 tx=0x7f8a9c009da0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.555+0000 7f8aa782a640 1 -- 172.21.15.119:0/1559461359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8aa00fb450 msgr2=0x7f8aa010fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:48:34.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.555+0000 7f8aa782a640 1 --2- 172.21.15.119:0/1559461359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8aa00fb450 0x7f8aa010fe00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000eb70 tx=0x7f8a9000b040 comp rx=0 tx=0).stop 2024-09-13T21:48:34.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.555+0000 7f8aa782a640 1 -- 172.21.15.119:0/1559461359 shutdown_connections 2024-09-13T21:48:34.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.555+0000 7f8aa782a640 1 --2- 172.21.15.119:0/1559461359 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a8c06e530 0x7f8a8c0709e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.555+0000 7f8aa782a640 1 --2- 172.21.15.119:0/1559461359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa00fc720 0x7f8aa0112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.555+0000 7f8aa782a640 1 --2- 172.21.15.119:0/1559461359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8aa00fb450 0x7f8aa010fe00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:48:34.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.555+0000 7f8aa782a640 1 -- 172.21.15.119:0/1559461359 >> 172.21.15.119:0/1559461359 conn(0x7f8aa00f6c10 msgr2=0x7f8aa00f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:48:34.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.555+0000 7f8aa782a640 1 -- 172.21.15.119:0/1559461359 shutdown_connections 2024-09-13T21:48:34.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:48:34.555+0000 7f8aa782a640 1 -- 172.21.15.119:0/1559461359 wait complete. 2024-09-13T21:48:34.880 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:34 smithi119 systemd[1]: Stopping Ceph osd.1 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:48:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:34 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/4281491594' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:34.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:34 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3920366324' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:48:34.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:34 smithi119 ceph-mon[90896]: pgmap v59: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:48:34.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:34 smithi119 ceph-mon[90896]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:34.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:34 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1559461359' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:48:35.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:34 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/4281491594' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:35.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:34 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3920366324' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:48:35.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:34 smithi155 ceph-mon[79928]: pgmap v59: 65 pgs: 65 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T21:48:35.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:34 smithi155 ceph-mon[79928]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:48:35.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:34 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1559461359' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:48:35.380 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:34 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[53646]: 2024-09-13T21:48:34.931+0000 7f564cc66640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:48:35.380 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:34 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[53646]: 2024-09-13T21:48:34.931+0000 7f564cc66640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-13T21:48:35.380 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:34 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[53646]: 2024-09-13T21:48:34.931+0000 7f564cc66640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:48:36.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:35 smithi155 ceph-mon[79928]: osd.1 marked itself down and dead 2024-09-13T21:48:36.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:35 smithi119 ceph-mon[90896]: osd.1 marked itself down and dead 2024-09-13T21:48:36.517 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:36 smithi119 podman[104503]: 2024-09-13 21:48:36.228611133 +0000 UTC m=+1.402981973 container died 654674a31fb7a0e911e8d0987790d019e08193fe03a7fe741d4f2e7a9af92b62 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, RELEASE=quincy-eb16b97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T21:48:36.867 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:36 smithi119 ceph-mon[90896]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:48:36.867 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:36 smithi119 ceph-mon[90896]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T21:48:36.868 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:36 smithi119 ceph-mon[90896]: pgmap v61: 65 pgs: 12 stale+active+clean, 53 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:36.868 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:36 smithi119 podman[104503]: 2024-09-13 21:48:36.590210728 +0000 UTC m=+1.764581558 container cleanup 654674a31fb7a0e911e8d0987790d019e08193fe03a7fe741d4f2e7a9af92b62 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-eb16b97, org.label-schema.schema-version=1.0) 2024-09-13T21:48:36.868 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:36 smithi119 bash[104503]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1 2024-09-13T21:48:37.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:36 smithi155 ceph-mon[79928]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:48:37.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:36 smithi155 ceph-mon[79928]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T21:48:37.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:36 smithi155 ceph-mon[79928]: pgmap v61: 65 pgs: 12 stale+active+clean, 53 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:37.129 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:36 smithi119 podman[104517]: 2024-09-13 21:48:36.866714987 +0000 UTC m=+0.640332691 container remove 654674a31fb7a0e911e8d0987790d019e08193fe03a7fe741d4f2e7a9af92b62 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=quincy-eb16b97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T21:48:37.529 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:37 smithi119 podman[104605]: 2024-09-13 21:48:37.123973747 +0000 UTC m=+0.015882281 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:37.530 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:37 smithi119 podman[104605]: 2024-09-13 21:48:37.259810242 +0000 UTC m=+0.151718765 container create 96671d0501dc2f2274393643a00cd2e87a39d48ed8bbcb47e52341898843426f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-13T21:48:37.530 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:37 smithi119 podman[104605]: 2024-09-13 21:48:37.453861846 +0000 UTC m=+0.345770366 container init 96671d0501dc2f2274393643a00cd2e87a39d48ed8bbcb47e52341898843426f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T21:48:37.530 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:37 smithi119 podman[104605]: 2024-09-13 21:48:37.457232956 +0000 UTC m=+0.349141477 container start 96671d0501dc2f2274393643a00cd2e87a39d48ed8bbcb47e52341898843426f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-ecab7be) 2024-09-13T21:48:37.530 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:37 smithi119 podman[104605]: 2024-09-13 21:48:37.528752951 +0000 UTC m=+0.420661473 container attach 96671d0501dc2f2274393643a00cd2e87a39d48ed8bbcb47e52341898843426f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:48:37.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:37 smithi119 ceph-mon[90896]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T21:48:37.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:37.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:37.880 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:37 smithi119 podman[104605]: 2024-09-13 21:48:37.645553302 +0000 UTC m=+0.537461838 container died 96671d0501dc2f2274393643a00cd2e87a39d48ed8bbcb47e52341898843426f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:48:38.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:37 smithi155 ceph-mon[79928]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T21:48:38.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:38.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:38.630 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:38 smithi119 podman[104628]: 2024-09-13 21:48:38.215898795 +0000 UTC m=+0.564127803 container remove 96671d0501dc2f2274393643a00cd2e87a39d48ed8bbcb47e52341898843426f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T21:48:38.630 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:38 smithi119 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-13T21:48:38.630 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:38 smithi119 systemd[1]: Stopped Ceph osd.1 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:48:38.630 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:38 smithi119 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 4.826s CPU time. 2024-09-13T21:48:38.631 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:38 smithi119 systemd[1]: Starting Ceph osd.1 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:48:38.899 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:38 smithi119 ceph-mon[90896]: pgmap v63: 65 pgs: 15 active+undersized, 3 stale+active+clean, 14 active+undersized+degraded, 33 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 44/318 objects degraded (13.836%) 2024-09-13T21:48:38.899 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:38 smithi119 podman[104728]: 2024-09-13 21:48:38.548946226 +0000 UTC m=+0.015590141 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:38.899 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:38 smithi119 podman[104728]: 2024-09-13 21:48:38.675777156 +0000 UTC m=+0.142421062 container create 9a2fd35a8e41a691d0dc2322032cb39b8f76813c12e30da3eb10360fb5892e96 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-13T21:48:38.899 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:38 smithi119 podman[104728]: 2024-09-13 21:48:38.894967276 +0000 UTC m=+0.361611184 container init 9a2fd35a8e41a691d0dc2322032cb39b8f76813c12e30da3eb10360fb5892e96 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T21:48:38.899 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:38 smithi119 podman[104728]: 2024-09-13 21:48:38.898387141 +0000 UTC m=+0.365031061 container start 9a2fd35a8e41a691d0dc2322032cb39b8f76813c12e30da3eb10360fb5892e96 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-13T21:48:39.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:38 smithi155 ceph-mon[79928]: pgmap v63: 65 pgs: 15 active+undersized, 3 stale+active+clean, 14 active+undersized+degraded, 33 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 44/318 objects degraded (13.836%) 2024-09-13T21:48:39.380 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:38 smithi119 podman[104728]: 2024-09-13 21:48:38.994958419 +0000 UTC m=+0.461602331 container attach 9a2fd35a8e41a691d0dc2322032cb39b8f76813c12e30da3eb10360fb5892e96 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-13T21:48:39.380 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:39 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate[104742]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:39.380 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:39 smithi119 bash[104728]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:39.380 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:39 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate[104742]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:39.380 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:39 smithi119 bash[104728]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:48:40.051 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:39 smithi119 ceph-mon[90896]: Health check failed: Degraded data redundancy: 44/318 objects degraded (13.836%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:40.051 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:39 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate[104742]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T21:48:40.052 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:39 smithi119 bash[104728]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T21:48:40.052 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:39 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate[104742]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T21:48:40.052 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:39 smithi119 bash[104728]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T21:48:40.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:39 smithi155 ceph-mon[79928]: Health check failed: Degraded data redundancy: 44/318 objects degraded (13.836%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:40.366 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate[104742]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T21:48:40.366 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 bash[104728]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T21:48:40.366 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate[104742]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T21:48:40.367 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 bash[104728]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T21:48:40.367 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate[104742]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T21:48:40.367 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 bash[104728]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T21:48:40.367 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate[104742]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T21:48:40.367 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 bash[104728]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T21:48:40.367 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate[104742]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T21:48:40.367 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 bash[104728]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T21:48:40.367 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 podman[104728]: 2024-09-13 21:48:40.080055965 +0000 UTC m=+1.546699881 container died 9a2fd35a8e41a691d0dc2322032cb39b8f76813c12e30da3eb10360fb5892e96 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T21:48:40.989 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:40 smithi119 ceph-mon[90896]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:40.989 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 podman[104875]: 2024-09-13 21:48:40.782072501 +0000 UTC m=+0.695375875 container remove 9a2fd35a8e41a691d0dc2322032cb39b8f76813c12e30da3eb10360fb5892e96 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-13T21:48:41.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:40 smithi155 ceph-mon[79928]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:41.278 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 podman[104933]: 2024-09-13 21:48:40.890835358 +0000 UTC m=+0.016282377 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:48:41.278 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:40 smithi119 podman[104933]: 2024-09-13 21:48:40.991198687 +0000 UTC m=+0.116645693 container create 8f69bf25cd20fe1d37dd684e4c46d022f094cecd9e085c7ac3c783dc555fad2a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T21:48:41.278 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:41 smithi119 podman[104933]: 2024-09-13 21:48:41.185521587 +0000 UTC m=+0.310968592 container init 8f69bf25cd20fe1d37dd684e4c46d022f094cecd9e085c7ac3c783dc555fad2a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T21:48:41.278 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:41 smithi119 podman[104933]: 2024-09-13 21:48:41.188870446 +0000 UTC m=+0.314321451 container start 8f69bf25cd20fe1d37dd684e4c46d022f094cecd9e085c7ac3c783dc555fad2a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T21:48:41.278 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:41 smithi119 ceph-osd[104952]: -- 172.21.15.119:0/34896061 <== mon.0 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563dad9321e0 con 0x563dad91a000 2024-09-13T21:48:41.279 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:41 smithi119 bash[104933]: 8f69bf25cd20fe1d37dd684e4c46d022f094cecd9e085c7ac3c783dc555fad2a 2024-09-13T21:48:41.629 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:41 smithi119 systemd[1]: Started Ceph osd.1 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:48:42.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:42 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:42.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:42 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:42.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:42 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:42.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:42 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:42 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:42 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:43.130 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:42 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[104948]: 2024-09-13T21:48:42.818+0000 7f532afcd640 -1 Falling back to public interface 2024-09-13T21:48:43.546 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:43 smithi119 ceph-mon[90896]: pgmap v65: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:43.750 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:43 smithi155 ceph-mon[79928]: pgmap v65: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:45 smithi119 ceph-mon[90896]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:45.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:45 smithi155 ceph-mon[79928]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:46 smithi119 ceph-mon[90896]: Health check update: Degraded data redundancy: 50/318 objects degraded (15.723%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:46 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:46 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:46.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:46 smithi155 ceph-mon[79928]: Health check update: Degraded data redundancy: 50/318 objects degraded (15.723%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:46.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:46 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:46.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:46 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:47.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:47 smithi119 ceph-mon[90896]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:47.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:47 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:47.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:47 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:47.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:47 smithi155 ceph-mon[79928]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:47.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:47 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:47.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:47 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:49.152 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:48 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[104948]: 2024-09-13T21:48:48.885+0000 7f532afcd640 -1 osd.1 52 log_to_monitors true 2024-09-13T21:48:49.498 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:49 smithi119 ceph-mon[90896]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:49.498 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:49 smithi119 ceph-mon[90896]: from='osd.1 [v2:172.21.15.119:6810/270594277,v1:172.21.15.119:6811/270594277]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T21:48:49.499 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 21:48:49 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[104948]: 2024-09-13T21:48:49.366+0000 7f5322d67640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:48:49.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:49 smithi155 ceph-mon[79928]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:49.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:49 smithi155 ceph-mon[79928]: from='osd.1 [v2:172.21.15.119:6810/270594277,v1:172.21.15.119:6811/270594277]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T21:48:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='osd.1 [v2:172.21.15.119:6810/270594277,v1:172.21.15.119:6811/270594277]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T21:48:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T21:48:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='osd.1 [v2:172.21.15.119:6810/270594277,v1:172.21.15.119:6811/270594277]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:48:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:48:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:50.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:50.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:50.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:48:50.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='osd.1 [v2:172.21.15.119:6810/270594277,v1:172.21.15.119:6811/270594277]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T21:48:50.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T21:48:50.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='osd.1 [v2:172.21.15.119:6810/270594277,v1:172.21.15.119:6811/270594277]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:48:50.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:50.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:50.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:48:50.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:48:50.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:50.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:48:50.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:50.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:50.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:48:50.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:48:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:51 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:48:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:51 smithi119 ceph-mon[90896]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T21:48:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:51 smithi119 ceph-mon[90896]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:51 smithi119 ceph-mon[90896]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:48:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:51 smithi119 ceph-mon[90896]: osd.1 [v2:172.21.15.119:6810/270594277,v1:172.21.15.119:6811/270594277] boot 2024-09-13T21:48:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:51 smithi119 ceph-mon[90896]: osdmap e56: 6 total, 6 up, 6 in 2024-09-13T21:48:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:51 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:48:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:51 smithi119 ceph-mon[90896]: osdmap e57: 6 total, 6 up, 6 in 2024-09-13T21:48:51.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:51 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:48:51.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:51 smithi155 ceph-mon[79928]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T21:48:51.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:51 smithi155 ceph-mon[79928]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:51.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:51 smithi155 ceph-mon[79928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:48:51.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:51 smithi155 ceph-mon[79928]: osd.1 [v2:172.21.15.119:6810/270594277,v1:172.21.15.119:6811/270594277] boot 2024-09-13T21:48:51.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:51 smithi155 ceph-mon[79928]: osdmap e56: 6 total, 6 up, 6 in 2024-09-13T21:48:51.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:51 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T21:48:51.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:51 smithi155 ceph-mon[79928]: osdmap e57: 6 total, 6 up, 6 in 2024-09-13T21:48:53.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:53 smithi119 ceph-mon[90896]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:53.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:53.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:53 smithi155 ceph-mon[79928]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:48:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:48:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:48:54.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:54 smithi155 ceph-mon[79928]: Health check update: Degraded data redundancy: 21/318 objects degraded (6.604%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:54.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:54 smithi119 ceph-mon[90896]: Health check update: Degraded data redundancy: 21/318 objects degraded (6.604%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T21:48:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:55 smithi155 ceph-mon[79928]: pgmap v74: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 21/318 objects degraded (6.604%) 2024-09-13T21:48:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:55 smithi119 ceph-mon[90896]: pgmap v74: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 21/318 objects degraded (6.604%) 2024-09-13T21:48:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:56 smithi155 ceph-mon[79928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/318 objects degraded (6.604%), 7 pgs degraded) 2024-09-13T21:48:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:56 smithi155 ceph-mon[79928]: Cluster is now healthy 2024-09-13T21:48:56.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:56 smithi119 ceph-mon[90896]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/318 objects degraded (6.604%), 7 pgs degraded) 2024-09-13T21:48:56.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:56 smithi119 ceph-mon[90896]: Cluster is now healthy 2024-09-13T21:48:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:57 smithi155 ceph-mon[79928]: pgmap v75: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:57 smithi119 ceph-mon[90896]: pgmap v75: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:59.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:48:59 smithi155 ceph-mon[79928]: pgmap v76: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:48:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:48:59 smithi119 ceph-mon[90896]: pgmap v76: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:01 smithi155 ceph-mon[79928]: pgmap v77: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:01.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:01 smithi119 ceph-mon[90896]: pgmap v77: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:03.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:03 smithi119 ceph-mon[90896]: pgmap v78: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:03.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:03 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:03 smithi155 ceph-mon[79928]: pgmap v78: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:03 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:04.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.647+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3213214347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2440fdba0 msgr2=0x7fe2440fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.647+0000 7fe24a5ba640 1 --2- 172.21.15.119:0/3213214347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2440fdba0 0x7fe2440fdfb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe2340048d0 tx=0x7fe234009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.647+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3213214347 shutdown_connections 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.647+0000 7fe24a5ba640 1 --2- 172.21.15.119:0/3213214347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2440fe4f0 0x7fe2440fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.647+0000 7fe24a5ba640 1 --2- 172.21.15.119:0/3213214347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2440fdba0 0x7fe2440fdfb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.647+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3213214347 >> 172.21.15.119:0/3213214347 conn(0x7fe2440f63a0 msgr2=0x7fe2440f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.647+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3213214347 shutdown_connections 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.647+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3213214347 wait complete. 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.648+0000 7fe24a5ba640 1 Processor -- start 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.648+0000 7fe24a5ba640 1 -- start start 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.648+0000 7fe24a5ba640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2440fdba0 0x7fe24410d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.648+0000 7fe24a5ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2440fe4f0 0x7fe24410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.648+0000 7fe24a5ba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24410dc00 con 0x7fe2440fe4f0 2024-09-13T21:49:04.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.648+0000 7fe24a5ba640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24410e420 con 0x7fe2440fdba0 2024-09-13T21:49:04.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe2437fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2440fe4f0 0x7fe24410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:04.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe2437fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2440fe4f0 0x7fe24410d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45464/0 (socket says 172.21.15.119:45464) 2024-09-13T21:49:04.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe2437fe640 1 -- 172.21.15.119:0/3607390998 learned_addr learned my addr 172.21.15.119:0/3607390998 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:04.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe243fff640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2440fdba0 0x7fe24410d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:04.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe2437fe640 1 -- 172.21.15.119:0/3607390998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2440fdba0 msgr2=0x7fe24410d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:04.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe2437fe640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2440fdba0 0x7fe24410d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe2437fe640 1 -- 172.21.15.119:0/3607390998 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe234005040 con 0x7fe2440fe4f0 2024-09-13T21:49:04.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe243fff640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2440fdba0 0x7fe24410d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:49:04.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe2437fe640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2440fe4f0 0x7fe24410d5b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe23800c7e0 tx=0x7fe2380043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:04.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe240ff9640 1 -- 172.21.15.119:0/3607390998 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe23800a820 con 0x7fe2440fe4f0 2024-09-13T21:49:04.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe240ff9640 1 -- 172.21.15.119:0/3607390998 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe23800ae20 con 0x7fe2440fe4f0 2024-09-13T21:49:04.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe240ff9640 1 -- 172.21.15.119:0/3607390998 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2380113a0 con 0x7fe2440fe4f0 2024-09-13T21:49:04.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3607390998 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24410e6b0 con 0x7fe2440fe4f0 2024-09-13T21:49:04.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.649+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3607390998 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24410ec50 con 0x7fe2440fe4f0 2024-09-13T21:49:04.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.651+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3607390998 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2440fa040 con 0x7fe2440fe4f0 2024-09-13T21:49:04.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.651+0000 7fe240ff9640 1 -- 172.21.15.119:0/3607390998 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe23800a980 con 0x7fe2440fe4f0 2024-09-13T21:49:04.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.651+0000 7fe240ff9640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe22c06e530 0x7fe22c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:04.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.652+0000 7fe240ff9640 1 -- 172.21.15.119:0/3607390998 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe23808e2c0 con 0x7fe2440fe4f0 2024-09-13T21:49:04.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.652+0000 7fe243fff640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe22c06e530 0x7fe22c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:04.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.652+0000 7fe243fff640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe22c06e530 0x7fe22c0709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe234004540 tx=0x7fe234035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:04.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.656+0000 7fe240ff9640 1 -- 172.21.15.119:0/3607390998 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe238057480 con 0x7fe2440fe4f0 2024-09-13T21:49:04.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.841+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3607390998 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe24410efe0 con 0x7fe22c06e530 2024-09-13T21:49:04.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.842+0000 7fe240ff9640 1 -- 172.21.15.119:0/3607390998 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe24410efe0 con 0x7fe22c06e530 2024-09-13T21:49:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.844+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3607390998 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe22c06e530 msgr2=0x7fe22c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.844+0000 7fe24a5ba640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe22c06e530 0x7fe22c0709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe234004540 tx=0x7fe234035040 comp rx=0 tx=0).stop 2024-09-13T21:49:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.844+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3607390998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2440fe4f0 msgr2=0x7fe24410d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.844+0000 7fe24a5ba640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2440fe4f0 0x7fe24410d5b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe23800c7e0 tx=0x7fe2380043c0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.844+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3607390998 shutdown_connections 2024-09-13T21:49:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.844+0000 7fe24a5ba640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe22c06e530 0x7fe22c0709e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.844+0000 7fe24a5ba640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2440fe4f0 0x7fe24410d5b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.844+0000 7fe24a5ba640 1 --2- 172.21.15.119:0/3607390998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2440fdba0 0x7fe24410d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.844+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3607390998 >> 172.21.15.119:0/3607390998 conn(0x7fe2440f63a0 msgr2=0x7fe2440f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.844+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3607390998 shutdown_connections 2024-09-13T21:49:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.844+0000 7fe24a5ba640 1 -- 172.21.15.119:0/3607390998 wait complete. 2024-09-13T21:49:04.855 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:49:04.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.923+0000 7f8a6d46d640 1 -- 172.21.15.119:0/354331823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a680fd7f0 msgr2=0x7f8a680fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:04.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.923+0000 7f8a6d46d640 1 --2- 172.21.15.119:0/354331823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a680fd7f0 0x7f8a680fdc60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0048d0 tx=0x7f8a5c009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.923+0000 7f8a6d46d640 1 -- 172.21.15.119:0/354331823 shutdown_connections 2024-09-13T21:49:04.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.923+0000 7f8a6d46d640 1 --2- 172.21.15.119:0/354331823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a680fd7f0 0x7f8a680fdc60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.923+0000 7f8a6d46d640 1 --2- 172.21.15.119:0/354331823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a680fc520 0x7f8a680fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.923+0000 7f8a6d46d640 1 -- 172.21.15.119:0/354331823 >> 172.21.15.119:0/354331823 conn(0x7f8a680f7ce0 msgr2=0x7f8a680fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:04.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.923+0000 7f8a6d46d640 1 -- 172.21.15.119:0/354331823 shutdown_connections 2024-09-13T21:49:04.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.923+0000 7f8a6d46d640 1 -- 172.21.15.119:0/354331823 wait complete. 2024-09-13T21:49:04.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.924+0000 7f8a6d46d640 1 Processor -- start 2024-09-13T21:49:04.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.924+0000 7f8a6d46d640 1 -- start start 2024-09-13T21:49:04.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.924+0000 7f8a6d46d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a680fc520 0x7f8a6810f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.924+0000 7f8a6d46d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a680fd7f0 0x7f8a6810f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.924+0000 7f8a6d46d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6810fe10 con 0x7f8a680fd7f0 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.924+0000 7f8a6d46d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68110630 con 0x7f8a680fc520 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.924+0000 7f8a667fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a680fd7f0 0x7f8a6810f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.924+0000 7f8a667fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a680fd7f0 0x7f8a6810f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45482/0 (socket says 172.21.15.119:45482) 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.924+0000 7f8a667fc640 1 -- 172.21.15.119:0/4182844282 learned_addr learned my addr 172.21.15.119:0/4182844282 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.924+0000 7f8a66ffd640 1 --2- 172.21.15.119:0/4182844282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a680fc520 0x7f8a6810f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.925+0000 7f8a667fc640 1 -- 172.21.15.119:0/4182844282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a680fc520 msgr2=0x7f8a6810f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.925+0000 7f8a667fc640 1 --2- 172.21.15.119:0/4182844282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a680fc520 0x7f8a6810f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.925+0000 7f8a667fc640 1 -- 172.21.15.119:0/4182844282 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c005040 con 0x7f8a680fd7f0 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.925+0000 7f8a667fc640 1 --2- 172.21.15.119:0/4182844282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a680fd7f0 0x7f8a6810f7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0043d0 tx=0x7f8a5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.925+0000 7f8a4f7fe640 1 -- 172.21.15.119:0/4182844282 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a5c038070 con 0x7f8a680fd7f0 2024-09-13T21:49:04.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.925+0000 7f8a4f7fe640 1 -- 172.21.15.119:0/4182844282 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a5c02ae90 con 0x7f8a680fd7f0 2024-09-13T21:49:04.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.925+0000 7f8a6d46d640 1 -- 172.21.15.119:0/4182844282 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a68110860 con 0x7f8a680fd7f0 2024-09-13T21:49:04.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.925+0000 7f8a4f7fe640 1 -- 172.21.15.119:0/4182844282 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a5c03e670 con 0x7f8a680fd7f0 2024-09-13T21:49:04.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.925+0000 7f8a6d46d640 1 -- 172.21.15.119:0/4182844282 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a68110e00 con 0x7f8a680fd7f0 2024-09-13T21:49:04.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.926+0000 7f8a6d46d640 1 -- 172.21.15.119:0/4182844282 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a680fb980 con 0x7f8a680fd7f0 2024-09-13T21:49:04.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.927+0000 7f8a4f7fe640 1 -- 172.21.15.119:0/4182844282 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8a5c030020 con 0x7f8a680fd7f0 2024-09-13T21:49:04.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.927+0000 7f8a4f7fe640 1 --2- 172.21.15.119:0/4182844282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a5006e530 0x7f8a500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:04.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.927+0000 7f8a66ffd640 1 --2- 172.21.15.119:0/4182844282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a5006e530 0x7f8a500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:04.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.927+0000 7f8a4f7fe640 1 -- 172.21.15.119:0/4182844282 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8a5c0ae320 con 0x7f8a680fd7f0 2024-09-13T21:49:04.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.928+0000 7f8a66ffd640 1 --2- 172.21.15.119:0/4182844282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a5006e530 0x7f8a500709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a58004ed0 tx=0x7f8a5800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:04.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:04.932+0000 7f8a4f7fe640 1 -- 172.21.15.119:0/4182844282 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8a5c077510 con 0x7f8a680fd7f0 2024-09-13T21:49:05.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.122+0000 7f8a6d46d640 1 -- 172.21.15.119:0/4182844282 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a68105090 con 0x7f8a5006e530 2024-09-13T21:49:05.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.123+0000 7f8a4f7fe640 1 -- 172.21.15.119:0/4182844282 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8a68105090 con 0x7f8a5006e530 2024-09-13T21:49:05.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.125+0000 7f8a6d46d640 1 -- 172.21.15.119:0/4182844282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a5006e530 msgr2=0x7f8a500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.125+0000 7f8a6d46d640 1 --2- 172.21.15.119:0/4182844282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a5006e530 0x7f8a500709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a58004ed0 tx=0x7f8a5800b040 comp rx=0 tx=0).stop 2024-09-13T21:49:05.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.125+0000 7f8a6d46d640 1 -- 172.21.15.119:0/4182844282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a680fd7f0 msgr2=0x7f8a6810f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.125+0000 7f8a6d46d640 1 --2- 172.21.15.119:0/4182844282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a680fd7f0 0x7f8a6810f7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0043d0 tx=0x7f8a5c009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.125+0000 7f8a6d46d640 1 -- 172.21.15.119:0/4182844282 shutdown_connections 2024-09-13T21:49:05.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.125+0000 7f8a6d46d640 1 --2- 172.21.15.119:0/4182844282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8a5006e530 0x7f8a500709e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.125+0000 7f8a6d46d640 1 --2- 172.21.15.119:0/4182844282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a680fd7f0 0x7f8a6810f7c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.125+0000 7f8a6d46d640 1 --2- 172.21.15.119:0/4182844282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a680fc520 0x7f8a6810f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.126+0000 7f8a6d46d640 1 -- 172.21.15.119:0/4182844282 >> 172.21.15.119:0/4182844282 conn(0x7f8a680f7ce0 msgr2=0x7f8a680f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:05.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.126+0000 7f8a6d46d640 1 -- 172.21.15.119:0/4182844282 shutdown_connections 2024-09-13T21:49:05.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.126+0000 7f8a6d46d640 1 -- 172.21.15.119:0/4182844282 wait complete. 2024-09-13T21:49:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.206+0000 7f540256c640 1 -- 172.21.15.119:0/3411728648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53fc065b80 msgr2=0x7f53fc0ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.206+0000 7f540256c640 1 --2- 172.21.15.119:0/3411728648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53fc065b80 0x7f53fc0ff200 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0048d0 tx=0x7f53ec009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.206+0000 7f540256c640 1 -- 172.21.15.119:0/3411728648 shutdown_connections 2024-09-13T21:49:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.206+0000 7f540256c640 1 --2- 172.21.15.119:0/3411728648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc0ff740 0x7f53fc101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.206+0000 7f540256c640 1 --2- 172.21.15.119:0/3411728648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53fc065b80 0x7f53fc0ff200 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.206+0000 7f540256c640 1 -- 172.21.15.119:0/3411728648 >> 172.21.15.119:0/3411728648 conn(0x7f53fc0f6c10 msgr2=0x7f53fc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.206+0000 7f540256c640 1 -- 172.21.15.119:0/3411728648 shutdown_connections 2024-09-13T21:49:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.206+0000 7f540256c640 1 -- 172.21.15.119:0/3411728648 wait complete. 2024-09-13T21:49:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.207+0000 7f540256c640 1 Processor -- start 2024-09-13T21:49:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.207+0000 7f540256c640 1 -- start start 2024-09-13T21:49:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.207+0000 7f540256c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc065b80 0x7f53fc10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:05.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.207+0000 7f540256c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53fc0ff740 0x7f53fc10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:05.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.207+0000 7f540256c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc10dc40 con 0x7f53fc0ff740 2024-09-13T21:49:05.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.207+0000 7f540256c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc10e410 con 0x7f53fc065b80 2024-09-13T21:49:05.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.207+0000 7f53fb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53fc0ff740 0x7f53fc10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:05.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.207+0000 7f53fb7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53fc0ff740 0x7f53fc10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45492/0 (socket says 172.21.15.119:45492) 2024-09-13T21:49:05.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.207+0000 7f53fb7fe640 1 -- 172.21.15.119:0/2725634635 learned_addr learned my addr 172.21.15.119:0/2725634635 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:05.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.208+0000 7f53fbfff640 1 --2- 172.21.15.119:0/2725634635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc065b80 0x7f53fc10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:05.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.208+0000 7f53fb7fe640 1 -- 172.21.15.119:0/2725634635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc065b80 msgr2=0x7f53fc10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.208+0000 7f53fb7fe640 1 --2- 172.21.15.119:0/2725634635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc065b80 0x7f53fc10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.208+0000 7f53fb7fe640 1 -- 172.21.15.119:0/2725634635 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec005040 con 0x7f53fc0ff740 2024-09-13T21:49:05.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.208+0000 7f53fb7fe640 1 --2- 172.21.15.119:0/2725634635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53fc0ff740 0x7f53fc10d5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f53e4002a50 tx=0x7f53e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.208+0000 7f53f8ff9640 1 -- 172.21.15.119:0/2725634635 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53e4007c30 con 0x7f53fc0ff740 2024-09-13T21:49:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.208+0000 7f540256c640 1 -- 172.21.15.119:0/2725634635 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc10e6a0 con 0x7f53fc0ff740 2024-09-13T21:49:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.208+0000 7f53f8ff9640 1 -- 172.21.15.119:0/2725634635 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f53e400f040 con 0x7f53fc0ff740 2024-09-13T21:49:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.208+0000 7f53f8ff9640 1 -- 172.21.15.119:0/2725634635 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53e400da10 con 0x7f53fc0ff740 2024-09-13T21:49:05.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.208+0000 7f540256c640 1 -- 172.21.15.119:0/2725634635 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc10ec40 con 0x7f53fc0ff740 2024-09-13T21:49:05.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.210+0000 7f540256c640 1 -- 172.21.15.119:0/2725634635 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc0fa890 con 0x7f53fc0ff740 2024-09-13T21:49:05.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.210+0000 7f53f8ff9640 1 -- 172.21.15.119:0/2725634635 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f53e400dca0 con 0x7f53fc0ff740 2024-09-13T21:49:05.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.210+0000 7f53f8ff9640 1 --2- 172.21.15.119:0/2725634635 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53e806e530 0x7f53e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:05.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.211+0000 7f53f8ff9640 1 -- 172.21.15.119:0/2725634635 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f53e408d950 con 0x7f53fc0ff740 2024-09-13T21:49:05.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.211+0000 7f53fbfff640 1 --2- 172.21.15.119:0/2725634635 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53e806e530 0x7f53e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:05.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.211+0000 7f53fbfff640 1 --2- 172.21.15.119:0/2725634635 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53e806e530 0x7f53e80709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f53ec000c00 tx=0x7f53ec035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:05.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.215+0000 7f53f8ff9640 1 -- 172.21.15.119:0/2725634635 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f53e4056b40 con 0x7f53fc0ff740 2024-09-13T21:49:05.378 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:05 smithi119 ceph-mon[90896]: pgmap v79: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:05.378 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:05 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:49:05.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.399+0000 7f540256c640 1 -- 172.21.15.119:0/2725634635 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f53fc10efc0 con 0x7f53e806e530 2024-09-13T21:49:05.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.409+0000 7f53f8ff9640 1 -- 172.21.15.119:0/2725634635 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f53fc10efc0 con 0x7f53e806e530 2024-09-13T21:49:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:49:05.410 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (3m) 19s ago 12m 23.8M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (84s) 19s ago 12m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (79s) 76s ago 11m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (3m) 19s ago 11m 80.2M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (6m) 19s ago 6m 13.7M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (6m) 19s ago 6m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (6m) 76s ago 6m 16.3M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (6m) 76s ago 6m 110M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (3m) 19s ago 13m 497M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (2m) 76s ago 11m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (2m) 19s ago 13m 46.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (2m) 76s ago 11m 34.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:49:05.411 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (3m) 19s ago 12m 16.7M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:49:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (3m) 76s ago 11m 15.4M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:49:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (59s) 19s ago 10m 92.1M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:49:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (24s) 19s ago 10m 12.1M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 8f69bf25cd20 2024-09-13T21:49:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (9m) 19s ago 9m 191M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 2be2fb8dc5b6 2024-09-13T21:49:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (9m) 76s ago 9m 266M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:49:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (8m) 76s ago 8m 228M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:49:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (8m) 76s ago 8m 227M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:49:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (2m) 19s ago 11m 51.7M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:49:05.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.411+0000 7f540256c640 1 -- 172.21.15.119:0/2725634635 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53e806e530 msgr2=0x7f53e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.411+0000 7f540256c640 1 --2- 172.21.15.119:0/2725634635 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53e806e530 0x7f53e80709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f53ec000c00 tx=0x7f53ec035040 comp rx=0 tx=0).stop 2024-09-13T21:49:05.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.411+0000 7f540256c640 1 -- 172.21.15.119:0/2725634635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53fc0ff740 msgr2=0x7f53fc10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.411+0000 7f540256c640 1 --2- 172.21.15.119:0/2725634635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53fc0ff740 0x7f53fc10d5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f53e4002a50 tx=0x7f53e4004600 comp rx=0 tx=0).stop 2024-09-13T21:49:05.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.411+0000 7f540256c640 1 -- 172.21.15.119:0/2725634635 shutdown_connections 2024-09-13T21:49:05.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.411+0000 7f540256c640 1 --2- 172.21.15.119:0/2725634635 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53e806e530 0x7f53e80709e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.411+0000 7f540256c640 1 --2- 172.21.15.119:0/2725634635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53fc0ff740 0x7f53fc10d5f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.411+0000 7f540256c640 1 --2- 172.21.15.119:0/2725634635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53fc065b80 0x7f53fc10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.411+0000 7f540256c640 1 -- 172.21.15.119:0/2725634635 >> 172.21.15.119:0/2725634635 conn(0x7f53fc0f6c10 msgr2=0x7f53fc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:05.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.411+0000 7f540256c640 1 -- 172.21.15.119:0/2725634635 shutdown_connections 2024-09-13T21:49:05.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.411+0000 7f540256c640 1 -- 172.21.15.119:0/2725634635 wait complete. 2024-09-13T21:49:05.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.490+0000 7f3ad342e640 1 -- 172.21.15.119:0/253387199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3acc0fc720 msgr2=0x7f3acc0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.490+0000 7f3ad342e640 1 --2- 172.21.15.119:0/253387199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3acc0fc720 0x7f3acc0fcb90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0048d0 tx=0x7f3abc009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.490+0000 7f3ad342e640 1 -- 172.21.15.119:0/253387199 shutdown_connections 2024-09-13T21:49:05.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.490+0000 7f3ad342e640 1 --2- 172.21.15.119:0/253387199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3acc0fc720 0x7f3acc0fcb90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.490+0000 7f3ad342e640 1 --2- 172.21.15.119:0/253387199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc0fb450 0x7f3acc0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.490+0000 7f3ad342e640 1 -- 172.21.15.119:0/253387199 >> 172.21.15.119:0/253387199 conn(0x7f3acc0f6c10 msgr2=0x7f3acc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:05.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.490+0000 7f3ad342e640 1 -- 172.21.15.119:0/253387199 shutdown_connections 2024-09-13T21:49:05.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.490+0000 7f3ad342e640 1 -- 172.21.15.119:0/253387199 wait complete. 2024-09-13T21:49:05.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.490+0000 7f3ad342e640 1 Processor -- start 2024-09-13T21:49:05.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad342e640 1 -- start start 2024-09-13T21:49:05.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad342e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3acc0fb450 0x7f3acc10d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:05.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad342e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc0fc720 0x7f3acc10d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:05.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad342e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc10dc60 con 0x7f3acc0fb450 2024-09-13T21:49:05.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad342e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc10e430 con 0x7f3acc0fc720 2024-09-13T21:49:05.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad11ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3acc0fb450 0x7f3acc10d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:05.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad11ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3acc0fb450 0x7f3acc10d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45502/0 (socket says 172.21.15.119:45502) 2024-09-13T21:49:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad11ca640 1 -- 172.21.15.119:0/2829573458 learned_addr learned my addr 172.21.15.119:0/2829573458 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad09c9640 1 --2- 172.21.15.119:0/2829573458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc0fc720 0x7f3acc10d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad11ca640 1 -- 172.21.15.119:0/2829573458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc0fc720 msgr2=0x7f3acc10d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad11ca640 1 --2- 172.21.15.119:0/2829573458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc0fc720 0x7f3acc10d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.491+0000 7f3ad11ca640 1 -- 172.21.15.119:0/2829573458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc005040 con 0x7f3acc0fb450 2024-09-13T21:49:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.492+0000 7f3ad11ca640 1 --2- 172.21.15.119:0/2829573458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3acc0fb450 0x7f3acc10d0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800c790 tx=0x7f3ac80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.492+0000 7f3ac1ffb640 1 -- 172.21.15.119:0/2829573458 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ac800a820 con 0x7f3acc0fb450 2024-09-13T21:49:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.492+0000 7f3ad342e640 1 -- 172.21.15.119:0/2829573458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc10e6c0 con 0x7f3acc0fb450 2024-09-13T21:49:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.492+0000 7f3ac1ffb640 1 -- 172.21.15.119:0/2829573458 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ac800ae20 con 0x7f3acc0fb450 2024-09-13T21:49:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.492+0000 7f3ac1ffb640 1 -- 172.21.15.119:0/2829573458 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ac80113a0 con 0x7f3acc0fb450 2024-09-13T21:49:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.492+0000 7f3ad342e640 1 -- 172.21.15.119:0/2829573458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc10ec60 con 0x7f3acc0fb450 2024-09-13T21:49:05.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.493+0000 7f3ad342e640 1 -- 172.21.15.119:0/2829573458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3acc0fa8b0 con 0x7f3acc0fb450 2024-09-13T21:49:05.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.493+0000 7f3ac1ffb640 1 -- 172.21.15.119:0/2829573458 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3ac8012400 con 0x7f3acc0fb450 2024-09-13T21:49:05.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.494+0000 7f3ac1ffb640 1 --2- 172.21.15.119:0/2829573458 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3ab806e530 0x7f3ab80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:05.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.494+0000 7f3ac1ffb640 1 -- 172.21.15.119:0/2829573458 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3ac808e2d0 con 0x7f3acc0fb450 2024-09-13T21:49:05.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.494+0000 7f3ad09c9640 1 --2- 172.21.15.119:0/2829573458 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3ab806e530 0x7f3ab80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:05.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.494+0000 7f3ad09c9640 1 --2- 172.21.15.119:0/2829573458 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3ab806e530 0x7f3ab80709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3abc000c00 tx=0x7f3abc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:05.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.498+0000 7f3ac1ffb640 1 -- 172.21.15.119:0/2829573458 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3ac8057490 con 0x7f3acc0fb450 2024-09-13T21:49:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:05 smithi155 ceph-mon[79928]: pgmap v79: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:05 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:49:05.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.744+0000 7f3ad342e640 1 -- 172.21.15.119:0/2829573458 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3acc103fb0 con 0x7f3acc0fb450 2024-09-13T21:49:05.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.744+0000 7f3ac1ffb640 1 -- 172.21.15.119:0/2829573458 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f3ac800a980 con 0x7f3acc0fb450 2024-09-13T21:49:05.746 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:49:05.746 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:49:05.746 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:49:05.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:49:05.746 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:49:05.746 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4, 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 8, 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:49:05.747 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:49:05.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.747+0000 7f3ad342e640 1 -- 172.21.15.119:0/2829573458 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3ab806e530 msgr2=0x7f3ab80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.747+0000 7f3ad342e640 1 --2- 172.21.15.119:0/2829573458 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3ab806e530 0x7f3ab80709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3abc000c00 tx=0x7f3abc009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.747+0000 7f3ad342e640 1 -- 172.21.15.119:0/2829573458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3acc0fb450 msgr2=0x7f3acc10d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.747+0000 7f3ad342e640 1 --2- 172.21.15.119:0/2829573458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3acc0fb450 0x7f3acc10d0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800c790 tx=0x7f3ac80043c0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.747+0000 7f3ad342e640 1 -- 172.21.15.119:0/2829573458 shutdown_connections 2024-09-13T21:49:05.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.747+0000 7f3ad342e640 1 --2- 172.21.15.119:0/2829573458 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3ab806e530 0x7f3ab80709e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.747+0000 7f3ad342e640 1 --2- 172.21.15.119:0/2829573458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3acc0fc720 0x7f3acc10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.747+0000 7f3ad342e640 1 --2- 172.21.15.119:0/2829573458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3acc0fb450 0x7f3acc10d0d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.747+0000 7f3ad342e640 1 -- 172.21.15.119:0/2829573458 >> 172.21.15.119:0/2829573458 conn(0x7f3acc0f6c10 msgr2=0x7f3acc0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:05.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.747+0000 7f3ad342e640 1 -- 172.21.15.119:0/2829573458 shutdown_connections 2024-09-13T21:49:05.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.747+0000 7f3ad342e640 1 -- 172.21.15.119:0/2829573458 wait complete. 2024-09-13T21:49:05.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.828+0000 7fd45541b640 1 -- 172.21.15.119:0/3769156729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fd820 msgr2=0x7fd4500fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.828+0000 7fd45541b640 1 --2- 172.21.15.119:0/3769156729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fd820 0x7fd4500fdc90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd4440048d0 tx=0x7fd444009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.828+0000 7fd45541b640 1 -- 172.21.15.119:0/3769156729 shutdown_connections 2024-09-13T21:49:05.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.828+0000 7fd45541b640 1 --2- 172.21.15.119:0/3769156729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fd820 0x7fd4500fdc90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.828+0000 7fd45541b640 1 --2- 172.21.15.119:0/3769156729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fc550 0x7fd4500fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.828+0000 7fd45541b640 1 -- 172.21.15.119:0/3769156729 >> 172.21.15.119:0/3769156729 conn(0x7fd4500f7d30 msgr2=0x7fd4500fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:05.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.828+0000 7fd45541b640 1 -- 172.21.15.119:0/3769156729 shutdown_connections 2024-09-13T21:49:05.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.828+0000 7fd45541b640 1 -- 172.21.15.119:0/3769156729 wait complete. 2024-09-13T21:49:05.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd45541b640 1 Processor -- start 2024-09-13T21:49:05.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd45541b640 1 -- start start 2024-09-13T21:49:05.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd45541b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc550 0x7fd45010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:05.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd45541b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fd820 0x7fd45010d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd45541b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45010dc40 con 0x7fd4500fc550 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd45541b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45010e460 con 0x7fd4500fd820 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd44effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc550 0x7fd45010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd44effd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc550 0x7fd45010d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45522/0 (socket says 172.21.15.119:45522) 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd44effd640 1 -- 172.21.15.119:0/3493782046 learned_addr learned my addr 172.21.15.119:0/3493782046 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd44e7fc640 1 --2- 172.21.15.119:0/3493782046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fd820 0x7fd45010d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd44effd640 1 -- 172.21.15.119:0/3493782046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fd820 msgr2=0x7fd45010d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd44effd640 1 --2- 172.21.15.119:0/3493782046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fd820 0x7fd45010d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.829+0000 7fd44effd640 1 -- 172.21.15.119:0/3493782046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd444005040 con 0x7fd4500fc550 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.830+0000 7fd44effd640 1 --2- 172.21.15.119:0/3493782046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc550 0x7fd45010d0b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd44000c790 tx=0x7fd4400043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.830+0000 7fd4377fe640 1 -- 172.21.15.119:0/3493782046 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd44000a820 con 0x7fd4500fc550 2024-09-13T21:49:05.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.830+0000 7fd4377fe640 1 -- 172.21.15.119:0/3493782046 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd44000ae20 con 0x7fd4500fc550 2024-09-13T21:49:05.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.830+0000 7fd45541b640 1 -- 172.21.15.119:0/3493782046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45010e6f0 con 0x7fd4500fc550 2024-09-13T21:49:05.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.830+0000 7fd4377fe640 1 -- 172.21.15.119:0/3493782046 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4400113a0 con 0x7fd4500fc550 2024-09-13T21:49:05.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.830+0000 7fd45541b640 1 -- 172.21.15.119:0/3493782046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45010ec90 con 0x7fd4500fc550 2024-09-13T21:49:05.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.831+0000 7fd45541b640 1 -- 172.21.15.119:0/3493782046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4500fb9b0 con 0x7fd4500fc550 2024-09-13T21:49:05.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.831+0000 7fd4377fe640 1 -- 172.21.15.119:0/3493782046 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd440012400 con 0x7fd4500fc550 2024-09-13T21:49:05.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.832+0000 7fd4377fe640 1 --2- 172.21.15.119:0/3493782046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd43806e530 0x7fd4380709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:05.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.832+0000 7fd4377fe640 1 -- 172.21.15.119:0/3493782046 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd44008e2d0 con 0x7fd4500fc550 2024-09-13T21:49:05.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.832+0000 7fd44e7fc640 1 --2- 172.21.15.119:0/3493782046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd43806e530 0x7fd4380709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:05.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.832+0000 7fd44e7fc640 1 --2- 172.21.15.119:0/3493782046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd43806e530 0x7fd4380709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd444007ac0 tx=0x7fd444035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:05.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:05.836+0000 7fd4377fe640 1 -- 172.21.15.119:0/3493782046 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd440057490 con 0x7fd4500fc550 2024-09-13T21:49:06.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.038+0000 7fd45541b640 1 -- 172.21.15.119:0/3493782046 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd45004b720 con 0x7fd4500fc550 2024-09-13T21:49:06.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.038+0000 7fd4377fe640 1 -- 172.21.15.119:0/3493782046 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1943 (secure 0 0 0) 0x7fd44000a980 con 0x7fd4500fc550 2024-09-13T21:49:06.040 INFO:teuthology.orchestra.run.smithi119.stdout:e22 2024-09-13T21:49:06.040 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:48:12:719560+0000 2024-09-13T21:49:06.040 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:49:06.040 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 22 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:48:12.175306+0000 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:49:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:49:06.042 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 14472 members: 24267,14472 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:49:06.043 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:49:06.044 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:49:06.044 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 22 2024-09-13T21:49:06.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.040+0000 7fd45541b640 1 -- 172.21.15.119:0/3493782046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd43806e530 msgr2=0x7fd4380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:06.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.040+0000 7fd45541b640 1 --2- 172.21.15.119:0/3493782046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd43806e530 0x7fd4380709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd444007ac0 tx=0x7fd444035040 comp rx=0 tx=0).stop 2024-09-13T21:49:06.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.040+0000 7fd45541b640 1 -- 172.21.15.119:0/3493782046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc550 msgr2=0x7fd45010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:06.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.040+0000 7fd45541b640 1 --2- 172.21.15.119:0/3493782046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc550 0x7fd45010d0b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd44000c790 tx=0x7fd4400043c0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.040+0000 7fd45541b640 1 -- 172.21.15.119:0/3493782046 shutdown_connections 2024-09-13T21:49:06.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.040+0000 7fd45541b640 1 --2- 172.21.15.119:0/3493782046 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd43806e530 0x7fd4380709e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.040+0000 7fd45541b640 1 --2- 172.21.15.119:0/3493782046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4500fd820 0x7fd45010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.040+0000 7fd45541b640 1 --2- 172.21.15.119:0/3493782046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4500fc550 0x7fd45010d0b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.040+0000 7fd45541b640 1 -- 172.21.15.119:0/3493782046 >> 172.21.15.119:0/3493782046 conn(0x7fd4500f7d30 msgr2=0x7fd4500f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:06.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.040+0000 7fd45541b640 1 -- 172.21.15.119:0/3493782046 shutdown_connections 2024-09-13T21:49:06.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.040+0000 7fd45541b640 1 -- 172.21.15.119:0/3493782046 wait complete. 2024-09-13T21:49:06.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.122+0000 7f5cabf1b640 1 -- 172.21.15.119:0/3876282125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ca40fc3c0 msgr2=0x7f5ca40fc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:06.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.122+0000 7f5cabf1b640 1 --2- 172.21.15.119:0/3876282125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ca40fc3c0 0x7f5ca40fc810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5c940048d0 tx=0x7f5c94009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.122+0000 7f5cabf1b640 1 -- 172.21.15.119:0/3876282125 shutdown_connections 2024-09-13T21:49:06.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.122+0000 7f5cabf1b640 1 --2- 172.21.15.119:0/3876282125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ca40fc3c0 0x7f5ca40fc810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.122+0000 7f5cabf1b640 1 --2- 172.21.15.119:0/3876282125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ca40fba70 0x7f5ca40fbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.122+0000 7f5cabf1b640 1 -- 172.21.15.119:0/3876282125 >> 172.21.15.119:0/3876282125 conn(0x7f5ca40f63a0 msgr2=0x7f5ca40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.122+0000 7f5cabf1b640 1 -- 172.21.15.119:0/3876282125 shutdown_connections 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.122+0000 7f5cabf1b640 1 -- 172.21.15.119:0/3876282125 wait complete. 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.122+0000 7f5cabf1b640 1 Processor -- start 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.122+0000 7f5cabf1b640 1 -- start start 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5cabf1b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ca40fba70 0x7f5ca40fb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5cabf1b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ca40fc3c0 0x7f5ca4111e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5cabf1b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4112530 con 0x7f5ca40fc3c0 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5cabf1b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4112670 con 0x7f5ca40fba70 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5ca94b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ca40fc3c0 0x7f5ca4111e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5ca94b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ca40fc3c0 0x7f5ca4111e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45552/0 (socket says 172.21.15.119:45552) 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5ca94b6640 1 -- 172.21.15.119:0/1434120767 learned_addr learned my addr 172.21.15.119:0/1434120767 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5ca9cb7640 1 --2- 172.21.15.119:0/1434120767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ca40fba70 0x7f5ca40fb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:06.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5ca94b6640 1 -- 172.21.15.119:0/1434120767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ca40fba70 msgr2=0x7f5ca40fb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:06.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5ca94b6640 1 --2- 172.21.15.119:0/1434120767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ca40fba70 0x7f5ca40fb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5ca94b6640 1 -- 172.21.15.119:0/1434120767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94005040 con 0x7f5ca40fc3c0 2024-09-13T21:49:06.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5ca94b6640 1 --2- 172.21.15.119:0/1434120767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ca40fc3c0 0x7f5ca4111e70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5c94003080 tx=0x7f5c94009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:06.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5c9a7fc640 1 -- 172.21.15.119:0/1434120767 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c94038070 con 0x7f5ca40fc3c0 2024-09-13T21:49:06.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5c9a7fc640 1 -- 172.21.15.119:0/1434120767 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5c94009800 con 0x7f5ca40fc3c0 2024-09-13T21:49:06.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5c9a7fc640 1 -- 172.21.15.119:0/1434120767 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c94033660 con 0x7f5ca40fc3c0 2024-09-13T21:49:06.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.123+0000 7f5cabf1b640 1 -- 172.21.15.119:0/1434120767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca41128f0 con 0x7f5ca40fc3c0 2024-09-13T21:49:06.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.124+0000 7f5cabf1b640 1 -- 172.21.15.119:0/1434120767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca4112db0 con 0x7f5ca40fc3c0 2024-09-13T21:49:06.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.125+0000 7f5cabf1b640 1 -- 172.21.15.119:0/1434120767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca40fa040 con 0x7f5ca40fc3c0 2024-09-13T21:49:06.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.125+0000 7f5c9a7fc640 1 -- 172.21.15.119:0/1434120767 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5c94030020 con 0x7f5ca40fc3c0 2024-09-13T21:49:06.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.126+0000 7f5c9a7fc640 1 --2- 172.21.15.119:0/1434120767 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5c9006e530 0x7f5c900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:06.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.126+0000 7f5ca9cb7640 1 --2- 172.21.15.119:0/1434120767 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5c9006e530 0x7f5c900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:06.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.126+0000 7f5c9a7fc640 1 -- 172.21.15.119:0/1434120767 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f5c940ae1b0 con 0x7f5ca40fc3c0 2024-09-13T21:49:06.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.126+0000 7f5ca9cb7640 1 --2- 172.21.15.119:0/1434120767 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5c9006e530 0x7f5c900709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0006fd0 tx=0x7f5ca0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:06.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.130+0000 7f5c9a7fc640 1 -- 172.21.15.119:0/1434120767 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5c94077370 con 0x7f5ca40fc3c0 2024-09-13T21:49:06.320 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:06 smithi119 ceph-mon[90896]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:06.320 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:06 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:49:06.321 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:06 smithi119 ceph-mon[90896]: Upgrade: osd.2 is safe to restart 2024-09-13T21:49:06.321 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:06 smithi119 ceph-mon[90896]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:06.321 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:06 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2829573458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:06.321 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:06 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3493782046' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:49:06.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.318+0000 7f5cabf1b640 1 -- 172.21.15.119:0/1434120767 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ca4100c30 con 0x7f5c9006e530 2024-09-13T21:49:06.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.319+0000 7f5c9a7fc640 1 -- 172.21.15.119:0/1434120767 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5ca4100c30 con 0x7f5c9006e530 2024-09-13T21:49:06.323 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:49:06.323 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:49:06.323 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:49:06.324 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:49:06.324 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:49:06.324 INFO:teuthology.orchestra.run.smithi119.stdout: "crash", 2024-09-13T21:49:06.324 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr", 2024-09-13T21:49:06.324 INFO:teuthology.orchestra.run.smithi119.stdout: "mon" 2024-09-13T21:49:06.324 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:49:06.324 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "8/21 daemons upgraded", 2024-09-13T21:49:06.325 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:49:06.325 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:49:06.325 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:49:06.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.321+0000 7f5cabf1b640 1 -- 172.21.15.119:0/1434120767 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5c9006e530 msgr2=0x7f5c900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:06.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.321+0000 7f5cabf1b640 1 --2- 172.21.15.119:0/1434120767 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5c9006e530 0x7f5c900709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0006fd0 tx=0x7f5ca0008040 comp rx=0 tx=0).stop 2024-09-13T21:49:06.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.321+0000 7f5cabf1b640 1 -- 172.21.15.119:0/1434120767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ca40fc3c0 msgr2=0x7f5ca4111e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:06.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.321+0000 7f5cabf1b640 1 --2- 172.21.15.119:0/1434120767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ca40fc3c0 0x7f5ca4111e70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5c94003080 tx=0x7f5c94009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.321+0000 7f5cabf1b640 1 -- 172.21.15.119:0/1434120767 shutdown_connections 2024-09-13T21:49:06.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.321+0000 7f5cabf1b640 1 --2- 172.21.15.119:0/1434120767 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5c9006e530 0x7f5c900709e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.321+0000 7f5cabf1b640 1 --2- 172.21.15.119:0/1434120767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ca40fc3c0 0x7f5ca4111e70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.321+0000 7f5cabf1b640 1 --2- 172.21.15.119:0/1434120767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ca40fba70 0x7f5ca40fb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.321+0000 7f5cabf1b640 1 -- 172.21.15.119:0/1434120767 >> 172.21.15.119:0/1434120767 conn(0x7f5ca40f63a0 msgr2=0x7f5ca40f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:06.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.321+0000 7f5cabf1b640 1 -- 172.21.15.119:0/1434120767 shutdown_connections 2024-09-13T21:49:06.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.321+0000 7f5cabf1b640 1 -- 172.21.15.119:0/1434120767 wait complete. 2024-09-13T21:49:06.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.406+0000 7fe33cd6a640 1 -- 172.21.15.119:0/720777860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3380fb430 msgr2=0x7fe3380fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.406+0000 7fe33cd6a640 1 --2- 172.21.15.119:0/720777860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3380fb430 0x7fe3380fb840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe3280048d0 tx=0x7fe328009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.406+0000 7fe33cd6a640 1 -- 172.21.15.119:0/720777860 shutdown_connections 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.406+0000 7fe33cd6a640 1 --2- 172.21.15.119:0/720777860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3380fc700 0x7fe3380fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.406+0000 7fe33cd6a640 1 --2- 172.21.15.119:0/720777860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3380fb430 0x7fe3380fb840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.406+0000 7fe33cd6a640 1 -- 172.21.15.119:0/720777860 >> 172.21.15.119:0/720777860 conn(0x7fe3380f6c10 msgr2=0x7fe3380f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.406+0000 7fe33cd6a640 1 -- 172.21.15.119:0/720777860 shutdown_connections 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.406+0000 7fe33cd6a640 1 -- 172.21.15.119:0/720777860 wait complete. 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33cd6a640 1 Processor -- start 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33cd6a640 1 -- start start 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33cd6a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3380fb430 0x7fe33810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33cd6a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3380fc700 0x7fe3381122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33cd6a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe338065c80 con 0x7fe3380fb430 2024-09-13T21:49:06.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33cd6a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe338065df0 con 0x7fe3380fc700 2024-09-13T21:49:06.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3380fb430 0x7fe33810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:06.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3380fb430 0x7fe33810fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45570/0 (socket says 172.21.15.119:45570) 2024-09-13T21:49:06.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33659c640 1 -- 172.21.15.119:0/717433891 learned_addr learned my addr 172.21.15.119:0/717433891 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:06.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe32ffff640 1 --2- 172.21.15.119:0/717433891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3380fc700 0x7fe3381122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:06.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33659c640 1 -- 172.21.15.119:0/717433891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3380fc700 msgr2=0x7fe3381122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:06.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33659c640 1 --2- 172.21.15.119:0/717433891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3380fc700 0x7fe3381122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.407+0000 7fe33659c640 1 -- 172.21.15.119:0/717433891 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328005040 con 0x7fe3380fb430 2024-09-13T21:49:06.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.408+0000 7fe33659c640 1 --2- 172.21.15.119:0/717433891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3380fb430 0x7fe33810fda0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe3280043d0 tx=0x7fe328009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:06.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.408+0000 7fe32effd640 1 -- 172.21.15.119:0/717433891 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe328038070 con 0x7fe3380fb430 2024-09-13T21:49:06.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.408+0000 7fe32effd640 1 -- 172.21.15.119:0/717433891 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe32802ae90 con 0x7fe3380fb430 2024-09-13T21:49:06.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.408+0000 7fe33cd6a640 1 -- 172.21.15.119:0/717433891 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe338112830 con 0x7fe3380fb430 2024-09-13T21:49:06.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.408+0000 7fe33cd6a640 1 -- 172.21.15.119:0/717433891 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe338112dd0 con 0x7fe3380fb430 2024-09-13T21:49:06.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.408+0000 7fe32effd640 1 -- 172.21.15.119:0/717433891 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe32803e670 con 0x7fe3380fb430 2024-09-13T21:49:06.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.409+0000 7fe33cd6a640 1 -- 172.21.15.119:0/717433891 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3380fa890 con 0x7fe3380fb430 2024-09-13T21:49:06.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.409+0000 7fe32effd640 1 -- 172.21.15.119:0/717433891 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe328030020 con 0x7fe3380fb430 2024-09-13T21:49:06.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.410+0000 7fe32effd640 1 --2- 172.21.15.119:0/717433891 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe32406e530 0x7fe3240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:06.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.410+0000 7fe32effd640 1 -- 172.21.15.119:0/717433891 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe3280ae2b0 con 0x7fe3380fb430 2024-09-13T21:49:06.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.410+0000 7fe32ffff640 1 --2- 172.21.15.119:0/717433891 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe32406e530 0x7fe3240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:06.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.410+0000 7fe32ffff640 1 --2- 172.21.15.119:0/717433891 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe32406e530 0x7fe3240709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe320004ed0 tx=0x7fe32000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:06.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.414+0000 7fe32effd640 1 -- 172.21.15.119:0/717433891 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe328077520 con 0x7fe3380fb430 2024-09-13T21:49:06.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:06 smithi155 ceph-mon[79928]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:06.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:06 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T21:49:06.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:06 smithi155 ceph-mon[79928]: Upgrade: osd.2 is safe to restart 2024-09-13T21:49:06.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:06 smithi155 ceph-mon[79928]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:06.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:06 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2829573458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:06.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:06 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3493782046' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:49:06.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.662+0000 7fe33cd6a640 1 -- 172.21.15.119:0/717433891 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe33804b720 con 0x7fe3380fb430 2024-09-13T21:49:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.662+0000 7fe32effd640 1 -- 172.21.15.119:0/717433891 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe32807abe0 con 0x7fe3380fb430 2024-09-13T21:49:06.664 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:49:06.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.664+0000 7fe33cd6a640 1 -- 172.21.15.119:0/717433891 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe32406e530 msgr2=0x7fe3240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:06.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.664+0000 7fe33cd6a640 1 --2- 172.21.15.119:0/717433891 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe32406e530 0x7fe3240709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe320004ed0 tx=0x7fe32000b040 comp rx=0 tx=0).stop 2024-09-13T21:49:06.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.664+0000 7fe33cd6a640 1 -- 172.21.15.119:0/717433891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3380fb430 msgr2=0x7fe33810fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:06.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.664+0000 7fe33cd6a640 1 --2- 172.21.15.119:0/717433891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3380fb430 0x7fe33810fda0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe3280043d0 tx=0x7fe328009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.664+0000 7fe33cd6a640 1 -- 172.21.15.119:0/717433891 shutdown_connections 2024-09-13T21:49:06.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.664+0000 7fe33cd6a640 1 --2- 172.21.15.119:0/717433891 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe32406e530 0x7fe3240709e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.664+0000 7fe33cd6a640 1 --2- 172.21.15.119:0/717433891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3380fc700 0x7fe3381122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.664+0000 7fe33cd6a640 1 --2- 172.21.15.119:0/717433891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3380fb430 0x7fe33810fda0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:06.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.664+0000 7fe33cd6a640 1 -- 172.21.15.119:0/717433891 >> 172.21.15.119:0/717433891 conn(0x7fe3380f6c10 msgr2=0x7fe3380f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:06.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.664+0000 7fe33cd6a640 1 -- 172.21.15.119:0/717433891 shutdown_connections 2024-09-13T21:49:06.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:06.664+0000 7fe33cd6a640 1 -- 172.21.15.119:0/717433891 wait complete. 2024-09-13T21:49:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:07 smithi119 ceph-mon[90896]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:07 smithi119 ceph-mon[90896]: pgmap v80: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:07 smithi119 ceph-mon[90896]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:49:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:07.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:07 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/717433891' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:49:07.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:07.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:07 smithi155 ceph-mon[79928]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:07 smithi155 ceph-mon[79928]: pgmap v80: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:07 smithi155 ceph-mon[79928]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T21:49:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:07.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:07 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/717433891' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:49:07.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:07.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:08.275 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:08 smithi119 ceph-mon[90896]: Upgrade: Updating osd.2 2024-09-13T21:49:08.275 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:08 smithi119 ceph-mon[90896]: Deploying daemon osd.2 on smithi119 2024-09-13T21:49:08.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:08 smithi155 ceph-mon[79928]: Upgrade: Updating osd.2 2024-09-13T21:49:08.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:08 smithi155 ceph-mon[79928]: Deploying daemon osd.2 on smithi119 2024-09-13T21:49:09.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:09 smithi119 ceph-mon[90896]: pgmap v81: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:09.380 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:09 smithi119 systemd[1]: Stopping Ceph osd.2 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:49:09.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:09 smithi155 ceph-mon[79928]: pgmap v81: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:09.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:09 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2[61050]: 2024-09-13T21:49:09.465+0000 7f7757d74640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:49:09.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:09 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2[61050]: 2024-09-13T21:49:09.465+0000 7f7757d74640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-13T21:49:09.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:09 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2[61050]: 2024-09-13T21:49:09.465+0000 7f7757d74640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:49:10.550 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:10 smithi119 ceph-mon[90896]: osd.2 marked itself down and dead 2024-09-13T21:49:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:10 smithi155 ceph-mon[79928]: osd.2 marked itself down and dead 2024-09-13T21:49:10.844 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:10 smithi119 podman[110135]: 2024-09-13 21:49:10.548859037 +0000 UTC m=+1.208748680 container died 2be2fb8dc5b6bb2ad58bd7fda026ee1665adba2d938295d4d4d3d7fc7958487f (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=quincy-eb16b97, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:49:11.130 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:10 smithi119 podman[110135]: 2024-09-13 21:49:10.941615894 +0000 UTC m=+1.601505526 container cleanup 2be2fb8dc5b6bb2ad58bd7fda026ee1665adba2d938295d4d4d3d7fc7958487f (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, ceph=True, RELEASE=quincy-eb16b97, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:49:11.130 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:10 smithi119 bash[110135]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2 2024-09-13T21:49:11.576 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:11 smithi119 podman[110153]: 2024-09-13 21:49:11.134646638 +0000 UTC m=+0.584157134 container remove 2be2fb8dc5b6bb2ad58bd7fda026ee1665adba2d938295d4d4d3d7fc7958487f (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=quincy-eb16b97, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T21:49:11.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:11 smithi119 ceph-mon[90896]: pgmap v82: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:11.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:11 smithi119 ceph-mon[90896]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:49:11.576 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:11 smithi119 ceph-mon[90896]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T21:49:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:11 smithi155 ceph-mon[79928]: pgmap v82: 65 pgs: 65 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:11 smithi155 ceph-mon[79928]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:49:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:11 smithi155 ceph-mon[79928]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T21:49:11.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:11 smithi119 podman[110242]: 2024-09-13 21:49:11.47829153 +0000 UTC m=+0.015785731 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:49:11.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:11 smithi119 podman[110242]: 2024-09-13 21:49:11.619160792 +0000 UTC m=+0.156654983 container create c0c2c543e0b0daef47cee5d0e9248a46db00acedda5536f303005187792532b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, io.buildah.version=1.37.2) 2024-09-13T21:49:12.215 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:11 smithi119 podman[110242]: 2024-09-13 21:49:11.879994127 +0000 UTC m=+0.417488332 container init c0c2c543e0b0daef47cee5d0e9248a46db00acedda5536f303005187792532b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-13T21:49:12.216 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:11 smithi119 podman[110242]: 2024-09-13 21:49:11.883379113 +0000 UTC m=+0.420873316 container start c0c2c543e0b0daef47cee5d0e9248a46db00acedda5536f303005187792532b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T21:49:12.216 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:11 smithi119 podman[110242]: 2024-09-13 21:49:11.963302323 +0000 UTC m=+0.500796522 container attach c0c2c543e0b0daef47cee5d0e9248a46db00acedda5536f303005187792532b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-13T21:49:12.216 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:12 smithi119 podman[110242]: 2024-09-13 21:49:12.076276174 +0000 UTC m=+0.613770367 container died c0c2c543e0b0daef47cee5d0e9248a46db00acedda5536f303005187792532b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be) 2024-09-13T21:49:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:12 smithi155 ceph-mon[79928]: osdmap e59: 6 total, 5 up, 6 in 2024-09-13T21:49:12.601 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:12 smithi119 ceph-mon[90896]: osdmap e59: 6 total, 5 up, 6 in 2024-09-13T21:49:12.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:12 smithi119 podman[110265]: 2024-09-13 21:49:12.600456328 +0000 UTC m=+0.513600248 container remove c0c2c543e0b0daef47cee5d0e9248a46db00acedda5536f303005187792532b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-13T21:49:12.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:12 smithi119 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-13T21:49:12.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:12 smithi119 systemd[1]: Stopped Ceph osd.2 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:49:12.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:12 smithi119 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.2.service: Consumed 51.997s CPU time. 2024-09-13T21:49:12.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:12 smithi119 systemd[1]: Starting Ceph osd.2 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:49:13.355 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:13 smithi119 ceph-mon[90896]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:13.355 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:13 smithi119 podman[110363]: 2024-09-13 21:49:12.92852441 +0000 UTC m=+0.015498716 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:49:13.355 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:13 smithi119 podman[110363]: 2024-09-13 21:49:13.101778063 +0000 UTC m=+0.188752353 container create 6674da1025996a35c63746c87de1afdf6ebf31c08e99160cd63fbd4d49b77fdd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:49:13.355 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:13 smithi119 podman[110363]: 2024-09-13 21:49:13.354305156 +0000 UTC m=+0.441279461 container init 6674da1025996a35c63746c87de1afdf6ebf31c08e99160cd63fbd4d49b77fdd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T21:49:13.484 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:13 smithi155 ceph-mon[79928]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-13T21:49:13.630 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:13 smithi119 podman[110363]: 2024-09-13 21:49:13.35765132 +0000 UTC m=+0.444625615 container start 6674da1025996a35c63746c87de1afdf6ebf31c08e99160cd63fbd4d49b77fdd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T21:49:13.630 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:13 smithi119 podman[110363]: 2024-09-13 21:49:13.437563094 +0000 UTC m=+0.524537399 container attach 6674da1025996a35c63746c87de1afdf6ebf31c08e99160cd63fbd4d49b77fdd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:49:13.630 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:13 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate[110377]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:49:13.630 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:13 smithi119 bash[110363]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:49:13.630 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:13 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate[110377]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:49:13.630 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:13 smithi119 bash[110363]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:49:14.509 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:14 smithi119 ceph-mon[90896]: Health check failed: Degraded data redundancy: 14/318 objects degraded (4.403%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T21:49:14.509 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate[110377]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T21:49:14.509 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 bash[110363]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T21:49:14.509 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate[110377]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T21:49:14.509 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 bash[110363]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T21:49:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:14 smithi155 ceph-mon[79928]: Health check failed: Degraded data redundancy: 14/318 objects degraded (4.403%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T21:49:14.825 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate[110377]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T21:49:14.826 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 bash[110363]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T21:49:14.826 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate[110377]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T21:49:14.826 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 bash[110363]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T21:49:14.826 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate[110377]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T21:49:14.826 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 bash[110363]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T21:49:14.826 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate[110377]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T21:49:14.826 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 bash[110363]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T21:49:14.826 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate[110377]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T21:49:14.827 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 bash[110363]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T21:49:14.827 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:14 smithi119 podman[110363]: 2024-09-13 21:49:14.536737875 +0000 UTC m=+1.623712185 container died 6674da1025996a35c63746c87de1afdf6ebf31c08e99160cd63fbd4d49b77fdd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:49:15.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:15 smithi119 ceph-mon[90896]: pgmap v86: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 14/318 objects degraded (4.403%) 2024-09-13T21:49:15.380 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:15 smithi119 podman[110511]: 2024-09-13 21:49:15.091584884 +0000 UTC m=+0.543427263 container remove 6674da1025996a35c63746c87de1afdf6ebf31c08e99160cd63fbd4d49b77fdd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-13T21:49:15.380 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:15 smithi119 podman[110569]: 2024-09-13 21:49:15.200485927 +0000 UTC m=+0.016027978 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:49:15.380 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:15 smithi119 podman[110569]: 2024-09-13 21:49:15.32570116 +0000 UTC m=+0.141243201 container create 0f73e4fc2c43b92d0eded917e3be8634ffec9eea02dcd2f9ed9ec566319302af (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T21:49:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:15 smithi155 ceph-mon[79928]: pgmap v86: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 14/318 objects degraded (4.403%) 2024-09-13T21:49:15.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:15 smithi119 podman[110569]: 2024-09-13 21:49:15.569779225 +0000 UTC m=+0.385321267 container init 0f73e4fc2c43b92d0eded917e3be8634ffec9eea02dcd2f9ed9ec566319302af (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:49:15.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:15 smithi119 podman[110569]: 2024-09-13 21:49:15.572917165 +0000 UTC m=+0.388459210 container start 0f73e4fc2c43b92d0eded917e3be8634ffec9eea02dcd2f9ed9ec566319302af (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:49:15.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:15 smithi119 ceph-osd[110588]: -- 172.21.15.119:0/995006112 <== mon.0 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c006b4c1e0 con 0x55c005cf9c00 2024-09-13T21:49:15.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:15 smithi119 bash[110569]: 0f73e4fc2c43b92d0eded917e3be8634ffec9eea02dcd2f9ed9ec566319302af 2024-09-13T21:49:15.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:15 smithi119 systemd[1]: Started Ceph osd.2 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:49:17.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:16 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:17.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:16 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:17.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:16 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:17.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:16 smithi155 ceph-mon[79928]: pgmap v87: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:17.093 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:16 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:17.093 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:16 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:17.093 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:16 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:17.093 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:16 smithi119 ceph-mon[90896]: pgmap v87: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:17.780 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:17 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2[110584]: 2024-09-13T21:49:17.459+0000 7fcc31f61640 -1 Falling back to public interface 2024-09-13T21:49:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:19 smithi155 ceph-mon[79928]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:19.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:19 smithi119 ceph-mon[90896]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:21.554 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:21 smithi119 ceph-mon[90896]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:21.554 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:21.554 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:21.554 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:21 smithi119 ceph-mon[90896]: Health check update: Degraded data redundancy: 38/318 objects degraded (11.950%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T21:49:21.554 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:21.554 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:21 smithi155 ceph-mon[79928]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:21 smithi155 ceph-mon[79928]: Health check update: Degraded data redundancy: 38/318 objects degraded (11.950%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T21:49:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:22.880 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:22 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2[110584]: 2024-09-13T21:49:22.810+0000 7fcc31f61640 -1 osd.2 57 log_to_monitors true 2024-09-13T21:49:23.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:23 smithi119 ceph-mon[90896]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:23.507 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:23.507 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:23.507 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:23 smithi119 ceph-mon[90896]: from='osd.2 [v2:172.21.15.119:6818/2861686624,v1:172.21.15.119:6819/2861686624]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T21:49:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:23 smithi155 ceph-mon[79928]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:23 smithi155 ceph-mon[79928]: from='osd.2 [v2:172.21.15.119:6818/2861686624,v1:172.21.15.119:6819/2861686624]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T21:49:24.195 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 21:49:24 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2[110584]: 2024-09-13T21:49:24.024+0000 7fcc25cf3640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:49:24.455 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:24 smithi119 ceph-mon[90896]: from='osd.2 [v2:172.21.15.119:6818/2861686624,v1:172.21.15.119:6819/2861686624]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T21:49:24.455 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:24 smithi119 ceph-mon[90896]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T21:49:24.455 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:24 smithi119 ceph-mon[90896]: from='osd.2 [v2:172.21.15.119:6818/2861686624,v1:172.21.15.119:6819/2861686624]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:49:24.455 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:24 smithi119 ceph-mon[90896]: from='osd.2 [v2:172.21.15.119:6818/2861686624,v1:172.21.15.119:6819/2861686624]' entity='osd.2' 2024-09-13T21:49:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:24 smithi155 ceph-mon[79928]: from='osd.2 [v2:172.21.15.119:6818/2861686624,v1:172.21.15.119:6819/2861686624]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T21:49:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:24 smithi155 ceph-mon[79928]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T21:49:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:24 smithi155 ceph-mon[79928]: from='osd.2 [v2:172.21.15.119:6818/2861686624,v1:172.21.15.119:6819/2861686624]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2024-09-13T21:49:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:24 smithi155 ceph-mon[79928]: from='osd.2 [v2:172.21.15.119:6818/2861686624,v1:172.21.15.119:6819/2861686624]' entity='osd.2' 2024-09-13T21:49:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:25.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:25.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:25.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:25.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:25.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:25.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:49:25.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:49:25.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: osd.2 [v2:172.21.15.119:6818/2861686624,v1:172.21.15.119:6819/2861686624] boot 2024-09-13T21:49:25.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: osdmap e61: 6 total, 6 up, 6 in 2024-09-13T21:49:25.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:49:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:25.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:25.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:25.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:25.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:49:25.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:49:25.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: osd.2 [v2:172.21.15.119:6818/2861686624,v1:172.21.15.119:6819/2861686624] boot 2024-09-13T21:49:25.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: osdmap e61: 6 total, 6 up, 6 in 2024-09-13T21:49:25.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T21:49:26.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:26 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:49:26.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:26 smithi155 ceph-mon[79928]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T21:49:26.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:26 smithi155 ceph-mon[79928]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T21:49:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:26 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:49:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:26 smithi119 ceph-mon[90896]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T21:49:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:26 smithi119 ceph-mon[90896]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T21:49:27.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:27 smithi155 ceph-mon[79928]: pgmap v95: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:27 smithi119 ceph-mon[90896]: pgmap v95: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:28.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:28 smithi155 ceph-mon[79928]: Health check update: Degraded data redundancy: 24/318 objects degraded (7.547%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T21:49:28.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:28 smithi119 ceph-mon[90896]: Health check update: Degraded data redundancy: 24/318 objects degraded (7.547%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T21:49:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:29 smithi155 ceph-mon[79928]: pgmap v96: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 24/318 objects degraded (7.547%) 2024-09-13T21:49:29.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:29 smithi119 ceph-mon[90896]: pgmap v96: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 24/318 objects degraded (7.547%) 2024-09-13T21:49:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:30 smithi119 ceph-mon[90896]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/318 objects degraded (7.547%), 7 pgs degraded) 2024-09-13T21:49:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:30 smithi119 ceph-mon[90896]: Cluster is now healthy 2024-09-13T21:49:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:30 smithi155 ceph-mon[79928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/318 objects degraded (7.547%), 7 pgs degraded) 2024-09-13T21:49:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:30 smithi155 ceph-mon[79928]: Cluster is now healthy 2024-09-13T21:49:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:31 smithi119 ceph-mon[90896]: pgmap v97: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:31.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:31 smithi155 ceph-mon[79928]: pgmap v97: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:33.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:33 smithi119 ceph-mon[90896]: pgmap v98: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:33.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:33 smithi155 ceph-mon[79928]: pgmap v98: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:34.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:34 smithi155 ceph-mon[79928]: pgmap v99: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:34 smithi119 ceph-mon[90896]: pgmap v99: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:36.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.757+0000 7f8affd91640 1 -- 172.21.15.119:0/1622258441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8af80fd840 msgr2=0x7f8af80fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.757+0000 7f8affd91640 1 --2- 172.21.15.119:0/1622258441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8af80fd840 0x7f8af80fdcb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80048d0 tx=0x7f8ae8009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.757+0000 7f8affd91640 1 -- 172.21.15.119:0/1622258441 shutdown_connections 2024-09-13T21:49:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.757+0000 7f8affd91640 1 --2- 172.21.15.119:0/1622258441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8af80fd840 0x7f8af80fdcb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.757+0000 7f8affd91640 1 --2- 172.21.15.119:0/1622258441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af80fc570 0x7f8af80fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.757+0000 7f8affd91640 1 -- 172.21.15.119:0/1622258441 >> 172.21.15.119:0/1622258441 conn(0x7f8af80f7d30 msgr2=0x7f8af80fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.757+0000 7f8affd91640 1 -- 172.21.15.119:0/1622258441 shutdown_connections 2024-09-13T21:49:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.757+0000 7f8affd91640 1 -- 172.21.15.119:0/1622258441 wait complete. 2024-09-13T21:49:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.757+0000 7f8affd91640 1 Processor -- start 2024-09-13T21:49:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8affd91640 1 -- start start 2024-09-13T21:49:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8affd91640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af80fc570 0x7f8af810d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8affd91640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8af80fd840 0x7f8af810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:36.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8affd91640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af810dbf0 con 0x7f8af80fd840 2024-09-13T21:49:36.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8affd91640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af810e410 con 0x7f8af80fc570 2024-09-13T21:49:36.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8afd32c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8af80fd840 0x7f8af810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:36.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8afd32c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8af80fd840 0x7f8af810d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39082/0 (socket says 172.21.15.119:39082) 2024-09-13T21:49:36.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8afd32c640 1 -- 172.21.15.119:0/418693607 learned_addr learned my addr 172.21.15.119:0/418693607 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:36.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8afdb2d640 1 --2- 172.21.15.119:0/418693607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af80fc570 0x7f8af810d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:36.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8afd32c640 1 -- 172.21.15.119:0/418693607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af80fc570 msgr2=0x7f8af810d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:36.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8afd32c640 1 --2- 172.21.15.119:0/418693607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af80fc570 0x7f8af810d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:36.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8afd32c640 1 -- 172.21.15.119:0/418693607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae8005040 con 0x7f8af80fd840 2024-09-13T21:49:36.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.758+0000 7f8afd32c640 1 --2- 172.21.15.119:0/418693607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8af80fd840 0x7f8af810d5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80043d0 tx=0x7f8ae8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:36.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.759+0000 7f8aee7fc640 1 -- 172.21.15.119:0/418693607 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae8038070 con 0x7f8af80fd840 2024-09-13T21:49:36.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.759+0000 7f8aee7fc640 1 -- 172.21.15.119:0/418693607 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ae802ae90 con 0x7f8af80fd840 2024-09-13T21:49:36.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.759+0000 7f8affd91640 1 -- 172.21.15.119:0/418693607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af810e640 con 0x7f8af80fd840 2024-09-13T21:49:36.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.759+0000 7f8aee7fc640 1 -- 172.21.15.119:0/418693607 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae803e670 con 0x7f8af80fd840 2024-09-13T21:49:36.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.759+0000 7f8affd91640 1 -- 172.21.15.119:0/418693607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af810ebe0 con 0x7f8af80fd840 2024-09-13T21:49:36.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.760+0000 7f8affd91640 1 -- 172.21.15.119:0/418693607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af80fb9d0 con 0x7f8af80fd840 2024-09-13T21:49:36.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.760+0000 7f8aee7fc640 1 -- 172.21.15.119:0/418693607 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8ae8030020 con 0x7f8af80fd840 2024-09-13T21:49:36.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.761+0000 7f8aee7fc640 1 --2- 172.21.15.119:0/418693607 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ae406e530 0x7f8ae40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:36.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.761+0000 7f8aee7fc640 1 -- 172.21.15.119:0/418693607 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8ae80add10 con 0x7f8af80fd840 2024-09-13T21:49:36.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.761+0000 7f8afdb2d640 1 --2- 172.21.15.119:0/418693607 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ae406e530 0x7f8ae40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:36.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.761+0000 7f8afdb2d640 1 --2- 172.21.15.119:0/418693607 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ae406e530 0x7f8ae40709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8af4001250 tx=0x7f8af4004d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:36.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.765+0000 7f8aee7fc640 1 -- 172.21.15.119:0/418693607 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8ae8076e50 con 0x7f8af80fd840 2024-09-13T21:49:36.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.949+0000 7f8affd91640 1 -- 172.21.15.119:0/418693607 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8af810eec0 con 0x7f8ae406e530 2024-09-13T21:49:36.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.950+0000 7f8aee7fc640 1 -- 172.21.15.119:0/418693607 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8af810eec0 con 0x7f8ae406e530 2024-09-13T21:49:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.952+0000 7f8affd91640 1 -- 172.21.15.119:0/418693607 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ae406e530 msgr2=0x7f8ae40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.952+0000 7f8affd91640 1 --2- 172.21.15.119:0/418693607 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ae406e530 0x7f8ae40709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8af4001250 tx=0x7f8af4004d00 comp rx=0 tx=0).stop 2024-09-13T21:49:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.952+0000 7f8affd91640 1 -- 172.21.15.119:0/418693607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8af80fd840 msgr2=0x7f8af810d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.952+0000 7f8affd91640 1 --2- 172.21.15.119:0/418693607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8af80fd840 0x7f8af810d5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80043d0 tx=0x7f8ae8009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.952+0000 7f8affd91640 1 -- 172.21.15.119:0/418693607 shutdown_connections 2024-09-13T21:49:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.952+0000 7f8affd91640 1 --2- 172.21.15.119:0/418693607 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ae406e530 0x7f8ae40709e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.952+0000 7f8affd91640 1 --2- 172.21.15.119:0/418693607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8af80fd840 0x7f8af810d5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.952+0000 7f8affd91640 1 --2- 172.21.15.119:0/418693607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af80fc570 0x7f8af810d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:36.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.952+0000 7f8affd91640 1 -- 172.21.15.119:0/418693607 >> 172.21.15.119:0/418693607 conn(0x7f8af80f7d30 msgr2=0x7f8af80f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:36.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.952+0000 7f8affd91640 1 -- 172.21.15.119:0/418693607 shutdown_connections 2024-09-13T21:49:36.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:36.952+0000 7f8affd91640 1 -- 172.21.15.119:0/418693607 wait complete. 2024-09-13T21:49:36.962 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:49:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.031+0000 7f83574ad640 1 -- 172.21.15.119:0/2660237650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8350066710 msgr2=0x7f83500fcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.031+0000 7f83574ad640 1 --2- 172.21.15.119:0/2660237650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8350066710 0x7f83500fcf70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f834c0048d0 tx=0x7f834c009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.031+0000 7f83574ad640 1 -- 172.21.15.119:0/2660237650 shutdown_connections 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.031+0000 7f83574ad640 1 --2- 172.21.15.119:0/2660237650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83500fd4b0 0x7f83500ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.031+0000 7f83574ad640 1 --2- 172.21.15.119:0/2660237650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8350066710 0x7f83500fcf70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.031+0000 7f83574ad640 1 -- 172.21.15.119:0/2660237650 >> 172.21.15.119:0/2660237650 conn(0x7f83500f6c10 msgr2=0x7f83500f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.031+0000 7f83574ad640 1 -- 172.21.15.119:0/2660237650 shutdown_connections 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.031+0000 7f83574ad640 1 -- 172.21.15.119:0/2660237650 wait complete. 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f83574ad640 1 Processor -- start 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f83574ad640 1 -- start start 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f83574ad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8350066710 0x7f83501136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f83574ad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83500fd4b0 0x7f8350113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f83574ad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8350114240 con 0x7f83500fd4b0 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f83574ad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8350114a60 con 0x7f8350066710 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f8354a48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83500fd4b0 0x7f8350113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f8354a48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83500fd4b0 0x7f8350113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39108/0 (socket says 172.21.15.119:39108) 2024-09-13T21:49:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f8354a48640 1 -- 172.21.15.119:0/664706760 learned_addr learned my addr 172.21.15.119:0/664706760 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:37.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f8355249640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8350066710 0x7f83501136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f8354a48640 1 -- 172.21.15.119:0/664706760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8350066710 msgr2=0x7f83501136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f8354a48640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8350066710 0x7f83501136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f8354a48640 1 -- 172.21.15.119:0/664706760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c005040 con 0x7f83500fd4b0 2024-09-13T21:49:37.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.032+0000 7f8355249640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8350066710 0x7f83501136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:49:37.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.033+0000 7f8354a48640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83500fd4b0 0x7f8350113bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f834000eb70 tx=0x7f834000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:37.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.033+0000 7f8345ffb640 1 -- 172.21.15.119:0/664706760 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8340007c30 con 0x7f83500fd4b0 2024-09-13T21:49:37.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.033+0000 7f8345ffb640 1 -- 172.21.15.119:0/664706760 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f834000f040 con 0x7f83500fd4b0 2024-09-13T21:49:37.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.033+0000 7f83574ad640 1 -- 172.21.15.119:0/664706760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8350114c90 con 0x7f83500fd4b0 2024-09-13T21:49:37.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.033+0000 7f8345ffb640 1 -- 172.21.15.119:0/664706760 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83400094e0 con 0x7f83500fd4b0 2024-09-13T21:49:37.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.033+0000 7f83574ad640 1 -- 172.21.15.119:0/664706760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8350115230 con 0x7f83500fd4b0 2024-09-13T21:49:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.034+0000 7f83574ad640 1 -- 172.21.15.119:0/664706760 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83500fa8d0 con 0x7f83500fd4b0 2024-09-13T21:49:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.034+0000 7f8345ffb640 1 -- 172.21.15.119:0/664706760 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8340009660 con 0x7f83500fd4b0 2024-09-13T21:49:37.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.035+0000 7f8345ffb640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f833c06e530 0x7f833c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.035+0000 7f8345ffb640 1 -- 172.21.15.119:0/664706760 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f834008deb0 con 0x7f83500fd4b0 2024-09-13T21:49:37.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.035+0000 7f8355249640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f833c06e530 0x7f833c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.036+0000 7f8355249640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f833c06e530 0x7f833c0709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f834c007ac0 tx=0x7f834c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:37.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.039+0000 7f8345ffb640 1 -- 172.21.15.119:0/664706760 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8340056ff0 con 0x7f83500fd4b0 2024-09-13T21:49:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.223+0000 7f83574ad640 1 -- 172.21.15.119:0/664706760 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8350115560 con 0x7f833c06e530 2024-09-13T21:49:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.225+0000 7f8345ffb640 1 -- 172.21.15.119:0/664706760 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8350115560 con 0x7f833c06e530 2024-09-13T21:49:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.227+0000 7f83574ad640 1 -- 172.21.15.119:0/664706760 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f833c06e530 msgr2=0x7f833c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.227+0000 7f83574ad640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f833c06e530 0x7f833c0709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f834c007ac0 tx=0x7f834c035040 comp rx=0 tx=0).stop 2024-09-13T21:49:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.227+0000 7f83574ad640 1 -- 172.21.15.119:0/664706760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83500fd4b0 msgr2=0x7f8350113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.227+0000 7f83574ad640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83500fd4b0 0x7f8350113bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f834000eb70 tx=0x7f834000b040 comp rx=0 tx=0).stop 2024-09-13T21:49:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.227+0000 7f83574ad640 1 -- 172.21.15.119:0/664706760 shutdown_connections 2024-09-13T21:49:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.227+0000 7f83574ad640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f833c06e530 0x7f833c0709e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.227+0000 7f83574ad640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83500fd4b0 0x7f8350113bf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.227+0000 7f83574ad640 1 --2- 172.21.15.119:0/664706760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8350066710 0x7f83501136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.227+0000 7f83574ad640 1 -- 172.21.15.119:0/664706760 >> 172.21.15.119:0/664706760 conn(0x7f83500f6c10 msgr2=0x7f83500f7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.227+0000 7f83574ad640 1 -- 172.21.15.119:0/664706760 shutdown_connections 2024-09-13T21:49:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.227+0000 7f83574ad640 1 -- 172.21.15.119:0/664706760 wait complete. 2024-09-13T21:49:37.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.305+0000 7f53e64bc640 1 -- 172.21.15.119:0/564822360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53e00fa9a0 msgr2=0x7f53e00fadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.305+0000 7f53e64bc640 1 --2- 172.21.15.119:0/564822360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53e00fa9a0 0x7f53e00fadb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53d00048d0 tx=0x7f53d0009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.305+0000 7f53e64bc640 1 -- 172.21.15.119:0/564822360 shutdown_connections 2024-09-13T21:49:37.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.305+0000 7f53e64bc640 1 --2- 172.21.15.119:0/564822360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e00fb2f0 0x7f53e0101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.305+0000 7f53e64bc640 1 --2- 172.21.15.119:0/564822360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53e00fa9a0 0x7f53e00fadb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.305+0000 7f53e64bc640 1 -- 172.21.15.119:0/564822360 >> 172.21.15.119:0/564822360 conn(0x7f53e00f63a0 msgr2=0x7f53e00f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:37.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.305+0000 7f53e64bc640 1 -- 172.21.15.119:0/564822360 shutdown_connections 2024-09-13T21:49:37.307 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:37 smithi119 ceph-mon[90896]: pgmap v100: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:37.307 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:37.307 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:37.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.305+0000 7f53e64bc640 1 -- 172.21.15.119:0/564822360 wait complete. 2024-09-13T21:49:37.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.305+0000 7f53e64bc640 1 Processor -- start 2024-09-13T21:49:37.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53e64bc640 1 -- start start 2024-09-13T21:49:37.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53e64bc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e00fa9a0 0x7f53e00fd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53e64bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53e00fb2f0 0x7f53e00fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53e64bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00fbf30 con 0x7f53e00fb2f0 2024-09-13T21:49:37.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53e64bc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00fc070 con 0x7f53e00fa9a0 2024-09-13T21:49:37.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53df7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53e00fb2f0 0x7f53e00fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53dffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e00fa9a0 0x7f53e00fd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53df7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53e00fb2f0 0x7f53e00fb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39128/0 (socket says 172.21.15.119:39128) 2024-09-13T21:49:37.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53df7fe640 1 -- 172.21.15.119:0/1192183558 learned_addr learned my addr 172.21.15.119:0/1192183558 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:37.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53df7fe640 1 -- 172.21.15.119:0/1192183558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e00fa9a0 msgr2=0x7f53e00fd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53df7fe640 1 --2- 172.21.15.119:0/1192183558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e00fa9a0 0x7f53e00fd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.306+0000 7f53df7fe640 1 -- 172.21.15.119:0/1192183558 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d0005040 con 0x7f53e00fb2f0 2024-09-13T21:49:37.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.307+0000 7f53df7fe640 1 --2- 172.21.15.119:0/1192183558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53e00fb2f0 0x7f53e00fb9a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c7e0 tx=0x7f53d40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:37.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.307+0000 7f53dcff9640 1 -- 172.21.15.119:0/1192183558 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53d400a7a0 con 0x7f53e00fb2f0 2024-09-13T21:49:37.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.307+0000 7f53e64bc640 1 -- 172.21.15.119:0/1192183558 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e00fc350 con 0x7f53e00fb2f0 2024-09-13T21:49:37.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.307+0000 7f53dcff9640 1 -- 172.21.15.119:0/1192183558 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f53d400ada0 con 0x7f53e00fb2f0 2024-09-13T21:49:37.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.307+0000 7f53dcff9640 1 -- 172.21.15.119:0/1192183558 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53d40113a0 con 0x7f53e00fb2f0 2024-09-13T21:49:37.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.307+0000 7f53e64bc640 1 -- 172.21.15.119:0/1192183558 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e0115100 con 0x7f53e00fb2f0 2024-09-13T21:49:37.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.308+0000 7f53e64bc640 1 -- 172.21.15.119:0/1192183558 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e00fa040 con 0x7f53e00fb2f0 2024-09-13T21:49:37.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.309+0000 7f53dcff9640 1 -- 172.21.15.119:0/1192183558 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f53d4012400 con 0x7f53e00fb2f0 2024-09-13T21:49:37.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.309+0000 7f53dcff9640 1 --2- 172.21.15.119:0/1192183558 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53c806e530 0x7f53c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.309+0000 7f53dcff9640 1 -- 172.21.15.119:0/1192183558 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f53d408e1e0 con 0x7f53e00fb2f0 2024-09-13T21:49:37.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.309+0000 7f53dffff640 1 --2- 172.21.15.119:0/1192183558 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53c806e530 0x7f53c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.310+0000 7f53dffff640 1 --2- 172.21.15.119:0/1192183558 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53c806e530 0x7f53c80709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53d0000c00 tx=0x7f53d0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:37.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.314+0000 7f53dcff9640 1 -- 172.21.15.119:0/1192183558 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f53d40573a0 con 0x7f53e00fb2f0 2024-09-13T21:49:37.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.488+0000 7f53e64bc640 1 -- 172.21.15.119:0/1192183558 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f53e01013f0 con 0x7f53c806e530 2024-09-13T21:49:37.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.497+0000 7f53dcff9640 1 -- 172.21.15.119:0/1192183558 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f53e01013f0 con 0x7f53c806e530 2024-09-13T21:49:37.498 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (4m) 17s ago 12m 25.9M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (116s) 17s ago 12m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (111s) 108s ago 11m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (3m) 17s ago 12m 80.4M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (7m) 17s ago 7m 13.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (7m) 17s ago 7m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (7m) 108s ago 7m 16.3M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (7m) 108s ago 7m 110M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (3m) 17s ago 13m 498M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (3m) 108s ago 11m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (2m) 17s ago 13m 47.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (2m) 108s ago 11m 34.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (4m) 17s ago 12m 16.2M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:49:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (3m) 108s ago 11m 15.4M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:49:37.500 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (91s) 17s ago 11m 93.3M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:49:37.500 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (56s) 17s ago 10m 93.6M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 8f69bf25cd20 2024-09-13T21:49:37.500 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (22s) 17s ago 10m 11.0M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 0f73e4fc2c43 2024-09-13T21:49:37.500 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (9m) 108s ago 9m 266M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 b83274b94224 2024-09-13T21:49:37.500 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (9m) 108s ago 9m 228M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:49:37.500 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (8m) 108s ago 8m 227M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:49:37.500 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (3m) 17s ago 12m 51.8M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:49:37.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.499+0000 7f53e64bc640 1 -- 172.21.15.119:0/1192183558 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53c806e530 msgr2=0x7f53c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.499+0000 7f53e64bc640 1 --2- 172.21.15.119:0/1192183558 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53c806e530 0x7f53c80709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53d0000c00 tx=0x7f53d0035040 comp rx=0 tx=0).stop 2024-09-13T21:49:37.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.499+0000 7f53e64bc640 1 -- 172.21.15.119:0/1192183558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53e00fb2f0 msgr2=0x7f53e00fb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.499+0000 7f53e64bc640 1 --2- 172.21.15.119:0/1192183558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53e00fb2f0 0x7f53e00fb9a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c7e0 tx=0x7f53d40043c0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.499+0000 7f53e64bc640 1 -- 172.21.15.119:0/1192183558 shutdown_connections 2024-09-13T21:49:37.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.499+0000 7f53e64bc640 1 --2- 172.21.15.119:0/1192183558 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f53c806e530 0x7f53c80709e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.499+0000 7f53e64bc640 1 --2- 172.21.15.119:0/1192183558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53e00fb2f0 0x7f53e00fb9a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.499+0000 7f53e64bc640 1 --2- 172.21.15.119:0/1192183558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e00fa9a0 0x7f53e00fd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.499+0000 7f53e64bc640 1 -- 172.21.15.119:0/1192183558 >> 172.21.15.119:0/1192183558 conn(0x7f53e00f63a0 msgr2=0x7f53e00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:37.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.499+0000 7f53e64bc640 1 -- 172.21.15.119:0/1192183558 shutdown_connections 2024-09-13T21:49:37.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.499+0000 7f53e64bc640 1 -- 172.21.15.119:0/1192183558 wait complete. 2024-09-13T21:49:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.577+0000 7fdffc832640 1 -- 172.21.15.119:0/2689604094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff80fc700 msgr2=0x7fdff80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.577+0000 7fdffc832640 1 --2- 172.21.15.119:0/2689604094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff80fc700 0x7fdff80fcb70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00048d0 tx=0x7fdfe0009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.577+0000 7fdffc832640 1 -- 172.21.15.119:0/2689604094 shutdown_connections 2024-09-13T21:49:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.577+0000 7fdffc832640 1 --2- 172.21.15.119:0/2689604094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff80fc700 0x7fdff80fcb70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.577+0000 7fdffc832640 1 --2- 172.21.15.119:0/2689604094 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdff80fb430 0x7fdff80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.577+0000 7fdffc832640 1 -- 172.21.15.119:0/2689604094 >> 172.21.15.119:0/2689604094 conn(0x7fdff80f6c10 msgr2=0x7fdff80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.577+0000 7fdffc832640 1 -- 172.21.15.119:0/2689604094 shutdown_connections 2024-09-13T21:49:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.577+0000 7fdffc832640 1 -- 172.21.15.119:0/2689604094 wait complete. 2024-09-13T21:49:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.578+0000 7fdffc832640 1 Processor -- start 2024-09-13T21:49:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.578+0000 7fdffc832640 1 -- start start 2024-09-13T21:49:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.578+0000 7fdffc832640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff80fb430 0x7fdff810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.578+0000 7fdffc832640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdff80fc700 0x7fdff8112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.578+0000 7fdffc832640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff8065c60 con 0x7fdff80fb430 2024-09-13T21:49:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.578+0000 7fdffc832640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff8065dd0 con 0x7fdff80fc700 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.578+0000 7fdff659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff80fb430 0x7fdff810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.578+0000 7fdff659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff80fb430 0x7fdff810fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39152/0 (socket says 172.21.15.119:39152) 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.578+0000 7fdff659c640 1 -- 172.21.15.119:0/3725268199 learned_addr learned my addr 172.21.15.119:0/3725268199 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.578+0000 7fdfeffff640 1 --2- 172.21.15.119:0/3725268199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdff80fc700 0x7fdff8112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.579+0000 7fdff659c640 1 -- 172.21.15.119:0/3725268199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdff80fc700 msgr2=0x7fdff8112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.579+0000 7fdff659c640 1 --2- 172.21.15.119:0/3725268199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdff80fc700 0x7fdff8112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.579+0000 7fdff659c640 1 -- 172.21.15.119:0/3725268199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe0005040 con 0x7fdff80fb430 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.579+0000 7fdff659c640 1 --2- 172.21.15.119:0/3725268199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff80fb430 0x7fdff810fdc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800eb70 tx=0x7fdfe800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.579+0000 7fdfeeffd640 1 -- 172.21.15.119:0/3725268199 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe8007c30 con 0x7fdff80fb430 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.579+0000 7fdffc832640 1 -- 172.21.15.119:0/3725268199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff8112850 con 0x7fdff80fb430 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.579+0000 7fdfeeffd640 1 -- 172.21.15.119:0/3725268199 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdfe800f040 con 0x7fdff80fb430 2024-09-13T21:49:37.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.579+0000 7fdfeeffd640 1 -- 172.21.15.119:0/3725268199 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe800ca60 con 0x7fdff80fb430 2024-09-13T21:49:37.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.579+0000 7fdffc832640 1 -- 172.21.15.119:0/3725268199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff8112dc0 con 0x7fdff80fb430 2024-09-13T21:49:37.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.580+0000 7fdffc832640 1 -- 172.21.15.119:0/3725268199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff80fa890 con 0x7fdff80fb430 2024-09-13T21:49:37.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.581+0000 7fdfeeffd640 1 -- 172.21.15.119:0/3725268199 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdfe800cbc0 con 0x7fdff80fb430 2024-09-13T21:49:37.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.581+0000 7fdfeeffd640 1 --2- 172.21.15.119:0/3725268199 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfe406e530 0x7fdfe40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.581+0000 7fdfeeffd640 1 -- 172.21.15.119:0/3725268199 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdfe808dd30 con 0x7fdff80fb430 2024-09-13T21:49:37.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.581+0000 7fdfeffff640 1 --2- 172.21.15.119:0/3725268199 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfe406e530 0x7fdfe40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:37 smithi155 ceph-mon[79928]: pgmap v100: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:37.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:37.587 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:37.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.582+0000 7fdfeffff640 1 --2- 172.21.15.119:0/3725268199 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfe406e530 0x7fdfe40709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0004540 tx=0x7fdfe0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:37.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.585+0000 7fdfeeffd640 1 -- 172.21.15.119:0/3725268199 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdfe8056f20 con 0x7fdff80fb430 2024-09-13T21:49:37.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.817+0000 7fdffc832640 1 -- 172.21.15.119:0/3725268199 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdff81130e0 con 0x7fdff80fb430 2024-09-13T21:49:37.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.818+0000 7fdfeeffd640 1 -- 172.21.15.119:0/3725268199 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fdfe805a5e0 con 0x7fdff80fb430 2024-09-13T21:49:37.819 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:49:37.819 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:49:37.819 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:49:37.819 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:49:37.820 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:49:37.820 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:49:37.820 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:49:37.820 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:49:37.820 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 3, 2024-09-13T21:49:37.820 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 3 2024-09-13T21:49:37.820 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:49:37.820 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:49:37.820 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:49:37.820 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:49:37.821 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:49:37.821 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 7, 2024-09-13T21:49:37.821 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 7 2024-09-13T21:49:37.821 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:49:37.821 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:49:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.820+0000 7fdffc832640 1 -- 172.21.15.119:0/3725268199 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfe406e530 msgr2=0x7fdfe40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.820+0000 7fdffc832640 1 --2- 172.21.15.119:0/3725268199 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfe406e530 0x7fdfe40709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0004540 tx=0x7fdfe0035040 comp rx=0 tx=0).stop 2024-09-13T21:49:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.820+0000 7fdffc832640 1 -- 172.21.15.119:0/3725268199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff80fb430 msgr2=0x7fdff810fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.820+0000 7fdffc832640 1 --2- 172.21.15.119:0/3725268199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff80fb430 0x7fdff810fdc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800eb70 tx=0x7fdfe800b040 comp rx=0 tx=0).stop 2024-09-13T21:49:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.820+0000 7fdffc832640 1 -- 172.21.15.119:0/3725268199 shutdown_connections 2024-09-13T21:49:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.820+0000 7fdffc832640 1 --2- 172.21.15.119:0/3725268199 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfe406e530 0x7fdfe40709e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.820+0000 7fdffc832640 1 --2- 172.21.15.119:0/3725268199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdff80fc700 0x7fdff8112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.820+0000 7fdffc832640 1 --2- 172.21.15.119:0/3725268199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff80fb430 0x7fdff810fdc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.820+0000 7fdffc832640 1 -- 172.21.15.119:0/3725268199 >> 172.21.15.119:0/3725268199 conn(0x7fdff80f6c10 msgr2=0x7fdff80f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:37.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.820+0000 7fdffc832640 1 -- 172.21.15.119:0/3725268199 shutdown_connections 2024-09-13T21:49:37.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.820+0000 7fdffc832640 1 -- 172.21.15.119:0/3725268199 wait complete. 2024-09-13T21:49:37.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.900+0000 7f853cdbf640 1 -- 172.21.15.119:0/1684108610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85380fc3b0 msgr2=0x7f85380fc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.900+0000 7f853cdbf640 1 --2- 172.21.15.119:0/1684108610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85380fc3b0 0x7f85380fc820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f852c0048d0 tx=0x7f852c009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.900+0000 7f853cdbf640 1 -- 172.21.15.119:0/1684108610 shutdown_connections 2024-09-13T21:49:37.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.900+0000 7f853cdbf640 1 --2- 172.21.15.119:0/1684108610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85380fc3b0 0x7f85380fc820 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.900+0000 7f853cdbf640 1 --2- 172.21.15.119:0/1684108610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85380fba60 0x7f85380fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.900+0000 7f853cdbf640 1 -- 172.21.15.119:0/1684108610 >> 172.21.15.119:0/1684108610 conn(0x7f85380f63b0 msgr2=0x7f85380f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.900+0000 7f853cdbf640 1 -- 172.21.15.119:0/1684108610 shutdown_connections 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.900+0000 7f853cdbf640 1 -- 172.21.15.119:0/1684108610 wait complete. 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f853cdbf640 1 Processor -- start 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f853cdbf640 1 -- start start 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f853cdbf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85380fba60 0x7f853810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f853cdbf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85380fc3b0 0x7f853810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f853cdbf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853810dc10 con 0x7f85380fc3b0 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f853cdbf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853810e430 con 0x7f85380fba60 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f8535d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85380fc3b0 0x7f853810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f8535d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85380fc3b0 0x7f853810d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39178/0 (socket says 172.21.15.119:39178) 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f8535d9b640 1 -- 172.21.15.119:0/3299393294 learned_addr learned my addr 172.21.15.119:0/3299393294 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f853659c640 1 --2- 172.21.15.119:0/3299393294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85380fba60 0x7f853810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f8535d9b640 1 -- 172.21.15.119:0/3299393294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85380fba60 msgr2=0x7f853810d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f8535d9b640 1 --2- 172.21.15.119:0/3299393294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85380fba60 0x7f853810d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f8535d9b640 1 -- 172.21.15.119:0/3299393294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c005040 con 0x7f85380fc3b0 2024-09-13T21:49:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.901+0000 7f8535d9b640 1 --2- 172.21.15.119:0/3299393294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85380fc3b0 0x7f853810d5c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f852c0043d0 tx=0x7f852c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.902+0000 7f8526ffd640 1 -- 172.21.15.119:0/3299393294 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f852c038070 con 0x7f85380fc3b0 2024-09-13T21:49:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.902+0000 7f853cdbf640 1 -- 172.21.15.119:0/3299393294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853810e660 con 0x7f85380fc3b0 2024-09-13T21:49:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.902+0000 7f8526ffd640 1 -- 172.21.15.119:0/3299393294 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f852c02ae90 con 0x7f85380fc3b0 2024-09-13T21:49:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.902+0000 7f8526ffd640 1 -- 172.21.15.119:0/3299393294 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f852c03e670 con 0x7f85380fc3b0 2024-09-13T21:49:37.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.902+0000 7f853cdbf640 1 -- 172.21.15.119:0/3299393294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853810eb80 con 0x7f85380fc3b0 2024-09-13T21:49:37.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.903+0000 7f853cdbf640 1 -- 172.21.15.119:0/3299393294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85380fa050 con 0x7f85380fc3b0 2024-09-13T21:49:37.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.903+0000 7f8526ffd640 1 -- 172.21.15.119:0/3299393294 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f852c030020 con 0x7f85380fc3b0 2024-09-13T21:49:37.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.904+0000 7f8526ffd640 1 --2- 172.21.15.119:0/3299393294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f852006e530 0x7f85200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:37.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.904+0000 7f8526ffd640 1 -- 172.21.15.119:0/3299393294 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f852c0ae320 con 0x7f85380fc3b0 2024-09-13T21:49:37.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.904+0000 7f853659c640 1 --2- 172.21.15.119:0/3299393294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f852006e530 0x7f85200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:37.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.904+0000 7f853659c640 1 --2- 172.21.15.119:0/3299393294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f852006e530 0x7f85200709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8528009fd0 tx=0x7f852800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:37.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:37.908+0000 7f8526ffd640 1 -- 172.21.15.119:0/3299393294 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f852c077510 con 0x7f85380fc3b0 2024-09-13T21:49:38.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.106+0000 7f853cdbf640 1 -- 172.21.15.119:0/3299393294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8538103fc0 con 0x7f85380fc3b0 2024-09-13T21:49:38.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.106+0000 7f8526ffd640 1 -- 172.21.15.119:0/3299393294 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1943 (secure 0 0 0) 0x7f852c07abd0 con 0x7f85380fc3b0 2024-09-13T21:49:38.108 INFO:teuthology.orchestra.run.smithi119.stdout:e22 2024-09-13T21:49:38.108 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:48:12:719560+0000 2024-09-13T21:49:38.109 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:49:38.109 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:49:38.109 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:49:38.109 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:49:38.109 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:49:38.109 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:49:38.110 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 22 2024-09-13T21:49:38.110 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:49:38.110 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:49:38.110 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:48:12.175306+0000 2024-09-13T21:49:38.110 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:49:38.111 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:49:38.111 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:49:38.111 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:49:38.111 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:49:38.111 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:49:38.111 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:49:38.111 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:49:38.112 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:49:38.112 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:49:38.112 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:49:38.112 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:49:38.112 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:49:38.113 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:49:38.113 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:49:38.113 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:49:38.113 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:49:38.113 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:49:38.113 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:49:38.114 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:49:38.114 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:49:38.114 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:49:38.114 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 14472 members: 24267,14472 2024-09-13T21:49:38.114 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:49:38.114 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:49:38.115 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:49:38.115 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:49:38.115 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:49:38.115 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:49:38.115 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:49:38.115 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:49:38.117 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 22 2024-09-13T21:49:38.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.108+0000 7f853cdbf640 1 -- 172.21.15.119:0/3299393294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f852006e530 msgr2=0x7f85200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:38.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.108+0000 7f853cdbf640 1 --2- 172.21.15.119:0/3299393294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f852006e530 0x7f85200709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8528009fd0 tx=0x7f852800b040 comp rx=0 tx=0).stop 2024-09-13T21:49:38.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.108+0000 7f853cdbf640 1 -- 172.21.15.119:0/3299393294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85380fc3b0 msgr2=0x7f853810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:38.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.108+0000 7f853cdbf640 1 --2- 172.21.15.119:0/3299393294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85380fc3b0 0x7f853810d5c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f852c0043d0 tx=0x7f852c009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.108+0000 7f853cdbf640 1 -- 172.21.15.119:0/3299393294 shutdown_connections 2024-09-13T21:49:38.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.108+0000 7f853cdbf640 1 --2- 172.21.15.119:0/3299393294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f852006e530 0x7f85200709e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.108+0000 7f853cdbf640 1 --2- 172.21.15.119:0/3299393294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85380fc3b0 0x7f853810d5c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.108+0000 7f853cdbf640 1 --2- 172.21.15.119:0/3299393294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85380fba60 0x7f853810d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.108+0000 7f853cdbf640 1 -- 172.21.15.119:0/3299393294 >> 172.21.15.119:0/3299393294 conn(0x7f85380f63b0 msgr2=0x7f85380fad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:38.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.108+0000 7f853cdbf640 1 -- 172.21.15.119:0/3299393294 shutdown_connections 2024-09-13T21:49:38.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.108+0000 7f853cdbf640 1 -- 172.21.15.119:0/3299393294 wait complete. 2024-09-13T21:49:38.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.191+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/646084360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc40ff740 msgr2=0x7f4cc4101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:38.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.191+0000 7f4cc8f8b640 1 --2- 172.21.15.119:0/646084360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc40ff740 0x7f4cc4101b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009c50 tx=0x7f4cac004d10 comp rx=0 tx=0).stop 2024-09-13T21:49:38.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.191+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/646084360 shutdown_connections 2024-09-13T21:49:38.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.191+0000 7f4cc8f8b640 1 --2- 172.21.15.119:0/646084360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc40ff740 0x7f4cc4101b20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.191+0000 7f4cc8f8b640 1 --2- 172.21.15.119:0/646084360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cc4065b80 0x7f4cc40ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.191+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/646084360 >> 172.21.15.119:0/646084360 conn(0x7f4cc40f6c10 msgr2=0x7f4cc40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:38.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.191+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/646084360 shutdown_connections 2024-09-13T21:49:38.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.191+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/646084360 wait complete. 2024-09-13T21:49:38.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.191+0000 7f4cc8f8b640 1 Processor -- start 2024-09-13T21:49:38.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.191+0000 7f4cc8f8b640 1 -- start start 2024-09-13T21:49:38.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc8f8b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc4065b80 0x7f4cc410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:38.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc8f8b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cc40ff740 0x7f4cc410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:38.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc8f8b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc410dc20 con 0x7f4cc4065b80 2024-09-13T21:49:38.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc8f8b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc410e3f0 con 0x7f4cc40ff740 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc4065b80 0x7f4cc410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc4065b80 0x7f4cc410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39190/0 (socket says 172.21.15.119:39190) 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc259c640 1 -- 172.21.15.119:0/3107234074 learned_addr learned my addr 172.21.15.119:0/3107234074 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc1d9b640 1 --2- 172.21.15.119:0/3107234074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cc40ff740 0x7f4cc410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc259c640 1 -- 172.21.15.119:0/3107234074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cc40ff740 msgr2=0x7f4cc410d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc259c640 1 --2- 172.21.15.119:0/3107234074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cc40ff740 0x7f4cc410d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc259c640 1 -- 172.21.15.119:0/3107234074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac0098b0 con 0x7f4cc4065b80 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.192+0000 7f4cc259c640 1 --2- 172.21.15.119:0/3107234074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc4065b80 0x7f4cc410d090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc002a80 tx=0x7f4cbc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.193+0000 7f4cbaffd640 1 -- 172.21.15.119:0/3107234074 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cbc007c30 con 0x7f4cc4065b80 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.193+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/3107234074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc410e680 con 0x7f4cc4065b80 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.193+0000 7f4cbaffd640 1 -- 172.21.15.119:0/3107234074 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4cbc00f040 con 0x7f4cc4065b80 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.193+0000 7f4cbaffd640 1 -- 172.21.15.119:0/3107234074 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cbc009580 con 0x7f4cc4065b80 2024-09-13T21:49:38.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.193+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/3107234074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc410ec20 con 0x7f4cc4065b80 2024-09-13T21:49:38.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.194+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/3107234074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc40fa890 con 0x7f4cc4065b80 2024-09-13T21:49:38.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.195+0000 7f4cbaffd640 1 -- 172.21.15.119:0/3107234074 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4cbc00d6b0 con 0x7f4cc4065b80 2024-09-13T21:49:38.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.196+0000 7f4cbaffd640 1 --2- 172.21.15.119:0/3107234074 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4cb006e530 0x7f4cb00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:38.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.196+0000 7f4cbaffd640 1 -- 172.21.15.119:0/3107234074 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f4cbc08e760 con 0x7f4cc4065b80 2024-09-13T21:49:38.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.196+0000 7f4cc1d9b640 1 --2- 172.21.15.119:0/3107234074 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4cb006e530 0x7f4cb00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:38.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.196+0000 7f4cc1d9b640 1 --2- 172.21.15.119:0/3107234074 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4cb006e530 0x7f4cb00709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4cac004a30 tx=0x7f4cac004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:38.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.203+0000 7f4cbaffd640 1 -- 172.21.15.119:0/3107234074 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4cbc0579d0 con 0x7f4cc4065b80 2024-09-13T21:49:38.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.386+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/3107234074 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cc410f040 con 0x7f4cb006e530 2024-09-13T21:49:38.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.388+0000 7f4cbaffd640 1 -- 172.21.15.119:0/3107234074 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4cc410f040 con 0x7f4cb006e530 2024-09-13T21:49:38.389 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:49:38.389 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:49:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:49:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:49:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:49:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "crash", 2024-09-13T21:49:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr", 2024-09-13T21:49:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: "mon" 2024-09-13T21:49:38.390 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:49:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "9/21 daemons upgraded", 2024-09-13T21:49:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:49:38.391 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:49:38.391 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:49:38.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.390+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/3107234074 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4cb006e530 msgr2=0x7f4cb00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:38.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.390+0000 7f4cc8f8b640 1 --2- 172.21.15.119:0/3107234074 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4cb006e530 0x7f4cb00709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4cac004a30 tx=0x7f4cac004d10 comp rx=0 tx=0).stop 2024-09-13T21:49:38.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.390+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/3107234074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc4065b80 msgr2=0x7f4cc410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:38.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.390+0000 7f4cc8f8b640 1 --2- 172.21.15.119:0/3107234074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc4065b80 0x7f4cc410d090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc002a80 tx=0x7f4cbc004570 comp rx=0 tx=0).stop 2024-09-13T21:49:38.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.390+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/3107234074 shutdown_connections 2024-09-13T21:49:38.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.390+0000 7f4cc8f8b640 1 --2- 172.21.15.119:0/3107234074 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4cb006e530 0x7f4cb00709e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.390+0000 7f4cc8f8b640 1 --2- 172.21.15.119:0/3107234074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cc40ff740 0x7f4cc410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.390+0000 7f4cc8f8b640 1 --2- 172.21.15.119:0/3107234074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cc4065b80 0x7f4cc410d090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.390+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/3107234074 >> 172.21.15.119:0/3107234074 conn(0x7f4cc40f6c10 msgr2=0x7f4cc40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:38.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.390+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/3107234074 shutdown_connections 2024-09-13T21:49:38.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.390+0000 7f4cc8f8b640 1 -- 172.21.15.119:0/3107234074 wait complete. 2024-09-13T21:49:38.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.468+0000 7f105056c640 1 -- 172.21.15.119:0/3477955639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10480fb450 msgr2=0x7f10480fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:38.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.468+0000 7f105056c640 1 --2- 172.21.15.119:0/3477955639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10480fb450 0x7f10480fb860 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f10440048d0 tx=0x7f1044009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.468+0000 7f105056c640 1 -- 172.21.15.119:0/3477955639 shutdown_connections 2024-09-13T21:49:38.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.468+0000 7f105056c640 1 --2- 172.21.15.119:0/3477955639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10480fc720 0x7f10480fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.468+0000 7f105056c640 1 --2- 172.21.15.119:0/3477955639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10480fb450 0x7f10480fb860 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.468+0000 7f105056c640 1 -- 172.21.15.119:0/3477955639 >> 172.21.15.119:0/3477955639 conn(0x7f10480f6c10 msgr2=0x7f10480f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:38.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.468+0000 7f105056c640 1 -- 172.21.15.119:0/3477955639 shutdown_connections 2024-09-13T21:49:38.471 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:38 smithi119 ceph-mon[90896]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:38.471 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:38 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:38.471 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:38 smithi119 ceph-mon[90896]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:38.471 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:38 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3725268199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:38.471 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:38 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3299393294' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:49:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.468+0000 7f105056c640 1 -- 172.21.15.119:0/3477955639 wait complete. 2024-09-13T21:49:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f105056c640 1 Processor -- start 2024-09-13T21:49:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f105056c640 1 -- start start 2024-09-13T21:49:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f105056c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10480fb450 0x7f104810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f105056c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10480fc720 0x7f104810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f105056c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104810dc40 con 0x7f10480fb450 2024-09-13T21:49:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f105056c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104810e460 con 0x7f10480fc720 2024-09-13T21:49:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f104e308640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10480fb450 0x7f104810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f104e308640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10480fb450 0x7f104810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39212/0 (socket says 172.21.15.119:39212) 2024-09-13T21:49:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f104e308640 1 -- 172.21.15.119:0/1975280595 learned_addr learned my addr 172.21.15.119:0/1975280595 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:49:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f104db07640 1 --2- 172.21.15.119:0/1975280595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10480fc720 0x7f104810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f104e308640 1 -- 172.21.15.119:0/1975280595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10480fc720 msgr2=0x7f104810d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f104e308640 1 --2- 172.21.15.119:0/1975280595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10480fc720 0x7f104810d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.469+0000 7f104e308640 1 -- 172.21.15.119:0/1975280595 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1044005040 con 0x7f10480fb450 2024-09-13T21:49:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.470+0000 7f104e308640 1 --2- 172.21.15.119:0/1975280595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10480fb450 0x7f104810d0b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10440043d0 tx=0x7f1044009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.470+0000 7f103effd640 1 -- 172.21.15.119:0/1975280595 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1044038070 con 0x7f10480fb450 2024-09-13T21:49:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.470+0000 7f105056c640 1 -- 172.21.15.119:0/1975280595 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104810e690 con 0x7f10480fb450 2024-09-13T21:49:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.470+0000 7f103effd640 1 -- 172.21.15.119:0/1975280595 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f104402ae90 con 0x7f10480fb450 2024-09-13T21:49:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.470+0000 7f103effd640 1 -- 172.21.15.119:0/1975280595 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f104403e670 con 0x7f10480fb450 2024-09-13T21:49:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.470+0000 7f105056c640 1 -- 172.21.15.119:0/1975280595 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104810ec30 con 0x7f10480fb450 2024-09-13T21:49:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.471+0000 7f105056c640 1 -- 172.21.15.119:0/1975280595 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10480fa8b0 con 0x7f10480fb450 2024-09-13T21:49:38.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.472+0000 7f103effd640 1 -- 172.21.15.119:0/1975280595 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1044030020 con 0x7f10480fb450 2024-09-13T21:49:38.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.473+0000 7f103effd640 1 --2- 172.21.15.119:0/1975280595 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f103406e530 0x7f10340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:49:38.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.473+0000 7f103effd640 1 -- 172.21.15.119:0/1975280595 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f10440ae2c0 con 0x7f10480fb450 2024-09-13T21:49:38.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.473+0000 7f104db07640 1 --2- 172.21.15.119:0/1975280595 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f103406e530 0x7f10340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:49:38.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.473+0000 7f104db07640 1 --2- 172.21.15.119:0/1975280595 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f103406e530 0x7f10340709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f104810ce60 tx=0x7f103800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:49:38.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.477+0000 7f103effd640 1 -- 172.21.15.119:0/1975280595 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f10440774b0 con 0x7f10480fb450 2024-09-13T21:49:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:38 smithi155 ceph-mon[79928]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:38 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:38 smithi155 ceph-mon[79928]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:38 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3725268199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:38 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3299393294' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:49:38.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.709+0000 7f105056c640 1 -- 172.21.15.119:0/1975280595 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f104804b720 con 0x7f10480fb450 2024-09-13T21:49:38.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.710+0000 7f103effd640 1 -- 172.21.15.119:0/1975280595 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f104407ab70 con 0x7f10480fb450 2024-09-13T21:49:38.711 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:49:38.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.711+0000 7f105056c640 1 -- 172.21.15.119:0/1975280595 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f103406e530 msgr2=0x7f10340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:38.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.711+0000 7f105056c640 1 --2- 172.21.15.119:0/1975280595 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f103406e530 0x7f10340709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f104810ce60 tx=0x7f103800b040 comp rx=0 tx=0).stop 2024-09-13T21:49:38.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.711+0000 7f105056c640 1 -- 172.21.15.119:0/1975280595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10480fb450 msgr2=0x7f104810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:49:38.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.711+0000 7f105056c640 1 --2- 172.21.15.119:0/1975280595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10480fb450 0x7f104810d0b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10440043d0 tx=0x7f1044009da0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.712+0000 7f105056c640 1 -- 172.21.15.119:0/1975280595 shutdown_connections 2024-09-13T21:49:38.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.712+0000 7f105056c640 1 --2- 172.21.15.119:0/1975280595 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f103406e530 0x7f10340709e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.712+0000 7f105056c640 1 --2- 172.21.15.119:0/1975280595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10480fc720 0x7f104810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.712+0000 7f105056c640 1 --2- 172.21.15.119:0/1975280595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10480fb450 0x7f104810d0b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:49:38.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.712+0000 7f105056c640 1 -- 172.21.15.119:0/1975280595 >> 172.21.15.119:0/1975280595 conn(0x7f10480f6c10 msgr2=0x7f1048066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:49:38.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.712+0000 7f105056c640 1 -- 172.21.15.119:0/1975280595 shutdown_connections 2024-09-13T21:49:38.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:49:38.712+0000 7f105056c640 1 -- 172.21.15.119:0/1975280595 wait complete. 2024-09-13T21:49:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:39 smithi155 ceph-mon[79928]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:39 smithi155 ceph-mon[79928]: pgmap v101: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:39 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1975280595' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:49:39.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:39 smithi119 ceph-mon[90896]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:39.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:39 smithi119 ceph-mon[90896]: pgmap v101: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:39.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:39 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1975280595' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:49:40.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:40 smithi155 ceph-mon[79928]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:40.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:40 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:49:40.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:40 smithi119 ceph-mon[90896]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:49:40.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:40 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:49:41.492 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:41 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:49:41.492 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:41 smithi155 ceph-mon[79928]: Upgrade: osd.3 is safe to restart 2024-09-13T21:49:41.492 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:41 smithi155 ceph-mon[79928]: pgmap v102: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:41.492 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:41 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:41.492 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:41 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:49:41.492 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:41 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:41.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:41 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T21:49:41.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:41 smithi119 ceph-mon[90896]: Upgrade: osd.3 is safe to restart 2024-09-13T21:49:41.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:41 smithi119 ceph-mon[90896]: pgmap v102: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:41.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:41 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:41.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:41 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T21:49:41.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:41 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:42.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:42 smithi155 ceph-mon[79928]: Upgrade: Updating osd.3 2024-09-13T21:49:42.542 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:42 smithi155 ceph-mon[79928]: Deploying daemon osd.3 on smithi155 2024-09-13T21:49:42.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:42 smithi119 ceph-mon[90896]: Upgrade: Updating osd.3 2024-09-13T21:49:42.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:42 smithi119 ceph-mon[90896]: Deploying daemon osd.3 on smithi155 2024-09-13T21:49:43.388 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:43 smithi155 ceph-mon[79928]: pgmap v103: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:43.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:43 smithi119 ceph-mon[90896]: pgmap v103: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:43.998 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:43 smithi155 systemd[1]: Stopping Ceph osd.3 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:49:44.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:44 smithi155 ceph-mon[79928]: osd.3 marked itself down and dead 2024-09-13T21:49:44.333 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:44 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[40092]: 2024-09-13T21:49:44.034+0000 7f47e72ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:49:44.333 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:44 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[40092]: 2024-09-13T21:49:44.034+0000 7f47e72ce640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-13T21:49:44.333 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:44 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[40092]: 2024-09-13T21:49:44.034+0000 7f47e72ce640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:49:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:44 smithi119 ceph-mon[90896]: osd.3 marked itself down and dead 2024-09-13T21:49:44.943 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:44 smithi155 podman[88714]: 2024-09-13 21:49:44.645571733 +0000 UTC m=+0.747199631 container died b83274b94224996904cfa70c0777290836307e00932ecad0e65b3a44e0c6b89a (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=quincy-eb16b97) 2024-09-13T21:49:45.235 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:45 smithi155 podman[88714]: 2024-09-13 21:49:45.054012083 +0000 UTC m=+1.155639977 container cleanup b83274b94224996904cfa70c0777290836307e00932ecad0e65b3a44e0c6b89a (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3, RELEASE=quincy-eb16b97, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T21:49:45.235 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:45 smithi155 bash[88714]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3 2024-09-13T21:49:45.583 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:45 smithi155 podman[88742]: 2024-09-13 21:49:45.259670448 +0000 UTC m=+0.610616270 container remove b83274b94224996904cfa70c0777290836307e00932ecad0e65b3a44e0c6b89a (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=quincy-eb16b97, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:49:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:45 smithi155 ceph-mon[79928]: pgmap v104: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:45 smithi155 ceph-mon[79928]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:49:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:45 smithi155 ceph-mon[79928]: osdmap e63: 6 total, 5 up, 6 in 2024-09-13T21:49:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:45 smithi119 ceph-mon[90896]: pgmap v104: 65 pgs: 65 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:45 smithi119 ceph-mon[90896]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:49:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:45 smithi119 ceph-mon[90896]: osdmap e63: 6 total, 5 up, 6 in 2024-09-13T21:49:45.938 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:45 smithi155 podman[88826]: 2024-09-13 21:49:45.566324062 +0000 UTC m=+0.016358541 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:49:45.939 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:45 smithi155 podman[88826]: 2024-09-13 21:49:45.685748009 +0000 UTC m=+0.135782472 container create 221bfe88f6af9d9df20b1d2990323fd27c7ac955551a8823fd18c5426ee60017 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T21:49:45.939 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:45 smithi155 podman[88826]: 2024-09-13 21:49:45.938205644 +0000 UTC m=+0.388240107 container init 221bfe88f6af9d9df20b1d2990323fd27c7ac955551a8823fd18c5426ee60017 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_CLEAN=True) 2024-09-13T21:49:46.240 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:45 smithi155 podman[88826]: 2024-09-13 21:49:45.941646075 +0000 UTC m=+0.391680541 container start 221bfe88f6af9d9df20b1d2990323fd27c7ac955551a8823fd18c5426ee60017 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:49:46.240 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:46 smithi155 podman[88826]: 2024-09-13 21:49:46.021541117 +0000 UTC m=+0.471575593 container attach 221bfe88f6af9d9df20b1d2990323fd27c7ac955551a8823fd18c5426ee60017 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:49:46.240 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:46 smithi155 podman[88826]: 2024-09-13 21:49:46.126218555 +0000 UTC m=+0.576253021 container died 221bfe88f6af9d9df20b1d2990323fd27c7ac955551a8823fd18c5426ee60017 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0) 2024-09-13T21:49:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:46 smithi155 ceph-mon[79928]: osdmap e64: 6 total, 5 up, 6 in 2024-09-13T21:49:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:46 smithi119 ceph-mon[90896]: osdmap e64: 6 total, 5 up, 6 in 2024-09-13T21:49:47.083 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:46 smithi155 podman[88849]: 2024-09-13 21:49:46.741769243 +0000 UTC m=+0.605249546 container remove 221bfe88f6af9d9df20b1d2990323fd27c7ac955551a8823fd18c5426ee60017 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T21:49:47.083 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:46 smithi155 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-13T21:49:47.083 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:46 smithi155 systemd[1]: Stopped Ceph osd.3 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:49:47.083 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:46 smithi155 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 12.980s CPU time. 2024-09-13T21:49:47.084 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:46 smithi155 systemd[1]: Starting Ceph osd.3 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:49:47.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:47 smithi155 ceph-mon[79928]: pgmap v107: 65 pgs: 16 peering, 11 stale+active+clean, 38 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:47.488 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:47 smithi155 ceph-mon[79928]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-09-13T21:49:47.488 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:47 smithi155 podman[88951]: 2024-09-13 21:49:47.072876588 +0000 UTC m=+0.015694546 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:49:47.488 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:47 smithi155 podman[88951]: 2024-09-13 21:49:47.193056687 +0000 UTC m=+0.135874632 container create 74b883717a2beb2af28c01d1ff21315ad516f62cf2d4777c7b1b6c4368cfc439 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T21:49:47.488 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:47 smithi155 podman[88951]: 2024-09-13 21:49:47.387151074 +0000 UTC m=+0.329969022 container init 74b883717a2beb2af28c01d1ff21315ad516f62cf2d4777c7b1b6c4368cfc439 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:49:47.488 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:47 smithi155 podman[88951]: 2024-09-13 21:49:47.390482643 +0000 UTC m=+0.333300595 container start 74b883717a2beb2af28c01d1ff21315ad516f62cf2d4777c7b1b6c4368cfc439 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:49:47.488 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:47 smithi155 podman[88951]: 2024-09-13 21:49:47.487111135 +0000 UTC m=+0.429929093 container attach 74b883717a2beb2af28c01d1ff21315ad516f62cf2d4777c7b1b6c4368cfc439 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T21:49:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:47 smithi119 ceph-mon[90896]: pgmap v107: 65 pgs: 16 peering, 11 stale+active+clean, 38 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:49:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:47 smithi119 ceph-mon[90896]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-09-13T21:49:47.833 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:47 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate[88967]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:49:47.833 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:47 smithi155 bash[88951]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:49:47.833 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:47 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate[88967]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:49:47.833 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:47 smithi155 bash[88951]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:49:48.541 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:48 smithi155 ceph-mon[79928]: Health check failed: Degraded data redundancy: 38/318 objects degraded (11.950%), 9 pgs degraded (PG_DEGRADED) 2024-09-13T21:49:48.542 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate[88967]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T21:49:48.542 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 bash[88951]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T21:49:48.542 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate[88967]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T21:49:48.542 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 bash[88951]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T21:49:48.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:48 smithi119 ceph-mon[90896]: Health check failed: Degraded data redundancy: 38/318 objects degraded (11.950%), 9 pgs degraded (PG_DEGRADED) 2024-09-13T21:49:48.833 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate[88967]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T21:49:48.833 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 bash[88951]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T21:49:48.833 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate[88967]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T21:49:48.833 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 bash[88951]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T21:49:48.833 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate[88967]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T21:49:48.834 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 bash[88951]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T21:49:48.834 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate[88967]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T21:49:48.834 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 bash[88951]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T21:49:48.834 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate[88967]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T21:49:48.834 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 bash[88951]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T21:49:48.834 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:48 smithi155 podman[88951]: 2024-09-13 21:49:48.569482903 +0000 UTC m=+1.512300857 container died 74b883717a2beb2af28c01d1ff21315ad516f62cf2d4777c7b1b6c4368cfc439 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T21:49:49.398 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:49 smithi119 ceph-mon[90896]: pgmap v108: 65 pgs: 9 active+undersized, 16 peering, 1 stale+active+clean, 9 active+undersized+degraded, 30 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:49.540 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:49 smithi155 ceph-mon[79928]: pgmap v108: 65 pgs: 9 active+undersized, 16 peering, 1 stale+active+clean, 9 active+undersized+degraded, 30 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 38/318 objects degraded (11.950%) 2024-09-13T21:49:49.540 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:49 smithi155 podman[89106]: 2024-09-13 21:49:49.215575169 +0000 UTC m=+0.639245784 container remove 74b883717a2beb2af28c01d1ff21315ad516f62cf2d4777c7b1b6c4368cfc439 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T21:49:49.540 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:49 smithi155 podman[89166]: 2024-09-13 21:49:49.324563303 +0000 UTC m=+0.016374204 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:49:49.540 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:49 smithi155 podman[89166]: 2024-09-13 21:49:49.433028524 +0000 UTC m=+0.124839421 container create 5a7f5a9c1c4de5818459a1c47958c9d76593c0dbeba95e3e78c348d71466e813 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T21:49:50.083 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:49 smithi155 podman[89166]: 2024-09-13 21:49:49.661981442 +0000 UTC m=+0.353792340 container init 5a7f5a9c1c4de5818459a1c47958c9d76593c0dbeba95e3e78c348d71466e813 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T21:49:50.083 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:49 smithi155 podman[89166]: 2024-09-13 21:49:49.665201851 +0000 UTC m=+0.357012752 container start 5a7f5a9c1c4de5818459a1c47958c9d76593c0dbeba95e3e78c348d71466e813 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T21:49:50.083 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:49 smithi155 ceph-osd[89185]: -- 172.21.15.155:0/979995178 <== mon.1 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ee9c161e0 con 0x556ee8dbfc00 2024-09-13T21:49:50.083 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:49 smithi155 bash[89166]: 5a7f5a9c1c4de5818459a1c47958c9d76593c0dbeba95e3e78c348d71466e813 2024-09-13T21:49:50.084 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:49 smithi155 systemd[1]: Started Ceph osd.3 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:49:51.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:51.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:51.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:50 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:51.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:50 smithi155 ceph-mon[79928]: pgmap v109: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/318 objects degraded (20.755%) 2024-09-13T21:49:51.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:51.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:51.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:50 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:51.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:50 smithi119 ceph-mon[90896]: pgmap v109: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/318 objects degraded (20.755%) 2024-09-13T21:49:51.583 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:51 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[89181]: 2024-09-13T21:49:51.312+0000 7faf37c40640 -1 Falling back to public interface 2024-09-13T21:49:52.071 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:51 smithi155 ceph-mon[79928]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-13T21:49:52.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:51 smithi119 ceph-mon[90896]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-13T21:49:53.493 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:53 smithi155 ceph-mon[79928]: pgmap v110: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/318 objects degraded (20.755%) 2024-09-13T21:49:53.493 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:53.493 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:53.493 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:53.493 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:53.493 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:53.493 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:53.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:53 smithi119 ceph-mon[90896]: pgmap v110: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/318 objects degraded (20.755%) 2024-09-13T21:49:53.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:53.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:49:53.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:53.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:53.507 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:53.507 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:55.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:55 smithi155 ceph-mon[79928]: pgmap v111: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/318 objects degraded (20.755%) 2024-09-13T21:49:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:55 smithi119 ceph-mon[90896]: pgmap v111: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/318 objects degraded (20.755%) 2024-09-13T21:49:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:56 smithi155 ceph-mon[79928]: Health check update: Degraded data redundancy: 66/318 objects degraded (20.755%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T21:49:56.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:56 smithi119 ceph-mon[90896]: Health check update: Degraded data redundancy: 66/318 objects degraded (20.755%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T21:49:57.441 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/318 objects degraded (20.755%) 2024-09-13T21:49:57.441 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:57.441 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:57.441 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:57.441 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:57.442 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:57.442 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:57.442 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:57.442 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:57.442 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:57.442 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:49:57.442 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:49:57.442 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-mon[79928]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T21:49:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/318 objects degraded (20.755%) 2024-09-13T21:49:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:49:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:49:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:49:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:49:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:57.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:49:57.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:49:57.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:49:57.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:57 smithi119 ceph-mon[90896]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T21:49:57.833 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:57 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[89181]: 2024-09-13T21:49:57.439+0000 7faf37c40640 -1 osd.3 62 log_to_monitors true 2024-09-13T21:49:58.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:58 smithi155 ceph-mon[79928]: from='osd.3 [v2:172.21.15.155:6800/4151153939,v1:172.21.15.155:6801/4151153939]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:49:58.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:58 smithi155 ceph-mon[79928]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:49:58.583 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 21:49:58 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[89181]: 2024-09-13T21:49:58.196+0000 7faf2f9da640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:49:58.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:58 smithi119 ceph-mon[90896]: from='osd.3 [v2:172.21.15.155:6800/4151153939,v1:172.21.15.155:6801/4151153939]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:49:58.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:58 smithi119 ceph-mon[90896]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T21:49:59.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:59 smithi155 ceph-mon[79928]: pgmap v113: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/318 objects degraded (20.755%) 2024-09-13T21:49:59.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:59 smithi155 ceph-mon[79928]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T21:49:59.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:59 smithi155 ceph-mon[79928]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T21:49:59.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:59 smithi155 ceph-mon[79928]: from='osd.3 [v2:172.21.15.155:6800/4151153939,v1:172.21.15.155:6801/4151153939]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:49:59.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:49:59 smithi155 ceph-mon[79928]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:49:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:59 smithi119 ceph-mon[90896]: pgmap v113: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/318 objects degraded (20.755%) 2024-09-13T21:49:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:59 smithi119 ceph-mon[90896]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T21:49:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:59 smithi119 ceph-mon[90896]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T21:49:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:59 smithi119 ceph-mon[90896]: from='osd.3 [v2:172.21.15.155:6800/4151153939,v1:172.21.15.155:6801/4151153939]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:49:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:49:59 smithi119 ceph-mon[90896]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:50:00.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:50:00.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: osd.3 [v2:172.21.15.155:6800/4151153939,v1:172.21.15.155:6801/4151153939] boot 2024-09-13T21:50:00.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: osdmap e66: 6 total, 6 up, 6 in 2024-09-13T21:50:00.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:50:00.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: Health detail: HEALTH_WARN Degraded data redundancy: 66/318 objects degraded (20.755%), 19 pgs degraded 2024-09-13T21:50:00.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: [WRN] PG_DEGRADED: Degraded data redundancy: 66/318 objects degraded (20.755%), 19 pgs degraded 2024-09-13T21:50:00.445 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.11 is active+undersized+degraded, acting [4,1] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-13T21:50:00.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-13T21:50:00.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-13T21:50:00.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-13T21:50:00.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-13T21:50:00.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-13T21:50:00.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:00 smithi119 ceph-mon[90896]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T21:50:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:50:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: osd.3 [v2:172.21.15.155:6800/4151153939,v1:172.21.15.155:6801/4151153939] boot 2024-09-13T21:50:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: osdmap e66: 6 total, 6 up, 6 in 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: Health detail: HEALTH_WARN Degraded data redundancy: 66/318 objects degraded (20.755%), 19 pgs degraded 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: [WRN] PG_DEGRADED: Degraded data redundancy: 66/318 objects degraded (20.755%), 19 pgs degraded 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-13T21:50:00.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-13T21:50:00.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.11 is active+undersized+degraded, acting [4,1] 2024-09-13T21:50:00.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-09-13T21:50:00.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-13T21:50:00.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-13T21:50:00.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-13T21:50:00.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-13T21:50:00.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-13T21:50:00.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-13T21:50:00.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-13T21:50:00.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:00 smithi155 ceph-mon[79928]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T21:50:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:01 smithi155 ceph-mon[79928]: pgmap v116: 65 pgs: 11 peering, 13 active+undersized, 14 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51/318 objects degraded (16.038%) 2024-09-13T21:50:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:01 smithi155 ceph-mon[79928]: Health check update: Degraded data redundancy: 51/318 objects degraded (16.038%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T21:50:01.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:01 smithi119 ceph-mon[90896]: pgmap v116: 65 pgs: 11 peering, 13 active+undersized, 14 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51/318 objects degraded (16.038%) 2024-09-13T21:50:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:01 smithi119 ceph-mon[90896]: Health check update: Degraded data redundancy: 51/318 objects degraded (16.038%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T21:50:03.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:03 smithi119 ceph-mon[90896]: pgmap v118: 65 pgs: 11 peering, 13 active+undersized, 14 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51/318 objects degraded (16.038%) 2024-09-13T21:50:03.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:03 smithi155 ceph-mon[79928]: pgmap v118: 65 pgs: 11 peering, 13 active+undersized, 14 active+undersized+degraded, 27 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51/318 objects degraded (16.038%) 2024-09-13T21:50:04.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:04 smithi155 ceph-mon[79928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 51/318 objects degraded (16.038%), 14 pgs degraded) 2024-09-13T21:50:04.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:04 smithi155 ceph-mon[79928]: Cluster is now healthy 2024-09-13T21:50:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:04 smithi119 ceph-mon[90896]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 51/318 objects degraded (16.038%), 14 pgs degraded) 2024-09-13T21:50:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:04 smithi119 ceph-mon[90896]: Cluster is now healthy 2024-09-13T21:50:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:05 smithi155 ceph-mon[79928]: pgmap v119: 65 pgs: 11 peering, 54 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:05.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:05 smithi119 ceph-mon[90896]: pgmap v119: 65 pgs: 11 peering, 54 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:07 smithi155 ceph-mon[79928]: pgmap v120: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:07.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:07 smithi119 ceph-mon[90896]: pgmap v120: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:08.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.803+0000 7f8195e15640 1 -- 172.21.15.119:0/1401183291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81900fdba0 msgr2=0x7f81900fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:08.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.803+0000 7f8195e15640 1 --2- 172.21.15.119:0/1401183291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81900fdba0 0x7f81900fdfb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f81800048d0 tx=0x7f8180009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:08.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.803+0000 7f8195e15640 1 -- 172.21.15.119:0/1401183291 shutdown_connections 2024-09-13T21:50:08.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.803+0000 7f8195e15640 1 --2- 172.21.15.119:0/1401183291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81900fe4f0 0x7f81900fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:08.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.803+0000 7f8195e15640 1 --2- 172.21.15.119:0/1401183291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81900fdba0 0x7f81900fdfb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:08.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.803+0000 7f8195e15640 1 -- 172.21.15.119:0/1401183291 >> 172.21.15.119:0/1401183291 conn(0x7f81900f63a0 msgr2=0x7f81900f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:08.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.803+0000 7f8195e15640 1 -- 172.21.15.119:0/1401183291 shutdown_connections 2024-09-13T21:50:08.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.803+0000 7f8195e15640 1 -- 172.21.15.119:0/1401183291 wait complete. 2024-09-13T21:50:08.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.803+0000 7f8195e15640 1 Processor -- start 2024-09-13T21:50:08.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.803+0000 7f8195e15640 1 -- start start 2024-09-13T21:50:08.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f8195e15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81900fdba0 0x7f819010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:08.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f8195e15640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81900fe4f0 0x7f819010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:08.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f8195e15640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819010dc20 con 0x7f81900fdba0 2024-09-13T21:50:08.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f8195e15640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819010e440 con 0x7f81900fe4f0 2024-09-13T21:50:08.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81900fdba0 0x7f819010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:08.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81900fdba0 0x7f819010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52658/0 (socket says 172.21.15.119:52658) 2024-09-13T21:50:08.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f818f7fe640 1 -- 172.21.15.119:0/1841592152 learned_addr learned my addr 172.21.15.119:0/1841592152 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:08.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f818effd640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81900fe4f0 0x7f819010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:08.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f818f7fe640 1 -- 172.21.15.119:0/1841592152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81900fe4f0 msgr2=0x7f819010d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:08.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f818f7fe640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81900fe4f0 0x7f819010d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:08.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f818f7fe640 1 -- 172.21.15.119:0/1841592152 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180005040 con 0x7f81900fdba0 2024-09-13T21:50:08.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f818effd640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81900fe4f0 0x7f819010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:50:08.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.804+0000 7f818f7fe640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81900fdba0 0x7f819010d090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81800043d0 tx=0x7f8180009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:08.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.805+0000 7f8177fff640 1 -- 172.21.15.119:0/1841592152 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8180038070 con 0x7f81900fdba0 2024-09-13T21:50:08.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.805+0000 7f8195e15640 1 -- 172.21.15.119:0/1841592152 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819010e670 con 0x7f81900fdba0 2024-09-13T21:50:08.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.805+0000 7f8177fff640 1 -- 172.21.15.119:0/1841592152 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f818002ae90 con 0x7f81900fdba0 2024-09-13T21:50:08.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.805+0000 7f8177fff640 1 -- 172.21.15.119:0/1841592152 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f818003e670 con 0x7f81900fdba0 2024-09-13T21:50:08.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.805+0000 7f8195e15640 1 -- 172.21.15.119:0/1841592152 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819010ec10 con 0x7f81900fdba0 2024-09-13T21:50:08.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.806+0000 7f8195e15640 1 -- 172.21.15.119:0/1841592152 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81900fa040 con 0x7f81900fdba0 2024-09-13T21:50:08.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.806+0000 7f8177fff640 1 -- 172.21.15.119:0/1841592152 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8180030020 con 0x7f81900fdba0 2024-09-13T21:50:08.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.807+0000 7f8177fff640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f817806e530 0x7f81780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:08.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.807+0000 7f8177fff640 1 -- 172.21.15.119:0/1841592152 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f81800ae430 con 0x7f81900fdba0 2024-09-13T21:50:08.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.807+0000 7f818effd640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f817806e530 0x7f81780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:08.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.807+0000 7f818effd640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f817806e530 0x7f81780709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f819010ce40 tx=0x7f818400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:08.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.811+0000 7f8177fff640 1 -- 172.21.15.119:0/1841592152 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8180077510 con 0x7f81900fdba0 2024-09-13T21:50:08.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.995+0000 7f8195e15640 1 -- 172.21.15.119:0/1841592152 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f819010ef40 con 0x7f817806e530 2024-09-13T21:50:08.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.996+0000 7f8177fff640 1 -- 172.21.15.119:0/1841592152 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f819010ef40 con 0x7f817806e530 2024-09-13T21:50:09.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.998+0000 7f8195e15640 1 -- 172.21.15.119:0/1841592152 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f817806e530 msgr2=0x7f81780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.998+0000 7f8195e15640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f817806e530 0x7f81780709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f819010ce40 tx=0x7f818400b040 comp rx=0 tx=0).stop 2024-09-13T21:50:09.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.998+0000 7f8195e15640 1 -- 172.21.15.119:0/1841592152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81900fdba0 msgr2=0x7f819010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.998+0000 7f8195e15640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81900fdba0 0x7f819010d090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81800043d0 tx=0x7f8180009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.998+0000 7f8195e15640 1 -- 172.21.15.119:0/1841592152 shutdown_connections 2024-09-13T21:50:09.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.998+0000 7f8195e15640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f817806e530 0x7f81780709e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.998+0000 7f8195e15640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81900fe4f0 0x7f819010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.998+0000 7f8195e15640 1 --2- 172.21.15.119:0/1841592152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81900fdba0 0x7f819010d090 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.998+0000 7f8195e15640 1 -- 172.21.15.119:0/1841592152 >> 172.21.15.119:0/1841592152 conn(0x7f81900f63a0 msgr2=0x7f81900f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:09.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.998+0000 7f8195e15640 1 -- 172.21.15.119:0/1841592152 shutdown_connections 2024-09-13T21:50:09.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:08.998+0000 7f8195e15640 1 -- 172.21.15.119:0/1841592152 wait complete. 2024-09-13T21:50:09.009 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:50:09.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.078+0000 7f85a209d640 1 -- 172.21.15.119:0/4274444595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c0fb450 msgr2=0x7f859c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.078+0000 7f85a209d640 1 --2- 172.21.15.119:0/4274444595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c0fb450 0x7f859c0fb860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f858c0048d0 tx=0x7f858c009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.078+0000 7f85a209d640 1 -- 172.21.15.119:0/4274444595 shutdown_connections 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.078+0000 7f85a209d640 1 --2- 172.21.15.119:0/4274444595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c0fc720 0x7f859c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.078+0000 7f85a209d640 1 --2- 172.21.15.119:0/4274444595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c0fb450 0x7f859c0fb860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.078+0000 7f85a209d640 1 -- 172.21.15.119:0/4274444595 >> 172.21.15.119:0/4274444595 conn(0x7f859c0f6c10 msgr2=0x7f859c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.078+0000 7f85a209d640 1 -- 172.21.15.119:0/4274444595 shutdown_connections 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.078+0000 7f85a209d640 1 -- 172.21.15.119:0/4274444595 wait complete. 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.079+0000 7f85a209d640 1 Processor -- start 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.079+0000 7f85a209d640 1 -- start start 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.079+0000 7f85a209d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c0fb450 0x7f859c10fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.079+0000 7f85a209d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c0fc720 0x7f859c112360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.079+0000 7f85a209d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c066730 con 0x7f859c0fb450 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.079+0000 7f85a209d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c0668a0 con 0x7f859c0fc720 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.079+0000 7f859b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c0fb450 0x7f859c10fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.079+0000 7f859b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c0fb450 0x7f859c10fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52690/0 (socket says 172.21.15.119:52690) 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.079+0000 7f859b7fe640 1 -- 172.21.15.119:0/2454525172 learned_addr learned my addr 172.21.15.119:0/2454525172 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.079+0000 7f859affd640 1 --2- 172.21.15.119:0/2454525172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c0fc720 0x7f859c112360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.080+0000 7f859b7fe640 1 -- 172.21.15.119:0/2454525172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c0fc720 msgr2=0x7f859c112360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.080+0000 7f859b7fe640 1 --2- 172.21.15.119:0/2454525172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c0fc720 0x7f859c112360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.080+0000 7f859b7fe640 1 -- 172.21.15.119:0/2454525172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c005040 con 0x7f859c0fb450 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.080+0000 7f859b7fe640 1 --2- 172.21.15.119:0/2454525172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c0fb450 0x7f859c10fe10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f858c000c00 tx=0x7f858c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.080+0000 7f8583fff640 1 -- 172.21.15.119:0/2454525172 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f858c038070 con 0x7f859c0fb450 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.080+0000 7f85a209d640 1 -- 172.21.15.119:0/2454525172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859c1128a0 con 0x7f859c0fb450 2024-09-13T21:50:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.080+0000 7f8583fff640 1 -- 172.21.15.119:0/2454525172 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f858c02ae90 con 0x7f859c0fb450 2024-09-13T21:50:09.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.080+0000 7f8583fff640 1 -- 172.21.15.119:0/2454525172 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f858c03d420 con 0x7f859c0fb450 2024-09-13T21:50:09.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.080+0000 7f85a209d640 1 -- 172.21.15.119:0/2454525172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859c112db0 con 0x7f859c0fb450 2024-09-13T21:50:09.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.081+0000 7f85a209d640 1 -- 172.21.15.119:0/2454525172 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859c0fa8b0 con 0x7f859c0fb450 2024-09-13T21:50:09.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.081+0000 7f8583fff640 1 -- 172.21.15.119:0/2454525172 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f858c030020 con 0x7f859c0fb450 2024-09-13T21:50:09.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.082+0000 7f8583fff640 1 --2- 172.21.15.119:0/2454525172 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f858406e530 0x7f85840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.082+0000 7f8583fff640 1 -- 172.21.15.119:0/2454525172 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f858c0ae810 con 0x7f859c0fb450 2024-09-13T21:50:09.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.082+0000 7f859affd640 1 --2- 172.21.15.119:0/2454525172 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f858406e530 0x7f85840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.082+0000 7f859affd640 1 --2- 172.21.15.119:0/2454525172 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f858406e530 0x7f85840709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f85900041d0 tx=0x7f8590009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:09.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.086+0000 7f8583fff640 1 -- 172.21.15.119:0/2454525172 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f858c0779d0 con 0x7f859c0fb450 2024-09-13T21:50:09.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.271+0000 7f85a209d640 1 -- 172.21.15.119:0/2454525172 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f859c100bd0 con 0x7f858406e530 2024-09-13T21:50:09.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.272+0000 7f8583fff640 1 -- 172.21.15.119:0/2454525172 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f859c100bd0 con 0x7f858406e530 2024-09-13T21:50:09.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.275+0000 7f85a209d640 1 -- 172.21.15.119:0/2454525172 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f858406e530 msgr2=0x7f85840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.275+0000 7f85a209d640 1 --2- 172.21.15.119:0/2454525172 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f858406e530 0x7f85840709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f85900041d0 tx=0x7f8590009040 comp rx=0 tx=0).stop 2024-09-13T21:50:09.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.275+0000 7f85a209d640 1 -- 172.21.15.119:0/2454525172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c0fb450 msgr2=0x7f859c10fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.275+0000 7f85a209d640 1 --2- 172.21.15.119:0/2454525172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c0fb450 0x7f859c10fe10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f858c000c00 tx=0x7f858c009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.275+0000 7f85a209d640 1 -- 172.21.15.119:0/2454525172 shutdown_connections 2024-09-13T21:50:09.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.275+0000 7f85a209d640 1 --2- 172.21.15.119:0/2454525172 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f858406e530 0x7f85840709e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.275+0000 7f85a209d640 1 --2- 172.21.15.119:0/2454525172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f859c0fc720 0x7f859c112360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.275+0000 7f85a209d640 1 --2- 172.21.15.119:0/2454525172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f859c0fb450 0x7f859c10fe10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.275+0000 7f85a209d640 1 -- 172.21.15.119:0/2454525172 >> 172.21.15.119:0/2454525172 conn(0x7f859c0f6c10 msgr2=0x7f859c0f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:09.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.275+0000 7f85a209d640 1 -- 172.21.15.119:0/2454525172 shutdown_connections 2024-09-13T21:50:09.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.275+0000 7f85a209d640 1 -- 172.21.15.119:0/2454525172 wait complete. 2024-09-13T21:50:09.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.353+0000 7f0ce78bf640 1 -- 172.21.15.119:0/2343175805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ce00fd7f0 msgr2=0x7f0ce00fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.353+0000 7f0ce78bf640 1 --2- 172.21.15.119:0/2343175805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ce00fd7f0 0x7f0ce00fdc60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40048d0 tx=0x7f0cd4009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 -- 172.21.15.119:0/2343175805 shutdown_connections 2024-09-13T21:50:09.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 --2- 172.21.15.119:0/2343175805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ce00fd7f0 0x7f0ce00fdc60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 --2- 172.21.15.119:0/2343175805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ce00fc520 0x7f0ce00fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 -- 172.21.15.119:0/2343175805 >> 172.21.15.119:0/2343175805 conn(0x7f0ce00f7ce0 msgr2=0x7f0ce00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:09.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 -- 172.21.15.119:0/2343175805 shutdown_connections 2024-09-13T21:50:09.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 -- 172.21.15.119:0/2343175805 wait complete. 2024-09-13T21:50:09.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 Processor -- start 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 -- start start 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ce00fc520 0x7f0ce010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ce00fd7f0 0x7f0ce010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce010dbf0 con 0x7f0ce00fc520 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce78bf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce010e410 con 0x7f0ce00fd7f0 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce565b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ce00fc520 0x7f0ce010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.354+0000 7f0ce565b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ce00fc520 0x7f0ce010d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52700/0 (socket says 172.21.15.119:52700) 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.355+0000 7f0ce565b640 1 -- 172.21.15.119:0/1442067629 learned_addr learned my addr 172.21.15.119:0/1442067629 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.355+0000 7f0ce4e5a640 1 --2- 172.21.15.119:0/1442067629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ce00fd7f0 0x7f0ce010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.355+0000 7f0ce565b640 1 -- 172.21.15.119:0/1442067629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ce00fd7f0 msgr2=0x7f0ce010d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.355+0000 7f0ce565b640 1 --2- 172.21.15.119:0/1442067629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ce00fd7f0 0x7f0ce010d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.355+0000 7f0ce565b640 1 -- 172.21.15.119:0/1442067629 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd4005040 con 0x7f0ce00fc520 2024-09-13T21:50:09.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.355+0000 7f0ce565b640 1 --2- 172.21.15.119:0/1442067629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ce00fc520 0x7f0ce010d060 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000db80 tx=0x7f0cd0004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:09.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.355+0000 7f0cddffb640 1 -- 172.21.15.119:0/1442067629 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd000b8d0 con 0x7f0ce00fc520 2024-09-13T21:50:09.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.355+0000 7f0cddffb640 1 -- 172.21.15.119:0/1442067629 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0cd000f040 con 0x7f0ce00fc520 2024-09-13T21:50:09.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.355+0000 7f0ce78bf640 1 -- 172.21.15.119:0/1442067629 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce010e6a0 con 0x7f0ce00fc520 2024-09-13T21:50:09.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.355+0000 7f0cddffb640 1 -- 172.21.15.119:0/1442067629 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd0012390 con 0x7f0ce00fc520 2024-09-13T21:50:09.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.355+0000 7f0ce78bf640 1 -- 172.21.15.119:0/1442067629 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce010ebc0 con 0x7f0ce00fc520 2024-09-13T21:50:09.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.356+0000 7f0ce78bf640 1 -- 172.21.15.119:0/1442067629 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce00fb980 con 0x7f0ce00fc520 2024-09-13T21:50:09.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.357+0000 7f0cddffb640 1 -- 172.21.15.119:0/1442067629 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0cd000ba30 con 0x7f0ce00fc520 2024-09-13T21:50:09.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.357+0000 7f0cddffb640 1 --2- 172.21.15.119:0/1442067629 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0cc806e530 0x7f0cc80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.357+0000 7f0ce4e5a640 1 --2- 172.21.15.119:0/1442067629 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0cc806e530 0x7f0cc80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.357+0000 7f0cddffb640 1 -- 172.21.15.119:0/1442067629 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0cd008dfe0 con 0x7f0ce00fc520 2024-09-13T21:50:09.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.358+0000 7f0ce4e5a640 1 --2- 172.21.15.119:0/1442067629 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0cc806e530 0x7f0cc80709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ce010ce10 tx=0x7f0cd4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:09.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.362+0000 7f0cddffb640 1 -- 172.21.15.119:0/1442067629 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0cd0057120 con 0x7f0ce00fc520 2024-09-13T21:50:09.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.536+0000 7f0ce78bf640 1 -- 172.21.15.119:0/1442067629 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ce010efb0 con 0x7f0cc806e530 2024-09-13T21:50:09.538 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:09 smithi119 ceph-mon[90896]: pgmap v121: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:09.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.545+0000 7f0cddffb640 1 -- 172.21.15.119:0/1442067629 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0ce010efb0 con 0x7f0cc806e530 2024-09-13T21:50:09.546 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:50:09.546 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (4m) 49s ago 13m 25.9M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:50:09.546 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (2m) 49s ago 13m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (2m) 17s ago 12m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (4m) 49s ago 12m 80.4M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (7m) 49s ago 7m 13.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (7m) 49s ago 7m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (7m) 17s ago 7m 16.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (7m) 17s ago 7m 110M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (4m) 49s ago 14m 498M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (3m) 17s ago 12m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (3m) 49s ago 14m 47.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (3m) 17s ago 12m 39.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (4m) 49s ago 13m 16.2M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (4m) 17s ago 12m 15.1M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:50:09.547 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (2m) 49s ago 11m 93.3M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:50:09.548 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (88s) 49s ago 11m 93.6M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 8f69bf25cd20 2024-09-13T21:50:09.548 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (54s) 49s ago 10m 11.0M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 0f73e4fc2c43 2024-09-13T21:50:09.548 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (20s) 17s ago 10m 14.3M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5a7f5a9c1c4d 2024-09-13T21:50:09.548 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (9m) 17s ago 9m 229M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 385742a74acf 2024-09-13T21:50:09.548 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (9m) 17s ago 9m 223M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:50:09.548 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (3m) 49s ago 12m 51.8M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:50:09.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.547+0000 7f0ce78bf640 1 -- 172.21.15.119:0/1442067629 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0cc806e530 msgr2=0x7f0cc80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.547+0000 7f0ce78bf640 1 --2- 172.21.15.119:0/1442067629 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0cc806e530 0x7f0cc80709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ce010ce10 tx=0x7f0cd4035040 comp rx=0 tx=0).stop 2024-09-13T21:50:09.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.547+0000 7f0ce78bf640 1 -- 172.21.15.119:0/1442067629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ce00fc520 msgr2=0x7f0ce010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.547+0000 7f0ce78bf640 1 --2- 172.21.15.119:0/1442067629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ce00fc520 0x7f0ce010d060 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000db80 tx=0x7f0cd0004f00 comp rx=0 tx=0).stop 2024-09-13T21:50:09.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.547+0000 7f0ce78bf640 1 -- 172.21.15.119:0/1442067629 shutdown_connections 2024-09-13T21:50:09.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.547+0000 7f0ce78bf640 1 --2- 172.21.15.119:0/1442067629 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0cc806e530 0x7f0cc80709e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.547+0000 7f0ce78bf640 1 --2- 172.21.15.119:0/1442067629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ce00fd7f0 0x7f0ce010d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.547+0000 7f0ce78bf640 1 --2- 172.21.15.119:0/1442067629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ce00fc520 0x7f0ce010d060 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.547+0000 7f0ce78bf640 1 -- 172.21.15.119:0/1442067629 >> 172.21.15.119:0/1442067629 conn(0x7f0ce00f7ce0 msgr2=0x7f0ce00f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:09.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.547+0000 7f0ce78bf640 1 -- 172.21.15.119:0/1442067629 shutdown_connections 2024-09-13T21:50:09.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.547+0000 7f0ce78bf640 1 -- 172.21.15.119:0/1442067629 wait complete. 2024-09-13T21:50:09.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:09 smithi155 ceph-mon[79928]: pgmap v121: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:09.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.624+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/2504014023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7f00fe500 msgr2=0x7ff7f00fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.624+0000 7ff7f4b3d640 1 --2- 172.21.15.119:0/2504014023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7f00fe500 0x7ff7f00fa660 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80048d0 tx=0x7ff7d8009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.624+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/2504014023 shutdown_connections 2024-09-13T21:50:09.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.624+0000 7ff7f4b3d640 1 --2- 172.21.15.119:0/2504014023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7f00fe500 0x7ff7f00fa660 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.624+0000 7ff7f4b3d640 1 --2- 172.21.15.119:0/2504014023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7f00fdbb0 0x7ff7f00fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.624+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/2504014023 >> 172.21.15.119:0/2504014023 conn(0x7ff7f00f63b0 msgr2=0x7ff7f00f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.624+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/2504014023 shutdown_connections 2024-09-13T21:50:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.624+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/2504014023 wait complete. 2024-09-13T21:50:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.625+0000 7ff7f4b3d640 1 Processor -- start 2024-09-13T21:50:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.625+0000 7ff7f4b3d640 1 -- start start 2024-09-13T21:50:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.625+0000 7ff7f4b3d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7f00fdbb0 0x7ff7f00fd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.625+0000 7ff7f4b3d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7f00fe500 0x7ff7f00fb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.625+0000 7ff7f4b3d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00fbe60 con 0x7ff7f00fe500 2024-09-13T21:50:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.625+0000 7ff7f4b3d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00fbfa0 con 0x7ff7f00fdbb0 2024-09-13T21:50:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.625+0000 7ff7e5d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7f00fe500 0x7ff7f00fb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.625+0000 7ff7e5d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7f00fe500 0x7ff7f00fb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52714/0 (socket says 172.21.15.119:52714) 2024-09-13T21:50:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.625+0000 7ff7e5d9b640 1 -- 172.21.15.119:0/731345083 learned_addr learned my addr 172.21.15.119:0/731345083 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.625+0000 7ff7ee59c640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7f00fdbb0 0x7ff7f00fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.625+0000 7ff7e5d9b640 1 -- 172.21.15.119:0/731345083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7f00fdbb0 msgr2=0x7ff7f00fd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.626+0000 7ff7e5d9b640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7f00fdbb0 0x7ff7f00fd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.626+0000 7ff7e5d9b640 1 -- 172.21.15.119:0/731345083 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8005040 con 0x7ff7f00fe500 2024-09-13T21:50:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.626+0000 7ff7ee59c640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7f00fdbb0 0x7ff7f00fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:50:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.626+0000 7ff7e5d9b640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7f00fe500 0x7ff7f00fb890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80048a0 tx=0x7ff7d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.626+0000 7ff7e77fe640 1 -- 172.21.15.119:0/731345083 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7d8038070 con 0x7ff7f00fe500 2024-09-13T21:50:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.626+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/731345083 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f00fc220 con 0x7ff7f00fe500 2024-09-13T21:50:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.626+0000 7ff7e77fe640 1 -- 172.21.15.119:0/731345083 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7d802abd0 con 0x7ff7f00fe500 2024-09-13T21:50:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.626+0000 7ff7e77fe640 1 -- 172.21.15.119:0/731345083 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7d8033640 con 0x7ff7f00fe500 2024-09-13T21:50:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.626+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/731345083 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f0115190 con 0x7ff7f00fe500 2024-09-13T21:50:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.627+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/731345083 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f00fa050 con 0x7ff7f00fe500 2024-09-13T21:50:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.627+0000 7ff7e77fe640 1 -- 172.21.15.119:0/731345083 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff7d8030020 con 0x7ff7f00fe500 2024-09-13T21:50:09.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.628+0000 7ff7e77fe640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff7dc06e530 0x7ff7dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.628+0000 7ff7ee59c640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff7dc06e530 0x7ff7dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.628+0000 7ff7e77fe640 1 -- 172.21.15.119:0/731345083 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff7d80ae4d0 con 0x7ff7f00fe500 2024-09-13T21:50:09.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.628+0000 7ff7ee59c640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff7dc06e530 0x7ff7dc0709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0006fd0 tx=0x7ff7e0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:09.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.632+0000 7ff7e77fe640 1 -- 172.21.15.119:0/731345083 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff7d8077610 con 0x7ff7f00fe500 2024-09-13T21:50:09.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.865+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/731345083 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff7f0105000 con 0x7ff7f00fe500 2024-09-13T21:50:09.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.865+0000 7ff7e77fe640 1 -- 172.21.15.119:0/731345083 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7ff7d807acd0 con 0x7ff7f00fe500 2024-09-13T21:50:09.867 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:50:09.867 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:50:09.867 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:50:09.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:50:09.867 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2, 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6, 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 8 2024-09-13T21:50:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:50:09.869 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:50:09.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.867+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/731345083 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff7dc06e530 msgr2=0x7ff7dc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.867+0000 7ff7f4b3d640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff7dc06e530 0x7ff7dc0709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0006fd0 tx=0x7ff7e0008040 comp rx=0 tx=0).stop 2024-09-13T21:50:09.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.867+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/731345083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7f00fe500 msgr2=0x7ff7f00fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.867+0000 7ff7f4b3d640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7f00fe500 0x7ff7f00fb890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80048a0 tx=0x7ff7d8009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.867+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/731345083 shutdown_connections 2024-09-13T21:50:09.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.867+0000 7ff7f4b3d640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff7dc06e530 0x7ff7dc0709e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.867+0000 7ff7f4b3d640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7f00fe500 0x7ff7f00fb890 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.867+0000 7ff7f4b3d640 1 --2- 172.21.15.119:0/731345083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7f00fdbb0 0x7ff7f00fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.867+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/731345083 >> 172.21.15.119:0/731345083 conn(0x7ff7f00f63b0 msgr2=0x7ff7f00f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:09.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.868+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/731345083 shutdown_connections 2024-09-13T21:50:09.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.868+0000 7ff7f4b3d640 1 -- 172.21.15.119:0/731345083 wait complete. 2024-09-13T21:50:09.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.946+0000 7f4284597640 1 -- 172.21.15.119:0/3197150233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c0666b0 msgr2=0x7f427c0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.946+0000 7f4284597640 1 --2- 172.21.15.119:0/3197150233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c0666b0 0x7f427c0ff1c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f42780048d0 tx=0x7f4278009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.946+0000 7f4284597640 1 -- 172.21.15.119:0/3197150233 shutdown_connections 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.946+0000 7f4284597640 1 --2- 172.21.15.119:0/3197150233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f427c0ff700 0x7f427c101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.946+0000 7f4284597640 1 --2- 172.21.15.119:0/3197150233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c0666b0 0x7f427c0ff1c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.946+0000 7f4284597640 1 -- 172.21.15.119:0/3197150233 >> 172.21.15.119:0/3197150233 conn(0x7f427c0f6c10 msgr2=0x7f427c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.946+0000 7f4284597640 1 -- 172.21.15.119:0/3197150233 shutdown_connections 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.946+0000 7f4284597640 1 -- 172.21.15.119:0/3197150233 wait complete. 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4284597640 1 Processor -- start 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4284597640 1 -- start start 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4284597640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c0666b0 0x7f427c10d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4284597640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f427c0ff700 0x7f427c10d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4284597640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c10dd40 con 0x7f427c0666b0 2024-09-13T21:50:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4284597640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c10e510 con 0x7f427c0ff700 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4282333640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c0666b0 0x7f427c10d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4282333640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c0666b0 0x7f427c10d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52736/0 (socket says 172.21.15.119:52736) 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4282333640 1 -- 172.21.15.119:0/2959787860 learned_addr learned my addr 172.21.15.119:0/2959787860 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4281b32640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f427c0ff700 0x7f427c10d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4282333640 1 -- 172.21.15.119:0/2959787860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f427c0ff700 msgr2=0x7f427c10d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4282333640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f427c0ff700 0x7f427c10d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4282333640 1 -- 172.21.15.119:0/2959787860 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278005040 con 0x7f427c0666b0 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.947+0000 7f4281b32640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f427c0ff700 0x7f427c10d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.948+0000 7f4282333640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c0666b0 0x7f427c10d1b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4278009ac0 tx=0x7f4278009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.948+0000 7f4272ffd640 1 -- 172.21.15.119:0/2959787860 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4278038070 con 0x7f427c0666b0 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.948+0000 7f4272ffd640 1 -- 172.21.15.119:0/2959787860 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4278009740 con 0x7f427c0666b0 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.948+0000 7f4284597640 1 -- 172.21.15.119:0/2959787860 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c10e740 con 0x7f427c0666b0 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.948+0000 7f4272ffd640 1 -- 172.21.15.119:0/2959787860 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f427803eb30 con 0x7f427c0666b0 2024-09-13T21:50:09.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.948+0000 7f4284597640 1 -- 172.21.15.119:0/2959787860 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c10ece0 con 0x7f427c0666b0 2024-09-13T21:50:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.949+0000 7f4284597640 1 -- 172.21.15.119:0/2959787860 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427c0fa8b0 con 0x7f427c0666b0 2024-09-13T21:50:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.949+0000 7f4272ffd640 1 -- 172.21.15.119:0/2959787860 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4278030020 con 0x7f427c0666b0 2024-09-13T21:50:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.950+0000 7f4272ffd640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f426806e530 0x7f42680709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.950+0000 7f4272ffd640 1 -- 172.21.15.119:0/2959787860 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f42780ae570 con 0x7f427c0666b0 2024-09-13T21:50:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.950+0000 7f4281b32640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f426806e530 0x7f42680709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.950+0000 7f4281b32640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f426806e530 0x7f42680709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f427c10cf60 tx=0x7f426c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:09.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:09.954+0000 7f4272ffd640 1 -- 172.21.15.119:0/2959787860 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4278077730 con 0x7f427c0666b0 2024-09-13T21:50:10.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.152+0000 7f4284597640 1 -- 172.21.15.119:0/2959787860 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f427c10eff0 con 0x7f427c0666b0 2024-09-13T21:50:10.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.152+0000 7f4272ffd640 1 -- 172.21.15.119:0/2959787860 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1943 (secure 0 0 0) 0x7f427807adf0 con 0x7f427c0666b0 2024-09-13T21:50:10.154 INFO:teuthology.orchestra.run.smithi119.stdout:e22 2024-09-13T21:50:10.154 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:48:12:719560+0000 2024-09-13T21:50:10.154 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:50:10.154 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:50:10.154 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:50:10.154 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:50:10.154 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 22 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:48:12.175306+0000 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:50:10.155 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 14472 members: 24267,14472 2024-09-13T21:50:10.156 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:50:10.157 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:50:10.157 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:50:10.157 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:50:10.157 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:50:10.157 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:50:10.157 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:50:10.157 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:50:10.158 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 22 2024-09-13T21:50:10.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.155+0000 7f4284597640 1 -- 172.21.15.119:0/2959787860 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f426806e530 msgr2=0x7f42680709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:10.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.155+0000 7f4284597640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f426806e530 0x7f42680709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f427c10cf60 tx=0x7f426c00b040 comp rx=0 tx=0).stop 2024-09-13T21:50:10.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.155+0000 7f4284597640 1 -- 172.21.15.119:0/2959787860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c0666b0 msgr2=0x7f427c10d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:10.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.155+0000 7f4284597640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c0666b0 0x7f427c10d1b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4278009ac0 tx=0x7f4278009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.155+0000 7f4284597640 1 -- 172.21.15.119:0/2959787860 shutdown_connections 2024-09-13T21:50:10.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.155+0000 7f4284597640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f426806e530 0x7f42680709e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.155+0000 7f4284597640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f427c0ff700 0x7f427c10d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.155+0000 7f4284597640 1 --2- 172.21.15.119:0/2959787860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f427c0666b0 0x7f427c10d1b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.155+0000 7f4284597640 1 -- 172.21.15.119:0/2959787860 >> 172.21.15.119:0/2959787860 conn(0x7f427c0f6c10 msgr2=0x7f427c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:10.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.155+0000 7f4284597640 1 -- 172.21.15.119:0/2959787860 shutdown_connections 2024-09-13T21:50:10.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.155+0000 7f4284597640 1 -- 172.21.15.119:0/2959787860 wait complete. 2024-09-13T21:50:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.234+0000 7fdc83776640 1 -- 172.21.15.119:0/2537503478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc7c0fc720 msgr2=0x7fdc7c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.234+0000 7fdc83776640 1 --2- 172.21.15.119:0/2537503478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc7c0fc720 0x7fdc7c0fcb90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0048d0 tx=0x7fdc6c009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.234+0000 7fdc83776640 1 -- 172.21.15.119:0/2537503478 shutdown_connections 2024-09-13T21:50:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.234+0000 7fdc83776640 1 --2- 172.21.15.119:0/2537503478 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc7c0fc720 0x7fdc7c0fcb90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.234+0000 7fdc83776640 1 --2- 172.21.15.119:0/2537503478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7c0fb450 0x7fdc7c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.234+0000 7fdc83776640 1 -- 172.21.15.119:0/2537503478 >> 172.21.15.119:0/2537503478 conn(0x7fdc7c0f6c10 msgr2=0x7fdc7c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.235+0000 7fdc83776640 1 -- 172.21.15.119:0/2537503478 shutdown_connections 2024-09-13T21:50:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.235+0000 7fdc83776640 1 -- 172.21.15.119:0/2537503478 wait complete. 2024-09-13T21:50:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.235+0000 7fdc83776640 1 Processor -- start 2024-09-13T21:50:10.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.235+0000 7fdc83776640 1 -- start start 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.235+0000 7fdc83776640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7c0fb450 0x7fdc7c10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.235+0000 7fdc83776640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc7c0fc720 0x7fdc7c10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.235+0000 7fdc83776640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c10dc70 con 0x7fdc7c0fc720 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.235+0000 7fdc83776640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c10e440 con 0x7fdc7c0fb450 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.235+0000 7fdc80d11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc7c0fc720 0x7fdc7c10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.235+0000 7fdc80d11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc7c0fc720 0x7fdc7c10d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52756/0 (socket says 172.21.15.119:52756) 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.235+0000 7fdc80d11640 1 -- 172.21.15.119:0/1093400299 learned_addr learned my addr 172.21.15.119:0/1093400299 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.236+0000 7fdc81512640 1 --2- 172.21.15.119:0/1093400299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7c0fb450 0x7fdc7c10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.236+0000 7fdc80d11640 1 -- 172.21.15.119:0/1093400299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7c0fb450 msgr2=0x7fdc7c10d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.236+0000 7fdc80d11640 1 --2- 172.21.15.119:0/1093400299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7c0fb450 0x7fdc7c10d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.236+0000 7fdc80d11640 1 -- 172.21.15.119:0/1093400299 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c005040 con 0x7fdc7c0fc720 2024-09-13T21:50:10.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.236+0000 7fdc80d11640 1 --2- 172.21.15.119:0/1093400299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc7c0fc720 0x7fdc7c10d620 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0043d0 tx=0x7fdc6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:10.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.236+0000 7fdc71ffb640 1 -- 172.21.15.119:0/1093400299 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6c038070 con 0x7fdc7c0fc720 2024-09-13T21:50:10.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.236+0000 7fdc71ffb640 1 -- 172.21.15.119:0/1093400299 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdc6c02ae90 con 0x7fdc7c0fc720 2024-09-13T21:50:10.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.236+0000 7fdc83776640 1 -- 172.21.15.119:0/1093400299 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c10e670 con 0x7fdc7c0fc720 2024-09-13T21:50:10.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.236+0000 7fdc71ffb640 1 -- 172.21.15.119:0/1093400299 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6c03e670 con 0x7fdc7c0fc720 2024-09-13T21:50:10.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.236+0000 7fdc83776640 1 -- 172.21.15.119:0/1093400299 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c10ec10 con 0x7fdc7c0fc720 2024-09-13T21:50:10.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.237+0000 7fdc83776640 1 -- 172.21.15.119:0/1093400299 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c0fa8b0 con 0x7fdc7c0fc720 2024-09-13T21:50:10.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.238+0000 7fdc71ffb640 1 -- 172.21.15.119:0/1093400299 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdc6c030020 con 0x7fdc7c0fc720 2024-09-13T21:50:10.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.238+0000 7fdc71ffb640 1 --2- 172.21.15.119:0/1093400299 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdc6806e530 0x7fdc680709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:10.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.238+0000 7fdc71ffb640 1 -- 172.21.15.119:0/1093400299 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdc6c0ae2e0 con 0x7fdc7c0fc720 2024-09-13T21:50:10.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.238+0000 7fdc81512640 1 --2- 172.21.15.119:0/1093400299 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdc6806e530 0x7fdc680709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:10.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.239+0000 7fdc81512640 1 --2- 172.21.15.119:0/1093400299 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdc6806e530 0x7fdc680709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009fd0 tx=0x7fdc78009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:10.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.243+0000 7fdc71ffb640 1 -- 172.21.15.119:0/1093400299 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdc6c0774a0 con 0x7fdc7c0fc720 2024-09-13T21:50:10.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.425+0000 7fdc83776640 1 -- 172.21.15.119:0/1093400299 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc7c103ec0 con 0x7fdc6806e530 2024-09-13T21:50:10.427 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:10 smithi119 ceph-mon[90896]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:10.427 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:10 smithi119 ceph-mon[90896]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:10.427 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:10 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/731345083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:10.427 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:10 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2959787860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:50:10.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.426+0000 7fdc71ffb640 1 -- 172.21.15.119:0/1093400299 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fdc7c103ec0 con 0x7fdc6806e530 2024-09-13T21:50:10.428 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:50:10.428 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:50:10.428 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:50:10.428 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:50:10.428 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:50:10.428 INFO:teuthology.orchestra.run.smithi119.stdout: "crash", 2024-09-13T21:50:10.428 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr", 2024-09-13T21:50:10.428 INFO:teuthology.orchestra.run.smithi119.stdout: "mon" 2024-09-13T21:50:10.429 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:50:10.429 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "10/21 daemons upgraded", 2024-09-13T21:50:10.429 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:50:10.429 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:50:10.429 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:50:10.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.428+0000 7fdc83776640 1 -- 172.21.15.119:0/1093400299 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdc6806e530 msgr2=0x7fdc680709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:10.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.428+0000 7fdc83776640 1 --2- 172.21.15.119:0/1093400299 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdc6806e530 0x7fdc680709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009fd0 tx=0x7fdc78009e50 comp rx=0 tx=0).stop 2024-09-13T21:50:10.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.428+0000 7fdc83776640 1 -- 172.21.15.119:0/1093400299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc7c0fc720 msgr2=0x7fdc7c10d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:10.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.428+0000 7fdc83776640 1 --2- 172.21.15.119:0/1093400299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc7c0fc720 0x7fdc7c10d620 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0043d0 tx=0x7fdc6c009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.428+0000 7fdc83776640 1 -- 172.21.15.119:0/1093400299 shutdown_connections 2024-09-13T21:50:10.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.428+0000 7fdc83776640 1 --2- 172.21.15.119:0/1093400299 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdc6806e530 0x7fdc680709e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.428+0000 7fdc83776640 1 --2- 172.21.15.119:0/1093400299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc7c0fc720 0x7fdc7c10d620 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.428+0000 7fdc83776640 1 --2- 172.21.15.119:0/1093400299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7c0fb450 0x7fdc7c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.428+0000 7fdc83776640 1 -- 172.21.15.119:0/1093400299 >> 172.21.15.119:0/1093400299 conn(0x7fdc7c0f6c10 msgr2=0x7fdc7c066160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:10.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.428+0000 7fdc83776640 1 -- 172.21.15.119:0/1093400299 shutdown_connections 2024-09-13T21:50:10.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.428+0000 7fdc83776640 1 -- 172.21.15.119:0/1093400299 wait complete. 2024-09-13T21:50:10.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.508+0000 7f42e2175640 1 -- 172.21.15.119:0/181485081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42dc0fc520 msgr2=0x7f42dc0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:10.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.508+0000 7f42e2175640 1 --2- 172.21.15.119:0/181485081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42dc0fc520 0x7f42dc0fc930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0048d0 tx=0x7f42cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.508+0000 7f42e2175640 1 -- 172.21.15.119:0/181485081 shutdown_connections 2024-09-13T21:50:10.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.508+0000 7f42e2175640 1 --2- 172.21.15.119:0/181485081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0fd7f0 0x7f42dc0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.508+0000 7f42e2175640 1 --2- 172.21.15.119:0/181485081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42dc0fc520 0x7f42dc0fc930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.508+0000 7f42e2175640 1 -- 172.21.15.119:0/181485081 >> 172.21.15.119:0/181485081 conn(0x7f42dc0f7ce0 msgr2=0x7f42dc0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:10.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.508+0000 7f42e2175640 1 -- 172.21.15.119:0/181485081 shutdown_connections 2024-09-13T21:50:10.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.508+0000 7f42e2175640 1 -- 172.21.15.119:0/181485081 wait complete. 2024-09-13T21:50:10.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.508+0000 7f42e2175640 1 Processor -- start 2024-09-13T21:50:10.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42e2175640 1 -- start start 2024-09-13T21:50:10.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42e2175640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0fc520 0x7f42dc10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:10.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42e2175640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42dc0fd7f0 0x7f42dc10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:10.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42e2175640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc10dc10 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42e2175640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc10e430 con 0x7f42dc0fc520 2024-09-13T21:50:10.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42d3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42dc0fd7f0 0x7f42dc10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:10.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42d3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42dc0fd7f0 0x7f42dc10d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52774/0 (socket says 172.21.15.119:52774) 2024-09-13T21:50:10.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42d3fff640 1 -- 172.21.15.119:0/3273027487 learned_addr learned my addr 172.21.15.119:0/3273027487 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:10.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42db7fe640 1 --2- 172.21.15.119:0/3273027487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0fc520 0x7f42dc10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:10.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42d3fff640 1 -- 172.21.15.119:0/3273027487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0fc520 msgr2=0x7f42dc10d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:10.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42d3fff640 1 --2- 172.21.15.119:0/3273027487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0fc520 0x7f42dc10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42d3fff640 1 -- 172.21.15.119:0/3273027487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc005040 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42d3fff640 1 --2- 172.21.15.119:0/3273027487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42dc0fd7f0 0x7f42dc10d5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c830 tx=0x7f42c4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:10.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.509+0000 7f42d8ff9640 1 -- 172.21.15.119:0/3273027487 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c400a7d0 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.510+0000 7f42e2175640 1 -- 172.21.15.119:0/3273027487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42dc10e6c0 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.510+0000 7f42d8ff9640 1 -- 172.21.15.119:0/3273027487 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f42c400add0 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.510+0000 7f42d8ff9640 1 -- 172.21.15.119:0/3273027487 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c40113a0 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.510+0000 7f42e2175640 1 -- 172.21.15.119:0/3273027487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc10ec60 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.511+0000 7f42e2175640 1 -- 172.21.15.119:0/3273027487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42dc0fb980 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.511+0000 7f42d8ff9640 1 -- 172.21.15.119:0/3273027487 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f42c4012400 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.512+0000 7f42d8ff9640 1 --2- 172.21.15.119:0/3273027487 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f42c806e530 0x7f42c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:10.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.512+0000 7f42d8ff9640 1 -- 172.21.15.119:0/3273027487 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f42c408e2e0 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.512+0000 7f42db7fe640 1 --2- 172.21.15.119:0/3273027487 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f42c806e530 0x7f42c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:10.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.512+0000 7f42db7fe640 1 --2- 172.21.15.119:0/3273027487 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f42c806e530 0x7f42c80709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42cc004540 tx=0x7f42cc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:10.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.516+0000 7f42d8ff9640 1 -- 172.21.15.119:0/3273027487 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f42c40574a0 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:10 smithi155 ceph-mon[79928]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:10 smithi155 ceph-mon[79928]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:10 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/731345083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:10 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2959787860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:50:10.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.747+0000 7f42e2175640 1 -- 172.21.15.119:0/3273027487 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f42dc04b720 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.748+0000 7f42d8ff9640 1 -- 172.21.15.119:0/3273027487 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f42c405ab60 con 0x7f42dc0fd7f0 2024-09-13T21:50:10.749 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:50:10.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.750+0000 7f42e2175640 1 -- 172.21.15.119:0/3273027487 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f42c806e530 msgr2=0x7f42c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:10.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.750+0000 7f42e2175640 1 --2- 172.21.15.119:0/3273027487 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f42c806e530 0x7f42c80709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42cc004540 tx=0x7f42cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.750+0000 7f42e2175640 1 -- 172.21.15.119:0/3273027487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42dc0fd7f0 msgr2=0x7f42dc10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:10.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.750+0000 7f42e2175640 1 --2- 172.21.15.119:0/3273027487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42dc0fd7f0 0x7f42dc10d5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c830 tx=0x7f42c4004430 comp rx=0 tx=0).stop 2024-09-13T21:50:10.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.750+0000 7f42e2175640 1 -- 172.21.15.119:0/3273027487 shutdown_connections 2024-09-13T21:50:10.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.750+0000 7f42e2175640 1 --2- 172.21.15.119:0/3273027487 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f42c806e530 0x7f42c80709e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.750+0000 7f42e2175640 1 --2- 172.21.15.119:0/3273027487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42dc0fd7f0 0x7f42dc10d5c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.750+0000 7f42e2175640 1 --2- 172.21.15.119:0/3273027487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42dc0fc520 0x7f42dc10d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:10.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.750+0000 7f42e2175640 1 -- 172.21.15.119:0/3273027487 >> 172.21.15.119:0/3273027487 conn(0x7f42dc0f7ce0 msgr2=0x7f42dc0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:10.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.750+0000 7f42e2175640 1 -- 172.21.15.119:0/3273027487 shutdown_connections 2024-09-13T21:50:10.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:10.750+0000 7f42e2175640 1 -- 172.21.15.119:0/3273027487 wait complete. 2024-09-13T21:50:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:11 smithi155 ceph-mon[79928]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:11 smithi155 ceph-mon[79928]: pgmap v122: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:11 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3273027487' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:50:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:11 smithi119 ceph-mon[90896]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:11 smithi119 ceph-mon[90896]: pgmap v122: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:11 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3273027487' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:50:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:12 smithi155 ceph-mon[79928]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:12 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:50:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:12 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:50:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:12 smithi155 ceph-mon[79928]: Upgrade: osd.4 is safe to restart 2024-09-13T21:50:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:12 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:12.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:12 smithi119 ceph-mon[90896]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:12.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:12 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:50:12.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:12 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T21:50:12.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:12 smithi119 ceph-mon[90896]: Upgrade: osd.4 is safe to restart 2024-09-13T21:50:12.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:12 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:13.399 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:13 smithi155 ceph-mon[79928]: pgmap v123: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:13.400 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:13.400 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:50:13.400 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:13 smithi119 ceph-mon[90896]: pgmap v123: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T21:50:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:14.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:14 smithi155 ceph-mon[79928]: Upgrade: Updating osd.4 2024-09-13T21:50:14.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:14 smithi155 ceph-mon[79928]: Deploying daemon osd.4 on smithi155 2024-09-13T21:50:14.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:14 smithi119 ceph-mon[90896]: Upgrade: Updating osd.4 2024-09-13T21:50:14.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:14 smithi119 ceph-mon[90896]: Deploying daemon osd.4 on smithi155 2024-09-13T21:50:15.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:15 smithi155 ceph-mon[79928]: pgmap v124: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:15 smithi119 ceph-mon[90896]: pgmap v124: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:15.977 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:15 smithi155 systemd[1]: Stopping Ceph osd.4 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:50:16.286 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:15 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[46867]: 2024-09-13T21:50:15.974+0000 7f21e8189640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:50:16.286 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:15 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[46867]: 2024-09-13T21:50:15.974+0000 7f21e8189640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-13T21:50:16.286 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:15 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[46867]: 2024-09-13T21:50:15.974+0000 7f21e8189640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:50:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:16 smithi155 ceph-mon[79928]: osd.4 marked itself down and dead 2024-09-13T21:50:16.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:16 smithi119 ceph-mon[90896]: osd.4 marked itself down and dead 2024-09-13T21:50:17.120 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:16 smithi155 podman[93569]: 2024-09-13 21:50:16.832616052 +0000 UTC m=+0.958828928 container died 385742a74acf2b209516e334e407d961190f0b15f80da7f9b8af814b064592aa (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=quincy-eb16b97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-13T21:50:17.512 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:17 smithi155 ceph-mon[79928]: pgmap v125: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:17.512 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:17 smithi155 ceph-mon[79928]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:50:17.512 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:17 smithi155 ceph-mon[79928]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T21:50:17.513 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:17 smithi155 podman[93569]: 2024-09-13 21:50:17.218046385 +0000 UTC m=+1.344259291 container cleanup 385742a74acf2b209516e334e407d961190f0b15f80da7f9b8af814b064592aa (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-eb16b97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T21:50:17.513 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:17 smithi155 bash[93569]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4 2024-09-13T21:50:17.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:17 smithi119 ceph-mon[90896]: pgmap v125: 65 pgs: 65 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:17.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:17 smithi119 ceph-mon[90896]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:50:17.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:17 smithi119 ceph-mon[90896]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T21:50:17.833 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:17 smithi155 podman[93586]: 2024-09-13 21:50:17.511178511 +0000 UTC m=+0.674925559 container remove 385742a74acf2b209516e334e407d961190f0b15f80da7f9b8af814b064592aa (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=quincy-eb16b97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T21:50:18.099 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:17 smithi155 podman[93676]: 2024-09-13 21:50:17.743375289 +0000 UTC m=+0.015903867 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:50:18.099 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:17 smithi155 podman[93676]: 2024-09-13 21:50:17.853872801 +0000 UTC m=+0.126401408 container create f3a6f9af95764ce561441b7e08015f78b35efe2441c0b8fd769a6df53904eda9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux ) 2024-09-13T21:50:18.099 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:18 smithi155 podman[93676]: 2024-09-13 21:50:18.098101721 +0000 UTC m=+0.370630296 container init f3a6f9af95764ce561441b7e08015f78b35efe2441c0b8fd769a6df53904eda9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be) 2024-09-13T21:50:18.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:18 smithi155 ceph-mon[79928]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T21:50:18.583 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:18 smithi155 podman[93676]: 2024-09-13 21:50:18.101354743 +0000 UTC m=+0.373883316 container start f3a6f9af95764ce561441b7e08015f78b35efe2441c0b8fd769a6df53904eda9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T21:50:18.583 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:18 smithi155 podman[93676]: 2024-09-13 21:50:18.206832781 +0000 UTC m=+0.479361349 container attach f3a6f9af95764ce561441b7e08015f78b35efe2441c0b8fd769a6df53904eda9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:50:18.583 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:18 smithi155 podman[93699]: 2024-09-13 21:50:18.312976169 +0000 UTC m=+0.016498893 container died f3a6f9af95764ce561441b7e08015f78b35efe2441c0b8fd769a6df53904eda9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T21:50:18.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:18 smithi119 ceph-mon[90896]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T21:50:19.295 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:18 smithi155 podman[93699]: 2024-09-13 21:50:18.918991786 +0000 UTC m=+0.622514511 container remove f3a6f9af95764ce561441b7e08015f78b35efe2441c0b8fd769a6df53904eda9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:50:19.296 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:18 smithi155 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-13T21:50:19.296 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:18 smithi155 systemd[1]: Stopped Ceph osd.4 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:50:19.296 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:18 smithi155 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.4.service: Consumed 1min 1.531s CPU time. 2024-09-13T21:50:19.296 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:19 smithi155 systemd[1]: Starting Ceph osd.4 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:50:19.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:19 smithi155 ceph-mon[79928]: pgmap v128: 65 pgs: 3 active+undersized, 5 stale+active+clean, 2 active+undersized+degraded, 55 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 5/318 objects degraded (1.572%) 2024-09-13T21:50:19.595 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:19 smithi155 ceph-mon[79928]: Health check failed: Degraded data redundancy: 5/318 objects degraded (1.572%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T21:50:19.595 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:19 smithi155 podman[93798]: 2024-09-13 21:50:19.258832471 +0000 UTC m=+0.016096377 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:50:19.596 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:19 smithi155 podman[93798]: 2024-09-13 21:50:19.378364754 +0000 UTC m=+0.135628648 container create 336ea1dafc46c9599eb5b731bb93a539234c8eafb3bbe1a1c03486f678b4da6e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T21:50:19.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:19 smithi119 ceph-mon[90896]: pgmap v128: 65 pgs: 3 active+undersized, 5 stale+active+clean, 2 active+undersized+degraded, 55 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 5/318 objects degraded (1.572%) 2024-09-13T21:50:19.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:19 smithi119 ceph-mon[90896]: Health check failed: Degraded data redundancy: 5/318 objects degraded (1.572%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T21:50:20.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:19 smithi155 podman[93798]: 2024-09-13 21:50:19.616643468 +0000 UTC m=+0.373907364 container init 336ea1dafc46c9599eb5b731bb93a539234c8eafb3bbe1a1c03486f678b4da6e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T21:50:20.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:19 smithi155 podman[93798]: 2024-09-13 21:50:19.621030001 +0000 UTC m=+0.378293895 container start 336ea1dafc46c9599eb5b731bb93a539234c8eafb3bbe1a1c03486f678b4da6e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T21:50:20.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:19 smithi155 podman[93798]: 2024-09-13 21:50:19.706134527 +0000 UTC m=+0.463398435 container attach 336ea1dafc46c9599eb5b731bb93a539234c8eafb3bbe1a1c03486f678b4da6e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-13T21:50:20.084 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:19 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate[93813]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:50:20.084 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:19 smithi155 bash[93798]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:50:20.084 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:19 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate[93813]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:50:20.084 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:19 smithi155 bash[93798]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:50:20.771 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate[93813]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T21:50:20.771 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 bash[93798]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T21:50:20.771 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate[93813]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T21:50:20.771 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 bash[93798]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T21:50:21.084 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate[93813]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T21:50:21.085 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 bash[93798]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T21:50:21.085 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate[93813]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T21:50:21.085 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 bash[93798]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T21:50:21.085 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate[93813]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T21:50:21.085 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 bash[93798]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T21:50:21.085 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate[93813]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T21:50:21.086 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 bash[93798]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T21:50:21.086 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate[93813]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T21:50:21.086 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 bash[93798]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T21:50:21.086 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:20 smithi155 podman[93798]: 2024-09-13 21:50:20.798786648 +0000 UTC m=+1.556050551 container died 336ea1dafc46c9599eb5b731bb93a539234c8eafb3bbe1a1c03486f678b4da6e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-13T21:50:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:21 smithi155 ceph-mon[79928]: pgmap v129: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:21 smithi119 ceph-mon[90896]: pgmap v129: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:22.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:21 smithi155 podman[93947]: 2024-09-13 21:50:21.777465122 +0000 UTC m=+0.972231728 container remove 336ea1dafc46c9599eb5b731bb93a539234c8eafb3bbe1a1c03486f678b4da6e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T21:50:22.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:21 smithi155 podman[94006]: 2024-09-13 21:50:21.898763956 +0000 UTC m=+0.016582678 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:50:22.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:22 smithi155 podman[94006]: 2024-09-13 21:50:22.003353801 +0000 UTC m=+0.121172523 container create 03c992670291bbcd29226073528e2617332ba802f9ea8aa91a37b43a829af2ef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T21:50:22.583 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:22 smithi155 podman[94006]: 2024-09-13 21:50:22.280807163 +0000 UTC m=+0.398625885 container init 03c992670291bbcd29226073528e2617332ba802f9ea8aa91a37b43a829af2ef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T21:50:22.583 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:22 smithi155 podman[94006]: 2024-09-13 21:50:22.28418447 +0000 UTC m=+0.402003193 container start 03c992670291bbcd29226073528e2617332ba802f9ea8aa91a37b43a829af2ef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-ecab7be) 2024-09-13T21:50:22.583 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:22 smithi155 ceph-osd[94025]: -- 172.21.15.155:0/60416800 <== mon.1 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f34fdee1e0 con 0x55f34fdec000 2024-09-13T21:50:22.583 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:22 smithi155 bash[94006]: 03c992670291bbcd29226073528e2617332ba802f9ea8aa91a37b43a829af2ef 2024-09-13T21:50:22.583 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:22 smithi155 systemd[1]: Started Ceph osd.4 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:50:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:23 smithi155 ceph-mon[79928]: pgmap v130: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:23.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:23 smithi119 ceph-mon[90896]: pgmap v130: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:23.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:23.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:23.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:23.507 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:23.507 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:24.583 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:24 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T21:50:24.145+0000 7ff69735e640 -1 Falling back to public interface 2024-09-13T21:50:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:25 smithi155 ceph-mon[79928]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:25.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:25 smithi119 ceph-mon[90896]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:26.431 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:26.431 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:26.431 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:26.431 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:26.432 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:26 smithi155 ceph-mon[79928]: Health check update: Degraded data redundancy: 52/318 objects degraded (16.352%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T21:50:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:26 smithi119 ceph-mon[90896]: Health check update: Degraded data redundancy: 52/318 objects degraded (16.352%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T21:50:27.321 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:27 smithi155 ceph-mon[79928]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:27 smithi119 ceph-mon[90896]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:29.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:29 smithi119 ceph-mon[90896]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:29.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:29 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:29.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:29 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:29.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:29 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:29.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:29 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:50:29.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:29 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:29.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:29 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:29.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:29 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:29.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:29 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:29.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:29 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:29.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:29 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:50:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:29 smithi155 ceph-mon[79928]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:29 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:29 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:29 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:29 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:50:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:29 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:29 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:29 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:29 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:29.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:29 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:29.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:29 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:50:30.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:30 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:50:30.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:30 smithi155 ceph-mon[79928]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T21:50:30.583 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:30 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T21:50:30.222+0000 7ff69735e640 -1 osd.4 67 log_to_monitors true 2024-09-13T21:50:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:30 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:50:30.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:30 smithi119 ceph-mon[90896]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T21:50:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:31 smithi155 ceph-mon[79928]: pgmap v134: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:31 smithi155 ceph-mon[79928]: from='osd.4 [v2:172.21.15.155:6808/1877732999,v1:172.21.15.155:6809/1877732999]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:50:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:31 smithi155 ceph-mon[79928]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:50:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:31 smithi119 ceph-mon[90896]: pgmap v134: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:31 smithi119 ceph-mon[90896]: from='osd.4 [v2:172.21.15.155:6808/1877732999,v1:172.21.15.155:6809/1877732999]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:50:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:31 smithi119 ceph-mon[90896]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T21:50:32.583 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 21:50:32 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T21:50:32.085+0000 7ff68b0f0640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:50:32.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:32 smithi155 ceph-mon[79928]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T21:50:32.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:32 smithi155 ceph-mon[79928]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T21:50:32.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:32 smithi155 ceph-mon[79928]: from='osd.4 [v2:172.21.15.155:6808/1877732999,v1:172.21.15.155:6809/1877732999]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:50:32.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:32 smithi155 ceph-mon[79928]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:50:32.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:32 smithi155 ceph-mon[79928]: from='osd.4 ' entity='osd.4' 2024-09-13T21:50:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:32 smithi119 ceph-mon[90896]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T21:50:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:32 smithi119 ceph-mon[90896]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T21:50:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:32 smithi119 ceph-mon[90896]: from='osd.4 [v2:172.21.15.155:6808/1877732999,v1:172.21.15.155:6809/1877732999]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:50:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:32 smithi119 ceph-mon[90896]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:50:32.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:32 smithi119 ceph-mon[90896]: from='osd.4 ' entity='osd.4' 2024-09-13T21:50:33.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:33 smithi119 ceph-mon[90896]: pgmap v136: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:33.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:33 smithi119 ceph-mon[90896]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:50:33.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:33 smithi119 ceph-mon[90896]: osd.4 [v2:172.21.15.155:6808/1877732999,v1:172.21.15.155:6809/1877732999] boot 2024-09-13T21:50:33.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:33 smithi119 ceph-mon[90896]: osdmap e71: 6 total, 6 up, 6 in 2024-09-13T21:50:33.507 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:33 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:50:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:33 smithi155 ceph-mon[79928]: pgmap v136: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 52/318 objects degraded (16.352%) 2024-09-13T21:50:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:33 smithi155 ceph-mon[79928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:50:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:33 smithi155 ceph-mon[79928]: osd.4 [v2:172.21.15.155:6808/1877732999,v1:172.21.15.155:6809/1877732999] boot 2024-09-13T21:50:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:33 smithi155 ceph-mon[79928]: osdmap e71: 6 total, 6 up, 6 in 2024-09-13T21:50:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:33 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T21:50:35.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:35 smithi119 ceph-mon[90896]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T21:50:35.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:35 smithi119 ceph-mon[90896]: pgmap v139: 65 pgs: 15 peering, 9 active+undersized, 10 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 27/318 objects degraded (8.491%) 2024-09-13T21:50:35.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:35 smithi155 ceph-mon[79928]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T21:50:35.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:35 smithi155 ceph-mon[79928]: pgmap v139: 65 pgs: 15 peering, 9 active+undersized, 10 active+undersized+degraded, 31 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 27/318 objects degraded (8.491%) 2024-09-13T21:50:36.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:36 smithi119 ceph-mon[90896]: Health check update: Degraded data redundancy: 27/318 objects degraded (8.491%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T21:50:36.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:36 smithi155 ceph-mon[79928]: Health check update: Degraded data redundancy: 27/318 objects degraded (8.491%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T21:50:37.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:37 smithi119 ceph-mon[90896]: pgmap v140: 65 pgs: 15 peering, 3 active+undersized, 3 active+undersized+degraded, 44 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 6/318 objects degraded (1.887%) 2024-09-13T21:50:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:37 smithi155 ceph-mon[79928]: pgmap v140: 65 pgs: 15 peering, 3 active+undersized, 3 active+undersized+degraded, 44 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 6/318 objects degraded (1.887%) 2024-09-13T21:50:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:38 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:38 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:38 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:38 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:39 smithi155 ceph-mon[79928]: pgmap v141: 65 pgs: 11 peering, 54 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:39 smithi155 ceph-mon[79928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/318 objects degraded (1.887%), 3 pgs degraded) 2024-09-13T21:50:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:39 smithi155 ceph-mon[79928]: Cluster is now healthy 2024-09-13T21:50:39.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:39 smithi119 ceph-mon[90896]: pgmap v141: 65 pgs: 11 peering, 54 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:39.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:39 smithi119 ceph-mon[90896]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/318 objects degraded (1.887%), 3 pgs degraded) 2024-09-13T21:50:39.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:39 smithi119 ceph-mon[90896]: Cluster is now healthy 2024-09-13T21:50:40.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.842+0000 7fa2acf37640 1 -- 172.21.15.119:0/1736053354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a80fc700 msgr2=0x7fa2a80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:40.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.842+0000 7fa2acf37640 1 --2- 172.21.15.119:0/1736053354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a80fc700 0x7fa2a80fcb70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa2900048d0 tx=0x7fa290009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:40.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.842+0000 7fa2acf37640 1 -- 172.21.15.119:0/1736053354 shutdown_connections 2024-09-13T21:50:40.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.842+0000 7fa2acf37640 1 --2- 172.21.15.119:0/1736053354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a80fc700 0x7fa2a80fcb70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.842+0000 7fa2acf37640 1 --2- 172.21.15.119:0/1736053354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2a80fb430 0x7fa2a80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.842+0000 7fa2acf37640 1 -- 172.21.15.119:0/1736053354 >> 172.21.15.119:0/1736053354 conn(0x7fa2a80f6c10 msgr2=0x7fa2a80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.842+0000 7fa2acf37640 1 -- 172.21.15.119:0/1736053354 shutdown_connections 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.842+0000 7fa2acf37640 1 -- 172.21.15.119:0/1736053354 wait complete. 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.843+0000 7fa2acf37640 1 Processor -- start 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.843+0000 7fa2acf37640 1 -- start start 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.843+0000 7fa2acf37640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2a80fb430 0x7fa2a810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.843+0000 7fa2acf37640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a80fc700 0x7fa2a810c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.843+0000 7fa2acf37640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a810cb10 con 0x7fa2a80fc700 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.843+0000 7fa2acf37640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a810d330 con 0x7fa2a80fb430 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.843+0000 7fa2a5d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a80fc700 0x7fa2a810c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:40.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.843+0000 7fa2a5d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a80fc700 0x7fa2a810c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52962/0 (socket says 172.21.15.119:52962) 2024-09-13T21:50:40.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.843+0000 7fa2a5d9b640 1 -- 172.21.15.119:0/303509792 learned_addr learned my addr 172.21.15.119:0/303509792 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:40.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.843+0000 7fa2a659c640 1 --2- 172.21.15.119:0/303509792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2a80fb430 0x7fa2a810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:40.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.844+0000 7fa2a5d9b640 1 -- 172.21.15.119:0/303509792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2a80fb430 msgr2=0x7fa2a810bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:40.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.844+0000 7fa2a5d9b640 1 --2- 172.21.15.119:0/303509792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2a80fb430 0x7fa2a810bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:40.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.844+0000 7fa2a5d9b640 1 -- 172.21.15.119:0/303509792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290005040 con 0x7fa2a80fc700 2024-09-13T21:50:40.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.844+0000 7fa2a5d9b640 1 --2- 172.21.15.119:0/303509792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a80fc700 0x7fa2a810c4c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2900048a0 tx=0x7fa290009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:40.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.844+0000 7fa29effd640 1 -- 172.21.15.119:0/303509792 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa290038070 con 0x7fa2a80fc700 2024-09-13T21:50:40.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.844+0000 7fa29effd640 1 -- 172.21.15.119:0/303509792 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa290004290 con 0x7fa2a80fc700 2024-09-13T21:50:40.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.844+0000 7fa29effd640 1 -- 172.21.15.119:0/303509792 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa290033660 con 0x7fa2a80fc700 2024-09-13T21:50:40.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.844+0000 7fa2acf37640 1 -- 172.21.15.119:0/303509792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a810d560 con 0x7fa2a80fc700 2024-09-13T21:50:40.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.844+0000 7fa2acf37640 1 -- 172.21.15.119:0/303509792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a810db00 con 0x7fa2a80fc700 2024-09-13T21:50:40.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.845+0000 7fa2acf37640 1 -- 172.21.15.119:0/303509792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a80fa890 con 0x7fa2a80fc700 2024-09-13T21:50:40.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.846+0000 7fa29effd640 1 -- 172.21.15.119:0/303509792 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa290030020 con 0x7fa2a80fc700 2024-09-13T21:50:40.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.846+0000 7fa29effd640 1 --2- 172.21.15.119:0/303509792 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa29406e530 0x7fa2940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:40.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.846+0000 7fa29effd640 1 -- 172.21.15.119:0/303509792 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa2900ae1b0 con 0x7fa2a80fc700 2024-09-13T21:50:40.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.847+0000 7fa2a659c640 1 --2- 172.21.15.119:0/303509792 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa29406e530 0x7fa2940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:40.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.847+0000 7fa2a659c640 1 --2- 172.21.15.119:0/303509792 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa29406e530 0x7fa2940709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa298004fd0 tx=0x7fa29800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:40.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:40.851+0000 7fa29effd640 1 -- 172.21.15.119:0/303509792 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa290077420 con 0x7fa2a80fc700 2024-09-13T21:50:41.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.037+0000 7fa2acf37640 1 -- 172.21.15.119:0/303509792 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2a810de80 con 0x7fa29406e530 2024-09-13T21:50:41.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.039+0000 7fa29effd640 1 -- 172.21.15.119:0/303509792 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa2a810de80 con 0x7fa29406e530 2024-09-13T21:50:41.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.041+0000 7fa2acf37640 1 -- 172.21.15.119:0/303509792 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa29406e530 msgr2=0x7fa2940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.041+0000 7fa2acf37640 1 --2- 172.21.15.119:0/303509792 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa29406e530 0x7fa2940709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa298004fd0 tx=0x7fa29800b040 comp rx=0 tx=0).stop 2024-09-13T21:50:41.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.041+0000 7fa2acf37640 1 -- 172.21.15.119:0/303509792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a80fc700 msgr2=0x7fa2a810c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.041+0000 7fa2acf37640 1 --2- 172.21.15.119:0/303509792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a80fc700 0x7fa2a810c4c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2900048a0 tx=0x7fa290009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.041+0000 7fa2acf37640 1 -- 172.21.15.119:0/303509792 shutdown_connections 2024-09-13T21:50:41.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.041+0000 7fa2acf37640 1 --2- 172.21.15.119:0/303509792 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa29406e530 0x7fa2940709e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.041+0000 7fa2acf37640 1 --2- 172.21.15.119:0/303509792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2a80fc700 0x7fa2a810c4c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.041+0000 7fa2acf37640 1 --2- 172.21.15.119:0/303509792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2a80fb430 0x7fa2a810bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.041+0000 7fa2acf37640 1 -- 172.21.15.119:0/303509792 >> 172.21.15.119:0/303509792 conn(0x7fa2a80f6c10 msgr2=0x7fa2a80f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:41.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.041+0000 7fa2acf37640 1 -- 172.21.15.119:0/303509792 shutdown_connections 2024-09-13T21:50:41.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.041+0000 7fa2acf37640 1 -- 172.21.15.119:0/303509792 wait complete. 2024-09-13T21:50:41.051 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:50:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.120+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/4227139403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c40fc530 msgr2=0x7fb2c40fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.120+0000 7fb2ca5fc640 1 --2- 172.21.15.119:0/4227139403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c40fc530 0x7fb2c40fc940 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40048d0 tx=0x7fb2b4009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.120+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/4227139403 shutdown_connections 2024-09-13T21:50:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.120+0000 7fb2ca5fc640 1 --2- 172.21.15.119:0/4227139403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2c40fd800 0x7fb2c40fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.120+0000 7fb2ca5fc640 1 --2- 172.21.15.119:0/4227139403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c40fc530 0x7fb2c40fc940 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.120+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/4227139403 >> 172.21.15.119:0/4227139403 conn(0x7fb2c40f7d10 msgr2=0x7fb2c40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.120+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/4227139403 shutdown_connections 2024-09-13T21:50:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.120+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/4227139403 wait complete. 2024-09-13T21:50:41.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.121+0000 7fb2ca5fc640 1 Processor -- start 2024-09-13T21:50:41.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.121+0000 7fb2ca5fc640 1 -- start start 2024-09-13T21:50:41.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.121+0000 7fb2ca5fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c40fc530 0x7fb2c4071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.121+0000 7fb2ca5fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2c40fd800 0x7fb2c406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.121+0000 7fb2ca5fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c406fff0 con 0x7fb2c40fc530 2024-09-13T21:50:41.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.121+0000 7fb2ca5fc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4070130 con 0x7fb2c40fd800 2024-09-13T21:50:41.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.121+0000 7fb2c3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c40fc530 0x7fb2c4071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:41.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.121+0000 7fb2c3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c40fc530 0x7fb2c4071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52990/0 (socket says 172.21.15.119:52990) 2024-09-13T21:50:41.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.121+0000 7fb2c3fff640 1 -- 172.21.15.119:0/2792414742 learned_addr learned my addr 172.21.15.119:0/2792414742 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:41.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.122+0000 7fb2c37fe640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2c40fd800 0x7fb2c406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:41.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.122+0000 7fb2c3fff640 1 -- 172.21.15.119:0/2792414742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2c40fd800 msgr2=0x7fb2c406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.122+0000 7fb2c3fff640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2c40fd800 0x7fb2c406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.122+0000 7fb2c3fff640 1 -- 172.21.15.119:0/2792414742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b4005040 con 0x7fb2c40fc530 2024-09-13T21:50:41.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.122+0000 7fb2c37fe640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2c40fd800 0x7fb2c406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:50:41.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.122+0000 7fb2c3fff640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c40fc530 0x7fb2c4071570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40048a0 tx=0x7fb2b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:41.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.122+0000 7fb2c0ff9640 1 -- 172.21.15.119:0/2792414742 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2b4038070 con 0x7fb2c40fc530 2024-09-13T21:50:41.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.122+0000 7fb2c0ff9640 1 -- 172.21.15.119:0/2792414742 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb2b4004290 con 0x7fb2c40fc530 2024-09-13T21:50:41.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.122+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/2792414742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c40703b0 con 0x7fb2c40fc530 2024-09-13T21:50:41.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.122+0000 7fb2c0ff9640 1 -- 172.21.15.119:0/2792414742 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2b4033660 con 0x7fb2c40fc530 2024-09-13T21:50:41.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.122+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/2792414742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c41150e0 con 0x7fb2c40fc530 2024-09-13T21:50:41.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.123+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/2792414742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c404b720 con 0x7fb2c40fc530 2024-09-13T21:50:41.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.124+0000 7fb2c0ff9640 1 -- 172.21.15.119:0/2792414742 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb2b4030020 con 0x7fb2c40fc530 2024-09-13T21:50:41.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.124+0000 7fb2c0ff9640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb2ac06e530 0x7fb2ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.125+0000 7fb2c0ff9640 1 -- 172.21.15.119:0/2792414742 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb2b40ae310 con 0x7fb2c40fc530 2024-09-13T21:50:41.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.125+0000 7fb2c37fe640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb2ac06e530 0x7fb2ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:41.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.125+0000 7fb2c37fe640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb2ac06e530 0x7fb2ac0709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8004ab0 tx=0x7fb2b800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:41.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.129+0000 7fb2c0ff9640 1 -- 172.21.15.119:0/2792414742 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb2b4077450 con 0x7fb2c40fc530 2024-09-13T21:50:41.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.311+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/2792414742 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2c4070540 con 0x7fb2ac06e530 2024-09-13T21:50:41.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.312+0000 7fb2c0ff9640 1 -- 172.21.15.119:0/2792414742 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb2c4070540 con 0x7fb2ac06e530 2024-09-13T21:50:41.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.314+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/2792414742 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb2ac06e530 msgr2=0x7fb2ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.314+0000 7fb2ca5fc640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb2ac06e530 0x7fb2ac0709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8004ab0 tx=0x7fb2b800b040 comp rx=0 tx=0).stop 2024-09-13T21:50:41.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.315+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/2792414742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c40fc530 msgr2=0x7fb2c4071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.315+0000 7fb2ca5fc640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c40fc530 0x7fb2c4071570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40048a0 tx=0x7fb2b4009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.315+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/2792414742 shutdown_connections 2024-09-13T21:50:41.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.315+0000 7fb2ca5fc640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb2ac06e530 0x7fb2ac0709e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.315+0000 7fb2ca5fc640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2c40fd800 0x7fb2c406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.315+0000 7fb2ca5fc640 1 --2- 172.21.15.119:0/2792414742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2c40fc530 0x7fb2c4071570 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.315+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/2792414742 >> 172.21.15.119:0/2792414742 conn(0x7fb2c40f7d10 msgr2=0x7fb2c40f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:41.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.315+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/2792414742 shutdown_connections 2024-09-13T21:50:41.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.315+0000 7fb2ca5fc640 1 -- 172.21.15.119:0/2792414742 wait complete. 2024-09-13T21:50:41.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:41 smithi119 ceph-mon[90896]: pgmap v142: 65 pgs: 65 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:41.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.393+0000 7f3829681640 1 -- 172.21.15.119:0/1100246229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38240fc700 msgr2=0x7f38240fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.393+0000 7f3829681640 1 --2- 172.21.15.119:0/1100246229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38240fc700 0x7f38240fcb70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38180048d0 tx=0x7f3818009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.393+0000 7f3829681640 1 -- 172.21.15.119:0/1100246229 shutdown_connections 2024-09-13T21:50:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.393+0000 7f3829681640 1 --2- 172.21.15.119:0/1100246229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38240fc700 0x7f38240fcb70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.393+0000 7f3829681640 1 --2- 172.21.15.119:0/1100246229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38240fb430 0x7f38240fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.393+0000 7f3829681640 1 -- 172.21.15.119:0/1100246229 >> 172.21.15.119:0/1100246229 conn(0x7f38240f6c10 msgr2=0x7f38240f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.394+0000 7f3829681640 1 -- 172.21.15.119:0/1100246229 shutdown_connections 2024-09-13T21:50:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.394+0000 7f3829681640 1 -- 172.21.15.119:0/1100246229 wait complete. 2024-09-13T21:50:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.394+0000 7f3829681640 1 Processor -- start 2024-09-13T21:50:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.394+0000 7f3829681640 1 -- start start 2024-09-13T21:50:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.394+0000 7f3829681640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38240fb430 0x7f382410fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.394+0000 7f3829681640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38240fc700 0x7f38241122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.394+0000 7f3829681640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824065c60 con 0x7f38240fb430 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.394+0000 7f3829681640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824065dd0 con 0x7f38240fc700 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.394+0000 7f3822ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38240fb430 0x7f382410fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.394+0000 7f3822ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38240fb430 0x7f382410fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53002/0 (socket says 172.21.15.119:53002) 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.395+0000 7f3822ffd640 1 -- 172.21.15.119:0/2086307903 learned_addr learned my addr 172.21.15.119:0/2086307903 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.395+0000 7f38227fc640 1 --2- 172.21.15.119:0/2086307903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38240fc700 0x7f38241122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.395+0000 7f3822ffd640 1 -- 172.21.15.119:0/2086307903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38240fc700 msgr2=0x7f38241122d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.395+0000 7f3822ffd640 1 --2- 172.21.15.119:0/2086307903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38240fc700 0x7f38241122d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.395+0000 7f3822ffd640 1 -- 172.21.15.119:0/2086307903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818005040 con 0x7f38240fb430 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.395+0000 7f3822ffd640 1 --2- 172.21.15.119:0/2086307903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38240fb430 0x7f382410fd80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f381400c830 tx=0x7f3814004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.395+0000 7f380b7fe640 1 -- 172.21.15.119:0/2086307903 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f381400a7d0 con 0x7f38240fb430 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.395+0000 7f380b7fe640 1 -- 172.21.15.119:0/2086307903 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f381400add0 con 0x7f38240fb430 2024-09-13T21:50:41.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.395+0000 7f3829681640 1 -- 172.21.15.119:0/2086307903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3824112870 con 0x7f38240fb430 2024-09-13T21:50:41.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.395+0000 7f380b7fe640 1 -- 172.21.15.119:0/2086307903 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38140113a0 con 0x7f38240fb430 2024-09-13T21:50:41.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.395+0000 7f3829681640 1 -- 172.21.15.119:0/2086307903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3824112de0 con 0x7f38240fb430 2024-09-13T21:50:41.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.396+0000 7f3829681640 1 -- 172.21.15.119:0/2086307903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38240fa890 con 0x7f38240fb430 2024-09-13T21:50:41.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.397+0000 7f380b7fe640 1 -- 172.21.15.119:0/2086307903 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3814012400 con 0x7f38240fb430 2024-09-13T21:50:41.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.397+0000 7f380b7fe640 1 --2- 172.21.15.119:0/2086307903 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f380c06e530 0x7f380c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.397+0000 7f380b7fe640 1 -- 172.21.15.119:0/2086307903 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f381408e230 con 0x7f38240fb430 2024-09-13T21:50:41.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.397+0000 7f38227fc640 1 --2- 172.21.15.119:0/2086307903 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f380c06e530 0x7f380c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:41.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.398+0000 7f38227fc640 1 --2- 172.21.15.119:0/2086307903 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f380c06e530 0x7f380c0709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3818000c00 tx=0x7f3818035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:41.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.401+0000 7f380b7fe640 1 -- 172.21.15.119:0/2086307903 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f38140573f0 con 0x7f38240fb430 2024-09-13T21:50:41.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.577+0000 7f3829681640 1 -- 172.21.15.119:0/2086307903 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3824100bb0 con 0x7f380c06e530 2024-09-13T21:50:41.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:41 smithi155 ceph-mon[79928]: pgmap v142: 65 pgs: 65 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:41.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.586+0000 7f380b7fe640 1 -- 172.21.15.119:0/2086307903 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3824100bb0 con 0x7f380c06e530 2024-09-13T21:50:41.588 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:50:41.588 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (5m) 81s ago 13m 25.9M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:50:41.588 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (3m) 81s ago 13m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (2m) 16s ago 13m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (4m) 81s ago 13m 80.4M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (8m) 81s ago 8m 13.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (8m) 81s ago 8m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (8m) 16s ago 8m 17.0M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (8m) 16s ago 8m 110M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (4m) 81s ago 14m 498M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (4m) 16s ago 12m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (3m) 81s ago 15m 47.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (3m) 16s ago 12m 40.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (5m) 81s ago 13m 16.2M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:50:41.589 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (4m) 16s ago 12m 15.1M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:50:41.590 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (2m) 81s ago 12m 93.3M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:50:41.590 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (2m) 81s ago 11m 93.6M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 8f69bf25cd20 2024-09-13T21:50:41.590 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (86s) 81s ago 11m 11.0M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 0f73e4fc2c43 2024-09-13T21:50:41.590 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (52s) 16s ago 10m 102M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5a7f5a9c1c4d 2024-09-13T21:50:41.590 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (19s) 16s ago 10m 14.5M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 03c992670291 2024-09-13T21:50:41.590 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (9m) 16s ago 9m 224M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 7f54c8bb7f0b 2024-09-13T21:50:41.590 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (4m) 81s ago 13m 51.8M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:50:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.588+0000 7f3829681640 1 -- 172.21.15.119:0/2086307903 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f380c06e530 msgr2=0x7f380c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.588+0000 7f3829681640 1 --2- 172.21.15.119:0/2086307903 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f380c06e530 0x7f380c0709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3818000c00 tx=0x7f3818035040 comp rx=0 tx=0).stop 2024-09-13T21:50:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.588+0000 7f3829681640 1 -- 172.21.15.119:0/2086307903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38240fb430 msgr2=0x7f382410fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.588+0000 7f3829681640 1 --2- 172.21.15.119:0/2086307903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38240fb430 0x7f382410fd80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f381400c830 tx=0x7f3814004430 comp rx=0 tx=0).stop 2024-09-13T21:50:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.588+0000 7f3829681640 1 -- 172.21.15.119:0/2086307903 shutdown_connections 2024-09-13T21:50:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.588+0000 7f3829681640 1 --2- 172.21.15.119:0/2086307903 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f380c06e530 0x7f380c0709e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.588+0000 7f3829681640 1 --2- 172.21.15.119:0/2086307903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38240fc700 0x7f38241122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.588+0000 7f3829681640 1 --2- 172.21.15.119:0/2086307903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38240fb430 0x7f382410fd80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.588+0000 7f3829681640 1 -- 172.21.15.119:0/2086307903 >> 172.21.15.119:0/2086307903 conn(0x7f38240f6c10 msgr2=0x7f38240f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.588+0000 7f3829681640 1 -- 172.21.15.119:0/2086307903 shutdown_connections 2024-09-13T21:50:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.588+0000 7f3829681640 1 -- 172.21.15.119:0/2086307903 wait complete. 2024-09-13T21:50:41.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.666+0000 7f2f2d294640 1 -- 172.21.15.119:0/982024909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f280fc550 msgr2=0x7f2f280fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.666+0000 7f2f2d294640 1 --2- 172.21.15.119:0/982024909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f280fc550 0x7f2f280fc960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009c50 tx=0x7f2f20004d10 comp rx=0 tx=0).stop 2024-09-13T21:50:41.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.666+0000 7f2f2d294640 1 -- 172.21.15.119:0/982024909 shutdown_connections 2024-09-13T21:50:41.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.666+0000 7f2f2d294640 1 --2- 172.21.15.119:0/982024909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fd820 0x7f2f280fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.666+0000 7f2f2d294640 1 --2- 172.21.15.119:0/982024909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f280fc550 0x7f2f280fc960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.666+0000 7f2f2d294640 1 -- 172.21.15.119:0/982024909 >> 172.21.15.119:0/982024909 conn(0x7f2f280f7d30 msgr2=0x7f2f280fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:41.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.666+0000 7f2f2d294640 1 -- 172.21.15.119:0/982024909 shutdown_connections 2024-09-13T21:50:41.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.666+0000 7f2f2d294640 1 -- 172.21.15.119:0/982024909 wait complete. 2024-09-13T21:50:41.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.666+0000 7f2f2d294640 1 Processor -- start 2024-09-13T21:50:41.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f2d294640 1 -- start start 2024-09-13T21:50:41.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f2d294640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fc550 0x7f2f28071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f2d294640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f280fd820 0x7f2f2806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f2d294640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f28070080 con 0x7f2f280fd820 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f2d294640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280701c0 con 0x7f2f280fc550 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f267fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f280fd820 0x7f2f2806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f267fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f280fd820 0x7f2f2806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53008/0 (socket says 172.21.15.119:53008) 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f267fc640 1 -- 172.21.15.119:0/1029194282 learned_addr learned my addr 172.21.15.119:0/1029194282 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f26ffd640 1 --2- 172.21.15.119:0/1029194282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fc550 0x7f2f28071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f267fc640 1 -- 172.21.15.119:0/1029194282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fc550 msgr2=0x7f2f28071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f267fc640 1 --2- 172.21.15.119:0/1029194282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fc550 0x7f2f28071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.667+0000 7f2f267fc640 1 -- 172.21.15.119:0/1029194282 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200098b0 con 0x7f2f280fd820 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.668+0000 7f2f267fc640 1 --2- 172.21.15.119:0/1029194282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f280fd820 0x7f2f2806fa60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000b790 tx=0x7f2f100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:41.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.668+0000 7f2f1f7fe640 1 -- 172.21.15.119:0/1029194282 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f1000c700 con 0x7f2f280fd820 2024-09-13T21:50:41.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.668+0000 7f2f1f7fe640 1 -- 172.21.15.119:0/1029194282 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2f1000cd00 con 0x7f2f280fd820 2024-09-13T21:50:41.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.668+0000 7f2f2d294640 1 -- 172.21.15.119:0/1029194282 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f280704a0 con 0x7f2f280fd820 2024-09-13T21:50:41.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.668+0000 7f2f1f7fe640 1 -- 172.21.15.119:0/1029194282 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f10015e70 con 0x7f2f280fd820 2024-09-13T21:50:41.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.668+0000 7f2f2d294640 1 -- 172.21.15.119:0/1029194282 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f28115180 con 0x7f2f280fd820 2024-09-13T21:50:41.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.669+0000 7f2f2d294640 1 -- 172.21.15.119:0/1029194282 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f280fb9b0 con 0x7f2f280fd820 2024-09-13T21:50:41.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.670+0000 7f2f1f7fe640 1 -- 172.21.15.119:0/1029194282 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2f10012070 con 0x7f2f280fd820 2024-09-13T21:50:41.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.670+0000 7f2f1f7fe640 1 --2- 172.21.15.119:0/1029194282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2f1406e530 0x7f2f140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.670+0000 7f2f1f7fe640 1 -- 172.21.15.119:0/1029194282 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2f1008dad0 con 0x7f2f280fd820 2024-09-13T21:50:41.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.670+0000 7f2f26ffd640 1 --2- 172.21.15.119:0/1029194282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2f1406e530 0x7f2f140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:41.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.671+0000 7f2f26ffd640 1 --2- 172.21.15.119:0/1029194282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2f1406e530 0x7f2f140709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f20004a30 tx=0x7f2f20004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:41.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.674+0000 7f2f1f7fe640 1 -- 172.21.15.119:0/1029194282 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2f1005a740 con 0x7f2f280fd820 2024-09-13T21:50:41.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.907+0000 7f2f2d294640 1 -- 172.21.15.119:0/1029194282 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2f28104fd0 con 0x7f2f280fd820 2024-09-13T21:50:41.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.908+0000 7f2f1f7fe640 1 -- 172.21.15.119:0/1029194282 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f2f1005a2d0 con 0x7f2f280fd820 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 1, 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 5 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:50:41.911 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:50:41.912 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:50:41.912 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:50:41.912 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:50:41.912 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 5, 2024-09-13T21:50:41.912 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 9 2024-09-13T21:50:41.912 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:50:41.912 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:50:41.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.910+0000 7f2f2d294640 1 -- 172.21.15.119:0/1029194282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2f1406e530 msgr2=0x7f2f140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.910+0000 7f2f2d294640 1 --2- 172.21.15.119:0/1029194282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2f1406e530 0x7f2f140709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f20004a30 tx=0x7f2f20004d10 comp rx=0 tx=0).stop 2024-09-13T21:50:41.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.910+0000 7f2f2d294640 1 -- 172.21.15.119:0/1029194282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f280fd820 msgr2=0x7f2f2806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.910+0000 7f2f2d294640 1 --2- 172.21.15.119:0/1029194282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f280fd820 0x7f2f2806fa60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000b790 tx=0x7f2f100091d0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.910+0000 7f2f2d294640 1 -- 172.21.15.119:0/1029194282 shutdown_connections 2024-09-13T21:50:41.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.910+0000 7f2f2d294640 1 --2- 172.21.15.119:0/1029194282 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2f1406e530 0x7f2f140709e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.910+0000 7f2f2d294640 1 --2- 172.21.15.119:0/1029194282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f280fd820 0x7f2f2806fa60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.910+0000 7f2f2d294640 1 --2- 172.21.15.119:0/1029194282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f280fc550 0x7f2f28071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.910+0000 7f2f2d294640 1 -- 172.21.15.119:0/1029194282 >> 172.21.15.119:0/1029194282 conn(0x7f2f280f7d30 msgr2=0x7f2f280f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:41.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.910+0000 7f2f2d294640 1 -- 172.21.15.119:0/1029194282 shutdown_connections 2024-09-13T21:50:41.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.910+0000 7f2f2d294640 1 -- 172.21.15.119:0/1029194282 wait complete. 2024-09-13T21:50:41.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.988+0000 7f5075fb3640 1 -- 172.21.15.119:0/860679489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50700fc520 msgr2=0x7f50700fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.988+0000 7f5075fb3640 1 --2- 172.21.15.119:0/860679489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50700fc520 0x7f50700fc930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50580048d0 tx=0x7f5058009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.989+0000 7f5075fb3640 1 -- 172.21.15.119:0/860679489 shutdown_connections 2024-09-13T21:50:41.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.989+0000 7f5075fb3640 1 --2- 172.21.15.119:0/860679489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50700fd7f0 0x7f50700fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.989+0000 7f5075fb3640 1 --2- 172.21.15.119:0/860679489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50700fc520 0x7f50700fc930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.989+0000 7f5075fb3640 1 -- 172.21.15.119:0/860679489 >> 172.21.15.119:0/860679489 conn(0x7f50700f7ce0 msgr2=0x7f50700fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:41.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.989+0000 7f5075fb3640 1 -- 172.21.15.119:0/860679489 shutdown_connections 2024-09-13T21:50:41.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.989+0000 7f5075fb3640 1 -- 172.21.15.119:0/860679489 wait complete. 2024-09-13T21:50:41.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.989+0000 7f5075fb3640 1 Processor -- start 2024-09-13T21:50:41.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.989+0000 7f5075fb3640 1 -- start start 2024-09-13T21:50:41.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f5075fb3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50700fc520 0x7f5070071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f5075fb3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50700fd7f0 0x7f507006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f5075fb3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507006fff0 con 0x7f50700fc520 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f5075fb3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5070070130 con 0x7f50700fd7f0 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f506f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50700fc520 0x7f5070071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f506f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50700fc520 0x7f5070071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53020/0 (socket says 172.21.15.119:53020) 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f506f7fe640 1 -- 172.21.15.119:0/2798738784 learned_addr learned my addr 172.21.15.119:0/2798738784 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f506f7fe640 1 -- 172.21.15.119:0/2798738784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50700fd7f0 msgr2=0x7f507006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f506f7fe640 1 --2- 172.21.15.119:0/2798738784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50700fd7f0 0x7f507006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f506f7fe640 1 -- 172.21.15.119:0/2798738784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058005040 con 0x7f50700fc520 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f506f7fe640 1 --2- 172.21.15.119:0/2798738784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50700fc520 0x7f5070071570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50580043d0 tx=0x7f5058009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f5067fff640 1 -- 172.21.15.119:0/2798738784 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5058038070 con 0x7f50700fc520 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f5075fb3640 1 -- 172.21.15.119:0/2798738784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50700703b0 con 0x7f50700fc520 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f5067fff640 1 -- 172.21.15.119:0/2798738784 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f505802ae90 con 0x7f50700fc520 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f5067fff640 1 -- 172.21.15.119:0/2798738784 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f505803e670 con 0x7f50700fc520 2024-09-13T21:50:41.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.990+0000 7f5075fb3640 1 -- 172.21.15.119:0/2798738784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5070115100 con 0x7f50700fc520 2024-09-13T21:50:41.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.992+0000 7f5075fb3640 1 -- 172.21.15.119:0/2798738784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50700fb980 con 0x7f50700fc520 2024-09-13T21:50:41.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.992+0000 7f5067fff640 1 -- 172.21.15.119:0/2798738784 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5058030020 con 0x7f50700fc520 2024-09-13T21:50:41.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.992+0000 7f5067fff640 1 --2- 172.21.15.119:0/2798738784 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f505c06e530 0x7f505c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:41.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.993+0000 7f5067fff640 1 -- 172.21.15.119:0/2798738784 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f50580ae3e0 con 0x7f50700fc520 2024-09-13T21:50:41.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.993+0000 7f506effd640 1 --2- 172.21.15.119:0/2798738784 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f505c06e530 0x7f505c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:41.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.993+0000 7f506effd640 1 --2- 172.21.15.119:0/2798738784 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f505c06e530 0x7f505c0709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5060004c80 tx=0x7f5060009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:41.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:41.997+0000 7f5067fff640 1 -- 172.21.15.119:0/2798738784 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5058078410 con 0x7f50700fc520 2024-09-13T21:50:42.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.200+0000 7f5075fb3640 1 -- 172.21.15.119:0/2798738784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5070104f50 con 0x7f50700fc520 2024-09-13T21:50:42.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.200+0000 7f5067fff640 1 -- 172.21.15.119:0/2798738784 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1943 (secure 0 0 0) 0x7f505802c3a0 con 0x7f50700fc520 2024-09-13T21:50:42.203 INFO:teuthology.orchestra.run.smithi119.stdout:e22 2024-09-13T21:50:42.203 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:48:12:719560+0000 2024-09-13T21:50:42.203 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:50:42.203 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:50:42.203 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:50:42.203 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 22 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:48:12.175306+0000 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:50:42.204 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:50:42.205 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:50:42.206 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:50:42.206 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 14472 members: 24267,14472 2024-09-13T21:50:42.206 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:50:42.206 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:50:42.206 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:50:42.206 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:50:42.206 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:50:42.206 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:50:42.206 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:50:42.206 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:50:42.207 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 22 2024-09-13T21:50:42.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.202+0000 7f5075fb3640 1 -- 172.21.15.119:0/2798738784 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f505c06e530 msgr2=0x7f505c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:42.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.202+0000 7f5075fb3640 1 --2- 172.21.15.119:0/2798738784 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f505c06e530 0x7f505c0709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5060004c80 tx=0x7f5060009c50 comp rx=0 tx=0).stop 2024-09-13T21:50:42.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.202+0000 7f5075fb3640 1 -- 172.21.15.119:0/2798738784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50700fc520 msgr2=0x7f5070071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:42.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.202+0000 7f5075fb3640 1 --2- 172.21.15.119:0/2798738784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50700fc520 0x7f5070071570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50580043d0 tx=0x7f5058009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.202+0000 7f5075fb3640 1 -- 172.21.15.119:0/2798738784 shutdown_connections 2024-09-13T21:50:42.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.202+0000 7f5075fb3640 1 --2- 172.21.15.119:0/2798738784 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f505c06e530 0x7f505c0709e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.202+0000 7f5075fb3640 1 --2- 172.21.15.119:0/2798738784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50700fd7f0 0x7f507006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.202+0000 7f5075fb3640 1 --2- 172.21.15.119:0/2798738784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50700fc520 0x7f5070071570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.202+0000 7f5075fb3640 1 -- 172.21.15.119:0/2798738784 >> 172.21.15.119:0/2798738784 conn(0x7f50700f7ce0 msgr2=0x7f50700f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:42.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.202+0000 7f5075fb3640 1 -- 172.21.15.119:0/2798738784 shutdown_connections 2024-09-13T21:50:42.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.203+0000 7f5075fb3640 1 -- 172.21.15.119:0/2798738784 wait complete. 2024-09-13T21:50:42.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.281+0000 7f777a775640 1 -- 172.21.15.119:0/4242652873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740fc520 msgr2=0x7f77740fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:42.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.281+0000 7f777a775640 1 --2- 172.21.15.119:0/4242652873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740fc520 0x7f77740fc930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f77640048d0 tx=0x7f7764009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 -- 172.21.15.119:0/4242652873 shutdown_connections 2024-09-13T21:50:42.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 --2- 172.21.15.119:0/4242652873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77740fd7f0 0x7f77740fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 --2- 172.21.15.119:0/4242652873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740fc520 0x7f77740fc930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 -- 172.21.15.119:0/4242652873 >> 172.21.15.119:0/4242652873 conn(0x7f77740f7ce0 msgr2=0x7f77740fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:42.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 -- 172.21.15.119:0/4242652873 shutdown_connections 2024-09-13T21:50:42.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 -- 172.21.15.119:0/4242652873 wait complete. 2024-09-13T21:50:42.285 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:42 smithi119 ceph-mon[90896]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:42.285 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:42 smithi119 ceph-mon[90896]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:42.285 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:42 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1029194282' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:42.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 Processor -- start 2024-09-13T21:50:42.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 -- start start 2024-09-13T21:50:42.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740fc520 0x7f777410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:42.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77740fd7f0 0x7f777410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:42.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777410dc10 con 0x7f77740fc520 2024-09-13T21:50:42.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.282+0000 7f777a775640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777410e430 con 0x7f77740fd7f0 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f7773fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740fc520 0x7f777410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f7773fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740fc520 0x7f777410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53040/0 (socket says 172.21.15.119:53040) 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f7773fff640 1 -- 172.21.15.119:0/1617462886 learned_addr learned my addr 172.21.15.119:0/1617462886 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f77737fe640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77740fd7f0 0x7f777410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f7773fff640 1 -- 172.21.15.119:0/1617462886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77740fd7f0 msgr2=0x7f777410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f7773fff640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77740fd7f0 0x7f777410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f7773fff640 1 -- 172.21.15.119:0/1617462886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7764005040 con 0x7f77740fc520 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f77737fe640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77740fd7f0 0x7f777410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f7773fff640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740fc520 0x7f777410d080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f77640043d0 tx=0x7f7764009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f7770ff9640 1 -- 172.21.15.119:0/1617462886 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7764038070 con 0x7f77740fc520 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f7770ff9640 1 -- 172.21.15.119:0/1617462886 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f776402ae90 con 0x7f77740fc520 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f777a775640 1 -- 172.21.15.119:0/1617462886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777410e660 con 0x7f77740fc520 2024-09-13T21:50:42.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.283+0000 7f7770ff9640 1 -- 172.21.15.119:0/1617462886 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f776403e670 con 0x7f77740fc520 2024-09-13T21:50:42.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.284+0000 7f777a775640 1 -- 172.21.15.119:0/1617462886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777410ec00 con 0x7f77740fc520 2024-09-13T21:50:42.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.285+0000 7f777a775640 1 -- 172.21.15.119:0/1617462886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77740fb980 con 0x7f77740fc520 2024-09-13T21:50:42.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.285+0000 7f7770ff9640 1 -- 172.21.15.119:0/1617462886 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7764030020 con 0x7f77740fc520 2024-09-13T21:50:42.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.286+0000 7f7770ff9640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f775c06e530 0x7f775c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:42.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.286+0000 7f7770ff9640 1 -- 172.21.15.119:0/1617462886 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f77640ae3d0 con 0x7f77740fc520 2024-09-13T21:50:42.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.286+0000 7f77737fe640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f775c06e530 0x7f775c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:42.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.286+0000 7f77737fe640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f775c06e530 0x7f775c0709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7768009fd0 tx=0x7f7768009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:42.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.290+0000 7f7770ff9640 1 -- 172.21.15.119:0/1617462886 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7764077510 con 0x7f77740fc520 2024-09-13T21:50:42.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.471+0000 7f777a775640 1 -- 172.21.15.119:0/1617462886 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f777410ef30 con 0x7f775c06e530 2024-09-13T21:50:42.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.472+0000 7f7770ff9640 1 -- 172.21.15.119:0/1617462886 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f777410ef30 con 0x7f775c06e530 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout: "crash", 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr", 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout: "mon" 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "11/21 daemons upgraded", 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:50:42.475 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:50:42.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.474+0000 7f777a775640 1 -- 172.21.15.119:0/1617462886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f775c06e530 msgr2=0x7f775c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:42.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.474+0000 7f777a775640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f775c06e530 0x7f775c0709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7768009fd0 tx=0x7f7768009e50 comp rx=0 tx=0).stop 2024-09-13T21:50:42.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.474+0000 7f777a775640 1 -- 172.21.15.119:0/1617462886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740fc520 msgr2=0x7f777410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:42.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.474+0000 7f777a775640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740fc520 0x7f777410d080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f77640043d0 tx=0x7f7764009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.474+0000 7f777a775640 1 -- 172.21.15.119:0/1617462886 shutdown_connections 2024-09-13T21:50:42.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.474+0000 7f777a775640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f775c06e530 0x7f775c0709e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.474+0000 7f777a775640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77740fd7f0 0x7f777410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.474+0000 7f777a775640 1 --2- 172.21.15.119:0/1617462886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740fc520 0x7f777410d080 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.474+0000 7f777a775640 1 -- 172.21.15.119:0/1617462886 >> 172.21.15.119:0/1617462886 conn(0x7f77740f7ce0 msgr2=0x7f77740f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:42.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.475+0000 7f777a775640 1 -- 172.21.15.119:0/1617462886 shutdown_connections 2024-09-13T21:50:42.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.475+0000 7f777a775640 1 -- 172.21.15.119:0/1617462886 wait complete. 2024-09-13T21:50:42.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.552+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1668320474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe280fb2b0 msgr2=0x7efe280fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:42.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.552+0000 7efe2f1bc640 1 --2- 172.21.15.119:0/1668320474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe280fb2b0 0x7efe280fdb30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efe140048d0 tx=0x7efe14009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.552+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1668320474 shutdown_connections 2024-09-13T21:50:42.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.552+0000 7efe2f1bc640 1 --2- 172.21.15.119:0/1668320474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe280fb2b0 0x7efe280fdb30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.552+0000 7efe2f1bc640 1 --2- 172.21.15.119:0/1668320474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe280fa960 0x7efe280fad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.552+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1668320474 >> 172.21.15.119:0/1668320474 conn(0x7efe280f63a0 msgr2=0x7efe280f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:42.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.552+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1668320474 shutdown_connections 2024-09-13T21:50:42.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.552+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1668320474 wait complete. 2024-09-13T21:50:42.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.552+0000 7efe2f1bc640 1 Processor -- start 2024-09-13T21:50:42.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe2f1bc640 1 -- start start 2024-09-13T21:50:42.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe2f1bc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe280fa960 0x7efe2810d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:42.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe2f1bc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe280fb2b0 0x7efe2810d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:42.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe2f1bc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2810dec0 con 0x7efe280fa960 2024-09-13T21:50:42.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe2f1bc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2810e6e0 con 0x7efe280fb2b0 2024-09-13T21:50:42.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe2cf58640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe280fa960 0x7efe2810d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe2cf58640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe280fa960 0x7efe2810d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53058/0 (socket says 172.21.15.119:53058) 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe2cf58640 1 -- 172.21.15.119:0/1509393344 learned_addr learned my addr 172.21.15.119:0/1509393344 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe27fff640 1 --2- 172.21.15.119:0/1509393344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe280fb2b0 0x7efe2810d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe2cf58640 1 -- 172.21.15.119:0/1509393344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe280fb2b0 msgr2=0x7efe2810d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe2cf58640 1 --2- 172.21.15.119:0/1509393344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe280fb2b0 0x7efe2810d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.553+0000 7efe2cf58640 1 -- 172.21.15.119:0/1509393344 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe14005040 con 0x7efe280fa960 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.554+0000 7efe2cf58640 1 --2- 172.21.15.119:0/1509393344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe280fa960 0x7efe2810d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe1c002a50 tx=0x7efe1c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.554+0000 7efe257fa640 1 -- 172.21.15.119:0/1509393344 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe1c007c30 con 0x7efe280fa960 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.554+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1509393344 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2810e970 con 0x7efe280fa960 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.554+0000 7efe257fa640 1 -- 172.21.15.119:0/1509393344 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efe1c00f040 con 0x7efe280fa960 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.554+0000 7efe257fa640 1 -- 172.21.15.119:0/1509393344 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe1c00da90 con 0x7efe280fa960 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.554+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1509393344 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2810ef10 con 0x7efe280fa960 2024-09-13T21:50:42.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.555+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1509393344 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe280fa040 con 0x7efe280fa960 2024-09-13T21:50:42.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.556+0000 7efe257fa640 1 -- 172.21.15.119:0/1509393344 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7efe1c00dd00 con 0x7efe280fa960 2024-09-13T21:50:42.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.556+0000 7efe257fa640 1 --2- 172.21.15.119:0/1509393344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe1806e530 0x7efe180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:50:42.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.556+0000 7efe257fa640 1 -- 172.21.15.119:0/1509393344 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efe1c08da40 con 0x7efe280fa960 2024-09-13T21:50:42.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.556+0000 7efe27fff640 1 --2- 172.21.15.119:0/1509393344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe1806e530 0x7efe180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:50:42.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.557+0000 7efe27fff640 1 --2- 172.21.15.119:0/1509393344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe1806e530 0x7efe180709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efe14000c00 tx=0x7efe14009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:50:42.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.561+0000 7efe257fa640 1 -- 172.21.15.119:0/1509393344 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efe1c056b80 con 0x7efe280fa960 2024-09-13T21:50:42.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:42 smithi155 ceph-mon[79928]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:42.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:42 smithi155 ceph-mon[79928]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:42.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:42 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1029194282' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:50:42.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.791+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1509393344 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efe2804b720 con 0x7efe280fa960 2024-09-13T21:50:42.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.791+0000 7efe257fa640 1 -- 172.21.15.119:0/1509393344 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7efe1c05a240 con 0x7efe280fa960 2024-09-13T21:50:42.794 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:50:42.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.793+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1509393344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe1806e530 msgr2=0x7efe180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:42.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.793+0000 7efe2f1bc640 1 --2- 172.21.15.119:0/1509393344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe1806e530 0x7efe180709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efe14000c00 tx=0x7efe14009da0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.793+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1509393344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe280fa960 msgr2=0x7efe2810d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:50:42.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.793+0000 7efe2f1bc640 1 --2- 172.21.15.119:0/1509393344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe280fa960 0x7efe2810d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe1c002a50 tx=0x7efe1c004600 comp rx=0 tx=0).stop 2024-09-13T21:50:42.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.793+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1509393344 shutdown_connections 2024-09-13T21:50:42.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.793+0000 7efe2f1bc640 1 --2- 172.21.15.119:0/1509393344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe1806e530 0x7efe180709e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.793+0000 7efe2f1bc640 1 --2- 172.21.15.119:0/1509393344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe280fb2b0 0x7efe2810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.793+0000 7efe2f1bc640 1 --2- 172.21.15.119:0/1509393344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe280fa960 0x7efe2810d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:50:42.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.793+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1509393344 >> 172.21.15.119:0/1509393344 conn(0x7efe280f63a0 msgr2=0x7efe280f7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:50:42.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.793+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1509393344 shutdown_connections 2024-09-13T21:50:42.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:50:42.794+0000 7efe2f1bc640 1 -- 172.21.15.119:0/1509393344 wait complete. 2024-09-13T21:50:43.484 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:43 smithi155 ceph-mon[79928]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:43.484 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:43 smithi155 ceph-mon[79928]: pgmap v143: 65 pgs: 65 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:43.485 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:43 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2798738784' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:50:43.485 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:43 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1509393344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:50:43.505 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:43 smithi119 ceph-mon[90896]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:43.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:43 smithi119 ceph-mon[90896]: pgmap v143: 65 pgs: 65 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:43.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:43 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2798738784' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:50:43.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:43 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1509393344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:50:44.461 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:44 smithi155 ceph-mon[79928]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:44.461 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:44 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:50:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:44 smithi119 ceph-mon[90896]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:50:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:44 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:50:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:45 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:50:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:45 smithi155 ceph-mon[79928]: Upgrade: osd.5 is safe to restart 2024-09-13T21:50:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:45 smithi155 ceph-mon[79928]: pgmap v144: 65 pgs: 65 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:45 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T21:50:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:45 smithi119 ceph-mon[90896]: Upgrade: osd.5 is safe to restart 2024-09-13T21:50:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:45 smithi119 ceph-mon[90896]: pgmap v144: 65 pgs: 65 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:46 smithi155 ceph-mon[79928]: Upgrade: Updating osd.5 2024-09-13T21:50:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:46 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:46 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:50:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:46 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:46 smithi155 ceph-mon[79928]: Deploying daemon osd.5 on smithi155 2024-09-13T21:50:46.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:46 smithi119 ceph-mon[90896]: Upgrade: Updating osd.5 2024-09-13T21:50:46.633 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:46 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:46.633 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:46 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T21:50:46.633 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:46 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:50:46.633 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:46 smithi119 ceph-mon[90896]: Deploying daemon osd.5 on smithi155 2024-09-13T21:50:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:47 smithi155 ceph-mon[79928]: pgmap v145: 65 pgs: 65 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:47 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:47.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:47 smithi119 ceph-mon[90896]: pgmap v145: 65 pgs: 65 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:47 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:48.542 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:48 smithi155 systemd[1]: Stopping Ceph osd.5 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:50:48.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[53534]: 2024-09-13T21:50:48.540+0000 7f4fe970a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T21:50:48.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[53534]: 2024-09-13T21:50:48.540+0000 7f4fe970a640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-13T21:50:48.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[53534]: 2024-09-13T21:50:48.540+0000 7f4fe970a640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T21:50:49.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:49 smithi119 ceph-mon[90896]: pgmap v146: 65 pgs: 65 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:49.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:49 smithi119 ceph-mon[90896]: osd.5 marked itself down and dead 2024-09-13T21:50:49.739 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:49 smithi155 ceph-mon[79928]: pgmap v146: 65 pgs: 65 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:49.739 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:49 smithi155 ceph-mon[79928]: osd.5 marked itself down and dead 2024-09-13T21:50:50.041 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:49 smithi155 podman[98578]: 2024-09-13 21:50:49.739102915 +0000 UTC m=+1.307026181 container died 7f54c8bb7f0ba16274d03d8ff3f96d3bc82db8e3c7bf955c8bfd00ec7f1489e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-eb16b97, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-13T21:50:50.333 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:50 smithi155 podman[98578]: 2024-09-13 21:50:50.248963141 +0000 UTC m=+1.816886408 container cleanup 7f54c8bb7f0ba16274d03d8ff3f96d3bc82db8e3c7bf955c8bfd00ec7f1489e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=quincy-eb16b97, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T21:50:50.333 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:50 smithi155 bash[98578]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5 2024-09-13T21:50:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:50 smithi119 ceph-mon[90896]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:50:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:50 smithi119 ceph-mon[90896]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T21:50:50.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:50 smithi119 ceph-mon[90896]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T21:50:50.803 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:50 smithi155 ceph-mon[79928]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T21:50:50.803 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:50 smithi155 ceph-mon[79928]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T21:50:50.803 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:50 smithi155 ceph-mon[79928]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T21:50:50.803 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:50 smithi155 podman[98599]: 2024-09-13 21:50:50.492180868 +0000 UTC m=+0.748568031 container remove 7f54c8bb7f0ba16274d03d8ff3f96d3bc82db8e3c7bf955c8bfd00ec7f1489e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=quincy-eb16b97, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T21:50:51.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:50 smithi155 podman[98684]: 2024-09-13 21:50:50.705351802 +0000 UTC m=+0.015960300 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:50:51.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:50 smithi155 podman[98684]: 2024-09-13 21:50:50.809753889 +0000 UTC m=+0.120362376 container create 064bea7688a03bd7d64b51ae90050b90fb0244ba2536196e8c991557d0ff710b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T21:50:51.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:51 smithi155 podman[98684]: 2024-09-13 21:50:51.012279232 +0000 UTC m=+0.322887725 container init 064bea7688a03bd7d64b51ae90050b90fb0244ba2536196e8c991557d0ff710b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be) 2024-09-13T21:50:51.084 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:51 smithi155 podman[98684]: 2024-09-13 21:50:51.015562871 +0000 UTC m=+0.326171364 container start 064bea7688a03bd7d64b51ae90050b90fb0244ba2536196e8c991557d0ff710b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-13T21:50:51.347 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:51 smithi155 podman[98684]: 2024-09-13 21:50:51.095347528 +0000 UTC m=+0.405956025 container attach 064bea7688a03bd7d64b51ae90050b90fb0244ba2536196e8c991557d0ff710b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T21:50:51.347 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:51 smithi155 podman[98684]: 2024-09-13 21:50:51.200769558 +0000 UTC m=+0.511378045 container died 064bea7688a03bd7d64b51ae90050b90fb0244ba2536196e8c991557d0ff710b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be) 2024-09-13T21:50:51.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:51 smithi119 ceph-mon[90896]: pgmap v148: 65 pgs: 6 peering, 10 stale+active+clean, 49 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:51 smithi119 ceph-mon[90896]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T21:50:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:51 smithi119 ceph-mon[90896]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T21:50:51.816 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:51 smithi155 ceph-mon[79928]: pgmap v148: 65 pgs: 6 peering, 10 stale+active+clean, 49 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T21:50:51.816 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:51 smithi155 ceph-mon[79928]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T21:50:51.817 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:51 smithi155 ceph-mon[79928]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T21:50:52.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:51 smithi155 podman[98709]: 2024-09-13 21:50:51.815687835 +0000 UTC m=+0.609065571 container remove 064bea7688a03bd7d64b51ae90050b90fb0244ba2536196e8c991557d0ff710b (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-13T21:50:52.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:51 smithi155 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-13T21:50:52.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:51 smithi155 systemd[1]: Stopped Ceph osd.5 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:50:52.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:51 smithi155 systemd[1]: ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 3.547s CPU time. 2024-09-13T21:50:52.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:52 smithi155 systemd[1]: Starting Ceph osd.5 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T21:50:52.520 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:52 smithi155 podman[98807]: 2024-09-13 21:50:52.148362095 +0000 UTC m=+0.015579219 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:50:52.520 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:52 smithi155 podman[98807]: 2024-09-13 21:50:52.27509103 +0000 UTC m=+0.142308148 container create 8ef4217f0f101e6dba86a5ab6fa37b2e0cf4acc6c959ca19d8dafa2a370d0c5c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T21:50:52.520 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:52 smithi155 podman[98807]: 2024-09-13 21:50:52.519160491 +0000 UTC m=+0.386377615 container init 8ef4217f0f101e6dba86a5ab6fa37b2e0cf4acc6c959ca19d8dafa2a370d0c5c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS) 2024-09-13T21:50:52.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:52 smithi155 podman[98807]: 2024-09-13 21:50:52.522610436 +0000 UTC m=+0.389827557 container start 8ef4217f0f101e6dba86a5ab6fa37b2e0cf4acc6c959ca19d8dafa2a370d0c5c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T21:50:52.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:52 smithi155 podman[98807]: 2024-09-13 21:50:52.602305634 +0000 UTC m=+0.469522767 container attach 8ef4217f0f101e6dba86a5ab6fa37b2e0cf4acc6c959ca19d8dafa2a370d0c5c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-13T21:50:52.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:52 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate[98823]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:50:52.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:52 smithi155 bash[98807]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:50:52.834 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:52 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate[98823]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:50:52.834 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:52 smithi155 bash[98807]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T21:50:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:53 smithi155 ceph-mon[79928]: pgmap v150: 65 pgs: 4 active+undersized, 6 peering, 6 stale+active+clean, 3 active+undersized+degraded, 46 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/318 objects degraded (2.201%) 2024-09-13T21:50:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:53.583 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate[98823]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T21:50:53.584 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 bash[98807]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T21:50:53.584 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate[98823]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T21:50:53.584 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 bash[98807]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T21:50:53.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:53.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:53 smithi119 ceph-mon[90896]: pgmap v150: 65 pgs: 4 active+undersized, 6 peering, 6 stale+active+clean, 3 active+undersized+degraded, 46 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/318 objects degraded (2.201%) 2024-09-13T21:50:53.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:50:53.989 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate[98823]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T21:50:53.989 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 bash[98807]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T21:50:53.989 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate[98823]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T21:50:53.989 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 bash[98807]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T21:50:53.989 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate[98823]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T21:50:53.990 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 bash[98807]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T21:50:53.990 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate[98823]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T21:50:53.990 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 bash[98807]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T21:50:53.990 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate[98823]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T21:50:53.990 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 bash[98807]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T21:50:53.990 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:53 smithi155 podman[98807]: 2024-09-13 21:50:53.697806754 +0000 UTC m=+1.565023874 container died 8ef4217f0f101e6dba86a5ab6fa37b2e0cf4acc6c959ca19d8dafa2a370d0c5c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T21:50:54.281 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:54 smithi155 ceph-mon[79928]: Health check failed: Degraded data redundancy: 7/318 objects degraded (2.201%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T21:50:54.583 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:54 smithi155 podman[98968]: 2024-09-13 21:50:54.281034513 +0000 UTC m=+0.577145786 container remove 8ef4217f0f101e6dba86a5ab6fa37b2e0cf4acc6c959ca19d8dafa2a370d0c5c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T21:50:54.583 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:54 smithi155 podman[99029]: 2024-09-13 21:50:54.388222003 +0000 UTC m=+0.015882825 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T21:50:54.583 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:54 smithi155 podman[99029]: 2024-09-13 21:50:54.490162025 +0000 UTC m=+0.117822842 container create bf54ed40f20f09eb7c5302894ac692ab91fb32f625cf362c5772da2ac65942c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T21:50:54.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:54 smithi119 ceph-mon[90896]: Health check failed: Degraded data redundancy: 7/318 objects degraded (2.201%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T21:50:55.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:54 smithi155 podman[99029]: 2024-09-13 21:50:54.71754133 +0000 UTC m=+0.345202148 container init bf54ed40f20f09eb7c5302894ac692ab91fb32f625cf362c5772da2ac65942c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be) 2024-09-13T21:50:55.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:54 smithi155 podman[99029]: 2024-09-13 21:50:54.720737829 +0000 UTC m=+0.348398648 container start bf54ed40f20f09eb7c5302894ac692ab91fb32f625cf362c5772da2ac65942c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T21:50:55.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:54 smithi155 ceph-osd[99047]: -- 172.21.15.155:0/2271820585 <== mon.1 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5625c5cae1e0 con 0x5625c4e5bc00 2024-09-13T21:50:55.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:54 smithi155 bash[99029]: bf54ed40f20f09eb7c5302894ac692ab91fb32f625cf362c5772da2ac65942c2 2024-09-13T21:50:55.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:54 smithi155 systemd[1]: Started Ceph osd.5 for f9722044-7217-11ef-bceb-c7b262605968. 2024-09-13T21:50:55.524 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:55 smithi155 ceph-mon[79928]: pgmap v151: 65 pgs: 10 active+undersized, 6 peering, 12 active+undersized+degraded, 37 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/318 objects degraded (13.522%) 2024-09-13T21:50:55.524 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:55.524 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:55.524 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:55 smithi119 ceph-mon[90896]: pgmap v151: 65 pgs: 10 active+undersized, 6 peering, 12 active+undersized+degraded, 37 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/318 objects degraded (13.522%) 2024-09-13T21:50:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:50:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:56 smithi155 ceph-mon[79928]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T21:50:56.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:56 smithi119 ceph-mon[90896]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T21:50:57.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:50:56 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T21:50:56.602+0000 7eff0ed3c640 -1 Falling back to public interface 2024-09-13T21:50:57.394 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:57 smithi155 ceph-mon[79928]: pgmap v152: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:50:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:57 smithi119 ceph-mon[90896]: pgmap v152: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:50:58.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:58 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:58.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:58 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:58.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:58 smithi119 ceph-mon[90896]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:50:58.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:58 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:58.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:50:58 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:58.915 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:58 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:58.915 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:58 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:58.916 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:58 smithi155 ceph-mon[79928]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:50:58.916 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:58 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:50:58.916 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:50:58 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:01 smithi155 ceph-mon[79928]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:51:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:01 smithi155 ceph-mon[79928]: Health check update: Degraded data redundancy: 50/318 objects degraded (15.723%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T21:51:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:01 smithi119 ceph-mon[90896]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:51:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:01 smithi119 ceph-mon[90896]: Health check update: Degraded data redundancy: 50/318 objects degraded (15.723%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T21:51:02.583 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T21:51:02.295+0000 7eff0ed3c640 -1 osd.5 72 log_to_monitors true 2024-09-13T21:51:03.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T21:51:02.821+0000 7eff06ad6640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: Upgrade: Setting container_image for all osd 2024-09-13T21:51:03.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T21:51:03.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T21:51:03.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T21:51:03.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T21:51:03.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: pgmap v155: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:51:03.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='osd.5 [v2:172.21.15.155:6816/1689157657,v1:172.21.15.155:6817/1689157657]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:51:03.086 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:02 smithi155 ceph-mon[79928]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:51:03.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:03.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:03.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: Upgrade: Setting container_image for all osd 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T21:51:03.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: pgmap v155: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 252 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='osd.5 [v2:172.21.15.155:6816/1689157657,v1:172.21.15.155:6817/1689157657]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:51:03.132 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:02 smithi119 ceph-mon[90896]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T21:51:04.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:03 smithi155 ceph-mon[79928]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T21:51:04.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:03 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T21:51:04.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:03 smithi155 ceph-mon[79928]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T21:51:04.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:03 smithi155 ceph-mon[79928]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T21:51:04.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:03 smithi155 ceph-mon[79928]: from='osd.5 [v2:172.21.15.155:6816/1689157657,v1:172.21.15.155:6817/1689157657]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:51:04.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:03 smithi155 ceph-mon[79928]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:51:04.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:03 smithi155 ceph-mon[79928]: Upgrade: Scaling down filesystem cephfs 2024-09-13T21:51:04.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:03 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:04.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:03 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T21:51:04.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:03 smithi119 ceph-mon[90896]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T21:51:04.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:03 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T21:51:04.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:03 smithi119 ceph-mon[90896]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T21:51:04.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:03 smithi119 ceph-mon[90896]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T21:51:04.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:03 smithi119 ceph-mon[90896]: from='osd.5 [v2:172.21.15.155:6816/1689157657,v1:172.21.15.155:6817/1689157657]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:51:04.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:03 smithi119 ceph-mon[90896]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-13T21:51:04.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:03 smithi119 ceph-mon[90896]: Upgrade: Scaling down filesystem cephfs 2024-09-13T21:51:04.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:03 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:04.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:03 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T21:51:05.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:51:05.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: osd.5 [v2:172.21.15.155:6816/1689157657,v1:172.21.15.155:6817/1689157657] boot 2024-09-13T21:51:05.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: osdmap e76: 6 total, 6 up, 6 in 2024-09-13T21:51:05.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: stopping daemon mds.cephfs.smithi155.yblkxo 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:stopping} 2 up:standby 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:05.084 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T21:51:05.085 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:04 smithi155 ceph-mon[79928]: pgmap v158: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:51:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T21:51:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: osd.5 [v2:172.21.15.155:6816/1689157657,v1:172.21.15.155:6817/1689157657] boot 2024-09-13T21:51:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: osdmap e76: 6 total, 6 up, 6 in 2024-09-13T21:51:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T21:51:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T21:51:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: stopping daemon mds.cephfs.smithi155.yblkxo 2024-09-13T21:51:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:active} 2 up:standby 2024-09-13T21:51:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:stopping} 2 up:standby 2024-09-13T21:51:05.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:05.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:05.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:05.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:05.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:05.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:05.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:05.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T21:51:05.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:04 smithi119 ceph-mon[90896]: pgmap v158: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 50/318 objects degraded (15.723%) 2024-09-13T21:51:06.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:05 smithi155 ceph-mon[79928]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T21:51:06.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:05 smithi119 ceph-mon[90896]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T21:51:07.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:06 smithi155 ceph-mon[79928]: pgmap v160: 65 pgs: 3 peering, 12 active+undersized, 13 active+undersized+degraded, 37 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 46/318 objects degraded (14.465%) 2024-09-13T21:51:07.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:06 smithi119 ceph-mon[90896]: pgmap v160: 65 pgs: 3 peering, 12 active+undersized, 13 active+undersized+degraded, 37 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 46/318 objects degraded (14.465%) 2024-09-13T21:51:08.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:07 smithi155 ceph-mon[79928]: Health check update: Degraded data redundancy: 46/318 objects degraded (14.465%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T21:51:08.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:08.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:08.129 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:07 smithi119 ceph-mon[90896]: Health check update: Degraded data redundancy: 46/318 objects degraded (14.465%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T21:51:08.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:08.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:09.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:08 smithi155 ceph-mon[79928]: pgmap v161: 65 pgs: 3 peering, 3 active+undersized, 6 active+undersized+degraded, 53 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s; 27/318 objects degraded (8.491%) 2024-09-13T21:51:09.130 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:08 smithi119 ceph-mon[90896]: pgmap v161: 65 pgs: 3 peering, 3 active+undersized, 6 active+undersized+degraded, 53 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s; 27/318 objects degraded (8.491%) 2024-09-13T21:51:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:10 smithi155 ceph-mon[79928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/318 objects degraded (8.491%), 6 pgs degraded) 2024-09-13T21:51:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:10 smithi155 ceph-mon[79928]: Cluster is now healthy 2024-09-13T21:51:10.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:10 smithi119 ceph-mon[90896]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/318 objects degraded (8.491%), 6 pgs degraded) 2024-09-13T21:51:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:10 smithi119 ceph-mon[90896]: Cluster is now healthy 2024-09-13T21:51:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:11 smithi155 ceph-mon[79928]: pgmap v162: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 0 op/s 2024-09-13T21:51:11.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:11 smithi119 ceph-mon[90896]: pgmap v162: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 0 op/s 2024-09-13T21:51:12.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.886+0000 7f0e77c99640 1 -- 172.21.15.119:0/3085570862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e700fd800 msgr2=0x7f0e700fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:12.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.886+0000 7f0e77c99640 1 --2- 172.21.15.119:0/3085570862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e700fd800 0x7f0e700fdc70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0048d0 tx=0x7f0e6c009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:12.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.886+0000 7f0e77c99640 1 -- 172.21.15.119:0/3085570862 shutdown_connections 2024-09-13T21:51:12.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.886+0000 7f0e77c99640 1 --2- 172.21.15.119:0/3085570862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e700fd800 0x7f0e700fdc70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.886+0000 7f0e77c99640 1 --2- 172.21.15.119:0/3085570862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e700fc530 0x7f0e700fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.886+0000 7f0e77c99640 1 -- 172.21.15.119:0/3085570862 >> 172.21.15.119:0/3085570862 conn(0x7f0e700f7d10 msgr2=0x7f0e700fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.886+0000 7f0e77c99640 1 -- 172.21.15.119:0/3085570862 shutdown_connections 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.886+0000 7f0e77c99640 1 -- 172.21.15.119:0/3085570862 wait complete. 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.887+0000 7f0e77c99640 1 Processor -- start 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.887+0000 7f0e77c99640 1 -- start start 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.887+0000 7f0e77c99640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e700fc530 0x7f0e7010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.887+0000 7f0e77c99640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e700fd800 0x7f0e7010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.887+0000 7f0e77c99640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7010dc30 con 0x7f0e700fc530 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.887+0000 7f0e77c99640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7010e450 con 0x7f0e700fd800 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.887+0000 7f0e75a35640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e700fc530 0x7f0e7010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:12.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.887+0000 7f0e75a35640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e700fc530 0x7f0e7010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55030/0 (socket says 172.21.15.119:55030) 2024-09-13T21:51:12.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.887+0000 7f0e75a35640 1 -- 172.21.15.119:0/3921102781 learned_addr learned my addr 172.21.15.119:0/3921102781 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:12.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.888+0000 7f0e75234640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e700fd800 0x7f0e7010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:12.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.888+0000 7f0e75a35640 1 -- 172.21.15.119:0/3921102781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e700fd800 msgr2=0x7f0e7010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:12.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.888+0000 7f0e75a35640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e700fd800 0x7f0e7010d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:12.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.888+0000 7f0e75a35640 1 -- 172.21.15.119:0/3921102781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c005040 con 0x7f0e700fc530 2024-09-13T21:51:12.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.888+0000 7f0e75234640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e700fd800 0x7f0e7010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:51:12.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.888+0000 7f0e75a35640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e700fc530 0x7f0e7010d0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0e64002a50 tx=0x7f0e64004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:12.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.888+0000 7f0e627fc640 1 -- 172.21.15.119:0/3921102781 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e64007c30 con 0x7f0e700fc530 2024-09-13T21:51:12.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.888+0000 7f0e77c99640 1 -- 172.21.15.119:0/3921102781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7010e6e0 con 0x7f0e700fc530 2024-09-13T21:51:12.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.888+0000 7f0e627fc640 1 -- 172.21.15.119:0/3921102781 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e6400f040 con 0x7f0e700fc530 2024-09-13T21:51:12.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.888+0000 7f0e627fc640 1 -- 172.21.15.119:0/3921102781 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e6400da90 con 0x7f0e700fc530 2024-09-13T21:51:12.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.888+0000 7f0e77c99640 1 -- 172.21.15.119:0/3921102781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7010ec80 con 0x7f0e700fc530 2024-09-13T21:51:12.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.889+0000 7f0e77c99640 1 -- 172.21.15.119:0/3921102781 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e700fb990 con 0x7f0e700fc530 2024-09-13T21:51:12.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.890+0000 7f0e627fc640 1 -- 172.21.15.119:0/3921102781 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0e6400dd00 con 0x7f0e700fc530 2024-09-13T21:51:12.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.890+0000 7f0e627fc640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0e5c06e530 0x7f0e5c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:12.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.890+0000 7f0e627fc640 1 -- 172.21.15.119:0/3921102781 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0e6408da20 con 0x7f0e700fc530 2024-09-13T21:51:12.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.890+0000 7f0e75234640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0e5c06e530 0x7f0e5c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:12.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.891+0000 7f0e75234640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0e5c06e530 0x7f0e5c0709e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c007ac0 tx=0x7f0e6c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:12.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:12.895+0000 7f0e627fc640 1 -- 172.21.15.119:0/3921102781 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0e64056b60 con 0x7f0e700fc530 2024-09-13T21:51:13.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.077+0000 7f0e77c99640 1 -- 172.21.15.119:0/3921102781 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e7010efe0 con 0x7f0e5c06e530 2024-09-13T21:51:13.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.078+0000 7f0e627fc640 1 -- 172.21.15.119:0/3921102781 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0e7010efe0 con 0x7f0e5c06e530 2024-09-13T21:51:13.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.080+0000 7f0e77c99640 1 -- 172.21.15.119:0/3921102781 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0e5c06e530 msgr2=0x7f0e5c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.080+0000 7f0e77c99640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0e5c06e530 0x7f0e5c0709e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c007ac0 tx=0x7f0e6c035040 comp rx=0 tx=0).stop 2024-09-13T21:51:13.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.080+0000 7f0e77c99640 1 -- 172.21.15.119:0/3921102781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e700fc530 msgr2=0x7f0e7010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.080+0000 7f0e77c99640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e700fc530 0x7f0e7010d0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0e64002a50 tx=0x7f0e64004600 comp rx=0 tx=0).stop 2024-09-13T21:51:13.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.081+0000 7f0e77c99640 1 -- 172.21.15.119:0/3921102781 shutdown_connections 2024-09-13T21:51:13.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.081+0000 7f0e77c99640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0e5c06e530 0x7f0e5c0709e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.081+0000 7f0e77c99640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e700fd800 0x7f0e7010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.081+0000 7f0e77c99640 1 --2- 172.21.15.119:0/3921102781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e700fc530 0x7f0e7010d0a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.081+0000 7f0e77c99640 1 -- 172.21.15.119:0/3921102781 >> 172.21.15.119:0/3921102781 conn(0x7f0e700f7d10 msgr2=0x7f0e700f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:13.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.081+0000 7f0e77c99640 1 -- 172.21.15.119:0/3921102781 shutdown_connections 2024-09-13T21:51:13.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.081+0000 7f0e77c99640 1 -- 172.21.15.119:0/3921102781 wait complete. 2024-09-13T21:51:13.091 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:51:13.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.160+0000 7f0290ccd640 1 -- 172.21.15.119:0/1427790103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028c0fc550 msgr2=0x7f028c0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.160+0000 7f0290ccd640 1 --2- 172.21.15.119:0/1427790103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028c0fc550 0x7f028c0fc960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f027c0048d0 tx=0x7f027c009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.160+0000 7f0290ccd640 1 -- 172.21.15.119:0/1427790103 shutdown_connections 2024-09-13T21:51:13.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.160+0000 7f0290ccd640 1 --2- 172.21.15.119:0/1427790103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028c0fd820 0x7f028c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.160+0000 7f0290ccd640 1 --2- 172.21.15.119:0/1427790103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028c0fc550 0x7f028c0fc960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.160+0000 7f0290ccd640 1 -- 172.21.15.119:0/1427790103 >> 172.21.15.119:0/1427790103 conn(0x7f028c0f7d30 msgr2=0x7f028c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:13.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.160+0000 7f0290ccd640 1 -- 172.21.15.119:0/1427790103 shutdown_connections 2024-09-13T21:51:13.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.160+0000 7f0290ccd640 1 -- 172.21.15.119:0/1427790103 wait complete. 2024-09-13T21:51:13.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0290ccd640 1 Processor -- start 2024-09-13T21:51:13.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0290ccd640 1 -- start start 2024-09-13T21:51:13.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0290ccd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028c0fc550 0x7f028c10f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:13.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0290ccd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028c0fd820 0x7f028c10f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:13.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0290ccd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c110720 con 0x7f028c0fd820 2024-09-13T21:51:13.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0290ccd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c110890 con 0x7f028c0fc550 2024-09-13T21:51:13.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0283fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028c0fd820 0x7f028c10f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:13.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0283fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028c0fd820 0x7f028c10f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55052/0 (socket says 172.21.15.119:55052) 2024-09-13T21:51:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0283fff640 1 -- 172.21.15.119:0/3399773970 learned_addr learned my addr 172.21.15.119:0/3399773970 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f028a59c640 1 --2- 172.21.15.119:0/3399773970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028c0fc550 0x7f028c10f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0283fff640 1 -- 172.21.15.119:0/3399773970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028c0fc550 msgr2=0x7f028c10f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0283fff640 1 --2- 172.21.15.119:0/3399773970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028c0fc550 0x7f028c10f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0283fff640 1 -- 172.21.15.119:0/3399773970 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c005040 con 0x7f028c0fd820 2024-09-13T21:51:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.161+0000 7f0283fff640 1 --2- 172.21.15.119:0/3399773970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028c0fd820 0x7f028c10f8b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f027400b790 tx=0x7f02740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.162+0000 7f0282ffd640 1 -- 172.21.15.119:0/3399773970 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027400c700 con 0x7f028c0fd820 2024-09-13T21:51:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.162+0000 7f0282ffd640 1 -- 172.21.15.119:0/3399773970 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f027400cd00 con 0x7f028c0fd820 2024-09-13T21:51:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.162+0000 7f0290ccd640 1 -- 172.21.15.119:0/3399773970 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028c110b70 con 0x7f028c0fd820 2024-09-13T21:51:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.162+0000 7f0282ffd640 1 -- 172.21.15.119:0/3399773970 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0274015e70 con 0x7f028c0fd820 2024-09-13T21:51:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.162+0000 7f0290ccd640 1 -- 172.21.15.119:0/3399773970 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028c111090 con 0x7f028c0fd820 2024-09-13T21:51:13.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.163+0000 7f0290ccd640 1 -- 172.21.15.119:0/3399773970 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028c0fb9b0 con 0x7f028c0fd820 2024-09-13T21:51:13.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.163+0000 7f0282ffd640 1 -- 172.21.15.119:0/3399773970 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0274012070 con 0x7f028c0fd820 2024-09-13T21:51:13.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.164+0000 7f0282ffd640 1 --2- 172.21.15.119:0/3399773970 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f027806e530 0x7f02780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:13.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.164+0000 7f0282ffd640 1 -- 172.21.15.119:0/3399773970 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f027408dd30 con 0x7f028c0fd820 2024-09-13T21:51:13.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.164+0000 7f028a59c640 1 --2- 172.21.15.119:0/3399773970 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f027806e530 0x7f02780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:13.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.164+0000 7f028a59c640 1 --2- 172.21.15.119:0/3399773970 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f027806e530 0x7f02780709e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f027c000c00 tx=0x7f027c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:13.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.170+0000 7f0282ffd640 1 -- 172.21.15.119:0/3399773970 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0274056e70 con 0x7f028c0fd820 2024-09-13T21:51:13.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.357+0000 7f0290ccd640 1 -- 172.21.15.119:0/3399773970 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f028c111310 con 0x7f027806e530 2024-09-13T21:51:13.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.358+0000 7f0282ffd640 1 -- 172.21.15.119:0/3399773970 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f028c111310 con 0x7f027806e530 2024-09-13T21:51:13.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.360+0000 7f0290ccd640 1 -- 172.21.15.119:0/3399773970 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f027806e530 msgr2=0x7f02780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.360+0000 7f0290ccd640 1 --2- 172.21.15.119:0/3399773970 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f027806e530 0x7f02780709e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f027c000c00 tx=0x7f027c009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.360+0000 7f0290ccd640 1 -- 172.21.15.119:0/3399773970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028c0fd820 msgr2=0x7f028c10f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.360+0000 7f0290ccd640 1 --2- 172.21.15.119:0/3399773970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028c0fd820 0x7f028c10f8b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f027400b790 tx=0x7f02740091d0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.360+0000 7f0290ccd640 1 -- 172.21.15.119:0/3399773970 shutdown_connections 2024-09-13T21:51:13.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.360+0000 7f0290ccd640 1 --2- 172.21.15.119:0/3399773970 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f027806e530 0x7f02780709e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.360+0000 7f0290ccd640 1 --2- 172.21.15.119:0/3399773970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f028c0fd820 0x7f028c10f8b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.360+0000 7f0290ccd640 1 --2- 172.21.15.119:0/3399773970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028c0fc550 0x7f028c10f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.360+0000 7f0290ccd640 1 -- 172.21.15.119:0/3399773970 >> 172.21.15.119:0/3399773970 conn(0x7f028c0f7d30 msgr2=0x7f028c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:13.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.360+0000 7f0290ccd640 1 -- 172.21.15.119:0/3399773970 shutdown_connections 2024-09-13T21:51:13.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.360+0000 7f0290ccd640 1 -- 172.21.15.119:0/3399773970 wait complete. 2024-09-13T21:51:13.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.438+0000 7f5e157a1640 1 -- 172.21.15.119:0/4251299593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e100fc550 msgr2=0x7f5e100fc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.438+0000 7f5e157a1640 1 --2- 172.21.15.119:0/4251299593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e100fc550 0x7f5e100fc9c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e040048d0 tx=0x7f5e04009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.438+0000 7f5e157a1640 1 -- 172.21.15.119:0/4251299593 shutdown_connections 2024-09-13T21:51:13.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.438+0000 7f5e157a1640 1 --2- 172.21.15.119:0/4251299593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e100fc550 0x7f5e100fc9c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.438+0000 7f5e157a1640 1 --2- 172.21.15.119:0/4251299593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e100fb280 0x7f5e100fb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.438+0000 7f5e157a1640 1 -- 172.21.15.119:0/4251299593 >> 172.21.15.119:0/4251299593 conn(0x7f5e100f6a60 msgr2=0x7f5e100f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:13.441 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:13 smithi119 ceph-mon[90896]: pgmap v163: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 0 op/s 2024-09-13T21:51:13.441 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:13 smithi119 ceph-mon[90896]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:stopping} 2 up:standby 2024-09-13T21:51:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.438+0000 7f5e157a1640 1 -- 172.21.15.119:0/4251299593 shutdown_connections 2024-09-13T21:51:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.438+0000 7f5e157a1640 1 -- 172.21.15.119:0/4251299593 wait complete. 2024-09-13T21:51:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.439+0000 7f5e157a1640 1 Processor -- start 2024-09-13T21:51:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.439+0000 7f5e157a1640 1 -- start start 2024-09-13T21:51:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.439+0000 7f5e157a1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e100fb280 0x7f5e1010fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.439+0000 7f5e157a1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e100fc550 0x7f5e10112140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:13.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.439+0000 7f5e157a1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e10066580 con 0x7f5e100fc550 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.439+0000 7f5e157a1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100666f0 con 0x7f5e100fb280 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.439+0000 7f5e0f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e100fc550 0x7f5e10112140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.439+0000 7f5e0f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e100fc550 0x7f5e10112140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55084/0 (socket says 172.21.15.119:55084) 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.439+0000 7f5e0f7fe640 1 -- 172.21.15.119:0/3493297641 learned_addr learned my addr 172.21.15.119:0/3493297641 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.440+0000 7f5e0ffff640 1 --2- 172.21.15.119:0/3493297641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e100fb280 0x7f5e1010fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.440+0000 7f5e0f7fe640 1 -- 172.21.15.119:0/3493297641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e100fb280 msgr2=0x7f5e1010fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.440+0000 7f5e0f7fe640 1 --2- 172.21.15.119:0/3493297641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e100fb280 0x7f5e1010fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.440+0000 7f5e0f7fe640 1 -- 172.21.15.119:0/3493297641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04005040 con 0x7f5e100fc550 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.440+0000 7f5e0f7fe640 1 --2- 172.21.15.119:0/3493297641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e100fc550 0x7f5e10112140 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e040043d0 tx=0x7f5e04009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.440+0000 7f5e0cff9640 1 -- 172.21.15.119:0/3493297641 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e04038070 con 0x7f5e100fc550 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.440+0000 7f5e157a1640 1 -- 172.21.15.119:0/3493297641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e10112680 con 0x7f5e100fc550 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.440+0000 7f5e0cff9640 1 -- 172.21.15.119:0/3493297641 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e0402ae90 con 0x7f5e100fc550 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.440+0000 7f5e0cff9640 1 -- 172.21.15.119:0/3493297641 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0403e670 con 0x7f5e100fc550 2024-09-13T21:51:13.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.440+0000 7f5e157a1640 1 -- 172.21.15.119:0/3493297641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e10112bf0 con 0x7f5e100fc550 2024-09-13T21:51:13.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.441+0000 7f5e157a1640 1 -- 172.21.15.119:0/3493297641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e10105630 con 0x7f5e100fc550 2024-09-13T21:51:13.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.442+0000 7f5e0cff9640 1 -- 172.21.15.119:0/3493297641 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5e04030020 con 0x7f5e100fc550 2024-09-13T21:51:13.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.442+0000 7f5e0cff9640 1 --2- 172.21.15.119:0/3493297641 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5df806e530 0x7f5df80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:13.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.442+0000 7f5e0cff9640 1 -- 172.21.15.119:0/3493297641 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f5e040ae310 con 0x7f5e100fc550 2024-09-13T21:51:13.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.442+0000 7f5e0ffff640 1 --2- 172.21.15.119:0/3493297641 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5df806e530 0x7f5df80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:13.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.443+0000 7f5e0ffff640 1 --2- 172.21.15.119:0/3493297641 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5df806e530 0x7f5df80709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e10066270 tx=0x7f5e0000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:13.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.446+0000 7f5e0cff9640 1 -- 172.21.15.119:0/3493297641 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5e04077500 con 0x7f5e100fc550 2024-09-13T21:51:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:13 smithi155 ceph-mon[79928]: pgmap v163: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 0 op/s 2024-09-13T21:51:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:13 smithi155 ceph-mon[79928]: fsmap cephfs:2 {0=cephfs.smithi119.yydzwt=up:active,1=cephfs.smithi155.yblkxo=up:stopping} 2 up:standby 2024-09-13T21:51:13.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.627+0000 7f5e157a1640 1 -- 172.21.15.119:0/3493297641 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e10100f20 con 0x7f5df806e530 2024-09-13T21:51:13.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.635+0000 7f5e0cff9640 1 -- 172.21.15.119:0/3493297641 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f5e10100f20 con 0x7f5df806e530 2024-09-13T21:51:13.637 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:51:13.637 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (5m) 113s ago 14m 25.9M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:51:13.638 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (3m) 113s ago 14m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:51:13.638 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (3m) 16s ago 13m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:51:13.638 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (5m) 113s ago 13m 80.4M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:51:13.638 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (8m) 113s ago 8m 13.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:51:13.638 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (8m) 113s ago 8m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:51:13.638 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (8m) 16s ago 8m 17.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:51:13.638 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (8m) 16s ago 8m 110M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:51:13.638 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (5m) 113s ago 15m 498M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:51:13.638 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (4m) 16s ago 13m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:51:13.638 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (4m) 113s ago 15m 47.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:51:13.639 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (4m) 16s ago 13m 41.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:51:13.639 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (5m) 113s ago 14m 16.2M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:51:13.639 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (5m) 16s ago 13m 14.8M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:51:13.639 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (3m) 113s ago 12m 93.3M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:51:13.639 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (2m) 113s ago 12m 93.6M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 8f69bf25cd20 2024-09-13T21:51:13.639 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (118s) 113s ago 11m 11.0M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 0f73e4fc2c43 2024-09-13T21:51:13.639 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (84s) 16s ago 11m 103M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5a7f5a9c1c4d 2024-09-13T21:51:13.639 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (51s) 16s ago 10m 102M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 03c992670291 2024-09-13T21:51:13.639 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (19s) 16s ago 10m 11.7M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 bf54ed40f20f 2024-09-13T21:51:13.639 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (4m) 113s ago 13m 51.8M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:51:13.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.637+0000 7f5e157a1640 1 -- 172.21.15.119:0/3493297641 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5df806e530 msgr2=0x7f5df80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.637+0000 7f5e157a1640 1 --2- 172.21.15.119:0/3493297641 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5df806e530 0x7f5df80709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e10066270 tx=0x7f5e0000b040 comp rx=0 tx=0).stop 2024-09-13T21:51:13.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.637+0000 7f5e157a1640 1 -- 172.21.15.119:0/3493297641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e100fc550 msgr2=0x7f5e10112140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.637+0000 7f5e157a1640 1 --2- 172.21.15.119:0/3493297641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e100fc550 0x7f5e10112140 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e040043d0 tx=0x7f5e04009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.637+0000 7f5e157a1640 1 -- 172.21.15.119:0/3493297641 shutdown_connections 2024-09-13T21:51:13.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.637+0000 7f5e157a1640 1 --2- 172.21.15.119:0/3493297641 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5df806e530 0x7f5df80709e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.637+0000 7f5e157a1640 1 --2- 172.21.15.119:0/3493297641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e100fc550 0x7f5e10112140 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.637+0000 7f5e157a1640 1 --2- 172.21.15.119:0/3493297641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e100fb280 0x7f5e1010fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.637+0000 7f5e157a1640 1 -- 172.21.15.119:0/3493297641 >> 172.21.15.119:0/3493297641 conn(0x7f5e100f6a60 msgr2=0x7f5e100ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:13.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.638+0000 7f5e157a1640 1 -- 172.21.15.119:0/3493297641 shutdown_connections 2024-09-13T21:51:13.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.638+0000 7f5e157a1640 1 -- 172.21.15.119:0/3493297641 wait complete. 2024-09-13T21:51:13.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.715+0000 7f9a60ae3640 1 -- 172.21.15.119:0/1303835197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a5c0fd820 msgr2=0x7f9a5c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.715+0000 7f9a60ae3640 1 --2- 172.21.15.119:0/1303835197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a5c0fd820 0x7f9a5c0fdc90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a500048d0 tx=0x7f9a50009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.715+0000 7f9a60ae3640 1 -- 172.21.15.119:0/1303835197 shutdown_connections 2024-09-13T21:51:13.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.715+0000 7f9a60ae3640 1 --2- 172.21.15.119:0/1303835197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a5c0fd820 0x7f9a5c0fdc90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.715+0000 7f9a60ae3640 1 --2- 172.21.15.119:0/1303835197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a5c0fc550 0x7f9a5c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.715+0000 7f9a60ae3640 1 -- 172.21.15.119:0/1303835197 >> 172.21.15.119:0/1303835197 conn(0x7f9a5c0f7d30 msgr2=0x7f9a5c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:13.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.715+0000 7f9a60ae3640 1 -- 172.21.15.119:0/1303835197 shutdown_connections 2024-09-13T21:51:13.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.715+0000 7f9a60ae3640 1 -- 172.21.15.119:0/1303835197 wait complete. 2024-09-13T21:51:13.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a60ae3640 1 Processor -- start 2024-09-13T21:51:13.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a60ae3640 1 -- start start 2024-09-13T21:51:13.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a60ae3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a5c0fc550 0x7f9a5c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:13.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a60ae3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a5c0fd820 0x7f9a5c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:13.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a60ae3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c10dc40 con 0x7f9a5c0fc550 2024-09-13T21:51:13.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a60ae3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c10e460 con 0x7f9a5c0fd820 2024-09-13T21:51:13.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a5a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a5c0fc550 0x7f9a5c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:13.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a5a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a5c0fc550 0x7f9a5c10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:55108/0 (socket says 172.21.15.119:55108) 2024-09-13T21:51:13.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a5a59c640 1 -- 172.21.15.119:0/3355134832 learned_addr learned my addr 172.21.15.119:0/3355134832 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:13.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a59d9b640 1 --2- 172.21.15.119:0/3355134832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a5c0fd820 0x7f9a5c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:13.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a5a59c640 1 -- 172.21.15.119:0/3355134832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a5c0fd820 msgr2=0x7f9a5c10d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a5a59c640 1 --2- 172.21.15.119:0/3355134832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a5c0fd820 0x7f9a5c10d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.716+0000 7f9a5a59c640 1 -- 172.21.15.119:0/3355134832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a50005040 con 0x7f9a5c0fc550 2024-09-13T21:51:13.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.717+0000 7f9a5a59c640 1 --2- 172.21.15.119:0/3355134832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a5c0fc550 0x7f9a5c10d0b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c002a50 tx=0x7f9a4c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:13.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.717+0000 7f9a4affd640 1 -- 172.21.15.119:0/3355134832 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a4c007c30 con 0x7f9a5c0fc550 2024-09-13T21:51:13.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.717+0000 7f9a4affd640 1 -- 172.21.15.119:0/3355134832 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a4c00f040 con 0x7f9a5c0fc550 2024-09-13T21:51:13.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.717+0000 7f9a4affd640 1 -- 172.21.15.119:0/3355134832 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a4c00da10 con 0x7f9a5c0fc550 2024-09-13T21:51:13.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.717+0000 7f9a60ae3640 1 -- 172.21.15.119:0/3355134832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c10e6f0 con 0x7f9a5c0fc550 2024-09-13T21:51:13.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.717+0000 7f9a60ae3640 1 -- 172.21.15.119:0/3355134832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c10ec40 con 0x7f9a5c0fc550 2024-09-13T21:51:13.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.718+0000 7f9a60ae3640 1 -- 172.21.15.119:0/3355134832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c0fb9b0 con 0x7f9a5c0fc550 2024-09-13T21:51:13.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.718+0000 7f9a4affd640 1 -- 172.21.15.119:0/3355134832 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9a4c00dc80 con 0x7f9a5c0fc550 2024-09-13T21:51:13.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.719+0000 7f9a4affd640 1 --2- 172.21.15.119:0/3355134832 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9a4406e530 0x7f9a440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:13.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.719+0000 7f9a4affd640 1 -- 172.21.15.119:0/3355134832 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9a4c08d8e0 con 0x7f9a5c0fc550 2024-09-13T21:51:13.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.719+0000 7f9a59d9b640 1 --2- 172.21.15.119:0/3355134832 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9a4406e530 0x7f9a440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:13.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.719+0000 7f9a59d9b640 1 --2- 172.21.15.119:0/3355134832 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9a4406e530 0x7f9a440709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c10ce60 tx=0x7f9a50035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:13.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.723+0000 7f9a4affd640 1 -- 172.21.15.119:0/3355134832 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9a4c056ad0 con 0x7f9a5c0fc550 2024-09-13T21:51:13.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.954+0000 7f9a60ae3640 1 -- 172.21.15.119:0/3355134832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9a5c10ef80 con 0x7f9a5c0fc550 2024-09-13T21:51:13.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.955+0000 7f9a4affd640 1 -- 172.21.15.119:0/3355134832 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f9a4c05a190 con 0x7f9a5c0fc550 2024-09-13T21:51:13.956 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:51:13.956 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:51:13.956 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4, 2024-09-13T21:51:13.957 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 10 2024-09-13T21:51:13.958 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:51:13.958 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:51:13.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.957+0000 7f9a60ae3640 1 -- 172.21.15.119:0/3355134832 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9a4406e530 msgr2=0x7f9a440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.957+0000 7f9a60ae3640 1 --2- 172.21.15.119:0/3355134832 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9a4406e530 0x7f9a440709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c10ce60 tx=0x7f9a50035040 comp rx=0 tx=0).stop 2024-09-13T21:51:13.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.957+0000 7f9a60ae3640 1 -- 172.21.15.119:0/3355134832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a5c0fc550 msgr2=0x7f9a5c10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:13.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.957+0000 7f9a60ae3640 1 --2- 172.21.15.119:0/3355134832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a5c0fc550 0x7f9a5c10d0b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c002a50 tx=0x7f9a4c004600 comp rx=0 tx=0).stop 2024-09-13T21:51:13.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.957+0000 7f9a60ae3640 1 -- 172.21.15.119:0/3355134832 shutdown_connections 2024-09-13T21:51:13.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.957+0000 7f9a60ae3640 1 --2- 172.21.15.119:0/3355134832 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9a4406e530 0x7f9a440709e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.957+0000 7f9a60ae3640 1 --2- 172.21.15.119:0/3355134832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a5c0fd820 0x7f9a5c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.957+0000 7f9a60ae3640 1 --2- 172.21.15.119:0/3355134832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a5c0fc550 0x7f9a5c10d0b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:13.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.957+0000 7f9a60ae3640 1 -- 172.21.15.119:0/3355134832 >> 172.21.15.119:0/3355134832 conn(0x7f9a5c0f7d30 msgr2=0x7f9a5c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:13.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.957+0000 7f9a60ae3640 1 -- 172.21.15.119:0/3355134832 shutdown_connections 2024-09-13T21:51:13.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:13.957+0000 7f9a60ae3640 1 -- 172.21.15.119:0/3355134832 wait complete. 2024-09-13T21:51:14.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.040+0000 7f0c4e54f640 1 -- 172.21.15.119:0/2006233762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c480fc520 msgr2=0x7f0c480fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.040+0000 7f0c4e54f640 1 --2- 172.21.15.119:0/2006233762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c480fc520 0x7f0c480fc930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0c380048d0 tx=0x7f0c38009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.040+0000 7f0c4e54f640 1 -- 172.21.15.119:0/2006233762 shutdown_connections 2024-09-13T21:51:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.040+0000 7f0c4e54f640 1 --2- 172.21.15.119:0/2006233762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c480fd7f0 0x7f0c480fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.040+0000 7f0c4e54f640 1 --2- 172.21.15.119:0/2006233762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c480fc520 0x7f0c480fc930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.040+0000 7f0c4e54f640 1 -- 172.21.15.119:0/2006233762 >> 172.21.15.119:0/2006233762 conn(0x7f0c480f7ce0 msgr2=0x7f0c480fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.040+0000 7f0c4e54f640 1 -- 172.21.15.119:0/2006233762 shutdown_connections 2024-09-13T21:51:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.040+0000 7f0c4e54f640 1 -- 172.21.15.119:0/2006233762 wait complete. 2024-09-13T21:51:14.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.040+0000 7f0c4e54f640 1 Processor -- start 2024-09-13T21:51:14.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c4e54f640 1 -- start start 2024-09-13T21:51:14.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c4e54f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c480fc520 0x7f0c48071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:14.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c4e54f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c480fd7f0 0x7f0c4806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:14.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c4e54f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4806fff0 con 0x7f0c480fd7f0 2024-09-13T21:51:14.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c4e54f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c48070130 con 0x7f0c480fc520 2024-09-13T21:51:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c477fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c480fd7f0 0x7f0c4806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c477fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c480fd7f0 0x7f0c4806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47400/0 (socket says 172.21.15.119:47400) 2024-09-13T21:51:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c477fe640 1 -- 172.21.15.119:0/1815324531 learned_addr learned my addr 172.21.15.119:0/1815324531 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c47fff640 1 --2- 172.21.15.119:0/1815324531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c480fc520 0x7f0c48071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c477fe640 1 -- 172.21.15.119:0/1815324531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c480fc520 msgr2=0x7f0c48071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c477fe640 1 --2- 172.21.15.119:0/1815324531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c480fc520 0x7f0c48071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c477fe640 1 -- 172.21.15.119:0/1815324531 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c38005040 con 0x7f0c480fd7f0 2024-09-13T21:51:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.041+0000 7f0c477fe640 1 --2- 172.21.15.119:0/1815324531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c480fd7f0 0x7f0c4806fa60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c002a50 tx=0x7f0c3c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.042+0000 7f0c44ff9640 1 -- 172.21.15.119:0/1815324531 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c3c007c30 con 0x7f0c480fd7f0 2024-09-13T21:51:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.042+0000 7f0c4e54f640 1 -- 172.21.15.119:0/1815324531 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c48070410 con 0x7f0c480fd7f0 2024-09-13T21:51:14.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.042+0000 7f0c44ff9640 1 -- 172.21.15.119:0/1815324531 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c3c00f040 con 0x7f0c480fd7f0 2024-09-13T21:51:14.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.042+0000 7f0c44ff9640 1 -- 172.21.15.119:0/1815324531 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c3c00dad0 con 0x7f0c480fd7f0 2024-09-13T21:51:14.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.042+0000 7f0c4e54f640 1 -- 172.21.15.119:0/1815324531 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c481150d0 con 0x7f0c480fd7f0 2024-09-13T21:51:14.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.043+0000 7f0c4e54f640 1 -- 172.21.15.119:0/1815324531 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c480fb980 con 0x7f0c480fd7f0 2024-09-13T21:51:14.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.044+0000 7f0c44ff9640 1 -- 172.21.15.119:0/1815324531 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0c3c00dc30 con 0x7f0c480fd7f0 2024-09-13T21:51:14.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.044+0000 7f0c44ff9640 1 --2- 172.21.15.119:0/1815324531 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0c3006e530 0x7f0c300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:14.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.045+0000 7f0c47fff640 1 --2- 172.21.15.119:0/1815324531 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0c3006e530 0x7f0c300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:14.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.045+0000 7f0c44ff9640 1 -- 172.21.15.119:0/1815324531 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0c3c08dee0 con 0x7f0c480fd7f0 2024-09-13T21:51:14.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.045+0000 7f0c47fff640 1 --2- 172.21.15.119:0/1815324531 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0c3006e530 0x7f0c300709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c38000c00 tx=0x7f0c38035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:14.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.049+0000 7f0c44ff9640 1 -- 172.21.15.119:0/1815324531 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0c3c0570a0 con 0x7f0c480fd7f0 2024-09-13T21:51:14.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.270+0000 7f0c4e54f640 1 -- 172.21.15.119:0/1815324531 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0c4804b720 con 0x7f0c480fd7f0 2024-09-13T21:51:14.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.270+0000 7f0c44ff9640 1 -- 172.21.15.119:0/1815324531 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1956 (secure 0 0 0) 0x7f0c3c05a760 con 0x7f0c480fd7f0 2024-09-13T21:51:14.272 INFO:teuthology.orchestra.run.smithi119.stdout:e25 2024-09-13T21:51:14.272 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:51:12:268598+0000 2024-09-13T21:51:14.272 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:51:14.272 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:51:14.272 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:51:14.272 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:51:14.272 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:51:14.272 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:51:14.272 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 25 2024-09-13T21:51:14.272 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:51:12.179164+0000 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 1 2024-09-13T21:51:14.273 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472,1=24267} 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 14472 members: 14472 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{1:24267} state up:stopping seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:51:14.274 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:51:14.275 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:51:14.275 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:51:14.275 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:51:14.275 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:51:14.275 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 25 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.272+0000 7f0c4e54f640 1 -- 172.21.15.119:0/1815324531 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0c3006e530 msgr2=0x7f0c300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.272+0000 7f0c4e54f640 1 --2- 172.21.15.119:0/1815324531 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0c3006e530 0x7f0c300709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c38000c00 tx=0x7f0c38035040 comp rx=0 tx=0).stop 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.272+0000 7f0c4e54f640 1 -- 172.21.15.119:0/1815324531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c480fd7f0 msgr2=0x7f0c4806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.272+0000 7f0c4e54f640 1 --2- 172.21.15.119:0/1815324531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c480fd7f0 0x7f0c4806fa60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c002a50 tx=0x7f0c3c004600 comp rx=0 tx=0).stop 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.272+0000 7f0c4e54f640 1 -- 172.21.15.119:0/1815324531 shutdown_connections 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.272+0000 7f0c4e54f640 1 --2- 172.21.15.119:0/1815324531 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0c3006e530 0x7f0c300709e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.272+0000 7f0c4e54f640 1 --2- 172.21.15.119:0/1815324531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c480fd7f0 0x7f0c4806fa60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.272+0000 7f0c4e54f640 1 --2- 172.21.15.119:0/1815324531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c480fc520 0x7f0c48071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.272+0000 7f0c4e54f640 1 -- 172.21.15.119:0/1815324531 >> 172.21.15.119:0/1815324531 conn(0x7f0c480f7ce0 msgr2=0x7f0c480f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.272+0000 7f0c4e54f640 1 -- 172.21.15.119:0/1815324531 shutdown_connections 2024-09-13T21:51:14.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.272+0000 7f0c4e54f640 1 -- 172.21.15.119:0/1815324531 wait complete. 2024-09-13T21:51:14.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.351+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/4246539575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e580fd820 msgr2=0x7f8e580fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.351+0000 7f8e5f2dd640 1 --2- 172.21.15.119:0/4246539575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e580fd820 0x7f8e580fdc90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8e540048d0 tx=0x7f8e54009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.351+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/4246539575 shutdown_connections 2024-09-13T21:51:14.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.351+0000 7f8e5f2dd640 1 --2- 172.21.15.119:0/4246539575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e580fd820 0x7f8e580fdc90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.351+0000 7f8e5f2dd640 1 --2- 172.21.15.119:0/4246539575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580fc550 0x7f8e580fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.351+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/4246539575 >> 172.21.15.119:0/4246539575 conn(0x7f8e580f7d30 msgr2=0x7f8e580fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:14.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.351+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/4246539575 shutdown_connections 2024-09-13T21:51:14.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.351+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/4246539575 wait complete. 2024-09-13T21:51:14.354 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:14.354 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:14.354 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3355134832' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:14.354 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:14.354 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:14.354 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:14.355 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:14.355 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:14.355 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:14.355 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:14.355 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:14.355 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:14.355 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:14 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1815324531' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:51:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.352+0000 7f8e5f2dd640 1 Processor -- start 2024-09-13T21:51:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.352+0000 7f8e5f2dd640 1 -- start start 2024-09-13T21:51:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.352+0000 7f8e5f2dd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580fc550 0x7f8e58071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.352+0000 7f8e5f2dd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e580fd820 0x7f8e5806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.352+0000 7f8e5f2dd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5806fff0 con 0x7f8e580fd820 2024-09-13T21:51:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.352+0000 7f8e5f2dd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58070130 con 0x7f8e580fc550 2024-09-13T21:51:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.352+0000 7f8e5d079640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580fc550 0x7f8e58071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.352+0000 7f8e5c878640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e580fd820 0x7f8e5806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.352+0000 7f8e5d079640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580fc550 0x7f8e58071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:59246/0 (socket says 172.21.15.119:59246) 2024-09-13T21:51:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.352+0000 7f8e5d079640 1 -- 172.21.15.119:0/3205328120 learned_addr learned my addr 172.21.15.119:0/3205328120 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:14.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.353+0000 7f8e5d079640 1 -- 172.21.15.119:0/3205328120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e580fd820 msgr2=0x7f8e5806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.353+0000 7f8e5d079640 1 --2- 172.21.15.119:0/3205328120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e580fd820 0x7f8e5806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.353+0000 7f8e5d079640 1 -- 172.21.15.119:0/3205328120 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e54005040 con 0x7f8e580fc550 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.353+0000 7f8e5d079640 1 --2- 172.21.15.119:0/3205328120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580fc550 0x7f8e58071570 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800eb70 tx=0x7f8e4800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.353+0000 7f8e4dffb640 1 -- 172.21.15.119:0/3205328120 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e48007c30 con 0x7f8e580fc550 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.353+0000 7f8e4dffb640 1 -- 172.21.15.119:0/3205328120 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8e4800f040 con 0x7f8e580fc550 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.353+0000 7f8e4dffb640 1 -- 172.21.15.119:0/3205328120 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e4800ca60 con 0x7f8e580fc550 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.353+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/3205328120 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e580703b0 con 0x7f8e580fc550 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.353+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/3205328120 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e58115100 con 0x7f8e580fc550 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.354+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/3205328120 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e580fb9b0 con 0x7f8e580fc550 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.355+0000 7f8e4dffb640 1 -- 172.21.15.119:0/3205328120 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8e4800cbc0 con 0x7f8e580fc550 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.355+0000 7f8e4dffb640 1 --2- 172.21.15.119:0/3205328120 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8e4406e530 0x7f8e440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.355+0000 7f8e4dffb640 1 -- 172.21.15.119:0/3205328120 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8e4808dca0 con 0x7f8e580fc550 2024-09-13T21:51:14.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.355+0000 7f8e5c878640 1 --2- 172.21.15.119:0/3205328120 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8e4406e530 0x7f8e440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:14.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.356+0000 7f8e5c878640 1 --2- 172.21.15.119:0/3205328120 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8e4406e530 0x7f8e440709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e54000c00 tx=0x7f8e54035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:14.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.360+0000 7f8e4dffb640 1 -- 172.21.15.119:0/3205328120 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8e48092070 con 0x7f8e580fc550 2024-09-13T21:51:14.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.544+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/3205328120 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e58101c40 con 0x7f8e4406e530 2024-09-13T21:51:14.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.545+0000 7f8e4dffb640 1 -- 172.21.15.119:0/3205328120 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8e58101c40 con 0x7f8e4406e530 2024-09-13T21:51:14.546 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: "crash", 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: "osd", 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr", 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: "mon" 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "12/21 daemons upgraded", 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:51:14.547 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:51:14.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.547+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/3205328120 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8e4406e530 msgr2=0x7f8e440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.547+0000 7f8e5f2dd640 1 --2- 172.21.15.119:0/3205328120 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8e4406e530 0x7f8e440709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e54000c00 tx=0x7f8e54035040 comp rx=0 tx=0).stop 2024-09-13T21:51:14.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.547+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/3205328120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580fc550 msgr2=0x7f8e58071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.547+0000 7f8e5f2dd640 1 --2- 172.21.15.119:0/3205328120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580fc550 0x7f8e58071570 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800eb70 tx=0x7f8e4800b040 comp rx=0 tx=0).stop 2024-09-13T21:51:14.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.547+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/3205328120 shutdown_connections 2024-09-13T21:51:14.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.547+0000 7f8e5f2dd640 1 --2- 172.21.15.119:0/3205328120 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8e4406e530 0x7f8e440709e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.547+0000 7f8e5f2dd640 1 --2- 172.21.15.119:0/3205328120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e580fd820 0x7f8e5806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.547+0000 7f8e5f2dd640 1 --2- 172.21.15.119:0/3205328120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e580fc550 0x7f8e58071570 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.547+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/3205328120 >> 172.21.15.119:0/3205328120 conn(0x7f8e580f7d30 msgr2=0x7f8e580f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:14.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.547+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/3205328120 shutdown_connections 2024-09-13T21:51:14.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.547+0000 7f8e5f2dd640 1 -- 172.21.15.119:0/3205328120 wait complete. 2024-09-13T21:51:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3355134832' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:14.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:14.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:14.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:14.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:14.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:14.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:14 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1815324531' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:51:14.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.625+0000 7f65342be640 1 -- 172.21.15.119:0/3743023024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c0fb450 msgr2=0x7f652c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.625+0000 7f65342be640 1 --2- 172.21.15.119:0/3743023024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c0fb450 0x7f652c0fb860 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65280048d0 tx=0x7f6528009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 -- 172.21.15.119:0/3743023024 shutdown_connections 2024-09-13T21:51:14.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 --2- 172.21.15.119:0/3743023024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f652c0fc720 0x7f652c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 --2- 172.21.15.119:0/3743023024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c0fb450 0x7f652c0fb860 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 -- 172.21.15.119:0/3743023024 >> 172.21.15.119:0/3743023024 conn(0x7f652c0f6c10 msgr2=0x7f652c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:14.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 -- 172.21.15.119:0/3743023024 shutdown_connections 2024-09-13T21:51:14.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 -- 172.21.15.119:0/3743023024 wait complete. 2024-09-13T21:51:14.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 Processor -- start 2024-09-13T21:51:14.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 -- start start 2024-09-13T21:51:14.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c0fb450 0x7f652c10d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f652c0fc720 0x7f652c10d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c10dc60 con 0x7f652c0fb450 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f65342be640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c10e480 con 0x7f652c0fc720 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.626+0000 7f653205a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c0fb450 0x7f652c10d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f653205a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c0fb450 0x7f652c10d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47428/0 (socket says 172.21.15.119:47428) 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f653205a640 1 -- 172.21.15.119:0/2121939362 learned_addr learned my addr 172.21.15.119:0/2121939362 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f6531859640 1 --2- 172.21.15.119:0/2121939362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f652c0fc720 0x7f652c10d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f653205a640 1 -- 172.21.15.119:0/2121939362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f652c0fc720 msgr2=0x7f652c10d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f653205a640 1 --2- 172.21.15.119:0/2121939362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f652c0fc720 0x7f652c10d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f653205a640 1 -- 172.21.15.119:0/2121939362 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528005040 con 0x7f652c0fb450 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f653205a640 1 --2- 172.21.15.119:0/2121939362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c0fb450 0x7f652c10d0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65280043d0 tx=0x7f6528009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f6522ffd640 1 -- 172.21.15.119:0/2121939362 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6528038070 con 0x7f652c0fb450 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f6522ffd640 1 -- 172.21.15.119:0/2121939362 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6528009800 con 0x7f652c0fb450 2024-09-13T21:51:14.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f65342be640 1 -- 172.21.15.119:0/2121939362 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652c10e6b0 con 0x7f652c0fb450 2024-09-13T21:51:14.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f6522ffd640 1 -- 172.21.15.119:0/2121939362 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f652803e670 con 0x7f652c0fb450 2024-09-13T21:51:14.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.627+0000 7f65342be640 1 -- 172.21.15.119:0/2121939362 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c10ec50 con 0x7f652c0fb450 2024-09-13T21:51:14.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.628+0000 7f65342be640 1 -- 172.21.15.119:0/2121939362 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652c0fa8b0 con 0x7f652c0fb450 2024-09-13T21:51:14.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.629+0000 7f6522ffd640 1 -- 172.21.15.119:0/2121939362 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6528030020 con 0x7f652c0fb450 2024-09-13T21:51:14.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.630+0000 7f6522ffd640 1 --2- 172.21.15.119:0/2121939362 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f651806e530 0x7f65180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:14.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.630+0000 7f6522ffd640 1 -- 172.21.15.119:0/2121939362 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f65280ae220 con 0x7f652c0fb450 2024-09-13T21:51:14.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.630+0000 7f6531859640 1 --2- 172.21.15.119:0/2121939362 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f651806e530 0x7f65180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:14.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.630+0000 7f6531859640 1 --2- 172.21.15.119:0/2121939362 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f651806e530 0x7f65180709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f652c10ce80 tx=0x7f651c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:14.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.634+0000 7f6522ffd640 1 -- 172.21.15.119:0/2121939362 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6528077490 con 0x7f652c0fb450 2024-09-13T21:51:14.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.865+0000 7f65342be640 1 -- 172.21.15.119:0/2121939362 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f652c04b720 con 0x7f652c0fb450 2024-09-13T21:51:14.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.866+0000 7f6522ffd640 1 -- 172.21.15.119:0/2121939362 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f652807ab50 con 0x7f652c0fb450 2024-09-13T21:51:14.868 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:51:14.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.868+0000 7f65342be640 1 -- 172.21.15.119:0/2121939362 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f651806e530 msgr2=0x7f65180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.868+0000 7f65342be640 1 --2- 172.21.15.119:0/2121939362 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f651806e530 0x7f65180709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f652c10ce80 tx=0x7f651c00b040 comp rx=0 tx=0).stop 2024-09-13T21:51:14.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.868+0000 7f65342be640 1 -- 172.21.15.119:0/2121939362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c0fb450 msgr2=0x7f652c10d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:14.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.868+0000 7f65342be640 1 --2- 172.21.15.119:0/2121939362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c0fb450 0x7f652c10d0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65280043d0 tx=0x7f6528009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.868+0000 7f65342be640 1 -- 172.21.15.119:0/2121939362 shutdown_connections 2024-09-13T21:51:14.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.868+0000 7f65342be640 1 --2- 172.21.15.119:0/2121939362 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f651806e530 0x7f65180709e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.868+0000 7f65342be640 1 --2- 172.21.15.119:0/2121939362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f652c0fc720 0x7f652c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.868+0000 7f65342be640 1 --2- 172.21.15.119:0/2121939362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c0fb450 0x7f652c10d0d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:14.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.868+0000 7f65342be640 1 -- 172.21.15.119:0/2121939362 >> 172.21.15.119:0/2121939362 conn(0x7f652c0f6c10 msgr2=0x7f652c066140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:14.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.868+0000 7f65342be640 1 -- 172.21.15.119:0/2121939362 shutdown_connections 2024-09-13T21:51:14.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:14.868+0000 7f65342be640 1 -- 172.21.15.119:0/2121939362 wait complete. 2024-09-13T21:51:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:15 smithi155 ceph-mon[79928]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:15 smithi155 ceph-mon[79928]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T21:51:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:15 smithi155 ceph-mon[79928]: pgmap v164: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1.7 KiB/s wr, 0 op/s 2024-09-13T21:51:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:15 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2121939362' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:51:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:15 smithi119 ceph-mon[90896]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:15 smithi119 ceph-mon[90896]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T21:51:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:15 smithi119 ceph-mon[90896]: pgmap v164: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1.7 KiB/s wr, 0 op/s 2024-09-13T21:51:15.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:15 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2121939362' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:51:16.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:16 smithi155 ceph-mon[79928]: from='client.44273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:16.652 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:16 smithi119 ceph-mon[90896]: from='client.44273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:17.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:17 smithi155 ceph-mon[79928]: pgmap v165: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 90 B/s rd, 1.6 KiB/s wr, 0 op/s 2024-09-13T21:51:17.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:17 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:17.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:17 smithi119 ceph-mon[90896]: pgmap v165: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 90 B/s rd, 1.6 KiB/s wr, 0 op/s 2024-09-13T21:51:17.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:17 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:19 smithi155 ceph-mon[79928]: pgmap v166: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-13T21:51:19.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:19 smithi119 ceph-mon[90896]: pgmap v166: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-13T21:51:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:21 smithi155 ceph-mon[79928]: pgmap v167: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 0 op/s 2024-09-13T21:51:21.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:21 smithi119 ceph-mon[90896]: pgmap v167: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 0 op/s 2024-09-13T21:51:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:23 smithi155 ceph-mon[79928]: pgmap v168: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 938 B/s wr, 0 op/s 2024-09-13T21:51:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:23 smithi119 ceph-mon[90896]: pgmap v168: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 938 B/s wr, 0 op/s 2024-09-13T21:51:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:24.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:25 smithi155 ceph-mon[79928]: pgmap v169: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-13T21:51:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:25.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:25.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:25 smithi119 ceph-mon[90896]: pgmap v169: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-13T21:51:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:26.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:26 smithi155 ceph-mon[79928]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T21:51:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:26 smithi119 ceph-mon[90896]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T21:51:27.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:27 smithi155 ceph-mon[79928]: pgmap v170: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 5 op/s 2024-09-13T21:51:27.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:27 smithi119 ceph-mon[90896]: pgmap v170: 65 pgs: 65 active+clean; 252 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 5 op/s 2024-09-13T21:51:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:29 smithi155 ceph-mon[79928]: pgmap v171: 65 pgs: 65 active+clean; 236 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 5 op/s 2024-09-13T21:51:29.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:29 smithi119 ceph-mon[90896]: pgmap v171: 65 pgs: 65 active+clean; 236 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 5 op/s 2024-09-13T21:51:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:31 smithi155 ceph-mon[79928]: pgmap v172: 65 pgs: 65 active+clean; 148 MiB data, 754 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 7 op/s 2024-09-13T21:51:31.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:31 smithi119 ceph-mon[90896]: pgmap v172: 65 pgs: 65 active+clean; 148 MiB data, 754 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 7 op/s 2024-09-13T21:51:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:33 smithi155 ceph-mon[79928]: pgmap v173: 65 pgs: 65 active+clean; 140 MiB data, 702 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-09-13T21:51:33.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:33 smithi119 ceph-mon[90896]: pgmap v173: 65 pgs: 65 active+clean; 140 MiB data, 702 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-09-13T21:51:35.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:35 smithi155 ceph-mon[79928]: pgmap v174: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 7 op/s 2024-09-13T21:51:35.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:35.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:35.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:35.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:35.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:35.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:35.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:35.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:35.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:35 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:35.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:35 smithi119 ceph-mon[90896]: pgmap v174: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 7 op/s 2024-09-13T21:51:35.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:35.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:35.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:35.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:35.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:35.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:35.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:35.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:35.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:35 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:36.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:36 smithi155 ceph-mon[79928]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T21:51:36.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:36 smithi119 ceph-mon[90896]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T21:51:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:37 smithi155 ceph-mon[79928]: pgmap v175: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 3 op/s 2024-09-13T21:51:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:37 smithi155 ceph-mon[79928]: daemon mds.cephfs.smithi155.yblkxo finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-13T21:51:37.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:37 smithi119 ceph-mon[90896]: pgmap v175: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 3 op/s 2024-09-13T21:51:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:37 smithi119 ceph-mon[90896]: daemon mds.cephfs.smithi155.yblkxo finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-13T21:51:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:38 smithi155 ceph-mon[79928]: mds.1 [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] down:stopped 2024-09-13T21:51:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:38 smithi155 ceph-mon[79928]: fsmap cephfs:1 {0=cephfs.smithi119.yydzwt=up:active} 2 up:standby 2024-09-13T21:51:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:38 smithi119 ceph-mon[90896]: mds.1 [v2:172.21.15.155:6824/1473450727,v1:172.21.15.155:6825/1473450727] down:stopped 2024-09-13T21:51:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:38 smithi119 ceph-mon[90896]: fsmap cephfs:1 {0=cephfs.smithi119.yydzwt=up:active} 2 up:standby 2024-09-13T21:51:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:39 smithi155 ceph-mon[79928]: pgmap v176: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-09-13T21:51:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:39 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.155:6824/1541412300,v1:172.21.15.155:6825/1541412300] up:boot 2024-09-13T21:51:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:39 smithi155 ceph-mon[79928]: fsmap cephfs:1 {0=cephfs.smithi119.yydzwt=up:active} 3 up:standby 2024-09-13T21:51:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:39 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:51:39.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:39 smithi119 ceph-mon[90896]: pgmap v176: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-09-13T21:51:39.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:39 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.155:6824/1541412300,v1:172.21.15.155:6825/1541412300] up:boot 2024-09-13T21:51:39.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:39 smithi119 ceph-mon[90896]: fsmap cephfs:1 {0=cephfs.smithi119.yydzwt=up:active} 3 up:standby 2024-09-13T21:51:39.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:39 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:51:41.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:41 smithi155 ceph-mon[79928]: pgmap v177: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 2 op/s 2024-09-13T21:51:41.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:41 smithi119 ceph-mon[90896]: pgmap v177: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 2 op/s 2024-09-13T21:51:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:43 smithi155 ceph-mon[79928]: pgmap v178: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T21:51:43.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:43 smithi119 ceph-mon[90896]: pgmap v178: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T21:51:44.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.963+0000 7f16ea1a3640 1 -- 172.21.15.119:0/605212842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16e40fa930 msgr2=0x7f16e40fad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:44.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.963+0000 7f16ea1a3640 1 --2- 172.21.15.119:0/605212842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16e40fa930 0x7f16e40fad40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f16d80048d0 tx=0x7f16d8009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:44.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.963+0000 7f16ea1a3640 1 -- 172.21.15.119:0/605212842 shutdown_connections 2024-09-13T21:51:44.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.963+0000 7f16ea1a3640 1 --2- 172.21.15.119:0/605212842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40fb280 0x7f16e40fdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:44.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.963+0000 7f16ea1a3640 1 --2- 172.21.15.119:0/605212842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16e40fa930 0x7f16e40fad40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:44.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.963+0000 7f16ea1a3640 1 -- 172.21.15.119:0/605212842 >> 172.21.15.119:0/605212842 conn(0x7f16e40f6390 msgr2=0x7f16e40f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:44.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.963+0000 7f16ea1a3640 1 -- 172.21.15.119:0/605212842 shutdown_connections 2024-09-13T21:51:44.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.963+0000 7f16ea1a3640 1 -- 172.21.15.119:0/605212842 wait complete. 2024-09-13T21:51:44.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.964+0000 7f16ea1a3640 1 Processor -- start 2024-09-13T21:51:44.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.964+0000 7f16ea1a3640 1 -- start start 2024-09-13T21:51:44.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.964+0000 7f16ea1a3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40fa930 0x7f16e410d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:44.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.964+0000 7f16ea1a3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16e40fb280 0x7f16e410d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:44.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.964+0000 7f16ea1a3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e410e6b0 con 0x7f16e40fb280 2024-09-13T21:51:44.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.964+0000 7f16ea1a3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e410e820 con 0x7f16e40fa930 2024-09-13T21:51:44.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16e2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16e40fb280 0x7f16e410d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:44.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16e37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40fa930 0x7f16e410d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:44.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16e2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16e40fb280 0x7f16e410d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46866/0 (socket says 172.21.15.119:46866) 2024-09-13T21:51:44.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16e37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40fa930 0x7f16e410d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.119:41920/0 (socket says 172.21.15.119:41920) 2024-09-13T21:51:44.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16e2ffd640 1 -- 172.21.15.119:0/4171164457 learned_addr learned my addr 172.21.15.119:0/4171164457 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:44.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16e2ffd640 1 -- 172.21.15.119:0/4171164457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40fa930 msgr2=0x7f16e410d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:44.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16e2ffd640 1 --2- 172.21.15.119:0/4171164457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40fa930 0x7f16e410d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:44.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16e2ffd640 1 -- 172.21.15.119:0/4171164457 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d8005040 con 0x7f16e40fb280 2024-09-13T21:51:44.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16e37fe640 1 --2- 172.21.15.119:0/4171164457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40fa930 0x7f16e410d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:51:44.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16e2ffd640 1 --2- 172.21.15.119:0/4171164457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16e40fb280 0x7f16e410d840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f16d400b580 tx=0x7f16d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:44.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16cbfff640 1 -- 172.21.15.119:0/4171164457 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d400f570 con 0x7f16e40fb280 2024-09-13T21:51:44.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16cbfff640 1 -- 172.21.15.119:0/4171164457 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f16d400fb70 con 0x7f16e40fb280 2024-09-13T21:51:44.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16ea1a3640 1 -- 172.21.15.119:0/4171164457 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e410eb00 con 0x7f16e40fb280 2024-09-13T21:51:44.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.965+0000 7f16cbfff640 1 -- 172.21.15.119:0/4171164457 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d4010cd0 con 0x7f16e40fb280 2024-09-13T21:51:44.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.966+0000 7f16ea1a3640 1 -- 172.21.15.119:0/4171164457 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e410f020 con 0x7f16e40fb280 2024-09-13T21:51:44.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.967+0000 7f16ea1a3640 1 -- 172.21.15.119:0/4171164457 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e40fa010 con 0x7f16e40fb280 2024-09-13T21:51:44.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.967+0000 7f16cbfff640 1 -- 172.21.15.119:0/4171164457 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f16d400fce0 con 0x7f16e40fb280 2024-09-13T21:51:44.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.968+0000 7f16cbfff640 1 --2- 172.21.15.119:0/4171164457 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f16cc06e530 0x7f16cc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:44.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.968+0000 7f16cbfff640 1 -- 172.21.15.119:0/4171164457 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f16d408ded0 con 0x7f16e40fb280 2024-09-13T21:51:44.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.968+0000 7f16e37fe640 1 --2- 172.21.15.119:0/4171164457 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f16cc06e530 0x7f16cc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:44.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.968+0000 7f16e37fe640 1 --2- 172.21.15.119:0/4171164457 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f16cc06e530 0x7f16cc0709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16d8007ac0 tx=0x7f16d8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:44.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:44.972+0000 7f16cbfff640 1 -- 172.21.15.119:0/4171164457 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f16d4057090 con 0x7f16e40fb280 2024-09-13T21:51:45.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.164+0000 7f16ea1a3640 1 -- 172.21.15.119:0/4171164457 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f16e4105200 con 0x7f16cc06e530 2024-09-13T21:51:45.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.166+0000 7f16cbfff640 1 -- 172.21.15.119:0/4171164457 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f16e4105200 con 0x7f16cc06e530 2024-09-13T21:51:45.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.168+0000 7f16ea1a3640 1 -- 172.21.15.119:0/4171164457 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f16cc06e530 msgr2=0x7f16cc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.168+0000 7f16ea1a3640 1 --2- 172.21.15.119:0/4171164457 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f16cc06e530 0x7f16cc0709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16d8007ac0 tx=0x7f16d8035040 comp rx=0 tx=0).stop 2024-09-13T21:51:45.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.168+0000 7f16ea1a3640 1 -- 172.21.15.119:0/4171164457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16e40fb280 msgr2=0x7f16e410d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.168+0000 7f16ea1a3640 1 --2- 172.21.15.119:0/4171164457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16e40fb280 0x7f16e410d840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f16d400b580 tx=0x7f16d40091a0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.168+0000 7f16ea1a3640 1 -- 172.21.15.119:0/4171164457 shutdown_connections 2024-09-13T21:51:45.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.168+0000 7f16ea1a3640 1 --2- 172.21.15.119:0/4171164457 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f16cc06e530 0x7f16cc0709e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.168+0000 7f16ea1a3640 1 --2- 172.21.15.119:0/4171164457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16e40fb280 0x7f16e410d840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.168+0000 7f16ea1a3640 1 --2- 172.21.15.119:0/4171164457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40fa930 0x7f16e410d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.168+0000 7f16ea1a3640 1 -- 172.21.15.119:0/4171164457 >> 172.21.15.119:0/4171164457 conn(0x7f16e40f6390 msgr2=0x7f16e40f7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:45.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.168+0000 7f16ea1a3640 1 -- 172.21.15.119:0/4171164457 shutdown_connections 2024-09-13T21:51:45.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.168+0000 7f16ea1a3640 1 -- 172.21.15.119:0/4171164457 wait complete. 2024-09-13T21:51:45.180 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:51:45.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.250+0000 7f48f7456640 1 -- 172.21.15.119:0/4265871140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f00fc570 msgr2=0x7f48f00fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.250+0000 7f48f7456640 1 --2- 172.21.15.119:0/4265871140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f00fc570 0x7f48f00fc980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f48e00048d0 tx=0x7f48e0009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.250+0000 7f48f7456640 1 -- 172.21.15.119:0/4265871140 shutdown_connections 2024-09-13T21:51:45.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.250+0000 7f48f7456640 1 --2- 172.21.15.119:0/4265871140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f00fd840 0x7f48f00fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.250+0000 7f48f7456640 1 --2- 172.21.15.119:0/4265871140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f00fc570 0x7f48f00fc980 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f7456640 1 -- 172.21.15.119:0/4265871140 >> 172.21.15.119:0/4265871140 conn(0x7f48f00f7d30 msgr2=0x7f48f00fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:45.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f7456640 1 -- 172.21.15.119:0/4265871140 shutdown_connections 2024-09-13T21:51:45.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f7456640 1 -- 172.21.15.119:0/4265871140 wait complete. 2024-09-13T21:51:45.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f7456640 1 Processor -- start 2024-09-13T21:51:45.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f7456640 1 -- start start 2024-09-13T21:51:45.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f7456640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f00fc570 0x7f48f010d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f7456640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f00fd840 0x7f48f010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f7456640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f010dc00 con 0x7f48f00fd840 2024-09-13T21:51:45.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f7456640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f010e420 con 0x7f48f00fc570 2024-09-13T21:51:45.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f49f1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f00fd840 0x7f48f010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f49f1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f00fd840 0x7f48f010d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46882/0 (socket says 172.21.15.119:46882) 2024-09-13T21:51:45.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f49f1640 1 -- 172.21.15.119:0/294959293 learned_addr learned my addr 172.21.15.119:0/294959293 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:45.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.251+0000 7f48f51f2640 1 --2- 172.21.15.119:0/294959293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f00fc570 0x7f48f010d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.252+0000 7f48f49f1640 1 -- 172.21.15.119:0/294959293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f00fc570 msgr2=0x7f48f010d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.252+0000 7f48f49f1640 1 --2- 172.21.15.119:0/294959293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f00fc570 0x7f48f010d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.252+0000 7f48f49f1640 1 -- 172.21.15.119:0/294959293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0005040 con 0x7f48f00fd840 2024-09-13T21:51:45.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.252+0000 7f48f49f1640 1 --2- 172.21.15.119:0/294959293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f00fd840 0x7f48f010d5b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f48ec002a50 tx=0x7f48ec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:45.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.252+0000 7f48e5ffb640 1 -- 172.21.15.119:0/294959293 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48ec007c30 con 0x7f48f00fd840 2024-09-13T21:51:45.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.252+0000 7f48e5ffb640 1 -- 172.21.15.119:0/294959293 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f48ec00f040 con 0x7f48f00fd840 2024-09-13T21:51:45.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.252+0000 7f48f7456640 1 -- 172.21.15.119:0/294959293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f010e6b0 con 0x7f48f00fd840 2024-09-13T21:51:45.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.252+0000 7f48e5ffb640 1 -- 172.21.15.119:0/294959293 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48ec00dad0 con 0x7f48f00fd840 2024-09-13T21:51:45.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.252+0000 7f48f7456640 1 -- 172.21.15.119:0/294959293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f010ec50 con 0x7f48f00fd840 2024-09-13T21:51:45.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.253+0000 7f48f7456640 1 -- 172.21.15.119:0/294959293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f00fb9d0 con 0x7f48f00fd840 2024-09-13T21:51:45.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.254+0000 7f48e5ffb640 1 -- 172.21.15.119:0/294959293 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f48ec00dc30 con 0x7f48f00fd840 2024-09-13T21:51:45.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.254+0000 7f48e5ffb640 1 --2- 172.21.15.119:0/294959293 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48dc06e530 0x7f48dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.254+0000 7f48e5ffb640 1 -- 172.21.15.119:0/294959293 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f48ec08e090 con 0x7f48f00fd840 2024-09-13T21:51:45.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.254+0000 7f48f51f2640 1 --2- 172.21.15.119:0/294959293 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48dc06e530 0x7f48dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.255+0000 7f48f51f2640 1 --2- 172.21.15.119:0/294959293 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48dc06e530 0x7f48dc0709e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f48e000b020 tx=0x7f48e0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:45.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.259+0000 7f48e5ffb640 1 -- 172.21.15.119:0/294959293 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f48ec057130 con 0x7f48f00fd840 2024-09-13T21:51:45.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.447+0000 7f48f7456640 1 -- 172.21.15.119:0/294959293 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48f010ef80 con 0x7f48dc06e530 2024-09-13T21:51:45.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.448+0000 7f48e5ffb640 1 -- 172.21.15.119:0/294959293 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f48f010ef80 con 0x7f48dc06e530 2024-09-13T21:51:45.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.450+0000 7f48f7456640 1 -- 172.21.15.119:0/294959293 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48dc06e530 msgr2=0x7f48dc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.450+0000 7f48f7456640 1 --2- 172.21.15.119:0/294959293 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48dc06e530 0x7f48dc0709e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f48e000b020 tx=0x7f48e0035040 comp rx=0 tx=0).stop 2024-09-13T21:51:45.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.450+0000 7f48f7456640 1 -- 172.21.15.119:0/294959293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f00fd840 msgr2=0x7f48f010d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.450+0000 7f48f7456640 1 --2- 172.21.15.119:0/294959293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f00fd840 0x7f48f010d5b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f48ec002a50 tx=0x7f48ec004600 comp rx=0 tx=0).stop 2024-09-13T21:51:45.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.450+0000 7f48f7456640 1 -- 172.21.15.119:0/294959293 shutdown_connections 2024-09-13T21:51:45.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.450+0000 7f48f7456640 1 --2- 172.21.15.119:0/294959293 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f48dc06e530 0x7f48dc0709e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.450+0000 7f48f7456640 1 --2- 172.21.15.119:0/294959293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48f00fd840 0x7f48f010d5b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.450+0000 7f48f7456640 1 --2- 172.21.15.119:0/294959293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f00fc570 0x7f48f010d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.450+0000 7f48f7456640 1 -- 172.21.15.119:0/294959293 >> 172.21.15.119:0/294959293 conn(0x7f48f00f7d30 msgr2=0x7f48f00f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:45.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.450+0000 7f48f7456640 1 -- 172.21.15.119:0/294959293 shutdown_connections 2024-09-13T21:51:45.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.450+0000 7f48f7456640 1 -- 172.21.15.119:0/294959293 wait complete. 2024-09-13T21:51:45.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.529+0000 7f63c6938640 1 -- 172.21.15.119:0/2011991190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63c006ffe0 msgr2=0x7f63c0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.529+0000 7f63c6938640 1 --2- 172.21.15.119:0/2011991190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63c006ffe0 0x7f63c0070450 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f63a80048d0 tx=0x7f63a8009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.529+0000 7f63c6938640 1 -- 172.21.15.119:0/2011991190 shutdown_connections 2024-09-13T21:51:45.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.529+0000 7f63c6938640 1 --2- 172.21.15.119:0/2011991190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63c006ffe0 0x7f63c0070450 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.529+0000 7f63c6938640 1 --2- 172.21.15.119:0/2011991190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63c0071570 0x7f63c006faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.529+0000 7f63c6938640 1 -- 172.21.15.119:0/2011991190 >> 172.21.15.119:0/2011991190 conn(0x7f63c00f7d10 msgr2=0x7f63c00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:45.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.529+0000 7f63c6938640 1 -- 172.21.15.119:0/2011991190 shutdown_connections 2024-09-13T21:51:45.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.529+0000 7f63c6938640 1 -- 172.21.15.119:0/2011991190 wait complete. 2024-09-13T21:51:45.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:45 smithi119 ceph-mon[90896]: pgmap v179: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T21:51:45.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:45 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:45.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:45 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:45.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:45 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:45.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:45 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:45.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:45 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:45.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:45 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:45.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:45 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:45.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:45 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:45.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:45 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:45.533 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:45 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi119.rpmijj"]}]: dispatch 2024-09-13T21:51:45.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.529+0000 7f63c6938640 1 Processor -- start 2024-09-13T21:51:45.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63c6938640 1 -- start start 2024-09-13T21:51:45.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63c6938640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63c006ffe0 0x7f63c010f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63c6938640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63c0071570 0x7f63c010f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63c6938640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0110650 con 0x7f63c006ffe0 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63c6938640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c01107c0 con 0x7f63c0071570 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63bffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63c006ffe0 0x7f63c010f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63bffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63c006ffe0 0x7f63c010f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46900/0 (socket says 172.21.15.119:46900) 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63bffff640 1 -- 172.21.15.119:0/229141561 learned_addr learned my addr 172.21.15.119:0/229141561 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63bf7fe640 1 --2- 172.21.15.119:0/229141561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63c0071570 0x7f63c010f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63bffff640 1 -- 172.21.15.119:0/229141561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63c0071570 msgr2=0x7f63c010f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63bffff640 1 --2- 172.21.15.119:0/229141561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63c0071570 0x7f63c010f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.530+0000 7f63bffff640 1 -- 172.21.15.119:0/229141561 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a8005040 con 0x7f63c006ffe0 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.531+0000 7f63bffff640 1 --2- 172.21.15.119:0/229141561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63c006ffe0 0x7f63c010f310 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f63b000b580 tx=0x7f63b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.531+0000 7f63bcff9640 1 -- 172.21.15.119:0/229141561 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b000f570 con 0x7f63c006ffe0 2024-09-13T21:51:45.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.531+0000 7f63bcff9640 1 -- 172.21.15.119:0/229141561 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f63b000fb70 con 0x7f63c006ffe0 2024-09-13T21:51:45.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.531+0000 7f63bcff9640 1 -- 172.21.15.119:0/229141561 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b0010d40 con 0x7f63c006ffe0 2024-09-13T21:51:45.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.531+0000 7f63c6938640 1 -- 172.21.15.119:0/229141561 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c0110aa0 con 0x7f63c006ffe0 2024-09-13T21:51:45.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.531+0000 7f63c6938640 1 -- 172.21.15.119:0/229141561 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c0110fc0 con 0x7f63c006ffe0 2024-09-13T21:51:45.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.532+0000 7f63c6938640 1 -- 172.21.15.119:0/229141561 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c01079f0 con 0x7f63c006ffe0 2024-09-13T21:51:45.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.532+0000 7f63bcff9640 1 -- 172.21.15.119:0/229141561 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f63b000fce0 con 0x7f63c006ffe0 2024-09-13T21:51:45.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.533+0000 7f63bcff9640 1 --2- 172.21.15.119:0/229141561 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f63ac06e530 0x7f63ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.533+0000 7f63bcff9640 1 -- 172.21.15.119:0/229141561 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f63b008e010 con 0x7f63c006ffe0 2024-09-13T21:51:45.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.533+0000 7f63bf7fe640 1 --2- 172.21.15.119:0/229141561 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f63ac06e530 0x7f63ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.533+0000 7f63bf7fe640 1 --2- 172.21.15.119:0/229141561 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f63ac06e530 0x7f63ac0709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f63a8007ac0 tx=0x7f63a8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:45.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.537+0000 7f63bcff9640 1 -- 172.21.15.119:0/229141561 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f63b00571d0 con 0x7f63c006ffe0 2024-09-13T21:51:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:45 smithi155 ceph-mon[79928]: pgmap v179: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T21:51:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:45 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:45 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:45 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:51:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:45 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:45 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:45 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:45 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:45 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:45 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:45 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi119.rpmijj"]}]: dispatch 2024-09-13T21:51:45.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.720+0000 7f63c6938640 1 -- 172.21.15.119:0/229141561 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f63c01111e0 con 0x7f63ac06e530 2024-09-13T21:51:45.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.728+0000 7f63bcff9640 1 -- 172.21.15.119:0/229141561 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f63c01111e0 con 0x7f63ac06e530 2024-09-13T21:51:45.731 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:51:45.731 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (6m) 2m ago 14m 25.9M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:51:45.731 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (4m) 2m ago 14m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:51:45.731 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (3m) 48s ago 14m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:51:45.731 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (6m) 2m ago 14m 80.4M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:51:45.731 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (9m) 2m ago 9m 13.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 a18fa8bbd7f9 2024-09-13T21:51:45.732 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (9m) 2m ago 9m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 a6f367764069 2024-09-13T21:51:45.732 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (9m) 48s ago 9m 17.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:51:45.732 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (9m) 48s ago 9m 110M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:51:45.732 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (5m) 2m ago 15m 498M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:51:45.732 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (5m) 48s ago 13m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:51:45.732 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (5m) 2m ago 16m 47.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:51:45.733 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (4m) 48s ago 13m 41.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:51:45.733 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (6m) 2m ago 14m 16.2M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:51:45.733 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (5m) 48s ago 14m 14.8M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:51:45.733 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (3m) 2m ago 13m 93.3M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:51:45.733 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (3m) 2m ago 12m 93.6M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 8f69bf25cd20 2024-09-13T21:51:45.733 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (2m) 2m ago 12m 11.0M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 0f73e4fc2c43 2024-09-13T21:51:45.734 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (116s) 48s ago 11m 103M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5a7f5a9c1c4d 2024-09-13T21:51:45.734 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (83s) 48s ago 11m 102M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 03c992670291 2024-09-13T21:51:45.734 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (51s) 48s ago 10m 11.7M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 bf54ed40f20f 2024-09-13T21:51:45.734 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (5m) 2m ago 14m 51.8M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:51:45.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.730+0000 7f63c6938640 1 -- 172.21.15.119:0/229141561 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f63ac06e530 msgr2=0x7f63ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.730+0000 7f63c6938640 1 --2- 172.21.15.119:0/229141561 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f63ac06e530 0x7f63ac0709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f63a8007ac0 tx=0x7f63a8035040 comp rx=0 tx=0).stop 2024-09-13T21:51:45.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.730+0000 7f63c6938640 1 -- 172.21.15.119:0/229141561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63c006ffe0 msgr2=0x7f63c010f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.730+0000 7f63c6938640 1 --2- 172.21.15.119:0/229141561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63c006ffe0 0x7f63c010f310 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f63b000b580 tx=0x7f63b00091a0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.730+0000 7f63c6938640 1 -- 172.21.15.119:0/229141561 shutdown_connections 2024-09-13T21:51:45.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.730+0000 7f63c6938640 1 --2- 172.21.15.119:0/229141561 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f63ac06e530 0x7f63ac0709e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.731+0000 7f63c6938640 1 --2- 172.21.15.119:0/229141561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63c0071570 0x7f63c010f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.731+0000 7f63c6938640 1 --2- 172.21.15.119:0/229141561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63c006ffe0 0x7f63c010f310 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.731+0000 7f63c6938640 1 -- 172.21.15.119:0/229141561 >> 172.21.15.119:0/229141561 conn(0x7f63c00f7d10 msgr2=0x7f63c00f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:45.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.731+0000 7f63c6938640 1 -- 172.21.15.119:0/229141561 shutdown_connections 2024-09-13T21:51:45.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.731+0000 7f63c6938640 1 -- 172.21.15.119:0/229141561 wait complete. 2024-09-13T21:51:45.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.808+0000 7f1547cb6640 1 -- 172.21.15.119:0/3274277542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400fdbc0 msgr2=0x7f15400fdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.808+0000 7f1547cb6640 1 --2- 172.21.15.119:0/3274277542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400fdbc0 0x7f15400fdfd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f153c0048d0 tx=0x7f153c009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.808+0000 7f1547cb6640 1 -- 172.21.15.119:0/3274277542 shutdown_connections 2024-09-13T21:51:45.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.808+0000 7f1547cb6640 1 --2- 172.21.15.119:0/3274277542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400fe510 0x7f15400fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.808+0000 7f1547cb6640 1 --2- 172.21.15.119:0/3274277542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400fdbc0 0x7f15400fdfd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.808+0000 7f1547cb6640 1 -- 172.21.15.119:0/3274277542 >> 172.21.15.119:0/3274277542 conn(0x7f15400f63c0 msgr2=0x7f15400f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.808+0000 7f1547cb6640 1 -- 172.21.15.119:0/3274277542 shutdown_connections 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.808+0000 7f1547cb6640 1 -- 172.21.15.119:0/3274277542 wait complete. 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.808+0000 7f1547cb6640 1 Processor -- start 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.808+0000 7f1547cb6640 1 -- start start 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1547cb6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400fdbc0 0x7f154010d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1547cb6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400fe510 0x7f154010d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1547cb6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154010dce0 con 0x7f15400fdbc0 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1547cb6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154010e500 con 0x7f15400fe510 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1545a52640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400fdbc0 0x7f154010d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1545a52640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400fdbc0 0x7f154010d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46930/0 (socket says 172.21.15.119:46930) 2024-09-13T21:51:45.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1545a52640 1 -- 172.21.15.119:0/2268709433 learned_addr learned my addr 172.21.15.119:0/2268709433 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:45.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1545251640 1 --2- 172.21.15.119:0/2268709433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400fe510 0x7f154010d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1545a52640 1 -- 172.21.15.119:0/2268709433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400fe510 msgr2=0x7f154010d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:45.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1545a52640 1 --2- 172.21.15.119:0/2268709433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400fe510 0x7f154010d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:45.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1545a52640 1 -- 172.21.15.119:0/2268709433 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c005040 con 0x7f15400fdbc0 2024-09-13T21:51:45.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1545a52640 1 --2- 172.21.15.119:0/2268709433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400fdbc0 0x7f154010d150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f153c000c00 tx=0x7f153c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:45.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f15367fc640 1 -- 172.21.15.119:0/2268709433 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f153c038070 con 0x7f15400fdbc0 2024-09-13T21:51:45.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f15367fc640 1 -- 172.21.15.119:0/2268709433 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f153c004290 con 0x7f15400fdbc0 2024-09-13T21:51:45.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1547cb6640 1 -- 172.21.15.119:0/2268709433 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154010e730 con 0x7f15400fdbc0 2024-09-13T21:51:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f1547cb6640 1 -- 172.21.15.119:0/2268709433 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154010ecd0 con 0x7f15400fdbc0 2024-09-13T21:51:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.809+0000 7f15367fc640 1 -- 172.21.15.119:0/2268709433 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f153c03e430 con 0x7f15400fdbc0 2024-09-13T21:51:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.811+0000 7f1547cb6640 1 -- 172.21.15.119:0/2268709433 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15400fa060 con 0x7f15400fdbc0 2024-09-13T21:51:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.811+0000 7f15367fc640 1 -- 172.21.15.119:0/2268709433 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f153c030020 con 0x7f15400fdbc0 2024-09-13T21:51:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.811+0000 7f15367fc640 1 --2- 172.21.15.119:0/2268709433 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f152c06e530 0x7f152c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.811+0000 7f15367fc640 1 -- 172.21.15.119:0/2268709433 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f153c0ae1e0 con 0x7f15400fdbc0 2024-09-13T21:51:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.811+0000 7f1545251640 1 --2- 172.21.15.119:0/2268709433 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f152c06e530 0x7f152c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.812+0000 7f1545251640 1 --2- 172.21.15.119:0/2268709433 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f152c06e530 0x7f152c0709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f154010cf00 tx=0x7f153000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:45.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:45.816+0000 7f15367fc640 1 -- 172.21.15.119:0/2268709433 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f153c0773d0 con 0x7f15400fdbc0 2024-09-13T21:51:46.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.055+0000 7f1547cb6640 1 -- 172.21.15.119:0/2268709433 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f154010ef40 con 0x7f15400fdbc0 2024-09-13T21:51:46.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.055+0000 7f15367fc640 1 -- 172.21.15.119:0/2268709433 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f153c07aa90 con 0x7f15400fdbc0 2024-09-13T21:51:46.057 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:51:46.057 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:51:46.057 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:51:46.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:51:46.057 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4, 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 10 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:51:46.058 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:51:46.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.057+0000 7f1547cb6640 1 -- 172.21.15.119:0/2268709433 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f152c06e530 msgr2=0x7f152c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.057+0000 7f1547cb6640 1 --2- 172.21.15.119:0/2268709433 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f152c06e530 0x7f152c0709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f154010cf00 tx=0x7f153000b040 comp rx=0 tx=0).stop 2024-09-13T21:51:46.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.057+0000 7f1547cb6640 1 -- 172.21.15.119:0/2268709433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400fdbc0 msgr2=0x7f154010d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.057+0000 7f1547cb6640 1 --2- 172.21.15.119:0/2268709433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400fdbc0 0x7f154010d150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f153c000c00 tx=0x7f153c009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.057+0000 7f1547cb6640 1 -- 172.21.15.119:0/2268709433 shutdown_connections 2024-09-13T21:51:46.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.057+0000 7f1547cb6640 1 --2- 172.21.15.119:0/2268709433 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f152c06e530 0x7f152c0709e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.057+0000 7f1547cb6640 1 --2- 172.21.15.119:0/2268709433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15400fe510 0x7f154010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.058+0000 7f1547cb6640 1 --2- 172.21.15.119:0/2268709433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400fdbc0 0x7f154010d150 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.058+0000 7f1547cb6640 1 -- 172.21.15.119:0/2268709433 >> 172.21.15.119:0/2268709433 conn(0x7f15400f63c0 msgr2=0x7f15400f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:46.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.058+0000 7f1547cb6640 1 -- 172.21.15.119:0/2268709433 shutdown_connections 2024-09-13T21:51:46.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.058+0000 7f1547cb6640 1 -- 172.21.15.119:0/2268709433 wait complete. 2024-09-13T21:51:46.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.136+0000 7f13e2152640 1 -- 172.21.15.119:0/2046109772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0fb430 msgr2=0x7f13dc0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.136+0000 7f13e2152640 1 --2- 172.21.15.119:0/2046109772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0fb430 0x7f13dc0fb840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f13d00048d0 tx=0x7f13d0009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.136+0000 7f13e2152640 1 -- 172.21.15.119:0/2046109772 shutdown_connections 2024-09-13T21:51:46.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.136+0000 7f13e2152640 1 --2- 172.21.15.119:0/2046109772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13dc0fc700 0x7f13dc0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.136+0000 7f13e2152640 1 --2- 172.21.15.119:0/2046109772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0fb430 0x7f13dc0fb840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.136+0000 7f13e2152640 1 -- 172.21.15.119:0/2046109772 >> 172.21.15.119:0/2046109772 conn(0x7f13dc0f6c10 msgr2=0x7f13dc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:46.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.136+0000 7f13e2152640 1 -- 172.21.15.119:0/2046109772 shutdown_connections 2024-09-13T21:51:46.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.136+0000 7f13e2152640 1 -- 172.21.15.119:0/2046109772 wait complete. 2024-09-13T21:51:46.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.137+0000 7f13e2152640 1 Processor -- start 2024-09-13T21:51:46.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.137+0000 7f13e2152640 1 -- start start 2024-09-13T21:51:46.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.137+0000 7f13e2152640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0fb430 0x7f13dc10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:46.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.137+0000 7f13e2152640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13dc0fc700 0x7f13dc10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.137+0000 7f13e2152640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc10cb10 con 0x7f13dc0fb430 2024-09-13T21:51:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.137+0000 7f13e2152640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc10d330 con 0x7f13dc0fc700 2024-09-13T21:51:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.137+0000 7f13db7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0fb430 0x7f13dc10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.137+0000 7f13db7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0fb430 0x7f13dc10bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46956/0 (socket says 172.21.15.119:46956) 2024-09-13T21:51:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.137+0000 7f13db7fe640 1 -- 172.21.15.119:0/1017649577 learned_addr learned my addr 172.21.15.119:0/1017649577 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.137+0000 7f13daffd640 1 --2- 172.21.15.119:0/1017649577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13dc0fc700 0x7f13dc10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.138+0000 7f13db7fe640 1 -- 172.21.15.119:0/1017649577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13dc0fc700 msgr2=0x7f13dc10c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.138+0000 7f13db7fe640 1 --2- 172.21.15.119:0/1017649577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13dc0fc700 0x7f13dc10c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.138+0000 7f13db7fe640 1 -- 172.21.15.119:0/1017649577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0005040 con 0x7f13dc0fb430 2024-09-13T21:51:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.138+0000 7f13db7fe640 1 --2- 172.21.15.119:0/1017649577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0fb430 0x7f13dc10bf80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f13d0004930 tx=0x7f13d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.138+0000 7f13c3fff640 1 -- 172.21.15.119:0/1017649577 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13d003a070 con 0x7f13dc0fb430 2024-09-13T21:51:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.138+0000 7f13c3fff640 1 -- 172.21.15.119:0/1017649577 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f13d00338c0 con 0x7f13dc0fb430 2024-09-13T21:51:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.138+0000 7f13e2152640 1 -- 172.21.15.119:0/1017649577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc10d560 con 0x7f13dc0fb430 2024-09-13T21:51:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.138+0000 7f13c3fff640 1 -- 172.21.15.119:0/1017649577 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13d003e8e0 con 0x7f13dc0fb430 2024-09-13T21:51:46.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.138+0000 7f13e2152640 1 -- 172.21.15.119:0/1017649577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc10daa0 con 0x7f13dc0fb430 2024-09-13T21:51:46.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.139+0000 7f13e2152640 1 -- 172.21.15.119:0/1017649577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc0fa890 con 0x7f13dc0fb430 2024-09-13T21:51:46.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.139+0000 7f13c3fff640 1 -- 172.21.15.119:0/1017649577 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f13d0030020 con 0x7f13dc0fb430 2024-09-13T21:51:46.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.140+0000 7f13c3fff640 1 --2- 172.21.15.119:0/1017649577 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f13c406e530 0x7f13c40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:46.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.140+0000 7f13c3fff640 1 -- 172.21.15.119:0/1017649577 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f13d00affb0 con 0x7f13dc0fb430 2024-09-13T21:51:46.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.140+0000 7f13daffd640 1 --2- 172.21.15.119:0/1017649577 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f13c406e530 0x7f13c40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:46.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.140+0000 7f13daffd640 1 --2- 172.21.15.119:0/1017649577 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f13c406e530 0x7f13c40709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f13dc10bd30 tx=0x7f13cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:46.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.144+0000 7f13c3fff640 1 -- 172.21.15.119:0/1017649577 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f13d00792e0 con 0x7f13dc0fb430 2024-09-13T21:51:46.335 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:46 smithi119 ceph-mon[90896]: Upgrade: It appears safe to stop mds.cephfs.smithi119.rpmijj 2024-09-13T21:51:46.336 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:46 smithi119 ceph-mon[90896]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:46.336 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:46 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2268709433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:46.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.353+0000 7f13e2152640 1 -- 172.21.15.119:0/1017649577 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f13dc10ddb0 con 0x7f13dc0fb430 2024-09-13T21:51:46.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.354+0000 7f13c3fff640 1 -- 172.21.15.119:0/1017649577 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1930 (secure 0 0 0) 0x7f13d007c9a0 con 0x7f13dc0fb430 2024-09-13T21:51:46.356 INFO:teuthology.orchestra.run.smithi119.stdout:e27 2024-09-13T21:51:46.356 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:51:38:209181+0000 2024-09-13T21:51:46.356 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:51:46.357 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:51:46.357 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:51:46.357 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:51:46.357 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:51:46.357 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:51:46.358 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 26 2024-09-13T21:51:46.358 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:51:46.358 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:51:46.358 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:51:37.180357+0000 2024-09-13T21:51:46.358 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:51:46.358 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 44 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 1 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:in 0 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=14472} 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:51:46.359 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:51:46.360 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 1 2024-09-13T21:51:46.360 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:51:46.360 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:51:46.360 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:51:46.360 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:51:46.360 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:51:46.360 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:51:46.360 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 14472 members: 14472 2024-09-13T21:51:46.360 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{0:14472} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.119:6828/66730685,v1:172.21.15.119:6829/66730685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:51:46.360 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:51:46.361 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:51:46.361 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:51:46.361 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:51:46.361 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:51:46.361 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/1506378601,v1:172.21.15.119:6827/1506378601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:51:46.361 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.155:6824/1541412300,v1:172.21.15.155:6825/1541412300] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:51:46.362 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 27 2024-09-13T21:51:46.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.357+0000 7f13e2152640 1 -- 172.21.15.119:0/1017649577 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f13c406e530 msgr2=0x7f13c40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.357+0000 7f13e2152640 1 --2- 172.21.15.119:0/1017649577 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f13c406e530 0x7f13c40709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f13dc10bd30 tx=0x7f13cc00b040 comp rx=0 tx=0).stop 2024-09-13T21:51:46.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.357+0000 7f13e2152640 1 -- 172.21.15.119:0/1017649577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0fb430 msgr2=0x7f13dc10bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.357+0000 7f13e2152640 1 --2- 172.21.15.119:0/1017649577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0fb430 0x7f13dc10bf80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f13d0004930 tx=0x7f13d0009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.357+0000 7f13e2152640 1 -- 172.21.15.119:0/1017649577 shutdown_connections 2024-09-13T21:51:46.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.357+0000 7f13e2152640 1 --2- 172.21.15.119:0/1017649577 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f13c406e530 0x7f13c40709e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.357+0000 7f13e2152640 1 --2- 172.21.15.119:0/1017649577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13dc0fc700 0x7f13dc10c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.357+0000 7f13e2152640 1 --2- 172.21.15.119:0/1017649577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0fb430 0x7f13dc10bf80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.357+0000 7f13e2152640 1 -- 172.21.15.119:0/1017649577 >> 172.21.15.119:0/1017649577 conn(0x7f13dc0f6c10 msgr2=0x7f13dc0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:46.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.357+0000 7f13e2152640 1 -- 172.21.15.119:0/1017649577 shutdown_connections 2024-09-13T21:51:46.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.357+0000 7f13e2152640 1 -- 172.21.15.119:0/1017649577 wait complete. 2024-09-13T21:51:46.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.442+0000 7fd1672b3640 1 -- 172.21.15.119:0/2081217244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd160065be0 msgr2=0x7fd1600ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.442+0000 7fd1672b3640 1 --2- 172.21.15.119:0/2081217244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd160065be0 0x7fd1600ff1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0048d0 tx=0x7fd15c009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.442+0000 7fd1672b3640 1 -- 172.21.15.119:0/2081217244 shutdown_connections 2024-09-13T21:51:46.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.442+0000 7fd1672b3640 1 --2- 172.21.15.119:0/2081217244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1600ff6e0 0x7fd160101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.442+0000 7fd1672b3640 1 --2- 172.21.15.119:0/2081217244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd160065be0 0x7fd1600ff1a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.442+0000 7fd1672b3640 1 -- 172.21.15.119:0/2081217244 >> 172.21.15.119:0/2081217244 conn(0x7fd1600f6c10 msgr2=0x7fd1600f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:46.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.442+0000 7fd1672b3640 1 -- 172.21.15.119:0/2081217244 shutdown_connections 2024-09-13T21:51:46.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.442+0000 7fd1672b3640 1 -- 172.21.15.119:0/2081217244 wait complete. 2024-09-13T21:51:46.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.442+0000 7fd1672b3640 1 Processor -- start 2024-09-13T21:51:46.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.442+0000 7fd1672b3640 1 -- start start 2024-09-13T21:51:46.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd1672b3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd160065be0 0x7fd16010d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:46.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd1672b3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1600ff6e0 0x7fd16010d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:46.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd1672b3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16010dcc0 con 0x7fd1600ff6e0 2024-09-13T21:51:46.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd1672b3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16010e490 con 0x7fd160065be0 2024-09-13T21:51:46.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd16484e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1600ff6e0 0x7fd16010d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd16484e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1600ff6e0 0x7fd16010d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46972/0 (socket says 172.21.15.119:46972) 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd16484e640 1 -- 172.21.15.119:0/2023244872 learned_addr learned my addr 172.21.15.119:0/2023244872 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd16504f640 1 --2- 172.21.15.119:0/2023244872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd160065be0 0x7fd16010d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd16484e640 1 -- 172.21.15.119:0/2023244872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd160065be0 msgr2=0x7fd16010d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd16484e640 1 --2- 172.21.15.119:0/2023244872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd160065be0 0x7fd16010d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd16484e640 1 -- 172.21.15.119:0/2023244872 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c005040 con 0x7fd1600ff6e0 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd16484e640 1 --2- 172.21.15.119:0/2023244872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1600ff6e0 0x7fd16010d670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd150002a50 tx=0x7fd150004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd155ffb640 1 -- 172.21.15.119:0/2023244872 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd150007c30 con 0x7fd1600ff6e0 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd155ffb640 1 -- 172.21.15.119:0/2023244872 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd15000f040 con 0x7fd1600ff6e0 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.443+0000 7fd1672b3640 1 -- 172.21.15.119:0/2023244872 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16010e720 con 0x7fd1600ff6e0 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.444+0000 7fd155ffb640 1 -- 172.21.15.119:0/2023244872 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd15000da90 con 0x7fd1600ff6e0 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.444+0000 7fd1672b3640 1 -- 172.21.15.119:0/2023244872 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16010ecc0 con 0x7fd1600ff6e0 2024-09-13T21:51:46.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.445+0000 7fd155ffb640 1 -- 172.21.15.119:0/2023244872 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd15000dd20 con 0x7fd1600ff6e0 2024-09-13T21:51:46.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.445+0000 7fd1672b3640 1 -- 172.21.15.119:0/2023244872 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1600fa890 con 0x7fd1600ff6e0 2024-09-13T21:51:46.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.446+0000 7fd155ffb640 1 --2- 172.21.15.119:0/2023244872 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd14c06e530 0x7fd14c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:46.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.446+0000 7fd155ffb640 1 -- 172.21.15.119:0/2023244872 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd15008da20 con 0x7fd1600ff6e0 2024-09-13T21:51:46.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.446+0000 7fd16504f640 1 --2- 172.21.15.119:0/2023244872 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd14c06e530 0x7fd14c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:46.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.446+0000 7fd16504f640 1 --2- 172.21.15.119:0/2023244872 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd14c06e530 0x7fd14c0709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0048a0 tx=0x7fd15c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:46.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.450+0000 7fd155ffb640 1 -- 172.21.15.119:0/2023244872 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd150056b60 con 0x7fd1600ff6e0 2024-09-13T21:51:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:46 smithi155 ceph-mon[79928]: Upgrade: It appears safe to stop mds.cephfs.smithi119.rpmijj 2024-09-13T21:51:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:46 smithi155 ceph-mon[79928]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:46 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2268709433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:51:46.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.650+0000 7fd1672b3640 1 -- 172.21.15.119:0/2023244872 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd16010f050 con 0x7fd14c06e530 2024-09-13T21:51:46.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.651+0000 7fd155ffb640 1 -- 172.21.15.119:0/2023244872 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd16010f050 con 0x7fd14c06e530 2024-09-13T21:51:46.653 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:51:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:51:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:51:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:51:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:51:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "crash", 2024-09-13T21:51:46.653 INFO:teuthology.orchestra.run.smithi119.stdout: "osd", 2024-09-13T21:51:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr", 2024-09-13T21:51:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "mon" 2024-09-13T21:51:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:51:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "12/21 daemons upgraded", 2024-09-13T21:51:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T21:51:46.654 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:51:46.654 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:51:46.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.654+0000 7fd1672b3640 1 -- 172.21.15.119:0/2023244872 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd14c06e530 msgr2=0x7fd14c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.654+0000 7fd1672b3640 1 --2- 172.21.15.119:0/2023244872 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd14c06e530 0x7fd14c0709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0048a0 tx=0x7fd15c009da0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.654+0000 7fd1672b3640 1 -- 172.21.15.119:0/2023244872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1600ff6e0 msgr2=0x7fd16010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.654+0000 7fd1672b3640 1 --2- 172.21.15.119:0/2023244872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1600ff6e0 0x7fd16010d670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd150002a50 tx=0x7fd150004600 comp rx=0 tx=0).stop 2024-09-13T21:51:46.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.654+0000 7fd1672b3640 1 -- 172.21.15.119:0/2023244872 shutdown_connections 2024-09-13T21:51:46.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.654+0000 7fd1672b3640 1 --2- 172.21.15.119:0/2023244872 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd14c06e530 0x7fd14c0709e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.654+0000 7fd1672b3640 1 --2- 172.21.15.119:0/2023244872 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1600ff6e0 0x7fd16010d670 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.654+0000 7fd1672b3640 1 --2- 172.21.15.119:0/2023244872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd160065be0 0x7fd16010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.654+0000 7fd1672b3640 1 -- 172.21.15.119:0/2023244872 >> 172.21.15.119:0/2023244872 conn(0x7fd1600f6c10 msgr2=0x7fd1600f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:46.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.654+0000 7fd1672b3640 1 -- 172.21.15.119:0/2023244872 shutdown_connections 2024-09-13T21:51:46.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.654+0000 7fd1672b3640 1 -- 172.21.15.119:0/2023244872 wait complete. 2024-09-13T21:51:46.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.732+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1328864700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4b00fc720 msgr2=0x7fd4b00fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.732+0000 7fd4b50ba640 1 --2- 172.21.15.119:0/1328864700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4b00fc720 0x7fd4b00fcb90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd498009c50 tx=0x7fd498004d10 comp rx=0 tx=0).stop 2024-09-13T21:51:46.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1328864700 shutdown_connections 2024-09-13T21:51:46.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 --2- 172.21.15.119:0/1328864700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4b00fc720 0x7fd4b00fcb90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 --2- 172.21.15.119:0/1328864700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4b00fb450 0x7fd4b00fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1328864700 >> 172.21.15.119:0/1328864700 conn(0x7fd4b00f6c10 msgr2=0x7fd4b00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:46.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1328864700 shutdown_connections 2024-09-13T21:51:46.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1328864700 wait complete. 2024-09-13T21:51:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 Processor -- start 2024-09-13T21:51:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 -- start start 2024-09-13T21:51:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4b00fb450 0x7fd4b010d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4b00fc720 0x7fd4b010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b010dc00 con 0x7fd4b00fc720 2024-09-13T21:51:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.733+0000 7fd4b50ba640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b010e420 con 0x7fd4b00fb450 2024-09-13T21:51:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4ae59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4b00fc720 0x7fd4b010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4ae59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4b00fc720 0x7fd4b010d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46976/0 (socket says 172.21.15.119:46976) 2024-09-13T21:51:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4ae59c640 1 -- 172.21.15.119:0/1687661560 learned_addr learned my addr 172.21.15.119:0/1687661560 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:51:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4aed9d640 1 --2- 172.21.15.119:0/1687661560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4b00fb450 0x7fd4b010d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:46.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4ae59c640 1 -- 172.21.15.119:0/1687661560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4b00fb450 msgr2=0x7fd4b010d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4ae59c640 1 --2- 172.21.15.119:0/1687661560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4b00fb450 0x7fd4b010d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4ae59c640 1 -- 172.21.15.119:0/1687661560 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4980098b0 con 0x7fd4b00fc720 2024-09-13T21:51:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4ae59c640 1 --2- 172.21.15.119:0/1687661560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4b00fc720 0x7fd4b010d5b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd498004a30 tx=0x7fd498004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4a77fe640 1 -- 172.21.15.119:0/1687661560 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd498009710 con 0x7fd4b00fc720 2024-09-13T21:51:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1687661560 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b010e650 con 0x7fd4b00fc720 2024-09-13T21:51:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4a77fe640 1 -- 172.21.15.119:0/1687661560 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd498032b10 con 0x7fd4b00fc720 2024-09-13T21:51:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4a77fe640 1 -- 172.21.15.119:0/1687661560 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd49803db10 con 0x7fd4b00fc720 2024-09-13T21:51:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.734+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1687661560 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b010ebf0 con 0x7fd4b00fc720 2024-09-13T21:51:46.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.736+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1687661560 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b00fa8b0 con 0x7fd4b00fc720 2024-09-13T21:51:46.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.736+0000 7fd4a77fe640 1 -- 172.21.15.119:0/1687661560 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd49802f030 con 0x7fd4b00fc720 2024-09-13T21:51:46.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.736+0000 7fd4a77fe640 1 --2- 172.21.15.119:0/1687661560 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd49c06e530 0x7fd49c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:51:46.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.736+0000 7fd4a77fe640 1 -- 172.21.15.119:0/1687661560 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd4980af800 con 0x7fd4b00fc720 2024-09-13T21:51:46.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.736+0000 7fd4aed9d640 1 --2- 172.21.15.119:0/1687661560 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd49c06e530 0x7fd49c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:51:46.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.737+0000 7fd4aed9d640 1 --2- 172.21.15.119:0/1687661560 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd49c06e530 0x7fd49c0709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8004ed0 tx=0x7fd4a800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:51:46.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.741+0000 7fd4a77fe640 1 -- 172.21.15.119:0/1687661560 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd498078a00 con 0x7fd4b00fc720 2024-09-13T21:51:46.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.977+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1687661560 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd4b0103f40 con 0x7fd4b00fc720 2024-09-13T21:51:46.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.977+0000 7fd4a77fe640 1 -- 172.21.15.119:0/1687661560 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd49807c0c0 con 0x7fd4b00fc720 2024-09-13T21:51:46.979 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:51:46.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.979+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1687661560 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd49c06e530 msgr2=0x7fd49c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.979+0000 7fd4b50ba640 1 --2- 172.21.15.119:0/1687661560 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd49c06e530 0x7fd49c0709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8004ed0 tx=0x7fd4a800b040 comp rx=0 tx=0).stop 2024-09-13T21:51:46.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.979+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1687661560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4b00fc720 msgr2=0x7fd4b010d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:51:46.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.979+0000 7fd4b50ba640 1 --2- 172.21.15.119:0/1687661560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4b00fc720 0x7fd4b010d5b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd498004a30 tx=0x7fd498004d10 comp rx=0 tx=0).stop 2024-09-13T21:51:46.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.979+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1687661560 shutdown_connections 2024-09-13T21:51:46.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.979+0000 7fd4b50ba640 1 --2- 172.21.15.119:0/1687661560 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd49c06e530 0x7fd49c0709e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.979+0000 7fd4b50ba640 1 --2- 172.21.15.119:0/1687661560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4b00fc720 0x7fd4b010d5b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.979+0000 7fd4b50ba640 1 --2- 172.21.15.119:0/1687661560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4b00fb450 0x7fd4b010d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:51:46.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.979+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1687661560 >> 172.21.15.119:0/1687661560 conn(0x7fd4b00f6c10 msgr2=0x7fd4b00660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:51:46.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.979+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1687661560 shutdown_connections 2024-09-13T21:51:46.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:51:46.979+0000 7fd4b50ba640 1 -- 172.21.15.119:0/1687661560 wait complete. 2024-09-13T21:51:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:47 smithi155 ceph-mon[79928]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:47 smithi155 ceph-mon[79928]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:47 smithi155 ceph-mon[79928]: pgmap v180: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:47 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1017649577' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:51:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:47 smithi155 ceph-mon[79928]: Upgrade: Updating mds.cephfs.smithi119.rpmijj 2024-09-13T21:51:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:47 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:47 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.rpmijj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:51:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:47 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:47 smithi155 ceph-mon[79928]: Deploying daemon mds.cephfs.smithi119.rpmijj on smithi119 2024-09-13T21:51:47.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:47 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1687661560' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:51:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:47 smithi119 ceph-mon[90896]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:47 smithi119 ceph-mon[90896]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:47 smithi119 ceph-mon[90896]: pgmap v180: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:47 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1017649577' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:51:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:47 smithi119 ceph-mon[90896]: Upgrade: Updating mds.cephfs.smithi119.rpmijj 2024-09-13T21:51:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:47 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:47 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.rpmijj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:51:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:47 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:51:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:47 smithi119 ceph-mon[90896]: Deploying daemon mds.cephfs.smithi119.rpmijj on smithi119 2024-09-13T21:51:47.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:47 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1687661560' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:51:48.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:48 smithi155 ceph-mon[79928]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:48.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:48 smithi119 ceph-mon[90896]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:51:49.531 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:49 smithi119 ceph-mon[90896]: pgmap v181: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:49.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:49 smithi119 ceph-mon[90896]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T21:51:49.532 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:49 smithi119 ceph-mon[90896]: fsmap cephfs:1 {0=cephfs.smithi119.yydzwt=up:active} 2 up:standby 2024-09-13T21:51:49.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:49 smithi155 ceph-mon[79928]: pgmap v181: 65 pgs: 65 active+clean; 140 MiB data, 654 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:49.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:49 smithi155 ceph-mon[79928]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T21:51:49.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:49 smithi155 ceph-mon[79928]: fsmap cephfs:1 {0=cephfs.smithi119.yydzwt=up:active} 2 up:standby 2024-09-13T21:51:51.574 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:51 smithi119 ceph-mon[90896]: pgmap v183: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:51 smithi155 ceph-mon[79928]: pgmap v183: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:52.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:52.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:52.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:52.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:52.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:51:52.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:52.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:52.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:51:53.510 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:53 smithi119 ceph-mon[90896]: pgmap v184: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:53.510 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:53 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] up:boot 2024-09-13T21:51:53.510 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:53 smithi119 ceph-mon[90896]: fsmap cephfs:1 {0=cephfs.smithi119.yydzwt=up:active} 3 up:standby 2024-09-13T21:51:53.510 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:53 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:51:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:53 smithi155 ceph-mon[79928]: pgmap v184: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:53 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] up:boot 2024-09-13T21:51:53.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:53 smithi155 ceph-mon[79928]: fsmap cephfs:1 {0=cephfs.smithi119.yydzwt=up:active} 3 up:standby 2024-09-13T21:51:53.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:53 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:51:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:55 smithi155 ceph-mon[79928]: pgmap v185: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:55 smithi119 ceph-mon[90896]: pgmap v185: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:57 smithi155 ceph-mon[79928]: pgmap v186: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:57 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:57.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:57 smithi119 ceph-mon[90896]: pgmap v186: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:57 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:58.990 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:58 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:58.990 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:58 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:58.990 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:51:58 smithi119 ceph-mon[90896]: pgmap v187: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:51:59.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:58 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:59.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:58 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:51:59.083 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:51:58 smithi155 ceph-mon[79928]: pgmap v187: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:01.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: pgmap v188: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:01.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:01.446 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:01.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:01.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:52:01.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:01.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:01.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:01.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:01.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:01.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:01.447 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:01 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi119.yydzwt"]}]: dispatch 2024-09-13T21:52:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: pgmap v188: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:01.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:52:01.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:01.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:01.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:01.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:01.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:01.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:01.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:01 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi119.yydzwt"]}]: dispatch 2024-09-13T21:52:02.268 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:02 smithi119 ceph-mon[90896]: Detected new or changed devices on smithi119 2024-09-13T21:52:02.268 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:02 smithi119 ceph-mon[90896]: Upgrade: It appears safe to stop mds.cephfs.smithi119.yydzwt 2024-09-13T21:52:02.268 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:02.268 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.yydzwt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:52:02.268 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:02 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:02 smithi155 ceph-mon[79928]: Detected new or changed devices on smithi119 2024-09-13T21:52:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:02 smithi155 ceph-mon[79928]: Upgrade: It appears safe to stop mds.cephfs.smithi119.yydzwt 2024-09-13T21:52:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.yydzwt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:52:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:02 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:03.570 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:03 smithi119 ceph-mon[90896]: Upgrade: Updating mds.cephfs.smithi119.yydzwt 2024-09-13T21:52:03.570 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:03 smithi119 ceph-mon[90896]: Deploying daemon mds.cephfs.smithi119.yydzwt on smithi119 2024-09-13T21:52:03.570 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:03 smithi119 ceph-mon[90896]: pgmap v189: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:03 smithi155 ceph-mon[79928]: Upgrade: Updating mds.cephfs.smithi119.yydzwt 2024-09-13T21:52:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:03 smithi155 ceph-mon[79928]: Deploying daemon mds.cephfs.smithi119.yydzwt on smithi119 2024-09-13T21:52:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:03 smithi155 ceph-mon[79928]: pgmap v189: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:03.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:03 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119[90892]: 2024-09-13T21:52:03.806+0000 7f027643b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:52:04.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:04 smithi155 ceph-mon[79928]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T21:52:04.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:04 smithi155 ceph-mon[79928]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:52:04.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:04 smithi155 ceph-mon[79928]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T21:52:04.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:04 smithi155 ceph-mon[79928]: Standby daemon mds.cephfs.smithi155.afmavb assigned to filesystem cephfs as rank 0 2024-09-13T21:52:04.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:04 smithi155 ceph-mon[79928]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T21:52:04.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:04 smithi155 ceph-mon[79928]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T21:52:04.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:04 smithi155 ceph-mon[79928]: fsmap cephfs:1/1 {0=cephfs.smithi155.afmavb=up:replay} 2 up:standby 2024-09-13T21:52:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:04 smithi119 ceph-mon[90896]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T21:52:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:04 smithi119 ceph-mon[90896]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:52:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:04 smithi119 ceph-mon[90896]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T21:52:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:04 smithi119 ceph-mon[90896]: Standby daemon mds.cephfs.smithi155.afmavb assigned to filesystem cephfs as rank 0 2024-09-13T21:52:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:04 smithi119 ceph-mon[90896]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T21:52:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:04 smithi119 ceph-mon[90896]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T21:52:04.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:04 smithi119 ceph-mon[90896]: fsmap cephfs:1/1 {0=cephfs.smithi155.afmavb=up:replay} 2 up:standby 2024-09-13T21:52:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:05 smithi155 ceph-mon[79928]: pgmap v191: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:05 smithi119 ceph-mon[90896]: pgmap v191: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:07 smithi155 ceph-mon[79928]: pgmap v192: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-13T21:52:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:07 smithi119 ceph-mon[90896]: pgmap v192: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-13T21:52:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:09.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:09 smithi155 ceph-mon[79928]: pgmap v193: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-09-13T21:52:09.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:09 smithi119 ceph-mon[90896]: pgmap v193: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-09-13T21:52:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:10 smithi155 ceph-mon[79928]: reconnect by client.24295 192.168.0.1:0/1537294791 after 0 2024-09-13T21:52:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:10 smithi155 ceph-mon[79928]: reconnect by client.14506 192.168.0.1:0/3612892378 after 0.00099998 2024-09-13T21:52:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:10 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] up:reconnect 2024-09-13T21:52:10.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:10 smithi155 ceph-mon[79928]: fsmap cephfs:1/1 {0=cephfs.smithi155.afmavb=up:reconnect} 2 up:standby 2024-09-13T21:52:10.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:10 smithi119 ceph-mon[90896]: reconnect by client.24295 192.168.0.1:0/1537294791 after 0 2024-09-13T21:52:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:10 smithi119 ceph-mon[90896]: reconnect by client.14506 192.168.0.1:0/3612892378 after 0.00099998 2024-09-13T21:52:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:10 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] up:reconnect 2024-09-13T21:52:10.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:10 smithi119 ceph-mon[90896]: fsmap cephfs:1/1 {0=cephfs.smithi155.afmavb=up:reconnect} 2 up:standby 2024-09-13T21:52:11.367 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:11 smithi119 ceph-mon[90896]: pgmap v194: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T21:52:11.367 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:11 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] up:rejoin 2024-09-13T21:52:11.367 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:11 smithi119 ceph-mon[90896]: fsmap cephfs:1/1 {0=cephfs.smithi155.afmavb=up:rejoin} 2 up:standby 2024-09-13T21:52:11.367 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:11 smithi119 ceph-mon[90896]: daemon mds.cephfs.smithi155.afmavb is now active in filesystem cephfs as rank 0 2024-09-13T21:52:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:11 smithi155 ceph-mon[79928]: pgmap v194: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T21:52:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:11 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] up:rejoin 2024-09-13T21:52:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:11 smithi155 ceph-mon[79928]: fsmap cephfs:1/1 {0=cephfs.smithi155.afmavb=up:rejoin} 2 up:standby 2024-09-13T21:52:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:11 smithi155 ceph-mon[79928]: daemon mds.cephfs.smithi155.afmavb is now active in filesystem cephfs as rank 0 2024-09-13T21:52:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:12 smithi155 ceph-mon[79928]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T21:52:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:12 smithi155 ceph-mon[79928]: Cluster is now healthy 2024-09-13T21:52:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:12 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] up:active 2024-09-13T21:52:12.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:12 smithi155 ceph-mon[79928]: fsmap cephfs:1 {0=cephfs.smithi155.afmavb=up:active} 2 up:standby 2024-09-13T21:52:12.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:12 smithi119 ceph-mon[90896]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T21:52:12.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:12 smithi119 ceph-mon[90896]: Cluster is now healthy 2024-09-13T21:52:12.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:12 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] up:active 2024-09-13T21:52:12.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:12 smithi119 ceph-mon[90896]: fsmap cephfs:1 {0=cephfs.smithi155.afmavb=up:active} 2 up:standby 2024-09-13T21:52:13.484 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:13 smithi155 ceph-mon[79928]: pgmap v195: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T21:52:13.484 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:13 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.119:6828/3559937126,v1:172.21.15.119:6829/3559937126] up:boot 2024-09-13T21:52:13.484 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:13 smithi155 ceph-mon[79928]: fsmap cephfs:1 {0=cephfs.smithi155.afmavb=up:active} 3 up:standby 2024-09-13T21:52:13.484 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:52:13.484 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:13.485 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:13.485 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:13 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:13 smithi119 ceph-mon[90896]: pgmap v195: 65 pgs: 65 active+clean; 140 MiB data, 655 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T21:52:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:13 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.119:6828/3559937126,v1:172.21.15.119:6829/3559937126] up:boot 2024-09-13T21:52:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:13 smithi119 ceph-mon[90896]: fsmap cephfs:1 {0=cephfs.smithi155.afmavb=up:active} 3 up:standby 2024-09-13T21:52:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:52:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:13 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:15.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:15 smithi119 ceph-mon[90896]: pgmap v196: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 296 B/s wr, 7 op/s 2024-09-13T21:52:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:15 smithi155 ceph-mon[79928]: pgmap v196: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 296 B/s wr, 7 op/s 2024-09-13T21:52:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.074+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/3229990907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eb40ff720 msgr2=0x7f8eb4101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.074+0000 7f8eb8e6b640 1 --2- 172.21.15.119:0/3229990907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eb40ff720 0x7f8eb4101b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0048d0 tx=0x7f8e9c009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.074+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/3229990907 shutdown_connections 2024-09-13T21:52:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.074+0000 7f8eb8e6b640 1 --2- 172.21.15.119:0/3229990907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eb40ff720 0x7f8eb4101b00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.074+0000 7f8eb8e6b640 1 --2- 172.21.15.119:0/3229990907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb4066690 0x7f8eb40ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.074+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/3229990907 >> 172.21.15.119:0/3229990907 conn(0x7f8eb40f6c10 msgr2=0x7f8eb40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:17.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.074+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/3229990907 shutdown_connections 2024-09-13T21:52:17.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.074+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/3229990907 wait complete. 2024-09-13T21:52:17.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.075+0000 7f8eb8e6b640 1 Processor -- start 2024-09-13T21:52:17.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.075+0000 7f8eb8e6b640 1 -- start start 2024-09-13T21:52:17.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.075+0000 7f8eb8e6b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eb4066690 0x7f8eb410d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.075+0000 7f8eb8e6b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb40ff720 0x7f8eb410d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.075+0000 7f8eb8e6b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb410e580 con 0x7f8eb4066690 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.075+0000 7f8eb8e6b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb410e6f0 con 0x7f8eb40ff720 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.075+0000 7f8eb259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eb4066690 0x7f8eb410d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.075+0000 7f8eb259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eb4066690 0x7f8eb410d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47880/0 (socket says 172.21.15.119:47880) 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.075+0000 7f8eb259c640 1 -- 172.21.15.119:0/1988398126 learned_addr learned my addr 172.21.15.119:0/1988398126 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.076+0000 7f8ea9d9b640 1 --2- 172.21.15.119:0/1988398126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb40ff720 0x7f8eb410d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.076+0000 7f8eb259c640 1 -- 172.21.15.119:0/1988398126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb40ff720 msgr2=0x7f8eb410d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.076+0000 7f8eb259c640 1 --2- 172.21.15.119:0/1988398126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb40ff720 0x7f8eb410d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.076+0000 7f8eb259c640 1 -- 172.21.15.119:0/1988398126 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c005040 con 0x7f8eb4066690 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.076+0000 7f8eb259c640 1 --2- 172.21.15.119:0/1988398126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eb4066690 0x7f8eb410d220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400b580 tx=0x7f8ea40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.076+0000 7f8eab7fe640 1 -- 172.21.15.119:0/1988398126 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea400f6f0 con 0x7f8eb4066690 2024-09-13T21:52:17.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.076+0000 7f8eab7fe640 1 -- 172.21.15.119:0/1988398126 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ea400fcf0 con 0x7f8eb4066690 2024-09-13T21:52:17.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.076+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/1988398126 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb410e9d0 con 0x7f8eb4066690 2024-09-13T21:52:17.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.076+0000 7f8eab7fe640 1 -- 172.21.15.119:0/1988398126 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea40103a0 con 0x7f8eb4066690 2024-09-13T21:52:17.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.076+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/1988398126 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb410eec0 con 0x7f8eb4066690 2024-09-13T21:52:17.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.077+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/1988398126 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb410de40 con 0x7f8eb4066690 2024-09-13T21:52:17.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.078+0000 7f8eab7fe640 1 -- 172.21.15.119:0/1988398126 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8ea40116b0 con 0x7f8eb4066690 2024-09-13T21:52:17.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.078+0000 7f8eab7fe640 1 --2- 172.21.15.119:0/1988398126 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ea006e530 0x7f8ea00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.078+0000 7f8eab7fe640 1 -- 172.21.15.119:0/1988398126 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8ea408e040 con 0x7f8eb4066690 2024-09-13T21:52:17.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.078+0000 7f8ea9d9b640 1 --2- 172.21.15.119:0/1988398126 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ea006e530 0x7f8ea00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.079+0000 7f8ea9d9b640 1 --2- 172.21.15.119:0/1988398126 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ea006e530 0x7f8ea00709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c000c00 tx=0x7f8e9c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:17.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.083+0000 7f8eab7fe640 1 -- 172.21.15.119:0/1988398126 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8ea40571b0 con 0x7f8eb4066690 2024-09-13T21:52:17.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.275+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/1988398126 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8eb41051c0 con 0x7f8ea006e530 2024-09-13T21:52:17.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.277+0000 7f8eab7fe640 1 -- 172.21.15.119:0/1988398126 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8eb41051c0 con 0x7f8ea006e530 2024-09-13T21:52:17.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.279+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/1988398126 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ea006e530 msgr2=0x7f8ea00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.279+0000 7f8eb8e6b640 1 --2- 172.21.15.119:0/1988398126 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ea006e530 0x7f8ea00709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c000c00 tx=0x7f8e9c035040 comp rx=0 tx=0).stop 2024-09-13T21:52:17.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.279+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/1988398126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eb4066690 msgr2=0x7f8eb410d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.279+0000 7f8eb8e6b640 1 --2- 172.21.15.119:0/1988398126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eb4066690 0x7f8eb410d220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400b580 tx=0x7f8ea40091a0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.279+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/1988398126 shutdown_connections 2024-09-13T21:52:17.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.279+0000 7f8eb8e6b640 1 --2- 172.21.15.119:0/1988398126 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8ea006e530 0x7f8ea00709e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.279+0000 7f8eb8e6b640 1 --2- 172.21.15.119:0/1988398126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb40ff720 0x7f8eb410d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.279+0000 7f8eb8e6b640 1 --2- 172.21.15.119:0/1988398126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8eb4066690 0x7f8eb410d220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.279+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/1988398126 >> 172.21.15.119:0/1988398126 conn(0x7f8eb40f6c10 msgr2=0x7f8eb40f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:17.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.279+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/1988398126 shutdown_connections 2024-09-13T21:52:17.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.279+0000 7f8eb8e6b640 1 -- 172.21.15.119:0/1988398126 wait complete. 2024-09-13T21:52:17.289 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:52:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.365+0000 7f46dcca1640 1 -- 172.21.15.119:0/2871738256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46d80fe4c0 msgr2=0x7f46d80fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.365+0000 7f46dcca1640 1 --2- 172.21.15.119:0/2871738256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46d80fe4c0 0x7f46d80fa620 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0048d0 tx=0x7f46cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.367 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:17 smithi119 ceph-mon[90896]: pgmap v197: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T21:52:17.367 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:17 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:17.367 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:17 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:17.367 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:17 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:17.367 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:17 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:17.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.365+0000 7f46dcca1640 1 -- 172.21.15.119:0/2871738256 shutdown_connections 2024-09-13T21:52:17.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.365+0000 7f46dcca1640 1 --2- 172.21.15.119:0/2871738256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46d80fe4c0 0x7f46d80fa620 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.365+0000 7f46dcca1640 1 --2- 172.21.15.119:0/2871738256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d80fdb70 0x7f46d80fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.365+0000 7f46dcca1640 1 -- 172.21.15.119:0/2871738256 >> 172.21.15.119:0/2871738256 conn(0x7f46d80f6390 msgr2=0x7f46d80f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.365+0000 7f46dcca1640 1 -- 172.21.15.119:0/2871738256 shutdown_connections 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.365+0000 7f46dcca1640 1 -- 172.21.15.119:0/2871738256 wait complete. 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.366+0000 7f46dcca1640 1 Processor -- start 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.366+0000 7f46dcca1640 1 -- start start 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.366+0000 7f46dcca1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d80fdb70 0x7f46d80fd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.366+0000 7f46dcca1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46d80fe4c0 0x7f46d80fb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.366+0000 7f46dcca1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80fbde0 con 0x7f46d80fe4c0 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.366+0000 7f46dcca1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80fbf20 con 0x7f46d80fdb70 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.367+0000 7f46d5d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46d80fe4c0 0x7f46d80fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.367+0000 7f46d5d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46d80fe4c0 0x7f46d80fb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47904/0 (socket says 172.21.15.119:47904) 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.367+0000 7f46d5d9b640 1 -- 172.21.15.119:0/2197643223 learned_addr learned my addr 172.21.15.119:0/2197643223 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.367+0000 7f46d659c640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d80fdb70 0x7f46d80fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.367+0000 7f46d5d9b640 1 -- 172.21.15.119:0/2197643223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d80fdb70 msgr2=0x7f46d80fd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.367+0000 7f46d5d9b640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d80fdb70 0x7f46d80fd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.367+0000 7f46d5d9b640 1 -- 172.21.15.119:0/2197643223 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc005040 con 0x7f46d80fe4c0 2024-09-13T21:52:17.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.367+0000 7f46d659c640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d80fdb70 0x7f46d80fd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:52:17.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.367+0000 7f46d5d9b640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46d80fe4c0 0x7f46d80fb850 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0043d0 tx=0x7f46cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:17.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.368+0000 7f46c6ffd640 1 -- 172.21.15.119:0/2197643223 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46cc038070 con 0x7f46d80fe4c0 2024-09-13T21:52:17.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.368+0000 7f46c6ffd640 1 -- 172.21.15.119:0/2197643223 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f46cc02ae90 con 0x7f46d80fe4c0 2024-09-13T21:52:17.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.368+0000 7f46dcca1640 1 -- 172.21.15.119:0/2197643223 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d80fc1a0 con 0x7f46d80fe4c0 2024-09-13T21:52:17.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.368+0000 7f46dcca1640 1 -- 172.21.15.119:0/2197643223 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d81150f0 con 0x7f46d80fe4c0 2024-09-13T21:52:17.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.368+0000 7f46c6ffd640 1 -- 172.21.15.119:0/2197643223 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46cc03e670 con 0x7f46d80fe4c0 2024-09-13T21:52:17.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.369+0000 7f46dcca1640 1 -- 172.21.15.119:0/2197643223 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b8005240 con 0x7f46d80fe4c0 2024-09-13T21:52:17.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.369+0000 7f46c6ffd640 1 -- 172.21.15.119:0/2197643223 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f46cc030020 con 0x7f46d80fe4c0 2024-09-13T21:52:17.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.370+0000 7f46c6ffd640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f46c006e530 0x7f46c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.370+0000 7f46d659c640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f46c006e530 0x7f46c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.370+0000 7f46c6ffd640 1 -- 172.21.15.119:0/2197643223 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f46cc0ae200 con 0x7f46d80fe4c0 2024-09-13T21:52:17.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.371+0000 7f46d659c640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f46c006e530 0x7f46c00709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f46d80fd110 tx=0x7f46c800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:17.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.378+0000 7f46c6ffd640 1 -- 172.21.15.119:0/2197643223 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f46cc077370 con 0x7f46d80fe4c0 2024-09-13T21:52:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.577+0000 7f46dcca1640 1 -- 172.21.15.119:0/2197643223 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46b8000bf0 con 0x7f46c006e530 2024-09-13T21:52:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.578+0000 7f46c6ffd640 1 -- 172.21.15.119:0/2197643223 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f46b8000bf0 con 0x7f46c006e530 2024-09-13T21:52:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.580+0000 7f46dcca1640 1 -- 172.21.15.119:0/2197643223 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f46c006e530 msgr2=0x7f46c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.581+0000 7f46dcca1640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f46c006e530 0x7f46c00709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f46d80fd110 tx=0x7f46c800b040 comp rx=0 tx=0).stop 2024-09-13T21:52:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.581+0000 7f46dcca1640 1 -- 172.21.15.119:0/2197643223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46d80fe4c0 msgr2=0x7f46d80fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.581+0000 7f46dcca1640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46d80fe4c0 0x7f46d80fb850 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0043d0 tx=0x7f46cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.581+0000 7f46dcca1640 1 -- 172.21.15.119:0/2197643223 shutdown_connections 2024-09-13T21:52:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.581+0000 7f46dcca1640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f46c006e530 0x7f46c00709e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.581+0000 7f46dcca1640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46d80fe4c0 0x7f46d80fb850 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.581+0000 7f46dcca1640 1 --2- 172.21.15.119:0/2197643223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d80fdb70 0x7f46d80fd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.581+0000 7f46dcca1640 1 -- 172.21.15.119:0/2197643223 >> 172.21.15.119:0/2197643223 conn(0x7f46d80f6390 msgr2=0x7f46d80f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.581+0000 7f46dcca1640 1 -- 172.21.15.119:0/2197643223 shutdown_connections 2024-09-13T21:52:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.581+0000 7f46dcca1640 1 -- 172.21.15.119:0/2197643223 wait complete. 2024-09-13T21:52:17.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:17 smithi155 ceph-mon[79928]: pgmap v197: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T21:52:17.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:17 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:17.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:17 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:17.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:17 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:17.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:17 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:17.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.663+0000 7f76db03a640 1 -- 172.21.15.119:0/4254481022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40fd7f0 msgr2=0x7f76d40fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.663+0000 7f76db03a640 1 --2- 172.21.15.119:0/4254481022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40fd7f0 0x7f76d40fdc60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f76c80048d0 tx=0x7f76c8009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.663+0000 7f76db03a640 1 -- 172.21.15.119:0/4254481022 shutdown_connections 2024-09-13T21:52:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.663+0000 7f76db03a640 1 --2- 172.21.15.119:0/4254481022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40fd7f0 0x7f76d40fdc60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.663+0000 7f76db03a640 1 --2- 172.21.15.119:0/4254481022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d40fc520 0x7f76d40fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.663+0000 7f76db03a640 1 -- 172.21.15.119:0/4254481022 >> 172.21.15.119:0/4254481022 conn(0x7f76d40f7ce0 msgr2=0x7f76d40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.663+0000 7f76db03a640 1 -- 172.21.15.119:0/4254481022 shutdown_connections 2024-09-13T21:52:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.663+0000 7f76db03a640 1 -- 172.21.15.119:0/4254481022 wait complete. 2024-09-13T21:52:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.664+0000 7f76db03a640 1 Processor -- start 2024-09-13T21:52:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.664+0000 7f76db03a640 1 -- start start 2024-09-13T21:52:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.664+0000 7f76db03a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40fc520 0x7f76d4113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.664+0000 7f76db03a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d40fd7f0 0x7f76d4113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.664+0000 7f76db03a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4114210 con 0x7f76d40fc520 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.664+0000 7f76db03a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4114a30 con 0x7f76d40fd7f0 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d8dd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40fc520 0x7f76d4113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d8dd6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40fc520 0x7f76d4113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47932/0 (socket says 172.21.15.119:47932) 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d8dd6640 1 -- 172.21.15.119:0/2387415543 learned_addr learned my addr 172.21.15.119:0/2387415543 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d3fff640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d40fd7f0 0x7f76d4113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d8dd6640 1 -- 172.21.15.119:0/2387415543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d40fd7f0 msgr2=0x7f76d4113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d8dd6640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d40fd7f0 0x7f76d4113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d8dd6640 1 -- 172.21.15.119:0/2387415543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c8005040 con 0x7f76d40fc520 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d3fff640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d40fd7f0 0x7f76d4113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d8dd6640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40fc520 0x7f76d4113680 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c790 tx=0x7f76c40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d17fa640 1 -- 172.21.15.119:0/2387415543 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c400a820 con 0x7f76d40fc520 2024-09-13T21:52:17.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d17fa640 1 -- 172.21.15.119:0/2387415543 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f76c400ae20 con 0x7f76d40fc520 2024-09-13T21:52:17.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76db03a640 1 -- 172.21.15.119:0/2387415543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d4114cc0 con 0x7f76d40fc520 2024-09-13T21:52:17.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76d17fa640 1 -- 172.21.15.119:0/2387415543 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c40113a0 con 0x7f76d40fc520 2024-09-13T21:52:17.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.665+0000 7f76db03a640 1 -- 172.21.15.119:0/2387415543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d4115260 con 0x7f76d40fc520 2024-09-13T21:52:17.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.666+0000 7f76db03a640 1 -- 172.21.15.119:0/2387415543 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d40fb980 con 0x7f76d40fc520 2024-09-13T21:52:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.667+0000 7f76d17fa640 1 -- 172.21.15.119:0/2387415543 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f76c4011500 con 0x7f76d40fc520 2024-09-13T21:52:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.667+0000 7f76d17fa640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f76bc06e530 0x7f76bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.667+0000 7f76d17fa640 1 -- 172.21.15.119:0/2387415543 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f76c408e310 con 0x7f76d40fc520 2024-09-13T21:52:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.667+0000 7f76d3fff640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f76bc06e530 0x7f76bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.668+0000 7f76d3fff640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f76bc06e530 0x7f76bc0709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76c8007ac0 tx=0x7f76c8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:17.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.672+0000 7f76d17fa640 1 -- 172.21.15.119:0/2387415543 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f76c40574f0 con 0x7f76d40fc520 2024-09-13T21:52:17.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.849+0000 7f76db03a640 1 -- 172.21.15.119:0/2387415543 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f76d4105090 con 0x7f76bc06e530 2024-09-13T21:52:17.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.859+0000 7f76d17fa640 1 -- 172.21.15.119:0/2387415543 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f76d4105090 con 0x7f76bc06e530 2024-09-13T21:52:17.860 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:52:17.861 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (6m) 1s ago 15m 25.0M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:52:17.861 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (4m) 1s ago 15m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:52:17.861 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (4m) 80s ago 14m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:52:17.861 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (6m) 1s ago 15m 87.2M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:52:17.862 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (26s) 1s ago 10m 12.9M - 19.1.1-324-gecab7be5 0652ff2b5d78 a39ea5706ead 2024-09-13T21:52:17.862 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (6s) 1s ago 9m 15.4M - 19.1.1-324-gecab7be5 0652ff2b5d78 1d784af814a8 2024-09-13T21:52:17.862 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (9m) 80s ago 9m 17.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 76211aef9e9c 2024-09-13T21:52:17.862 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (10m) 80s ago 10m 110M - 17.2.7-1629-geb16b97b ab51d1bebd12 f58e37aa9b99 2024-09-13T21:52:17.862 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (6m) 1s ago 16m 506M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:52:17.862 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (5m) 80s ago 14m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:52:17.863 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (5m) 1s ago 16m 51.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:52:17.863 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (5m) 80s ago 14m 41.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:52:17.863 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (7m) 1s ago 15m 16.6M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:52:17.863 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (6m) 80s ago 14m 14.8M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:52:17.863 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (4m) 1s ago 13m 103M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:52:17.864 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (3m) 1s ago 13m 105M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 8f69bf25cd20 2024-09-13T21:52:17.864 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (3m) 1s ago 12m 94.7M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 0f73e4fc2c43 2024-09-13T21:52:17.864 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (2m) 80s ago 12m 103M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5a7f5a9c1c4d 2024-09-13T21:52:17.864 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (115s) 80s ago 11m 102M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 03c992670291 2024-09-13T21:52:17.864 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (83s) 80s ago 11m 11.7M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 bf54ed40f20f 2024-09-13T21:52:17.864 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (5m) 1s ago 14m 65.7M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:52:17.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.861+0000 7f76db03a640 1 -- 172.21.15.119:0/2387415543 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f76bc06e530 msgr2=0x7f76bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.861+0000 7f76db03a640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f76bc06e530 0x7f76bc0709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76c8007ac0 tx=0x7f76c8035040 comp rx=0 tx=0).stop 2024-09-13T21:52:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.861+0000 7f76db03a640 1 -- 172.21.15.119:0/2387415543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40fc520 msgr2=0x7f76d4113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.861+0000 7f76db03a640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40fc520 0x7f76d4113680 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c790 tx=0x7f76c40043c0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.861+0000 7f76db03a640 1 -- 172.21.15.119:0/2387415543 shutdown_connections 2024-09-13T21:52:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.861+0000 7f76db03a640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f76bc06e530 0x7f76bc0709e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.861+0000 7f76db03a640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d40fd7f0 0x7f76d4113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.861+0000 7f76db03a640 1 --2- 172.21.15.119:0/2387415543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76d40fc520 0x7f76d4113680 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.861+0000 7f76db03a640 1 -- 172.21.15.119:0/2387415543 >> 172.21.15.119:0/2387415543 conn(0x7f76d40f7ce0 msgr2=0x7f76d40f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.861+0000 7f76db03a640 1 -- 172.21.15.119:0/2387415543 shutdown_connections 2024-09-13T21:52:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.861+0000 7f76db03a640 1 -- 172.21.15.119:0/2387415543 wait complete. 2024-09-13T21:52:17.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.938+0000 7fb099c6b640 1 -- 172.21.15.119:0/3008929460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0940fb450 msgr2=0x7fb0940fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.938+0000 7fb099c6b640 1 --2- 172.21.15.119:0/3008929460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0940fb450 0x7fb0940fb860 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0840048d0 tx=0x7fb084009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.938+0000 7fb099c6b640 1 -- 172.21.15.119:0/3008929460 shutdown_connections 2024-09-13T21:52:17.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.938+0000 7fb099c6b640 1 --2- 172.21.15.119:0/3008929460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0940fc720 0x7fb0940fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.938+0000 7fb099c6b640 1 --2- 172.21.15.119:0/3008929460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0940fb450 0x7fb0940fb860 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.938+0000 7fb099c6b640 1 -- 172.21.15.119:0/3008929460 >> 172.21.15.119:0/3008929460 conn(0x7fb0940f6c10 msgr2=0x7fb0940f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.938+0000 7fb099c6b640 1 -- 172.21.15.119:0/3008929460 shutdown_connections 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.938+0000 7fb099c6b640 1 -- 172.21.15.119:0/3008929460 wait complete. 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb099c6b640 1 Processor -- start 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb099c6b640 1 -- start start 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb099c6b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0940fb450 0x7fb0940ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb099c6b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0940fc720 0x7fb0940fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb099c6b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0940fdff0 con 0x7fb0940fb450 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb099c6b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0940fe130 con 0x7fb0940fc720 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0940fb450 0x7fb0940ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0940fb450 0x7fb0940ff570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47952/0 (socket says 172.21.15.119:47952) 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb0937fe640 1 -- 172.21.15.119:0/3236156576 learned_addr learned my addr 172.21.15.119:0/3236156576 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:17.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb092ffd640 1 --2- 172.21.15.119:0/3236156576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0940fc720 0x7fb0940fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb0937fe640 1 -- 172.21.15.119:0/3236156576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0940fc720 msgr2=0x7fb0940fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb0937fe640 1 --2- 172.21.15.119:0/3236156576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0940fc720 0x7fb0940fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.939+0000 7fb0937fe640 1 -- 172.21.15.119:0/3236156576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb084005040 con 0x7fb0940fb450 2024-09-13T21:52:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.940+0000 7fb0937fe640 1 --2- 172.21.15.119:0/3236156576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0940fb450 0x7fb0940ff570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb084003080 tx=0x7fb084009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.940+0000 7fb08bfff640 1 -- 172.21.15.119:0/3236156576 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb084038070 con 0x7fb0940fb450 2024-09-13T21:52:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.940+0000 7fb08bfff640 1 -- 172.21.15.119:0/3236156576 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb08402ae90 con 0x7fb0940fb450 2024-09-13T21:52:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.940+0000 7fb08bfff640 1 -- 172.21.15.119:0/3236156576 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb084033660 con 0x7fb0940fb450 2024-09-13T21:52:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.940+0000 7fb099c6b640 1 -- 172.21.15.119:0/3236156576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0940fe3b0 con 0x7fb0940fb450 2024-09-13T21:52:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.940+0000 7fb099c6b640 1 -- 172.21.15.119:0/3236156576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb094115150 con 0x7fb0940fb450 2024-09-13T21:52:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.941+0000 7fb099c6b640 1 -- 172.21.15.119:0/3236156576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0940fa8b0 con 0x7fb0940fb450 2024-09-13T21:52:17.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.941+0000 7fb08bfff640 1 -- 172.21.15.119:0/3236156576 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb084030020 con 0x7fb0940fb450 2024-09-13T21:52:17.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.942+0000 7fb08bfff640 1 --2- 172.21.15.119:0/3236156576 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb08006e530 0x7fb0800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:17.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.942+0000 7fb08bfff640 1 -- 172.21.15.119:0/3236156576 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb0840ae310 con 0x7fb0940fb450 2024-09-13T21:52:17.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.942+0000 7fb092ffd640 1 --2- 172.21.15.119:0/3236156576 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb08006e530 0x7fb0800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:17.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.942+0000 7fb092ffd640 1 --2- 172.21.15.119:0/3236156576 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb08006e530 0x7fb0800709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb07c004ed0 tx=0x7fb07c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:17.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:17.946+0000 7fb08bfff640 1 -- 172.21.15.119:0/3236156576 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb084077470 con 0x7fb0940fb450 2024-09-13T21:52:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.184+0000 7fb099c6b640 1 -- 172.21.15.119:0/3236156576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb094103f10 con 0x7fb0940fb450 2024-09-13T21:52:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.185+0000 7fb08bfff640 1 -- 172.21.15.119:0/3236156576 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7fb08407ab30 con 0x7fb0940fb450 2024-09-13T21:52:18.186 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2, 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:52:18.187 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:52:18.188 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2, 2024-09-13T21:52:18.188 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 12 2024-09-13T21:52:18.188 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:52:18.188 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:52:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.187+0000 7fb099c6b640 1 -- 172.21.15.119:0/3236156576 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb08006e530 msgr2=0x7fb0800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.187+0000 7fb099c6b640 1 --2- 172.21.15.119:0/3236156576 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb08006e530 0x7fb0800709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb07c004ed0 tx=0x7fb07c00b040 comp rx=0 tx=0).stop 2024-09-13T21:52:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.187+0000 7fb099c6b640 1 -- 172.21.15.119:0/3236156576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0940fb450 msgr2=0x7fb0940ff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.187+0000 7fb099c6b640 1 --2- 172.21.15.119:0/3236156576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0940fb450 0x7fb0940ff570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb084003080 tx=0x7fb084009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.187+0000 7fb099c6b640 1 -- 172.21.15.119:0/3236156576 shutdown_connections 2024-09-13T21:52:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.187+0000 7fb099c6b640 1 --2- 172.21.15.119:0/3236156576 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb08006e530 0x7fb0800709e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.187+0000 7fb099c6b640 1 --2- 172.21.15.119:0/3236156576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0940fc720 0x7fb0940fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.187+0000 7fb099c6b640 1 --2- 172.21.15.119:0/3236156576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0940fb450 0x7fb0940ff570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.187+0000 7fb099c6b640 1 -- 172.21.15.119:0/3236156576 >> 172.21.15.119:0/3236156576 conn(0x7fb0940f6c10 msgr2=0x7fb0940661e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.188+0000 7fb099c6b640 1 -- 172.21.15.119:0/3236156576 shutdown_connections 2024-09-13T21:52:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.188+0000 7fb099c6b640 1 -- 172.21.15.119:0/3236156576 wait complete. 2024-09-13T21:52:18.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.267+0000 7f583236d640 1 -- 172.21.15.119:0/3577582083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f582c0fd820 msgr2=0x7f582c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.267+0000 7f583236d640 1 --2- 172.21.15.119:0/3577582083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f582c0fd820 0x7f582c0fdc90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f58200048d0 tx=0x7f5820009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.267+0000 7f583236d640 1 -- 172.21.15.119:0/3577582083 shutdown_connections 2024-09-13T21:52:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.267+0000 7f583236d640 1 --2- 172.21.15.119:0/3577582083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f582c0fd820 0x7f582c0fdc90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.267+0000 7f583236d640 1 --2- 172.21.15.119:0/3577582083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c0fc550 0x7f582c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.267+0000 7f583236d640 1 -- 172.21.15.119:0/3577582083 >> 172.21.15.119:0/3577582083 conn(0x7f582c0f7d30 msgr2=0x7f582c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.267+0000 7f583236d640 1 -- 172.21.15.119:0/3577582083 shutdown_connections 2024-09-13T21:52:18.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.267+0000 7f583236d640 1 -- 172.21.15.119:0/3577582083 wait complete. 2024-09-13T21:52:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.268+0000 7f583236d640 1 Processor -- start 2024-09-13T21:52:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.268+0000 7f583236d640 1 -- start start 2024-09-13T21:52:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.268+0000 7f583236d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f582c0fc550 0x7f582c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.268+0000 7f583236d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c0fd820 0x7f582c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.268+0000 7f583236d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c06fff0 con 0x7f582c0fc550 2024-09-13T21:52:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.268+0000 7f583236d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c070130 con 0x7f582c0fd820 2024-09-13T21:52:18.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.268+0000 7f582bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f582c0fc550 0x7f582c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.268+0000 7f582bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f582c0fc550 0x7f582c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47968/0 (socket says 172.21.15.119:47968) 2024-09-13T21:52:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.268+0000 7f582bfff640 1 -- 172.21.15.119:0/986877249 learned_addr learned my addr 172.21.15.119:0/986877249 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.268+0000 7f582b7fe640 1 --2- 172.21.15.119:0/986877249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c0fd820 0x7f582c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.269+0000 7f582bfff640 1 -- 172.21.15.119:0/986877249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c0fd820 msgr2=0x7f582c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.269+0000 7f582bfff640 1 --2- 172.21.15.119:0/986877249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c0fd820 0x7f582c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.269+0000 7f582bfff640 1 -- 172.21.15.119:0/986877249 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820005040 con 0x7f582c0fc550 2024-09-13T21:52:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.269+0000 7f582bfff640 1 --2- 172.21.15.119:0/986877249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f582c0fc550 0x7f582c071570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f581c002a50 tx=0x7f581c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:18.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.272+0000 7f5828ff9640 1 -- 172.21.15.119:0/986877249 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f581c007c30 con 0x7f582c0fc550 2024-09-13T21:52:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.272+0000 7f5828ff9640 1 -- 172.21.15.119:0/986877249 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f581c00f040 con 0x7f582c0fc550 2024-09-13T21:52:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.272+0000 7f583236d640 1 -- 172.21.15.119:0/986877249 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c070410 con 0x7f582c0fc550 2024-09-13T21:52:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.272+0000 7f5828ff9640 1 -- 172.21.15.119:0/986877249 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f581c00da10 con 0x7f582c0fc550 2024-09-13T21:52:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.272+0000 7f583236d640 1 -- 172.21.15.119:0/986877249 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c115100 con 0x7f582c0fc550 2024-09-13T21:52:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.273+0000 7f583236d640 1 -- 172.21.15.119:0/986877249 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c0fb9b0 con 0x7f582c0fc550 2024-09-13T21:52:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.274+0000 7f5828ff9640 1 -- 172.21.15.119:0/986877249 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f581c00dbb0 con 0x7f582c0fc550 2024-09-13T21:52:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.274+0000 7f5828ff9640 1 --2- 172.21.15.119:0/986877249 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f581406e530 0x7f58140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:18.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.274+0000 7f5828ff9640 1 -- 172.21.15.119:0/986877249 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f581c08d880 con 0x7f582c0fc550 2024-09-13T21:52:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.274+0000 7f582b7fe640 1 --2- 172.21.15.119:0/986877249 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f581406e530 0x7f58140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.275+0000 7f582b7fe640 1 --2- 172.21.15.119:0/986877249 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f581406e530 0x7f58140709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f582000b020 tx=0x7f5820035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:18.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.280+0000 7f5828ff9640 1 -- 172.21.15.119:0/986877249 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f581c056aa0 con 0x7f582c0fc550 2024-09-13T21:52:18.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.481+0000 7f583236d640 1 -- 172.21.15.119:0/986877249 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f582c115390 con 0x7f582c0fc550 2024-09-13T21:52:18.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.482+0000 7f5828ff9640 1 -- 172.21.15.119:0/986877249 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f581c00de60 con 0x7f582c0fc550 2024-09-13T21:52:18.483 INFO:teuthology.orchestra.run.smithi119.stdout:e35 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:52:12:256540+0000 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 34 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:52:11.251193+0000 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:52:18.484 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 79 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 1 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:in 0 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=24277} 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:52:18.485 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 1 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 24277 members: 24277 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{0:24277} state up:active seq 150 join_fscid=1 addr [v2:172.21.15.155:6826/2908862913,v1:172.21.15.155:6827/2908862913] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{-1:34434} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:52:18.486 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{-1:34438} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6828/3559937126,v1:172.21.15.119:6829/3559937126] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:52:18.487 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{-1:44281} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.155:6824/1541412300,v1:172.21.15.155:6825/1541412300] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T21:52:18.487 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 35 2024-09-13T21:52:18.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.484+0000 7f583236d640 1 -- 172.21.15.119:0/986877249 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f581406e530 msgr2=0x7f58140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.484+0000 7f583236d640 1 --2- 172.21.15.119:0/986877249 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f581406e530 0x7f58140709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f582000b020 tx=0x7f5820035040 comp rx=0 tx=0).stop 2024-09-13T21:52:18.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.484+0000 7f583236d640 1 -- 172.21.15.119:0/986877249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f582c0fc550 msgr2=0x7f582c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.484+0000 7f583236d640 1 --2- 172.21.15.119:0/986877249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f582c0fc550 0x7f582c071570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f581c002a50 tx=0x7f581c004600 comp rx=0 tx=0).stop 2024-09-13T21:52:18.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.484+0000 7f583236d640 1 -- 172.21.15.119:0/986877249 shutdown_connections 2024-09-13T21:52:18.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.484+0000 7f583236d640 1 --2- 172.21.15.119:0/986877249 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f581406e530 0x7f58140709e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.484+0000 7f583236d640 1 --2- 172.21.15.119:0/986877249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c0fd820 0x7f582c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.484+0000 7f583236d640 1 --2- 172.21.15.119:0/986877249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f582c0fc550 0x7f582c071570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.484+0000 7f583236d640 1 -- 172.21.15.119:0/986877249 >> 172.21.15.119:0/986877249 conn(0x7f582c0f7d30 msgr2=0x7f582c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:18.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.484+0000 7f583236d640 1 -- 172.21.15.119:0/986877249 shutdown_connections 2024-09-13T21:52:18.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.484+0000 7f583236d640 1 -- 172.21.15.119:0/986877249 wait complete. 2024-09-13T21:52:18.527 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:18 smithi119 ceph-mon[90896]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:18.527 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:18 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3236156576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:18.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.566+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/812770020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f4065ba0 msgr2=0x7fc7f40ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.566+0000 7fc7f8cf8640 1 --2- 172.21.15.119:0/812770020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f4065ba0 0x7fc7f40ff1e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009c50 tx=0x7fc7e4004d10 comp rx=0 tx=0).stop 2024-09-13T21:52:18.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/812770020 shutdown_connections 2024-09-13T21:52:18.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 --2- 172.21.15.119:0/812770020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7f40ff720 0x7fc7f4101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 --2- 172.21.15.119:0/812770020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f4065ba0 0x7fc7f40ff1e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/812770020 >> 172.21.15.119:0/812770020 conn(0x7fc7f40f6c10 msgr2=0x7fc7f40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:18.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/812770020 shutdown_connections 2024-09-13T21:52:18.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/812770020 wait complete. 2024-09-13T21:52:18.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 Processor -- start 2024-09-13T21:52:18.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 -- start start 2024-09-13T21:52:18.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f4065ba0 0x7fc7f410d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7f40ff720 0x7fc7f410d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f410dcd0 con 0x7fc7f4065ba0 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f8cf8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f410e4a0 con 0x7fc7f40ff720 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f4065ba0 0x7fc7f410d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f4065ba0 0x7fc7f410d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47980/0 (socket says 172.21.15.119:47980) 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.567+0000 7fc7f259c640 1 -- 172.21.15.119:0/2168302252 learned_addr learned my addr 172.21.15.119:0/2168302252 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.568+0000 7fc7f1d9b640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7f40ff720 0x7fc7f410d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.568+0000 7fc7f259c640 1 -- 172.21.15.119:0/2168302252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7f40ff720 msgr2=0x7fc7f410d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.568+0000 7fc7f259c640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7f40ff720 0x7fc7f410d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.568+0000 7fc7f259c640 1 -- 172.21.15.119:0/2168302252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e40098b0 con 0x7fc7f4065ba0 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.568+0000 7fc7f1d9b640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7f40ff720 0x7fc7f410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.568+0000 7fc7f259c640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f4065ba0 0x7fc7f410d140 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4000f80 tx=0x7fc7e4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:18.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.568+0000 7fc7eaffd640 1 -- 172.21.15.119:0/2168302252 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7e4032850 con 0x7fc7f4065ba0 2024-09-13T21:52:18.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.568+0000 7fc7eaffd640 1 -- 172.21.15.119:0/2168302252 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc7e4009710 con 0x7fc7f4065ba0 2024-09-13T21:52:18.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.568+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/2168302252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f410e6d0 con 0x7fc7f4065ba0 2024-09-13T21:52:18.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.568+0000 7fc7eaffd640 1 -- 172.21.15.119:0/2168302252 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7e403db20 con 0x7fc7f4065ba0 2024-09-13T21:52:18.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.568+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/2168302252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f410ec70 con 0x7fc7f4065ba0 2024-09-13T21:52:18.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.570+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/2168302252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f40fa890 con 0x7fc7f4065ba0 2024-09-13T21:52:18.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.570+0000 7fc7eaffd640 1 -- 172.21.15.119:0/2168302252 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc7e402f030 con 0x7fc7f4065ba0 2024-09-13T21:52:18.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.570+0000 7fc7eaffd640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc7e006e530 0x7fc7e00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:18.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.570+0000 7fc7eaffd640 1 -- 172.21.15.119:0/2168302252 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc7e40af430 con 0x7fc7f4065ba0 2024-09-13T21:52:18.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.570+0000 7fc7f1d9b640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc7e006e530 0x7fc7e00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:18.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.571+0000 7fc7f1d9b640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc7e006e530 0x7fc7e00709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7f410cef0 tx=0x7fc7dc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:18.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.575+0000 7fc7eaffd640 1 -- 172.21.15.119:0/2168302252 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc7e4078520 con 0x7fc7f4065ba0 2024-09-13T21:52:18.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:18 smithi155 ceph-mon[79928]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:18.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:18 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3236156576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:18.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.765+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/2168302252 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7f410ef50 con 0x7fc7e006e530 2024-09-13T21:52:18.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.767+0000 7fc7eaffd640 1 -- 172.21.15.119:0/2168302252 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc7f410ef50 con 0x7fc7e006e530 2024-09-13T21:52:18.768 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: "crash", 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: "osd", 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr", 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: "mon" 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "14/21 daemons upgraded", 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T21:52:18.769 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:52:18.770 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:52:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.769+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/2168302252 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc7e006e530 msgr2=0x7fc7e00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.769+0000 7fc7f8cf8640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc7e006e530 0x7fc7e00709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7f410cef0 tx=0x7fc7dc009040 comp rx=0 tx=0).stop 2024-09-13T21:52:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.769+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/2168302252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f4065ba0 msgr2=0x7fc7f410d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.769+0000 7fc7f8cf8640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f4065ba0 0x7fc7f410d140 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4000f80 tx=0x7fc7e4004d10 comp rx=0 tx=0).stop 2024-09-13T21:52:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.769+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/2168302252 shutdown_connections 2024-09-13T21:52:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.769+0000 7fc7f8cf8640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc7e006e530 0x7fc7e00709e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.769+0000 7fc7f8cf8640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7f40ff720 0x7fc7f410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.769+0000 7fc7f8cf8640 1 --2- 172.21.15.119:0/2168302252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f4065ba0 0x7fc7f410d140 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.769+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/2168302252 >> 172.21.15.119:0/2168302252 conn(0x7fc7f40f6c10 msgr2=0x7fc7f40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:18.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.769+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/2168302252 shutdown_connections 2024-09-13T21:52:18.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.769+0000 7fc7f8cf8640 1 -- 172.21.15.119:0/2168302252 wait complete. 2024-09-13T21:52:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.848+0000 7fc98869c640 1 -- 172.21.15.119:0/2904930490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9800fd820 msgr2=0x7fc9800fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.848+0000 7fc98869c640 1 --2- 172.21.15.119:0/2904930490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9800fd820 0x7fc9800fdc90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc9700048d0 tx=0x7fc970009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.848+0000 7fc98869c640 1 -- 172.21.15.119:0/2904930490 shutdown_connections 2024-09-13T21:52:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.848+0000 7fc98869c640 1 --2- 172.21.15.119:0/2904930490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9800fd820 0x7fc9800fdc90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.848+0000 7fc98869c640 1 --2- 172.21.15.119:0/2904930490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9800fc550 0x7fc9800fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.848+0000 7fc98869c640 1 -- 172.21.15.119:0/2904930490 >> 172.21.15.119:0/2904930490 conn(0x7fc9800f7d30 msgr2=0x7fc9800fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.849+0000 7fc98869c640 1 -- 172.21.15.119:0/2904930490 shutdown_connections 2024-09-13T21:52:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.849+0000 7fc98869c640 1 -- 172.21.15.119:0/2904930490 wait complete. 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.849+0000 7fc98869c640 1 Processor -- start 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.849+0000 7fc98869c640 1 -- start start 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.849+0000 7fc98869c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9800fc550 0x7fc98010d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.849+0000 7fc98869c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9800fd820 0x7fc98010d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.849+0000 7fc98869c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98010e490 con 0x7fc9800fc550 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.849+0000 7fc98869c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98010e600 con 0x7fc9800fd820 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.849+0000 7fc986438640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9800fc550 0x7fc98010d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.849+0000 7fc986438640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9800fc550 0x7fc98010d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47986/0 (socket says 172.21.15.119:47986) 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.849+0000 7fc986438640 1 -- 172.21.15.119:0/86265516 learned_addr learned my addr 172.21.15.119:0/86265516 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.850+0000 7fc985c37640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9800fd820 0x7fc98010d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.850+0000 7fc986438640 1 -- 172.21.15.119:0/86265516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9800fd820 msgr2=0x7fc98010d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.850+0000 7fc986438640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9800fd820 0x7fc98010d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.850+0000 7fc986438640 1 -- 172.21.15.119:0/86265516 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc970005040 con 0x7fc9800fc550 2024-09-13T21:52:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.850+0000 7fc985c37640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9800fd820 0x7fc98010d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:52:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.850+0000 7fc986438640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9800fc550 0x7fc98010d0e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00b790 tx=0x7fc97c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.850+0000 7fc976ffd640 1 -- 172.21.15.119:0/86265516 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc97c00c700 con 0x7fc9800fc550 2024-09-13T21:52:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.850+0000 7fc976ffd640 1 -- 172.21.15.119:0/86265516 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc97c00cd00 con 0x7fc9800fc550 2024-09-13T21:52:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.850+0000 7fc976ffd640 1 -- 172.21.15.119:0/86265516 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc97c015e70 con 0x7fc9800fc550 2024-09-13T21:52:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.850+0000 7fc98869c640 1 -- 172.21.15.119:0/86265516 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98010e8e0 con 0x7fc9800fc550 2024-09-13T21:52:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.850+0000 7fc98869c640 1 -- 172.21.15.119:0/86265516 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98010ee00 con 0x7fc9800fc550 2024-09-13T21:52:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.851+0000 7fc98869c640 1 -- 172.21.15.119:0/86265516 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9801057e0 con 0x7fc9800fc550 2024-09-13T21:52:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.852+0000 7fc976ffd640 1 -- 172.21.15.119:0/86265516 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc97c012070 con 0x7fc9800fc550 2024-09-13T21:52:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.852+0000 7fc976ffd640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc96c06e530 0x7fc96c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.852+0000 7fc985c37640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc96c06e530 0x7fc96c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:18.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.852+0000 7fc976ffd640 1 -- 172.21.15.119:0/86265516 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc97c08db00 con 0x7fc9800fc550 2024-09-13T21:52:18.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.853+0000 7fc985c37640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc96c06e530 0x7fc96c0709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc97000b020 tx=0x7fc970009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:18.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:18.857+0000 7fc976ffd640 1 -- 172.21.15.119:0/86265516 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc97c056bf0 con 0x7fc9800fc550 2024-09-13T21:52:19.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.103+0000 7fc98869c640 1 -- 172.21.15.119:0/86265516 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc98010f080 con 0x7fc9800fc550 2024-09-13T21:52:19.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.104+0000 7fc976ffd640 1 -- 172.21.15.119:0/86265516 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc97c05a2b0 con 0x7fc9800fc550 2024-09-13T21:52:19.105 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:52:19.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.106+0000 7fc98869c640 1 -- 172.21.15.119:0/86265516 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc96c06e530 msgr2=0x7fc96c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:19.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.106+0000 7fc98869c640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc96c06e530 0x7fc96c0709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc97000b020 tx=0x7fc970009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:19.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.106+0000 7fc98869c640 1 -- 172.21.15.119:0/86265516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9800fc550 msgr2=0x7fc98010d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:19.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.106+0000 7fc98869c640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9800fc550 0x7fc98010d0e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00b790 tx=0x7fc97c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:52:19.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.106+0000 7fc98869c640 1 -- 172.21.15.119:0/86265516 shutdown_connections 2024-09-13T21:52:19.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.106+0000 7fc98869c640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fc96c06e530 0x7fc96c0709e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:19.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.106+0000 7fc98869c640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9800fd820 0x7fc98010d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:19.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.106+0000 7fc98869c640 1 --2- 172.21.15.119:0/86265516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9800fc550 0x7fc98010d0e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:19.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.106+0000 7fc98869c640 1 -- 172.21.15.119:0/86265516 >> 172.21.15.119:0/86265516 conn(0x7fc9800f7d30 msgr2=0x7fc9800f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:19.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.106+0000 7fc98869c640 1 -- 172.21.15.119:0/86265516 shutdown_connections 2024-09-13T21:52:19.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:19.106+0000 7fc98869c640 1 -- 172.21.15.119:0/86265516 wait complete. 2024-09-13T21:52:19.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:19 smithi119 ceph-mon[90896]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:19.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:19 smithi119 ceph-mon[90896]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:19.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:19 smithi119 ceph-mon[90896]: pgmap v198: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T21:52:19.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:19 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/986877249' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:52:19.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:19 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/86265516' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:52:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:19 smithi155 ceph-mon[79928]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:19 smithi155 ceph-mon[79928]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:19 smithi155 ceph-mon[79928]: pgmap v198: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T21:52:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:19 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/986877249' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:52:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:19 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/86265516' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:52:20.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:20 smithi155 ceph-mon[79928]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:20.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:20 smithi119 ceph-mon[90896]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:21.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: pgmap v199: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 7.4 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-13T21:52:21.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:21.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:21.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:21.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:52:21.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:21.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:21.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:21.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:21.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:21.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:21.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:21 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi155.yblkxo"]}]: dispatch 2024-09-13T21:52:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: pgmap v199: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 7.4 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-13T21:52:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:52:21.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:21.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:21.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:21.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:21.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:21.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:21.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:21 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi155.yblkxo"]}]: dispatch 2024-09-13T21:52:22.563 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:22 smithi155 ceph-mon[79928]: Upgrade: It appears safe to stop mds.cephfs.smithi155.yblkxo 2024-09-13T21:52:22.563 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:22.563 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.yblkxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:52:22.563 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:22.563 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:22.563 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:22 smithi119 ceph-mon[90896]: Upgrade: It appears safe to stop mds.cephfs.smithi155.yblkxo 2024-09-13T21:52:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.yblkxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:52:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:23.461 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:23 smithi155 ceph-mon[79928]: Upgrade: Updating mds.cephfs.smithi155.yblkxo 2024-09-13T21:52:23.461 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:23 smithi155 ceph-mon[79928]: Deploying daemon mds.cephfs.smithi155.yblkxo on smithi155 2024-09-13T21:52:23.461 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:23 smithi155 ceph-mon[79928]: pgmap v200: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-13T21:52:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:23 smithi119 ceph-mon[90896]: Upgrade: Updating mds.cephfs.smithi155.yblkxo 2024-09-13T21:52:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:23 smithi119 ceph-mon[90896]: Deploying daemon mds.cephfs.smithi155.yblkxo on smithi155 2024-09-13T21:52:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:23 smithi119 ceph-mon[90896]: pgmap v200: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-13T21:52:25.574 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:25 smithi155 ceph-mon[79928]: pgmap v201: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-13T21:52:25.574 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:25 smithi155 ceph-mon[79928]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T21:52:25.574 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:25 smithi155 ceph-mon[79928]: fsmap cephfs:1 {0=cephfs.smithi155.afmavb=up:active} 2 up:standby 2024-09-13T21:52:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:25 smithi119 ceph-mon[90896]: pgmap v201: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-13T21:52:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:25 smithi119 ceph-mon[90896]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T21:52:25.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:25 smithi119 ceph-mon[90896]: fsmap cephfs:1 {0=cephfs.smithi155.afmavb=up:active} 2 up:standby 2024-09-13T21:52:27.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:27 smithi155 ceph-mon[79928]: pgmap v203: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 307 B/s rd, 5.1 KiB/s wr, 2 op/s 2024-09-13T21:52:27.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:27.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:27.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:27 smithi119 ceph-mon[90896]: pgmap v203: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 307 B/s rd, 5.1 KiB/s wr, 2 op/s 2024-09-13T21:52:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:28.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:28 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.155:6824/2986837064,v1:172.21.15.155:6825/2986837064] up:boot 2024-09-13T21:52:28.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:28 smithi155 ceph-mon[79928]: fsmap cephfs:1 {0=cephfs.smithi155.afmavb=up:active} 3 up:standby 2024-09-13T21:52:28.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:28 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:52:28.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:28 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.155:6824/2986837064,v1:172.21.15.155:6825/2986837064] up:boot 2024-09-13T21:52:28.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:28 smithi119 ceph-mon[90896]: fsmap cephfs:1 {0=cephfs.smithi155.afmavb=up:active} 3 up:standby 2024-09-13T21:52:28.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:28 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:52:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:29 smithi155 ceph-mon[79928]: pgmap v204: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 5.1 KiB/s wr, 2 op/s 2024-09-13T21:52:29.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:29 smithi119 ceph-mon[90896]: pgmap v204: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 5.1 KiB/s wr, 2 op/s 2024-09-13T21:52:30.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:30 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:30.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:30 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:30.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:30 smithi119 ceph-mon[90896]: pgmap v205: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:30.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:30 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:30.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:30 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:30.959 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:30 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:30.959 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:30 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:30.959 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:30 smithi155 ceph-mon[79928]: pgmap v205: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:30.959 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:30 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:30.959 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:30 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:33.528 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:33 smithi155 ceph-mon[79928]: pgmap v206: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:33.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:33 smithi119 ceph-mon[90896]: pgmap v206: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:34.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: Detected new or changed devices on smithi155 2024-09-13T21:52:34.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi155.afmavb"]}]: dispatch 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: Upgrade: It appears safe to stop mds.cephfs.smithi155.afmavb 2024-09-13T21:52:34.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:34 smithi155 ceph-mon[79928]: pgmap v207: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: Detected new or changed devices on smithi155 2024-09-13T21:52:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:52:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:34.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:34.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:34.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:34.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:34.882 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi155.afmavb"]}]: dispatch 2024-09-13T21:52:34.882 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: Upgrade: It appears safe to stop mds.cephfs.smithi155.afmavb 2024-09-13T21:52:34.882 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:34 smithi119 ceph-mon[90896]: pgmap v207: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:36.525 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:36 smithi155 ceph-mon[79928]: Upgrade: Updating mds.cephfs.smithi155.afmavb 2024-09-13T21:52:36.525 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:36 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:36.525 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:36 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.afmavb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:52:36.526 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:36 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:36.526 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:36 smithi155 ceph-mon[79928]: Deploying daemon mds.cephfs.smithi155.afmavb on smithi155 2024-09-13T21:52:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:36 smithi119 ceph-mon[90896]: Upgrade: Updating mds.cephfs.smithi155.afmavb 2024-09-13T21:52:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:36 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:36 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi155.afmavb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T21:52:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:36 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:36.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:36 smithi119 ceph-mon[90896]: Deploying daemon mds.cephfs.smithi155.afmavb on smithi155 2024-09-13T21:52:37.414 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:37 smithi155 ceph-mon[79928]: pgmap v208: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:37.414 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:37.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:37 smithi119 ceph-mon[90896]: pgmap v208: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:52:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:37 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119[90892]: 2024-09-13T21:52:37.413+0000 7f027643b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:52:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:38 smithi155 ceph-mon[79928]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T21:52:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:38 smithi155 ceph-mon[79928]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:52:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:38 smithi155 ceph-mon[79928]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T21:52:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:38 smithi155 ceph-mon[79928]: Standby daemon mds.cephfs.smithi119.rpmijj assigned to filesystem cephfs as rank 0 2024-09-13T21:52:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:38 smithi155 ceph-mon[79928]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T21:52:38.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:38 smithi155 ceph-mon[79928]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T21:52:38.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:38 smithi155 ceph-mon[79928]: fsmap cephfs:1/1 {0=cephfs.smithi119.rpmijj=up:replay} 2 up:standby 2024-09-13T21:52:38.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:38 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:52:38.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:38 smithi119 ceph-mon[90896]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T21:52:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:38 smithi119 ceph-mon[90896]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T21:52:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:38 smithi119 ceph-mon[90896]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T21:52:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:38 smithi119 ceph-mon[90896]: Standby daemon mds.cephfs.smithi119.rpmijj assigned to filesystem cephfs as rank 0 2024-09-13T21:52:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:38 smithi119 ceph-mon[90896]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T21:52:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:38 smithi119 ceph-mon[90896]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T21:52:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:38 smithi119 ceph-mon[90896]: fsmap cephfs:1/1 {0=cephfs.smithi119.rpmijj=up:replay} 2 up:standby 2024-09-13T21:52:38.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:38 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:52:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:39 smithi155 ceph-mon[79928]: pgmap v210: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 409 KiB/s rd, 0 op/s 2024-09-13T21:52:39.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:39 smithi119 ceph-mon[90896]: pgmap v210: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 409 KiB/s rd, 0 op/s 2024-09-13T21:52:41.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:41 smithi155 ceph-mon[79928]: pgmap v211: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 2 op/s 2024-09-13T21:52:41.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:41 smithi119 ceph-mon[90896]: pgmap v211: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 2 op/s 2024-09-13T21:52:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:43 smithi155 ceph-mon[79928]: pgmap v212: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 7.6 MiB/s rd, 3 op/s 2024-09-13T21:52:43.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:43 smithi119 ceph-mon[90896]: pgmap v212: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 7.6 MiB/s rd, 3 op/s 2024-09-13T21:52:44.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:44 smithi155 ceph-mon[79928]: reconnect by client.14506 192.168.0.1:0/3612892378 after 0.000999976 2024-09-13T21:52:44.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:44 smithi155 ceph-mon[79928]: reconnect by client.24295 192.168.0.1:0/1537294791 after 0.000999976 2024-09-13T21:52:44.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:44 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] up:reconnect 2024-09-13T21:52:44.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:44 smithi155 ceph-mon[79928]: fsmap cephfs:1/1 {0=cephfs.smithi119.rpmijj=up:reconnect} 2 up:standby 2024-09-13T21:52:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:44 smithi119 ceph-mon[90896]: reconnect by client.14506 192.168.0.1:0/3612892378 after 0.000999976 2024-09-13T21:52:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:44 smithi119 ceph-mon[90896]: reconnect by client.24295 192.168.0.1:0/1537294791 after 0.000999976 2024-09-13T21:52:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:44 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] up:reconnect 2024-09-13T21:52:44.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:44 smithi119 ceph-mon[90896]: fsmap cephfs:1/1 {0=cephfs.smithi119.rpmijj=up:reconnect} 2 up:standby 2024-09-13T21:52:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:45 smithi155 ceph-mon[79928]: pgmap v213: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T21:52:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:45 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] up:rejoin 2024-09-13T21:52:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:45 smithi155 ceph-mon[79928]: fsmap cephfs:1/1 {0=cephfs.smithi119.rpmijj=up:rejoin} 2 up:standby 2024-09-13T21:52:45.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:45 smithi155 ceph-mon[79928]: daemon mds.cephfs.smithi119.rpmijj is now active in filesystem cephfs as rank 0 2024-09-13T21:52:45.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:45 smithi119 ceph-mon[90896]: pgmap v213: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T21:52:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:45 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] up:rejoin 2024-09-13T21:52:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:45 smithi119 ceph-mon[90896]: fsmap cephfs:1/1 {0=cephfs.smithi119.rpmijj=up:rejoin} 2 up:standby 2024-09-13T21:52:45.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:45 smithi119 ceph-mon[90896]: daemon mds.cephfs.smithi119.rpmijj is now active in filesystem cephfs as rank 0 2024-09-13T21:52:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:46 smithi155 ceph-mon[79928]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T21:52:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:46 smithi155 ceph-mon[79928]: Cluster is now healthy 2024-09-13T21:52:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:46 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] up:active 2024-09-13T21:52:46.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:46 smithi155 ceph-mon[79928]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:active} 2 up:standby 2024-09-13T21:52:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:46 smithi119 ceph-mon[90896]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T21:52:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:46 smithi119 ceph-mon[90896]: Cluster is now healthy 2024-09-13T21:52:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:46 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] up:active 2024-09-13T21:52:46.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:46 smithi119 ceph-mon[90896]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:active} 2 up:standby 2024-09-13T21:52:47.503 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:47 smithi155 ceph-mon[79928]: pgmap v214: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T21:52:47.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:47 smithi119 ceph-mon[90896]: pgmap v214: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T21:52:49.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.197+0000 7ff67f852640 1 -- 172.21.15.119:0/2775699811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6780fc6f0 msgr2=0x7ff6780fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.197+0000 7ff67f852640 1 --2- 172.21.15.119:0/2775699811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6780fc6f0 0x7ff6780fcb60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0048d0 tx=0x7ff66c009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.197+0000 7ff67f852640 1 -- 172.21.15.119:0/2775699811 shutdown_connections 2024-09-13T21:52:49.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.197+0000 7ff67f852640 1 --2- 172.21.15.119:0/2775699811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6780fc6f0 0x7ff6780fcb60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.197+0000 7ff67f852640 1 --2- 172.21.15.119:0/2775699811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6780fb420 0x7ff6780fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.197+0000 7ff67f852640 1 -- 172.21.15.119:0/2775699811 >> 172.21.15.119:0/2775699811 conn(0x7ff6780f6c00 msgr2=0x7ff6780f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:49.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.197+0000 7ff67f852640 1 -- 172.21.15.119:0/2775699811 shutdown_connections 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.197+0000 7ff67f852640 1 -- 172.21.15.119:0/2775699811 wait complete. 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.198+0000 7ff67f852640 1 Processor -- start 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.198+0000 7ff67f852640 1 -- start start 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.198+0000 7ff67f852640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6780fb420 0x7ff67810fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.198+0000 7ff67f852640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6780fc6f0 0x7ff6781122a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.198+0000 7ff67f852640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff678066550 con 0x7ff6780fc6f0 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.198+0000 7ff67f852640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780666c0 con 0x7ff6780fb420 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.198+0000 7ff67cded640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6780fc6f0 0x7ff6781122a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.198+0000 7ff67cded640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6780fc6f0 0x7ff6781122a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34384/0 (socket says 172.21.15.119:34384) 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.198+0000 7ff67cded640 1 -- 172.21.15.119:0/3212930163 learned_addr learned my addr 172.21.15.119:0/3212930163 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.198+0000 7ff67d5ee640 1 --2- 172.21.15.119:0/3212930163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6780fb420 0x7ff67810fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.199+0000 7ff67cded640 1 -- 172.21.15.119:0/3212930163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6780fb420 msgr2=0x7ff67810fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.199+0000 7ff67cded640 1 --2- 172.21.15.119:0/3212930163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6780fb420 0x7ff67810fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.199+0000 7ff67cded640 1 -- 172.21.15.119:0/3212930163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c005040 con 0x7ff6780fc6f0 2024-09-13T21:52:49.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.199+0000 7ff67cded640 1 --2- 172.21.15.119:0/3212930163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6780fc6f0 0x7ff6781122a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0048a0 tx=0x7ff66c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:49.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.199+0000 7ff675ffb640 1 -- 172.21.15.119:0/3212930163 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff66c038070 con 0x7ff6780fc6f0 2024-09-13T21:52:49.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.199+0000 7ff675ffb640 1 -- 172.21.15.119:0/3212930163 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff66c009800 con 0x7ff6780fc6f0 2024-09-13T21:52:49.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.199+0000 7ff67f852640 1 -- 172.21.15.119:0/3212930163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff678112840 con 0x7ff6780fc6f0 2024-09-13T21:52:49.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.199+0000 7ff675ffb640 1 -- 172.21.15.119:0/3212930163 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff66c03e670 con 0x7ff6780fc6f0 2024-09-13T21:52:49.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.199+0000 7ff67f852640 1 -- 172.21.15.119:0/3212930163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff678112db0 con 0x7ff6780fc6f0 2024-09-13T21:52:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.200+0000 7ff67f852640 1 -- 172.21.15.119:0/3212930163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6780fa880 con 0x7ff6780fc6f0 2024-09-13T21:52:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.201+0000 7ff675ffb640 1 -- 172.21.15.119:0/3212930163 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff66c030020 con 0x7ff6780fc6f0 2024-09-13T21:52:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.201+0000 7ff675ffb640 1 --2- 172.21.15.119:0/3212930163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff66006e530 0x7ff6600709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.201+0000 7ff675ffb640 1 -- 172.21.15.119:0/3212930163 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff66c0ae1d0 con 0x7ff6780fc6f0 2024-09-13T21:52:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.201+0000 7ff67d5ee640 1 --2- 172.21.15.119:0/3212930163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff66006e530 0x7ff6600709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.202+0000 7ff67d5ee640 1 --2- 172.21.15.119:0/3212930163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff66006e530 0x7ff6600709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff668004fd0 tx=0x7ff66800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:49.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.206+0000 7ff675ffb640 1 -- 172.21.15.119:0/3212930163 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff66c077390 con 0x7ff6780fc6f0 2024-09-13T21:52:49.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:49 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:49.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:49 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:49.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:49 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:49.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:49 smithi119 ceph-mon[90896]: pgmap v215: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-13T21:52:49.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:49 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.155:6826/3721950377,v1:172.21.15.155:6827/3721950377] up:boot 2024-09-13T21:52:49.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:49 smithi119 ceph-mon[90896]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:active} 3 up:standby 2024-09-13T21:52:49.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:49 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:52:49.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.388+0000 7ff67f852640 1 -- 172.21.15.119:0/3212930163 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff678100b10 con 0x7ff66006e530 2024-09-13T21:52:49.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.390+0000 7ff675ffb640 1 -- 172.21.15.119:0/3212930163 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff678100b10 con 0x7ff66006e530 2024-09-13T21:52:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.393+0000 7ff67f852640 1 -- 172.21.15.119:0/3212930163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff66006e530 msgr2=0x7ff6600709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.393+0000 7ff67f852640 1 --2- 172.21.15.119:0/3212930163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff66006e530 0x7ff6600709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff668004fd0 tx=0x7ff66800b040 comp rx=0 tx=0).stop 2024-09-13T21:52:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.393+0000 7ff67f852640 1 -- 172.21.15.119:0/3212930163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6780fc6f0 msgr2=0x7ff6781122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.393+0000 7ff67f852640 1 --2- 172.21.15.119:0/3212930163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6780fc6f0 0x7ff6781122a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0048a0 tx=0x7ff66c009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.393+0000 7ff67f852640 1 -- 172.21.15.119:0/3212930163 shutdown_connections 2024-09-13T21:52:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.393+0000 7ff67f852640 1 --2- 172.21.15.119:0/3212930163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7ff66006e530 0x7ff6600709e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.393+0000 7ff67f852640 1 --2- 172.21.15.119:0/3212930163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff6780fc6f0 0x7ff6781122a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.393+0000 7ff67f852640 1 --2- 172.21.15.119:0/3212930163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6780fb420 0x7ff67810fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.393+0000 7ff67f852640 1 -- 172.21.15.119:0/3212930163 >> 172.21.15.119:0/3212930163 conn(0x7ff6780f6c00 msgr2=0x7ff6780f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.393+0000 7ff67f852640 1 -- 172.21.15.119:0/3212930163 shutdown_connections 2024-09-13T21:52:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.393+0000 7ff67f852640 1 -- 172.21.15.119:0/3212930163 wait complete. 2024-09-13T21:52:49.403 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:52:49.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:49 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:49.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:49 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:49.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:49 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:49.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:49 smithi155 ceph-mon[79928]: pgmap v215: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-13T21:52:49.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:49 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.155:6826/3721950377,v1:172.21.15.155:6827/3721950377] up:boot 2024-09-13T21:52:49.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:49 smithi155 ceph-mon[79928]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:active} 3 up:standby 2024-09-13T21:52:49.457 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:49 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:52:49.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.473+0000 7fa1a9f13640 1 -- 172.21.15.119:0/4127836239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a40fc520 msgr2=0x7fa1a40fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.473+0000 7fa1a9f13640 1 --2- 172.21.15.119:0/4127836239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a40fc520 0x7fa1a40fc930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa1940048d0 tx=0x7fa194009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.473+0000 7fa1a9f13640 1 -- 172.21.15.119:0/4127836239 shutdown_connections 2024-09-13T21:52:49.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.473+0000 7fa1a9f13640 1 --2- 172.21.15.119:0/4127836239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a40fd7f0 0x7fa1a40fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.473+0000 7fa1a9f13640 1 --2- 172.21.15.119:0/4127836239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a40fc520 0x7fa1a40fc930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.473+0000 7fa1a9f13640 1 -- 172.21.15.119:0/4127836239 >> 172.21.15.119:0/4127836239 conn(0x7fa1a40f7ce0 msgr2=0x7fa1a40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:49.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.473+0000 7fa1a9f13640 1 -- 172.21.15.119:0/4127836239 shutdown_connections 2024-09-13T21:52:49.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.474+0000 7fa1a9f13640 1 -- 172.21.15.119:0/4127836239 wait complete. 2024-09-13T21:52:49.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.474+0000 7fa1a9f13640 1 Processor -- start 2024-09-13T21:52:49.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.474+0000 7fa1a9f13640 1 -- start start 2024-09-13T21:52:49.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.474+0000 7fa1a9f13640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a40fc520 0x7fa1a4071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.474+0000 7fa1a9f13640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a40fd7f0 0x7fa1a406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.474+0000 7fa1a9f13640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a406fff0 con 0x7fa1a40fd7f0 2024-09-13T21:52:49.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.474+0000 7fa1a9f13640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a4070130 con 0x7fa1a40fc520 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa1a2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a40fd7f0 0x7fa1a406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa1a37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a40fc520 0x7fa1a4071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa1a2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a40fd7f0 0x7fa1a406fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34414/0 (socket says 172.21.15.119:34414) 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa1a2ffd640 1 -- 172.21.15.119:0/2825031689 learned_addr learned my addr 172.21.15.119:0/2825031689 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa1a2ffd640 1 -- 172.21.15.119:0/2825031689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a40fc520 msgr2=0x7fa1a4071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa1a2ffd640 1 --2- 172.21.15.119:0/2825031689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a40fc520 0x7fa1a4071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa1a2ffd640 1 -- 172.21.15.119:0/2825031689 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194005040 con 0x7fa1a40fd7f0 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa1a2ffd640 1 --2- 172.21.15.119:0/2825031689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a40fd7f0 0x7fa1a406fa60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa198002a80 tx=0x7fa198004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa18bfff640 1 -- 172.21.15.119:0/2825031689 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa198007c30 con 0x7fa1a40fd7f0 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa18bfff640 1 -- 172.21.15.119:0/2825031689 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa19800f040 con 0x7fa1a40fd7f0 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa1a9f13640 1 -- 172.21.15.119:0/2825031689 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a4070410 con 0x7fa1a40fd7f0 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa18bfff640 1 -- 172.21.15.119:0/2825031689 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa19800dab0 con 0x7fa1a40fd7f0 2024-09-13T21:52:49.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.475+0000 7fa1a9f13640 1 -- 172.21.15.119:0/2825031689 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a41150d0 con 0x7fa1a40fd7f0 2024-09-13T21:52:49.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.477+0000 7fa1a9f13640 1 -- 172.21.15.119:0/2825031689 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a40fb980 con 0x7fa1a40fd7f0 2024-09-13T21:52:49.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.477+0000 7fa18bfff640 1 -- 172.21.15.119:0/2825031689 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa19800dc10 con 0x7fa1a40fd7f0 2024-09-13T21:52:49.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.477+0000 7fa18bfff640 1 --2- 172.21.15.119:0/2825031689 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa18c06e530 0x7fa18c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.477+0000 7fa18bfff640 1 -- 172.21.15.119:0/2825031689 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa19808da70 con 0x7fa1a40fd7f0 2024-09-13T21:52:49.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.477+0000 7fa1a37fe640 1 --2- 172.21.15.119:0/2825031689 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa18c06e530 0x7fa18c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.478+0000 7fa1a37fe640 1 --2- 172.21.15.119:0/2825031689 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa18c06e530 0x7fa18c0709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa194000c00 tx=0x7fa194035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:49.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.482+0000 7fa18bfff640 1 -- 172.21.15.119:0/2825031689 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa198056c20 con 0x7fa1a40fd7f0 2024-09-13T21:52:49.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.671+0000 7fa1a9f13640 1 -- 172.21.15.119:0/2825031689 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1a4101c50 con 0x7fa18c06e530 2024-09-13T21:52:49.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.673+0000 7fa18bfff640 1 -- 172.21.15.119:0/2825031689 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa1a4101c50 con 0x7fa18c06e530 2024-09-13T21:52:49.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.675+0000 7fa1a9f13640 1 -- 172.21.15.119:0/2825031689 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa18c06e530 msgr2=0x7fa18c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.675+0000 7fa1a9f13640 1 --2- 172.21.15.119:0/2825031689 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa18c06e530 0x7fa18c0709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa194000c00 tx=0x7fa194035040 comp rx=0 tx=0).stop 2024-09-13T21:52:49.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.675+0000 7fa1a9f13640 1 -- 172.21.15.119:0/2825031689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a40fd7f0 msgr2=0x7fa1a406fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.675+0000 7fa1a9f13640 1 --2- 172.21.15.119:0/2825031689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a40fd7f0 0x7fa1a406fa60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa198002a80 tx=0x7fa198004600 comp rx=0 tx=0).stop 2024-09-13T21:52:49.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.675+0000 7fa1a9f13640 1 -- 172.21.15.119:0/2825031689 shutdown_connections 2024-09-13T21:52:49.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.675+0000 7fa1a9f13640 1 --2- 172.21.15.119:0/2825031689 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa18c06e530 0x7fa18c0709e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.675+0000 7fa1a9f13640 1 --2- 172.21.15.119:0/2825031689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a40fd7f0 0x7fa1a406fa60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.675+0000 7fa1a9f13640 1 --2- 172.21.15.119:0/2825031689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1a40fc520 0x7fa1a4071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.675+0000 7fa1a9f13640 1 -- 172.21.15.119:0/2825031689 >> 172.21.15.119:0/2825031689 conn(0x7fa1a40f7ce0 msgr2=0x7fa1a40f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:49.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.675+0000 7fa1a9f13640 1 -- 172.21.15.119:0/2825031689 shutdown_connections 2024-09-13T21:52:49.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.675+0000 7fa1a9f13640 1 -- 172.21.15.119:0/2825031689 wait complete. 2024-09-13T21:52:49.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.755+0000 7fb1db1e5640 1 -- 172.21.15.119:0/3603279305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d40fb430 msgr2=0x7fb1d40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.755+0000 7fb1db1e5640 1 --2- 172.21.15.119:0/3603279305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d40fb430 0x7fb1d40fb840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009c50 tx=0x7fb1cc004d10 comp rx=0 tx=0).stop 2024-09-13T21:52:49.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.755+0000 7fb1db1e5640 1 -- 172.21.15.119:0/3603279305 shutdown_connections 2024-09-13T21:52:49.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.755+0000 7fb1db1e5640 1 --2- 172.21.15.119:0/3603279305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1d40fc700 0x7fb1d40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.755+0000 7fb1db1e5640 1 --2- 172.21.15.119:0/3603279305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d40fb430 0x7fb1d40fb840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.755+0000 7fb1db1e5640 1 -- 172.21.15.119:0/3603279305 >> 172.21.15.119:0/3603279305 conn(0x7fb1d40f6c10 msgr2=0x7fb1d40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:49.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.755+0000 7fb1db1e5640 1 -- 172.21.15.119:0/3603279305 shutdown_connections 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.755+0000 7fb1db1e5640 1 -- 172.21.15.119:0/3603279305 wait complete. 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.755+0000 7fb1db1e5640 1 Processor -- start 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.755+0000 7fb1db1e5640 1 -- start start 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1db1e5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1d40fb430 0x7fb1d40ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1db1e5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d40fc700 0x7fb1d40fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1db1e5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40fdfd0 con 0x7fb1d40fc700 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1db1e5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40fe110 con 0x7fb1d40fb430 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1d3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d40fc700 0x7fb1d40fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1d3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d40fc700 0x7fb1d40fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34430/0 (socket says 172.21.15.119:34430) 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1d3fff640 1 -- 172.21.15.119:0/1887940000 learned_addr learned my addr 172.21.15.119:0/1887940000 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1d8f81640 1 --2- 172.21.15.119:0/1887940000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1d40fb430 0x7fb1d40ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1d3fff640 1 -- 172.21.15.119:0/1887940000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1d40fb430 msgr2=0x7fb1d40ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1d3fff640 1 --2- 172.21.15.119:0/1887940000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1d40fb430 0x7fb1d40ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1d3fff640 1 -- 172.21.15.119:0/1887940000 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc0098b0 con 0x7fb1d40fc700 2024-09-13T21:52:49.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1d3fff640 1 --2- 172.21.15.119:0/1887940000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d40fc700 0x7fb1d40fda40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4002a80 tx=0x7fb1c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:49.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1d17fa640 1 -- 172.21.15.119:0/1887940000 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c4007c30 con 0x7fb1d40fc700 2024-09-13T21:52:49.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1db1e5640 1 -- 172.21.15.119:0/1887940000 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d40fe3f0 con 0x7fb1d40fc700 2024-09-13T21:52:49.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.756+0000 7fb1d17fa640 1 -- 172.21.15.119:0/1887940000 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb1c400f040 con 0x7fb1d40fc700 2024-09-13T21:52:49.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.757+0000 7fb1db1e5640 1 -- 172.21.15.119:0/1887940000 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d41150f0 con 0x7fb1d40fc700 2024-09-13T21:52:49.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.757+0000 7fb1d17fa640 1 -- 172.21.15.119:0/1887940000 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c4009530 con 0x7fb1d40fc700 2024-09-13T21:52:49.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.757+0000 7fb1db1e5640 1 -- 172.21.15.119:0/1887940000 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d40fa890 con 0x7fb1d40fc700 2024-09-13T21:52:49.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.759+0000 7fb1d17fa640 1 -- 172.21.15.119:0/1887940000 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb1c40097a0 con 0x7fb1d40fc700 2024-09-13T21:52:49.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.759+0000 7fb1d17fa640 1 --2- 172.21.15.119:0/1887940000 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb1c006e530 0x7fb1c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:49.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.760+0000 7fb1d17fa640 1 -- 172.21.15.119:0/1887940000 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb1c408dd00 con 0x7fb1d40fc700 2024-09-13T21:52:49.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.760+0000 7fb1d8f81640 1 --2- 172.21.15.119:0/1887940000 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb1c006e530 0x7fb1c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:49.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.760+0000 7fb1d8f81640 1 --2- 172.21.15.119:0/1887940000 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb1c006e530 0x7fb1c00709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc000f80 tx=0x7fb1cc004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:49.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.763+0000 7fb1d17fa640 1 -- 172.21.15.119:0/1887940000 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb1c4056ec0 con 0x7fb1d40fc700 2024-09-13T21:52:49.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.945+0000 7fb1db1e5640 1 -- 172.21.15.119:0/1887940000 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1d4103fa0 con 0x7fb1c006e530 2024-09-13T21:52:49.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.955+0000 7fb1d17fa640 1 -- 172.21.15.119:0/1887940000 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb1d4103fa0 con 0x7fb1c006e530 2024-09-13T21:52:49.957 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:52:49.957 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (7m) 33s ago 15m 25.0M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:52:49.957 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (5m) 33s ago 16m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:52:49.957 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (5m) 20s ago 15m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:52:49.957 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (7m) 33s ago 15m 87.2M - 9.4.7 954c08fa6188 4ccbf2ee213b 2024-09-13T21:52:49.958 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (58s) 33s ago 10m 12.9M - 19.1.1-324-gecab7be5 0652ff2b5d78 a39ea5706ead 2024-09-13T21:52:49.958 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (38s) 33s ago 10m 15.4M - 19.1.1-324-gecab7be5 0652ff2b5d78 1d784af814a8 2024-09-13T21:52:49.958 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 starting - - - - 2024-09-13T21:52:49.958 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (23s) 20s ago 10m 15.3M - 19.1.1-324-gecab7be5 0652ff2b5d78 886302ecfbf8 2024-09-13T21:52:49.958 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (6m) 33s ago 17m 506M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:52:49.958 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (6m) 20s ago 15m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:52:49.958 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (6m) 33s ago 17m 51.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:52:49.958 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (5m) 20s ago 14m 40.3M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:52:49.958 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (7m) 33s ago 15m 16.6M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:52:49.958 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (6m) 20s ago 15m 15.0M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:52:49.958 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (4m) 33s ago 14m 103M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:52:49.959 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (4m) 33s ago 13m 105M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 8f69bf25cd20 2024-09-13T21:52:49.959 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (3m) 33s ago 13m 94.7M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 0f73e4fc2c43 2024-09-13T21:52:49.959 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (3m) 20s ago 12m 114M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5a7f5a9c1c4d 2024-09-13T21:52:49.959 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (2m) 20s ago 12m 108M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 03c992670291 2024-09-13T21:52:49.959 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (115s) 20s ago 12m 93.0M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 bf54ed40f20f 2024-09-13T21:52:49.959 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (6m) 33s ago 15m 65.7M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:52:49.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.957+0000 7fb1db1e5640 1 -- 172.21.15.119:0/1887940000 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb1c006e530 msgr2=0x7fb1c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.957+0000 7fb1db1e5640 1 --2- 172.21.15.119:0/1887940000 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb1c006e530 0x7fb1c00709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc000f80 tx=0x7fb1cc004d10 comp rx=0 tx=0).stop 2024-09-13T21:52:49.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.957+0000 7fb1db1e5640 1 -- 172.21.15.119:0/1887940000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d40fc700 msgr2=0x7fb1d40fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:49.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.957+0000 7fb1db1e5640 1 --2- 172.21.15.119:0/1887940000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d40fc700 0x7fb1d40fda40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4002a80 tx=0x7fb1c4004600 comp rx=0 tx=0).stop 2024-09-13T21:52:49.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.957+0000 7fb1db1e5640 1 -- 172.21.15.119:0/1887940000 shutdown_connections 2024-09-13T21:52:49.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.957+0000 7fb1db1e5640 1 --2- 172.21.15.119:0/1887940000 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb1c006e530 0x7fb1c00709e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.957+0000 7fb1db1e5640 1 --2- 172.21.15.119:0/1887940000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d40fc700 0x7fb1d40fda40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.957+0000 7fb1db1e5640 1 --2- 172.21.15.119:0/1887940000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1d40fb430 0x7fb1d40ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:49.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.957+0000 7fb1db1e5640 1 -- 172.21.15.119:0/1887940000 >> 172.21.15.119:0/1887940000 conn(0x7fb1d40f6c10 msgr2=0x7fb1d4065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:49.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.957+0000 7fb1db1e5640 1 -- 172.21.15.119:0/1887940000 shutdown_connections 2024-09-13T21:52:49.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:49.957+0000 7fb1db1e5640 1 -- 172.21.15.119:0/1887940000 wait complete. 2024-09-13T21:52:50.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.037+0000 7feb495fa640 1 -- 172.21.15.119:0/41613306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb440fc720 msgr2=0x7feb440fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.037+0000 7feb495fa640 1 --2- 172.21.15.119:0/41613306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb440fc720 0x7feb440fcb90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feb380048d0 tx=0x7feb38009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.037+0000 7feb495fa640 1 -- 172.21.15.119:0/41613306 shutdown_connections 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.037+0000 7feb495fa640 1 --2- 172.21.15.119:0/41613306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb440fc720 0x7feb440fcb90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.037+0000 7feb495fa640 1 --2- 172.21.15.119:0/41613306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb440fb450 0x7feb440fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.037+0000 7feb495fa640 1 -- 172.21.15.119:0/41613306 >> 172.21.15.119:0/41613306 conn(0x7feb440f6c10 msgr2=0x7feb440f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.037+0000 7feb495fa640 1 -- 172.21.15.119:0/41613306 shutdown_connections 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.037+0000 7feb495fa640 1 -- 172.21.15.119:0/41613306 wait complete. 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb495fa640 1 Processor -- start 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb495fa640 1 -- start start 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb495fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb440fb450 0x7feb4410d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb495fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb440fc720 0x7feb4410d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb495fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4410dc90 con 0x7feb440fc720 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb495fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4410e4b0 con 0x7feb440fb450 2024-09-13T21:52:50.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb427fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb440fc720 0x7feb4410d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb427fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb440fc720 0x7feb4410d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34444/0 (socket says 172.21.15.119:34444) 2024-09-13T21:52:50.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb427fc640 1 -- 172.21.15.119:0/3623411827 learned_addr learned my addr 172.21.15.119:0/3623411827 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:50.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb42ffd640 1 --2- 172.21.15.119:0/3623411827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb440fb450 0x7feb4410d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb427fc640 1 -- 172.21.15.119:0/3623411827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb440fb450 msgr2=0x7feb4410d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb427fc640 1 --2- 172.21.15.119:0/3623411827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb440fb450 0x7feb4410d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.038+0000 7feb427fc640 1 -- 172.21.15.119:0/3623411827 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb38005040 con 0x7feb440fc720 2024-09-13T21:52:50.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.039+0000 7feb427fc640 1 --2- 172.21.15.119:0/3623411827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb440fc720 0x7feb4410d640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feb38000c00 tx=0x7feb38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:50.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.039+0000 7feb2b7fe640 1 -- 172.21.15.119:0/3623411827 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb38038070 con 0x7feb440fc720 2024-09-13T21:52:50.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.039+0000 7feb2b7fe640 1 -- 172.21.15.119:0/3623411827 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feb38004290 con 0x7feb440fc720 2024-09-13T21:52:50.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.039+0000 7feb495fa640 1 -- 172.21.15.119:0/3623411827 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4410e6e0 con 0x7feb440fc720 2024-09-13T21:52:50.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.039+0000 7feb2b7fe640 1 -- 172.21.15.119:0/3623411827 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb3803e430 con 0x7feb440fc720 2024-09-13T21:52:50.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.039+0000 7feb495fa640 1 -- 172.21.15.119:0/3623411827 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4410ec80 con 0x7feb440fc720 2024-09-13T21:52:50.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.040+0000 7feb495fa640 1 -- 172.21.15.119:0/3623411827 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb440fa8b0 con 0x7feb440fc720 2024-09-13T21:52:50.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.041+0000 7feb2b7fe640 1 -- 172.21.15.119:0/3623411827 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7feb38030020 con 0x7feb440fc720 2024-09-13T21:52:50.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.041+0000 7feb2b7fe640 1 --2- 172.21.15.119:0/3623411827 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7feb2c06e530 0x7feb2c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.042+0000 7feb2b7fe640 1 -- 172.21.15.119:0/3623411827 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7feb380ae2b0 con 0x7feb440fc720 2024-09-13T21:52:50.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.042+0000 7feb42ffd640 1 --2- 172.21.15.119:0/3623411827 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7feb2c06e530 0x7feb2c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.042+0000 7feb42ffd640 1 --2- 172.21.15.119:0/3623411827 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7feb2c06e530 0x7feb2c0709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb34009af0 tx=0x7feb3400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:50.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.050+0000 7feb2b7fe640 1 -- 172.21.15.119:0/3623411827 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7feb380773f0 con 0x7feb440fc720 2024-09-13T21:52:50.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.301+0000 7feb495fa640 1 -- 172.21.15.119:0/3623411827 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feb44103f10 con 0x7feb440fc720 2024-09-13T21:52:50.303 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:50 smithi119 ceph-mon[90896]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:50.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.302+0000 7feb2b7fe640 1 -- 172.21.15.119:0/3623411827 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7feb3807aab0 con 0x7feb440fc720 2024-09-13T21:52:50.303 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:52:50.303 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:52:50.304 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T21:52:50.305 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:52:50.305 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:52:50.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.304+0000 7feb495fa640 1 -- 172.21.15.119:0/3623411827 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7feb2c06e530 msgr2=0x7feb2c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.304+0000 7feb495fa640 1 --2- 172.21.15.119:0/3623411827 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7feb2c06e530 0x7feb2c0709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb34009af0 tx=0x7feb3400b040 comp rx=0 tx=0).stop 2024-09-13T21:52:50.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.304+0000 7feb495fa640 1 -- 172.21.15.119:0/3623411827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb440fc720 msgr2=0x7feb4410d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.304+0000 7feb495fa640 1 --2- 172.21.15.119:0/3623411827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb440fc720 0x7feb4410d640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feb38000c00 tx=0x7feb38009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.304+0000 7feb495fa640 1 -- 172.21.15.119:0/3623411827 shutdown_connections 2024-09-13T21:52:50.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.304+0000 7feb495fa640 1 --2- 172.21.15.119:0/3623411827 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7feb2c06e530 0x7feb2c0709e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.304+0000 7feb495fa640 1 --2- 172.21.15.119:0/3623411827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb440fc720 0x7feb4410d640 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.304+0000 7feb495fa640 1 --2- 172.21.15.119:0/3623411827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb440fb450 0x7feb4410d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.304+0000 7feb495fa640 1 -- 172.21.15.119:0/3623411827 >> 172.21.15.119:0/3623411827 conn(0x7feb440f6c10 msgr2=0x7feb44066100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:50.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.304+0000 7feb495fa640 1 -- 172.21.15.119:0/3623411827 shutdown_connections 2024-09-13T21:52:50.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.304+0000 7feb495fa640 1 -- 172.21.15.119:0/3623411827 wait complete. 2024-09-13T21:52:50.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.384+0000 7f4091009640 1 -- 172.21.15.119:0/120941281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c065be0 msgr2=0x7f408c0ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.384+0000 7f4091009640 1 --2- 172.21.15.119:0/120941281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c065be0 0x7f408c0ff1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f407c0048d0 tx=0x7f407c009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.384+0000 7f4091009640 1 -- 172.21.15.119:0/120941281 shutdown_connections 2024-09-13T21:52:50.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.384+0000 7f4091009640 1 --2- 172.21.15.119:0/120941281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c0ff6e0 0x7f408c101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.384+0000 7f4091009640 1 --2- 172.21.15.119:0/120941281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c065be0 0x7f408c0ff1a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.384+0000 7f4091009640 1 -- 172.21.15.119:0/120941281 >> 172.21.15.119:0/120941281 conn(0x7f408c0f6c10 msgr2=0x7f408c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:50.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.384+0000 7f4091009640 1 -- 172.21.15.119:0/120941281 shutdown_connections 2024-09-13T21:52:50.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.384+0000 7f4091009640 1 -- 172.21.15.119:0/120941281 wait complete. 2024-09-13T21:52:50.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.385+0000 7f4091009640 1 Processor -- start 2024-09-13T21:52:50.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.385+0000 7f4091009640 1 -- start start 2024-09-13T21:52:50.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.385+0000 7f4091009640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c065be0 0x7f408c10d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.385+0000 7f4091009640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c0ff6e0 0x7f408c10d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.385+0000 7f4091009640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c10dcc0 con 0x7f408c065be0 2024-09-13T21:52:50.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.385+0000 7f4091009640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c10e490 con 0x7f408c0ff6e0 2024-09-13T21:52:50.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.385+0000 7f408ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c065be0 0x7f408c10d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.385+0000 7f408ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c065be0 0x7f408c10d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34470/0 (socket says 172.21.15.119:34470) 2024-09-13T21:52:50.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.385+0000 7f408ad9d640 1 -- 172.21.15.119:0/2666068280 learned_addr learned my addr 172.21.15.119:0/2666068280 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:50.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.385+0000 7f408a59c640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c0ff6e0 0x7f408c10d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.386+0000 7f408a59c640 1 -- 172.21.15.119:0/2666068280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c065be0 msgr2=0x7f408c10d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.386+0000 7f408a59c640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c065be0 0x7f408c10d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.386+0000 7f408a59c640 1 -- 172.21.15.119:0/2666068280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c005040 con 0x7f408c0ff6e0 2024-09-13T21:52:50.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.386+0000 7f408ad9d640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c065be0 0x7f408c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T21:52:50.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.386+0000 7f408a59c640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c0ff6e0 0x7f408c10d670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f407400eb40 tx=0x7f407400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:50.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.386+0000 7f40837fe640 1 -- 172.21.15.119:0/2666068280 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4074007c30 con 0x7f408c0ff6e0 2024-09-13T21:52:50.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.386+0000 7f40837fe640 1 -- 172.21.15.119:0/2666068280 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f407400f040 con 0x7f408c0ff6e0 2024-09-13T21:52:50.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.386+0000 7f4091009640 1 -- 172.21.15.119:0/2666068280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c10e6c0 con 0x7f408c0ff6e0 2024-09-13T21:52:50.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.386+0000 7f40837fe640 1 -- 172.21.15.119:0/2666068280 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40740094a0 con 0x7f408c0ff6e0 2024-09-13T21:52:50.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.386+0000 7f4091009640 1 -- 172.21.15.119:0/2666068280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c10ec60 con 0x7f408c0ff6e0 2024-09-13T21:52:50.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.387+0000 7f4091009640 1 -- 172.21.15.119:0/2666068280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c0fa890 con 0x7f408c0ff6e0 2024-09-13T21:52:50.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.388+0000 7f40837fe640 1 -- 172.21.15.119:0/2666068280 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4074009600 con 0x7f408c0ff6e0 2024-09-13T21:52:50.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.388+0000 7f40837fe640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f407806e530 0x7f40780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.388+0000 7f40837fe640 1 -- 172.21.15.119:0/2666068280 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f407408de20 con 0x7f408c0ff6e0 2024-09-13T21:52:50.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.388+0000 7f408ad9d640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f407806e530 0x7f40780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.389+0000 7f408ad9d640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f407806e530 0x7f40780709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f407c000c00 tx=0x7f407c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:50.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.393+0000 7f40837fe640 1 -- 172.21.15.119:0/2666068280 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4074056f60 con 0x7f408c0ff6e0 2024-09-13T21:52:50.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:50 smithi155 ceph-mon[79928]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:50.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.621+0000 7f4091009640 1 -- 172.21.15.119:0/2666068280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f408c04b720 con 0x7f408c0ff6e0 2024-09-13T21:52:50.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.622+0000 7f40837fe640 1 -- 172.21.15.119:0/2666068280 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+1983 (secure 0 0 0) 0x7f407405a620 con 0x7f408c0ff6e0 2024-09-13T21:52:50.624 INFO:teuthology.orchestra.run.smithi119.stdout:e43 2024-09-13T21:52:50.624 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:52:48:267921+0000 2024-09-13T21:52:50.624 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:52:50.624 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:52:50.624 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:52:50.624 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:52:50.624 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:52:50.624 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:52:50.624 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 42 2024-09-13T21:52:50.624 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:52:45.259352+0000 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 81 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T21:52:50.625 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 1 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:in 0 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=34434} 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 1 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 34434 members: 34434 2024-09-13T21:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{0:34434} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:52:50.627 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:52:50.627 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:52:50.627 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:52:50.627 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:52:50.627 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{-1:34438} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.119:6828/3559937126,v1:172.21.15.119:6829/3559937126] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:52:50.627 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.155:6824/2986837064,v1:172.21.15.155:6825/2986837064] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:52:50.627 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.155:6826/3721950377,v1:172.21.15.155:6827/3721950377] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:52:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 43 2024-09-13T21:52:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.626+0000 7f4091009640 1 -- 172.21.15.119:0/2666068280 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f407806e530 msgr2=0x7f40780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.626+0000 7f4091009640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f407806e530 0x7f40780709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f407c000c00 tx=0x7f407c035040 comp rx=0 tx=0).stop 2024-09-13T21:52:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.626+0000 7f4091009640 1 -- 172.21.15.119:0/2666068280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c0ff6e0 msgr2=0x7f408c10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.626+0000 7f4091009640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c0ff6e0 0x7f408c10d670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f407400eb40 tx=0x7f407400b040 comp rx=0 tx=0).stop 2024-09-13T21:52:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.626+0000 7f4091009640 1 -- 172.21.15.119:0/2666068280 shutdown_connections 2024-09-13T21:52:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.626+0000 7f4091009640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f407806e530 0x7f40780709e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.626+0000 7f4091009640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f408c0ff6e0 0x7f408c10d670 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.626+0000 7f4091009640 1 --2- 172.21.15.119:0/2666068280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f408c065be0 0x7f408c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.626+0000 7f4091009640 1 -- 172.21.15.119:0/2666068280 >> 172.21.15.119:0/2666068280 conn(0x7f408c0f6c10 msgr2=0x7f408c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.626+0000 7f4091009640 1 -- 172.21.15.119:0/2666068280 shutdown_connections 2024-09-13T21:52:50.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.626+0000 7f4091009640 1 -- 172.21.15.119:0/2666068280 wait complete. 2024-09-13T21:52:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.707+0000 7f9430e45640 1 -- 172.21.15.119:0/3083641558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f942c0fc700 msgr2=0x7f942c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.707+0000 7f9430e45640 1 --2- 172.21.15.119:0/3083641558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f942c0fc700 0x7f942c0fcb70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f94200048d0 tx=0x7f9420009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.707+0000 7f9430e45640 1 -- 172.21.15.119:0/3083641558 shutdown_connections 2024-09-13T21:52:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.707+0000 7f9430e45640 1 --2- 172.21.15.119:0/3083641558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f942c0fc700 0x7f942c0fcb70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.707+0000 7f9430e45640 1 --2- 172.21.15.119:0/3083641558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f942c0fb430 0x7f942c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.707+0000 7f9430e45640 1 -- 172.21.15.119:0/3083641558 >> 172.21.15.119:0/3083641558 conn(0x7f942c0f6c10 msgr2=0x7f942c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.707+0000 7f9430e45640 1 -- 172.21.15.119:0/3083641558 shutdown_connections 2024-09-13T21:52:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.707+0000 7f9430e45640 1 -- 172.21.15.119:0/3083641558 wait complete. 2024-09-13T21:52:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.708+0000 7f9430e45640 1 Processor -- start 2024-09-13T21:52:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.708+0000 7f9430e45640 1 -- start start 2024-09-13T21:52:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.708+0000 7f9430e45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f942c0fb430 0x7f942c10d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.708+0000 7f9430e45640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f942c0fc700 0x7f942c10d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.708+0000 7f9430e45640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c10dbf0 con 0x7f942c0fb430 2024-09-13T21:52:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.708+0000 7f9430e45640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c10e410 con 0x7f942c0fc700 2024-09-13T21:52:50.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.708+0000 7f942a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f942c0fb430 0x7f942c10d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.708+0000 7f942a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f942c0fb430 0x7f942c10d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34498/0 (socket says 172.21.15.119:34498) 2024-09-13T21:52:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.708+0000 7f942a59c640 1 -- 172.21.15.119:0/916364939 learned_addr learned my addr 172.21.15.119:0/916364939 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.708+0000 7f9429d9b640 1 --2- 172.21.15.119:0/916364939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f942c0fc700 0x7f942c10d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.709+0000 7f942a59c640 1 -- 172.21.15.119:0/916364939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f942c0fc700 msgr2=0x7f942c10d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.709+0000 7f942a59c640 1 --2- 172.21.15.119:0/916364939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f942c0fc700 0x7f942c10d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.709+0000 7f942a59c640 1 -- 172.21.15.119:0/916364939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9420005040 con 0x7f942c0fb430 2024-09-13T21:52:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.709+0000 7f942a59c640 1 --2- 172.21.15.119:0/916364939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f942c0fb430 0x7f942c10d060 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f941c00db00 tx=0x7f941c004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.709+0000 7f941affd640 1 -- 172.21.15.119:0/916364939 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f941c017070 con 0x7f942c0fb430 2024-09-13T21:52:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.709+0000 7f941affd640 1 -- 172.21.15.119:0/916364939 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f941c00f040 con 0x7f942c0fb430 2024-09-13T21:52:50.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.709+0000 7f9430e45640 1 -- 172.21.15.119:0/916364939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942c10e6a0 con 0x7f942c0fb430 2024-09-13T21:52:50.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.709+0000 7f941affd640 1 -- 172.21.15.119:0/916364939 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f941c003960 con 0x7f942c0fb430 2024-09-13T21:52:50.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.709+0000 7f9430e45640 1 -- 172.21.15.119:0/916364939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942c10ec40 con 0x7f942c0fb430 2024-09-13T21:52:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.710+0000 7f9430e45640 1 -- 172.21.15.119:0/916364939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f942c0fa890 con 0x7f942c0fb430 2024-09-13T21:52:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.710+0000 7f941affd640 1 -- 172.21.15.119:0/916364939 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f941c003b50 con 0x7f942c0fb430 2024-09-13T21:52:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.711+0000 7f941affd640 1 --2- 172.21.15.119:0/916364939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f941406e530 0x7f94140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.711+0000 7f941affd640 1 -- 172.21.15.119:0/916364939 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f941c08e1d0 con 0x7f942c0fb430 2024-09-13T21:52:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.711+0000 7f9429d9b640 1 --2- 172.21.15.119:0/916364939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f941406e530 0x7f94140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.711+0000 7f9429d9b640 1 --2- 172.21.15.119:0/916364939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f941406e530 0x7f94140709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f942c10ce10 tx=0x7f9420035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:50.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.715+0000 7f941affd640 1 -- 172.21.15.119:0/916364939 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f941c057260 con 0x7f942c0fb430 2024-09-13T21:52:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.900+0000 7f9430e45640 1 -- 172.21.15.119:0/916364939 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f942c103f60 con 0x7f941406e530 2024-09-13T21:52:50.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.901+0000 7f941affd640 1 -- 172.21.15.119:0/916364939 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f942c103f60 con 0x7f941406e530 2024-09-13T21:52:50.903 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:52:50.903 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T21:52:50.903 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": true, 2024-09-13T21:52:50.903 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T21:52:50.903 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [ 2024-09-13T21:52:50.903 INFO:teuthology.orchestra.run.smithi119.stdout: "mds", 2024-09-13T21:52:50.903 INFO:teuthology.orchestra.run.smithi119.stdout: "crash", 2024-09-13T21:52:50.903 INFO:teuthology.orchestra.run.smithi119.stdout: "osd", 2024-09-13T21:52:50.903 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr", 2024-09-13T21:52:50.903 INFO:teuthology.orchestra.run.smithi119.stdout: "mon" 2024-09-13T21:52:50.904 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-13T21:52:50.904 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": "16/21 daemons upgraded", 2024-09-13T21:52:50.904 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T21:52:50.904 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:52:50.904 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:52:50.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.903+0000 7f9430e45640 1 -- 172.21.15.119:0/916364939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f941406e530 msgr2=0x7f94140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.903+0000 7f9430e45640 1 --2- 172.21.15.119:0/916364939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f941406e530 0x7f94140709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f942c10ce10 tx=0x7f9420035040 comp rx=0 tx=0).stop 2024-09-13T21:52:50.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.903+0000 7f9430e45640 1 -- 172.21.15.119:0/916364939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f942c0fb430 msgr2=0x7f942c10d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.903+0000 7f9430e45640 1 --2- 172.21.15.119:0/916364939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f942c0fb430 0x7f942c10d060 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f941c00db00 tx=0x7f941c004e60 comp rx=0 tx=0).stop 2024-09-13T21:52:50.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.904+0000 7f9430e45640 1 -- 172.21.15.119:0/916364939 shutdown_connections 2024-09-13T21:52:50.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.904+0000 7f9430e45640 1 --2- 172.21.15.119:0/916364939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f941406e530 0x7f94140709e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.904+0000 7f9430e45640 1 --2- 172.21.15.119:0/916364939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f942c0fc700 0x7f942c10d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.904+0000 7f9430e45640 1 --2- 172.21.15.119:0/916364939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f942c0fb430 0x7f942c10d060 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.904+0000 7f9430e45640 1 -- 172.21.15.119:0/916364939 >> 172.21.15.119:0/916364939 conn(0x7f942c0f6c10 msgr2=0x7f942c065610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:50.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.904+0000 7f9430e45640 1 -- 172.21.15.119:0/916364939 shutdown_connections 2024-09-13T21:52:50.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.904+0000 7f9430e45640 1 -- 172.21.15.119:0/916364939 wait complete. 2024-09-13T21:52:50.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.983+0000 7f4585f8a640 1 -- 172.21.15.119:0/1134577965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45800fe4f0 msgr2=0x7f45800fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.983+0000 7f4585f8a640 1 --2- 172.21.15.119:0/1134577965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45800fe4f0 0x7f45800fa650 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f45740048d0 tx=0x7f4574009da0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.983+0000 7f4585f8a640 1 -- 172.21.15.119:0/1134577965 shutdown_connections 2024-09-13T21:52:50.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.983+0000 7f4585f8a640 1 --2- 172.21.15.119:0/1134577965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45800fe4f0 0x7f45800fa650 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.983+0000 7f4585f8a640 1 --2- 172.21.15.119:0/1134577965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45800fdba0 0x7f45800fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.983+0000 7f4585f8a640 1 -- 172.21.15.119:0/1134577965 >> 172.21.15.119:0/1134577965 conn(0x7f45800f63a0 msgr2=0x7f45800f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:50.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.983+0000 7f4585f8a640 1 -- 172.21.15.119:0/1134577965 shutdown_connections 2024-09-13T21:52:50.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.983+0000 7f4585f8a640 1 -- 172.21.15.119:0/1134577965 wait complete. 2024-09-13T21:52:50.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f4585f8a640 1 Processor -- start 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f4585f8a640 1 -- start start 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f4585f8a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45800fdba0 0x7f458010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f4585f8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45800fe4f0 0x7f458010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f4585f8a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458010dc30 con 0x7f45800fdba0 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f4585f8a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458010e450 con 0x7f45800fe4f0 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f457f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45800fdba0 0x7f458010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f457f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45800fdba0 0x7f458010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:34514/0 (socket says 172.21.15.119:34514) 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f457f7fe640 1 -- 172.21.15.119:0/2626734213 learned_addr learned my addr 172.21.15.119:0/2626734213 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f457effd640 1 --2- 172.21.15.119:0/2626734213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45800fe4f0 0x7f458010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f457f7fe640 1 -- 172.21.15.119:0/2626734213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45800fe4f0 msgr2=0x7f458010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f457f7fe640 1 --2- 172.21.15.119:0/2626734213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45800fe4f0 0x7f458010d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.984+0000 7f457f7fe640 1 -- 172.21.15.119:0/2626734213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4574005040 con 0x7f45800fdba0 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.985+0000 7f457f7fe640 1 --2- 172.21.15.119:0/2626734213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45800fdba0 0x7f458010d0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f457000eb70 tx=0x7f457000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:50.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.985+0000 7f4567fff640 1 -- 172.21.15.119:0/2626734213 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4570007c30 con 0x7f45800fdba0 2024-09-13T21:52:50.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.985+0000 7f4585f8a640 1 -- 172.21.15.119:0/2626734213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458010e680 con 0x7f45800fdba0 2024-09-13T21:52:50.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.985+0000 7f4567fff640 1 -- 172.21.15.119:0/2626734213 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f457000f040 con 0x7f45800fdba0 2024-09-13T21:52:50.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.985+0000 7f4567fff640 1 -- 172.21.15.119:0/2626734213 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f457000ca60 con 0x7f45800fdba0 2024-09-13T21:52:50.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.985+0000 7f4585f8a640 1 -- 172.21.15.119:0/2626734213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458010ec20 con 0x7f45800fdba0 2024-09-13T21:52:50.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.986+0000 7f4585f8a640 1 -- 172.21.15.119:0/2626734213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45800fa040 con 0x7f45800fdba0 2024-09-13T21:52:50.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.987+0000 7f4567fff640 1 -- 172.21.15.119:0/2626734213 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f457000cbc0 con 0x7f45800fdba0 2024-09-13T21:52:50.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.987+0000 7f4567fff640 1 --2- 172.21.15.119:0/2626734213 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f456806e530 0x7f45680709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:52:50.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.987+0000 7f4567fff640 1 -- 172.21.15.119:0/2626734213 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f457008de30 con 0x7f45800fdba0 2024-09-13T21:52:50.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.987+0000 7f457effd640 1 --2- 172.21.15.119:0/2626734213 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f456806e530 0x7f45680709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:52:50.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.988+0000 7f457effd640 1 --2- 172.21.15.119:0/2626734213 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f456806e530 0x7f45680709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f458010ce50 tx=0x7f4574035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:52:50.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:50.991+0000 7f4567fff640 1 -- 172.21.15.119:0/2626734213 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4570056f70 con 0x7f45800fdba0 2024-09-13T21:52:51.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.223+0000 7f4585f8a640 1 -- 172.21.15.119:0/2626734213 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f458004b720 con 0x7f45800fdba0 2024-09-13T21:52:51.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.223+0000 7f4567fff640 1 -- 172.21.15.119:0/2626734213 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f457005a630 con 0x7f45800fdba0 2024-09-13T21:52:51.225 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:52:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.225+0000 7f4585f8a640 1 -- 172.21.15.119:0/2626734213 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f456806e530 msgr2=0x7f45680709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.225+0000 7f4585f8a640 1 --2- 172.21.15.119:0/2626734213 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f456806e530 0x7f45680709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f458010ce50 tx=0x7f4574035040 comp rx=0 tx=0).stop 2024-09-13T21:52:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.225+0000 7f4585f8a640 1 -- 172.21.15.119:0/2626734213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45800fdba0 msgr2=0x7f458010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:52:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.225+0000 7f4585f8a640 1 --2- 172.21.15.119:0/2626734213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45800fdba0 0x7f458010d0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f457000eb70 tx=0x7f457000b040 comp rx=0 tx=0).stop 2024-09-13T21:52:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.225+0000 7f4585f8a640 1 -- 172.21.15.119:0/2626734213 shutdown_connections 2024-09-13T21:52:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.225+0000 7f4585f8a640 1 --2- 172.21.15.119:0/2626734213 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f456806e530 0x7f45680709e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.225+0000 7f4585f8a640 1 --2- 172.21.15.119:0/2626734213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45800fe4f0 0x7f458010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.225+0000 7f4585f8a640 1 --2- 172.21.15.119:0/2626734213 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45800fdba0 0x7f458010d0a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:52:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.225+0000 7f4585f8a640 1 -- 172.21.15.119:0/2626734213 >> 172.21.15.119:0/2626734213 conn(0x7f45800f63a0 msgr2=0x7f45800f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:52:51.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.226+0000 7f4585f8a640 1 -- 172.21.15.119:0/2626734213 shutdown_connections 2024-09-13T21:52:51.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:52:51.226+0000 7f4585f8a640 1 -- 172.21.15.119:0/2626734213 wait complete. 2024-09-13T21:52:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:51 smithi155 ceph-mon[79928]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:51 smithi155 ceph-mon[79928]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:51 smithi155 ceph-mon[79928]: pgmap v216: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T21:52:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:51 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:51 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:51 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3623411827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:51 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2666068280' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:52:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:51 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:51 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:51.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:51 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2626734213' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:52:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:51 smithi119 ceph-mon[90896]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:51 smithi119 ceph-mon[90896]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:51 smithi119 ceph-mon[90896]: pgmap v216: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T21:52:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:51 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:51 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:51 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3623411827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:51 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2666068280' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:52:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:51 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:51 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:51.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:51 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2626734213' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:52:52.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:52 smithi155 ceph-mon[79928]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:52.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:52.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:52 smithi119 ceph-mon[90896]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:52:52.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:52:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:53 smithi155 ceph-mon[79928]: pgmap v217: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T21:52:53.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:53 smithi119 ceph-mon[90896]: pgmap v217: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T21:52:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: pgmap v218: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T21:52:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:52:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:52:55.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi119.rpmijj"}]': finished 2024-09-13T21:52:55.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:52:55.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi119.yydzwt"}]': finished 2024-09-13T21:52:55.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:52:55.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi155.afmavb"}]': finished 2024-09-13T21:52:55.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:52:55.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi155.yblkxo"}]': finished 2024-09-13T21:52:55.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:55 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T21:52:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: pgmap v218: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T21:52:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:52:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:52:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:52:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi119.rpmijj"}]: dispatch 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi119.rpmijj"}]': finished 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi119.yydzwt"}]: dispatch 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi119.yydzwt"}]': finished 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi155.afmavb"}]: dispatch 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi155.afmavb"}]': finished 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi155.yblkxo"}]: dispatch 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi155.yblkxo"}]': finished 2024-09-13T21:52:55.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:55 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T21:52:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: Upgrade: Setting container_image for all mds 2024-09-13T21:52:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-13T21:52:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T21:52:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T21:52:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: daemon mds.cephfs.smithi119.yydzwt assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T21:52:56.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: Cluster is now healthy 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:active} 3 up:standby 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi119.yydzwt=up:starting} 2 up:standby 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: daemon mds.cephfs.smithi119.yydzwt is now active in filesystem cephfs as rank 1 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:56 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: Upgrade: Setting container_image for all mds 2024-09-13T21:52:56.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-13T21:52:56.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T21:52:56.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T21:52:56.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: daemon mds.cephfs.smithi119.yydzwt assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T21:52:56.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T21:52:56.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: Cluster is now healthy 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: fsmap cephfs:1 {0=cephfs.smithi119.rpmijj=up:active} 3 up:standby 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi119.yydzwt=up:starting} 2 up:standby 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: daemon mds.cephfs.smithi119.yydzwt is now active in filesystem cephfs as rank 1 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:52:56.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:56.632 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:56 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:52:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:57 smithi119 ceph-mon[90896]: Upgrade: Setting container_image for all rgw 2024-09-13T21:52:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:57 smithi119 ceph-mon[90896]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T21:52:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:57 smithi119 ceph-mon[90896]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T21:52:57.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:57 smithi119 ceph-mon[90896]: Upgrade: Setting container_image for all iscsi 2024-09-13T21:52:57.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:57 smithi119 ceph-mon[90896]: Upgrade: Setting container_image for all nfs 2024-09-13T21:52:57.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:57 smithi119 ceph-mon[90896]: Upgrade: Setting container_image for all nvmeof 2024-09-13T21:52:57.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:57 smithi119 ceph-mon[90896]: pgmap v219: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 344 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-13T21:52:57.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:57 smithi119 ceph-mon[90896]: mds.? [v2:172.21.15.119:6828/3559937126,v1:172.21.15.119:6829/3559937126] up:active 2024-09-13T21:52:57.631 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:57 smithi119 ceph-mon[90896]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi119.yydzwt=up:active} 2 up:standby 2024-09-13T21:52:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:57 smithi155 ceph-mon[79928]: Upgrade: Setting container_image for all rgw 2024-09-13T21:52:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:57 smithi155 ceph-mon[79928]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T21:52:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:57 smithi155 ceph-mon[79928]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T21:52:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:57 smithi155 ceph-mon[79928]: Upgrade: Setting container_image for all iscsi 2024-09-13T21:52:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:57 smithi155 ceph-mon[79928]: Upgrade: Setting container_image for all nfs 2024-09-13T21:52:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:57 smithi155 ceph-mon[79928]: Upgrade: Setting container_image for all nvmeof 2024-09-13T21:52:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:57 smithi155 ceph-mon[79928]: pgmap v219: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 344 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-13T21:52:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:57 smithi155 ceph-mon[79928]: mds.? [v2:172.21.15.119:6828/3559937126,v1:172.21.15.119:6829/3559937126] up:active 2024-09-13T21:52:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:57 smithi155 ceph-mon[79928]: fsmap cephfs:2 {0=cephfs.smithi119.rpmijj=up:active,1=cephfs.smithi119.yydzwt=up:active} 2 up:standby 2024-09-13T21:52:58.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:58 smithi119 ceph-mon[90896]: Upgrade: Updating grafana.smithi119 2024-09-13T21:52:58.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:58 smithi119 ceph-mon[90896]: Deploying daemon grafana.smithi119 on smithi119 2024-09-13T21:52:58.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:58 smithi155 ceph-mon[79928]: Upgrade: Updating grafana.smithi119 2024-09-13T21:52:58.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:58 smithi155 ceph-mon[79928]: Deploying daemon grafana.smithi119 on smithi119 2024-09-13T21:52:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:52:59 smithi119 ceph-mon[90896]: pgmap v220: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 5.1 KiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T21:52:59.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:52:59 smithi155 ceph-mon[79928]: pgmap v220: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 5.1 KiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T21:53:01.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:01 smithi119 ceph-mon[90896]: pgmap v221: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 9.2 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-13T21:53:01.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:01 smithi155 ceph-mon[79928]: pgmap v221: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 9.2 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-13T21:53:03.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:03 smithi119 ceph-mon[90896]: pgmap v222: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T21:53:03.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:03 smithi155 ceph-mon[79928]: pgmap v222: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T21:53:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:05 smithi119 ceph-mon[90896]: pgmap v223: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T21:53:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:05 smithi155 ceph-mon[79928]: pgmap v223: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T21:53:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:07 smithi119 ceph-mon[90896]: pgmap v224: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T21:53:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:53:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:07 smithi155 ceph-mon[79928]: pgmap v224: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T21:53:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:53:09.511 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:09 smithi119 ceph-mon[90896]: pgmap v225: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T21:53:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:09 smithi155 ceph-mon[79928]: pgmap v225: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T21:53:11.542 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:11 smithi119 ceph-mon[90896]: pgmap v226: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:53:11.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:11 smithi155 ceph-mon[79928]: pgmap v226: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T21:53:12.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:12 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:12.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:12 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:12.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:12 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:53:12.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:12 smithi155 ceph-mon[79928]: pgmap v227: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:12.853 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:12 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:12.853 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:12 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:12.853 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:12 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:53:12.853 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:12 smithi119 ceph-mon[90896]: pgmap v227: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:15.518 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:15 smithi119 ceph-mon[90896]: pgmap v228: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:15.536 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:15 smithi155 ceph-mon[79928]: pgmap v228: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:17.552 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:17 smithi119 ceph-mon[90896]: pgmap v229: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:17.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:17 smithi155 ceph-mon[79928]: pgmap v229: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:19.403 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:19 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:19.403 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:19 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:19.404 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:19 smithi119 ceph-mon[90896]: pgmap v230: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:19.404 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:19 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:19.404 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:19 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:19 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:19 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:19 smithi155 ceph-mon[79928]: pgmap v230: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:19 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:19.584 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:19 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:21.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.310+0000 7fce3a974640 1 -- 172.21.15.119:0/315915371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce340fc700 msgr2=0x7fce340fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:21.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.310+0000 7fce3a974640 1 --2- 172.21.15.119:0/315915371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce340fc700 0x7fce340fcb70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fce280048d0 tx=0x7fce28009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.310+0000 7fce3a974640 1 -- 172.21.15.119:0/315915371 shutdown_connections 2024-09-13T21:53:21.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.310+0000 7fce3a974640 1 --2- 172.21.15.119:0/315915371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce340fc700 0x7fce340fcb70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.310+0000 7fce3a974640 1 --2- 172.21.15.119:0/315915371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340fb430 0x7fce340fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.310+0000 7fce3a974640 1 -- 172.21.15.119:0/315915371 >> 172.21.15.119:0/315915371 conn(0x7fce340f6c10 msgr2=0x7fce340f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:21.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.310+0000 7fce3a974640 1 -- 172.21.15.119:0/315915371 shutdown_connections 2024-09-13T21:53:21.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.310+0000 7fce3a974640 1 -- 172.21.15.119:0/315915371 wait complete. 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.311+0000 7fce3a974640 1 Processor -- start 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.311+0000 7fce3a974640 1 -- start start 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.311+0000 7fce3a974640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340fb430 0x7fce3410f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.311+0000 7fce3a974640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce340fc700 0x7fce3410f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.311+0000 7fce3a974640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3410fe00 con 0x7fce340fc700 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.311+0000 7fce3a974640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce34110620 con 0x7fce340fb430 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.311+0000 7fce337fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce340fc700 0x7fce3410f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.311+0000 7fce337fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce340fc700 0x7fce3410f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47534/0 (socket says 172.21.15.119:47534) 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.311+0000 7fce337fe640 1 -- 172.21.15.119:0/2008354926 learned_addr learned my addr 172.21.15.119:0/2008354926 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.311+0000 7fce33fff640 1 --2- 172.21.15.119:0/2008354926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340fb430 0x7fce3410f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.312+0000 7fce337fe640 1 -- 172.21.15.119:0/2008354926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340fb430 msgr2=0x7fce3410f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.312+0000 7fce337fe640 1 --2- 172.21.15.119:0/2008354926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340fb430 0x7fce3410f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.312+0000 7fce337fe640 1 -- 172.21.15.119:0/2008354926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce28005040 con 0x7fce340fc700 2024-09-13T21:53:21.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.312+0000 7fce337fe640 1 --2- 172.21.15.119:0/2008354926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce340fc700 0x7fce3410f7b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fce280043d0 tx=0x7fce28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:21.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.312+0000 7fce30ff9640 1 -- 172.21.15.119:0/2008354926 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce28038070 con 0x7fce340fc700 2024-09-13T21:53:21.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.312+0000 7fce30ff9640 1 -- 172.21.15.119:0/2008354926 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce2802ae90 con 0x7fce340fc700 2024-09-13T21:53:21.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.312+0000 7fce3a974640 1 -- 172.21.15.119:0/2008354926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce34110850 con 0x7fce340fc700 2024-09-13T21:53:21.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.312+0000 7fce30ff9640 1 -- 172.21.15.119:0/2008354926 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce2803e670 con 0x7fce340fc700 2024-09-13T21:53:21.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.312+0000 7fce3a974640 1 -- 172.21.15.119:0/2008354926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce34110df0 con 0x7fce340fc700 2024-09-13T21:53:21.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.313+0000 7fce3a974640 1 -- 172.21.15.119:0/2008354926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce340fa890 con 0x7fce340fc700 2024-09-13T21:53:21.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.314+0000 7fce30ff9640 1 -- 172.21.15.119:0/2008354926 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fce28030020 con 0x7fce340fc700 2024-09-13T21:53:21.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.314+0000 7fce30ff9640 1 --2- 172.21.15.119:0/2008354926 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fce1c06e530 0x7fce1c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:21.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.314+0000 7fce30ff9640 1 -- 172.21.15.119:0/2008354926 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fce280ae440 con 0x7fce340fc700 2024-09-13T21:53:21.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.314+0000 7fce33fff640 1 --2- 172.21.15.119:0/2008354926 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fce1c06e530 0x7fce1c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:21.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.315+0000 7fce33fff640 1 --2- 172.21.15.119:0/2008354926 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fce1c06e530 0x7fce1c0709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fce24007fd0 tx=0x7fce24009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:21.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.321+0000 7fce30ff9640 1 -- 172.21.15.119:0/2008354926 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fce280774d0 con 0x7fce340fc700 2024-09-13T21:53:21.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.525+0000 7fce3a974640 1 -- 172.21.15.119:0/2008354926 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce34103ec0 con 0x7fce1c06e530 2024-09-13T21:53:21.526 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:21 smithi119 ceph-mon[90896]: pgmap v231: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:21.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.526+0000 7fce30ff9640 1 -- 172.21.15.119:0/2008354926 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fce34103ec0 con 0x7fce1c06e530 2024-09-13T21:53:21.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.528+0000 7fce3a974640 1 -- 172.21.15.119:0/2008354926 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fce1c06e530 msgr2=0x7fce1c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:21.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.528+0000 7fce3a974640 1 --2- 172.21.15.119:0/2008354926 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fce1c06e530 0x7fce1c0709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fce24007fd0 tx=0x7fce24009e90 comp rx=0 tx=0).stop 2024-09-13T21:53:21.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.528+0000 7fce3a974640 1 -- 172.21.15.119:0/2008354926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce340fc700 msgr2=0x7fce3410f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:21.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.528+0000 7fce3a974640 1 --2- 172.21.15.119:0/2008354926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce340fc700 0x7fce3410f7b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fce280043d0 tx=0x7fce28009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.528+0000 7fce3a974640 1 -- 172.21.15.119:0/2008354926 shutdown_connections 2024-09-13T21:53:21.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.528+0000 7fce3a974640 1 --2- 172.21.15.119:0/2008354926 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fce1c06e530 0x7fce1c0709e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.528+0000 7fce3a974640 1 --2- 172.21.15.119:0/2008354926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce340fc700 0x7fce3410f7b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.528+0000 7fce3a974640 1 --2- 172.21.15.119:0/2008354926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340fb430 0x7fce3410f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.528+0000 7fce3a974640 1 -- 172.21.15.119:0/2008354926 >> 172.21.15.119:0/2008354926 conn(0x7fce340f6c10 msgr2=0x7fce34065610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:21.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.528+0000 7fce3a974640 1 -- 172.21.15.119:0/2008354926 shutdown_connections 2024-09-13T21:53:21.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.528+0000 7fce3a974640 1 -- 172.21.15.119:0/2008354926 wait complete. 2024-09-13T21:53:21.538 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:53:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:21 smithi155 ceph-mon[79928]: pgmap v231: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:21.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.608+0000 7f2d6321e640 1 -- 172.21.15.119:0/2632015296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d5c0fd820 msgr2=0x7f2d5c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:21.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.608+0000 7f2d6321e640 1 --2- 172.21.15.119:0/2632015296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d5c0fd820 0x7f2d5c0fdc90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0048d0 tx=0x7f2d4c009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.608+0000 7f2d6321e640 1 -- 172.21.15.119:0/2632015296 shutdown_connections 2024-09-13T21:53:21.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.608+0000 7f2d6321e640 1 --2- 172.21.15.119:0/2632015296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d5c0fd820 0x7f2d5c0fdc90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.608+0000 7f2d6321e640 1 --2- 172.21.15.119:0/2632015296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d5c0fc550 0x7f2d5c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.608+0000 7f2d6321e640 1 -- 172.21.15.119:0/2632015296 >> 172.21.15.119:0/2632015296 conn(0x7f2d5c0f7d30 msgr2=0x7f2d5c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:21.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.608+0000 7f2d6321e640 1 -- 172.21.15.119:0/2632015296 shutdown_connections 2024-09-13T21:53:21.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.608+0000 7f2d6321e640 1 -- 172.21.15.119:0/2632015296 wait complete. 2024-09-13T21:53:21.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.609+0000 7f2d6321e640 1 Processor -- start 2024-09-13T21:53:21.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.609+0000 7f2d6321e640 1 -- start start 2024-09-13T21:53:21.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.609+0000 7f2d6321e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d5c0fc550 0x7f2d5c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.609+0000 7f2d6321e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d5c0fd820 0x7f2d5c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.609+0000 7f2d6321e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c10dc40 con 0x7f2d5c0fc550 2024-09-13T21:53:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.609+0000 7f2d6321e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c10e460 con 0x7f2d5c0fd820 2024-09-13T21:53:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d60fba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d5c0fc550 0x7f2d5c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d60fba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d5c0fc550 0x7f2d5c10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47566/0 (socket says 172.21.15.119:47566) 2024-09-13T21:53:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d60fba640 1 -- 172.21.15.119:0/526402163 learned_addr learned my addr 172.21.15.119:0/526402163 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:53:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d5bfff640 1 --2- 172.21.15.119:0/526402163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d5c0fd820 0x7f2d5c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d60fba640 1 -- 172.21.15.119:0/526402163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d5c0fd820 msgr2=0x7f2d5c10d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d60fba640 1 --2- 172.21.15.119:0/526402163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d5c0fd820 0x7f2d5c10d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d60fba640 1 -- 172.21.15.119:0/526402163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c005040 con 0x7f2d5c0fc550 2024-09-13T21:53:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d60fba640 1 --2- 172.21.15.119:0/526402163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d5c0fc550 0x7f2d5c10d0b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400db00 tx=0x7f2d54004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:21.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d597fa640 1 -- 172.21.15.119:0/526402163 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d54017070 con 0x7f2d5c0fc550 2024-09-13T21:53:21.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d597fa640 1 -- 172.21.15.119:0/526402163 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2d5400f040 con 0x7f2d5c0fc550 2024-09-13T21:53:21.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d6321e640 1 -- 172.21.15.119:0/526402163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c10e6f0 con 0x7f2d5c0fc550 2024-09-13T21:53:21.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d6321e640 1 -- 172.21.15.119:0/526402163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c10ec90 con 0x7f2d5c0fc550 2024-09-13T21:53:21.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.610+0000 7f2d597fa640 1 -- 172.21.15.119:0/526402163 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d54003960 con 0x7f2d5c0fc550 2024-09-13T21:53:21.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.612+0000 7f2d6321e640 1 -- 172.21.15.119:0/526402163 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c0fb9b0 con 0x7f2d5c0fc550 2024-09-13T21:53:21.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.612+0000 7f2d597fa640 1 -- 172.21.15.119:0/526402163 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2d54003ac0 con 0x7f2d5c0fc550 2024-09-13T21:53:21.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.612+0000 7f2d597fa640 1 --2- 172.21.15.119:0/526402163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2d4806e530 0x7f2d480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:21.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.613+0000 7f2d597fa640 1 -- 172.21.15.119:0/526402163 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f2d5408e190 con 0x7f2d5c0fc550 2024-09-13T21:53:21.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.613+0000 7f2d5bfff640 1 --2- 172.21.15.119:0/526402163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2d4806e530 0x7f2d480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:21.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.613+0000 7f2d5bfff640 1 --2- 172.21.15.119:0/526402163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2d4806e530 0x7f2d480709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c007ac0 tx=0x7f2d4c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:21.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.617+0000 7f2d597fa640 1 -- 172.21.15.119:0/526402163 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2d540572a0 con 0x7f2d5c0fc550 2024-09-13T21:53:21.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.801+0000 7f2d6321e640 1 -- 172.21.15.119:0/526402163 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d5c10f030 con 0x7f2d4806e530 2024-09-13T21:53:21.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.802+0000 7f2d597fa640 1 -- 172.21.15.119:0/526402163 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f2d5c10f030 con 0x7f2d4806e530 2024-09-13T21:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.804+0000 7f2d6321e640 1 -- 172.21.15.119:0/526402163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2d4806e530 msgr2=0x7f2d480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.804+0000 7f2d6321e640 1 --2- 172.21.15.119:0/526402163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2d4806e530 0x7f2d480709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c007ac0 tx=0x7f2d4c035040 comp rx=0 tx=0).stop 2024-09-13T21:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.804+0000 7f2d6321e640 1 -- 172.21.15.119:0/526402163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d5c0fc550 msgr2=0x7f2d5c10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.804+0000 7f2d6321e640 1 --2- 172.21.15.119:0/526402163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d5c0fc550 0x7f2d5c10d0b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400db00 tx=0x7f2d54004e60 comp rx=0 tx=0).stop 2024-09-13T21:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.804+0000 7f2d6321e640 1 -- 172.21.15.119:0/526402163 shutdown_connections 2024-09-13T21:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.804+0000 7f2d6321e640 1 --2- 172.21.15.119:0/526402163 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f2d4806e530 0x7f2d480709e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.804+0000 7f2d6321e640 1 --2- 172.21.15.119:0/526402163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d5c0fd820 0x7f2d5c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.804+0000 7f2d6321e640 1 --2- 172.21.15.119:0/526402163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d5c0fc550 0x7f2d5c10d0b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.804+0000 7f2d6321e640 1 -- 172.21.15.119:0/526402163 >> 172.21.15.119:0/526402163 conn(0x7f2d5c0f7d30 msgr2=0x7f2d5c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.804+0000 7f2d6321e640 1 -- 172.21.15.119:0/526402163 shutdown_connections 2024-09-13T21:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.804+0000 7f2d6321e640 1 -- 172.21.15.119:0/526402163 wait complete. 2024-09-13T21:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.883+0000 7f9f70f7c640 1 -- 172.21.15.119:0/1354662049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f6c0fd3b0 msgr2=0x7f9f6c0fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.883+0000 7f9f70f7c640 1 --2- 172.21.15.119:0/1354662049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f6c0fd3b0 0x7f9f6c0fb7e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0048d0 tx=0x7f9f5c009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.883+0000 7f9f70f7c640 1 -- 172.21.15.119:0/1354662049 shutdown_connections 2024-09-13T21:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.883+0000 7f9f70f7c640 1 --2- 172.21.15.119:0/1354662049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f6c0fd3b0 0x7f9f6c0fb7e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.883+0000 7f9f70f7c640 1 --2- 172.21.15.119:0/1354662049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c0fca60 0x7f9f6c0fce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.883+0000 7f9f70f7c640 1 -- 172.21.15.119:0/1354662049 >> 172.21.15.119:0/1354662049 conn(0x7f9f6c0f63a0 msgr2=0x7f9f6c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.883+0000 7f9f70f7c640 1 -- 172.21.15.119:0/1354662049 shutdown_connections 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.883+0000 7f9f70f7c640 1 -- 172.21.15.119:0/1354662049 wait complete. 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f70f7c640 1 Processor -- start 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f70f7c640 1 -- start start 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f70f7c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c0fca60 0x7f9f6c0ff640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f70f7c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f6c0fd3b0 0x7f9f6c0fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f70f7c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c0fe150 con 0x7f9f6c0fd3b0 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f70f7c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c0fe290 con 0x7f9f6c0fca60 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f69d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f6c0fd3b0 0x7f9f6c0fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f69d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f6c0fd3b0 0x7f9f6c0fdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47592/0 (socket says 172.21.15.119:47592) 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f69d9b640 1 -- 172.21.15.119:0/3052764785 learned_addr learned my addr 172.21.15.119:0/3052764785 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f6a59c640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c0fca60 0x7f9f6c0ff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f69d9b640 1 -- 172.21.15.119:0/3052764785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c0fca60 msgr2=0x7f9f6c0ff640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f69d9b640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c0fca60 0x7f9f6c0ff640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f69d9b640 1 -- 172.21.15.119:0/3052764785 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c005040 con 0x7f9f6c0fd3b0 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f6a59c640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c0fca60 0x7f9f6c0ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.884+0000 7f9f69d9b640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f6c0fd3b0 0x7f9f6c0fdb30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c003080 tx=0x7f9f5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.885+0000 7f9f5affd640 1 -- 172.21.15.119:0/3052764785 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f5c038070 con 0x7f9f6c0fd3b0 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.885+0000 7f9f5affd640 1 -- 172.21.15.119:0/3052764785 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9f5c02abd0 con 0x7f9f6c0fd3b0 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.885+0000 7f9f70f7c640 1 -- 172.21.15.119:0/3052764785 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c0fe510 con 0x7f9f6c0fd3b0 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.885+0000 7f9f5affd640 1 -- 172.21.15.119:0/3052764785 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f5c03e670 con 0x7f9f6c0fd3b0 2024-09-13T21:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.885+0000 7f9f70f7c640 1 -- 172.21.15.119:0/3052764785 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6c115160 con 0x7f9f6c0fd3b0 2024-09-13T21:53:21.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.886+0000 7f9f70f7c640 1 -- 172.21.15.119:0/3052764785 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6c04b720 con 0x7f9f6c0fd3b0 2024-09-13T21:53:21.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.886+0000 7f9f5affd640 1 -- 172.21.15.119:0/3052764785 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9f5c030020 con 0x7f9f6c0fd3b0 2024-09-13T21:53:21.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.886+0000 7f9f5affd640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9f5406e530 0x7f9f540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:21.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.887+0000 7f9f5affd640 1 -- 172.21.15.119:0/3052764785 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9f5c0ae5c0 con 0x7f9f6c0fd3b0 2024-09-13T21:53:21.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.887+0000 7f9f6a59c640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9f5406e530 0x7f9f540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:21.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.887+0000 7f9f6a59c640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9f5406e530 0x7f9f540709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f60006fd0 tx=0x7f9f60008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:21.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:21.891+0000 7f9f5affd640 1 -- 172.21.15.119:0/3052764785 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9f5c077650 con 0x7f9f6c0fd3b0 2024-09-13T21:53:22.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.070+0000 7f9f70f7c640 1 -- 172.21.15.119:0/3052764785 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f6c104060 con 0x7f9f5406e530 2024-09-13T21:53:22.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.080+0000 7f9f5affd640 1 -- 172.21.15.119:0/3052764785 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f9f6c104060 con 0x7f9f5406e530 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (7m) 3s ago 16m 25.0M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (5m) 3s ago 16m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (5m) 31s ago 15m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (11s) 3s ago 16m 48.1M - 9.4.12 2bacad6d85d8 26300ca517fb 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (90s) 3s ago 11m 60.7M - 19.1.1-324-gecab7be5 0652ff2b5d78 a39ea5706ead 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (70s) 3s ago 11m 18.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 1d784af814a8 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (34s) 31s ago 10m 13.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 ab72fe18d1ff 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (55s) 31s ago 11m 16.7M - 19.1.1-324-gecab7be5 0652ff2b5d78 886302ecfbf8 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (7m) 3s ago 17m 515M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (6m) 31s ago 15m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (6m) 3s ago 17m 53.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:53:22.082 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (6m) 31s ago 15m 40.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:53:22.083 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (8m) 3s ago 16m 16.5M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:53:22.083 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (7m) 31s ago 15m 15.0M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:53:22.083 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (5m) 3s ago 14m 104M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:53:22.083 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (4m) 3s ago 14m 107M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 8f69bf25cd20 2024-09-13T21:53:22.083 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (4m) 3s ago 13m 96.5M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 0f73e4fc2c43 2024-09-13T21:53:22.083 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (3m) 31s ago 13m 116M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5a7f5a9c1c4d 2024-09-13T21:53:22.083 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (3m) 31s ago 13m 109M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 03c992670291 2024-09-13T21:53:22.083 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (2m) 31s ago 12m 93.5M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 bf54ed40f20f 2024-09-13T21:53:22.083 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (6m) 3s ago 15m 65.8M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:53:22.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.082+0000 7f9f70f7c640 1 -- 172.21.15.119:0/3052764785 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9f5406e530 msgr2=0x7f9f540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.082+0000 7f9f70f7c640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9f5406e530 0x7f9f540709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f60006fd0 tx=0x7f9f60008040 comp rx=0 tx=0).stop 2024-09-13T21:53:22.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.082+0000 7f9f70f7c640 1 -- 172.21.15.119:0/3052764785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f6c0fd3b0 msgr2=0x7f9f6c0fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.082+0000 7f9f70f7c640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f6c0fd3b0 0x7f9f6c0fdb30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c003080 tx=0x7f9f5c009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.082+0000 7f9f70f7c640 1 -- 172.21.15.119:0/3052764785 shutdown_connections 2024-09-13T21:53:22.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.082+0000 7f9f70f7c640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9f5406e530 0x7f9f540709e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.082+0000 7f9f70f7c640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f6c0fd3b0 0x7f9f6c0fdb30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.082+0000 7f9f70f7c640 1 --2- 172.21.15.119:0/3052764785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c0fca60 0x7f9f6c0ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.082+0000 7f9f70f7c640 1 -- 172.21.15.119:0/3052764785 >> 172.21.15.119:0/3052764785 conn(0x7f9f6c0f63a0 msgr2=0x7f9f6c0fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:22.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.083+0000 7f9f70f7c640 1 -- 172.21.15.119:0/3052764785 shutdown_connections 2024-09-13T21:53:22.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.083+0000 7f9f70f7c640 1 -- 172.21.15.119:0/3052764785 wait complete. 2024-09-13T21:53:22.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.165+0000 7f1315200640 1 -- 172.21.15.119:0/2146964272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13100fc3b0 msgr2=0x7f13100fc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.165+0000 7f1315200640 1 --2- 172.21.15.119:0/2146964272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13100fc3b0 0x7f13100fc7c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13000048d0 tx=0x7f1300009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.166+0000 7f1315200640 1 -- 172.21.15.119:0/2146964272 shutdown_connections 2024-09-13T21:53:22.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.166+0000 7f1315200640 1 --2- 172.21.15.119:0/2146964272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100fd680 0x7f13100fdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.166+0000 7f1315200640 1 --2- 172.21.15.119:0/2146964272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13100fc3b0 0x7f13100fc7c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.166+0000 7f1315200640 1 -- 172.21.15.119:0/2146964272 >> 172.21.15.119:0/2146964272 conn(0x7f13100f7b70 msgr2=0x7f13100f9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:22.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.166+0000 7f1315200640 1 -- 172.21.15.119:0/2146964272 shutdown_connections 2024-09-13T21:53:22.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.166+0000 7f1315200640 1 -- 172.21.15.119:0/2146964272 wait complete. 2024-09-13T21:53:22.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.166+0000 7f1315200640 1 Processor -- start 2024-09-13T21:53:22.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.166+0000 7f1315200640 1 -- start start 2024-09-13T21:53:22.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f1315200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100fc3b0 0x7f131010cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:22.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f1315200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13100fd680 0x7f131010d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:22.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f1315200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131010e2f0 con 0x7f13100fd680 2024-09-13T21:53:22.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f1315200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131010e460 con 0x7f13100fc3b0 2024-09-13T21:53:22.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f130e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13100fd680 0x7f131010d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:22.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f130e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13100fd680 0x7f131010d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47608/0 (socket says 172.21.15.119:47608) 2024-09-13T21:53:22.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f130e59c640 1 -- 172.21.15.119:0/470232330 learned_addr learned my addr 172.21.15.119:0/470232330 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:53:22.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f130ed9d640 1 --2- 172.21.15.119:0/470232330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100fc3b0 0x7f131010cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:22.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f130e59c640 1 -- 172.21.15.119:0/470232330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100fc3b0 msgr2=0x7f131010cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f130e59c640 1 --2- 172.21.15.119:0/470232330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100fc3b0 0x7f131010cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f130e59c640 1 -- 172.21.15.119:0/470232330 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300005040 con 0x7f13100fd680 2024-09-13T21:53:22.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.167+0000 7f130e59c640 1 --2- 172.21.15.119:0/470232330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13100fd680 0x7f131010d480 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f130400b790 tx=0x7f13040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:22.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.169+0000 7f12f77fe640 1 -- 172.21.15.119:0/470232330 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f130400c700 con 0x7f13100fd680 2024-09-13T21:53:22.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.169+0000 7f1315200640 1 -- 172.21.15.119:0/470232330 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131010e740 con 0x7f13100fd680 2024-09-13T21:53:22.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.169+0000 7f12f77fe640 1 -- 172.21.15.119:0/470232330 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f130400cd00 con 0x7f13100fd680 2024-09-13T21:53:22.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.169+0000 7f12f77fe640 1 -- 172.21.15.119:0/470232330 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1304015e80 con 0x7f13100fd680 2024-09-13T21:53:22.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.170+0000 7f1315200640 1 -- 172.21.15.119:0/470232330 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131010ec60 con 0x7f13100fd680 2024-09-13T21:53:22.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.171+0000 7f1315200640 1 -- 172.21.15.119:0/470232330 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13100fb810 con 0x7f13100fd680 2024-09-13T21:53:22.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.171+0000 7f12f77fe640 1 -- 172.21.15.119:0/470232330 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1304012070 con 0x7f13100fd680 2024-09-13T21:53:22.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.172+0000 7f12f77fe640 1 --2- 172.21.15.119:0/470232330 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f12f806e530 0x7f12f80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:22.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.172+0000 7f12f77fe640 1 -- 172.21.15.119:0/470232330 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f130408dab0 con 0x7f13100fd680 2024-09-13T21:53:22.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.172+0000 7f130ed9d640 1 --2- 172.21.15.119:0/470232330 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f12f806e530 0x7f12f80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:22.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.172+0000 7f130ed9d640 1 --2- 172.21.15.119:0/470232330 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f12f806e530 0x7f12f80709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1300000c00 tx=0x7f1300035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:22.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.176+0000 7f12f77fe640 1 -- 172.21.15.119:0/470232330 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f130408fe60 con 0x7f13100fd680 2024-09-13T21:53:22.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.434+0000 7f1315200640 1 -- 172.21.15.119:0/470232330 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f131004b720 con 0x7f13100fd680 2024-09-13T21:53:22.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.434+0000 7f12f77fe640 1 -- 172.21.15.119:0/470232330 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f1304056b20 con 0x7f13100fd680 2024-09-13T21:53:22.436 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:53:22.436 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:53:22.436 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:53:22.436 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:53:22.436 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:53:22.436 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:53:22.436 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:53:22.436 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:53:22.436 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:53:22.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:53:22.437 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:53:22.437 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:53:22.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:53:22.437 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:53:22.437 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T21:53:22.437 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:53:22.437 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:53:22.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.436+0000 7f1315200640 1 -- 172.21.15.119:0/470232330 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f12f806e530 msgr2=0x7f12f80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.436+0000 7f1315200640 1 --2- 172.21.15.119:0/470232330 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f12f806e530 0x7f12f80709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1300000c00 tx=0x7f1300035040 comp rx=0 tx=0).stop 2024-09-13T21:53:22.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.436+0000 7f1315200640 1 -- 172.21.15.119:0/470232330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13100fd680 msgr2=0x7f131010d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.436+0000 7f1315200640 1 --2- 172.21.15.119:0/470232330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13100fd680 0x7f131010d480 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f130400b790 tx=0x7f13040091d0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.436+0000 7f1315200640 1 -- 172.21.15.119:0/470232330 shutdown_connections 2024-09-13T21:53:22.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.436+0000 7f1315200640 1 --2- 172.21.15.119:0/470232330 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f12f806e530 0x7f12f80709e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.436+0000 7f1315200640 1 --2- 172.21.15.119:0/470232330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13100fd680 0x7f131010d480 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.436+0000 7f1315200640 1 --2- 172.21.15.119:0/470232330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100fc3b0 0x7f131010cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.436+0000 7f1315200640 1 -- 172.21.15.119:0/470232330 >> 172.21.15.119:0/470232330 conn(0x7f13100f7b70 msgr2=0x7f13100f9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:22.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.436+0000 7f1315200640 1 -- 172.21.15.119:0/470232330 shutdown_connections 2024-09-13T21:53:22.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.437+0000 7f1315200640 1 -- 172.21.15.119:0/470232330 wait complete. 2024-09-13T21:53:22.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.515+0000 7f95c77f0640 1 -- 172.21.15.119:0/618038973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c00fe500 msgr2=0x7f95c00fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.515+0000 7f95c77f0640 1 --2- 172.21.15.119:0/618038973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c00fe500 0x7f95c00fa660 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95b00048d0 tx=0x7f95b0009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.515+0000 7f95c77f0640 1 -- 172.21.15.119:0/618038973 shutdown_connections 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.515+0000 7f95c77f0640 1 --2- 172.21.15.119:0/618038973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c00fe500 0x7f95c00fa660 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.515+0000 7f95c77f0640 1 --2- 172.21.15.119:0/618038973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fdbb0 0x7f95c00fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.515+0000 7f95c77f0640 1 -- 172.21.15.119:0/618038973 >> 172.21.15.119:0/618038973 conn(0x7f95c00f63b0 msgr2=0x7f95c00f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.515+0000 7f95c77f0640 1 -- 172.21.15.119:0/618038973 shutdown_connections 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.516+0000 7f95c77f0640 1 -- 172.21.15.119:0/618038973 wait complete. 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.516+0000 7f95c77f0640 1 Processor -- start 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.516+0000 7f95c77f0640 1 -- start start 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.516+0000 7f95c77f0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c00fdbb0 0x7f95c010d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.516+0000 7f95c77f0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fe500 0x7f95c010d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.516+0000 7f95c77f0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c010e4e0 con 0x7f95c00fdbb0 2024-09-13T21:53:22.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.516+0000 7f95c77f0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c010e650 con 0x7f95c00fe500 2024-09-13T21:53:22.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.516+0000 7f95c558c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c00fdbb0 0x7f95c010d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:22.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.516+0000 7f95c558c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c00fdbb0 0x7f95c010d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47614/0 (socket says 172.21.15.119:47614) 2024-09-13T21:53:22.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.516+0000 7f95c558c640 1 -- 172.21.15.119:0/2561367675 learned_addr learned my addr 172.21.15.119:0/2561367675 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:53:22.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.516+0000 7f95c4d8b640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fe500 0x7f95c010d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:22.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.517+0000 7f95c558c640 1 -- 172.21.15.119:0/2561367675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fe500 msgr2=0x7f95c010d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.517+0000 7f95c558c640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fe500 0x7f95c010d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.517+0000 7f95c558c640 1 -- 172.21.15.119:0/2561367675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0005040 con 0x7f95c00fdbb0 2024-09-13T21:53:22.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.517+0000 7f95c4d8b640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fe500 0x7f95c010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:53:22.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.517+0000 7f95c558c640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c00fdbb0 0x7f95c010d130 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00b560 tx=0x7f95bc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:22.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.517+0000 7f95b5ffb640 1 -- 172.21.15.119:0/2561367675 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95bc00f6f0 con 0x7f95c00fdbb0 2024-09-13T21:53:22.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.517+0000 7f95b5ffb640 1 -- 172.21.15.119:0/2561367675 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f95bc00fcf0 con 0x7f95c00fdbb0 2024-09-13T21:53:22.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.517+0000 7f95c77f0640 1 -- 172.21.15.119:0/2561367675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c010e930 con 0x7f95c00fdbb0 2024-09-13T21:53:22.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.517+0000 7f95b5ffb640 1 -- 172.21.15.119:0/2561367675 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95bc011ea0 con 0x7f95c00fdbb0 2024-09-13T21:53:22.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.517+0000 7f95c77f0640 1 -- 172.21.15.119:0/2561367675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c010eed0 con 0x7f95c00fdbb0 2024-09-13T21:53:22.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.518+0000 7f95c77f0640 1 -- 172.21.15.119:0/2561367675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c0105830 con 0x7f95c00fdbb0 2024-09-13T21:53:22.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.519+0000 7f95b5ffb640 1 -- 172.21.15.119:0/2561367675 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f95bc0116b0 con 0x7f95c00fdbb0 2024-09-13T21:53:22.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.519+0000 7f95b5ffb640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f95ac06e530 0x7f95ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:22.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.519+0000 7f95b5ffb640 1 -- 172.21.15.119:0/2561367675 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f95bc08dfc0 con 0x7f95c00fdbb0 2024-09-13T21:53:22.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.519+0000 7f95c4d8b640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f95ac06e530 0x7f95ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:22.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.520+0000 7f95c4d8b640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f95ac06e530 0x7f95ac0709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f95b0009ac0 tx=0x7f95b0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:22.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.523+0000 7f95b5ffb640 1 -- 172.21.15.119:0/2561367675 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f95bc0570d0 con 0x7f95c00fdbb0 2024-09-13T21:53:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.721+0000 7f95c77f0640 1 -- 172.21.15.119:0/2561367675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f95c010f150 con 0x7f95c00fdbb0 2024-09-13T21:53:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.722+0000 7f95b5ffb640 1 -- 172.21.15.119:0/2561367675 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 46 v46) v1 ==== 76+0+1997 (secure 0 0 0) 0x7f95bc05a790 con 0x7f95c00fdbb0 2024-09-13T21:53:22.724 INFO:teuthology.orchestra.run.smithi119.stdout:e46 2024-09-13T21:53:22.724 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:52:56:503534+0000 2024-09-13T21:53:22.724 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:53:22.724 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:53:22.724 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:53:22.724 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:53:22.724 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:53:22.724 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:53:22.725 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 46 2024-09-13T21:53:22.725 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:53:22.725 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:53:22.725 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:52:56.503526+0000 2024-09-13T21:53:22.725 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:53:22.725 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:53:22.725 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:53:22.725 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:53:22.725 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:53:22.725 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:53:22.725 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 81 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=34434,1=34438} 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:53:22.726 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:53:22.727 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:53:22.727 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:53:22.727 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 34434 members: 34434,34438 2024-09-13T21:53:22.727 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{0:34434} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:53:22.727 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{1:34438} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.119:6828/3559937126,v1:172.21.15.119:6829/3559937126] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:53:22.727 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:53:22.727 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:53:22.727 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:53:22.727 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:53:22.727 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.155:6824/2986837064,v1:172.21.15.155:6825/2986837064] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:53:22.727 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.155:6826/3721950377,v1:172.21.15.155:6827/3721950377] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:53:22.728 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 46 2024-09-13T21:53:22.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.724+0000 7f95c77f0640 1 -- 172.21.15.119:0/2561367675 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f95ac06e530 msgr2=0x7f95ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.724+0000 7f95c77f0640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f95ac06e530 0x7f95ac0709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f95b0009ac0 tx=0x7f95b0009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.724+0000 7f95c77f0640 1 -- 172.21.15.119:0/2561367675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c00fdbb0 msgr2=0x7f95c010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.724+0000 7f95c77f0640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c00fdbb0 0x7f95c010d130 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00b560 tx=0x7f95bc0090f0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.724+0000 7f95c77f0640 1 -- 172.21.15.119:0/2561367675 shutdown_connections 2024-09-13T21:53:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.724+0000 7f95c77f0640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f95ac06e530 0x7f95ac0709e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.724+0000 7f95c77f0640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c00fe500 0x7f95c010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.724+0000 7f95c77f0640 1 --2- 172.21.15.119:0/2561367675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95c00fdbb0 0x7f95c010d130 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.724+0000 7f95c77f0640 1 -- 172.21.15.119:0/2561367675 >> 172.21.15.119:0/2561367675 conn(0x7f95c00f63b0 msgr2=0x7f95c00f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.724+0000 7f95c77f0640 1 -- 172.21.15.119:0/2561367675 shutdown_connections 2024-09-13T21:53:22.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.724+0000 7f95c77f0640 1 -- 172.21.15.119:0/2561367675 wait complete. 2024-09-13T21:53:22.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.802+0000 7f5a22710640 1 -- 172.21.15.119:0/1674218759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a1c0fc720 msgr2=0x7f5a1c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.802+0000 7f5a22710640 1 --2- 172.21.15.119:0/1674218759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a1c0fc720 0x7f5a1c0fcb90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5a040048d0 tx=0x7f5a04009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.802+0000 7f5a22710640 1 -- 172.21.15.119:0/1674218759 shutdown_connections 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.802+0000 7f5a22710640 1 --2- 172.21.15.119:0/1674218759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a1c0fc720 0x7f5a1c0fcb90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.802+0000 7f5a22710640 1 --2- 172.21.15.119:0/1674218759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a1c0fb450 0x7f5a1c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.802+0000 7f5a22710640 1 -- 172.21.15.119:0/1674218759 >> 172.21.15.119:0/1674218759 conn(0x7f5a1c0f6c10 msgr2=0x7f5a1c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.802+0000 7f5a22710640 1 -- 172.21.15.119:0/1674218759 shutdown_connections 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.802+0000 7f5a22710640 1 -- 172.21.15.119:0/1674218759 wait complete. 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.802+0000 7f5a22710640 1 Processor -- start 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a22710640 1 -- start start 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a22710640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a1c0fb450 0x7f5a1c10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a22710640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a1c0fc720 0x7f5a1c10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a22710640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c10dc70 con 0x7f5a1c0fb450 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a22710640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c10e440 con 0x7f5a1c0fc720 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a1c0fb450 0x7f5a1c10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:22.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a1bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a1c0fb450 0x7f5a1c10d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47638/0 (socket says 172.21.15.119:47638) 2024-09-13T21:53:22.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a1bfff640 1 -- 172.21.15.119:0/1089859006 learned_addr learned my addr 172.21.15.119:0/1089859006 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:53:22.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a1bfff640 1 -- 172.21.15.119:0/1089859006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a1c0fc720 msgr2=0x7f5a1c10d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a1bfff640 1 --2- 172.21.15.119:0/1089859006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a1c0fc720 0x7f5a1c10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a1bfff640 1 -- 172.21.15.119:0/1089859006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04005040 con 0x7f5a1c0fb450 2024-09-13T21:53:22.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a1bfff640 1 --2- 172.21.15.119:0/1089859006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a1c0fb450 0x7f5a1c10d0e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c002a80 tx=0x7f5a0c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:22.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a18ff9640 1 -- 172.21.15.119:0/1089859006 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0c007c30 con 0x7f5a1c0fb450 2024-09-13T21:53:22.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a18ff9640 1 -- 172.21.15.119:0/1089859006 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5a0c00f040 con 0x7f5a1c0fb450 2024-09-13T21:53:22.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.804+0000 7f5a22710640 1 -- 172.21.15.119:0/1089859006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1c10e6d0 con 0x7f5a1c0fb450 2024-09-13T21:53:22.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.803+0000 7f5a18ff9640 1 -- 172.21.15.119:0/1089859006 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0c009530 con 0x7f5a1c0fb450 2024-09-13T21:53:22.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.804+0000 7f5a22710640 1 -- 172.21.15.119:0/1089859006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1c10ebf0 con 0x7f5a1c0fb450 2024-09-13T21:53:22.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.804+0000 7f5a22710640 1 -- 172.21.15.119:0/1089859006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1c0fa8b0 con 0x7f5a1c0fb450 2024-09-13T21:53:22.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.805+0000 7f5a18ff9640 1 -- 172.21.15.119:0/1089859006 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5a0c009690 con 0x7f5a1c0fb450 2024-09-13T21:53:22.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.805+0000 7f5a18ff9640 1 --2- 172.21.15.119:0/1089859006 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5a0806e530 0x7f5a080709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:22.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.806+0000 7f5a18ff9640 1 -- 172.21.15.119:0/1089859006 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f5a0c08db10 con 0x7f5a1c0fb450 2024-09-13T21:53:22.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.806+0000 7f5a1b7fe640 1 --2- 172.21.15.119:0/1089859006 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5a0806e530 0x7f5a080709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:22.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.806+0000 7f5a1b7fe640 1 --2- 172.21.15.119:0/1089859006 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5a0806e530 0x7f5a080709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5a0402a530 tx=0x7f5a04009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:22.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.810+0000 7f5a18ff9640 1 -- 172.21.15.119:0/1089859006 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5a0c056c20 con 0x7f5a1c0fb450 2024-09-13T21:53:22.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.990+0000 7f5a22710640 1 -- 172.21.15.119:0/1089859006 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a1c10ee60 con 0x7f5a0806e530 2024-09-13T21:53:22.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.991+0000 7f5a18ff9640 1 -- 172.21.15.119:0/1089859006 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f5a1c10ee60 con 0x7f5a0806e530 2024-09-13T21:53:22.993 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:53:22.993 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": null, 2024-09-13T21:53:22.993 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": false, 2024-09-13T21:53:22.993 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "", 2024-09-13T21:53:22.993 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [], 2024-09-13T21:53:22.993 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": null, 2024-09-13T21:53:22.993 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "", 2024-09-13T21:53:22.993 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:53:22.993 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:53:22.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.993+0000 7f5a22710640 1 -- 172.21.15.119:0/1089859006 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5a0806e530 msgr2=0x7f5a080709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.993+0000 7f5a22710640 1 --2- 172.21.15.119:0/1089859006 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5a0806e530 0x7f5a080709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5a0402a530 tx=0x7f5a04009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.993+0000 7f5a22710640 1 -- 172.21.15.119:0/1089859006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a1c0fb450 msgr2=0x7f5a1c10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:22.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.993+0000 7f5a22710640 1 --2- 172.21.15.119:0/1089859006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a1c0fb450 0x7f5a1c10d0e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c002a80 tx=0x7f5a0c004600 comp rx=0 tx=0).stop 2024-09-13T21:53:22.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.993+0000 7f5a22710640 1 -- 172.21.15.119:0/1089859006 shutdown_connections 2024-09-13T21:53:22.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.993+0000 7f5a22710640 1 --2- 172.21.15.119:0/1089859006 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f5a0806e530 0x7f5a080709e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.993+0000 7f5a22710640 1 --2- 172.21.15.119:0/1089859006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a1c0fc720 0x7f5a1c10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.993+0000 7f5a22710640 1 --2- 172.21.15.119:0/1089859006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a1c0fb450 0x7f5a1c10d0e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:22.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.993+0000 7f5a22710640 1 -- 172.21.15.119:0/1089859006 >> 172.21.15.119:0/1089859006 conn(0x7f5a1c0f6c10 msgr2=0x7f5a1c066100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:22.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.993+0000 7f5a22710640 1 -- 172.21.15.119:0/1089859006 shutdown_connections 2024-09-13T21:53:22.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:22.993+0000 7f5a22710640 1 -- 172.21.15.119:0/1089859006 wait complete. 2024-09-13T21:53:23.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.071+0000 7fa4727db640 1 -- 172.21.15.119:0/3783458945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46c065bc0 msgr2=0x7fa46c0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.071+0000 7fa4727db640 1 --2- 172.21.15.119:0/3783458945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46c065bc0 0x7fa46c0ff1c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa45c0048d0 tx=0x7fa45c009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.071+0000 7fa4727db640 1 -- 172.21.15.119:0/3783458945 shutdown_connections 2024-09-13T21:53:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.071+0000 7fa4727db640 1 --2- 172.21.15.119:0/3783458945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c0ff700 0x7fa46c101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.071+0000 7fa4727db640 1 --2- 172.21.15.119:0/3783458945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46c065bc0 0x7fa46c0ff1c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.071+0000 7fa4727db640 1 -- 172.21.15.119:0/3783458945 >> 172.21.15.119:0/3783458945 conn(0x7fa46c0f6c10 msgr2=0x7fa46c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.072+0000 7fa4727db640 1 -- 172.21.15.119:0/3783458945 shutdown_connections 2024-09-13T21:53:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.072+0000 7fa4727db640 1 -- 172.21.15.119:0/3783458945 wait complete. 2024-09-13T21:53:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.072+0000 7fa4727db640 1 Processor -- start 2024-09-13T21:53:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.072+0000 7fa4727db640 1 -- start start 2024-09-13T21:53:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.072+0000 7fa4727db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c065bc0 0x7fa46c10d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:23.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.072+0000 7fa4727db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46c0ff700 0x7fa46c10d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.072+0000 7fa4727db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c10e4c0 con 0x7fa46c0ff700 2024-09-13T21:53:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.072+0000 7fa4727db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c10e630 con 0x7fa46c065bc0 2024-09-13T21:53:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.072+0000 7fa46b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46c0ff700 0x7fa46c10d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa46b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46c0ff700 0x7fa46c10d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:47660/0 (socket says 172.21.15.119:47660) 2024-09-13T21:53:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa46b7fe640 1 -- 172.21.15.119:0/1845049753 learned_addr learned my addr 172.21.15.119:0/1845049753 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:53:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa46bfff640 1 --2- 172.21.15.119:0/1845049753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c065bc0 0x7fa46c10d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa46b7fe640 1 -- 172.21.15.119:0/1845049753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c065bc0 msgr2=0x7fa46c10d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa46b7fe640 1 --2- 172.21.15.119:0/1845049753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c065bc0 0x7fa46c10d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa46b7fe640 1 -- 172.21.15.119:0/1845049753 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c005040 con 0x7fa46c0ff700 2024-09-13T21:53:23.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa46b7fe640 1 --2- 172.21.15.119:0/1845049753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46c0ff700 0x7fa46c10d6a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa45400b580 tx=0x7fa4540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:23.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa468ff9640 1 -- 172.21.15.119:0/1845049753 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa45400f6f0 con 0x7fa46c0ff700 2024-09-13T21:53:23.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa4727db640 1 -- 172.21.15.119:0/1845049753 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c10e910 con 0x7fa46c0ff700 2024-09-13T21:53:23.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa468ff9640 1 -- 172.21.15.119:0/1845049753 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa45400fcf0 con 0x7fa46c0ff700 2024-09-13T21:53:23.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa468ff9640 1 -- 172.21.15.119:0/1845049753 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4540103a0 con 0x7fa46c0ff700 2024-09-13T21:53:23.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.073+0000 7fa4727db640 1 -- 172.21.15.119:0/1845049753 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c10ee30 con 0x7fa46c0ff700 2024-09-13T21:53:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.074+0000 7fa4727db640 1 -- 172.21.15.119:0/1845049753 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c0fa890 con 0x7fa46c0ff700 2024-09-13T21:53:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.075+0000 7fa468ff9640 1 -- 172.21.15.119:0/1845049753 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa4540116b0 con 0x7fa46c0ff700 2024-09-13T21:53:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.075+0000 7fa468ff9640 1 --2- 172.21.15.119:0/1845049753 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa45806e530 0x7fa4580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.075+0000 7fa468ff9640 1 -- 172.21.15.119:0/1845049753 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa45408e000 con 0x7fa46c0ff700 2024-09-13T21:53:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.075+0000 7fa46bfff640 1 --2- 172.21.15.119:0/1845049753 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa45806e530 0x7fa4580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:23.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.076+0000 7fa46bfff640 1 --2- 172.21.15.119:0/1845049753 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa45806e530 0x7fa4580709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa45c007ac0 tx=0x7fa45c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:23.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.079+0000 7fa468ff9640 1 -- 172.21.15.119:0/1845049753 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa45405ace0 con 0x7fa46c0ff700 2024-09-13T21:53:23.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.311+0000 7fa4727db640 1 -- 172.21.15.119:0/1845049753 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa46c04b720 con 0x7fa46c0ff700 2024-09-13T21:53:23.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.311+0000 7fa468ff9640 1 -- 172.21.15.119:0/1845049753 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa45405a870 con 0x7fa46c0ff700 2024-09-13T21:53:23.313 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:53:23.314 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:23.314 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:23.314 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.314 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.314 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:53:23.314 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:53:23.314 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.314 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.316 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.316 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.316 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.316 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.317 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.317 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.317 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.317 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.317 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.317 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:53:23.318 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: Upgrade: Finalizing container_image settings 2024-09-13T21:53:23.318 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.318 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T21:53:23.318 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T21:53:23.318 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.319 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T21:53:23.319 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T21:53:23.319 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T21:53:23.319 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T21:53:23.319 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T21:53:23.319 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T21:53:23.319 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T21:53:23.319 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T21:53:23.319 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T21:53:23.320 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T21:53:23.320 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: pgmap v232: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:23.320 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T21:53:23.320 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.320 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T21:53:23.320 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T21:53:23.320 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T21:53:23.321 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T21:53:23.321 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T21:53:23.321 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T21:53:23.321 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T21:53:23.321 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T21:53:23.321 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.322 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.322 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.322 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.322 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.322 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.323 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: Upgrade: Complete! 2024-09-13T21:53:23.323 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T21:53:23.323 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T21:53:23.323 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:53:23.323 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:53:23.323 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:53:23.323 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.323 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.323 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:53:23.324 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:53:23.324 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:53:23.324 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.324 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/470232330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.324 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:23 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2561367675' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:53:23.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.313+0000 7fa4727db640 1 -- 172.21.15.119:0/1845049753 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa45806e530 msgr2=0x7fa4580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:23.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.313+0000 7fa4727db640 1 --2- 172.21.15.119:0/1845049753 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa45806e530 0x7fa4580709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa45c007ac0 tx=0x7fa45c035040 comp rx=0 tx=0).stop 2024-09-13T21:53:23.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.313+0000 7fa4727db640 1 -- 172.21.15.119:0/1845049753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46c0ff700 msgr2=0x7fa46c10d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:23.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.313+0000 7fa4727db640 1 --2- 172.21.15.119:0/1845049753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46c0ff700 0x7fa46c10d6a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa45400b580 tx=0x7fa4540091a0 comp rx=0 tx=0).stop 2024-09-13T21:53:23.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.314+0000 7fa4727db640 1 -- 172.21.15.119:0/1845049753 shutdown_connections 2024-09-13T21:53:23.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.314+0000 7fa4727db640 1 --2- 172.21.15.119:0/1845049753 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa45806e530 0x7fa4580709e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:23.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.314+0000 7fa4727db640 1 --2- 172.21.15.119:0/1845049753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46c0ff700 0x7fa46c10d6a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:23.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.314+0000 7fa4727db640 1 --2- 172.21.15.119:0/1845049753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c065bc0 0x7fa46c10d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:23.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.314+0000 7fa4727db640 1 -- 172.21.15.119:0/1845049753 >> 172.21.15.119:0/1845049753 conn(0x7fa46c0f6c10 msgr2=0x7fa46c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:23.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.314+0000 7fa4727db640 1 -- 172.21.15.119:0/1845049753 shutdown_connections 2024-09-13T21:53:23.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:23.314+0000 7fa4727db640 1 -- 172.21.15.119:0/1845049753 wait complete. 2024-09-13T21:53:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.334 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.335 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:53:23.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: Upgrade: Finalizing container_image settings 2024-09-13T21:53:23.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T21:53:23.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T21:53:23.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T21:53:23.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T21:53:23.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T21:53:23.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T21:53:23.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T21:53:23.336 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T21:53:23.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T21:53:23.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T21:53:23.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T21:53:23.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T21:53:23.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: pgmap v232: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:23.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T21:53:23.337 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T21:53:23.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T21:53:23.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T21:53:23.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T21:53:23.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T21:53:23.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T21:53:23.338 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T21:53:23.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T21:53:23.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T21:53:23.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: Upgrade: Complete! 2024-09-13T21:53:23.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T21:53:23.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T21:53:23.339 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:53:23.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:53:23.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:53:23.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:53:23.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:53:23.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:53:23.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:53:23.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/470232330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:53:23.340 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:23 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2561367675' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:53:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:24 smithi155 ceph-mon[79928]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:24.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:24 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1845049753' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:53:24.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:24 smithi119 ceph-mon[90896]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:24.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:24 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1845049753' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:53:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:25 smithi155 ceph-mon[79928]: pgmap v233: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:25.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:25 smithi119 ceph-mon[90896]: pgmap v233: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:27.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:27 smithi155 ceph-mon[79928]: pgmap v234: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:27.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:27 smithi119 ceph-mon[90896]: pgmap v234: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:29.485 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:29 smithi119 ceph-mon[90896]: pgmap v235: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:29 smithi155 ceph-mon[79928]: pgmap v235: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:31 smithi155 ceph-mon[79928]: pgmap v236: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:31.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:31 smithi119 ceph-mon[90896]: pgmap v236: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:33 smithi155 ceph-mon[79928]: pgmap v237: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:33.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:33 smithi119 ceph-mon[90896]: pgmap v237: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:35.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:35 smithi155 ceph-mon[79928]: pgmap v238: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:35.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:35 smithi119 ceph-mon[90896]: pgmap v238: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:37 smithi155 ceph-mon[79928]: pgmap v239: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:53:37.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:37 smithi119 ceph-mon[90896]: pgmap v239: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:53:39.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:39 smithi155 ceph-mon[79928]: pgmap v240: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:39.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:39 smithi119 ceph-mon[90896]: pgmap v240: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:41.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:41 smithi155 ceph-mon[79928]: pgmap v241: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:41.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:41 smithi119 ceph-mon[90896]: pgmap v241: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:43 smithi155 ceph-mon[79928]: pgmap v242: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:43.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:43 smithi119 ceph-mon[90896]: pgmap v242: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:45 smithi155 ceph-mon[79928]: pgmap v243: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:45.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:45 smithi119 ceph-mon[90896]: pgmap v243: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:47 smithi155 ceph-mon[79928]: pgmap v244: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:47.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:47 smithi119 ceph-mon[90896]: pgmap v244: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:49.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:49 smithi155 ceph-mon[79928]: pgmap v245: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:49.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:49 smithi119 ceph-mon[90896]: pgmap v245: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:51 smithi155 ceph-mon[79928]: pgmap v246: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:51.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:51 smithi119 ceph-mon[90896]: pgmap v246: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:52.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:53:52.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:53:53.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.404+0000 7f75d8052640 1 -- 172.21.15.119:0/3670157510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00fc550 msgr2=0x7f75d00fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:53.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.404+0000 7f75d8052640 1 --2- 172.21.15.119:0/3670157510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00fc550 0x7f75d00fc960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009c50 tx=0x7f75cc004d10 comp rx=0 tx=0).stop 2024-09-13T21:53:53.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.404+0000 7f75d8052640 1 -- 172.21.15.119:0/3670157510 shutdown_connections 2024-09-13T21:53:53.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.404+0000 7f75d8052640 1 --2- 172.21.15.119:0/3670157510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d00fd820 0x7f75d00fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:53.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.404+0000 7f75d8052640 1 --2- 172.21.15.119:0/3670157510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00fc550 0x7f75d00fc960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:53.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.404+0000 7f75d8052640 1 -- 172.21.15.119:0/3670157510 >> 172.21.15.119:0/3670157510 conn(0x7f75d00f7d30 msgr2=0x7f75d00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:53.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.404+0000 7f75d8052640 1 -- 172.21.15.119:0/3670157510 shutdown_connections 2024-09-13T21:53:53.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.404+0000 7f75d8052640 1 -- 172.21.15.119:0/3670157510 wait complete. 2024-09-13T21:53:53.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d8052640 1 Processor -- start 2024-09-13T21:53:53.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d8052640 1 -- start start 2024-09-13T21:53:53.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d8052640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00fc550 0x7f75d0071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:53.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d8052640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d00fd820 0x7f75d006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d8052640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d006fff0 con 0x7f75d00fc550 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d8052640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0070130 con 0x7f75d00fd820 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d5dee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00fc550 0x7f75d0071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d5dee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00fc550 0x7f75d0071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53892/0 (socket says 172.21.15.119:53892) 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d5dee640 1 -- 172.21.15.119:0/1872442799 learned_addr learned my addr 172.21.15.119:0/1872442799 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d55ed640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d00fd820 0x7f75d006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d5dee640 1 -- 172.21.15.119:0/1872442799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d00fd820 msgr2=0x7f75d006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d5dee640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d00fd820 0x7f75d006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d5dee640 1 -- 172.21.15.119:0/1872442799 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0098b0 con 0x7f75d00fc550 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.405+0000 7f75d55ed640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d00fd820 0x7f75d006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.406+0000 7f75d5dee640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00fc550 0x7f75d0071570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f75cc004a30 tx=0x7f75cc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.406+0000 7f75c67fc640 1 -- 172.21.15.119:0/1872442799 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75cc009710 con 0x7f75d00fc550 2024-09-13T21:53:53.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.406+0000 7f75c67fc640 1 -- 172.21.15.119:0/1872442799 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f75cc032b10 con 0x7f75d00fc550 2024-09-13T21:53:53.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.406+0000 7f75d8052640 1 -- 172.21.15.119:0/1872442799 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d00703b0 con 0x7f75d00fc550 2024-09-13T21:53:53.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.406+0000 7f75c67fc640 1 -- 172.21.15.119:0/1872442799 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75cc03db10 con 0x7f75d00fc550 2024-09-13T21:53:53.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.406+0000 7f75d8052640 1 -- 172.21.15.119:0/1872442799 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d00708d0 con 0x7f75d00fc550 2024-09-13T21:53:53.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.407+0000 7f75d8052640 1 -- 172.21.15.119:0/1872442799 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d00fb9b0 con 0x7f75d00fc550 2024-09-13T21:53:53.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.407+0000 7f75c67fc640 1 -- 172.21.15.119:0/1872442799 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f75cc02f030 con 0x7f75d00fc550 2024-09-13T21:53:53.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.408+0000 7f75c67fc640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f75bc06e530 0x7f75bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:53.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.408+0000 7f75c67fc640 1 -- 172.21.15.119:0/1872442799 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f75cc0af760 con 0x7f75d00fc550 2024-09-13T21:53:53.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.408+0000 7f75d55ed640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f75bc06e530 0x7f75bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:53.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.408+0000 7f75d55ed640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f75bc06e530 0x7f75bc0709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009af0 tx=0x7f75c000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.413+0000 7f75c67fc640 1 -- 172.21.15.119:0/1872442799 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f75cc0788b0 con 0x7f75d00fc550 2024-09-13T21:53:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:53 smithi155 ceph-mon[79928]: pgmap v247: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:53.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.596+0000 7f75d8052640 1 -- 172.21.15.119:0/1872442799 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75d00708d0 con 0x7f75bc06e530 2024-09-13T21:53:53.598 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:53 smithi119 ceph-mon[90896]: pgmap v247: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:53.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.598+0000 7f75c67fc640 1 -- 172.21.15.119:0/1872442799 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f75d00708d0 con 0x7f75bc06e530 2024-09-13T21:53:53.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.599+0000 7f75d8052640 1 -- 172.21.15.119:0/1872442799 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f75bc06e530 msgr2=0x7f75bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:53.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.599+0000 7f75d8052640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f75bc06e530 0x7f75bc0709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009af0 tx=0x7f75c000b040 comp rx=0 tx=0).stop 2024-09-13T21:53:53.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.599+0000 7f75d8052640 1 -- 172.21.15.119:0/1872442799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00fc550 msgr2=0x7f75d0071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:53.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.599+0000 7f75d8052640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00fc550 0x7f75d0071570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f75cc004a30 tx=0x7f75cc004d10 comp rx=0 tx=0).stop 2024-09-13T21:53:53.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.600+0000 7f75d8052640 1 -- 172.21.15.119:0/1872442799 shutdown_connections 2024-09-13T21:53:53.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.600+0000 7f75d8052640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f75bc06e530 0x7f75bc0709e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:53.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.600+0000 7f75d8052640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d00fd820 0x7f75d006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:53.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.600+0000 7f75d8052640 1 --2- 172.21.15.119:0/1872442799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00fc550 0x7f75d0071570 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:53.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.600+0000 7f75d8052640 1 -- 172.21.15.119:0/1872442799 >> 172.21.15.119:0/1872442799 conn(0x7f75d00f7d30 msgr2=0x7f75d00f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:53.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.600+0000 7f75d8052640 1 -- 172.21.15.119:0/1872442799 shutdown_connections 2024-09-13T21:53:53.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:53.600+0000 7f75d8052640 1 -- 172.21.15.119:0/1872442799 wait complete. 2024-09-13T21:53:54.343 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T21:53:54.630 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:53:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:55 smithi155 ceph-mon[79928]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:55 smithi155 ceph-mon[79928]: pgmap v248: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:55.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:55 smithi119 ceph-mon[90896]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:55 smithi119 ceph-mon[90896]: pgmap v248: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:56.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.187+0000 7f77a0593640 1 -- 172.21.15.119:0/3126934127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77980fb480 msgr2=0x7f77980fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.187+0000 7f77a0593640 1 --2- 172.21.15.119:0/3126934127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77980fb480 0x7f77980fb8f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f77880048d0 tx=0x7f7788009da0 comp rx=0 tx=0).stop 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.187+0000 7f77a0593640 1 -- 172.21.15.119:0/3126934127 shutdown_connections 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.187+0000 7f77a0593640 1 --2- 172.21.15.119:0/3126934127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77980fb480 0x7f77980fb8f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.187+0000 7f77a0593640 1 --2- 172.21.15.119:0/3126934127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77981014c0 0x7f7798101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.187+0000 7f77a0593640 1 -- 172.21.15.119:0/3126934127 >> 172.21.15.119:0/3126934127 conn(0x7f77980f7000 msgr2=0x7f77980f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.187+0000 7f77a0593640 1 -- 172.21.15.119:0/3126934127 shutdown_connections 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.188+0000 7f77a0593640 1 -- 172.21.15.119:0/3126934127 wait complete. 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.188+0000 7f77a0593640 1 Processor -- start 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.188+0000 7f77a0593640 1 -- start start 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.188+0000 7f77a0593640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77980fb480 0x7f77981120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.188+0000 7f77a0593640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77981014c0 0x7f7798112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:56.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.188+0000 7f77a0593640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7798112c30 con 0x7f77980fb480 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.188+0000 7f77a0593640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779810c070 con 0x7f77981014c0 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.188+0000 7f779e32f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77980fb480 0x7f77981120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f779e32f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77980fb480 0x7f77981120f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58732/0 (socket says 172.21.15.119:58732) 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f779e32f640 1 -- 172.21.15.119:0/4157540032 learned_addr learned my addr 172.21.15.119:0/4157540032 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f779db2e640 1 --2- 172.21.15.119:0/4157540032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77981014c0 0x7f7798112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f779e32f640 1 -- 172.21.15.119:0/4157540032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77981014c0 msgr2=0x7f7798112630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f779e32f640 1 --2- 172.21.15.119:0/4157540032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77981014c0 0x7f7798112630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f779e32f640 1 -- 172.21.15.119:0/4157540032 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788005040 con 0x7f77980fb480 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f779e32f640 1 --2- 172.21.15.119:0/4157540032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77980fb480 0x7f77981120f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f779400fce0 tx=0x7f7794004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f778effd640 1 -- 172.21.15.119:0/4157540032 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f779400de30 con 0x7f77980fb480 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f778effd640 1 -- 172.21.15.119:0/4157540032 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f77940090d0 con 0x7f77980fb480 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f77a0593640 1 -- 172.21.15.119:0/4157540032 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779810c2f0 con 0x7f77980fb480 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f778effd640 1 -- 172.21.15.119:0/4157540032 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77940126a0 con 0x7f77980fb480 2024-09-13T21:53:56.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.189+0000 7f77a0593640 1 -- 172.21.15.119:0/4157540032 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779810c860 con 0x7f77980fb480 2024-09-13T21:53:56.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.190+0000 7f77a0593640 1 -- 172.21.15.119:0/4157540032 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77980fcbc0 con 0x7f77980fb480 2024-09-13T21:53:56.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.191+0000 7f778effd640 1 -- 172.21.15.119:0/4157540032 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7794009240 con 0x7f77980fb480 2024-09-13T21:53:56.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.191+0000 7f778effd640 1 --2- 172.21.15.119:0/4157540032 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f778406e530 0x7f77840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:56.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.191+0000 7f778effd640 1 -- 172.21.15.119:0/4157540032 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7794090700 con 0x7f77980fb480 2024-09-13T21:53:56.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.191+0000 7f779db2e640 1 --2- 172.21.15.119:0/4157540032 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f778406e530 0x7f77840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:56.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.192+0000 7f779db2e640 1 --2- 172.21.15.119:0/4157540032 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f778406e530 0x7f77840709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7788009ac0 tx=0x7f7788035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:56.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.196+0000 7f778effd640 1 -- 172.21.15.119:0/4157540032 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7794059840 con 0x7f77980fb480 2024-09-13T21:53:56.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.374+0000 7f77a0593640 1 -- 172.21.15.119:0/4157540032 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f779804b720 con 0x7f778406e530 2024-09-13T21:53:56.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.383+0000 7f778effd640 1 -- 172.21.15.119:0/4157540032 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f779804b720 con 0x7f778406e530 2024-09-13T21:53:56.385 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:53:56.385 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (8m) 38s ago 16m 25.0M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:53:56.385 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (6m) 38s ago 17m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:53:56.385 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (6m) 66s ago 16m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:53:56.385 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (45s) 38s ago 16m 48.1M - 9.4.12 2bacad6d85d8 26300ca517fb 2024-09-13T21:53:56.385 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (2m) 38s ago 11m 60.7M - 19.1.1-324-gecab7be5 0652ff2b5d78 a39ea5706ead 2024-09-13T21:53:56.385 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (104s) 38s ago 11m 18.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 1d784af814a8 2024-09-13T21:53:56.385 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (68s) 66s ago 11m 13.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 ab72fe18d1ff 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (89s) 66s ago 11m 16.7M - 19.1.1-324-gecab7be5 0652ff2b5d78 886302ecfbf8 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (7m) 38s ago 18m 515M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (7m) 66s ago 16m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (7m) 38s ago 18m 53.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (6m) 66s ago 16m 40.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (8m) 38s ago 17m 16.5M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (8m) 66s ago 16m 15.0M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (5m) 38s ago 15m 104M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (5m) 38s ago 14m 107M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 8f69bf25cd20 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (4m) 38s ago 14m 96.5M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 0f73e4fc2c43 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (4m) 66s ago 13m 116M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5a7f5a9c1c4d 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (3m) 66s ago 13m 109M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 03c992670291 2024-09-13T21:53:56.386 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (3m) 66s ago 13m 93.5M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 bf54ed40f20f 2024-09-13T21:53:56.387 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (7m) 38s ago 16m 65.8M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:53:56.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.386+0000 7f77a0593640 1 -- 172.21.15.119:0/4157540032 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f778406e530 msgr2=0x7f77840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:56.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.386+0000 7f77a0593640 1 --2- 172.21.15.119:0/4157540032 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f778406e530 0x7f77840709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7788009ac0 tx=0x7f7788035040 comp rx=0 tx=0).stop 2024-09-13T21:53:56.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.386+0000 7f77a0593640 1 -- 172.21.15.119:0/4157540032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77980fb480 msgr2=0x7f77981120f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:56.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.386+0000 7f77a0593640 1 --2- 172.21.15.119:0/4157540032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77980fb480 0x7f77981120f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f779400fce0 tx=0x7f7794004600 comp rx=0 tx=0).stop 2024-09-13T21:53:56.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.386+0000 7f77a0593640 1 -- 172.21.15.119:0/4157540032 shutdown_connections 2024-09-13T21:53:56.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.386+0000 7f77a0593640 1 --2- 172.21.15.119:0/4157540032 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f778406e530 0x7f77840709e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:56.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.386+0000 7f77a0593640 1 --2- 172.21.15.119:0/4157540032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77981014c0 0x7f7798112630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:56.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.386+0000 7f77a0593640 1 --2- 172.21.15.119:0/4157540032 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77980fb480 0x7f77981120f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:56.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.386+0000 7f77a0593640 1 -- 172.21.15.119:0/4157540032 >> 172.21.15.119:0/4157540032 conn(0x7f77980f7000 msgr2=0x7f77980f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:56.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.386+0000 7f77a0593640 1 -- 172.21.15.119:0/4157540032 shutdown_connections 2024-09-13T21:53:56.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:56.386+0000 7f77a0593640 1 -- 172.21.15.119:0/4157540032 wait complete. 2024-09-13T21:53:57.059 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade status' 2024-09-13T21:53:57.305 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:53:57.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:57 smithi119 ceph-mon[90896]: pgmap v249: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:57.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:57 smithi119 ceph-mon[90896]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:57 smithi155 ceph-mon[79928]: pgmap v249: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:57 smithi155 ceph-mon[79928]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:53:59.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 -- 172.21.15.119:0/1841062243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0fb810 msgr2=0x7fb01c0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:59.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 --2- 172.21.15.119:0/1841062243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0fb810 0x7fb01c0fbbe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009c50 tx=0x7fb00c004d10 comp rx=0 tx=0).stop 2024-09-13T21:53:59.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 -- 172.21.15.119:0/1841062243 shutdown_connections 2024-09-13T21:53:59.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 --2- 172.21.15.119:0/1841062243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb01c0fcf80 0x7fb01c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:59.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 --2- 172.21.15.119:0/1841062243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0fb810 0x7fb01c0fbbe0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:59.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 -- 172.21.15.119:0/1841062243 >> 172.21.15.119:0/1841062243 conn(0x7fb01c0723b0 msgr2=0x7fb01c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:59.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 -- 172.21.15.119:0/1841062243 shutdown_connections 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 -- 172.21.15.119:0/1841062243 wait complete. 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 Processor -- start 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 -- start start 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb01c0fb810 0x7fb01c10e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0fcf80 0x7fb01c10e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c10ede0 con 0x7fb01c0fcf80 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.998+0000 7fb023efc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c10ef50 con 0x7fb01c0fb810 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb021497640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0fcf80 0x7fb01c10e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb021497640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0fcf80 0x7fb01c10e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58746/0 (socket says 172.21.15.119:58746) 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb021497640 1 -- 172.21.15.119:0/3799958636 learned_addr learned my addr 172.21.15.119:0/3799958636 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb021497640 1 -- 172.21.15.119:0/3799958636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb01c0fb810 msgr2=0x7fb01c10e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:59.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb021497640 1 --2- 172.21.15.119:0/3799958636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb01c0fb810 0x7fb01c10e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb021497640 1 -- 172.21.15.119:0/3799958636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0098b0 con 0x7fb01c0fcf80 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb021497640 1 --2- 172.21.15.119:0/3799958636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0fcf80 0x7fb01c10e700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb01000b790 tx=0x7fb0100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb01a7fc640 1 -- 172.21.15.119:0/3799958636 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01000c700 con 0x7fb01c0fcf80 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb01a7fc640 1 -- 172.21.15.119:0/3799958636 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb01000cd00 con 0x7fb01c0fcf80 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb023efc640 1 -- 172.21.15.119:0/3799958636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c117230 con 0x7fb01c0fcf80 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb01a7fc640 1 -- 172.21.15.119:0/3799958636 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb010015e70 con 0x7fb01c0fcf80 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:58.999+0000 7fb023efc640 1 -- 172.21.15.119:0/3799958636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c117750 con 0x7fb01c0fcf80 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.000+0000 7fb023efc640 1 -- 172.21.15.119:0/3799958636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c0fcbc0 con 0x7fb01c0fcf80 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.001+0000 7fb01a7fc640 1 -- 172.21.15.119:0/3799958636 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb010012070 con 0x7fb01c0fcf80 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.001+0000 7fb01a7fc640 1 --2- 172.21.15.119:0/3799958636 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb00406e530 0x7fb0040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.001+0000 7fb01a7fc640 1 -- 172.21.15.119:0/3799958636 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb01008dde0 con 0x7fb01c0fcf80 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.001+0000 7fb021c98640 1 --2- 172.21.15.119:0/3799958636 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb00406e530 0x7fb0040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:53:59.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.002+0000 7fb021c98640 1 --2- 172.21.15.119:0/3799958636 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb00406e530 0x7fb0040709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb00c02a8b0 tx=0x7fb00c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:53:59.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.006+0000 7fb01a7fc640 1 -- 172.21.15.119:0/3799958636 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb010056e70 con 0x7fb01c0fcf80 2024-09-13T21:53:59.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.189+0000 7fb023efc640 1 -- 172.21.15.119:0/3799958636 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb01c04b720 con 0x7fb00406e530 2024-09-13T21:53:59.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.190+0000 7fb01a7fc640 1 -- 172.21.15.119:0/3799958636 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fb01c04b720 con 0x7fb00406e530 2024-09-13T21:53:59.192 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:53:59.192 INFO:teuthology.orchestra.run.smithi119.stdout: "target_image": null, 2024-09-13T21:53:59.192 INFO:teuthology.orchestra.run.smithi119.stdout: "in_progress": false, 2024-09-13T21:53:59.192 INFO:teuthology.orchestra.run.smithi119.stdout: "which": "", 2024-09-13T21:53:59.192 INFO:teuthology.orchestra.run.smithi119.stdout: "services_complete": [], 2024-09-13T21:53:59.192 INFO:teuthology.orchestra.run.smithi119.stdout: "progress": null, 2024-09-13T21:53:59.192 INFO:teuthology.orchestra.run.smithi119.stdout: "message": "", 2024-09-13T21:53:59.192 INFO:teuthology.orchestra.run.smithi119.stdout: "is_paused": false 2024-09-13T21:53:59.192 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:53:59.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.193+0000 7fb023efc640 1 -- 172.21.15.119:0/3799958636 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb00406e530 msgr2=0x7fb0040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:59.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.193+0000 7fb023efc640 1 --2- 172.21.15.119:0/3799958636 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb00406e530 0x7fb0040709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb00c02a8b0 tx=0x7fb00c004d10 comp rx=0 tx=0).stop 2024-09-13T21:53:59.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.193+0000 7fb023efc640 1 -- 172.21.15.119:0/3799958636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0fcf80 msgr2=0x7fb01c10e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:53:59.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.193+0000 7fb023efc640 1 --2- 172.21.15.119:0/3799958636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0fcf80 0x7fb01c10e700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb01000b790 tx=0x7fb0100091d0 comp rx=0 tx=0).stop 2024-09-13T21:53:59.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.193+0000 7fb023efc640 1 -- 172.21.15.119:0/3799958636 shutdown_connections 2024-09-13T21:53:59.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.193+0000 7fb023efc640 1 --2- 172.21.15.119:0/3799958636 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb00406e530 0x7fb0040709e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:59.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.193+0000 7fb023efc640 1 --2- 172.21.15.119:0/3799958636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0fcf80 0x7fb01c10e700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:59.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.193+0000 7fb023efc640 1 --2- 172.21.15.119:0/3799958636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb01c0fb810 0x7fb01c10e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:53:59.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.193+0000 7fb023efc640 1 -- 172.21.15.119:0/3799958636 >> 172.21.15.119:0/3799958636 conn(0x7fb01c0723b0 msgr2=0x7fb01c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:53:59.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.193+0000 7fb023efc640 1 -- 172.21.15.119:0/3799958636 shutdown_connections 2024-09-13T21:53:59.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:53:59.193+0000 7fb023efc640 1 -- 172.21.15.119:0/3799958636 wait complete. 2024-09-13T21:53:59.573 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:53:59 smithi119 ceph-mon[90896]: pgmap v250: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:59.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:53:59 smithi155 ceph-mon[79928]: pgmap v250: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:53:59.893 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph health detail' 2024-09-13T21:54:00.146 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:54:00.533 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:00 smithi119 ceph-mon[90896]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:54:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:00 smithi155 ceph-mon[79928]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:54:01.579 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:01 smithi119 ceph-mon[90896]: pgmap v251: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:01.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:01 smithi155 ceph-mon[79928]: pgmap v251: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:01.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.811+0000 7f8128818640 1 -- 172.21.15.119:0/1265787978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81240fd560 msgr2=0x7f81240fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:54:01.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.811+0000 7f8128818640 1 --2- 172.21.15.119:0/1265787978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81240fd560 0x7f81240fd930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8114004900 tx=0x7f8114009da0 comp rx=0 tx=0).stop 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.811+0000 7f8128818640 1 -- 172.21.15.119:0/1265787978 shutdown_connections 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.811+0000 7f8128818640 1 --2- 172.21.15.119:0/1265787978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81240fdf00 0x7f81241065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.811+0000 7f8128818640 1 --2- 172.21.15.119:0/1265787978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81240fd560 0x7f81240fd930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.811+0000 7f8128818640 1 -- 172.21.15.119:0/1265787978 >> 172.21.15.119:0/1265787978 conn(0x7f81240f7000 msgr2=0x7f81240f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.811+0000 7f8128818640 1 -- 172.21.15.119:0/1265787978 shutdown_connections 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.811+0000 7f8128818640 1 -- 172.21.15.119:0/1265787978 wait complete. 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.811+0000 7f8128818640 1 Processor -- start 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8128818640 1 -- start start 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8128818640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81240fd560 0x7f8124113280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8128818640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81240fdf00 0x7f81241137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8128818640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8124113dc0 con 0x7f81240fdf00 2024-09-13T21:54:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8128818640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812410d200 con 0x7f81240fd560 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8119d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81240fdf00 0x7f81241137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8119d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81240fdf00 0x7f81241137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:58754/0 (socket says 172.21.15.119:58754) 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8119d9b640 1 -- 172.21.15.119:0/3083956145 learned_addr learned my addr 172.21.15.119:0/3083956145 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f812259c640 1 --2- 172.21.15.119:0/3083956145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81240fd560 0x7f8124113280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8119d9b640 1 -- 172.21.15.119:0/3083956145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81240fd560 msgr2=0x7f8124113280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8119d9b640 1 --2- 172.21.15.119:0/3083956145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81240fd560 0x7f8124113280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8119d9b640 1 -- 172.21.15.119:0/3083956145 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8114005040 con 0x7f81240fdf00 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8119d9b640 1 --2- 172.21.15.119:0/3083956145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81240fdf00 0x7f81241137c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c810 tx=0x7f810c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f811b7fe640 1 -- 172.21.15.119:0/3083956145 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810c00a820 con 0x7f81240fdf00 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f811b7fe640 1 -- 172.21.15.119:0/3083956145 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f810c00ae20 con 0x7f81240fdf00 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f8128818640 1 -- 172.21.15.119:0/3083956145 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812410d4e0 con 0x7f81240fdf00 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.812+0000 7f811b7fe640 1 -- 172.21.15.119:0/3083956145 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810c0115c0 con 0x7f81240fdf00 2024-09-13T21:54:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.813+0000 7f8128818640 1 -- 172.21.15.119:0/3083956145 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812410da00 con 0x7f81240fdf00 2024-09-13T21:54:01.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.813+0000 7f8128818640 1 -- 172.21.15.119:0/3083956145 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81240662b0 con 0x7f81240fdf00 2024-09-13T21:54:01.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.814+0000 7f811b7fe640 1 -- 172.21.15.119:0/3083956145 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f810c012840 con 0x7f81240fdf00 2024-09-13T21:54:01.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.814+0000 7f811b7fe640 1 --2- 172.21.15.119:0/3083956145 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f811006e530 0x7f81100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:54:01.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.814+0000 7f811b7fe640 1 -- 172.21.15.119:0/3083956145 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f810c08e700 con 0x7f81240fdf00 2024-09-13T21:54:01.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.815+0000 7f812259c640 1 --2- 172.21.15.119:0/3083956145 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f811006e530 0x7f81100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:54:01.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.815+0000 7f812259c640 1 --2- 172.21.15.119:0/3083956145 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f811006e530 0x7f81100709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8114007ac0 tx=0x7f8114035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:54:01.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:01.819+0000 7f811b7fe640 1 -- 172.21.15.119:0/3083956145 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f810c05b340 con 0x7f81240fdf00 2024-09-13T21:54:02.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.049+0000 7f8128818640 1 -- 172.21.15.119:0/3083956145 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f81241095a0 con 0x7f81240fdf00 2024-09-13T21:54:02.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.049+0000 7f811b7fe640 1 -- 172.21.15.119:0/3083956145 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f810c05aed0 con 0x7f81240fdf00 2024-09-13T21:54:02.051 INFO:teuthology.orchestra.run.smithi119.stdout:HEALTH_OK 2024-09-13T21:54:02.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.051+0000 7f8128818640 1 -- 172.21.15.119:0/3083956145 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f811006e530 msgr2=0x7f81100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:54:02.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.051+0000 7f8128818640 1 --2- 172.21.15.119:0/3083956145 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f811006e530 0x7f81100709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8114007ac0 tx=0x7f8114035040 comp rx=0 tx=0).stop 2024-09-13T21:54:02.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.051+0000 7f8128818640 1 -- 172.21.15.119:0/3083956145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81240fdf00 msgr2=0x7f81241137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:54:02.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.051+0000 7f8128818640 1 --2- 172.21.15.119:0/3083956145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81240fdf00 0x7f81241137c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c810 tx=0x7f810c0043c0 comp rx=0 tx=0).stop 2024-09-13T21:54:02.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.051+0000 7f8128818640 1 -- 172.21.15.119:0/3083956145 shutdown_connections 2024-09-13T21:54:02.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.051+0000 7f8128818640 1 --2- 172.21.15.119:0/3083956145 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f811006e530 0x7f81100709e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:02.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.051+0000 7f8128818640 1 --2- 172.21.15.119:0/3083956145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81240fdf00 0x7f81241137c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:02.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.051+0000 7f8128818640 1 --2- 172.21.15.119:0/3083956145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81240fd560 0x7f8124113280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:02.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.051+0000 7f8128818640 1 -- 172.21.15.119:0/3083956145 >> 172.21.15.119:0/3083956145 conn(0x7f81240f7000 msgr2=0x7f81240f8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:54:02.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.051+0000 7f8128818640 1 -- 172.21.15.119:0/3083956145 shutdown_connections 2024-09-13T21:54:02.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:02.051+0000 7f8128818640 1 -- 172.21.15.119:0/3083956145 wait complete. 2024-09-13T21:54:02.316 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:02 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3083956145' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:54:02.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:02 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3083956145' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T21:54:02.696 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions' 2024-09-13T21:54:02.940 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:54:03.341 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:03 smithi119 ceph-mon[90896]: pgmap v252: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:03.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:03 smithi155 ceph-mon[79928]: pgmap v252: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:04.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.684+0000 7f07c76d9640 1 -- 172.21.15.119:0/2946293162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07c00fac80 msgr2=0x7f07c00fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:54:04.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.684+0000 7f07c76d9640 1 --2- 172.21.15.119:0/2946293162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07c00fac80 0x7f07c00fb0f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f07b40048d0 tx=0x7f07b4009da0 comp rx=0 tx=0).stop 2024-09-13T21:54:04.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.684+0000 7f07c76d9640 1 -- 172.21.15.119:0/2946293162 shutdown_connections 2024-09-13T21:54:04.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.684+0000 7f07c76d9640 1 --2- 172.21.15.119:0/2946293162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07c00fac80 0x7f07c00fb0f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:04.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.684+0000 7f07c76d9640 1 --2- 172.21.15.119:0/2946293162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07c0102620 0x7f07c01029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:04.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.684+0000 7f07c76d9640 1 -- 172.21.15.119:0/2946293162 >> 172.21.15.119:0/2946293162 conn(0x7f07c0070ce0 msgr2=0x7f07c00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:54:04.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.684+0000 7f07c76d9640 1 -- 172.21.15.119:0/2946293162 shutdown_connections 2024-09-13T21:54:04.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.684+0000 7f07c76d9640 1 -- 172.21.15.119:0/2946293162 wait complete. 2024-09-13T21:54:04.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.685+0000 7f07c76d9640 1 Processor -- start 2024-09-13T21:54:04.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.685+0000 7f07c76d9640 1 -- start start 2024-09-13T21:54:04.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.685+0000 7f07c76d9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07c00fac80 0x7f07c010ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.685+0000 7f07c76d9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07c0102620 0x7f07c0110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.685+0000 7f07c76d9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0110b70 con 0x7f07c00fac80 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.685+0000 7f07c76d9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c010afe0 con 0x7f07c0102620 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.685+0000 7f07c5475640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07c00fac80 0x7f07c010ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.685+0000 7f07c5475640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07c00fac80 0x7f07c010ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37154/0 (socket says 172.21.15.119:37154) 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.685+0000 7f07c5475640 1 -- 172.21.15.119:0/854655559 learned_addr learned my addr 172.21.15.119:0/854655559 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.685+0000 7f07c4c74640 1 --2- 172.21.15.119:0/854655559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07c0102620 0x7f07c0110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.686+0000 7f07c5475640 1 -- 172.21.15.119:0/854655559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07c0102620 msgr2=0x7f07c0110520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.686+0000 7f07c5475640 1 --2- 172.21.15.119:0/854655559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07c0102620 0x7f07c0110520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.686+0000 7f07c5475640 1 -- 172.21.15.119:0/854655559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4005040 con 0x7f07c00fac80 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.686+0000 7f07c5475640 1 --2- 172.21.15.119:0/854655559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07c00fac80 0x7f07c010ffc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f07b8002a50 tx=0x7f07b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.686+0000 7f07bdffb640 1 -- 172.21.15.119:0/854655559 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07b8007c30 con 0x7f07c00fac80 2024-09-13T21:54:04.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.686+0000 7f07bdffb640 1 -- 172.21.15.119:0/854655559 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f07b800f040 con 0x7f07c00fac80 2024-09-13T21:54:04.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.686+0000 7f07bdffb640 1 -- 172.21.15.119:0/854655559 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07b800dad0 con 0x7f07c00fac80 2024-09-13T21:54:04.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.686+0000 7f07c76d9640 1 -- 172.21.15.119:0/854655559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c010b2c0 con 0x7f07c00fac80 2024-09-13T21:54:04.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.686+0000 7f07c76d9640 1 -- 172.21.15.119:0/854655559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c010b7b0 con 0x7f07c00fac80 2024-09-13T21:54:04.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.687+0000 7f07c76d9640 1 -- 172.21.15.119:0/854655559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c00657b0 con 0x7f07c00fac80 2024-09-13T21:54:04.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.688+0000 7f07bdffb640 1 -- 172.21.15.119:0/854655559 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f07b800dc30 con 0x7f07c00fac80 2024-09-13T21:54:04.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.688+0000 7f07bdffb640 1 --2- 172.21.15.119:0/854655559 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f07a806e530 0x7f07a80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:54:04.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.688+0000 7f07bdffb640 1 -- 172.21.15.119:0/854655559 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f07b808dfc0 con 0x7f07c00fac80 2024-09-13T21:54:04.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.688+0000 7f07c4c74640 1 --2- 172.21.15.119:0/854655559 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f07a806e530 0x7f07a80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:54:04.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.689+0000 7f07c4c74640 1 --2- 172.21.15.119:0/854655559 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f07a806e530 0x7f07a80709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009ac0 tx=0x7f07b4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:54:04.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.693+0000 7f07bdffb640 1 -- 172.21.15.119:0/854655559 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f07b80570d0 con 0x7f07c00fac80 2024-09-13T21:54:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.927+0000 7f07c76d9640 1 -- 172.21.15.119:0/854655559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f07c004b750 con 0x7f07c00fac80 2024-09-13T21:54:04.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.927+0000 7f07bdffb640 1 -- 172.21.15.119:0/854655559 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f07b805a790 con 0x7f07c00fac80 2024-09-13T21:54:04.929 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:54:04.929 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:54:04.929 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:54:04.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:54:04.929 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:54:04.929 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:54:04.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:54:04.930 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:54:04.930 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:54:04.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:54:04.930 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:54:04.930 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:54:04.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:54:04.930 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:54:04.930 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T21:54:04.930 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:54:04.930 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:54:04.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.929+0000 7f07c76d9640 1 -- 172.21.15.119:0/854655559 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f07a806e530 msgr2=0x7f07a80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:54:04.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.929+0000 7f07c76d9640 1 --2- 172.21.15.119:0/854655559 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f07a806e530 0x7f07a80709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009ac0 tx=0x7f07b4035040 comp rx=0 tx=0).stop 2024-09-13T21:54:04.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.929+0000 7f07c76d9640 1 -- 172.21.15.119:0/854655559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07c00fac80 msgr2=0x7f07c010ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:54:04.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.929+0000 7f07c76d9640 1 --2- 172.21.15.119:0/854655559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07c00fac80 0x7f07c010ffc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f07b8002a50 tx=0x7f07b8004600 comp rx=0 tx=0).stop 2024-09-13T21:54:04.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.929+0000 7f07c76d9640 1 -- 172.21.15.119:0/854655559 shutdown_connections 2024-09-13T21:54:04.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.929+0000 7f07c76d9640 1 --2- 172.21.15.119:0/854655559 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f07a806e530 0x7f07a80709e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:04.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.929+0000 7f07c76d9640 1 --2- 172.21.15.119:0/854655559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07c0102620 0x7f07c0110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:04.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.929+0000 7f07c76d9640 1 --2- 172.21.15.119:0/854655559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07c00fac80 0x7f07c010ffc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:54:04.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.929+0000 7f07c76d9640 1 -- 172.21.15.119:0/854655559 >> 172.21.15.119:0/854655559 conn(0x7f07c0070ce0 msgr2=0x7f07c00fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:54:04.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.929+0000 7f07c76d9640 1 -- 172.21.15.119:0/854655559 shutdown_connections 2024-09-13T21:54:04.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:54:04.929+0000 7f07c76d9640 1 -- 172.21.15.119:0/854655559 wait complete. 2024-09-13T21:54:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:05 smithi155 ceph-mon[79928]: pgmap v253: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:05 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/854655559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:54:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:05 smithi119 ceph-mon[90896]: pgmap v253: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:05 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/854655559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:54:05.662 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-13T21:54:05.908 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:54:07.335 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:07 smithi119 ceph-mon[90896]: pgmap v254: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:07.335 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:54:07.573 INFO:teuthology.orchestra.run.smithi119.stdout:wait for servicemap items w/ changing names to refresh 2024-09-13T21:54:07.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:07 smithi155 ceph-mon[79928]: pgmap v254: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:54:08.358 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'sleep 60' 2024-09-13T21:54:08.611 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:54:09.551 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:09 smithi119 ceph-mon[90896]: pgmap v255: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:09.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:09 smithi155 ceph-mon[79928]: pgmap v255: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:11 smithi155 ceph-mon[79928]: pgmap v256: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:11.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:11 smithi119 ceph-mon[90896]: pgmap v256: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:13 smithi155 ceph-mon[79928]: pgmap v257: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:13.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:13 smithi119 ceph-mon[90896]: pgmap v257: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:15 smithi155 ceph-mon[79928]: pgmap v258: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:15.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:15 smithi119 ceph-mon[90896]: pgmap v258: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:17.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:17 smithi155 ceph-mon[79928]: pgmap v259: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:17.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:17 smithi119 ceph-mon[90896]: pgmap v259: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:19 smithi155 ceph-mon[79928]: pgmap v260: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:19.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:19 smithi119 ceph-mon[90896]: pgmap v260: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:21 smithi155 ceph-mon[79928]: pgmap v261: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:21.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:21 smithi119 ceph-mon[90896]: pgmap v261: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:22.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:54:22.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:54:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:23 smithi155 ceph-mon[79928]: pgmap v262: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:54:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:54:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:54:23.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:54:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:23 smithi119 ceph-mon[90896]: pgmap v262: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:54:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:54:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:54:23.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:54:25.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:25 smithi155 ceph-mon[79928]: pgmap v263: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:25.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:25 smithi119 ceph-mon[90896]: pgmap v263: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:27.585 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:27 smithi155 ceph-mon[79928]: pgmap v264: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:27 smithi119 ceph-mon[90896]: pgmap v264: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:29.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:29 smithi155 ceph-mon[79928]: pgmap v265: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:29.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:29 smithi119 ceph-mon[90896]: pgmap v265: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:31.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:31 smithi155 ceph-mon[79928]: pgmap v266: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:31.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:31 smithi119 ceph-mon[90896]: pgmap v266: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:33.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:33 smithi155 ceph-mon[79928]: pgmap v267: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:33.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:33 smithi119 ceph-mon[90896]: pgmap v267: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:35.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:35 smithi155 ceph-mon[79928]: pgmap v268: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:35.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:35 smithi119 ceph-mon[90896]: pgmap v268: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:37 smithi155 ceph-mon[79928]: pgmap v269: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:37.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:54:37.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:37 smithi119 ceph-mon[90896]: pgmap v269: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:54:39.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:39 smithi119 ceph-mon[90896]: pgmap v270: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:39.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:39 smithi155 ceph-mon[79928]: pgmap v270: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:41.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:41 smithi119 ceph-mon[90896]: pgmap v271: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:41 smithi155 ceph-mon[79928]: pgmap v271: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:43.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:43 smithi119 ceph-mon[90896]: pgmap v272: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:43.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:43 smithi155 ceph-mon[79928]: pgmap v272: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:45.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:45 smithi119 ceph-mon[90896]: pgmap v273: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:45.635 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:45 smithi155 ceph-mon[79928]: pgmap v273: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:47.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:47 smithi119 ceph-mon[90896]: pgmap v274: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:47.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:47 smithi155 ceph-mon[79928]: pgmap v274: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:49.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:49 smithi119 ceph-mon[90896]: pgmap v275: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:49.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:49 smithi155 ceph-mon[79928]: pgmap v275: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:51.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:51 smithi119 ceph-mon[90896]: pgmap v276: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:51.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:51 smithi155 ceph-mon[79928]: pgmap v276: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:52.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:54:52.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:54:53.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:53 smithi119 ceph-mon[90896]: pgmap v277: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:53.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:53 smithi155 ceph-mon[79928]: pgmap v277: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:55.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:55 smithi119 ceph-mon[90896]: pgmap v278: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:55.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:55 smithi155 ceph-mon[79928]: pgmap v278: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:57.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:57 smithi119 ceph-mon[90896]: pgmap v279: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:57 smithi155 ceph-mon[79928]: pgmap v279: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:54:59 smithi119 ceph-mon[90896]: pgmap v280: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:54:59.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:54:59 smithi155 ceph-mon[79928]: pgmap v280: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:01.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:01 smithi119 ceph-mon[90896]: pgmap v281: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:01.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:01 smithi155 ceph-mon[79928]: pgmap v281: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:03.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:03 smithi119 ceph-mon[90896]: pgmap v282: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:03.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:03 smithi155 ceph-mon[79928]: pgmap v282: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:05 smithi119 ceph-mon[90896]: pgmap v283: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:05 smithi155 ceph-mon[79928]: pgmap v283: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:07 smithi155 ceph-mon[79928]: pgmap v284: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:55:07.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:07 smithi119 ceph-mon[90896]: pgmap v284: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:55:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:09 smithi155 ceph-mon[79928]: pgmap v285: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:09.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:09 smithi119 ceph-mon[90896]: pgmap v285: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:11.353 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T21:55:11.606 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:11.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:11 smithi119 ceph-mon[90896]: pgmap v286: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:11.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:11 smithi155 ceph-mon[79928]: pgmap v286: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:13.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.202+0000 7f763faaf640 1 -- 172.21.15.119:0/3043338834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76380fcf80 msgr2=0x7f76380fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.202+0000 7f763faaf640 1 --2- 172.21.15.119:0/3043338834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76380fcf80 0x7f76380fd3d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f76340048d0 tx=0x7f7634009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.202+0000 7f763faaf640 1 -- 172.21.15.119:0/3043338834 shutdown_connections 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.202+0000 7f763faaf640 1 --2- 172.21.15.119:0/3043338834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76380fcf80 0x7f76380fd3d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.202+0000 7f763faaf640 1 --2- 172.21.15.119:0/3043338834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76380fb810 0x7f76380fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.202+0000 7f763faaf640 1 -- 172.21.15.119:0/3043338834 >> 172.21.15.119:0/3043338834 conn(0x7f76380723b0 msgr2=0x7f76380727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.202+0000 7f763faaf640 1 -- 172.21.15.119:0/3043338834 shutdown_connections 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.202+0000 7f763faaf640 1 -- 172.21.15.119:0/3043338834 wait complete. 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763faaf640 1 Processor -- start 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763faaf640 1 -- start start 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763faaf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76380fb810 0x7f7638113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763faaf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76380fcf80 0x7f7638113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:13.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763faaf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7638113de0 con 0x7f76380fb810 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763faaf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763810d190 con 0x7f76380fcf80 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763d84b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76380fb810 0x7f7638113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763d84b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76380fb810 0x7f7638113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:57502/0 (socket says 172.21.15.119:57502) 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763d84b640 1 -- 172.21.15.119:0/4035437273 learned_addr learned my addr 172.21.15.119:0/4035437273 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763d84b640 1 -- 172.21.15.119:0/4035437273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76380fcf80 msgr2=0x7f7638113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763d84b640 1 --2- 172.21.15.119:0/4035437273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76380fcf80 0x7f7638113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763d84b640 1 -- 172.21.15.119:0/4035437273 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7634005040 con 0x7f76380fb810 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f763d84b640 1 --2- 172.21.15.119:0/4035437273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76380fb810 0x7f7638113210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f762c00b790 tx=0x7f762c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.203+0000 7f762a7fc640 1 -- 172.21.15.119:0/4035437273 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f762c00c700 con 0x7f76380fb810 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.204+0000 7f762a7fc640 1 -- 172.21.15.119:0/4035437273 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f762c00cd00 con 0x7f76380fb810 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.204+0000 7f763faaf640 1 -- 172.21.15.119:0/4035437273 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763810d470 con 0x7f76380fb810 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.204+0000 7f762a7fc640 1 -- 172.21.15.119:0/4035437273 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f762c015e70 con 0x7f76380fb810 2024-09-13T21:55:13.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.204+0000 7f763faaf640 1 -- 172.21.15.119:0/4035437273 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763810d990 con 0x7f76380fb810 2024-09-13T21:55:13.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.204+0000 7f763faaf640 1 -- 172.21.15.119:0/4035437273 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76380fcbc0 con 0x7f76380fb810 2024-09-13T21:55:13.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.205+0000 7f762a7fc640 1 -- 172.21.15.119:0/4035437273 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f762c012070 con 0x7f76380fb810 2024-09-13T21:55:13.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.205+0000 7f762a7fc640 1 --2- 172.21.15.119:0/4035437273 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f762406e530 0x7f76240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:13.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.206+0000 7f762a7fc640 1 -- 172.21.15.119:0/4035437273 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f762c08dce0 con 0x7f76380fb810 2024-09-13T21:55:13.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.206+0000 7f763d04a640 1 --2- 172.21.15.119:0/4035437273 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f762406e530 0x7f76240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:13.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.206+0000 7f763d04a640 1 --2- 172.21.15.119:0/4035437273 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f762406e530 0x7f76240709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f763402a530 tx=0x7f7634009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:13.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.210+0000 7f762a7fc640 1 -- 172.21.15.119:0/4035437273 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f762c056df0 con 0x7f76380fb810 2024-09-13T21:55:13.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.386+0000 7f763faaf640 1 -- 172.21.15.119:0/4035437273 --> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f763804b720 con 0x7f762406e530 2024-09-13T21:55:13.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.396+0000 7f762a7fc640 1 -- 172.21.15.119:0/4035437273 <== mgr.34104 v2:172.21.15.119:6800/42221219 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f763804b720 con 0x7f762406e530 2024-09-13T21:55:13.397 INFO:teuthology.orchestra.run.smithi119.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:alertmanager.smithi119 smithi119 *:9093,9094 running (9m) 115s ago 18m 25.0M - 0.25.0 c8568f914cd2 618af2121baf 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi119 smithi119 running (7m) 115s ago 18m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 b022944079f4 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:crash.smithi155 smithi155 running (7m) 2m ago 17m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 6a475353b99a 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:grafana.smithi119 smithi119 *:3000 running (2m) 115s ago 17m 48.1M - 9.4.12 2bacad6d85d8 26300ca517fb 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.rpmijj smithi119 running (3m) 115s ago 12m 60.7M - 19.1.1-324-gecab7be5 0652ff2b5d78 a39ea5706ead 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi119.yydzwt smithi119 running (3m) 115s ago 12m 18.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 1d784af814a8 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.afmavb smithi155 running (2m) 2m ago 12m 13.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 ab72fe18d1ff 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:mds.cephfs.smithi155.yblkxo smithi155 running (2m) 2m ago 12m 16.7M - 19.1.1-324-gecab7be5 0652ff2b5d78 886302ecfbf8 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi119.gwjxmq smithi119 *:8443,9283,8765 running (9m) 115s ago 19m 515M - 19.1.1-324-gecab7be5 0652ff2b5d78 0c06722d4814 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:mgr.smithi155.wuuxfd smithi155 *:8443,9283,8765 running (8m) 2m ago 17m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 415a3f54acb1 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi119 smithi119 running (8m) 115s ago 19m 53.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 a7778435eff6 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:mon.smithi155 smithi155 running (8m) 2m ago 17m 40.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4616d5306e8c 2024-09-13T21:55:13.398 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi119 smithi119 *:9100 running (9m) 115s ago 18m 16.5M - 1.5.0 0da6a335fe13 bae0d35c8506 2024-09-13T21:55:13.399 INFO:teuthology.orchestra.run.smithi119.stdout:node-exporter.smithi155 smithi155 *:9100 running (9m) 2m ago 17m 15.0M - 1.5.0 0da6a335fe13 e35c0f3695a4 2024-09-13T21:55:13.399 INFO:teuthology.orchestra.run.smithi119.stdout:osd.0 smithi119 running (7m) 115s ago 16m 104M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 dd1b263d2276 2024-09-13T21:55:13.399 INFO:teuthology.orchestra.run.smithi119.stdout:osd.1 smithi119 running (6m) 115s ago 16m 107M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 8f69bf25cd20 2024-09-13T21:55:13.399 INFO:teuthology.orchestra.run.smithi119.stdout:osd.2 smithi119 running (5m) 115s ago 15m 96.5M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 0f73e4fc2c43 2024-09-13T21:55:13.399 INFO:teuthology.orchestra.run.smithi119.stdout:osd.3 smithi155 running (5m) 2m ago 15m 116M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5a7f5a9c1c4d 2024-09-13T21:55:13.399 INFO:teuthology.orchestra.run.smithi119.stdout:osd.4 smithi155 running (4m) 2m ago 14m 109M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 03c992670291 2024-09-13T21:55:13.399 INFO:teuthology.orchestra.run.smithi119.stdout:osd.5 smithi155 running (4m) 2m ago 14m 93.5M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 bf54ed40f20f 2024-09-13T21:55:13.399 INFO:teuthology.orchestra.run.smithi119.stdout:prometheus.smithi119 smithi119 *:9095 running (8m) 115s ago 17m 65.8M - 2.43.0 a07b618ecd1d 11ebd6d60b02 2024-09-13T21:55:13.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.398+0000 7f763faaf640 1 -- 172.21.15.119:0/4035437273 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f762406e530 msgr2=0x7f76240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:13.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.398+0000 7f763faaf640 1 --2- 172.21.15.119:0/4035437273 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f762406e530 0x7f76240709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f763402a530 tx=0x7f7634009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:13.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.398+0000 7f763faaf640 1 -- 172.21.15.119:0/4035437273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76380fb810 msgr2=0x7f7638113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:13.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.398+0000 7f763faaf640 1 --2- 172.21.15.119:0/4035437273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76380fb810 0x7f7638113210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f762c00b790 tx=0x7f762c0091d0 comp rx=0 tx=0).stop 2024-09-13T21:55:13.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.398+0000 7f763faaf640 1 -- 172.21.15.119:0/4035437273 shutdown_connections 2024-09-13T21:55:13.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.398+0000 7f763faaf640 1 --2- 172.21.15.119:0/4035437273 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f762406e530 0x7f76240709e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:13.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.398+0000 7f763faaf640 1 --2- 172.21.15.119:0/4035437273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76380fcf80 0x7f7638113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:13.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.398+0000 7f763faaf640 1 --2- 172.21.15.119:0/4035437273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76380fb810 0x7f7638113210 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:13.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.398+0000 7f763faaf640 1 -- 172.21.15.119:0/4035437273 >> 172.21.15.119:0/4035437273 conn(0x7f76380723b0 msgr2=0x7f76380fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:13.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.398+0000 7f763faaf640 1 -- 172.21.15.119:0/4035437273 shutdown_connections 2024-09-13T21:55:13.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:13.398+0000 7f763faaf640 1 -- 172.21.15.119:0/4035437273 wait complete. 2024-09-13T21:55:13.636 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:13 smithi119 ceph-mon[90896]: pgmap v287: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:13.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:13 smithi155 ceph-mon[79928]: pgmap v287: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:14.046 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions' 2024-09-13T21:55:14.301 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:14.667 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:14 smithi119 ceph-mon[90896]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:55:14.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:14 smithi155 ceph-mon[79928]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T21:55:15.495 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:15 smithi119 ceph-mon[90896]: pgmap v288: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:15.734 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:15 smithi155 ceph-mon[79928]: pgmap v288: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.948+0000 7f51e1f50640 1 -- 172.21.15.119:0/2281860519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc102530 msgr2=0x7f51dc102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.948+0000 7f51e1f50640 1 --2- 172.21.15.119:0/2281860519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc102530 0x7f51dc102900 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0048d0 tx=0x7f51cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.948+0000 7f51e1f50640 1 -- 172.21.15.119:0/2281860519 shutdown_connections 2024-09-13T21:55:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.948+0000 7f51e1f50640 1 --2- 172.21.15.119:0/2281860519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51dc102ed0 0x7f51dc0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.948+0000 7f51e1f50640 1 --2- 172.21.15.119:0/2281860519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc102530 0x7f51dc102900 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.948+0000 7f51e1f50640 1 -- 172.21.15.119:0/2281860519 >> 172.21.15.119:0/2281860519 conn(0x7f51dc0f80f0 msgr2=0x7f51dc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.948+0000 7f51e1f50640 1 -- 172.21.15.119:0/2281860519 shutdown_connections 2024-09-13T21:55:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.948+0000 7f51e1f50640 1 -- 172.21.15.119:0/2281860519 wait complete. 2024-09-13T21:55:15.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.949+0000 7f51e1f50640 1 Processor -- start 2024-09-13T21:55:15.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.949+0000 7f51e1f50640 1 -- start start 2024-09-13T21:55:15.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.949+0000 7f51e1f50640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51dc102530 0x7f51dc113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:15.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.949+0000 7f51e1f50640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc102ed0 0x7f51dc113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:15.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.949+0000 7f51e1f50640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc113d80 con 0x7f51dc102ed0 2024-09-13T21:55:15.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.949+0000 7f51e1f50640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc10d1c0 con 0x7f51dc102530 2024-09-13T21:55:15.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.949+0000 7f51d3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc102ed0 0x7f51dc113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:15.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.949+0000 7f51d3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc102ed0 0x7f51dc113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50586/0 (socket says 172.21.15.119:50586) 2024-09-13T21:55:15.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.949+0000 7f51d3fff640 1 -- 172.21.15.119:0/326224446 learned_addr learned my addr 172.21.15.119:0/326224446 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:15.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.949+0000 7f51db7fe640 1 --2- 172.21.15.119:0/326224446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51dc102530 0x7f51dc113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:15.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.950+0000 7f51d3fff640 1 -- 172.21.15.119:0/326224446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51dc102530 msgr2=0x7f51dc113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:15.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.950+0000 7f51d3fff640 1 --2- 172.21.15.119:0/326224446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51dc102530 0x7f51dc113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:15.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.950+0000 7f51d3fff640 1 -- 172.21.15.119:0/326224446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc005040 con 0x7f51dc102ed0 2024-09-13T21:55:15.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.950+0000 7f51d3fff640 1 --2- 172.21.15.119:0/326224446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc102ed0 0x7f51dc113780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f51c4002840 tx=0x7f51c4004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:15.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.950+0000 7f51d8ff9640 1 -- 172.21.15.119:0/326224446 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51c4007c30 con 0x7f51dc102ed0 2024-09-13T21:55:15.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.950+0000 7f51d8ff9640 1 -- 172.21.15.119:0/326224446 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f51c400f040 con 0x7f51dc102ed0 2024-09-13T21:55:15.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.950+0000 7f51d8ff9640 1 -- 172.21.15.119:0/326224446 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51c4009410 con 0x7f51dc102ed0 2024-09-13T21:55:15.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.950+0000 7f51e1f50640 1 -- 172.21.15.119:0/326224446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc10d4a0 con 0x7f51dc102ed0 2024-09-13T21:55:15.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.950+0000 7f51e1f50640 1 -- 172.21.15.119:0/326224446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc10da40 con 0x7f51dc102ed0 2024-09-13T21:55:15.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.951+0000 7f51e1f50640 1 -- 172.21.15.119:0/326224446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc0fdcb0 con 0x7f51dc102ed0 2024-09-13T21:55:15.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.951+0000 7f51d8ff9640 1 -- 172.21.15.119:0/326224446 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f51c4009680 con 0x7f51dc102ed0 2024-09-13T21:55:15.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.952+0000 7f51d8ff9640 1 --2- 172.21.15.119:0/326224446 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f51c806e530 0x7f51c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:15.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.952+0000 7f51d8ff9640 1 -- 172.21.15.119:0/326224446 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f51c408da10 con 0x7f51dc102ed0 2024-09-13T21:55:15.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.952+0000 7f51db7fe640 1 --2- 172.21.15.119:0/326224446 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f51c806e530 0x7f51c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:15.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.952+0000 7f51db7fe640 1 --2- 172.21.15.119:0/326224446 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f51c806e530 0x7f51c80709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009ac0 tx=0x7f51cc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:15.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:15.956+0000 7f51d8ff9640 1 -- 172.21.15.119:0/326224446 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f51c4056b20 con 0x7f51dc102ed0 2024-09-13T21:55:16.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.190+0000 7f51e1f50640 1 -- 172.21.15.119:0/326224446 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f51dc1095a0 con 0x7f51dc102ed0 2024-09-13T21:55:16.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.191+0000 7f51d8ff9640 1 -- 172.21.15.119:0/326224446 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f51c405a1e0 con 0x7f51dc102ed0 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": { 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": { 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": { 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-13T21:55:16.193 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T21:55:16.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-13T21:55:16.194 INFO:teuthology.orchestra.run.smithi119.stdout: "overall": { 2024-09-13T21:55:16.194 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T21:55:16.194 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-13T21:55:16.194 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-13T21:55:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.193+0000 7f51e1f50640 1 -- 172.21.15.119:0/326224446 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f51c806e530 msgr2=0x7f51c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.193+0000 7f51e1f50640 1 --2- 172.21.15.119:0/326224446 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f51c806e530 0x7f51c80709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009ac0 tx=0x7f51cc035040 comp rx=0 tx=0).stop 2024-09-13T21:55:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.193+0000 7f51e1f50640 1 -- 172.21.15.119:0/326224446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc102ed0 msgr2=0x7f51dc113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.193+0000 7f51e1f50640 1 --2- 172.21.15.119:0/326224446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc102ed0 0x7f51dc113780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f51c4002840 tx=0x7f51c4004570 comp rx=0 tx=0).stop 2024-09-13T21:55:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.193+0000 7f51e1f50640 1 -- 172.21.15.119:0/326224446 shutdown_connections 2024-09-13T21:55:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.193+0000 7f51e1f50640 1 --2- 172.21.15.119:0/326224446 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f51c806e530 0x7f51c80709e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.193+0000 7f51e1f50640 1 --2- 172.21.15.119:0/326224446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc102ed0 0x7f51dc113780 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.193+0000 7f51e1f50640 1 --2- 172.21.15.119:0/326224446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51dc102530 0x7f51dc113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.193+0000 7f51e1f50640 1 -- 172.21.15.119:0/326224446 >> 172.21.15.119:0/326224446 conn(0x7f51dc0f80f0 msgr2=0x7f51dc0f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.193+0000 7f51e1f50640 1 -- 172.21.15.119:0/326224446 shutdown_connections 2024-09-13T21:55:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:16.193+0000 7f51e1f50640 1 -- 172.21.15.119:0/326224446 wait complete. 2024-09-13T21:55:16.544 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:16 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/326224446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:55:16.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:16 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/326224446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:55:16.877 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-13T21:55:17.121 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:17.539 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:17 smithi119 ceph-mon[90896]: pgmap v289: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:17 smithi155 ceph-mon[79928]: pgmap v289: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:18.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.699+0000 7eff2cf98640 1 -- 172.21.15.119:0/1982338425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff280fdf10 msgr2=0x7eff281065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:18.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.699+0000 7eff2cf98640 1 --2- 172.21.15.119:0/1982338425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff280fdf10 0x7eff281065e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7eff1c004900 tx=0x7eff1c009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:18.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.699+0000 7eff2cf98640 1 -- 172.21.15.119:0/1982338425 shutdown_connections 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.699+0000 7eff2cf98640 1 --2- 172.21.15.119:0/1982338425 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff280fdf10 0x7eff281065e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.699+0000 7eff2cf98640 1 --2- 172.21.15.119:0/1982338425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff280fd570 0x7eff280fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.699+0000 7eff2cf98640 1 -- 172.21.15.119:0/1982338425 >> 172.21.15.119:0/1982338425 conn(0x7eff280f7010 msgr2=0x7eff280f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.699+0000 7eff2cf98640 1 -- 172.21.15.119:0/1982338425 shutdown_connections 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.699+0000 7eff2cf98640 1 -- 172.21.15.119:0/1982338425 wait complete. 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.699+0000 7eff2cf98640 1 Processor -- start 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.699+0000 7eff2cf98640 1 -- start start 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff2cf98640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff280fd570 0x7eff280fb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff2cf98640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff280fdf10 0x7eff280fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff2cf98640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280fbf40 con 0x7eff280fdf10 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff2cf98640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280fc0b0 con 0x7eff280fd570 2024-09-13T21:55:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff25d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff280fdf10 0x7eff280fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff25d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff280fdf10 0x7eff280fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50604/0 (socket says 172.21.15.119:50604) 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff25d9b640 1 -- 172.21.15.119:0/69755542 learned_addr learned my addr 172.21.15.119:0/69755542 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff2659c640 1 --2- 172.21.15.119:0/69755542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff280fd570 0x7eff280fb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff25d9b640 1 -- 172.21.15.119:0/69755542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff280fd570 msgr2=0x7eff280fb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff25d9b640 1 --2- 172.21.15.119:0/69755542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff280fd570 0x7eff280fb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff25d9b640 1 -- 172.21.15.119:0/69755542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c005040 con 0x7eff280fdf10 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff25d9b640 1 --2- 172.21.15.119:0/69755542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff280fdf10 0x7eff280fb970 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7eff1c004960 tx=0x7eff1c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff16ffd640 1 -- 172.21.15.119:0/69755542 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff1c038070 con 0x7eff280fdf10 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff16ffd640 1 -- 172.21.15.119:0/69755542 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff1c008ed0 con 0x7eff280fdf10 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff2cf98640 1 -- 172.21.15.119:0/69755542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff281195e0 con 0x7eff280fdf10 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff16ffd640 1 -- 172.21.15.119:0/69755542 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff1c0095a0 con 0x7eff280fdf10 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.700+0000 7eff2cf98640 1 -- 172.21.15.119:0/69755542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff28119960 con 0x7eff280fdf10 2024-09-13T21:55:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.702+0000 7eff2cf98640 1 -- 172.21.15.119:0/69755542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff28066330 con 0x7eff280fdf10 2024-09-13T21:55:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.702+0000 7eff16ffd640 1 -- 172.21.15.119:0/69755542 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7eff1c030020 con 0x7eff280fdf10 2024-09-13T21:55:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.702+0000 7eff16ffd640 1 --2- 172.21.15.119:0/69755542 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7eff1006e530 0x7eff100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.703+0000 7eff16ffd640 1 -- 172.21.15.119:0/69755542 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7eff1c0adfe0 con 0x7eff280fdf10 2024-09-13T21:55:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.703+0000 7eff2659c640 1 --2- 172.21.15.119:0/69755542 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7eff1006e530 0x7eff100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.703+0000 7eff2659c640 1 --2- 172.21.15.119:0/69755542 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7eff1006e530 0x7eff100709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff18006fd0 tx=0x7eff18008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.707+0000 7eff16ffd640 1 -- 172.21.15.119:0/69755542 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7eff1c0771b0 con 0x7eff280fdf10 2024-09-13T21:55:18.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.939+0000 7eff2cf98640 1 -- 172.21.15.119:0/69755542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7eff28109620 con 0x7eff280fdf10 2024-09-13T21:55:18.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.939+0000 7eff16ffd640 1 -- 172.21.15.119:0/69755542 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7eff1c07a870 con 0x7eff280fdf10 2024-09-13T21:55:18.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.941+0000 7eff2cf98640 1 -- 172.21.15.119:0/69755542 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7eff1006e530 msgr2=0x7eff100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:18.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.941+0000 7eff2cf98640 1 --2- 172.21.15.119:0/69755542 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7eff1006e530 0x7eff100709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff18006fd0 tx=0x7eff18008040 comp rx=0 tx=0).stop 2024-09-13T21:55:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.941+0000 7eff2cf98640 1 -- 172.21.15.119:0/69755542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff280fdf10 msgr2=0x7eff280fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.941+0000 7eff2cf98640 1 --2- 172.21.15.119:0/69755542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff280fdf10 0x7eff280fb970 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7eff1c004960 tx=0x7eff1c009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.941+0000 7eff2cf98640 1 -- 172.21.15.119:0/69755542 shutdown_connections 2024-09-13T21:55:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.941+0000 7eff2cf98640 1 --2- 172.21.15.119:0/69755542 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7eff1006e530 0x7eff100709e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.941+0000 7eff2cf98640 1 --2- 172.21.15.119:0/69755542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff280fdf10 0x7eff280fb970 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.941+0000 7eff2cf98640 1 --2- 172.21.15.119:0/69755542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff280fd570 0x7eff280fb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.941+0000 7eff2cf98640 1 -- 172.21.15.119:0/69755542 >> 172.21.15.119:0/69755542 conn(0x7eff280f7010 msgr2=0x7eff280f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.942+0000 7eff2cf98640 1 -- 172.21.15.119:0/69755542 shutdown_connections 2024-09-13T21:55:18.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:18.942+0000 7eff2cf98640 1 -- 172.21.15.119:0/69755542 wait complete. 2024-09-13T21:55:18.951 INFO:teuthology.orchestra.run.smithi119.stdout:true 2024-09-13T21:55:19.552 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:19 smithi119 ceph-mon[90896]: pgmap v290: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:19.553 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:19 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/69755542' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:55:19.574 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-13T21:55:19.818 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:19 smithi155 ceph-mon[79928]: pgmap v290: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:19 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/69755542' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:55:21.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.425+0000 7efe47e5d640 1 -- 172.21.15.119:0/63574115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40102ef0 msgr2=0x7efe400fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:21.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.425+0000 7efe47e5d640 1 --2- 172.21.15.119:0/63574115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40102ef0 0x7efe400fc5b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efe300048d0 tx=0x7efe30009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:21.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.425+0000 7efe47e5d640 1 -- 172.21.15.119:0/63574115 shutdown_connections 2024-09-13T21:55:21.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.425+0000 7efe47e5d640 1 --2- 172.21.15.119:0/63574115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40102ef0 0x7efe400fc5b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:21.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.425+0000 7efe47e5d640 1 --2- 172.21.15.119:0/63574115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe40102550 0x7efe40102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.425+0000 7efe47e5d640 1 -- 172.21.15.119:0/63574115 >> 172.21.15.119:0/63574115 conn(0x7efe400f80f0 msgr2=0x7efe400fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.425+0000 7efe47e5d640 1 -- 172.21.15.119:0/63574115 shutdown_connections 2024-09-13T21:55:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.425+0000 7efe47e5d640 1 -- 172.21.15.119:0/63574115 wait complete. 2024-09-13T21:55:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.426+0000 7efe47e5d640 1 Processor -- start 2024-09-13T21:55:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.426+0000 7efe47e5d640 1 -- start start 2024-09-13T21:55:21.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.426+0000 7efe47e5d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40102550 0x7efe40113510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.426+0000 7efe47e5d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe40102ef0 0x7efe40113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.426+0000 7efe47e5d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe401140a0 con 0x7efe40102550 2024-09-13T21:55:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.426+0000 7efe47e5d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4010d4b0 con 0x7efe40102ef0 2024-09-13T21:55:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.426+0000 7efe45bf9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40102550 0x7efe40113510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.426+0000 7efe45bf9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40102550 0x7efe40113510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50618/0 (socket says 172.21.15.119:50618) 2024-09-13T21:55:21.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.426+0000 7efe45bf9640 1 -- 172.21.15.119:0/2440891017 learned_addr learned my addr 172.21.15.119:0/2440891017 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.426+0000 7efe453f8640 1 --2- 172.21.15.119:0/2440891017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe40102ef0 0x7efe40113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.427+0000 7efe45bf9640 1 -- 172.21.15.119:0/2440891017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe40102ef0 msgr2=0x7efe40113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.427+0000 7efe45bf9640 1 --2- 172.21.15.119:0/2440891017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe40102ef0 0x7efe40113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.427+0000 7efe45bf9640 1 -- 172.21.15.119:0/2440891017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30005040 con 0x7efe40102550 2024-09-13T21:55:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.427+0000 7efe45bf9640 1 --2- 172.21.15.119:0/2440891017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40102550 0x7efe40113510 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efe3c002a80 tx=0x7efe3c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:21.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.427+0000 7efe367fc640 1 -- 172.21.15.119:0/2440891017 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe3c007c30 con 0x7efe40102550 2024-09-13T21:55:21.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.427+0000 7efe367fc640 1 -- 172.21.15.119:0/2440891017 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efe3c00f040 con 0x7efe40102550 2024-09-13T21:55:21.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.427+0000 7efe47e5d640 1 -- 172.21.15.119:0/2440891017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4010d790 con 0x7efe40102550 2024-09-13T21:55:21.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.427+0000 7efe367fc640 1 -- 172.21.15.119:0/2440891017 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe3c00dab0 con 0x7efe40102550 2024-09-13T21:55:21.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.427+0000 7efe47e5d640 1 -- 172.21.15.119:0/2440891017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4010dc80 con 0x7efe40102550 2024-09-13T21:55:21.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.428+0000 7efe47e5d640 1 -- 172.21.15.119:0/2440891017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe400fdcd0 con 0x7efe40102550 2024-09-13T21:55:21.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.428+0000 7efe367fc640 1 -- 172.21.15.119:0/2440891017 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7efe3c00dc10 con 0x7efe40102550 2024-09-13T21:55:21.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.429+0000 7efe367fc640 1 --2- 172.21.15.119:0/2440891017 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe2c06e530 0x7efe2c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:21.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.429+0000 7efe367fc640 1 -- 172.21.15.119:0/2440891017 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7efe3c08da50 con 0x7efe40102550 2024-09-13T21:55:21.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.429+0000 7efe453f8640 1 --2- 172.21.15.119:0/2440891017 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe2c06e530 0x7efe2c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:21.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.429+0000 7efe453f8640 1 --2- 172.21.15.119:0/2440891017 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe2c06e530 0x7efe2c0709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe300048a0 tx=0x7efe30035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:21.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.433+0000 7efe367fc640 1 -- 172.21.15.119:0/2440891017 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efe3c056b90 con 0x7efe40102550 2024-09-13T21:55:21.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:21 smithi119 ceph-mon[90896]: pgmap v291: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:21.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.668+0000 7efe47e5d640 1 -- 172.21.15.119:0/2440891017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efe4004b7b0 con 0x7efe40102550 2024-09-13T21:55:21.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.668+0000 7efe367fc640 1 -- 172.21.15.119:0/2440891017 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7efe3c05a250 con 0x7efe40102550 2024-09-13T21:55:21.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.670+0000 7efe47e5d640 1 -- 172.21.15.119:0/2440891017 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe2c06e530 msgr2=0x7efe2c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:21.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.670+0000 7efe47e5d640 1 --2- 172.21.15.119:0/2440891017 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe2c06e530 0x7efe2c0709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe300048a0 tx=0x7efe30035040 comp rx=0 tx=0).stop 2024-09-13T21:55:21.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.670+0000 7efe47e5d640 1 -- 172.21.15.119:0/2440891017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40102550 msgr2=0x7efe40113510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:21.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.670+0000 7efe47e5d640 1 --2- 172.21.15.119:0/2440891017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40102550 0x7efe40113510 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efe3c002a80 tx=0x7efe3c004600 comp rx=0 tx=0).stop 2024-09-13T21:55:21.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.670+0000 7efe47e5d640 1 -- 172.21.15.119:0/2440891017 shutdown_connections 2024-09-13T21:55:21.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.670+0000 7efe47e5d640 1 --2- 172.21.15.119:0/2440891017 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7efe2c06e530 0x7efe2c0709e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:21.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.670+0000 7efe47e5d640 1 --2- 172.21.15.119:0/2440891017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe40102ef0 0x7efe40113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:21.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.670+0000 7efe47e5d640 1 --2- 172.21.15.119:0/2440891017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe40102550 0x7efe40113510 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:21.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.670+0000 7efe47e5d640 1 -- 172.21.15.119:0/2440891017 >> 172.21.15.119:0/2440891017 conn(0x7efe400f80f0 msgr2=0x7efe400f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:21.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.671+0000 7efe47e5d640 1 -- 172.21.15.119:0/2440891017 shutdown_connections 2024-09-13T21:55:21.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:21.671+0000 7efe47e5d640 1 -- 172.21.15.119:0/2440891017 wait complete. 2024-09-13T21:55:21.680 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)" 2024-09-13T21:55:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:21 smithi155 ceph-mon[79928]: pgmap v291: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:22.425 DEBUG:teuthology.parallel:result is None 2024-09-13T21:55:22.425 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T21:55:22.437 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T21:55:22.437 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9722044-7217-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T21:55:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:22 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2440891017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:55:22.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:55:22.886 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:22 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2440891017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T21:55:22.886 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:55:22.886 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:23.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:23 smithi119 ceph-mon[90896]: pgmap v292: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:23.798 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:23 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:55:23.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:23 smithi155 ceph-mon[79928]: pgmap v292: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:23.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:23 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:55:24.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.295+0000 7f9e04384640 1 -- 172.21.15.119:0/3508478901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc102550 msgr2=0x7f9dfc102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:24.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.295+0000 7f9e04384640 1 --2- 172.21.15.119:0/3508478901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc102550 0x7f9dfc102920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9df80048d0 tx=0x7f9df8009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.295+0000 7f9e04384640 1 -- 172.21.15.119:0/3508478901 shutdown_connections 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.295+0000 7f9e04384640 1 --2- 172.21.15.119:0/3508478901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.295+0000 7f9e04384640 1 --2- 172.21.15.119:0/3508478901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc102550 0x7f9dfc102920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.295+0000 7f9e04384640 1 -- 172.21.15.119:0/3508478901 >> 172.21.15.119:0/3508478901 conn(0x7f9dfc0f80f0 msgr2=0x7f9dfc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.295+0000 7f9e04384640 1 -- 172.21.15.119:0/3508478901 shutdown_connections 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.295+0000 7f9e04384640 1 -- 172.21.15.119:0/3508478901 wait complete. 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e04384640 1 Processor -- start 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e04384640 1 -- start start 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e04384640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dfc102550 0x7f9dfc113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e04384640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e04384640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc114100 con 0x7f9dfc102ef0 2024-09-13T21:55:24.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e04384640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc10d510 con 0x7f9dfc102550 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e0191f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e0191f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56348/0 (socket says 172.21.15.119:56348) 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e0191f640 1 -- 172.21.15.119:0/151400294 learned_addr learned my addr 172.21.15.119:0/151400294 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e02120640 1 --2- 172.21.15.119:0/151400294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dfc102550 0x7f9dfc113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e0191f640 1 -- 172.21.15.119:0/151400294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dfc102550 msgr2=0x7f9dfc113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e0191f640 1 --2- 172.21.15.119:0/151400294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dfc102550 0x7f9dfc113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.296+0000 7f9e0191f640 1 -- 172.21.15.119:0/151400294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df8005040 con 0x7f9dfc102ef0 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.297+0000 7f9e0191f640 1 --2- 172.21.15.119:0/151400294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc113ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009af0 tx=0x7f9dec004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.297+0000 7f9df2ffd640 1 -- 172.21.15.119:0/151400294 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dec007c30 con 0x7f9dfc102ef0 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.297+0000 7f9df2ffd640 1 -- 172.21.15.119:0/151400294 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9dec00f040 con 0x7f9dfc102ef0 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.297+0000 7f9df2ffd640 1 -- 172.21.15.119:0/151400294 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dec00da10 con 0x7f9dfc102ef0 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.297+0000 7f9e04384640 1 -- 172.21.15.119:0/151400294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc10d7f0 con 0x7f9dfc102ef0 2024-09-13T21:55:24.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.297+0000 7f9e04384640 1 -- 172.21.15.119:0/151400294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc10dd90 con 0x7f9dfc102ef0 2024-09-13T21:55:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.298+0000 7f9e04384640 1 -- 172.21.15.119:0/151400294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc0fdcd0 con 0x7f9dfc102ef0 2024-09-13T21:55:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.298+0000 7f9df2ffd640 1 -- 172.21.15.119:0/151400294 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9dec009670 con 0x7f9dfc102ef0 2024-09-13T21:55:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.299+0000 7f9df2ffd640 1 --2- 172.21.15.119:0/151400294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9de806e530 0x7f9de80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.299+0000 7f9df2ffd640 1 -- 172.21.15.119:0/151400294 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9dec08dff0 con 0x7f9dfc102ef0 2024-09-13T21:55:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.299+0000 7f9e02120640 1 --2- 172.21.15.119:0/151400294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9de806e530 0x7f9de80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.299+0000 7f9e02120640 1 --2- 172.21.15.119:0/151400294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9de806e530 0x7f9de80709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009ac0 tx=0x7f9df8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.303+0000 7f9df2ffd640 1 -- 172.21.15.119:0/151400294 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9dec057080 con 0x7f9dfc102ef0 2024-09-13T21:55:24.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.506+0000 7f9e04384640 1 -- 172.21.15.119:0/151400294 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9dfc0fbd50 con 0x7f9dfc102ef0 2024-09-13T21:55:24.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.507+0000 7f9df2ffd640 1 -- 172.21.15.119:0/151400294 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 46 v46) v1 ==== 76+0+1997 (secure 0 0 0) 0x7f9dec05a740 con 0x7f9dfc102ef0 2024-09-13T21:55:24.509 INFO:teuthology.orchestra.run.smithi119.stdout:e46 2024-09-13T21:55:24.509 INFO:teuthology.orchestra.run.smithi119.stdout:btime 2024-09-13T21:52:56:503534+0000 2024-09-13T21:55:24.509 INFO:teuthology.orchestra.run.smithi119.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T21:55:24.509 INFO:teuthology.orchestra.run.smithi119.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T21:55:24.509 INFO:teuthology.orchestra.run.smithi119.stdout:legacy client fscid: 1 2024-09-13T21:55:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:24.509 INFO:teuthology.orchestra.run.smithi119.stdout:Filesystem 'cephfs' (1) 2024-09-13T21:55:24.509 INFO:teuthology.orchestra.run.smithi119.stdout:fs_name cephfs 2024-09-13T21:55:24.509 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 46 2024-09-13T21:55:24.510 INFO:teuthology.orchestra.run.smithi119.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T21:55:24.510 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-13T21:42:10.349266+0000 2024-09-13T21:55:24.510 INFO:teuthology.orchestra.run.smithi119.stdout:modified 2024-09-13T21:52:56.503526+0000 2024-09-13T21:55:24.510 INFO:teuthology.orchestra.run.smithi119.stdout:tableserver 0 2024-09-13T21:55:24.510 INFO:teuthology.orchestra.run.smithi119.stdout:root 0 2024-09-13T21:55:24.510 INFO:teuthology.orchestra.run.smithi119.stdout:session_timeout 60 2024-09-13T21:55:24.510 INFO:teuthology.orchestra.run.smithi119.stdout:session_autoclose 300 2024-09-13T21:55:24.511 INFO:teuthology.orchestra.run.smithi119.stdout:max_file_size 1099511627776 2024-09-13T21:55:24.511 INFO:teuthology.orchestra.run.smithi119.stdout:max_xattr_size 65536 2024-09-13T21:55:24.511 INFO:teuthology.orchestra.run.smithi119.stdout:required_client_features {} 2024-09-13T21:55:24.511 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure 0 2024-09-13T21:55:24.511 INFO:teuthology.orchestra.run.smithi119.stdout:last_failure_osd_epoch 81 2024-09-13T21:55:24.511 INFO:teuthology.orchestra.run.smithi119.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T21:55:24.511 INFO:teuthology.orchestra.run.smithi119.stdout:max_mds 2 2024-09-13T21:55:24.511 INFO:teuthology.orchestra.run.smithi119.stdout:in 0,1 2024-09-13T21:55:24.511 INFO:teuthology.orchestra.run.smithi119.stdout:up {0=34434,1=34438} 2024-09-13T21:55:24.512 INFO:teuthology.orchestra.run.smithi119.stdout:failed 2024-09-13T21:55:24.512 INFO:teuthology.orchestra.run.smithi119.stdout:damaged 2024-09-13T21:55:24.512 INFO:teuthology.orchestra.run.smithi119.stdout:stopped 2024-09-13T21:55:24.512 INFO:teuthology.orchestra.run.smithi119.stdout:data_pools [3] 2024-09-13T21:55:24.512 INFO:teuthology.orchestra.run.smithi119.stdout:metadata_pool 2 2024-09-13T21:55:24.512 INFO:teuthology.orchestra.run.smithi119.stdout:inline_data disabled 2024-09-13T21:55:24.512 INFO:teuthology.orchestra.run.smithi119.stdout:balancer 2024-09-13T21:55:24.512 INFO:teuthology.orchestra.run.smithi119.stdout:bal_rank_mask -1 2024-09-13T21:55:24.513 INFO:teuthology.orchestra.run.smithi119.stdout:standby_count_wanted 1 2024-09-13T21:55:24.513 INFO:teuthology.orchestra.run.smithi119.stdout:qdb_cluster leader: 34434 members: 34434,34438 2024-09-13T21:55:24.513 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.rpmijj{0:34434} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.119:6826/2388971361,v1:172.21.15.119:6827/2388971361] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:55:24.513 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi119.yydzwt{1:34438} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.119:6828/3559937126,v1:172.21.15.119:6829/3559937126] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:55:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:24.513 INFO:teuthology.orchestra.run.smithi119.stdout:Standby daemons: 2024-09-13T21:55:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:24.514 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.yblkxo{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.155:6824/2986837064,v1:172.21.15.155:6825/2986837064] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:55:24.514 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.cephfs.smithi155.afmavb{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.155:6826/3721950377,v1:172.21.15.155:6827/3721950377] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T21:55:24.515 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 46 2024-09-13T21:55:24.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.509+0000 7f9e04384640 1 -- 172.21.15.119:0/151400294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9de806e530 msgr2=0x7f9de80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:24.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.509+0000 7f9e04384640 1 --2- 172.21.15.119:0/151400294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9de806e530 0x7f9de80709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009ac0 tx=0x7f9df8035040 comp rx=0 tx=0).stop 2024-09-13T21:55:24.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.509+0000 7f9e04384640 1 -- 172.21.15.119:0/151400294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc102ef0 msgr2=0x7f9dfc113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:24.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.509+0000 7f9e04384640 1 --2- 172.21.15.119:0/151400294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc113ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009af0 tx=0x7f9dec004570 comp rx=0 tx=0).stop 2024-09-13T21:55:24.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.509+0000 7f9e04384640 1 -- 172.21.15.119:0/151400294 shutdown_connections 2024-09-13T21:55:24.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.509+0000 7f9e04384640 1 --2- 172.21.15.119:0/151400294 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f9de806e530 0x7f9de80709e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:24.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.509+0000 7f9e04384640 1 --2- 172.21.15.119:0/151400294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dfc102ef0 0x7f9dfc113ab0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:24.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.509+0000 7f9e04384640 1 --2- 172.21.15.119:0/151400294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9dfc102550 0x7f9dfc113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:24.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.509+0000 7f9e04384640 1 -- 172.21.15.119:0/151400294 >> 172.21.15.119:0/151400294 conn(0x7f9dfc0f80f0 msgr2=0x7f9dfc0f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:24.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.509+0000 7f9e04384640 1 -- 172.21.15.119:0/151400294 shutdown_connections 2024-09-13T21:55:24.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:24.509+0000 7f9e04384640 1 -- 172.21.15.119:0/151400294 wait complete. 2024-09-13T21:55:24.822 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:55:24.823 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:55:24.823 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:55:24.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:55:24.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:55:24.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:55:25.166 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-13T21:55:25.176 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T21:55:25.425 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:25.708 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:25 smithi119 ceph-mon[90896]: pgmap v293: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:25.708 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:25 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/151400294' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:55:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:25 smithi155 ceph-mon[79928]: pgmap v293: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:25 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/151400294' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T21:55:27.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.066+0000 7f281126e640 1 -- 172.21.15.119:0/2357817358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f280c102620 msgr2=0x7f280c1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:27.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.066+0000 7f281126e640 1 --2- 172.21.15.119:0/2357817358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f280c102620 0x7f280c1029f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0048d0 tx=0x7f27fc009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:27.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.066+0000 7f281126e640 1 -- 172.21.15.119:0/2357817358 shutdown_connections 2024-09-13T21:55:27.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.066+0000 7f281126e640 1 --2- 172.21.15.119:0/2357817358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fac80 0x7f280c0fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:27.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.066+0000 7f281126e640 1 --2- 172.21.15.119:0/2357817358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f280c102620 0x7f280c1029f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:27.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.066+0000 7f281126e640 1 -- 172.21.15.119:0/2357817358 >> 172.21.15.119:0/2357817358 conn(0x7f280c070ce0 msgr2=0x7f280c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:27.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.066+0000 7f281126e640 1 -- 172.21.15.119:0/2357817358 shutdown_connections 2024-09-13T21:55:27.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.066+0000 7f281126e640 1 -- 172.21.15.119:0/2357817358 wait complete. 2024-09-13T21:55:27.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.066+0000 7f281126e640 1 Processor -- start 2024-09-13T21:55:27.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.066+0000 7f281126e640 1 -- start start 2024-09-13T21:55:27.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f281126e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fac80 0x7f280c113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:27.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f281126e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f280c102620 0x7f280c113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:27.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f281126e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c113de0 con 0x7f280c102620 2024-09-13T21:55:27.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f281126e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c10d190 con 0x7f280c0fac80 2024-09-13T21:55:27.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f2803fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f280c102620 0x7f280c113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:27.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f2803fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f280c102620 0x7f280c113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56376/0 (socket says 172.21.15.119:56376) 2024-09-13T21:55:27.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f2803fff640 1 -- 172.21.15.119:0/2532730939 learned_addr learned my addr 172.21.15.119:0/2532730939 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:27.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f280affd640 1 --2- 172.21.15.119:0/2532730939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fac80 0x7f280c113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:27.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f2803fff640 1 -- 172.21.15.119:0/2532730939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fac80 msgr2=0x7f280c113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:27.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f2803fff640 1 --2- 172.21.15.119:0/2532730939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fac80 0x7f280c113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:27.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f2803fff640 1 -- 172.21.15.119:0/2532730939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc005040 con 0x7f280c102620 2024-09-13T21:55:27.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f2803fff640 1 --2- 172.21.15.119:0/2532730939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f280c102620 0x7f280c113750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f27f400b790 tx=0x7f27f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:27.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f28037fe640 1 -- 172.21.15.119:0/2532730939 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27f400c700 con 0x7f280c102620 2024-09-13T21:55:27.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f28037fe640 1 -- 172.21.15.119:0/2532730939 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f27f400cd00 con 0x7f280c102620 2024-09-13T21:55:27.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f281126e640 1 -- 172.21.15.119:0/2532730939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c10d470 con 0x7f280c102620 2024-09-13T21:55:27.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f28037fe640 1 -- 172.21.15.119:0/2532730939 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27f4015e80 con 0x7f280c102620 2024-09-13T21:55:27.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.067+0000 7f281126e640 1 -- 172.21.15.119:0/2532730939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c10d990 con 0x7f280c102620 2024-09-13T21:55:27.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.068+0000 7f281126e640 1 -- 172.21.15.119:0/2532730939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c065790 con 0x7f280c102620 2024-09-13T21:55:27.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.069+0000 7f28037fe640 1 -- 172.21.15.119:0/2532730939 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f27f4012070 con 0x7f280c102620 2024-09-13T21:55:27.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.069+0000 7f28037fe640 1 --2- 172.21.15.119:0/2532730939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f27f806e530 0x7f27f80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:27.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.069+0000 7f28037fe640 1 -- 172.21.15.119:0/2532730939 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f27f408daf0 con 0x7f280c102620 2024-09-13T21:55:27.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.069+0000 7f280affd640 1 --2- 172.21.15.119:0/2532730939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f27f806e530 0x7f27f80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:27.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.070+0000 7f280affd640 1 --2- 172.21.15.119:0/2532730939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f27f806e530 0x7f27f80709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f27fc000c00 tx=0x7f27fc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:27.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.074+0000 7f28037fe640 1 -- 172.21.15.119:0/2532730939 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f27f4056b80 con 0x7f280c102620 2024-09-13T21:55:27.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.274+0000 7f281126e640 1 -- 172.21.15.119:0/2532730939 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f280c10d600 con 0x7f280c102620 2024-09-13T21:55:27.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.275+0000 7f28037fe640 1 -- 172.21.15.119:0/2532730939 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+5284 (secure 0 0 0) 0x7f280c10d600 con 0x7f280c102620 2024-09-13T21:55:27.277 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:27.277 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":46,"btime":"2024-09-13T21:52:56:503534+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44327,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/2986837064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2986837064},{"type":"v1","addr":"172.21.15.155:6825","nonce":2986837064}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":44331,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6827/3721950377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3721950377},{"type":"v1","addr":"172.21.15.155:6827","nonce":3721950377}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:56.503526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34434,"mds_1":34438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34438":{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":1,"incarnation":45,"state":"up:active","state_seq":12,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434,34438]},"id":1}]} 2024-09-13T21:55:27.277 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 46 2024-09-13T21:55:27.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.277+0000 7f281126e640 1 -- 172.21.15.119:0/2532730939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f27f806e530 msgr2=0x7f27f80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:27.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.277+0000 7f281126e640 1 --2- 172.21.15.119:0/2532730939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f27f806e530 0x7f27f80709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f27fc000c00 tx=0x7f27fc035040 comp rx=0 tx=0).stop 2024-09-13T21:55:27.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.277+0000 7f281126e640 1 -- 172.21.15.119:0/2532730939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f280c102620 msgr2=0x7f280c113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:27.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.277+0000 7f281126e640 1 --2- 172.21.15.119:0/2532730939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f280c102620 0x7f280c113750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f27f400b790 tx=0x7f27f40091d0 comp rx=0 tx=0).stop 2024-09-13T21:55:27.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.277+0000 7f281126e640 1 -- 172.21.15.119:0/2532730939 shutdown_connections 2024-09-13T21:55:27.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.277+0000 7f281126e640 1 --2- 172.21.15.119:0/2532730939 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f27f806e530 0x7f27f80709e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:27.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.277+0000 7f281126e640 1 --2- 172.21.15.119:0/2532730939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f280c102620 0x7f280c113750 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:27.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.277+0000 7f281126e640 1 --2- 172.21.15.119:0/2532730939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f280c0fac80 0x7f280c113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:27.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.277+0000 7f281126e640 1 -- 172.21.15.119:0/2532730939 >> 172.21.15.119:0/2532730939 conn(0x7f280c070ce0 msgr2=0x7f280c100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:27.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.277+0000 7f281126e640 1 -- 172.21.15.119:0/2532730939 shutdown_connections 2024-09-13T21:55:27.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:27.277+0000 7f281126e640 1 -- 172.21.15.119:0/2532730939 wait complete. 2024-09-13T21:55:27.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:27 smithi119 ceph-mon[90896]: pgmap v294: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:27.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:27 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2532730939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:55:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:27 smithi155 ceph-mon[79928]: pgmap v294: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:27 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2532730939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T21:55:27.965 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 18} 2024-09-13T21:55:27.965 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-13T21:55:28.213 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:29.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:29 smithi119 ceph-mon[90896]: pgmap v295: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:29.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:29 smithi155 ceph-mon[79928]: pgmap v295: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:29.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.857+0000 7f3a90089640 1 -- 172.21.15.119:0/1685692272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a880fac80 msgr2=0x7f3a880fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:29.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.857+0000 7f3a90089640 1 --2- 172.21.15.119:0/1685692272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a880fac80 0x7f3a880fb0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3a780048d0 tx=0x7f3a78009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:29.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.857+0000 7f3a90089640 1 -- 172.21.15.119:0/1685692272 shutdown_connections 2024-09-13T21:55:29.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.857+0000 7f3a90089640 1 --2- 172.21.15.119:0/1685692272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a880fac80 0x7f3a880fb0d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:29.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.857+0000 7f3a90089640 1 --2- 172.21.15.119:0/1685692272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880fd3a0 0x7f3a880fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:29.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.857+0000 7f3a90089640 1 -- 172.21.15.119:0/1685692272 >> 172.21.15.119:0/1685692272 conn(0x7f3a88070ce0 msgr2=0x7f3a880710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:29.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.857+0000 7f3a90089640 1 -- 172.21.15.119:0/1685692272 shutdown_connections 2024-09-13T21:55:29.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.857+0000 7f3a90089640 1 -- 172.21.15.119:0/1685692272 wait complete. 2024-09-13T21:55:29.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.857+0000 7f3a90089640 1 Processor -- start 2024-09-13T21:55:29.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.857+0000 7f3a90089640 1 -- start start 2024-09-13T21:55:29.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a90089640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880fac80 0x7f3a881153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:29.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a90089640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a880fd3a0 0x7f3a88115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:29.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a90089640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a88115f20 con 0x7f3a880fd3a0 2024-09-13T21:55:29.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a90089640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a88116090 con 0x7f3a880fac80 2024-09-13T21:55:29.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a8d624640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a880fd3a0 0x7f3a88115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a8d624640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a880fd3a0 0x7f3a88115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56386/0 (socket says 172.21.15.119:56386) 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a8d624640 1 -- 172.21.15.119:0/2183991590 learned_addr learned my addr 172.21.15.119:0/2183991590 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a8de25640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880fac80 0x7f3a881153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a8d624640 1 -- 172.21.15.119:0/2183991590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880fac80 msgr2=0x7f3a881153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a8d624640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880fac80 0x7f3a881153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a8d624640 1 -- 172.21.15.119:0/2183991590 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78005040 con 0x7f3a880fd3a0 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a8de25640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880fac80 0x7f3a881153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a8d624640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a880fd3a0 0x7f3a88115920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3a78003080 tx=0x7f3a78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a7e7fc640 1 -- 172.21.15.119:0/2183991590 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a78038070 con 0x7f3a880fd3a0 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a90089640 1 -- 172.21.15.119:0/2183991590 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8810f4b0 con 0x7f3a880fd3a0 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a7e7fc640 1 -- 172.21.15.119:0/2183991590 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3a780097e0 con 0x7f3a880fd3a0 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a7e7fc640 1 -- 172.21.15.119:0/2183991590 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a7803d420 con 0x7f3a880fd3a0 2024-09-13T21:55:29.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.858+0000 7f3a90089640 1 -- 172.21.15.119:0/2183991590 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8810f970 con 0x7f3a880fd3a0 2024-09-13T21:55:29.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.859+0000 7f3a90089640 1 -- 172.21.15.119:0/2183991590 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a880fbc90 con 0x7f3a880fd3a0 2024-09-13T21:55:29.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.860+0000 7f3a7e7fc640 1 -- 172.21.15.119:0/2183991590 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3a78030020 con 0x7f3a880fd3a0 2024-09-13T21:55:29.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.860+0000 7f3a7e7fc640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3a7406e530 0x7f3a740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:29.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.860+0000 7f3a7e7fc640 1 -- 172.21.15.119:0/2183991590 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3a780ae780 con 0x7f3a880fd3a0 2024-09-13T21:55:29.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.860+0000 7f3a8de25640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3a7406e530 0x7f3a740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:29.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.861+0000 7f3a8de25640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3a7406e530 0x7f3a740709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a84004c80 tx=0x7f3a84009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:29.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:29.865+0000 7f3a7e7fc640 1 -- 172.21.15.119:0/2183991590 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3a78077810 con 0x7f3a880fd3a0 2024-09-13T21:55:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.062+0000 7f3a90089640 1 -- 172.21.15.119:0/2183991590 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f3a88074c00 con 0x7f3a880fd3a0 2024-09-13T21:55:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.062+0000 7f3a7e7fc640 1 -- 172.21.15.119:0/2183991590 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v46) v1 ==== 107+0+4921 (secure 0 0 0) 0x7f3a7807aed0 con 0x7f3a880fd3a0 2024-09-13T21:55:30.065 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:30.065 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":19,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24283,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/1506378601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1506378601},{"type":"v1","addr":"172.21.15.119:6827","nonce":1506378601}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:44:07.446483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14472,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi155.yblkxo","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6825/1473450727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1473450727},{"type":"v1","addr":"172.21.15.155:6825","nonce":1473450727}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:55:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 19 2024-09-13T21:55:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.065+0000 7f3a90089640 1 -- 172.21.15.119:0/2183991590 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3a7406e530 msgr2=0x7f3a740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.065+0000 7f3a90089640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3a7406e530 0x7f3a740709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a84004c80 tx=0x7f3a84009040 comp rx=0 tx=0).stop 2024-09-13T21:55:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.065+0000 7f3a90089640 1 -- 172.21.15.119:0/2183991590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a880fd3a0 msgr2=0x7f3a88115920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.065+0000 7f3a90089640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a880fd3a0 0x7f3a88115920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3a78003080 tx=0x7f3a78009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.065+0000 7f3a90089640 1 -- 172.21.15.119:0/2183991590 shutdown_connections 2024-09-13T21:55:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.065+0000 7f3a90089640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3a7406e530 0x7f3a740709e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.065+0000 7f3a90089640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a880fd3a0 0x7f3a88115920 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.065+0000 7f3a90089640 1 --2- 172.21.15.119:0/2183991590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880fac80 0x7f3a881153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.065+0000 7f3a90089640 1 -- 172.21.15.119:0/2183991590 >> 172.21.15.119:0/2183991590 conn(0x7f3a88070ce0 msgr2=0x7f3a880f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.065+0000 7f3a90089640 1 -- 172.21.15.119:0/2183991590 shutdown_connections 2024-09-13T21:55:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:30.065+0000 7f3a90089640 1 -- 172.21.15.119:0/2183991590 wait complete. 2024-09-13T21:55:30.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:30 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2183991590' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T21:55:30.685 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-13T21:55:30.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:30 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2183991590' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T21:55:30.931 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:31.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:31 smithi119 ceph-mon[90896]: pgmap v296: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:31.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:31 smithi155 ceph-mon[79928]: pgmap v296: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:32.592 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:32 smithi119 ceph-mon[90896]: pgmap v297: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:32.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.589+0000 7f75161d9640 1 -- 172.21.15.119:0/2458506480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7510102660 msgr2=0x7f7510102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:32.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.589+0000 7f75161d9640 1 --2- 172.21.15.119:0/2458506480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7510102660 0x7f7510102a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f75000048d0 tx=0x7f7500009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:32.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.590+0000 7f75161d9640 1 -- 172.21.15.119:0/2458506480 shutdown_connections 2024-09-13T21:55:32.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.590+0000 7f75161d9640 1 --2- 172.21.15.119:0/2458506480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75100fac80 0x7f75100fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:32.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.590+0000 7f75161d9640 1 --2- 172.21.15.119:0/2458506480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7510102660 0x7f7510102a30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:32.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.590+0000 7f75161d9640 1 -- 172.21.15.119:0/2458506480 >> 172.21.15.119:0/2458506480 conn(0x7f7510070ce0 msgr2=0x7f75100710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:32.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.590+0000 7f75161d9640 1 -- 172.21.15.119:0/2458506480 shutdown_connections 2024-09-13T21:55:32.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.590+0000 7f75161d9640 1 -- 172.21.15.119:0/2458506480 wait complete. 2024-09-13T21:55:32.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.590+0000 7f75161d9640 1 Processor -- start 2024-09-13T21:55:32.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.590+0000 7f75161d9640 1 -- start start 2024-09-13T21:55:32.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f75161d9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75100fac80 0x7f75100fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f75161d9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7510102660 0x7f75100fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f75161d9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75100fc930 con 0x7f75100fac80 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f75161d9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75100fcaa0 con 0x7f7510102660 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f750f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75100fac80 0x7f75100fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f750f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75100fac80 0x7f75100fbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56392/0 (socket says 172.21.15.119:56392) 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f750f7fe640 1 -- 172.21.15.119:0/2921656886 learned_addr learned my addr 172.21.15.119:0/2921656886 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f750effd640 1 --2- 172.21.15.119:0/2921656886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7510102660 0x7f75100fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f750f7fe640 1 -- 172.21.15.119:0/2921656886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7510102660 msgr2=0x7f75100fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f750f7fe640 1 --2- 172.21.15.119:0/2921656886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7510102660 0x7f75100fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f750f7fe640 1 -- 172.21.15.119:0/2921656886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7500005040 con 0x7f75100fac80 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f750f7fe640 1 --2- 172.21.15.119:0/2921656886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75100fac80 0x7f75100fbe60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f75000043d0 tx=0x7f7500009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f74f7fff640 1 -- 172.21.15.119:0/2921656886 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7500038070 con 0x7f75100fac80 2024-09-13T21:55:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f74f7fff640 1 -- 172.21.15.119:0/2921656886 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f75000096e0 con 0x7f75100fac80 2024-09-13T21:55:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f75161d9640 1 -- 172.21.15.119:0/2921656886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75101194d0 con 0x7f75100fac80 2024-09-13T21:55:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f74f7fff640 1 -- 172.21.15.119:0/2921656886 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f750003d420 con 0x7f75100fac80 2024-09-13T21:55:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.591+0000 7f75161d9640 1 -- 172.21.15.119:0/2921656886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75101198b0 con 0x7f75100fac80 2024-09-13T21:55:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.592+0000 7f75161d9640 1 -- 172.21.15.119:0/2921656886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75100657d0 con 0x7f75100fac80 2024-09-13T21:55:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.593+0000 7f74f7fff640 1 -- 172.21.15.119:0/2921656886 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7500030020 con 0x7f75100fac80 2024-09-13T21:55:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.593+0000 7f74f7fff640 1 --2- 172.21.15.119:0/2921656886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f74f806e530 0x7f74f80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.593+0000 7f74f7fff640 1 -- 172.21.15.119:0/2921656886 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f75000ae5c0 con 0x7f75100fac80 2024-09-13T21:55:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.593+0000 7f750effd640 1 --2- 172.21.15.119:0/2921656886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f74f806e530 0x7f74f80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.594+0000 7f750effd640 1 --2- 172.21.15.119:0/2921656886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f74f806e530 0x7f74f80709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75100fd7a0 tx=0x7f750400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.598+0000 7f74f7fff640 1 -- 172.21.15.119:0/2921656886 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f75000776d0 con 0x7f75100fac80 2024-09-13T21:55:32.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.799+0000 7f75161d9640 1 -- 172.21.15.119:0/2921656886 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f7510074c00 con 0x7f75100fac80 2024-09-13T21:55:32.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.800+0000 7f74f7fff640 1 -- 172.21.15.119:0/2921656886 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v46) v1 ==== 107+0+4922 (secure 0 0 0) 0x7f750007ad90 con 0x7f75100fac80 2024-09-13T21:55:32.802 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:32.802 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":20,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24283,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/1506378601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1506378601},{"type":"v1","addr":"172.21.15.119:6827","nonce":1506378601}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:45:37.594101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14472,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi155.yblkxo","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6825/1473450727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1473450727},{"type":"v1","addr":"172.21.15.155:6825","nonce":1473450727}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:55:32.803 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 20 2024-09-13T21:55:32.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.802+0000 7f75161d9640 1 -- 172.21.15.119:0/2921656886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f74f806e530 msgr2=0x7f74f80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:32.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.802+0000 7f75161d9640 1 --2- 172.21.15.119:0/2921656886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f74f806e530 0x7f74f80709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75100fd7a0 tx=0x7f750400b040 comp rx=0 tx=0).stop 2024-09-13T21:55:32.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.802+0000 7f75161d9640 1 -- 172.21.15.119:0/2921656886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75100fac80 msgr2=0x7f75100fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:32.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.802+0000 7f75161d9640 1 --2- 172.21.15.119:0/2921656886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75100fac80 0x7f75100fbe60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f75000043d0 tx=0x7f7500009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:32.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.802+0000 7f75161d9640 1 -- 172.21.15.119:0/2921656886 shutdown_connections 2024-09-13T21:55:32.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.802+0000 7f75161d9640 1 --2- 172.21.15.119:0/2921656886 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f74f806e530 0x7f74f80709e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:32.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.802+0000 7f75161d9640 1 --2- 172.21.15.119:0/2921656886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7510102660 0x7f75100fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:32.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.802+0000 7f75161d9640 1 --2- 172.21.15.119:0/2921656886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75100fac80 0x7f75100fbe60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:32.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.802+0000 7f75161d9640 1 -- 172.21.15.119:0/2921656886 >> 172.21.15.119:0/2921656886 conn(0x7f7510070ce0 msgr2=0x7f75100fa050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:32.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.802+0000 7f75161d9640 1 -- 172.21.15.119:0/2921656886 shutdown_connections 2024-09-13T21:55:32.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:32.802+0000 7f75161d9640 1 -- 172.21.15.119:0/2921656886 wait complete. 2024-09-13T21:55:32.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:32 smithi155 ceph-mon[79928]: pgmap v297: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:33.403 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-13T21:55:33.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:33 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2921656886' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T21:55:33.649 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:33.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:33 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2921656886' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T21:55:34.725 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:34 smithi119 ceph-mon[90896]: pgmap v298: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:34.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:34 smithi155 ceph-mon[79928]: pgmap v298: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 -- 172.21.15.119:0/2712897229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9000fb810 msgr2=0x7fa9000fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 --2- 172.21.15.119:0/2712897229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9000fb810 0x7fa9000fbbe0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00048d0 tx=0x7fa8f0009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 -- 172.21.15.119:0/2712897229 shutdown_connections 2024-09-13T21:55:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 --2- 172.21.15.119:0/2712897229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fcf80 0x7fa9000fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 --2- 172.21.15.119:0/2712897229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9000fb810 0x7fa9000fbbe0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 -- 172.21.15.119:0/2712897229 >> 172.21.15.119:0/2712897229 conn(0x7fa9000723b0 msgr2=0x7fa9000727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 -- 172.21.15.119:0/2712897229 shutdown_connections 2024-09-13T21:55:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 -- 172.21.15.119:0/2712897229 wait complete. 2024-09-13T21:55:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 Processor -- start 2024-09-13T21:55:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 -- start start 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fb810 0x7fa9001131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9000fcf80 0x7fa900113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa900113d10 con 0x7fa9000fcf80 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.238+0000 7fa906299640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90010d150 con 0x7fa9000fb810 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa8f7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9000fcf80 0x7fa900113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa8f7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9000fcf80 0x7fa900113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36568/0 (socket says 172.21.15.119:36568) 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa8f7fff640 1 -- 172.21.15.119:0/1001753905 learned_addr learned my addr 172.21.15.119:0/1001753905 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa8fffff640 1 --2- 172.21.15.119:0/1001753905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fb810 0x7fa9001131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa8f7fff640 1 -- 172.21.15.119:0/1001753905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fb810 msgr2=0x7fa9001131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa8f7fff640 1 --2- 172.21.15.119:0/1001753905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fb810 0x7fa9001131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa8f7fff640 1 -- 172.21.15.119:0/1001753905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f0005040 con 0x7fa9000fcf80 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa8f7fff640 1 --2- 172.21.15.119:0/1001753905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9000fcf80 0x7fa900113710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800c830 tx=0x7fa8e8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa8fd7fa640 1 -- 172.21.15.119:0/1001753905 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8e800a7d0 con 0x7fa9000fcf80 2024-09-13T21:55:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa906299640 1 -- 172.21.15.119:0/1001753905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90010d430 con 0x7fa9000fcf80 2024-09-13T21:55:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa8fd7fa640 1 -- 172.21.15.119:0/1001753905 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa8e800add0 con 0x7fa9000fcf80 2024-09-13T21:55:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa8fd7fa640 1 -- 172.21.15.119:0/1001753905 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8e80113a0 con 0x7fa9000fcf80 2024-09-13T21:55:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.239+0000 7fa906299640 1 -- 172.21.15.119:0/1001753905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90010d9d0 con 0x7fa9000fcf80 2024-09-13T21:55:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.240+0000 7fa906299640 1 -- 172.21.15.119:0/1001753905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9000fcbc0 con 0x7fa9000fcf80 2024-09-13T21:55:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.241+0000 7fa8fd7fa640 1 -- 172.21.15.119:0/1001753905 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa8e8012400 con 0x7fa9000fcf80 2024-09-13T21:55:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.241+0000 7fa8fd7fa640 1 --2- 172.21.15.119:0/1001753905 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa8ec06e530 0x7fa8ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.241+0000 7fa8fd7fa640 1 -- 172.21.15.119:0/1001753905 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa8e808e2e0 con 0x7fa9000fcf80 2024-09-13T21:55:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.241+0000 7fa8fffff640 1 --2- 172.21.15.119:0/1001753905 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa8ec06e530 0x7fa8ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.242+0000 7fa8fffff640 1 --2- 172.21.15.119:0/1001753905 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa8ec06e530 0x7fa8ec0709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009ac0 tx=0x7fa8f0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:35.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.246+0000 7fa8fd7fa640 1 -- 172.21.15.119:0/1001753905 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa8e80573f0 con 0x7fa9000fcf80 2024-09-13T21:55:35.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.444+0000 7fa906299640 1 -- 172.21.15.119:0/1001753905 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fa900072ec0 con 0x7fa9000fcf80 2024-09-13T21:55:35.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.445+0000 7fa8fd7fa640 1 -- 172.21.15.119:0/1001753905 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v46) v1 ==== 107+0+4936 (secure 0 0 0) 0x7fa8e805aab0 con 0x7fa9000fcf80 2024-09-13T21:55:35.447 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:35.447 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"btime":"2024-09-13T21:47:57:552017+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24283,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/1506378601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1506378601},{"type":"v1","addr":"172.21.15.119:6827","nonce":1506378601}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:47:57.552013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14472,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi155.yblkxo","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6825/1473450727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1473450727},{"type":"v1","addr":"172.21.15.155:6825","nonce":1473450727}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472,24267]},"id":1}]} 2024-09-13T21:55:35.448 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 21 2024-09-13T21:55:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.447+0000 7fa906299640 1 -- 172.21.15.119:0/1001753905 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa8ec06e530 msgr2=0x7fa8ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.447+0000 7fa906299640 1 --2- 172.21.15.119:0/1001753905 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa8ec06e530 0x7fa8ec0709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009ac0 tx=0x7fa8f0035040 comp rx=0 tx=0).stop 2024-09-13T21:55:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.447+0000 7fa906299640 1 -- 172.21.15.119:0/1001753905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9000fcf80 msgr2=0x7fa900113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.447+0000 7fa906299640 1 --2- 172.21.15.119:0/1001753905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9000fcf80 0x7fa900113710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800c830 tx=0x7fa8e8004430 comp rx=0 tx=0).stop 2024-09-13T21:55:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.447+0000 7fa906299640 1 -- 172.21.15.119:0/1001753905 shutdown_connections 2024-09-13T21:55:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.447+0000 7fa906299640 1 --2- 172.21.15.119:0/1001753905 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa8ec06e530 0x7fa8ec0709e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:35.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.447+0000 7fa906299640 1 --2- 172.21.15.119:0/1001753905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9000fcf80 0x7fa900113710 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:35.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.447+0000 7fa906299640 1 --2- 172.21.15.119:0/1001753905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9000fb810 0x7fa9001131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:35.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.447+0000 7fa906299640 1 -- 172.21.15.119:0/1001753905 >> 172.21.15.119:0/1001753905 conn(0x7fa9000723b0 msgr2=0x7fa900064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:35.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.447+0000 7fa906299640 1 -- 172.21.15.119:0/1001753905 shutdown_connections 2024-09-13T21:55:35.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:35.447+0000 7fa906299640 1 -- 172.21.15.119:0/1001753905 wait complete. 2024-09-13T21:55:35.823 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:35 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1001753905' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T21:55:35.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:35 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1001753905' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T21:55:36.164 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-13T21:55:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:36.749 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:36 smithi119 ceph-mon[90896]: pgmap v299: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:36.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:36 smithi155 ceph-mon[79928]: pgmap v299: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:37.514 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:55:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:55:38.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.026+0000 7fe252582640 1 -- 172.21.15.119:0/1819954899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24c102620 msgr2=0x7fe24c1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:38.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.026+0000 7fe252582640 1 --2- 172.21.15.119:0/1819954899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24c102620 0x7fe24c1029f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0048d0 tx=0x7fe23c009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:38.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.026+0000 7fe252582640 1 -- 172.21.15.119:0/1819954899 shutdown_connections 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.026+0000 7fe252582640 1 --2- 172.21.15.119:0/1819954899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe24c0fac80 0x7fe24c0fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.026+0000 7fe252582640 1 --2- 172.21.15.119:0/1819954899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24c102620 0x7fe24c1029f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.026+0000 7fe252582640 1 -- 172.21.15.119:0/1819954899 >> 172.21.15.119:0/1819954899 conn(0x7fe24c070ce0 msgr2=0x7fe24c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.026+0000 7fe252582640 1 -- 172.21.15.119:0/1819954899 shutdown_connections 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.026+0000 7fe252582640 1 -- 172.21.15.119:0/1819954899 wait complete. 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.027+0000 7fe252582640 1 Processor -- start 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.027+0000 7fe252582640 1 -- start start 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.027+0000 7fe252582640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24c0fac80 0x7fe24c1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.027+0000 7fe252582640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe24c102620 0x7fe24c113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.027+0000 7fe252582640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c113d10 con 0x7fe24c0fac80 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.027+0000 7fe252582640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c10d150 con 0x7fe24c102620 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.027+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24c0fac80 0x7fe24c1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:38.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.027+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24c0fac80 0x7fe24c1131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36594/0 (socket says 172.21.15.119:36594) 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.027+0000 7fe24bfff640 1 -- 172.21.15.119:0/2755803347 learned_addr learned my addr 172.21.15.119:0/2755803347 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.028+0000 7fe24b7fe640 1 --2- 172.21.15.119:0/2755803347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe24c102620 0x7fe24c113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.028+0000 7fe24bfff640 1 -- 172.21.15.119:0/2755803347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe24c102620 msgr2=0x7fe24c113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.028+0000 7fe24bfff640 1 --2- 172.21.15.119:0/2755803347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe24c102620 0x7fe24c113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.028+0000 7fe24bfff640 1 -- 172.21.15.119:0/2755803347 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c005040 con 0x7fe24c0fac80 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.028+0000 7fe24bfff640 1 --2- 172.21.15.119:0/2755803347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24c0fac80 0x7fe24c1131d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe23c000c00 tx=0x7fe23c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.028+0000 7fe248ff9640 1 -- 172.21.15.119:0/2755803347 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe23c038070 con 0x7fe24c0fac80 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.028+0000 7fe248ff9640 1 -- 172.21.15.119:0/2755803347 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe23c02ade0 con 0x7fe24c0fac80 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.028+0000 7fe252582640 1 -- 172.21.15.119:0/2755803347 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c10d3d0 con 0x7fe24c0fac80 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.028+0000 7fe248ff9640 1 -- 172.21.15.119:0/2755803347 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe23c02c7e0 con 0x7fe24c0fac80 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.028+0000 7fe252582640 1 -- 172.21.15.119:0/2755803347 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c10d890 con 0x7fe24c0fac80 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.029+0000 7fe252582640 1 -- 172.21.15.119:0/2755803347 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c0657b0 con 0x7fe24c0fac80 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.030+0000 7fe248ff9640 1 -- 172.21.15.119:0/2755803347 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe23c030020 con 0x7fe24c0fac80 2024-09-13T21:55:38.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.030+0000 7fe248ff9640 1 --2- 172.21.15.119:0/2755803347 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe23406e530 0x7fe2340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:38.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.030+0000 7fe248ff9640 1 -- 172.21.15.119:0/2755803347 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe23c0ade50 con 0x7fe24c0fac80 2024-09-13T21:55:38.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.030+0000 7fe24b7fe640 1 --2- 172.21.15.119:0/2755803347 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe23406e530 0x7fe2340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:38.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.031+0000 7fe24b7fe640 1 --2- 172.21.15.119:0/2755803347 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe23406e530 0x7fe2340709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe24c10ea90 tx=0x7fe24000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:38.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.035+0000 7fe248ff9640 1 -- 172.21.15.119:0/2755803347 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe23c076f90 con 0x7fe24c0fac80 2024-09-13T21:55:38.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.238+0000 7fe252582640 1 -- 172.21.15.119:0/2755803347 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fe24c074c00 con 0x7fe24c0fac80 2024-09-13T21:55:38.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.239+0000 7fe248ff9640 1 -- 172.21.15.119:0/2755803347 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v46) v1 ==== 107+0+4935 (secure 0 0 0) 0x7fe23c07a650 con 0x7fe24c0fac80 2024-09-13T21:55:38.240 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:38.240 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":22,"btime":"2024-09-13T21:48:12:719560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24283,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/1506378601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1506378601},{"type":"v1","addr":"172.21.15.119:6827","nonce":1506378601}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:48:12.175306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14472,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi155.yblkxo","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6825/1473450727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1473450727},{"type":"v1","addr":"172.21.15.155:6825","nonce":1473450727}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[24267,14472]},"id":1}]} 2024-09-13T21:55:38.241 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 22 2024-09-13T21:55:38.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.241+0000 7fe252582640 1 -- 172.21.15.119:0/2755803347 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe23406e530 msgr2=0x7fe2340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:38.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.241+0000 7fe252582640 1 --2- 172.21.15.119:0/2755803347 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe23406e530 0x7fe2340709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe24c10ea90 tx=0x7fe24000b040 comp rx=0 tx=0).stop 2024-09-13T21:55:38.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.241+0000 7fe252582640 1 -- 172.21.15.119:0/2755803347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24c0fac80 msgr2=0x7fe24c1131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:38.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.241+0000 7fe252582640 1 --2- 172.21.15.119:0/2755803347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24c0fac80 0x7fe24c1131d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe23c000c00 tx=0x7fe23c009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:38.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.241+0000 7fe252582640 1 -- 172.21.15.119:0/2755803347 shutdown_connections 2024-09-13T21:55:38.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.241+0000 7fe252582640 1 --2- 172.21.15.119:0/2755803347 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe23406e530 0x7fe2340709e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:38.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.241+0000 7fe252582640 1 --2- 172.21.15.119:0/2755803347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe24c102620 0x7fe24c113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:38.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.241+0000 7fe252582640 1 --2- 172.21.15.119:0/2755803347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24c0fac80 0x7fe24c1131d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:38.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.241+0000 7fe252582640 1 -- 172.21.15.119:0/2755803347 >> 172.21.15.119:0/2755803347 conn(0x7fe24c070ce0 msgr2=0x7fe24c105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:38.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.241+0000 7fe252582640 1 -- 172.21.15.119:0/2755803347 shutdown_connections 2024-09-13T21:55:38.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:38.241+0000 7fe252582640 1 -- 172.21.15.119:0/2755803347 wait complete. 2024-09-13T21:55:38.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:38 smithi119 ceph-mon[90896]: pgmap v300: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:38.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:38 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2755803347' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T21:55:38.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:38 smithi155 ceph-mon[79928]: pgmap v300: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:38.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:38 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2755803347' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T21:55:38.897 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-13T21:55:39.142 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:40.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.766+0000 7fad263e1640 1 -- 172.21.15.119:0/4081604538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200fabe0 msgr2=0x7fad200fb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:40.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.766+0000 7fad263e1640 1 --2- 172.21.15.119:0/4081604538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200fabe0 0x7fad200fb030 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fad080048d0 tx=0x7fad08009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:40.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.766+0000 7fad263e1640 1 -- 172.21.15.119:0/4081604538 shutdown_connections 2024-09-13T21:55:40.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.766+0000 7fad263e1640 1 --2- 172.21.15.119:0/4081604538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200fabe0 0x7fad200fb030 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:40.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.766+0000 7fad263e1640 1 --2- 172.21.15.119:0/4081604538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad200fe460 0x7fad200fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.766+0000 7fad263e1640 1 -- 172.21.15.119:0/4081604538 >> 172.21.15.119:0/4081604538 conn(0x7fad20071b00 msgr2=0x7fad20071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.766+0000 7fad263e1640 1 -- 172.21.15.119:0/4081604538 shutdown_connections 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.766+0000 7fad263e1640 1 -- 172.21.15.119:0/4081604538 wait complete. 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad263e1640 1 Processor -- start 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad263e1640 1 -- start start 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad263e1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200fabe0 0x7fad20113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad263e1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad200fe460 0x7fad201136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad263e1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad20113cb0 con 0x7fad200fabe0 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad263e1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2010d0f0 con 0x7fad200fe460 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad1ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200fabe0 0x7fad20113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad1ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200fabe0 0x7fad20113170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36602/0 (socket says 172.21.15.119:36602) 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad1ffff640 1 -- 172.21.15.119:0/4216277417 learned_addr learned my addr 172.21.15.119:0/4216277417 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:40.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad1ffff640 1 -- 172.21.15.119:0/4216277417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad200fe460 msgr2=0x7fad201136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad1ffff640 1 --2- 172.21.15.119:0/4216277417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad200fe460 0x7fad201136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad1ffff640 1 -- 172.21.15.119:0/4216277417 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad08005040 con 0x7fad200fabe0 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.767+0000 7fad1ffff640 1 --2- 172.21.15.119:0/4216277417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200fabe0 0x7fad20113170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fad10002a50 tx=0x7fad10004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.768+0000 7fad1d7fa640 1 -- 172.21.15.119:0/4216277417 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad10007c30 con 0x7fad200fabe0 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.768+0000 7fad1d7fa640 1 -- 172.21.15.119:0/4216277417 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fad1000f040 con 0x7fad200fabe0 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.768+0000 7fad263e1640 1 -- 172.21.15.119:0/4216277417 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2010d3d0 con 0x7fad200fabe0 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.768+0000 7fad1d7fa640 1 -- 172.21.15.119:0/4216277417 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad1000db50 con 0x7fad200fabe0 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.768+0000 7fad263e1640 1 -- 172.21.15.119:0/4216277417 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2010d970 con 0x7fad200fabe0 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.769+0000 7fad263e1640 1 -- 172.21.15.119:0/4216277417 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad20064d50 con 0x7fad200fabe0 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.769+0000 7fad1d7fa640 1 -- 172.21.15.119:0/4216277417 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fad1000dcb0 con 0x7fad200fabe0 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.770+0000 7fad1d7fa640 1 --2- 172.21.15.119:0/4216277417 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fad0c06e530 0x7fad0c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.770+0000 7fad17fff640 1 --2- 172.21.15.119:0/4216277417 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fad0c06e530 0x7fad0c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:40.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.770+0000 7fad1d7fa640 1 -- 172.21.15.119:0/4216277417 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fad1008e080 con 0x7fad200fabe0 2024-09-13T21:55:40.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.770+0000 7fad17fff640 1 --2- 172.21.15.119:0/4216277417 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fad0c06e530 0x7fad0c0709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad0802a530 tx=0x7fad08009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:40.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.774+0000 7fad1d7fa640 1 -- 172.21.15.119:0/4216277417 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fad10057190 con 0x7fad200fabe0 2024-09-13T21:55:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.975+0000 7fad263e1640 1 -- 172.21.15.119:0/4216277417 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fad20072610 con 0x7fad200fabe0 2024-09-13T21:55:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.975+0000 7fad1d7fa640 1 -- 172.21.15.119:0/4216277417 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v46) v1 ==== 107+0+4935 (secure 0 0 0) 0x7fad20072610 con 0x7fad200fabe0 2024-09-13T21:55:40.977 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:40.977 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":23,"btime":"2024-09-13T21:51:03:810042+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24283,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/1506378601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1506378601},{"type":"v1","addr":"172.21.15.119:6827","nonce":1506378601}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:51:02.812329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14472,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi155.yblkxo","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6825/1473450727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1473450727},{"type":"v1","addr":"172.21.15.155:6825","nonce":1473450727}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472,24267]},"id":1}]} 2024-09-13T21:55:40.978 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 23 2024-09-13T21:55:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.977+0000 7fad263e1640 1 -- 172.21.15.119:0/4216277417 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fad0c06e530 msgr2=0x7fad0c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.977+0000 7fad263e1640 1 --2- 172.21.15.119:0/4216277417 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fad0c06e530 0x7fad0c0709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad0802a530 tx=0x7fad08009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.977+0000 7fad263e1640 1 -- 172.21.15.119:0/4216277417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200fabe0 msgr2=0x7fad20113170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.977+0000 7fad263e1640 1 --2- 172.21.15.119:0/4216277417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200fabe0 0x7fad20113170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fad10002a50 tx=0x7fad10004600 comp rx=0 tx=0).stop 2024-09-13T21:55:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.977+0000 7fad263e1640 1 -- 172.21.15.119:0/4216277417 shutdown_connections 2024-09-13T21:55:40.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.977+0000 7fad263e1640 1 --2- 172.21.15.119:0/4216277417 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fad0c06e530 0x7fad0c0709e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:40.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.977+0000 7fad263e1640 1 --2- 172.21.15.119:0/4216277417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad200fe460 0x7fad201136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:40.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.978+0000 7fad263e1640 1 --2- 172.21.15.119:0/4216277417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200fabe0 0x7fad20113170 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:40.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.978+0000 7fad263e1640 1 -- 172.21.15.119:0/4216277417 >> 172.21.15.119:0/4216277417 conn(0x7fad20071b00 msgr2=0x7fad200f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:40.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.978+0000 7fad263e1640 1 -- 172.21.15.119:0/4216277417 shutdown_connections 2024-09-13T21:55:40.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:40.978+0000 7fad263e1640 1 -- 172.21.15.119:0/4216277417 wait complete. 2024-09-13T21:55:41.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:41 smithi155 ceph-mon[79928]: pgmap v301: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:41.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:41 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/4216277417' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T21:55:41.627 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:41 smithi119 ceph-mon[90896]: pgmap v301: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:41.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:41 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/4216277417' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T21:55:41.654 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-09-13T21:55:41.655 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-13T21:55:41.899 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:43.375 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:43 smithi119 ceph-mon[90896]: pgmap v302: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:43.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:43 smithi155 ceph-mon[79928]: pgmap v302: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:43.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.605+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/2563698956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a8102550 msgr2=0x7fe5a8102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:43.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.605+0000 7fe5ad8bf640 1 --2- 172.21.15.119:0/2563698956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a8102550 0x7fe5a8102920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe5980048d0 tx=0x7fe598009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.605+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/2563698956 shutdown_connections 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.605+0000 7fe5ad8bf640 1 --2- 172.21.15.119:0/2563698956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5a8102ef0 0x7fe5a80fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.605+0000 7fe5ad8bf640 1 --2- 172.21.15.119:0/2563698956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a8102550 0x7fe5a8102920 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.605+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/2563698956 >> 172.21.15.119:0/2563698956 conn(0x7fe5a80f80f0 msgr2=0x7fe5a80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.605+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/2563698956 shutdown_connections 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.605+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/2563698956 wait complete. 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.605+0000 7fe5ad8bf640 1 Processor -- start 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.605+0000 7fe5ad8bf640 1 -- start start 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5ad8bf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a8102550 0x7fe5a8113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5ad8bf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5a8102ef0 0x7fe5a8113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5ad8bf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a81140d0 con 0x7fe5a8102550 2024-09-13T21:55:43.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5ad8bf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a810d4e0 con 0x7fe5a8102ef0 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5a6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a8102550 0x7fe5a8113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5a6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a8102550 0x7fe5a8113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36620/0 (socket says 172.21.15.119:36620) 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5a6ffd640 1 -- 172.21.15.119:0/4049812815 learned_addr learned my addr 172.21.15.119:0/4049812815 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5a67fc640 1 --2- 172.21.15.119:0/4049812815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5a8102ef0 0x7fe5a8113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5a6ffd640 1 -- 172.21.15.119:0/4049812815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5a8102ef0 msgr2=0x7fe5a8113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5a6ffd640 1 --2- 172.21.15.119:0/4049812815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5a8102ef0 0x7fe5a8113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5a6ffd640 1 -- 172.21.15.119:0/4049812815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe598005040 con 0x7fe5a8102550 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5a6ffd640 1 --2- 172.21.15.119:0/4049812815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a8102550 0x7fe5a8113540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe598000c00 tx=0x7fe598009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe58f7fe640 1 -- 172.21.15.119:0/4049812815 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe598038070 con 0x7fe5a8102550 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe58f7fe640 1 -- 172.21.15.119:0/4049812815 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe59802ade0 con 0x7fe5a8102550 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/4049812815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a810d760 con 0x7fe5a8102550 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.606+0000 7fe58f7fe640 1 -- 172.21.15.119:0/4049812815 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe59802c7e0 con 0x7fe5a8102550 2024-09-13T21:55:43.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.607+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/4049812815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a810dca0 con 0x7fe5a8102550 2024-09-13T21:55:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.607+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/4049812815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a80fdcd0 con 0x7fe5a8102550 2024-09-13T21:55:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.608+0000 7fe58f7fe640 1 -- 172.21.15.119:0/4049812815 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe598030020 con 0x7fe5a8102550 2024-09-13T21:55:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.608+0000 7fe58f7fe640 1 --2- 172.21.15.119:0/4049812815 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe59006e530 0x7fe5900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.608+0000 7fe58f7fe640 1 -- 172.21.15.119:0/4049812815 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe5980ade50 con 0x7fe5a8102550 2024-09-13T21:55:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.609+0000 7fe5a67fc640 1 --2- 172.21.15.119:0/4049812815 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe59006e530 0x7fe5900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.609+0000 7fe5a67fc640 1 --2- 172.21.15.119:0/4049812815 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe59006e530 0x7fe5900709e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe59c007fd0 tx=0x7fe59c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.613+0000 7fe58f7fe640 1 -- 172.21.15.119:0/4049812815 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe598076f90 con 0x7fe5a8102550 2024-09-13T21:55:43.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.815+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/4049812815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fe5a804b750 con 0x7fe5a8102550 2024-09-13T21:55:43.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.815+0000 7fe58f7fe640 1 -- 172.21.15.119:0/4049812815 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v46) v1 ==== 107+0+4931 (secure 0 0 0) 0x7fe59807a650 con 0x7fe5a8102550 2024-09-13T21:55:43.817 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:43.817 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":24,"btime":"2024-09-13T21:51:03:820331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24283,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/1506378601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1506378601},{"type":"v1","addr":"172.21.15.119:6827","nonce":1506378601}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:51:03.820329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14472,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi155.yblkxo","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.155:6825/1473450727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1473450727},{"type":"v1","addr":"172.21.15.155:6825","nonce":1473450727}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-09-13T21:55:43.817 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 24 2024-09-13T21:55:43.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.817+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/4049812815 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe59006e530 msgr2=0x7fe5900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:43.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.817+0000 7fe5ad8bf640 1 --2- 172.21.15.119:0/4049812815 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe59006e530 0x7fe5900709e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe59c007fd0 tx=0x7fe59c009e90 comp rx=0 tx=0).stop 2024-09-13T21:55:43.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.817+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/4049812815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a8102550 msgr2=0x7fe5a8113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:43.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.817+0000 7fe5ad8bf640 1 --2- 172.21.15.119:0/4049812815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a8102550 0x7fe5a8113540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe598000c00 tx=0x7fe598009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:43.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.817+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/4049812815 shutdown_connections 2024-09-13T21:55:43.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.817+0000 7fe5ad8bf640 1 --2- 172.21.15.119:0/4049812815 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fe59006e530 0x7fe5900709e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:43.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.817+0000 7fe5ad8bf640 1 --2- 172.21.15.119:0/4049812815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5a8102ef0 0x7fe5a8113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:43.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.818+0000 7fe5ad8bf640 1 --2- 172.21.15.119:0/4049812815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5a8102550 0x7fe5a8113540 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:43.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.818+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/4049812815 >> 172.21.15.119:0/4049812815 conn(0x7fe5a80f80f0 msgr2=0x7fe5a80f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:43.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.818+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/4049812815 shutdown_connections 2024-09-13T21:55:43.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:43.818+0000 7fe5ad8bf640 1 -- 172.21.15.119:0/4049812815 wait complete. 2024-09-13T21:55:44.492 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:44 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/4049812815' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T21:55:44.516 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-09-13T21:55:44.516 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-13T21:55:44.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:44 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/4049812815' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T21:55:44.770 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:45.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:45 smithi119 ceph-mon[90896]: pgmap v303: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:45 smithi155 ceph-mon[79928]: pgmap v303: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:46.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.454+0000 7f8f6fb09640 1 -- 172.21.15.119:0/1107381093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f680fb810 msgr2=0x7f8f680fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:46.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.454+0000 7f8f6fb09640 1 --2- 172.21.15.119:0/1107381093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f680fb810 0x7f8f680fbbe0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8f640048d0 tx=0x7f8f64009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:46.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.454+0000 7f8f6fb09640 1 -- 172.21.15.119:0/1107381093 shutdown_connections 2024-09-13T21:55:46.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.454+0000 7f8f6fb09640 1 --2- 172.21.15.119:0/1107381093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f680fcf80 0x7f8f680fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:46.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.454+0000 7f8f6fb09640 1 --2- 172.21.15.119:0/1107381093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f680fb810 0x7f8f680fbbe0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:46.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.454+0000 7f8f6fb09640 1 -- 172.21.15.119:0/1107381093 >> 172.21.15.119:0/1107381093 conn(0x7f8f680723b0 msgr2=0x7f8f680727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:46.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.454+0000 7f8f6fb09640 1 -- 172.21.15.119:0/1107381093 shutdown_connections 2024-09-13T21:55:46.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.454+0000 7f8f6fb09640 1 -- 172.21.15.119:0/1107381093 wait complete. 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.454+0000 7f8f6fb09640 1 Processor -- start 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.454+0000 7f8f6fb09640 1 -- start start 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6fb09640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f680fb810 0x7f8f681131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6fb09640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f680fcf80 0x7f8f68113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6fb09640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f68113d30 con 0x7f8f680fb810 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6fb09640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6810d1c0 con 0x7f8f680fcf80 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6d8a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f680fb810 0x7f8f681131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6d8a5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f680fb810 0x7f8f681131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48078/0 (socket says 172.21.15.119:48078) 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6d8a5640 1 -- 172.21.15.119:0/475317850 learned_addr learned my addr 172.21.15.119:0/475317850 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6d0a4640 1 --2- 172.21.15.119:0/475317850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f680fcf80 0x7f8f68113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6d8a5640 1 -- 172.21.15.119:0/475317850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f680fcf80 msgr2=0x7f8f68113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6d8a5640 1 --2- 172.21.15.119:0/475317850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f680fcf80 0x7f8f68113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:46.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6d8a5640 1 -- 172.21.15.119:0/475317850 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f64005040 con 0x7f8f680fb810 2024-09-13T21:55:46.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6d8a5640 1 --2- 172.21.15.119:0/475317850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f680fb810 0x7f8f681131f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8f64000c00 tx=0x7f8f64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:46.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f5e7fc640 1 -- 172.21.15.119:0/475317850 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f64038070 con 0x7f8f680fb810 2024-09-13T21:55:46.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6fb09640 1 -- 172.21.15.119:0/475317850 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6810d440 con 0x7f8f680fb810 2024-09-13T21:55:46.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f5e7fc640 1 -- 172.21.15.119:0/475317850 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8f6402ade0 con 0x7f8f680fb810 2024-09-13T21:55:46.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f5e7fc640 1 -- 172.21.15.119:0/475317850 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f6402c7e0 con 0x7f8f680fb810 2024-09-13T21:55:46.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.455+0000 7f8f6fb09640 1 -- 172.21.15.119:0/475317850 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6810d980 con 0x7f8f680fb810 2024-09-13T21:55:46.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.456+0000 7f8f6fb09640 1 -- 172.21.15.119:0/475317850 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f680fcbc0 con 0x7f8f680fb810 2024-09-13T21:55:46.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.457+0000 7f8f5e7fc640 1 -- 172.21.15.119:0/475317850 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8f64030020 con 0x7f8f680fb810 2024-09-13T21:55:46.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.457+0000 7f8f5e7fc640 1 --2- 172.21.15.119:0/475317850 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f5406e530 0x7f8f540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:46.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.458+0000 7f8f5e7fc640 1 -- 172.21.15.119:0/475317850 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8f640ade50 con 0x7f8f680fb810 2024-09-13T21:55:46.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.458+0000 7f8f6d0a4640 1 --2- 172.21.15.119:0/475317850 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f5406e530 0x7f8f540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:46.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.458+0000 7f8f6d0a4640 1 --2- 172.21.15.119:0/475317850 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f5406e530 0x7f8f540709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8f58007fd0 tx=0x7f8f58009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:46.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.462+0000 7f8f5e7fc640 1 -- 172.21.15.119:0/475317850 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8f64076f90 con 0x7f8f680fb810 2024-09-13T21:55:46.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.664+0000 7f8f6fb09640 1 -- 172.21.15.119:0/475317850 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f8f6804b720 con 0x7f8f680fb810 2024-09-13T21:55:46.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.664+0000 7f8f5e7fc640 1 -- 172.21.15.119:0/475317850 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v46) v1 ==== 107+0+4932 (secure 0 0 0) 0x7f8f6407a650 con 0x7f8f680fb810 2024-09-13T21:55:46.666 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:46.666 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":25,"btime":"2024-09-13T21:51:12:268598+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24283,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/1506378601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1506378601},{"type":"v1","addr":"172.21.15.119:6827","nonce":1506378601}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:51:12.179164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14472,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi155.yblkxo","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.155:6825/1473450727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1473450727},{"type":"v1","addr":"172.21.15.155:6825","nonce":1473450727}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-09-13T21:55:46.666 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 25 2024-09-13T21:55:46.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.666+0000 7f8f6fb09640 1 -- 172.21.15.119:0/475317850 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f5406e530 msgr2=0x7f8f540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:46.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.666+0000 7f8f6fb09640 1 --2- 172.21.15.119:0/475317850 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f5406e530 0x7f8f540709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8f58007fd0 tx=0x7f8f58009e90 comp rx=0 tx=0).stop 2024-09-13T21:55:46.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.666+0000 7f8f6fb09640 1 -- 172.21.15.119:0/475317850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f680fb810 msgr2=0x7f8f681131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:46.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.666+0000 7f8f6fb09640 1 --2- 172.21.15.119:0/475317850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f680fb810 0x7f8f681131f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8f64000c00 tx=0x7f8f64009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:46.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.666+0000 7f8f6fb09640 1 -- 172.21.15.119:0/475317850 shutdown_connections 2024-09-13T21:55:46.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.666+0000 7f8f6fb09640 1 --2- 172.21.15.119:0/475317850 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f8f5406e530 0x7f8f540709e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:46.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.666+0000 7f8f6fb09640 1 --2- 172.21.15.119:0/475317850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f680fcf80 0x7f8f68113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:46.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.666+0000 7f8f6fb09640 1 --2- 172.21.15.119:0/475317850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f680fb810 0x7f8f681131f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:46.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.666+0000 7f8f6fb09640 1 -- 172.21.15.119:0/475317850 >> 172.21.15.119:0/475317850 conn(0x7f8f680723b0 msgr2=0x7f8f68104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:46.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.667+0000 7f8f6fb09640 1 -- 172.21.15.119:0/475317850 shutdown_connections 2024-09-13T21:55:46.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:46.667+0000 7f8f6fb09640 1 -- 172.21.15.119:0/475317850 wait complete. 2024-09-13T21:55:47.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:46 smithi119 ceph-mon[90896]: pgmap v304: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:47.315 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:46 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/475317850' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T21:55:47.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:46 smithi155 ceph-mon[79928]: pgmap v304: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:47.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:46 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/475317850' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T21:55:47.339 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-09-13T21:55:47.339 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-13T21:55:47.584 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:49.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.174+0000 7fbac8a6a640 1 -- 172.21.15.119:0/4062643536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac406fa30 msgr2=0x7fbac406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:49.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.174+0000 7fbac8a6a640 1 --2- 172.21.15.119:0/4062643536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac406fa30 0x7fbac406fe00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbab40048d0 tx=0x7fbab4009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:49.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.174+0000 7fbac8a6a640 1 -- 172.21.15.119:0/4062643536 shutdown_connections 2024-09-13T21:55:49.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.174+0000 7fbac8a6a640 1 --2- 172.21.15.119:0/4062643536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac4070340 0x7fbac4108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:49.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.174+0000 7fbac8a6a640 1 --2- 172.21.15.119:0/4062643536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac406fa30 0x7fbac406fe00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:49.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.174+0000 7fbac8a6a640 1 -- 172.21.15.119:0/4062643536 >> 172.21.15.119:0/4062643536 conn(0x7fbac40f80f0 msgr2=0x7fbac40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.174+0000 7fbac8a6a640 1 -- 172.21.15.119:0/4062643536 shutdown_connections 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.174+0000 7fbac8a6a640 1 -- 172.21.15.119:0/4062643536 wait complete. 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac8a6a640 1 Processor -- start 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac8a6a640 1 -- start start 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac8a6a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac406fa30 0x7fbac4115760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac8a6a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac4070340 0x7fbac4115ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac8a6a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac41162f0 con 0x7fbac406fa30 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac8a6a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac410f700 con 0x7fbac4070340 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac406fa30 0x7fbac4115760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac406fa30 0x7fbac4115760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48100/0 (socket says 172.21.15.119:48100) 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac259c640 1 -- 172.21.15.119:0/3588854344 learned_addr learned my addr 172.21.15.119:0/3588854344 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:49.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac259c640 1 -- 172.21.15.119:0/3588854344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac4070340 msgr2=0x7fbac4115ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:49.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac259c640 1 --2- 172.21.15.119:0/3588854344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac4070340 0x7fbac4115ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:49.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac259c640 1 -- 172.21.15.119:0/3588854344 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4005040 con 0x7fbac406fa30 2024-09-13T21:55:49.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.175+0000 7fbac259c640 1 --2- 172.21.15.119:0/3588854344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac406fa30 0x7fbac4115760 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbab4003080 tx=0x7fbab4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:49.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.176+0000 7fbab2ffd640 1 -- 172.21.15.119:0/3588854344 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab4038070 con 0x7fbac406fa30 2024-09-13T21:55:49.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.176+0000 7fbac8a6a640 1 -- 172.21.15.119:0/3588854344 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac410f980 con 0x7fbac406fa30 2024-09-13T21:55:49.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.176+0000 7fbab2ffd640 1 -- 172.21.15.119:0/3588854344 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbab402ade0 con 0x7fbac406fa30 2024-09-13T21:55:49.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.176+0000 7fbab2ffd640 1 -- 172.21.15.119:0/3588854344 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab402c880 con 0x7fbac406fa30 2024-09-13T21:55:49.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.176+0000 7fbac8a6a640 1 -- 172.21.15.119:0/3588854344 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac410fde0 con 0x7fbac406fa30 2024-09-13T21:55:49.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.177+0000 7fbac8a6a640 1 -- 172.21.15.119:0/3588854344 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac4071170 con 0x7fbac406fa30 2024-09-13T21:55:49.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.177+0000 7fbab2ffd640 1 -- 172.21.15.119:0/3588854344 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fbab4030020 con 0x7fbac406fa30 2024-09-13T21:55:49.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.178+0000 7fbab2ffd640 1 --2- 172.21.15.119:0/3588854344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fbaac06e530 0x7fbaac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:49.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.178+0000 7fbab2ffd640 1 -- 172.21.15.119:0/3588854344 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fbab40ae280 con 0x7fbac406fa30 2024-09-13T21:55:49.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.178+0000 7fbac1d9b640 1 --2- 172.21.15.119:0/3588854344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fbaac06e530 0x7fbaac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:49.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.178+0000 7fbac1d9b640 1 --2- 172.21.15.119:0/3588854344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fbaac06e530 0x7fbaac0709e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbac41109e0 tx=0x7fbab8007cb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:49.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.182+0000 7fbab2ffd640 1 -- 172.21.15.119:0/3588854344 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbab4077310 con 0x7fbac406fa30 2024-09-13T21:55:49.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.393+0000 7fbac8a6a640 1 -- 172.21.15.119:0/3588854344 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fbac404b720 con 0x7fbac406fa30 2024-09-13T21:55:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.394+0000 7fbab2ffd640 1 -- 172.21.15.119:0/3588854344 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v46) v1 ==== 107+0+4133 (secure 0 0 0) 0x7fbab407a9d0 con 0x7fbac406fa30 2024-09-13T21:55:49.395 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:49.395 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"btime":"2024-09-13T21:51:37:199359+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24283,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/1506378601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1506378601},{"type":"v1","addr":"172.21.15.119:6827","nonce":1506378601}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:51:37.180357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-09-13T21:55:49.395 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 26 2024-09-13T21:55:49.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.396+0000 7fbac8a6a640 1 -- 172.21.15.119:0/3588854344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fbaac06e530 msgr2=0x7fbaac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:49.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.396+0000 7fbac8a6a640 1 --2- 172.21.15.119:0/3588854344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fbaac06e530 0x7fbaac0709e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbac41109e0 tx=0x7fbab8007cb0 comp rx=0 tx=0).stop 2024-09-13T21:55:49.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.396+0000 7fbac8a6a640 1 -- 172.21.15.119:0/3588854344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac406fa30 msgr2=0x7fbac4115760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:49.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.396+0000 7fbac8a6a640 1 --2- 172.21.15.119:0/3588854344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac406fa30 0x7fbac4115760 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbab4003080 tx=0x7fbab4009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:49.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.396+0000 7fbac8a6a640 1 -- 172.21.15.119:0/3588854344 shutdown_connections 2024-09-13T21:55:49.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.396+0000 7fbac8a6a640 1 --2- 172.21.15.119:0/3588854344 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fbaac06e530 0x7fbaac0709e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:49.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.396+0000 7fbac8a6a640 1 --2- 172.21.15.119:0/3588854344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbac4070340 0x7fbac4115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:49.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.396+0000 7fbac8a6a640 1 --2- 172.21.15.119:0/3588854344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbac406fa30 0x7fbac4115760 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:49.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.396+0000 7fbac8a6a640 1 -- 172.21.15.119:0/3588854344 >> 172.21.15.119:0/3588854344 conn(0x7fbac40f80f0 msgr2=0x7fbac40f9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:49.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.396+0000 7fbac8a6a640 1 -- 172.21.15.119:0/3588854344 shutdown_connections 2024-09-13T21:55:49.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:49.396+0000 7fbac8a6a640 1 -- 172.21.15.119:0/3588854344 wait complete. 2024-09-13T21:55:49.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:49 smithi155 ceph-mon[79928]: pgmap v305: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:49.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:49 smithi119 ceph-mon[90896]: pgmap v305: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:50.070 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-09-13T21:55:50.070 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-13T21:55:50.320 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:50.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:50 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3588854344' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T21:55:50.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:50 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3588854344' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T21:55:51.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:51 smithi119 ceph-mon[90896]: pgmap v306: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:51.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:51 smithi155 ceph-mon[79928]: pgmap v306: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:51.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.881+0000 7fa371f93640 1 -- 172.21.15.119:0/3946781490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa36c102ed0 msgr2=0x7fa36c0fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:51.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.881+0000 7fa371f93640 1 --2- 172.21.15.119:0/3946781490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa36c102ed0 0x7fa36c0fc590 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa3600048d0 tx=0x7fa360009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:51.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.881+0000 7fa371f93640 1 -- 172.21.15.119:0/3946781490 shutdown_connections 2024-09-13T21:55:51.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.881+0000 7fa371f93640 1 --2- 172.21.15.119:0/3946781490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa36c102ed0 0x7fa36c0fc590 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:51.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.881+0000 7fa371f93640 1 --2- 172.21.15.119:0/3946781490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c102530 0x7fa36c102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:51.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.881+0000 7fa371f93640 1 -- 172.21.15.119:0/3946781490 >> 172.21.15.119:0/3946781490 conn(0x7fa36c0f80f0 msgr2=0x7fa36c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:51.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.881+0000 7fa371f93640 1 -- 172.21.15.119:0/3946781490 shutdown_connections 2024-09-13T21:55:51.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.881+0000 7fa371f93640 1 -- 172.21.15.119:0/3946781490 wait complete. 2024-09-13T21:55:51.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.882+0000 7fa371f93640 1 Processor -- start 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.882+0000 7fa371f93640 1 -- start start 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.882+0000 7fa371f93640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c102530 0x7fa36c1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.882+0000 7fa371f93640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa36c102ed0 0x7fa36c113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.882+0000 7fa371f93640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c113d10 con 0x7fa36c102ed0 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.882+0000 7fa371f93640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c10d150 con 0x7fa36c102530 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.882+0000 7fa36affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa36c102ed0 0x7fa36c113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.882+0000 7fa36affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa36c102ed0 0x7fa36c113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:48114/0 (socket says 172.21.15.119:48114) 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.882+0000 7fa36affd640 1 -- 172.21.15.119:0/2352796091 learned_addr learned my addr 172.21.15.119:0/2352796091 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.883+0000 7fa36b7fe640 1 --2- 172.21.15.119:0/2352796091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c102530 0x7fa36c1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.883+0000 7fa36affd640 1 -- 172.21.15.119:0/2352796091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c102530 msgr2=0x7fa36c1131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.883+0000 7fa36affd640 1 --2- 172.21.15.119:0/2352796091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c102530 0x7fa36c1131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.883+0000 7fa36affd640 1 -- 172.21.15.119:0/2352796091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360005040 con 0x7fa36c102ed0 2024-09-13T21:55:51.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.883+0000 7fa36affd640 1 --2- 172.21.15.119:0/2352796091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa36c102ed0 0x7fa36c113710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa3600043d0 tx=0x7fa360009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.883+0000 7fa353fff640 1 -- 172.21.15.119:0/2352796091 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa360038070 con 0x7fa36c102ed0 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.883+0000 7fa353fff640 1 -- 172.21.15.119:0/2352796091 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa3600096e0 con 0x7fa36c102ed0 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.883+0000 7fa371f93640 1 -- 172.21.15.119:0/2352796091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c10d3d0 con 0x7fa36c102ed0 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.883+0000 7fa353fff640 1 -- 172.21.15.119:0/2352796091 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36002c8a0 con 0x7fa36c102ed0 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.883+0000 7fa371f93640 1 -- 172.21.15.119:0/2352796091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c10d890 con 0x7fa36c102ed0 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.884+0000 7fa371f93640 1 -- 172.21.15.119:0/2352796091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c0fdcb0 con 0x7fa36c102ed0 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.885+0000 7fa353fff640 1 -- 172.21.15.119:0/2352796091 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa360030020 con 0x7fa36c102ed0 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.885+0000 7fa353fff640 1 --2- 172.21.15.119:0/2352796091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa35406e530 0x7fa3540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.885+0000 7fa36b7fe640 1 --2- 172.21.15.119:0/2352796091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa35406e530 0x7fa3540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.885+0000 7fa353fff640 1 -- 172.21.15.119:0/2352796091 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa3600adf10 con 0x7fa36c102ed0 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.886+0000 7fa36b7fe640 1 --2- 172.21.15.119:0/2352796091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa35406e530 0x7fa3540709e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009470 tx=0x7fa35c009ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:51.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:51.890+0000 7fa353fff640 1 -- 172.21.15.119:0/2352796091 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa360076fa0 con 0x7fa36c102ed0 2024-09-13T21:55:52.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.092+0000 7fa371f93640 1 -- 172.21.15.119:0/2352796091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fa36c04b720 con 0x7fa36c102ed0 2024-09-13T21:55:52.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.093+0000 7fa353fff640 1 -- 172.21.15.119:0/2352796091 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v46) v1 ==== 107+0+4915 (secure 0 0 0) 0x7fa36007a660 con 0x7fa36c102ed0 2024-09-13T21:55:52.094 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:52.094 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":27,"btime":"2024-09-13T21:51:38:209181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24283,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/1506378601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1506378601},{"type":"v1","addr":"172.21.15.119:6827","nonce":1506378601}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":44281,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/1541412300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1541412300},{"type":"v1","addr":"172.21.15.155:6825","nonce":1541412300}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:51:37.180357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-09-13T21:55:52.094 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 27 2024-09-13T21:55:52.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.095+0000 7fa371f93640 1 -- 172.21.15.119:0/2352796091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa35406e530 msgr2=0x7fa3540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:52.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.095+0000 7fa371f93640 1 --2- 172.21.15.119:0/2352796091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa35406e530 0x7fa3540709e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009470 tx=0x7fa35c009ed0 comp rx=0 tx=0).stop 2024-09-13T21:55:52.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.095+0000 7fa371f93640 1 -- 172.21.15.119:0/2352796091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa36c102ed0 msgr2=0x7fa36c113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:52.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.095+0000 7fa371f93640 1 --2- 172.21.15.119:0/2352796091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa36c102ed0 0x7fa36c113710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa3600043d0 tx=0x7fa360009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:52.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.095+0000 7fa371f93640 1 -- 172.21.15.119:0/2352796091 shutdown_connections 2024-09-13T21:55:52.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.095+0000 7fa371f93640 1 --2- 172.21.15.119:0/2352796091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fa35406e530 0x7fa3540709e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:52.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.095+0000 7fa371f93640 1 --2- 172.21.15.119:0/2352796091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa36c102ed0 0x7fa36c113710 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:52.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.095+0000 7fa371f93640 1 --2- 172.21.15.119:0/2352796091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa36c102530 0x7fa36c1131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:52.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.095+0000 7fa371f93640 1 -- 172.21.15.119:0/2352796091 >> 172.21.15.119:0/2352796091 conn(0x7fa36c0f80f0 msgr2=0x7fa36c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:52.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.095+0000 7fa371f93640 1 -- 172.21.15.119:0/2352796091 shutdown_connections 2024-09-13T21:55:52.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:52.095+0000 7fa371f93640 1 -- 172.21.15.119:0/2352796091 wait complete. 2024-09-13T21:55:52.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:52 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2352796091' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T21:55:52.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:55:52.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:52 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2352796091' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T21:55:52.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:55:52.725 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-09-13T21:55:52.726 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-13T21:55:52.973 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:53.355 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:53 smithi119 ceph-mon[90896]: pgmap v307: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:53.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:53 smithi155 ceph-mon[79928]: pgmap v307: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.564+0000 7f3beef5c640 1 -- 172.21.15.119:0/3511812483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be8102f00 msgr2=0x7f3be80fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.564+0000 7f3beef5c640 1 --2- 172.21.15.119:0/3511812483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be8102f00 0x7f3be80fc5c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3bd40048d0 tx=0x7f3bd4009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:54.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.564+0000 7f3beef5c640 1 -- 172.21.15.119:0/3511812483 shutdown_connections 2024-09-13T21:55:54.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.564+0000 7f3beef5c640 1 --2- 172.21.15.119:0/3511812483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be8102f00 0x7f3be80fc5c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:54.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.564+0000 7f3beef5c640 1 --2- 172.21.15.119:0/3511812483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3be8102560 0x7f3be8102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:54.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.564+0000 7f3beef5c640 1 -- 172.21.15.119:0/3511812483 >> 172.21.15.119:0/3511812483 conn(0x7f3be80f8100 msgr2=0x7f3be80fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:54.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.564+0000 7f3beef5c640 1 -- 172.21.15.119:0/3511812483 shutdown_connections 2024-09-13T21:55:54.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.564+0000 7f3beef5c640 1 -- 172.21.15.119:0/3511812483 wait complete. 2024-09-13T21:55:54.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.565+0000 7f3beef5c640 1 Processor -- start 2024-09-13T21:55:54.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.565+0000 7f3beef5c640 1 -- start start 2024-09-13T21:55:54.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.565+0000 7f3beef5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be8102560 0x7f3be81131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:54.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.565+0000 7f3beef5c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3be8102f00 0x7f3be8113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:54.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.565+0000 7f3beef5c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be8113d20 con 0x7f3be8102560 2024-09-13T21:55:54.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.565+0000 7f3beef5c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be810d160 con 0x7f3be8102f00 2024-09-13T21:55:54.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.565+0000 7f3beccf8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be8102560 0x7f3be81131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:54.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.565+0000 7f3beccf8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be8102560 0x7f3be81131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37238/0 (socket says 172.21.15.119:37238) 2024-09-13T21:55:54.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.565+0000 7f3beccf8640 1 -- 172.21.15.119:0/846314949 learned_addr learned my addr 172.21.15.119:0/846314949 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:54.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.565+0000 7f3be7fff640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3be8102f00 0x7f3be8113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:54.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.566+0000 7f3beccf8640 1 -- 172.21.15.119:0/846314949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3be8102f00 msgr2=0x7f3be8113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:54.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.566+0000 7f3beccf8640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3be8102f00 0x7f3be8113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:54.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.566+0000 7f3beccf8640 1 -- 172.21.15.119:0/846314949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4005040 con 0x7f3be8102560 2024-09-13T21:55:54.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.566+0000 7f3be7fff640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3be8102f00 0x7f3be8113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:55:54.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.566+0000 7f3beccf8640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be8102560 0x7f3be81131e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc002a80 tx=0x7f3bdc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:54.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.566+0000 7f3be57fa640 1 -- 172.21.15.119:0/846314949 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bdc007c30 con 0x7f3be8102560 2024-09-13T21:55:54.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.566+0000 7f3be57fa640 1 -- 172.21.15.119:0/846314949 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3bdc00f040 con 0x7f3be8102560 2024-09-13T21:55:54.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.566+0000 7f3beef5c640 1 -- 172.21.15.119:0/846314949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be810d440 con 0x7f3be8102560 2024-09-13T21:55:54.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.566+0000 7f3be57fa640 1 -- 172.21.15.119:0/846314949 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bdc009530 con 0x7f3be8102560 2024-09-13T21:55:54.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.566+0000 7f3beef5c640 1 -- 172.21.15.119:0/846314949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be810d930 con 0x7f3be8102560 2024-09-13T21:55:54.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.567+0000 7f3beef5c640 1 -- 172.21.15.119:0/846314949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be80fdce0 con 0x7f3be8102560 2024-09-13T21:55:54.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.567+0000 7f3be57fa640 1 -- 172.21.15.119:0/846314949 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3bdc009690 con 0x7f3be8102560 2024-09-13T21:55:54.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.568+0000 7f3be57fa640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3bd806e530 0x7f3bd80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:54.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.568+0000 7f3be57fa640 1 -- 172.21.15.119:0/846314949 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3bdc08db10 con 0x7f3be8102560 2024-09-13T21:55:54.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.568+0000 7f3be7fff640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3bd806e530 0x7f3bd80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:54.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.568+0000 7f3be7fff640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3bd806e530 0x7f3bd80709e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4000c00 tx=0x7f3bd4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:54.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.572+0000 7f3be57fa640 1 -- 172.21.15.119:0/846314949 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3bdc056c20 con 0x7f3be8102560 2024-09-13T21:55:54.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.771+0000 7f3beef5c640 1 -- 172.21.15.119:0/846314949 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f3be804b7b0 con 0x7f3be8102560 2024-09-13T21:55:54.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.772+0000 7f3be57fa640 1 -- 172.21.15.119:0/846314949 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v46) v1 ==== 107+0+4133 (secure 0 0 0) 0x7f3bdc05a2e0 con 0x7f3be8102560 2024-09-13T21:55:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:54.774 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":28,"btime":"2024-09-13T21:51:48:229131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":44281,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/1541412300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1541412300},{"type":"v1","addr":"172.21.15.155:6825","nonce":1541412300}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:51:37.180357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-09-13T21:55:54.774 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 28 2024-09-13T21:55:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.774+0000 7f3beef5c640 1 -- 172.21.15.119:0/846314949 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3bd806e530 msgr2=0x7f3bd80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.774+0000 7f3beef5c640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3bd806e530 0x7f3bd80709e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4000c00 tx=0x7f3bd4035040 comp rx=0 tx=0).stop 2024-09-13T21:55:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.774+0000 7f3beef5c640 1 -- 172.21.15.119:0/846314949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be8102560 msgr2=0x7f3be81131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.774+0000 7f3beef5c640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be8102560 0x7f3be81131e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc002a80 tx=0x7f3bdc004600 comp rx=0 tx=0).stop 2024-09-13T21:55:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.774+0000 7f3beef5c640 1 -- 172.21.15.119:0/846314949 shutdown_connections 2024-09-13T21:55:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.774+0000 7f3beef5c640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f3bd806e530 0x7f3bd80709e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.774+0000 7f3beef5c640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3be8102f00 0x7f3be8113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.774+0000 7f3beef5c640 1 --2- 172.21.15.119:0/846314949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be8102560 0x7f3be81131e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.774+0000 7f3beef5c640 1 -- 172.21.15.119:0/846314949 >> 172.21.15.119:0/846314949 conn(0x7f3be80f8100 msgr2=0x7f3be80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.774+0000 7f3beef5c640 1 -- 172.21.15.119:0/846314949 shutdown_connections 2024-09-13T21:55:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:54.774+0000 7f3beef5c640 1 -- 172.21.15.119:0/846314949 wait complete. 2024-09-13T21:55:55.366 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:55 smithi119 ceph-mon[90896]: pgmap v308: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:55.366 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:55 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/846314949' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T21:55:55.390 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-09-13T21:55:55.390 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-13T21:55:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:55 smithi155 ceph-mon[79928]: pgmap v308: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:55.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:55 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/846314949' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T21:55:55.637 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:57.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.219+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2421121821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a040fdf00 msgr2=0x7f3a041065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.219+0000 7f3a0a1c4640 1 --2- 172.21.15.119:0/2421121821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a040fdf00 0x7f3a041065d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f39f8004900 tx=0x7f39f8009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.219+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2421121821 shutdown_connections 2024-09-13T21:55:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.219+0000 7f3a0a1c4640 1 --2- 172.21.15.119:0/2421121821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a040fdf00 0x7f3a041065d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.219+0000 7f3a0a1c4640 1 --2- 172.21.15.119:0/2421121821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a040fd560 0x7f3a040fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.219+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2421121821 >> 172.21.15.119:0/2421121821 conn(0x7f3a040f7000 msgr2=0x7f3a040f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.219+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2421121821 shutdown_connections 2024-09-13T21:55:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.219+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2421121821 wait complete. 2024-09-13T21:55:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a0a1c4640 1 Processor -- start 2024-09-13T21:55:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a0a1c4640 1 -- start start 2024-09-13T21:55:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a0a1c4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a040fd560 0x7f3a04113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a0a1c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a040fdf00 0x7f3a04113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a0a1c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04113ee0 con 0x7f3a040fdf00 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a0a1c4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0410d2d0 con 0x7f3a040fd560 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a02ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a040fdf00 0x7f3a04113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a02ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a040fdf00 0x7f3a04113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37250/0 (socket says 172.21.15.119:37250) 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a02ffd640 1 -- 172.21.15.119:0/2783247761 learned_addr learned my addr 172.21.15.119:0/2783247761 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a037fe640 1 --2- 172.21.15.119:0/2783247761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a040fd560 0x7f3a04113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a02ffd640 1 -- 172.21.15.119:0/2783247761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a040fd560 msgr2=0x7f3a04113310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a02ffd640 1 --2- 172.21.15.119:0/2783247761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a040fd560 0x7f3a04113310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.220+0000 7f3a02ffd640 1 -- 172.21.15.119:0/2783247761 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f8005040 con 0x7f3a040fdf00 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.221+0000 7f3a02ffd640 1 --2- 172.21.15.119:0/2783247761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a040fdf00 0x7f3a04113850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f39f8004960 tx=0x7f39f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.221+0000 7f39ebfff640 1 -- 172.21.15.119:0/2783247761 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f8038070 con 0x7f3a040fdf00 2024-09-13T21:55:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.221+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2783247761 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0410d550 con 0x7f3a040fdf00 2024-09-13T21:55:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.221+0000 7f39ebfff640 1 -- 172.21.15.119:0/2783247761 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f39f8008ed0 con 0x7f3a040fdf00 2024-09-13T21:55:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.221+0000 7f39ebfff640 1 -- 172.21.15.119:0/2783247761 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f80095a0 con 0x7f3a040fdf00 2024-09-13T21:55:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.221+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2783247761 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0410da10 con 0x7f3a040fdf00 2024-09-13T21:55:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.222+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2783247761 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a040662b0 con 0x7f3a040fdf00 2024-09-13T21:55:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.222+0000 7f39ebfff640 1 -- 172.21.15.119:0/2783247761 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f39f8030020 con 0x7f3a040fdf00 2024-09-13T21:55:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.223+0000 7f39ebfff640 1 --2- 172.21.15.119:0/2783247761 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f39ec06e530 0x7f39ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:55:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.223+0000 7f39ebfff640 1 -- 172.21.15.119:0/2783247761 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f39f80ae0e0 con 0x7f3a040fdf00 2024-09-13T21:55:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.223+0000 7f3a037fe640 1 --2- 172.21.15.119:0/2783247761 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f39ec06e530 0x7f39ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:55:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.223+0000 7f3a037fe640 1 --2- 172.21.15.119:0/2783247761 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f39ec06e530 0x7f39ec0709e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f39f4006fd0 tx=0x7f39f4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:55:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.227+0000 7f39ebfff640 1 -- 172.21.15.119:0/2783247761 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f39f8077170 con 0x7f3a040fdf00 2024-09-13T21:55:57.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.438+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2783247761 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f3a040fac40 con 0x7f3a040fdf00 2024-09-13T21:55:57.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.439+0000 7f39ebfff640 1 -- 172.21.15.119:0/2783247761 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v46) v1 ==== 107+0+4983 (secure 0 0 0) 0x7f39f803e080 con 0x7f3a040fdf00 2024-09-13T21:55:57.441 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:55:57.441 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":29,"btime":"2024-09-13T21:51:52:240499+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44281,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/1541412300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1541412300},{"type":"v1","addr":"172.21.15.155:6825","nonce":1541412300}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:51:37.180357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi119.yydzwt","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.119:6829/66730685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":66730685},{"type":"v1","addr":"172.21.15.119:6829","nonce":66730685}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14472,"qdb_cluster":[14472]},"id":1}]} 2024-09-13T21:55:57.441 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 29 2024-09-13T21:55:57.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.441+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2783247761 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f39ec06e530 msgr2=0x7f39ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:57.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.441+0000 7f3a0a1c4640 1 --2- 172.21.15.119:0/2783247761 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f39ec06e530 0x7f39ec0709e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f39f4006fd0 tx=0x7f39f4008040 comp rx=0 tx=0).stop 2024-09-13T21:55:57.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.441+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2783247761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a040fdf00 msgr2=0x7f3a04113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:55:57.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.441+0000 7f3a0a1c4640 1 --2- 172.21.15.119:0/2783247761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a040fdf00 0x7f3a04113850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f39f8004960 tx=0x7f39f8009da0 comp rx=0 tx=0).stop 2024-09-13T21:55:57.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.441+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2783247761 shutdown_connections 2024-09-13T21:55:57.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.441+0000 7f3a0a1c4640 1 --2- 172.21.15.119:0/2783247761 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f39ec06e530 0x7f39ec0709e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:57.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.441+0000 7f3a0a1c4640 1 --2- 172.21.15.119:0/2783247761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a040fdf00 0x7f3a04113850 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:57.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.441+0000 7f3a0a1c4640 1 --2- 172.21.15.119:0/2783247761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a040fd560 0x7f3a04113310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:55:57.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.441+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2783247761 >> 172.21.15.119:0/2783247761 conn(0x7f3a040f7000 msgr2=0x7f3a040f8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:55:57.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.441+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2783247761 shutdown_connections 2024-09-13T21:55:57.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:55:57.441+0000 7f3a0a1c4640 1 -- 172.21.15.119:0/2783247761 wait complete. 2024-09-13T21:55:57.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:57 smithi155 ceph-mon[79928]: pgmap v309: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:57.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:57 smithi119 ceph-mon[90896]: pgmap v309: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:58.114 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-09-13T21:55:58.114 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-13T21:55:58.360 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:55:58.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:58 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2783247761' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T21:55:58.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:58 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2783247761' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T21:55:59.504 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:55:59 smithi119 ceph-mon[90896]: pgmap v310: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:55:59.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:55:59 smithi155 ceph-mon[79928]: pgmap v310: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.000+0000 7f523d1a7640 1 -- 172.21.15.119:0/542323202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238102550 msgr2=0x7f5238102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.000+0000 7f523d1a7640 1 --2- 172.21.15.119:0/542323202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238102550 0x7f5238102920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52280048d0 tx=0x7f5228009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.000+0000 7f523d1a7640 1 -- 172.21.15.119:0/542323202 shutdown_connections 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.000+0000 7f523d1a7640 1 --2- 172.21.15.119:0/542323202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5238102ef0 0x7f52380fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.000+0000 7f523d1a7640 1 --2- 172.21.15.119:0/542323202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238102550 0x7f5238102920 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.000+0000 7f523d1a7640 1 -- 172.21.15.119:0/542323202 >> 172.21.15.119:0/542323202 conn(0x7f52380f80f0 msgr2=0x7f52380fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.000+0000 7f523d1a7640 1 -- 172.21.15.119:0/542323202 shutdown_connections 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.000+0000 7f523d1a7640 1 -- 172.21.15.119:0/542323202 wait complete. 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.001+0000 7f523d1a7640 1 Processor -- start 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.001+0000 7f523d1a7640 1 -- start start 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.001+0000 7f523d1a7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238102550 0x7f5238113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.001+0000 7f523d1a7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5238102ef0 0x7f5238113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.001+0000 7f523d1a7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5238114100 con 0x7f5238102550 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.001+0000 7f523d1a7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523810d510 con 0x7f5238102ef0 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.001+0000 7f5236d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238102550 0x7f5238113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.001+0000 7f5236d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238102550 0x7f5238113570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37262/0 (socket says 172.21.15.119:37262) 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.001+0000 7f5236d9d640 1 -- 172.21.15.119:0/483181400 learned_addr learned my addr 172.21.15.119:0/483181400 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.002+0000 7f523659c640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5238102ef0 0x7f5238113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.002+0000 7f5236d9d640 1 -- 172.21.15.119:0/483181400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5238102ef0 msgr2=0x7f5238113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.002+0000 7f5236d9d640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5238102ef0 0x7f5238113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.002+0000 7f5236d9d640 1 -- 172.21.15.119:0/483181400 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228005040 con 0x7f5238102550 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.002+0000 7f523659c640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5238102ef0 0x7f5238113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.002+0000 7f5236d9d640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238102550 0x7f5238113570 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5228000c00 tx=0x7f5228009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.002+0000 7f521f7fe640 1 -- 172.21.15.119:0/483181400 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5228038070 con 0x7f5238102550 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.002+0000 7f521f7fe640 1 -- 172.21.15.119:0/483181400 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f522802ade0 con 0x7f5238102550 2024-09-13T21:56:00.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.002+0000 7f523d1a7640 1 -- 172.21.15.119:0/483181400 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523810d790 con 0x7f5238102550 2024-09-13T21:56:00.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.002+0000 7f521f7fe640 1 -- 172.21.15.119:0/483181400 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f522802c7e0 con 0x7f5238102550 2024-09-13T21:56:00.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.002+0000 7f523d1a7640 1 -- 172.21.15.119:0/483181400 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523810dcd0 con 0x7f5238102550 2024-09-13T21:56:00.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.003+0000 7f523d1a7640 1 -- 172.21.15.119:0/483181400 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52380fdcd0 con 0x7f5238102550 2024-09-13T21:56:00.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.003+0000 7f521f7fe640 1 -- 172.21.15.119:0/483181400 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5228030020 con 0x7f5238102550 2024-09-13T21:56:00.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.004+0000 7f521f7fe640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f522006e530 0x7f52200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:00.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.004+0000 7f521f7fe640 1 -- 172.21.15.119:0/483181400 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f52280ade10 con 0x7f5238102550 2024-09-13T21:56:00.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.004+0000 7f523659c640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f522006e530 0x7f52200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:00.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.004+0000 7f523659c640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f522006e530 0x7f52200709e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f523810e7f0 tx=0x7f522c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:00.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.008+0000 7f521f7fe640 1 -- 172.21.15.119:0/483181400 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5228076f70 con 0x7f5238102550 2024-09-13T21:56:00.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.212+0000 7f523d1a7640 1 -- 172.21.15.119:0/483181400 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f523804b7b0 con 0x7f5238102550 2024-09-13T21:56:00.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.212+0000 7f521f7fe640 1 -- 172.21.15.119:0/483181400 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v46) v1 ==== 107+0+4187 (secure 0 0 0) 0x7f522807a630 con 0x7f5238102550 2024-09-13T21:56:00.214 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:00.214 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":30,"btime":"2024-09-13T21:52:03:808000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44281,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/1541412300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1541412300},{"type":"v1","addr":"172.21.15.155:6825","nonce":1541412300}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:03.807997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:56:00.214 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 30 2024-09-13T21:56:00.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.215+0000 7f523d1a7640 1 -- 172.21.15.119:0/483181400 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f522006e530 msgr2=0x7f52200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.215+0000 7f523d1a7640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f522006e530 0x7f52200709e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f523810e7f0 tx=0x7f522c00b040 comp rx=0 tx=0).stop 2024-09-13T21:56:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.215+0000 7f523d1a7640 1 -- 172.21.15.119:0/483181400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238102550 msgr2=0x7f5238113570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.215+0000 7f523d1a7640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238102550 0x7f5238113570 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5228000c00 tx=0x7f5228009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.215+0000 7f523d1a7640 1 -- 172.21.15.119:0/483181400 shutdown_connections 2024-09-13T21:56:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.215+0000 7f523d1a7640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f522006e530 0x7f52200709e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.215+0000 7f523d1a7640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5238102ef0 0x7f5238113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.215+0000 7f523d1a7640 1 --2- 172.21.15.119:0/483181400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5238102550 0x7f5238113570 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.215+0000 7f523d1a7640 1 -- 172.21.15.119:0/483181400 >> 172.21.15.119:0/483181400 conn(0x7f52380f80f0 msgr2=0x7f52380f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.215+0000 7f523d1a7640 1 -- 172.21.15.119:0/483181400 shutdown_connections 2024-09-13T21:56:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:00.215+0000 7f523d1a7640 1 -- 172.21.15.119:0/483181400 wait complete. 2024-09-13T21:56:00.528 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:00 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/483181400' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T21:56:00.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:00 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/483181400' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T21:56:00.836 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-09-13T21:56:00.837 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-13T21:56:01.080 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:01.506 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:01 smithi119 ceph-mon[90896]: pgmap v311: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:01.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:01 smithi155 ceph-mon[79928]: pgmap v311: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:02.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.640+0000 7f7e02fb0640 1 -- 172.21.15.119:0/3910065245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dfc0fcf80 msgr2=0x7f7dfc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:02.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.640+0000 7f7e02fb0640 1 --2- 172.21.15.119:0/3910065245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dfc0fcf80 0x7f7dfc0fd3d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7de80048d0 tx=0x7f7de8009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:02.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.640+0000 7f7e02fb0640 1 -- 172.21.15.119:0/3910065245 shutdown_connections 2024-09-13T21:56:02.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.640+0000 7f7e02fb0640 1 --2- 172.21.15.119:0/3910065245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dfc0fcf80 0x7f7dfc0fd3d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:02.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.640+0000 7f7e02fb0640 1 --2- 172.21.15.119:0/3910065245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc0fb810 0x7f7dfc0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:02.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.640+0000 7f7e02fb0640 1 -- 172.21.15.119:0/3910065245 >> 172.21.15.119:0/3910065245 conn(0x7f7dfc0723b0 msgr2=0x7f7dfc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:02.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.640+0000 7f7e02fb0640 1 -- 172.21.15.119:0/3910065245 shutdown_connections 2024-09-13T21:56:02.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.640+0000 7f7e02fb0640 1 -- 172.21.15.119:0/3910065245 wait complete. 2024-09-13T21:56:02.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e02fb0640 1 Processor -- start 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e02fb0640 1 -- start start 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e02fb0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dfc0fb810 0x7f7dfc113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e02fb0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc0fcf80 0x7f7dfc1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e02fb0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc113cd0 con 0x7f7dfc0fb810 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e02fb0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc10d110 con 0x7f7dfc0fcf80 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e00d4c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dfc0fb810 0x7f7dfc113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e00d4c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dfc0fb810 0x7f7dfc113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:37278/0 (socket says 172.21.15.119:37278) 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e00d4c640 1 -- 172.21.15.119:0/2543828959 learned_addr learned my addr 172.21.15.119:0/2543828959 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7dfbfff640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc0fcf80 0x7f7dfc1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e00d4c640 1 -- 172.21.15.119:0/2543828959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc0fcf80 msgr2=0x7f7dfc1136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e00d4c640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc0fcf80 0x7f7dfc1136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:02.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7e00d4c640 1 -- 172.21.15.119:0/2543828959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de8005040 con 0x7f7dfc0fb810 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.641+0000 7f7dfbfff640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc0fcf80 0x7f7dfc1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.642+0000 7f7e00d4c640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dfc0fb810 0x7f7dfc113190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7df0002a80 tx=0x7f7df0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.642+0000 7f7df97fa640 1 -- 172.21.15.119:0/2543828959 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7df0007c30 con 0x7f7dfc0fb810 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.642+0000 7f7e02fb0640 1 -- 172.21.15.119:0/2543828959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dfc10d3f0 con 0x7f7dfc0fb810 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.642+0000 7f7df97fa640 1 -- 172.21.15.119:0/2543828959 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7df000f040 con 0x7f7dfc0fb810 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.642+0000 7f7df97fa640 1 -- 172.21.15.119:0/2543828959 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7df0009530 con 0x7f7dfc0fb810 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.642+0000 7f7e02fb0640 1 -- 172.21.15.119:0/2543828959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dfc10d910 con 0x7f7dfc0fb810 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.643+0000 7f7e02fb0640 1 -- 172.21.15.119:0/2543828959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dfc0fcbc0 con 0x7f7dfc0fb810 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.643+0000 7f7df97fa640 1 -- 172.21.15.119:0/2543828959 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7df0009690 con 0x7f7dfc0fb810 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.644+0000 7f7df97fa640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7dec06e530 0x7f7dec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.644+0000 7f7df97fa640 1 -- 172.21.15.119:0/2543828959 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7df008db10 con 0x7f7dfc0fb810 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.644+0000 7f7dfbfff640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7dec06e530 0x7f7dec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.644+0000 7f7dfbfff640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7dec06e530 0x7f7dec0709e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7de800b020 tx=0x7f7de8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:02.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.648+0000 7f7df97fa640 1 -- 172.21.15.119:0/2543828959 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7df0056c20 con 0x7f7dfc0fb810 2024-09-13T21:56:02.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.850+0000 7f7e02fb0640 1 -- 172.21.15.119:0/2543828959 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f7dfc072ec0 con 0x7f7dfc0fb810 2024-09-13T21:56:02.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.851+0000 7f7df97fa640 1 -- 172.21.15.119:0/2543828959 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v46) v1 ==== 107+0+4198 (secure 0 0 0) 0x7f7dfc072ec0 con 0x7f7dfc0fb810 2024-09-13T21:56:02.852 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:02.852 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":31,"btime":"2024-09-13T21:52:03:812185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44281,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/1541412300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1541412300},{"type":"v1","addr":"172.21.15.155:6825","nonce":1541412300}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:03.812178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":0,"incarnation":31,"state":"up:replay","state_seq":2,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:56:02.852 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 31 2024-09-13T21:56:02.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.853+0000 7f7e02fb0640 1 -- 172.21.15.119:0/2543828959 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7dec06e530 msgr2=0x7f7dec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:02.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.853+0000 7f7e02fb0640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7dec06e530 0x7f7dec0709e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7de800b020 tx=0x7f7de8009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:02.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.853+0000 7f7e02fb0640 1 -- 172.21.15.119:0/2543828959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dfc0fb810 msgr2=0x7f7dfc113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:02.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.853+0000 7f7e02fb0640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dfc0fb810 0x7f7dfc113190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7df0002a80 tx=0x7f7df0004600 comp rx=0 tx=0).stop 2024-09-13T21:56:02.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.853+0000 7f7e02fb0640 1 -- 172.21.15.119:0/2543828959 shutdown_connections 2024-09-13T21:56:02.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.853+0000 7f7e02fb0640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7dec06e530 0x7f7dec0709e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:02.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.853+0000 7f7e02fb0640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dfc0fcf80 0x7f7dfc1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:02.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.853+0000 7f7e02fb0640 1 --2- 172.21.15.119:0/2543828959 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dfc0fb810 0x7f7dfc113190 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:02.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.853+0000 7f7e02fb0640 1 -- 172.21.15.119:0/2543828959 >> 172.21.15.119:0/2543828959 conn(0x7f7dfc0723b0 msgr2=0x7f7dfc065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:02.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.853+0000 7f7e02fb0640 1 -- 172.21.15.119:0/2543828959 shutdown_connections 2024-09-13T21:56:02.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:02.853+0000 7f7e02fb0640 1 -- 172.21.15.119:0/2543828959 wait complete. 2024-09-13T21:56:03.468 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-09-13T21:56:03.468 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-13T21:56:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:03 smithi155 ceph-mon[79928]: pgmap v312: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:03.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:03 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2543828959' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T21:56:03.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:03 smithi119 ceph-mon[90896]: pgmap v312: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:03.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:03 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2543828959' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T21:56:03.713 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:05.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.322+0000 7f7d35613640 1 -- 172.21.15.119:0/2446325266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d30101530 msgr2=0x7f7d30101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:05.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.322+0000 7f7d35613640 1 --2- 172.21.15.119:0/2446325266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d30101530 0x7f7d30101900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7d200048d0 tx=0x7f7d20009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:05.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.323+0000 7f7d35613640 1 -- 172.21.15.119:0/2446325266 shutdown_connections 2024-09-13T21:56:05.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.323+0000 7f7d35613640 1 --2- 172.21.15.119:0/2446325266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d30101e40 0x7f7d300fbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:05.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.323+0000 7f7d35613640 1 --2- 172.21.15.119:0/2446325266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d30101530 0x7f7d30101900 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:05.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.323+0000 7f7d35613640 1 -- 172.21.15.119:0/2446325266 >> 172.21.15.119:0/2446325266 conn(0x7f7d30070d50 msgr2=0x7f7d30071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:05.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.323+0000 7f7d35613640 1 -- 172.21.15.119:0/2446325266 shutdown_connections 2024-09-13T21:56:05.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.323+0000 7f7d35613640 1 -- 172.21.15.119:0/2446325266 wait complete. 2024-09-13T21:56:05.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.323+0000 7f7d35613640 1 Processor -- start 2024-09-13T21:56:05.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.323+0000 7f7d35613640 1 -- start start 2024-09-13T21:56:05.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d35613640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d30101530 0x7f7d30113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:05.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d35613640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d30101e40 0x7f7d30113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:05.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d35613640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30113e60 con 0x7f7d30101e40 2024-09-13T21:56:05.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d35613640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3010d2a0 con 0x7f7d30101530 2024-09-13T21:56:05.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d267fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d30101e40 0x7f7d30113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:05.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d267fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d30101e40 0x7f7d30113860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45870/0 (socket says 172.21.15.119:45870) 2024-09-13T21:56:05.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d267fc640 1 -- 172.21.15.119:0/4118810091 learned_addr learned my addr 172.21.15.119:0/4118810091 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:05.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d2effd640 1 --2- 172.21.15.119:0/4118810091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d30101530 0x7f7d30113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:05.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d267fc640 1 -- 172.21.15.119:0/4118810091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d30101530 msgr2=0x7f7d30113320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:05.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d267fc640 1 --2- 172.21.15.119:0/4118810091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d30101530 0x7f7d30113320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:05.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d267fc640 1 -- 172.21.15.119:0/4118810091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d20005040 con 0x7f7d30101e40 2024-09-13T21:56:05.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d267fc640 1 --2- 172.21.15.119:0/4118810091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d30101e40 0x7f7d30113860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7d18002a50 tx=0x7f7d18004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:05.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.324+0000 7f7d27fff640 1 -- 172.21.15.119:0/4118810091 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d18007c30 con 0x7f7d30101e40 2024-09-13T21:56:05.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.325+0000 7f7d27fff640 1 -- 172.21.15.119:0/4118810091 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7d1800f040 con 0x7f7d30101e40 2024-09-13T21:56:05.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.325+0000 7f7d27fff640 1 -- 172.21.15.119:0/4118810091 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d1800da10 con 0x7f7d30101e40 2024-09-13T21:56:05.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.325+0000 7f7d35613640 1 -- 172.21.15.119:0/4118810091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3010d580 con 0x7f7d30101e40 2024-09-13T21:56:05.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.325+0000 7f7d35613640 1 -- 172.21.15.119:0/4118810091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3010daa0 con 0x7f7d30101e40 2024-09-13T21:56:05.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.326+0000 7f7d35613640 1 -- 172.21.15.119:0/4118810091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d300fce10 con 0x7f7d30101e40 2024-09-13T21:56:05.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.326+0000 7f7d27fff640 1 -- 172.21.15.119:0/4118810091 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7d1800dc80 con 0x7f7d30101e40 2024-09-13T21:56:05.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.327+0000 7f7d27fff640 1 --2- 172.21.15.119:0/4118810091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7d1c06e530 0x7f7d1c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:05.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.327+0000 7f7d27fff640 1 -- 172.21.15.119:0/4118810091 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7d1808d990 con 0x7f7d30101e40 2024-09-13T21:56:05.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.327+0000 7f7d2effd640 1 --2- 172.21.15.119:0/4118810091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7d1c06e530 0x7f7d1c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:05.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.327+0000 7f7d2effd640 1 --2- 172.21.15.119:0/4118810091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7d1c06e530 0x7f7d1c0709e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009ac0 tx=0x7f7d20035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.331+0000 7f7d27fff640 1 -- 172.21.15.119:0/4118810091 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7d18056ad0 con 0x7f7d30101e40 2024-09-13T21:56:05.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:05 smithi119 ceph-mon[90896]: pgmap v313: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:05.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.530+0000 7f7d35613640 1 -- 172.21.15.119:0/4118810091 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f7d30108540 con 0x7f7d30101e40 2024-09-13T21:56:05.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.531+0000 7f7d27fff640 1 -- 172.21.15.119:0/4118810091 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v46) v1 ==== 107+0+4203 (secure 0 0 0) 0x7f7d1805a190 con 0x7f7d30101e40 2024-09-13T21:56:05.532 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:05.533 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":32,"btime":"2024-09-13T21:52:09:241397+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44281,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/1541412300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1541412300},{"type":"v1","addr":"172.21.15.155:6825","nonce":1541412300}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:08.615900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":148,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:56:05.533 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 32 2024-09-13T21:56:05.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.533+0000 7f7d35613640 1 -- 172.21.15.119:0/4118810091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7d1c06e530 msgr2=0x7f7d1c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:05.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.533+0000 7f7d35613640 1 --2- 172.21.15.119:0/4118810091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7d1c06e530 0x7f7d1c0709e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009ac0 tx=0x7f7d20035040 comp rx=0 tx=0).stop 2024-09-13T21:56:05.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.533+0000 7f7d35613640 1 -- 172.21.15.119:0/4118810091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d30101e40 msgr2=0x7f7d30113860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:05.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.533+0000 7f7d35613640 1 --2- 172.21.15.119:0/4118810091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d30101e40 0x7f7d30113860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7d18002a50 tx=0x7f7d18004600 comp rx=0 tx=0).stop 2024-09-13T21:56:05.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.533+0000 7f7d35613640 1 -- 172.21.15.119:0/4118810091 shutdown_connections 2024-09-13T21:56:05.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.533+0000 7f7d35613640 1 --2- 172.21.15.119:0/4118810091 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7d1c06e530 0x7f7d1c0709e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:05.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.533+0000 7f7d35613640 1 --2- 172.21.15.119:0/4118810091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d30101e40 0x7f7d30113860 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:05.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.533+0000 7f7d35613640 1 --2- 172.21.15.119:0/4118810091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d30101530 0x7f7d30113320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:05.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.533+0000 7f7d35613640 1 -- 172.21.15.119:0/4118810091 >> 172.21.15.119:0/4118810091 conn(0x7f7d30070d50 msgr2=0x7f7d300fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:05.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.533+0000 7f7d35613640 1 -- 172.21.15.119:0/4118810091 shutdown_connections 2024-09-13T21:56:05.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:05.533+0000 7f7d35613640 1 -- 172.21.15.119:0/4118810091 wait complete. 2024-09-13T21:56:05.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:05 smithi155 ceph-mon[79928]: pgmap v313: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:06.182 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-09-13T21:56:06.182 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-13T21:56:06.428 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:06.548 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:06 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/4118810091' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T21:56:06.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:06 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/4118810091' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T21:56:07.577 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:07 smithi119 ceph-mon[90896]: pgmap v314: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:07.577 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:56:07.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:07 smithi155 ceph-mon[79928]: pgmap v314: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:07.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 -- 172.21.15.119:0/228419517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7280fac00 msgr2=0x7fb7280fb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 --2- 172.21.15.119:0/228419517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7280fac00 0x7fb7280fb070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0048d0 tx=0x7fb71c009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 -- 172.21.15.119:0/228419517 shutdown_connections 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 --2- 172.21.15.119:0/228419517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7280fac00 0x7fb7280fb070 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 --2- 172.21.15.119:0/228419517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb728102600 0x7fb7281029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 -- 172.21.15.119:0/228419517 >> 172.21.15.119:0/228419517 conn(0x7fb728070c80 msgr2=0x7fb728071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 -- 172.21.15.119:0/228419517 shutdown_connections 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 -- 172.21.15.119:0/228419517 wait complete. 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 Processor -- start 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 -- start start 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7280fac00 0x7fb7281131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:08.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb728102600 0x7fb7281136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:08.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb728113ce0 con 0x7fb728102600 2024-09-13T21:56:08.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.961+0000 7fb72ca40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72810d120 con 0x7fb7280fac00 2024-09-13T21:56:08.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb725d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb728102600 0x7fb7281136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:08.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb725d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb728102600 0x7fb7281136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45878/0 (socket says 172.21.15.119:45878) 2024-09-13T21:56:08.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb725d9b640 1 -- 172.21.15.119:0/955222871 learned_addr learned my addr 172.21.15.119:0/955222871 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:08.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb72659c640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7280fac00 0x7fb7281131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:08.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb725d9b640 1 -- 172.21.15.119:0/955222871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7280fac00 msgr2=0x7fb7281131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb725d9b640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7280fac00 0x7fb7281131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb725d9b640 1 -- 172.21.15.119:0/955222871 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c005040 con 0x7fb728102600 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb72659c640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7280fac00 0x7fb7281131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb725d9b640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb728102600 0x7fb7281136e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb71c000c00 tx=0x7fb71c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb716ffd640 1 -- 172.21.15.119:0/955222871 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb71c038070 con 0x7fb728102600 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb716ffd640 1 -- 172.21.15.119:0/955222871 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb71c02ade0 con 0x7fb728102600 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb72ca40640 1 -- 172.21.15.119:0/955222871 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72810d3a0 con 0x7fb728102600 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb716ffd640 1 -- 172.21.15.119:0/955222871 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb71c02c7e0 con 0x7fb728102600 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.962+0000 7fb72ca40640 1 -- 172.21.15.119:0/955222871 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72810d8e0 con 0x7fb728102600 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.963+0000 7fb72ca40640 1 -- 172.21.15.119:0/955222871 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb728065890 con 0x7fb728102600 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.964+0000 7fb716ffd640 1 -- 172.21.15.119:0/955222871 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb71c030020 con 0x7fb728102600 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.964+0000 7fb716ffd640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb71006e530 0x7fb7100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:08.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.964+0000 7fb716ffd640 1 -- 172.21.15.119:0/955222871 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb71c0addb0 con 0x7fb728102600 2024-09-13T21:56:08.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.964+0000 7fb72659c640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb71006e530 0x7fb7100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:08.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.965+0000 7fb72659c640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb71006e530 0x7fb7100709e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb718009fd0 tx=0x7fb718009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:08.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:07.969+0000 7fb716ffd640 1 -- 172.21.15.119:0/955222871 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb71c076f70 con 0x7fb728102600 2024-09-13T21:56:08.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.168+0000 7fb72ca40640 1 -- 172.21.15.119:0/955222871 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fb7281095b0 con 0x7fb728102600 2024-09-13T21:56:08.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.169+0000 7fb716ffd640 1 -- 172.21.15.119:0/955222871 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v46) v1 ==== 107+0+4200 (secure 0 0 0) 0x7fb71c07a630 con 0x7fb728102600 2024-09-13T21:56:08.170 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:08.170 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":33,"btime":"2024-09-13T21:52:10:246599+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44281,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/1541412300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1541412300},{"type":"v1","addr":"172.21.15.155:6825","nonce":1541412300}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:09.248632+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":149,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:56:08.171 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 33 2024-09-13T21:56:08.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.171+0000 7fb72ca40640 1 -- 172.21.15.119:0/955222871 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb71006e530 msgr2=0x7fb7100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:08.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.171+0000 7fb72ca40640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb71006e530 0x7fb7100709e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb718009fd0 tx=0x7fb718009e50 comp rx=0 tx=0).stop 2024-09-13T21:56:08.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.171+0000 7fb72ca40640 1 -- 172.21.15.119:0/955222871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb728102600 msgr2=0x7fb7281136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:08.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.171+0000 7fb72ca40640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb728102600 0x7fb7281136e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb71c000c00 tx=0x7fb71c009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:08.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.171+0000 7fb72ca40640 1 -- 172.21.15.119:0/955222871 shutdown_connections 2024-09-13T21:56:08.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.171+0000 7fb72ca40640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fb71006e530 0x7fb7100709e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.171+0000 7fb72ca40640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb728102600 0x7fb7281136e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.171+0000 7fb72ca40640 1 --2- 172.21.15.119:0/955222871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7280fac00 0x7fb7281131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.171+0000 7fb72ca40640 1 -- 172.21.15.119:0/955222871 >> 172.21.15.119:0/955222871 conn(0x7fb728070c80 msgr2=0x7fb728105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.171+0000 7fb72ca40640 1 -- 172.21.15.119:0/955222871 shutdown_connections 2024-09-13T21:56:08.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:08.171+0000 7fb72ca40640 1 -- 172.21.15.119:0/955222871 wait complete. 2024-09-13T21:56:08.577 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:08 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/955222871' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T21:56:08.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:08 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/955222871' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T21:56:08.754 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-09-13T21:56:08.754 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-13T21:56:09.002 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:09.380 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:09 smithi119 ceph-mon[90896]: pgmap v315: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:09 smithi155 ceph-mon[79928]: pgmap v315: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:10.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.648+0000 7f67eacc4640 1 -- 172.21.15.119:0/3333229579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e41014d0 msgr2=0x7f67e41018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:10.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.648+0000 7f67eacc4640 1 --2- 172.21.15.119:0/3333229579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e41014d0 0x7f67e41018a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f67d40048d0 tx=0x7f67d4009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:10.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.648+0000 7f67eacc4640 1 -- 172.21.15.119:0/3333229579 shutdown_connections 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.648+0000 7f67eacc4640 1 --2- 172.21.15.119:0/3333229579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67e40fb490 0x7f67e40fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.648+0000 7f67eacc4640 1 --2- 172.21.15.119:0/3333229579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e41014d0 0x7f67e41018a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.648+0000 7f67eacc4640 1 -- 172.21.15.119:0/3333229579 >> 172.21.15.119:0/3333229579 conn(0x7f67e40f7010 msgr2=0x7f67e40f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.648+0000 7f67eacc4640 1 -- 172.21.15.119:0/3333229579 shutdown_connections 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.648+0000 7f67eacc4640 1 -- 172.21.15.119:0/3333229579 wait complete. 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.648+0000 7f67eacc4640 1 Processor -- start 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67eacc4640 1 -- start start 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67eacc4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67e40fb490 0x7f67e4113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67eacc4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e41014d0 0x7f67e4113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67eacc4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4113e10 con 0x7f67e41014d0 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67eacc4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e410d1c0 con 0x7f67e40fb490 2024-09-13T21:56:10.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e41014d0 0x7f67e4113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e41014d0 0x7f67e4113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45906/0 (socket says 172.21.15.119:45906) 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67e3fff640 1 -- 172.21.15.119:0/1296904578 learned_addr learned my addr 172.21.15.119:0/1296904578 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67e8a60640 1 --2- 172.21.15.119:0/1296904578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67e40fb490 0x7f67e4113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67e3fff640 1 -- 172.21.15.119:0/1296904578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67e40fb490 msgr2=0x7f67e4113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67e3fff640 1 --2- 172.21.15.119:0/1296904578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67e40fb490 0x7f67e4113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.649+0000 7f67e3fff640 1 -- 172.21.15.119:0/1296904578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4005040 con 0x7f67e41014d0 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.650+0000 7f67e3fff640 1 --2- 172.21.15.119:0/1296904578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e41014d0 0x7f67e4113780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00b790 tx=0x7f67cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.650+0000 7f67e17fa640 1 -- 172.21.15.119:0/1296904578 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67cc00c700 con 0x7f67e41014d0 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.650+0000 7f67e17fa640 1 -- 172.21.15.119:0/1296904578 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f67cc00cd00 con 0x7f67e41014d0 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.650+0000 7f67eacc4640 1 -- 172.21.15.119:0/1296904578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e410d4a0 con 0x7f67e41014d0 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.650+0000 7f67e17fa640 1 -- 172.21.15.119:0/1296904578 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67cc015e80 con 0x7f67e41014d0 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.650+0000 7f67eacc4640 1 -- 172.21.15.119:0/1296904578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e410d9c0 con 0x7f67e41014d0 2024-09-13T21:56:10.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.651+0000 7f67eacc4640 1 -- 172.21.15.119:0/1296904578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e40fcbd0 con 0x7f67e41014d0 2024-09-13T21:56:10.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.651+0000 7f67e17fa640 1 -- 172.21.15.119:0/1296904578 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f67cc012070 con 0x7f67e41014d0 2024-09-13T21:56:10.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.652+0000 7f67e17fa640 1 --2- 172.21.15.119:0/1296904578 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f67d006e530 0x7f67d00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:10.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.652+0000 7f67e17fa640 1 -- 172.21.15.119:0/1296904578 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f67cc08da80 con 0x7f67e41014d0 2024-09-13T21:56:10.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.652+0000 7f67e8a60640 1 --2- 172.21.15.119:0/1296904578 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f67d006e530 0x7f67d00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:10.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.652+0000 7f67e8a60640 1 --2- 172.21.15.119:0/1296904578 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f67d006e530 0x7f67d00709e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009ac0 tx=0x7f67d4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:10.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.656+0000 7f67e17fa640 1 -- 172.21.15.119:0/1296904578 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f67cc056af0 con 0x7f67e41014d0 2024-09-13T21:56:10.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.855+0000 7f67eacc4640 1 -- 172.21.15.119:0/1296904578 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f67e40fac50 con 0x7f67e41014d0 2024-09-13T21:56:10.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.855+0000 7f67e17fa640 1 -- 172.21.15.119:0/1296904578 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v46) v1 ==== 107+0+4209 (secure 0 0 0) 0x7f67cc05a1b0 con 0x7f67e41014d0 2024-09-13T21:56:10.858 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:10.858 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":34,"btime":"2024-09-13T21:52:11:251197+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44281,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/1541412300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1541412300},{"type":"v1","addr":"172.21.15.155:6825","nonce":1541412300}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:11.251193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":0,"incarnation":31,"state":"up:active","state_seq":150,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24277,"qdb_cluster":[24277]},"id":1}]} 2024-09-13T21:56:10.858 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 34 2024-09-13T21:56:10.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.857+0000 7f67eacc4640 1 -- 172.21.15.119:0/1296904578 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f67d006e530 msgr2=0x7f67d00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:10.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.857+0000 7f67eacc4640 1 --2- 172.21.15.119:0/1296904578 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f67d006e530 0x7f67d00709e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009ac0 tx=0x7f67d4035040 comp rx=0 tx=0).stop 2024-09-13T21:56:10.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.857+0000 7f67eacc4640 1 -- 172.21.15.119:0/1296904578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e41014d0 msgr2=0x7f67e4113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:10.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.857+0000 7f67eacc4640 1 --2- 172.21.15.119:0/1296904578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e41014d0 0x7f67e4113780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00b790 tx=0x7f67cc0091d0 comp rx=0 tx=0).stop 2024-09-13T21:56:10.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.858+0000 7f67eacc4640 1 -- 172.21.15.119:0/1296904578 shutdown_connections 2024-09-13T21:56:10.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.858+0000 7f67eacc4640 1 --2- 172.21.15.119:0/1296904578 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f67d006e530 0x7f67d00709e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:10.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.858+0000 7f67eacc4640 1 --2- 172.21.15.119:0/1296904578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67e41014d0 0x7f67e4113780 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:10.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.858+0000 7f67eacc4640 1 --2- 172.21.15.119:0/1296904578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67e40fb490 0x7f67e4113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:10.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.858+0000 7f67eacc4640 1 -- 172.21.15.119:0/1296904578 >> 172.21.15.119:0/1296904578 conn(0x7f67e40f7010 msgr2=0x7f67e4065ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:10.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.858+0000 7f67eacc4640 1 -- 172.21.15.119:0/1296904578 shutdown_connections 2024-09-13T21:56:10.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:10.858+0000 7f67eacc4640 1 -- 172.21.15.119:0/1296904578 wait complete. 2024-09-13T21:56:11.435 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:11 smithi119 ceph-mon[90896]: pgmap v316: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:11.435 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:11 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1296904578' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T21:56:11.459 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-09-13T21:56:11.459 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-13T21:56:11.703 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:11.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:11 smithi155 ceph-mon[79928]: pgmap v316: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:11.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:11 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1296904578' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T21:56:13.462 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:13 smithi119 ceph-mon[90896]: pgmap v317: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.463+0000 7fcf9460f640 1 -- 172.21.15.119:0/3617697114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf8c0fb810 msgr2=0x7fcf8c0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.463+0000 7fcf9460f640 1 --2- 172.21.15.119:0/3617697114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf8c0fb810 0x7fcf8c0fbbe0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcf880048d0 tx=0x7fcf88009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:13.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.463+0000 7fcf9460f640 1 -- 172.21.15.119:0/3617697114 shutdown_connections 2024-09-13T21:56:13.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.463+0000 7fcf9460f640 1 --2- 172.21.15.119:0/3617697114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0fcf80 0x7fcf8c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:13.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.463+0000 7fcf9460f640 1 --2- 172.21.15.119:0/3617697114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf8c0fb810 0x7fcf8c0fbbe0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:13.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.463+0000 7fcf9460f640 1 -- 172.21.15.119:0/3617697114 >> 172.21.15.119:0/3617697114 conn(0x7fcf8c0723b0 msgr2=0x7fcf8c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:13.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.463+0000 7fcf9460f640 1 -- 172.21.15.119:0/3617697114 shutdown_connections 2024-09-13T21:56:13.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.463+0000 7fcf9460f640 1 -- 172.21.15.119:0/3617697114 wait complete. 2024-09-13T21:56:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf9460f640 1 Processor -- start 2024-09-13T21:56:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf9460f640 1 -- start start 2024-09-13T21:56:13.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf9460f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0fb810 0x7fcf8c1120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:13.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf9460f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf8c0fcf80 0x7fcf8c112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:13.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf9460f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c112c30 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf9460f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c10c070 con 0x7fcf8c0fb810 2024-09-13T21:56:13.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf91baa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf8c0fcf80 0x7fcf8c112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:13.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf91baa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf8c0fcf80 0x7fcf8c112630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45932/0 (socket says 172.21.15.119:45932) 2024-09-13T21:56:13.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf91baa640 1 -- 172.21.15.119:0/298016180 learned_addr learned my addr 172.21.15.119:0/298016180 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:13.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf923ab640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0fb810 0x7fcf8c1120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:13.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf91baa640 1 -- 172.21.15.119:0/298016180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0fb810 msgr2=0x7fcf8c1120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:13.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf91baa640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0fb810 0x7fcf8c1120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:13.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf91baa640 1 -- 172.21.15.119:0/298016180 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88005040 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.464+0000 7fcf923ab640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0fb810 0x7fcf8c1120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:56:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.465+0000 7fcf91baa640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf8c0fcf80 0x7fcf8c112630 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00eb70 tx=0x7fcf7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.465+0000 7fcf82ffd640 1 -- 172.21.15.119:0/298016180 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf7c007c30 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.465+0000 7fcf82ffd640 1 -- 172.21.15.119:0/298016180 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf7c00f040 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.465+0000 7fcf9460f640 1 -- 172.21.15.119:0/298016180 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8c10c2f0 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.465+0000 7fcf82ffd640 1 -- 172.21.15.119:0/298016180 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf7c0094e0 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.465+0000 7fcf9460f640 1 -- 172.21.15.119:0/298016180 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c10c890 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.466+0000 7fcf9460f640 1 -- 172.21.15.119:0/298016180 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8c0fcbc0 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.466+0000 7fcf82ffd640 1 -- 172.21.15.119:0/298016180 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fcf7c009660 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.467+0000 7fcf82ffd640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcf7806e530 0x7fcf780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:13.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.467+0000 7fcf82ffd640 1 -- 172.21.15.119:0/298016180 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fcf7c08df60 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.467+0000 7fcf923ab640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcf7806e530 0x7fcf780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:13.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.467+0000 7fcf923ab640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcf7806e530 0x7fcf780709e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcf88007ac0 tx=0x7fcf88035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:13.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.471+0000 7fcf82ffd640 1 -- 172.21.15.119:0/298016180 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcf7c0c31b0 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.675+0000 7fcf9460f640 1 -- 172.21.15.119:0/298016180 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fcf8c10d760 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.675+0000 7fcf82ffd640 1 -- 172.21.15.119:0/298016180 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v46) v1 ==== 107+0+5059 (secure 0 0 0) 0x7fcf7c056ff0 con 0x7fcf8c0fcf80 2024-09-13T21:56:13.678 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:13.678 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":35,"btime":"2024-09-13T21:52:12:256540+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44281,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/1541412300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1541412300},{"type":"v1","addr":"172.21.15.155:6825","nonce":1541412300}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:11.251193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":0,"incarnation":31,"state":"up:active","state_seq":150,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24277,"qdb_cluster":[24277]},"id":1}]} 2024-09-13T21:56:13.678 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 35 2024-09-13T21:56:13.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.677+0000 7fcf9460f640 1 -- 172.21.15.119:0/298016180 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcf7806e530 msgr2=0x7fcf780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:13.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.677+0000 7fcf9460f640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcf7806e530 0x7fcf780709e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcf88007ac0 tx=0x7fcf88035040 comp rx=0 tx=0).stop 2024-09-13T21:56:13.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.677+0000 7fcf9460f640 1 -- 172.21.15.119:0/298016180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf8c0fcf80 msgr2=0x7fcf8c112630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:13.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.677+0000 7fcf9460f640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf8c0fcf80 0x7fcf8c112630 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00eb70 tx=0x7fcf7c00b040 comp rx=0 tx=0).stop 2024-09-13T21:56:13.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.677+0000 7fcf9460f640 1 -- 172.21.15.119:0/298016180 shutdown_connections 2024-09-13T21:56:13.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.677+0000 7fcf9460f640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fcf7806e530 0x7fcf780709e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:13.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.677+0000 7fcf9460f640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf8c0fcf80 0x7fcf8c112630 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:13.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.677+0000 7fcf9460f640 1 --2- 172.21.15.119:0/298016180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0fb810 0x7fcf8c1120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:13.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.677+0000 7fcf9460f640 1 -- 172.21.15.119:0/298016180 >> 172.21.15.119:0/298016180 conn(0x7fcf8c0723b0 msgr2=0x7fcf8c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:13.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.677+0000 7fcf9460f640 1 -- 172.21.15.119:0/298016180 shutdown_connections 2024-09-13T21:56:13.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:13.677+0000 7fcf9460f640 1 -- 172.21.15.119:0/298016180 wait complete. 2024-09-13T21:56:13.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:13 smithi155 ceph-mon[79928]: pgmap v317: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:14.315 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-09-13T21:56:14.315 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-13T21:56:14.580 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:14.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:14 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/298016180' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T21:56:14.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:14 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/298016180' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T21:56:15.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:15 smithi119 ceph-mon[90896]: pgmap v318: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:15.734 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:15 smithi155 ceph-mon[79928]: pgmap v318: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:16.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.161+0000 7f21dcc3a640 1 -- 172.21.15.119:0/3386847134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21d8064fe0 msgr2=0x7f21d8065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.161+0000 7f21dcc3a640 1 --2- 172.21.15.119:0/3386847134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21d8064fe0 0x7f21d8065430 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f21cc0048d0 tx=0x7f21cc009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.161+0000 7f21dcc3a640 1 -- 172.21.15.119:0/3386847134 shutdown_connections 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.161+0000 7f21dcc3a640 1 --2- 172.21.15.119:0/3386847134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21d8064fe0 0x7f21d8065430 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.161+0000 7f21dcc3a640 1 --2- 172.21.15.119:0/3386847134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d80fe450 0x7f21d80fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.161+0000 7f21dcc3a640 1 -- 172.21.15.119:0/3386847134 >> 172.21.15.119:0/3386847134 conn(0x7f21d80723b0 msgr2=0x7f21d80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.161+0000 7f21dcc3a640 1 -- 172.21.15.119:0/3386847134 shutdown_connections 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.161+0000 7f21dcc3a640 1 -- 172.21.15.119:0/3386847134 wait complete. 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.162+0000 7f21dcc3a640 1 Processor -- start 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.162+0000 7f21dcc3a640 1 -- start start 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.162+0000 7f21dcc3a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21d8064fe0 0x7f21d8113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.162+0000 7f21dcc3a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d80fe450 0x7f21d8113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.162+0000 7f21dcc3a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d8113d60 con 0x7f21d8064fe0 2024-09-13T21:56:16.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.162+0000 7f21dcc3a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d810d1a0 con 0x7f21d80fe450 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.162+0000 7f21d659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21d8064fe0 0x7f21d8113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.162+0000 7f21d659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21d8064fe0 0x7f21d8113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46688/0 (socket says 172.21.15.119:46688) 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.162+0000 7f21d659c640 1 -- 172.21.15.119:0/1287923977 learned_addr learned my addr 172.21.15.119:0/1287923977 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.162+0000 7f21d5d9b640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d80fe450 0x7f21d8113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.163+0000 7f21d659c640 1 -- 172.21.15.119:0/1287923977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d80fe450 msgr2=0x7f21d8113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.163+0000 7f21d659c640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d80fe450 0x7f21d8113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.163+0000 7f21d659c640 1 -- 172.21.15.119:0/1287923977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc005040 con 0x7f21d8064fe0 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.163+0000 7f21d5d9b640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d80fe450 0x7f21d8113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.163+0000 7f21d659c640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21d8064fe0 0x7f21d8113220 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c790 tx=0x7f21c80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.163+0000 7f21c6ffd640 1 -- 172.21.15.119:0/1287923977 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c800a820 con 0x7f21d8064fe0 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.163+0000 7f21dcc3a640 1 -- 172.21.15.119:0/1287923977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d810d480 con 0x7f21d8064fe0 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.163+0000 7f21c6ffd640 1 -- 172.21.15.119:0/1287923977 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f21c800ae20 con 0x7f21d8064fe0 2024-09-13T21:56:16.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.163+0000 7f21c6ffd640 1 -- 172.21.15.119:0/1287923977 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c80113a0 con 0x7f21d8064fe0 2024-09-13T21:56:16.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.163+0000 7f21dcc3a640 1 -- 172.21.15.119:0/1287923977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d810d970 con 0x7f21d8064fe0 2024-09-13T21:56:16.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.164+0000 7f21dcc3a640 1 -- 172.21.15.119:0/1287923977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d80fdce0 con 0x7f21d8064fe0 2024-09-13T21:56:16.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.165+0000 7f21c6ffd640 1 -- 172.21.15.119:0/1287923977 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f21c8012400 con 0x7f21d8064fe0 2024-09-13T21:56:16.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.165+0000 7f21c6ffd640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f21c006e530 0x7f21c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:16.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.165+0000 7f21c6ffd640 1 -- 172.21.15.119:0/1287923977 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f21c808e380 con 0x7f21d8064fe0 2024-09-13T21:56:16.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.165+0000 7f21d5d9b640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f21c006e530 0x7f21c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:16.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.166+0000 7f21d5d9b640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f21c006e530 0x7f21c00709e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21d8072dd0 tx=0x7f21cc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:16.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.169+0000 7f21c6ffd640 1 -- 172.21.15.119:0/1287923977 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f21c8057490 con 0x7f21d8064fe0 2024-09-13T21:56:16.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.375+0000 7f21dcc3a640 1 -- 172.21.15.119:0/1287923977 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f21d804b750 con 0x7f21d8064fe0 2024-09-13T21:56:16.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.375+0000 7f21c6ffd640 1 -- 172.21.15.119:0/1287923977 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v46) v1 ==== 107+0+4277 (secure 0 0 0) 0x7f21c800a980 con 0x7f21d8064fe0 2024-09-13T21:56:16.377 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:16.377 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":36,"btime":"2024-09-13T21:52:24:287338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:11.251193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":0,"incarnation":31,"state":"up:active","state_seq":150,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24277,"qdb_cluster":[24277]},"id":1}]} 2024-09-13T21:56:16.377 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 36 2024-09-13T21:56:16.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.378+0000 7f21dcc3a640 1 -- 172.21.15.119:0/1287923977 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f21c006e530 msgr2=0x7f21c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:16.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.378+0000 7f21dcc3a640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f21c006e530 0x7f21c00709e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21d8072dd0 tx=0x7f21cc035040 comp rx=0 tx=0).stop 2024-09-13T21:56:16.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.378+0000 7f21dcc3a640 1 -- 172.21.15.119:0/1287923977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21d8064fe0 msgr2=0x7f21d8113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:16.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.378+0000 7f21dcc3a640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21d8064fe0 0x7f21d8113220 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c790 tx=0x7f21c80043c0 comp rx=0 tx=0).stop 2024-09-13T21:56:16.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.378+0000 7f21dcc3a640 1 -- 172.21.15.119:0/1287923977 shutdown_connections 2024-09-13T21:56:16.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.378+0000 7f21dcc3a640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f21c006e530 0x7f21c00709e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:16.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.378+0000 7f21dcc3a640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d80fe450 0x7f21d8113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:16.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.378+0000 7f21dcc3a640 1 --2- 172.21.15.119:0/1287923977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21d8064fe0 0x7f21d8113220 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:16.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.378+0000 7f21dcc3a640 1 -- 172.21.15.119:0/1287923977 >> 172.21.15.119:0/1287923977 conn(0x7f21d80723b0 msgr2=0x7f21d8105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:16.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.378+0000 7f21dcc3a640 1 -- 172.21.15.119:0/1287923977 shutdown_connections 2024-09-13T21:56:16.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:16.378+0000 7f21dcc3a640 1 -- 172.21.15.119:0/1287923977 wait complete. 2024-09-13T21:56:17.023 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-09-13T21:56:17.023 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-13T21:56:17.268 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:17.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:17 smithi119 ceph-mon[90896]: pgmap v319: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:17.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:17 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1287923977' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T21:56:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:17 smithi155 ceph-mon[79928]: pgmap v319: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:17 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1287923977' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T21:56:18.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.934+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2514443178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5e81014d0 msgr2=0x7fd5e81018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:18.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.934+0000 7fd5ef01f640 1 --2- 172.21.15.119:0/2514443178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5e81014d0 0x7fd5e81018a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0048d0 tx=0x7fd5dc009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:18.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.934+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2514443178 shutdown_connections 2024-09-13T21:56:18.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.934+0000 7fd5ef01f640 1 --2- 172.21.15.119:0/2514443178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5e80fb490 0x7fd5e80fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:18.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.934+0000 7fd5ef01f640 1 --2- 172.21.15.119:0/2514443178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5e81014d0 0x7fd5e81018a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:18.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.934+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2514443178 >> 172.21.15.119:0/2514443178 conn(0x7fd5e80f7010 msgr2=0x7fd5e80f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:18.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.934+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2514443178 shutdown_connections 2024-09-13T21:56:18.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.934+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2514443178 wait complete. 2024-09-13T21:56:18.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.935+0000 7fd5ef01f640 1 Processor -- start 2024-09-13T21:56:18.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.935+0000 7fd5ef01f640 1 -- start start 2024-09-13T21:56:18.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.935+0000 7fd5ef01f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5e80fb490 0x7fd5e8112140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:18.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.935+0000 7fd5ef01f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5e81014d0 0x7fd5e8112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:18.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.935+0000 7fd5ef01f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e8112d10 con 0x7fd5e80fb490 2024-09-13T21:56:18.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.935+0000 7fd5ef01f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e810c0c0 con 0x7fd5e81014d0 2024-09-13T21:56:18.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.935+0000 7fd5ecdbb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5e80fb490 0x7fd5e8112140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:18.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.935+0000 7fd5ecdbb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5e80fb490 0x7fd5e8112140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46704/0 (socket says 172.21.15.119:46704) 2024-09-13T21:56:18.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.935+0000 7fd5ecdbb640 1 -- 172.21.15.119:0/2357378842 learned_addr learned my addr 172.21.15.119:0/2357378842 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:18.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.935+0000 7fd5e7fff640 1 --2- 172.21.15.119:0/2357378842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5e81014d0 0x7fd5e8112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:18.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.936+0000 7fd5ecdbb640 1 -- 172.21.15.119:0/2357378842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5e81014d0 msgr2=0x7fd5e8112680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.936+0000 7fd5ecdbb640 1 --2- 172.21.15.119:0/2357378842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5e81014d0 0x7fd5e8112680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.936+0000 7fd5ecdbb640 1 -- 172.21.15.119:0/2357378842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc005040 con 0x7fd5e80fb490 2024-09-13T21:56:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.936+0000 7fd5ecdbb640 1 --2- 172.21.15.119:0/2357378842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5e80fb490 0x7fd5e8112140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc000c00 tx=0x7fd5dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.936+0000 7fd5e57fa640 1 -- 172.21.15.119:0/2357378842 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5dc03a070 con 0x7fd5e80fb490 2024-09-13T21:56:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.936+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2357378842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e810c340 con 0x7fd5e80fb490 2024-09-13T21:56:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.936+0000 7fd5e57fa640 1 -- 172.21.15.119:0/2357378842 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd5dc009880 con 0x7fd5e80fb490 2024-09-13T21:56:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.936+0000 7fd5e57fa640 1 -- 172.21.15.119:0/2357378842 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5dc0338f0 con 0x7fd5e80fb490 2024-09-13T21:56:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.936+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2357378842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e810c800 con 0x7fd5e80fb490 2024-09-13T21:56:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.937+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2357378842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e80fcbd0 con 0x7fd5e80fb490 2024-09-13T21:56:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.938+0000 7fd5e57fa640 1 -- 172.21.15.119:0/2357378842 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd5dc030020 con 0x7fd5e80fb490 2024-09-13T21:56:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.938+0000 7fd5e57fa640 1 --2- 172.21.15.119:0/2357378842 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5d806e530 0x7fd5d80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.938+0000 7fd5e57fa640 1 -- 172.21.15.119:0/2357378842 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd5dc0b0a80 con 0x7fd5e80fb490 2024-09-13T21:56:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.938+0000 7fd5e7fff640 1 --2- 172.21.15.119:0/2357378842 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5d806e530 0x7fd5d80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.939+0000 7fd5e7fff640 1 --2- 172.21.15.119:0/2357378842 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5d806e530 0x7fd5d80709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4006fd0 tx=0x7fd5d4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:18.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:18.942+0000 7fd5e57fa640 1 -- 172.21.15.119:0/2357378842 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd5dc079b10 con 0x7fd5e80fb490 2024-09-13T21:56:19.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.149+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2357378842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fd5e804b720 con 0x7fd5e80fb490 2024-09-13T21:56:19.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.150+0000 7fd5e57fa640 1 -- 172.21.15.119:0/2357378842 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v46) v1 ==== 107+0+5127 (secure 0 0 0) 0x7fd5dc07d1d0 con 0x7fd5e80fb490 2024-09-13T21:56:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:19.151 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":37,"btime":"2024-09-13T21:52:27:291555+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44327,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/2986837064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2986837064},{"type":"v1","addr":"172.21.15.155:6825","nonce":2986837064}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:11.251193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi155.afmavb","rank":0,"incarnation":31,"state":"up:active","state_seq":150,"addr":"172.21.15.155:6827/2908862913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2908862913},{"type":"v1","addr":"172.21.15.155:6827","nonce":2908862913}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24277,"qdb_cluster":[24277]},"id":1}]} 2024-09-13T21:56:19.151 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 37 2024-09-13T21:56:19.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.152+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2357378842 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5d806e530 msgr2=0x7fd5d80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:19.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.152+0000 7fd5ef01f640 1 --2- 172.21.15.119:0/2357378842 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5d806e530 0x7fd5d80709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4006fd0 tx=0x7fd5d4008040 comp rx=0 tx=0).stop 2024-09-13T21:56:19.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.152+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2357378842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5e80fb490 msgr2=0x7fd5e8112140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:19.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.152+0000 7fd5ef01f640 1 --2- 172.21.15.119:0/2357378842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5e80fb490 0x7fd5e8112140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc000c00 tx=0x7fd5dc009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:19.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.152+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2357378842 shutdown_connections 2024-09-13T21:56:19.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.152+0000 7fd5ef01f640 1 --2- 172.21.15.119:0/2357378842 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fd5d806e530 0x7fd5d80709e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:19.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.152+0000 7fd5ef01f640 1 --2- 172.21.15.119:0/2357378842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5e81014d0 0x7fd5e8112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:19.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.152+0000 7fd5ef01f640 1 --2- 172.21.15.119:0/2357378842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5e80fb490 0x7fd5e8112140 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:19.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.152+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2357378842 >> 172.21.15.119:0/2357378842 conn(0x7fd5e80f7010 msgr2=0x7fd5e80f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:19.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.152+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2357378842 shutdown_connections 2024-09-13T21:56:19.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:19.152+0000 7fd5ef01f640 1 -- 172.21.15.119:0/2357378842 wait complete. 2024-09-13T21:56:19.514 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:19 smithi119 ceph-mon[90896]: pgmap v320: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:19.514 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:19 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2357378842' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T21:56:19.827 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-09-13T21:56:19.827 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 38 2024-09-13T21:56:19.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:19 smithi155 ceph-mon[79928]: pgmap v320: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:19 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2357378842' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T21:56:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:21.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:21 smithi119 ceph-mon[90896]: pgmap v321: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.632+0000 7f31e5886640 1 -- 172.21.15.119:0/3342190692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31e0064fc0 msgr2=0x7f31e0065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.632+0000 7f31e5886640 1 --2- 172.21.15.119:0/3342190692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31e0064fc0 0x7f31e0065430 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f31d40048d0 tx=0x7f31d4009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.632+0000 7f31e5886640 1 -- 172.21.15.119:0/3342190692 shutdown_connections 2024-09-13T21:56:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.632+0000 7f31e5886640 1 --2- 172.21.15.119:0/3342190692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31e0064fc0 0x7f31e0065430 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.632+0000 7f31e5886640 1 --2- 172.21.15.119:0/3342190692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e00fe460 0x7f31e00fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.632+0000 7f31e5886640 1 -- 172.21.15.119:0/3342190692 >> 172.21.15.119:0/3342190692 conn(0x7f31e00723b0 msgr2=0x7f31e00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.632+0000 7f31e5886640 1 -- 172.21.15.119:0/3342190692 shutdown_connections 2024-09-13T21:56:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.632+0000 7f31e5886640 1 -- 172.21.15.119:0/3342190692 wait complete. 2024-09-13T21:56:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.632+0000 7f31e5886640 1 Processor -- start 2024-09-13T21:56:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.632+0000 7f31e5886640 1 -- start start 2024-09-13T21:56:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31e5886640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e0064fc0 0x7f31e0113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31e5886640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31e00fe460 0x7f31e0113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31e5886640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0113e00 con 0x7f31e00fe460 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31e5886640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e010d1b0 con 0x7f31e0064fc0 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31de7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31e00fe460 0x7f31e0113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31de7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31e00fe460 0x7f31e0113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:46726/0 (socket says 172.21.15.119:46726) 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31de7fc640 1 -- 172.21.15.119:0/3477566816 learned_addr learned my addr 172.21.15.119:0/3477566816 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31deffd640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e0064fc0 0x7f31e0113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31de7fc640 1 -- 172.21.15.119:0/3477566816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e0064fc0 msgr2=0x7f31e0113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31de7fc640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e0064fc0 0x7f31e0113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31de7fc640 1 -- 172.21.15.119:0/3477566816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d4005040 con 0x7f31e00fe460 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31deffd640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e0064fc0 0x7f31e0113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31de7fc640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31e00fe460 0x7f31e0113770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f31d4003080 tx=0x7f31d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31c77fe640 1 -- 172.21.15.119:0/3477566816 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31d4038070 con 0x7f31e00fe460 2024-09-13T21:56:21.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31c77fe640 1 -- 172.21.15.119:0/3477566816 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f31d40097e0 con 0x7f31e00fe460 2024-09-13T21:56:21.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31e5886640 1 -- 172.21.15.119:0/3477566816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e010d430 con 0x7f31e00fe460 2024-09-13T21:56:21.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.633+0000 7f31c77fe640 1 -- 172.21.15.119:0/3477566816 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31d403d420 con 0x7f31e00fe460 2024-09-13T21:56:21.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.634+0000 7f31e5886640 1 -- 172.21.15.119:0/3477566816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e010d8f0 con 0x7f31e00fe460 2024-09-13T21:56:21.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.635+0000 7f31e5886640 1 -- 172.21.15.119:0/3477566816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e00fdcf0 con 0x7f31e00fe460 2024-09-13T21:56:21.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.635+0000 7f31c77fe640 1 -- 172.21.15.119:0/3477566816 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f31d4030020 con 0x7f31e00fe460 2024-09-13T21:56:21.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.635+0000 7f31c77fe640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f31c806e530 0x7f31c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:21.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.636+0000 7f31c77fe640 1 -- 172.21.15.119:0/3477566816 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f31d40ae780 con 0x7f31e00fe460 2024-09-13T21:56:21.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.636+0000 7f31deffd640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f31c806e530 0x7f31c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:21.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.636+0000 7f31deffd640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f31c806e530 0x7f31c80709e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f31d0007fd0 tx=0x7f31d00074f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:21.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.640+0000 7f31c77fe640 1 -- 172.21.15.119:0/3477566816 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f31d4077810 con 0x7f31e00fe460 2024-09-13T21:56:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:21 smithi155 ceph-mon[79928]: pgmap v321: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:21.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.839+0000 7f31e5886640 1 -- 172.21.15.119:0/3477566816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f31e010e8a0 con 0x7f31e00fe460 2024-09-13T21:56:21.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.840+0000 7f31c77fe640 1 -- 172.21.15.119:0/3477566816 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v46) v1 ==== 107+0+4323 (secure 0 0 0) 0x7f31d407aed0 con 0x7f31e00fe460 2024-09-13T21:56:21.841 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:21.842 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":38,"btime":"2024-09-13T21:52:37:413951+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44327,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/2986837064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2986837064},{"type":"v1","addr":"172.21.15.155:6825","nonce":2986837064}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:37.413949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:56:21.842 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 38 2024-09-13T21:56:21.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.842+0000 7f31e5886640 1 -- 172.21.15.119:0/3477566816 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f31c806e530 msgr2=0x7f31c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.842+0000 7f31e5886640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f31c806e530 0x7f31c80709e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f31d0007fd0 tx=0x7f31d00074f0 comp rx=0 tx=0).stop 2024-09-13T21:56:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.842+0000 7f31e5886640 1 -- 172.21.15.119:0/3477566816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31e00fe460 msgr2=0x7f31e0113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.842+0000 7f31e5886640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31e00fe460 0x7f31e0113770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f31d4003080 tx=0x7f31d4009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.842+0000 7f31e5886640 1 -- 172.21.15.119:0/3477566816 shutdown_connections 2024-09-13T21:56:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.842+0000 7f31e5886640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f31c806e530 0x7f31c80709e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.842+0000 7f31e5886640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31e00fe460 0x7f31e0113770 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.842+0000 7f31e5886640 1 --2- 172.21.15.119:0/3477566816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31e0064fc0 0x7f31e0113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.842+0000 7f31e5886640 1 -- 172.21.15.119:0/3477566816 >> 172.21.15.119:0/3477566816 conn(0x7f31e00723b0 msgr2=0x7f31e0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.842+0000 7f31e5886640 1 -- 172.21.15.119:0/3477566816 shutdown_connections 2024-09-13T21:56:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:21.842+0000 7f31e5886640 1 -- 172.21.15.119:0/3477566816 wait complete. 2024-09-13T21:56:22.475 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:22 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3477566816' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T21:56:22.475 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:56:22.477 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-09-13T21:56:22.477 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 39 2024-09-13T21:56:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:22.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:22 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3477566816' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T21:56:22.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:56:23.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:23 smithi119 ceph-mon[90896]: pgmap v322: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:23.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:23 smithi155 ceph-mon[79928]: pgmap v322: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.297+0000 7f2775321640 1 -- 172.21.15.119:0/718343714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27700fd5a0 msgr2=0x7f27700fd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.297+0000 7f2775321640 1 --2- 172.21.15.119:0/718343714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27700fd5a0 0x7f27700fd970 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f27600048d0 tx=0x7f2760009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.297+0000 7f2775321640 1 -- 172.21.15.119:0/718343714 shutdown_connections 2024-09-13T21:56:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.297+0000 7f2775321640 1 --2- 172.21.15.119:0/718343714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27700fdf40 0x7f2770106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.297+0000 7f2775321640 1 --2- 172.21.15.119:0/718343714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27700fd5a0 0x7f27700fd970 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.297+0000 7f2775321640 1 -- 172.21.15.119:0/718343714 >> 172.21.15.119:0/718343714 conn(0x7f27700f7000 msgr2=0x7f27700f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:24.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.297+0000 7f2775321640 1 -- 172.21.15.119:0/718343714 shutdown_connections 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.297+0000 7f2775321640 1 -- 172.21.15.119:0/718343714 wait complete. 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2775321640 1 Processor -- start 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2775321640 1 -- start start 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2775321640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27700fd5a0 0x7f27700fb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2775321640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27700fdf40 0x7f27700fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2775321640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27700fbee0 con 0x7f27700fdf40 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2775321640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27700fc050 con 0x7f27700fd5a0 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27700fdf40 0x7f27700fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2767fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27700fdf40 0x7f27700fb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33136/0 (socket says 172.21.15.119:33136) 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2767fff640 1 -- 172.21.15.119:0/3571907206 learned_addr learned my addr 172.21.15.119:0/3571907206 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f276effd640 1 --2- 172.21.15.119:0/3571907206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27700fd5a0 0x7f27700fb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2767fff640 1 -- 172.21.15.119:0/3571907206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27700fd5a0 msgr2=0x7f27700fb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:24.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2767fff640 1 --2- 172.21.15.119:0/3571907206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27700fd5a0 0x7f27700fb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2767fff640 1 -- 172.21.15.119:0/3571907206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2760005040 con 0x7f27700fdf40 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.298+0000 7f2767fff640 1 --2- 172.21.15.119:0/3571907206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27700fdf40 0x7f27700fb9a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f275800c830 tx=0x7f2758004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.299+0000 7f27677fe640 1 -- 172.21.15.119:0/3571907206 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f275800a7d0 con 0x7f27700fdf40 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.299+0000 7f27677fe640 1 -- 172.21.15.119:0/3571907206 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f275800add0 con 0x7f27700fdf40 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.299+0000 7f27677fe640 1 -- 172.21.15.119:0/3571907206 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27580113a0 con 0x7f27700fdf40 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.299+0000 7f2775321640 1 -- 172.21.15.119:0/3571907206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27700fc2e0 con 0x7f27700fdf40 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.299+0000 7f2775321640 1 -- 172.21.15.119:0/3571907206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27701198d0 con 0x7f27700fdf40 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.300+0000 7f2775321640 1 -- 172.21.15.119:0/3571907206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2770066270 con 0x7f27700fdf40 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.300+0000 7f27677fe640 1 -- 172.21.15.119:0/3571907206 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2758012400 con 0x7f27700fdf40 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.301+0000 7f27677fe640 1 --2- 172.21.15.119:0/3571907206 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f275c06e530 0x7f275c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.301+0000 7f276effd640 1 --2- 172.21.15.119:0/3571907206 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f275c06e530 0x7f275c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.301+0000 7f27677fe640 1 -- 172.21.15.119:0/3571907206 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f275808e1f0 con 0x7f27700fdf40 2024-09-13T21:56:24.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.301+0000 7f276effd640 1 --2- 172.21.15.119:0/3571907206 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f275c06e530 0x7f275c0709e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2760004540 tx=0x7f2760035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:24.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.305+0000 7f27677fe640 1 -- 172.21.15.119:0/3571907206 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f27580573a0 con 0x7f27700fdf40 2024-09-13T21:56:24.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.513+0000 7f2775321640 1 -- 172.21.15.119:0/3571907206 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f27700fac40 con 0x7f27700fdf40 2024-09-13T21:56:24.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.513+0000 7f27677fe640 1 -- 172.21.15.119:0/3571907206 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v46) v1 ==== 107+0+4402 (secure 0 0 0) 0x7f275805aa60 con 0x7f27700fdf40 2024-09-13T21:56:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:24.515 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":39,"btime":"2024-09-13T21:52:37:418686+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44327,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/2986837064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2986837064},{"type":"v1","addr":"172.21.15.155:6825","nonce":2986837064}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:37.418669+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":0,"incarnation":39,"state":"up:replay","state_seq":1,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:56:24.515 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 39 2024-09-13T21:56:24.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.516+0000 7f2775321640 1 -- 172.21.15.119:0/3571907206 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f275c06e530 msgr2=0x7f275c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:24.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.516+0000 7f2775321640 1 --2- 172.21.15.119:0/3571907206 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f275c06e530 0x7f275c0709e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2760004540 tx=0x7f2760035040 comp rx=0 tx=0).stop 2024-09-13T21:56:24.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.516+0000 7f2775321640 1 -- 172.21.15.119:0/3571907206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27700fdf40 msgr2=0x7f27700fb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:24.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.516+0000 7f2775321640 1 --2- 172.21.15.119:0/3571907206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27700fdf40 0x7f27700fb9a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f275800c830 tx=0x7f2758004430 comp rx=0 tx=0).stop 2024-09-13T21:56:24.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.516+0000 7f2775321640 1 -- 172.21.15.119:0/3571907206 shutdown_connections 2024-09-13T21:56:24.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.516+0000 7f2775321640 1 --2- 172.21.15.119:0/3571907206 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f275c06e530 0x7f275c0709e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:24.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.516+0000 7f2775321640 1 --2- 172.21.15.119:0/3571907206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27700fdf40 0x7f27700fb9a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:24.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.516+0000 7f2775321640 1 --2- 172.21.15.119:0/3571907206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27700fd5a0 0x7f27700fb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:24.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.516+0000 7f2775321640 1 -- 172.21.15.119:0/3571907206 >> 172.21.15.119:0/3571907206 conn(0x7f27700f7000 msgr2=0x7f27700f8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:24.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.516+0000 7f2775321640 1 -- 172.21.15.119:0/3571907206 shutdown_connections 2024-09-13T21:56:24.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:24.516+0000 7f2775321640 1 -- 172.21.15.119:0/3571907206 wait complete. 2024-09-13T21:56:24.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:56:24.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:56:24.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:56:24.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:56:24.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:56:24.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:56:24.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:56:24.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:56:25.148 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-09-13T21:56:25.148 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 40 2024-09-13T21:56:25.392 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:25.512 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:25 smithi119 ceph-mon[90896]: pgmap v323: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:25.512 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:25 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3571907206' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-13T21:56:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:25 smithi155 ceph-mon[79928]: pgmap v323: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:25 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3571907206' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-13T21:56:26.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.977+0000 7f7bce00c640 1 -- 172.21.15.119:0/4239278692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc80fb810 msgr2=0x7f7bc80fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:26.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.977+0000 7f7bce00c640 1 --2- 172.21.15.119:0/4239278692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc80fb810 0x7f7bc80fbbe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009c50 tx=0x7f7bb8004d10 comp rx=0 tx=0).stop 2024-09-13T21:56:26.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.977+0000 7f7bce00c640 1 -- 172.21.15.119:0/4239278692 shutdown_connections 2024-09-13T21:56:26.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.977+0000 7f7bce00c640 1 --2- 172.21.15.119:0/4239278692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bc80fcf80 0x7f7bc80fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:26.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.977+0000 7f7bce00c640 1 --2- 172.21.15.119:0/4239278692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc80fb810 0x7f7bc80fbbe0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:26.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.977+0000 7f7bce00c640 1 -- 172.21.15.119:0/4239278692 >> 172.21.15.119:0/4239278692 conn(0x7f7bc80723b0 msgr2=0x7f7bc80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:26.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.977+0000 7f7bce00c640 1 -- 172.21.15.119:0/4239278692 shutdown_connections 2024-09-13T21:56:26.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.977+0000 7f7bce00c640 1 -- 172.21.15.119:0/4239278692 wait complete. 2024-09-13T21:56:26.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.978+0000 7f7bce00c640 1 Processor -- start 2024-09-13T21:56:26.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.978+0000 7f7bce00c640 1 -- start start 2024-09-13T21:56:26.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.978+0000 7f7bce00c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bc80fb810 0x7f7bc8113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:26.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.978+0000 7f7bce00c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc80fcf80 0x7f7bc8113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:26.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.978+0000 7f7bce00c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8113de0 con 0x7f7bc80fcf80 2024-09-13T21:56:26.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.978+0000 7f7bce00c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc810d190 con 0x7f7bc80fb810 2024-09-13T21:56:26.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bc6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc80fcf80 0x7f7bc8113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:26.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bc6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc80fcf80 0x7f7bc8113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33142/0 (socket says 172.21.15.119:33142) 2024-09-13T21:56:26.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bc6ffd640 1 -- 172.21.15.119:0/4124838800 learned_addr learned my addr 172.21.15.119:0/4124838800 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:26.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bc77fe640 1 --2- 172.21.15.119:0/4124838800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bc80fb810 0x7f7bc8113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:26.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bc6ffd640 1 -- 172.21.15.119:0/4124838800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bc80fb810 msgr2=0x7f7bc8113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:26.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bc6ffd640 1 --2- 172.21.15.119:0/4124838800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bc80fb810 0x7f7bc8113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:26.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bc6ffd640 1 -- 172.21.15.119:0/4124838800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb80098b0 con 0x7f7bc80fcf80 2024-09-13T21:56:26.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bc6ffd640 1 --2- 172.21.15.119:0/4124838800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc80fcf80 0x7f7bc8113750 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000b790 tx=0x7f7bb00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:26.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bbffff640 1 -- 172.21.15.119:0/4124838800 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb000c700 con 0x7f7bc80fcf80 2024-09-13T21:56:26.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bbffff640 1 -- 172.21.15.119:0/4124838800 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7bb000cd00 con 0x7f7bc80fcf80 2024-09-13T21:56:26.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bce00c640 1 -- 172.21.15.119:0/4124838800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc810d470 con 0x7f7bc80fcf80 2024-09-13T21:56:26.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bbffff640 1 -- 172.21.15.119:0/4124838800 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb0015e70 con 0x7f7bc80fcf80 2024-09-13T21:56:26.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.979+0000 7f7bce00c640 1 -- 172.21.15.119:0/4124838800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc810d990 con 0x7f7bc80fcf80 2024-09-13T21:56:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.981+0000 7f7bce00c640 1 -- 172.21.15.119:0/4124838800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc80fcbc0 con 0x7f7bc80fcf80 2024-09-13T21:56:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.981+0000 7f7bbffff640 1 -- 172.21.15.119:0/4124838800 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7bb0012070 con 0x7f7bc80fcf80 2024-09-13T21:56:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.981+0000 7f7bbffff640 1 --2- 172.21.15.119:0/4124838800 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7bb406e530 0x7f7bb40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.981+0000 7f7bbffff640 1 -- 172.21.15.119:0/4124838800 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7bb008daa0 con 0x7f7bc80fcf80 2024-09-13T21:56:26.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.981+0000 7f7bc77fe640 1 --2- 172.21.15.119:0/4124838800 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7bb406e530 0x7f7bb40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:26.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.982+0000 7f7bc77fe640 1 --2- 172.21.15.119:0/4124838800 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7bb406e530 0x7f7bb40709e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009c20 tx=0x7f7bb8004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:26.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:26.986+0000 7f7bbffff640 1 -- 172.21.15.119:0/4124838800 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7bb0056bb0 con 0x7f7bc80fcf80 2024-09-13T21:56:27.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.186+0000 7f7bce00c640 1 -- 172.21.15.119:0/4124838800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f7bc804b720 con 0x7f7bc80fcf80 2024-09-13T21:56:27.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.187+0000 7f7bbffff640 1 -- 172.21.15.119:0/4124838800 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v46) v1 ==== 107+0+4406 (secure 0 0 0) 0x7f7bb005a270 con 0x7f7bc80fcf80 2024-09-13T21:56:27.188 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:27.188 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":40,"btime":"2024-09-13T21:52:43:248346+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44327,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/2986837064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2986837064},{"type":"v1","addr":"172.21.15.155:6825","nonce":2986837064}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:42.367784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:56:27.189 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 40 2024-09-13T21:56:27.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.189+0000 7f7bce00c640 1 -- 172.21.15.119:0/4124838800 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7bb406e530 msgr2=0x7f7bb40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:27.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.189+0000 7f7bce00c640 1 --2- 172.21.15.119:0/4124838800 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7bb406e530 0x7f7bb40709e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009c20 tx=0x7f7bb8004d10 comp rx=0 tx=0).stop 2024-09-13T21:56:27.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.189+0000 7f7bce00c640 1 -- 172.21.15.119:0/4124838800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc80fcf80 msgr2=0x7f7bc8113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:27.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.189+0000 7f7bce00c640 1 --2- 172.21.15.119:0/4124838800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc80fcf80 0x7f7bc8113750 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000b790 tx=0x7f7bb00091d0 comp rx=0 tx=0).stop 2024-09-13T21:56:27.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.189+0000 7f7bce00c640 1 -- 172.21.15.119:0/4124838800 shutdown_connections 2024-09-13T21:56:27.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.189+0000 7f7bce00c640 1 --2- 172.21.15.119:0/4124838800 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7bb406e530 0x7f7bb40709e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:27.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.189+0000 7f7bce00c640 1 --2- 172.21.15.119:0/4124838800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bc80fcf80 0x7f7bc8113750 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:27.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.189+0000 7f7bce00c640 1 --2- 172.21.15.119:0/4124838800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bc80fb810 0x7f7bc8113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:27.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.189+0000 7f7bce00c640 1 -- 172.21.15.119:0/4124838800 >> 172.21.15.119:0/4124838800 conn(0x7f7bc80723b0 msgr2=0x7f7bc80fa880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:27.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.189+0000 7f7bce00c640 1 -- 172.21.15.119:0/4124838800 shutdown_connections 2024-09-13T21:56:27.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:27.189+0000 7f7bce00c640 1 -- 172.21.15.119:0/4124838800 wait complete. 2024-09-13T21:56:27.536 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:27 smithi119 ceph-mon[90896]: pgmap v324: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:27.536 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:27 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/4124838800' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-13T21:56:27.762 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-09-13T21:56:27.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 41 2024-09-13T21:56:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:27 smithi155 ceph-mon[79928]: pgmap v324: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:27 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/4124838800' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-13T21:56:28.007 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:29.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:29 smithi119 ceph-mon[90896]: pgmap v325: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:29.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.632+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/3180271011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f08102680 msgr2=0x7f4f08102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:29.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.632+0000 7f4f0e9ec640 1 --2- 172.21.15.119:0/3180271011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f08102680 0x7f4f08102a50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80048d0 tx=0x7f4ef8009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:29.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.632+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/3180271011 shutdown_connections 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.632+0000 7f4f0e9ec640 1 --2- 172.21.15.119:0/3180271011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f080fabd0 0x7f4f080fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.632+0000 7f4f0e9ec640 1 --2- 172.21.15.119:0/3180271011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f08102680 0x7f4f08102a50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.632+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/3180271011 >> 172.21.15.119:0/3180271011 conn(0x7f4f08071ac0 msgr2=0x7f4f08071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.632+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/3180271011 shutdown_connections 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.632+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/3180271011 wait complete. 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.633+0000 7f4f0e9ec640 1 Processor -- start 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.633+0000 7f4f0e9ec640 1 -- start start 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.633+0000 7f4f0e9ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f080fabd0 0x7f4f080fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.633+0000 7f4f0e9ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f08102680 0x7f4f080fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.633+0000 7f4f0e9ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f080fc830 con 0x7f4f08102680 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.633+0000 7f4f0e9ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f080fc9a0 con 0x7f4f080fabd0 2024-09-13T21:56:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.633+0000 7f4f077fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f08102680 0x7f4f080fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.633+0000 7f4f077fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f08102680 0x7f4f080fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33154/0 (socket says 172.21.15.119:33154) 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.633+0000 7f4f077fe640 1 -- 172.21.15.119:0/2959502704 learned_addr learned my addr 172.21.15.119:0/2959502704 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.634+0000 7f4f07fff640 1 --2- 172.21.15.119:0/2959502704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f080fabd0 0x7f4f080fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.634+0000 7f4f077fe640 1 -- 172.21.15.119:0/2959502704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f080fabd0 msgr2=0x7f4f080fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.634+0000 7f4f077fe640 1 --2- 172.21.15.119:0/2959502704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f080fabd0 0x7f4f080fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.634+0000 7f4f077fe640 1 -- 172.21.15.119:0/2959502704 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8005040 con 0x7f4f08102680 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.634+0000 7f4f077fe640 1 --2- 172.21.15.119:0/2959502704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f08102680 0x7f4f080fc2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c790 tx=0x7f4efc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.634+0000 7f4f04ff9640 1 -- 172.21.15.119:0/2959502704 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4efc00a7a0 con 0x7f4f08102680 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.634+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/2959502704 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f080fcc30 con 0x7f4f08102680 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.634+0000 7f4f04ff9640 1 -- 172.21.15.119:0/2959502704 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4efc00ada0 con 0x7f4f08102680 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.634+0000 7f4f04ff9640 1 -- 172.21.15.119:0/2959502704 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4efc0113a0 con 0x7f4f08102680 2024-09-13T21:56:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.634+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/2959502704 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f081199e0 con 0x7f4f08102680 2024-09-13T21:56:29.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.635+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/2959502704 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f080725d0 con 0x7f4f08102680 2024-09-13T21:56:29.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.636+0000 7f4f04ff9640 1 -- 172.21.15.119:0/2959502704 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4efc00a900 con 0x7f4f08102680 2024-09-13T21:56:29.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.636+0000 7f4f04ff9640 1 --2- 172.21.15.119:0/2959502704 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4ef006e530 0x7f4ef00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:29.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.636+0000 7f4f04ff9640 1 -- 172.21.15.119:0/2959502704 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4efc08e2e0 con 0x7f4f08102680 2024-09-13T21:56:29.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.636+0000 7f4f07fff640 1 --2- 172.21.15.119:0/2959502704 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4ef006e530 0x7f4ef00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:29.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.637+0000 7f4f07fff640 1 --2- 172.21.15.119:0/2959502704 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4ef006e530 0x7f4ef00709e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009ac0 tx=0x7f4ef8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:29.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.640+0000 7f4f04ff9640 1 -- 172.21.15.119:0/2959502704 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4efc0573f0 con 0x7f4f08102680 2024-09-13T21:56:29.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:29 smithi155 ceph-mon[79928]: pgmap v325: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:29.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.840+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/2959502704 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f4f080fd4a0 con 0x7f4f08102680 2024-09-13T21:56:29.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.840+0000 7f4f04ff9640 1 -- 172.21.15.119:0/2959502704 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v46) v1 ==== 107+0+4403 (secure 0 0 0) 0x7f4efc05aab0 con 0x7f4f08102680 2024-09-13T21:56:29.842 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:29.842 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":41,"btime":"2024-09-13T21:52:44:253780+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44327,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/2986837064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2986837064},{"type":"v1","addr":"172.21.15.155:6825","nonce":2986837064}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:43.256169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":0,"incarnation":39,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T21:56:29.842 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 41 2024-09-13T21:56:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.842+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/2959502704 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4ef006e530 msgr2=0x7f4ef00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.842+0000 7f4f0e9ec640 1 --2- 172.21.15.119:0/2959502704 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4ef006e530 0x7f4ef00709e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009ac0 tx=0x7f4ef8035040 comp rx=0 tx=0).stop 2024-09-13T21:56:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.842+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/2959502704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f08102680 msgr2=0x7f4f080fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.842+0000 7f4f0e9ec640 1 --2- 172.21.15.119:0/2959502704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f08102680 0x7f4f080fc2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c790 tx=0x7f4efc0043c0 comp rx=0 tx=0).stop 2024-09-13T21:56:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.842+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/2959502704 shutdown_connections 2024-09-13T21:56:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.842+0000 7f4f0e9ec640 1 --2- 172.21.15.119:0/2959502704 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f4ef006e530 0x7f4ef00709e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.842+0000 7f4f0e9ec640 1 --2- 172.21.15.119:0/2959502704 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f08102680 0x7f4f080fc2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.842+0000 7f4f0e9ec640 1 --2- 172.21.15.119:0/2959502704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f080fabd0 0x7f4f080fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.842+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/2959502704 >> 172.21.15.119:0/2959502704 conn(0x7f4f08071ac0 msgr2=0x7f4f08105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:29.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.843+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/2959502704 shutdown_connections 2024-09-13T21:56:29.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:29.843+0000 7f4f0e9ec640 1 -- 172.21.15.119:0/2959502704 wait complete. 2024-09-13T21:56:30.424 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:30 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/2959502704' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-13T21:56:30.426 DEBUG:tasks.fs:max_mds reduced in epoch 41 2024-09-13T21:56:30.426 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 42 2024-09-13T21:56:30.670 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:30.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:30 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/2959502704' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-13T21:56:31.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:31 smithi119 ceph-mon[90896]: pgmap v326: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:31.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:31 smithi155 ceph-mon[79928]: pgmap v326: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:32.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.257+0000 7f7232222640 1 -- 172.21.15.119:0/1576569048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1014b0 msgr2=0x7f722c101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:32.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.257+0000 7f7232222640 1 --2- 172.21.15.119:0/1576569048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1014b0 0x7f722c101880 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f721c0048d0 tx=0x7f721c009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:32.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.257+0000 7f7232222640 1 -- 172.21.15.119:0/1576569048 shutdown_connections 2024-09-13T21:56:32.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.257+0000 7f7232222640 1 --2- 172.21.15.119:0/1576569048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c0fb470 0x7f722c0fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:32.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.257+0000 7f7232222640 1 --2- 172.21.15.119:0/1576569048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1014b0 0x7f722c101880 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:32.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.257+0000 7f7232222640 1 -- 172.21.15.119:0/1576569048 >> 172.21.15.119:0/1576569048 conn(0x7f722c0f7030 msgr2=0x7f722c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:32.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.257+0000 7f7232222640 1 -- 172.21.15.119:0/1576569048 shutdown_connections 2024-09-13T21:56:32.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.257+0000 7f7232222640 1 -- 172.21.15.119:0/1576569048 wait complete. 2024-09-13T21:56:32.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7232222640 1 Processor -- start 2024-09-13T21:56:32.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7232222640 1 -- start start 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7232222640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c0fb470 0x7f722c10e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7232222640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1014b0 0x7f722c10e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7232222640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722c10ed10 con 0x7f722c1014b0 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7232222640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722c10ee80 con 0x7f722c0fb470 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7223fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1014b0 0x7f722c10e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7223fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1014b0 0x7f722c10e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:33160/0 (socket says 172.21.15.119:33160) 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7223fff640 1 -- 172.21.15.119:0/3638249410 learned_addr learned my addr 172.21.15.119:0/3638249410 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f722b7fe640 1 --2- 172.21.15.119:0/3638249410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c0fb470 0x7f722c10e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7223fff640 1 -- 172.21.15.119:0/3638249410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c0fb470 msgr2=0x7f722c10e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7223fff640 1 --2- 172.21.15.119:0/3638249410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c0fb470 0x7f722c10e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7223fff640 1 -- 172.21.15.119:0/3638249410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c005040 con 0x7f722c1014b0 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7223fff640 1 --2- 172.21.15.119:0/3638249410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1014b0 0x7f722c10e6c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7214002a50 tx=0x7f7214004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:32.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7228ff9640 1 -- 172.21.15.119:0/3638249410 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7214007c30 con 0x7f722c1014b0 2024-09-13T21:56:32.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.258+0000 7f7232222640 1 -- 172.21.15.119:0/3638249410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f722c1171f0 con 0x7f722c1014b0 2024-09-13T21:56:32.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.259+0000 7f7228ff9640 1 -- 172.21.15.119:0/3638249410 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f721400f040 con 0x7f722c1014b0 2024-09-13T21:56:32.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.259+0000 7f7228ff9640 1 -- 172.21.15.119:0/3638249410 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f721400da90 con 0x7f722c1014b0 2024-09-13T21:56:32.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.259+0000 7f7232222640 1 -- 172.21.15.119:0/3638249410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722c10c190 con 0x7f722c1014b0 2024-09-13T21:56:32.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.260+0000 7f7232222640 1 -- 172.21.15.119:0/3638249410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722c0fcbb0 con 0x7f722c1014b0 2024-09-13T21:56:32.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.260+0000 7f7228ff9640 1 -- 172.21.15.119:0/3638249410 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f721400dd00 con 0x7f722c1014b0 2024-09-13T21:56:32.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.261+0000 7f7228ff9640 1 --2- 172.21.15.119:0/3638249410 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7218072940 0x7f7218074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:32.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.261+0000 7f7228ff9640 1 -- 172.21.15.119:0/3638249410 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f721408da70 con 0x7f722c1014b0 2024-09-13T21:56:32.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.261+0000 7f722b7fe640 1 --2- 172.21.15.119:0/3638249410 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7218072940 0x7f7218074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:32.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.261+0000 7f722b7fe640 1 --2- 172.21.15.119:0/3638249410 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7218072940 0x7f7218074df0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f721c009ac0 tx=0x7f721c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:32.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.265+0000 7f7228ff9640 1 -- 172.21.15.119:0/3638249410 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7214056b00 con 0x7f722c1014b0 2024-09-13T21:56:32.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.471+0000 7f7232222640 1 -- 172.21.15.119:0/3638249410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7f722c0fac30 con 0x7f722c1014b0 2024-09-13T21:56:32.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.471+0000 7f7228ff9640 1 -- 172.21.15.119:0/3638249410 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v46) v1 ==== 107+0+4412 (secure 0 0 0) 0x7f721405a1c0 con 0x7f722c1014b0 2024-09-13T21:56:32.473 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:32.473 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":42,"btime":"2024-09-13T21:52:45:259355+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44327,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/2986837064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2986837064},{"type":"v1","addr":"172.21.15.155:6825","nonce":2986837064}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:45.259352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434]},"id":1}]} 2024-09-13T21:56:32.473 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 42 2024-09-13T21:56:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.473+0000 7f7232222640 1 -- 172.21.15.119:0/3638249410 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7218072940 msgr2=0x7f7218074df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.473+0000 7f7232222640 1 --2- 172.21.15.119:0/3638249410 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7218072940 0x7f7218074df0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f721c009ac0 tx=0x7f721c035040 comp rx=0 tx=0).stop 2024-09-13T21:56:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.473+0000 7f7232222640 1 -- 172.21.15.119:0/3638249410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1014b0 msgr2=0x7f722c10e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.473+0000 7f7232222640 1 --2- 172.21.15.119:0/3638249410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1014b0 0x7f722c10e6c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7214002a50 tx=0x7f7214004600 comp rx=0 tx=0).stop 2024-09-13T21:56:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.474+0000 7f7232222640 1 -- 172.21.15.119:0/3638249410 shutdown_connections 2024-09-13T21:56:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.474+0000 7f7232222640 1 --2- 172.21.15.119:0/3638249410 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f7218072940 0x7f7218074df0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.474+0000 7f7232222640 1 --2- 172.21.15.119:0/3638249410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f722c1014b0 0x7f722c10e6c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.474+0000 7f7232222640 1 --2- 172.21.15.119:0/3638249410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c0fb470 0x7f722c10e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.474+0000 7f7232222640 1 -- 172.21.15.119:0/3638249410 >> 172.21.15.119:0/3638249410 conn(0x7f722c0f7030 msgr2=0x7f722c0f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.474+0000 7f7232222640 1 -- 172.21.15.119:0/3638249410 shutdown_connections 2024-09-13T21:56:32.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:32.474+0000 7f7232222640 1 -- 172.21.15.119:0/3638249410 wait complete. 2024-09-13T21:56:33.083 DEBUG:tasks.fs:max_mds reduced in epoch 42 2024-09-13T21:56:33.084 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 43 2024-09-13T21:56:33.328 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:33.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:33 smithi119 ceph-mon[90896]: pgmap v327: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:33.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:33 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3638249410' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-13T21:56:33.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:33 smithi155 ceph-mon[79928]: pgmap v327: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:33.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:33 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3638249410' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-13T21:56:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.919+0000 7f6134bb8640 1 -- 172.21.15.119:0/3523853059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6130102550 msgr2=0x7f6130102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.919+0000 7f6134bb8640 1 --2- 172.21.15.119:0/3523853059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6130102550 0x7f6130102920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f61180048d0 tx=0x7f6118009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.919+0000 7f6134bb8640 1 -- 172.21.15.119:0/3523853059 shutdown_connections 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.919+0000 7f6134bb8640 1 --2- 172.21.15.119:0/3523853059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6130102ef0 0x7f61300fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.919+0000 7f6134bb8640 1 --2- 172.21.15.119:0/3523853059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6130102550 0x7f6130102920 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.919+0000 7f6134bb8640 1 -- 172.21.15.119:0/3523853059 >> 172.21.15.119:0/3523853059 conn(0x7f61300f80f0 msgr2=0x7f61300fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.919+0000 7f6134bb8640 1 -- 172.21.15.119:0/3523853059 shutdown_connections 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.919+0000 7f6134bb8640 1 -- 172.21.15.119:0/3523853059 wait complete. 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f6134bb8640 1 Processor -- start 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f6134bb8640 1 -- start start 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f6134bb8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6130102550 0x7f613006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f6134bb8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6130102ef0 0x7f613006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f6134bb8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6130070520 con 0x7f6130102ef0 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f6134bb8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6130070690 con 0x7f6130102550 2024-09-13T21:56:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f612dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6130102ef0 0x7f613006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f612dd9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6130102ef0 0x7f613006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44704/0 (socket says 172.21.15.119:44704) 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f612dd9b640 1 -- 172.21.15.119:0/3226460592 learned_addr learned my addr 172.21.15.119:0/3226460592 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f612dd9b640 1 -- 172.21.15.119:0/3226460592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6130102550 msgr2=0x7f613006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f612dd9b640 1 --2- 172.21.15.119:0/3226460592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6130102550 0x7f613006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f612dd9b640 1 -- 172.21.15.119:0/3226460592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118005040 con 0x7f6130102ef0 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.920+0000 7f612dd9b640 1 --2- 172.21.15.119:0/3226460592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6130102ef0 0x7f613006ff50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f612000b540 tx=0x7f61200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.921+0000 7f6126ffd640 1 -- 172.21.15.119:0/3226460592 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f612000f6f0 con 0x7f6130102ef0 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.921+0000 7f6134bb8640 1 -- 172.21.15.119:0/3226460592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61301198d0 con 0x7f6130102ef0 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.921+0000 7f6126ffd640 1 -- 172.21.15.119:0/3226460592 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f612000fcf0 con 0x7f6130102ef0 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.921+0000 7f6126ffd640 1 -- 172.21.15.119:0/3226460592 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61200103a0 con 0x7f6130102ef0 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.921+0000 7f6134bb8640 1 -- 172.21.15.119:0/3226460592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6130119d10 con 0x7f6130102ef0 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.922+0000 7f6134bb8640 1 -- 172.21.15.119:0/3226460592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61300fdcd0 con 0x7f6130102ef0 2024-09-13T21:56:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.922+0000 7f6126ffd640 1 -- 172.21.15.119:0/3226460592 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f612000f850 con 0x7f6130102ef0 2024-09-13T21:56:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.923+0000 7f6126ffd640 1 --2- 172.21.15.119:0/3226460592 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f611c06e530 0x7f611c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.923+0000 7f6126ffd640 1 -- 172.21.15.119:0/3226460592 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f612008e170 con 0x7f6130102ef0 2024-09-13T21:56:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.923+0000 7f612e59c640 1 --2- 172.21.15.119:0/3226460592 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f611c06e530 0x7f611c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.923+0000 7f612e59c640 1 --2- 172.21.15.119:0/3226460592 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f611c06e530 0x7f611c0709e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6118009fa0 tx=0x7f6118009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:34.927+0000 7f6126ffd640 1 -- 172.21.15.119:0/3226460592 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6120057280 con 0x7f6130102ef0 2024-09-13T21:56:35.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.130+0000 7f6134bb8640 1 -- 172.21.15.119:0/3226460592 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 43, "format": "json"} v 0) v1 -- 0x7f61300fbd50 con 0x7f6130102ef0 2024-09-13T21:56:35.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.131+0000 7f6126ffd640 1 -- 172.21.15.119:0/3226460592 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 43, "format": "json"}]=0 dumped fsmap epoch 43 v46) v1 ==== 107+0+5262 (secure 0 0 0) 0x7f612005a940 con 0x7f6130102ef0 2024-09-13T21:56:35.133 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:35.133 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":43,"btime":"2024-09-13T21:52:48:267921+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44327,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/2986837064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2986837064},{"type":"v1","addr":"172.21.15.155:6825","nonce":2986837064}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":44331,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6827/3721950377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3721950377},{"type":"v1","addr":"172.21.15.155:6827","nonce":3721950377}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:45.259352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434]},"id":1}]} 2024-09-13T21:56:35.134 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 43 2024-09-13T21:56:35.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.133+0000 7f6134bb8640 1 -- 172.21.15.119:0/3226460592 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f611c06e530 msgr2=0x7f611c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:35.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.133+0000 7f6134bb8640 1 --2- 172.21.15.119:0/3226460592 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f611c06e530 0x7f611c0709e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6118009fa0 tx=0x7f6118009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:35.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.133+0000 7f6134bb8640 1 -- 172.21.15.119:0/3226460592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6130102ef0 msgr2=0x7f613006ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:35.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.133+0000 7f6134bb8640 1 --2- 172.21.15.119:0/3226460592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6130102ef0 0x7f613006ff50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f612000b540 tx=0x7f61200091a0 comp rx=0 tx=0).stop 2024-09-13T21:56:35.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.133+0000 7f6134bb8640 1 -- 172.21.15.119:0/3226460592 shutdown_connections 2024-09-13T21:56:35.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.133+0000 7f6134bb8640 1 --2- 172.21.15.119:0/3226460592 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f611c06e530 0x7f611c0709e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:35.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.133+0000 7f6134bb8640 1 --2- 172.21.15.119:0/3226460592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6130102ef0 0x7f613006ff50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:35.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.133+0000 7f6134bb8640 1 --2- 172.21.15.119:0/3226460592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6130102550 0x7f613006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:35.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.133+0000 7f6134bb8640 1 -- 172.21.15.119:0/3226460592 >> 172.21.15.119:0/3226460592 conn(0x7f61300f80f0 msgr2=0x7f61300f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:35.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.133+0000 7f6134bb8640 1 -- 172.21.15.119:0/3226460592 shutdown_connections 2024-09-13T21:56:35.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:35.133+0000 7f6134bb8640 1 -- 172.21.15.119:0/3226460592 wait complete. 2024-09-13T21:56:35.430 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:35 smithi119 ceph-mon[90896]: pgmap v328: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:35.430 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:35 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3226460592' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-09-13T21:56:35.712 DEBUG:tasks.fs:max_mds reduced in epoch 43 2024-09-13T21:56:35.713 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 44 2024-09-13T21:56:35.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:35 smithi155 ceph-mon[79928]: pgmap v328: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:35.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:35 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3226460592' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-09-13T21:56:35.955 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:37.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.566+0000 7f05847c6640 1 -- 172.21.15.119:0/703112022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057c102ee0 msgr2=0x7f057c0fc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:37.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.566+0000 7f05847c6640 1 --2- 172.21.15.119:0/703112022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057c102ee0 0x7f057c0fc5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f05700048d0 tx=0x7f0570009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:37.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.566+0000 7f05847c6640 1 -- 172.21.15.119:0/703112022 shutdown_connections 2024-09-13T21:56:37.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.566+0000 7f05847c6640 1 --2- 172.21.15.119:0/703112022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057c102ee0 0x7f057c0fc5a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.566+0000 7f05847c6640 1 --2- 172.21.15.119:0/703112022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f057c102540 0x7f057c102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.566+0000 7f05847c6640 1 -- 172.21.15.119:0/703112022 >> 172.21.15.119:0/703112022 conn(0x7f057c0f8120 msgr2=0x7f057c0fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.566+0000 7f05847c6640 1 -- 172.21.15.119:0/703112022 shutdown_connections 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.566+0000 7f05847c6640 1 -- 172.21.15.119:0/703112022 wait complete. 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.566+0000 7f05847c6640 1 Processor -- start 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.566+0000 7f05847c6640 1 -- start start 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f05847c6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057c102540 0x7f057c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f05847c6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f057c102ee0 0x7f057c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f05847c6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c070490 con 0x7f057c102540 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f05847c6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c070600 con 0x7f057c102ee0 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f0582562640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057c102540 0x7f057c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:37.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f0582562640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057c102540 0x7f057c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44708/0 (socket says 172.21.15.119:44708) 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f0582562640 1 -- 172.21.15.119:0/3192642205 learned_addr learned my addr 172.21.15.119:0/3192642205 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f0581d61640 1 --2- 172.21.15.119:0/3192642205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f057c102ee0 0x7f057c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f0582562640 1 -- 172.21.15.119:0/3192642205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f057c102ee0 msgr2=0x7f057c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f0582562640 1 --2- 172.21.15.119:0/3192642205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f057c102ee0 0x7f057c06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f0582562640 1 -- 172.21.15.119:0/3192642205 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570005040 con 0x7f057c102540 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f0582562640 1 --2- 172.21.15.119:0/3192642205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057c102540 0x7f057c06fa10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f056c00cb10 tx=0x7f056c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f057affd640 1 -- 172.21.15.119:0/3192642205 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056c004200 con 0x7f057c102540 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f057affd640 1 -- 172.21.15.119:0/3192642205 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f056c00acc0 con 0x7f057c102540 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f057affd640 1 -- 172.21.15.119:0/3192642205 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056c003cd0 con 0x7f057c102540 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.567+0000 7f05847c6640 1 -- 172.21.15.119:0/3192642205 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c070890 con 0x7f057c102540 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.568+0000 7f05847c6640 1 -- 172.21.15.119:0/3192642205 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c119900 con 0x7f057c102540 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.569+0000 7f05847c6640 1 -- 172.21.15.119:0/3192642205 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057c0fdcc0 con 0x7f057c102540 2024-09-13T21:56:37.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.569+0000 7f057affd640 1 -- 172.21.15.119:0/3192642205 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f056c00a820 con 0x7f057c102540 2024-09-13T21:56:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.570+0000 7f057affd640 1 --2- 172.21.15.119:0/3192642205 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f056406e530 0x7f05640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.570+0000 7f057affd640 1 -- 172.21.15.119:0/3192642205 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f056c08e890 con 0x7f057c102540 2024-09-13T21:56:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.570+0000 7f0581d61640 1 --2- 172.21.15.119:0/3192642205 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f056406e530 0x7f05640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.570+0000 7f0581d61640 1 --2- 172.21.15.119:0/3192642205 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f056406e530 0x7f05640709e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0570000c00 tx=0x7f0570035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:37.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.574+0000 7f057affd640 1 -- 172.21.15.119:0/3192642205 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f056c0579a0 con 0x7f057c102540 2024-09-13T21:56:37.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:37 smithi119 ceph-mon[90896]: pgmap v329: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:37.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:56:37.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.775+0000 7f05847c6640 1 -- 172.21.15.119:0/3192642205 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 44, "format": "json"} v 0) v1 -- 0x7f057c0fbd40 con 0x7f057c102540 2024-09-13T21:56:37.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.775+0000 7f057affd640 1 -- 172.21.15.119:0/3192642205 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 44, "format": "json"}]=0 dumped fsmap epoch 44 v46) v1 ==== 107+0+5262 (secure 0 0 0) 0x7f056c08ce60 con 0x7f057c102540 2024-09-13T21:56:37.777 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:37.777 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":44,"btime":"2024-09-13T21:52:55:487754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":44327,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/2986837064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2986837064},{"type":"v1","addr":"172.21.15.155:6825","nonce":2986837064}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":44331,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6827/3721950377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3721950377},{"type":"v1","addr":"172.21.15.155:6827","nonce":3721950377}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:54.490643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434]},"id":1}]} 2024-09-13T21:56:37.778 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 44 2024-09-13T21:56:37.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.777+0000 7f05847c6640 1 -- 172.21.15.119:0/3192642205 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f056406e530 msgr2=0x7f05640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:37.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.777+0000 7f05847c6640 1 --2- 172.21.15.119:0/3192642205 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f056406e530 0x7f05640709e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0570000c00 tx=0x7f0570035040 comp rx=0 tx=0).stop 2024-09-13T21:56:37.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.777+0000 7f05847c6640 1 -- 172.21.15.119:0/3192642205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057c102540 msgr2=0x7f057c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:37.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.777+0000 7f05847c6640 1 --2- 172.21.15.119:0/3192642205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057c102540 0x7f057c06fa10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f056c00cb10 tx=0x7f056c007ee0 comp rx=0 tx=0).stop 2024-09-13T21:56:37.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.777+0000 7f05847c6640 1 -- 172.21.15.119:0/3192642205 shutdown_connections 2024-09-13T21:56:37.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.777+0000 7f05847c6640 1 --2- 172.21.15.119:0/3192642205 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f056406e530 0x7f05640709e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:37.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.777+0000 7f05847c6640 1 --2- 172.21.15.119:0/3192642205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f057c102ee0 0x7f057c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:37.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.777+0000 7f05847c6640 1 --2- 172.21.15.119:0/3192642205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057c102540 0x7f057c06fa10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:37.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.777+0000 7f05847c6640 1 -- 172.21.15.119:0/3192642205 >> 172.21.15.119:0/3192642205 conn(0x7f057c0f8120 msgr2=0x7f057c0f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:37.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.778+0000 7f05847c6640 1 -- 172.21.15.119:0/3192642205 shutdown_connections 2024-09-13T21:56:37.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:37.778+0000 7f05847c6640 1 -- 172.21.15.119:0/3192642205 wait complete. 2024-09-13T21:56:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:37 smithi155 ceph-mon[79928]: pgmap v329: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:56:38.411 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 45 2024-09-13T21:56:38.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:38 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3192642205' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 44, "format": "json"}]: dispatch 2024-09-13T21:56:38.654 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:38.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:38 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3192642205' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 44, "format": "json"}]: dispatch 2024-09-13T21:56:39.663 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:39 smithi119 ceph-mon[90896]: pgmap v330: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:39.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:39 smithi155 ceph-mon[79928]: pgmap v330: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:40.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.189+0000 7fea70a73640 1 -- 172.21.15.119:0/55743438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c064fc0 msgr2=0x7fea6c065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:40.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.189+0000 7fea70a73640 1 --2- 172.21.15.119:0/55743438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c064fc0 0x7fea6c065430 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fea540048d0 tx=0x7fea54009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:40.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.189+0000 7fea70a73640 1 -- 172.21.15.119:0/55743438 shutdown_connections 2024-09-13T21:56:40.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.189+0000 7fea70a73640 1 --2- 172.21.15.119:0/55743438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c064fc0 0x7fea6c065430 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:40.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.189+0000 7fea70a73640 1 --2- 172.21.15.119:0/55743438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6c0fe460 0x7fea6c0fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:40.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.189+0000 7fea70a73640 1 -- 172.21.15.119:0/55743438 >> 172.21.15.119:0/55743438 conn(0x7fea6c0723b0 msgr2=0x7fea6c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:40.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.189+0000 7fea70a73640 1 -- 172.21.15.119:0/55743438 shutdown_connections 2024-09-13T21:56:40.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.189+0000 7fea70a73640 1 -- 172.21.15.119:0/55743438 wait complete. 2024-09-13T21:56:40.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.189+0000 7fea70a73640 1 Processor -- start 2024-09-13T21:56:40.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.189+0000 7fea70a73640 1 -- start start 2024-09-13T21:56:40.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea70a73640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c064fc0 0x7fea6c113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea70a73640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6c0fe460 0x7fea6c113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea70a73640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c113e00 con 0x7fea6c064fc0 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea70a73640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c10d1b0 con 0x7fea6c0fe460 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea6a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c064fc0 0x7fea6c113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea6a59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c064fc0 0x7fea6c113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44728/0 (socket says 172.21.15.119:44728) 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea6a59c640 1 -- 172.21.15.119:0/1400636625 learned_addr learned my addr 172.21.15.119:0/1400636625 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea69d9b640 1 --2- 172.21.15.119:0/1400636625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6c0fe460 0x7fea6c113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea6a59c640 1 -- 172.21.15.119:0/1400636625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6c0fe460 msgr2=0x7fea6c113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea6a59c640 1 --2- 172.21.15.119:0/1400636625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6c0fe460 0x7fea6c113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea6a59c640 1 -- 172.21.15.119:0/1400636625 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea54005040 con 0x7fea6c064fc0 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea6a59c640 1 --2- 172.21.15.119:0/1400636625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c064fc0 0x7fea6c113230 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fea6400bbb0 tx=0x7fea64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:40.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea62ffd640 1 -- 172.21.15.119:0/1400636625 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea6400c9c0 con 0x7fea6c064fc0 2024-09-13T21:56:40.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea62ffd640 1 -- 172.21.15.119:0/1400636625 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea640092e0 con 0x7fea6c064fc0 2024-09-13T21:56:40.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea70a73640 1 -- 172.21.15.119:0/1400636625 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c10d490 con 0x7fea6c064fc0 2024-09-13T21:56:40.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea62ffd640 1 -- 172.21.15.119:0/1400636625 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea64007640 con 0x7fea6c064fc0 2024-09-13T21:56:40.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.190+0000 7fea70a73640 1 -- 172.21.15.119:0/1400636625 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c10d9b0 con 0x7fea6c064fc0 2024-09-13T21:56:40.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.191+0000 7fea70a73640 1 -- 172.21.15.119:0/1400636625 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c0fdcf0 con 0x7fea6c064fc0 2024-09-13T21:56:40.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.192+0000 7fea62ffd640 1 -- 172.21.15.119:0/1400636625 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fea64012070 con 0x7fea6c064fc0 2024-09-13T21:56:40.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.192+0000 7fea62ffd640 1 --2- 172.21.15.119:0/1400636625 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fea5806e530 0x7fea580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:40.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.192+0000 7fea62ffd640 1 -- 172.21.15.119:0/1400636625 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fea6408e3a0 con 0x7fea6c064fc0 2024-09-13T21:56:40.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.192+0000 7fea69d9b640 1 --2- 172.21.15.119:0/1400636625 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fea5806e530 0x7fea580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:40.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.193+0000 7fea69d9b640 1 --2- 172.21.15.119:0/1400636625 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fea5806e530 0x7fea580709e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea54009ac0 tx=0x7fea54009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:40.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.197+0000 7fea62ffd640 1 -- 172.21.15.119:0/1400636625 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fea64057430 con 0x7fea6c064fc0 2024-09-13T21:56:40.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.404+0000 7fea70a73640 1 -- 172.21.15.119:0/1400636625 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 45, "format": "json"} v 0) v1 -- 0x7fea6c04b7b0 con 0x7fea6c064fc0 2024-09-13T21:56:40.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.405+0000 7fea62ffd640 1 -- 172.21.15.119:0/1400636625 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 45, "format": "json"}]=0 dumped fsmap epoch 45 v46) v1 ==== 107+0+5279 (secure 0 0 0) 0x7fea6405aaf0 con 0x7fea6c064fc0 2024-09-13T21:56:40.406 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-13T21:56:40.406 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":45,"btime":"2024-09-13T21:52:55:491673+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44327,"name":"cephfs.smithi155.yblkxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6825/2986837064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2986837064},{"type":"v1","addr":"172.21.15.155:6825","nonce":2986837064}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":44331,"name":"cephfs.smithi155.afmavb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6827/3721950377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3721950377},{"type":"v1","addr":"172.21.15.155:6827","nonce":3721950377}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T21:42:10.349266+0000","modified":"2024-09-13T21:52:55.491659+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34434,"mds_1":34438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi119.rpmijj","rank":0,"incarnation":39,"state":"up:active","state_seq":16,"addr":"172.21.15.119:6827/2388971361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2388971361},{"type":"v1","addr":"172.21.15.119:6827","nonce":2388971361}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34438":{"gid":34438,"name":"cephfs.smithi119.yydzwt","rank":1,"incarnation":45,"state":"up:starting","state_seq":1,"addr":"172.21.15.119:6829/3559937126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":3559937126},{"type":"v1","addr":"172.21.15.119:6829","nonce":3559937126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434]},"id":1}]} 2024-09-13T21:56:40.407 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 45 2024-09-13T21:56:40.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.407+0000 7fea70a73640 1 -- 172.21.15.119:0/1400636625 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fea5806e530 msgr2=0x7fea580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:40.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.407+0000 7fea70a73640 1 --2- 172.21.15.119:0/1400636625 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fea5806e530 0x7fea580709e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea54009ac0 tx=0x7fea54009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:40.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.407+0000 7fea70a73640 1 -- 172.21.15.119:0/1400636625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c064fc0 msgr2=0x7fea6c113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:40.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.407+0000 7fea70a73640 1 --2- 172.21.15.119:0/1400636625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c064fc0 0x7fea6c113230 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fea6400bbb0 tx=0x7fea64009840 comp rx=0 tx=0).stop 2024-09-13T21:56:40.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.407+0000 7fea70a73640 1 -- 172.21.15.119:0/1400636625 shutdown_connections 2024-09-13T21:56:40.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.407+0000 7fea70a73640 1 --2- 172.21.15.119:0/1400636625 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fea5806e530 0x7fea580709e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:40.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.407+0000 7fea70a73640 1 --2- 172.21.15.119:0/1400636625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea6c0fe460 0x7fea6c113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:40.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.407+0000 7fea70a73640 1 --2- 172.21.15.119:0/1400636625 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea6c064fc0 0x7fea6c113230 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:40.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.407+0000 7fea70a73640 1 -- 172.21.15.119:0/1400636625 >> 172.21.15.119:0/1400636625 conn(0x7fea6c0723b0 msgr2=0x7fea6c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:40.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.407+0000 7fea70a73640 1 -- 172.21.15.119:0/1400636625 shutdown_connections 2024-09-13T21:56:40.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:40.407+0000 7fea70a73640 1 -- 172.21.15.119:0/1400636625 wait complete. 2024-09-13T21:56:40.990 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T21:56:41.001 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T21:56:41.001 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:56:41.001 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T21:56:41.019 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:56:41.019 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T21:56:41.078 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T21:56:41.358 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:41.726 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:41 smithi119 ceph-mon[90896]: pgmap v331: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:41.727 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:41 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/1400636625' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 45, "format": "json"}]: dispatch 2024-09-13T21:56:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:41 smithi155 ceph-mon[79928]: pgmap v331: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:41 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/1400636625' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 45, "format": "json"}]: dispatch 2024-09-13T21:56:43.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.018+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/2919837275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc4102530 msgr2=0x7fdfc4102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:43.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.018+0000 7fdfc8ba3640 1 --2- 172.21.15.119:0/2919837275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc4102530 0x7fdfc4102900 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40048d0 tx=0x7fdfb4009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:43.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.018+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/2919837275 shutdown_connections 2024-09-13T21:56:43.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.018+0000 7fdfc8ba3640 1 --2- 172.21.15.119:0/2919837275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102ed0 0x7fdfc40fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:43.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.018+0000 7fdfc8ba3640 1 --2- 172.21.15.119:0/2919837275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc4102530 0x7fdfc4102900 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:43.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.018+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/2919837275 >> 172.21.15.119:0/2919837275 conn(0x7fdfc40f80f0 msgr2=0x7fdfc40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:43.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.018+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/2919837275 shutdown_connections 2024-09-13T21:56:43.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.018+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/2919837275 wait complete. 2024-09-13T21:56:43.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.018+0000 7fdfc8ba3640 1 Processor -- start 2024-09-13T21:56:43.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.018+0000 7fdfc8ba3640 1 -- start start 2024-09-13T21:56:43.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc8ba3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102530 0x7fdfc406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:43.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc8ba3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc4102ed0 0x7fdfc406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:43.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc8ba3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4070490 con 0x7fdfc4102ed0 2024-09-13T21:56:43.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc8ba3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4070600 con 0x7fdfc4102530 2024-09-13T21:56:43.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc4102ed0 0x7fdfc406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:43.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc1d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc4102ed0 0x7fdfc406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44744/0 (socket says 172.21.15.119:44744) 2024-09-13T21:56:43.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc1d9b640 1 -- 172.21.15.119:0/3530904606 learned_addr learned my addr 172.21.15.119:0/3530904606 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:43.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc259c640 1 --2- 172.21.15.119:0/3530904606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102530 0x7fdfc406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:43.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc1d9b640 1 -- 172.21.15.119:0/3530904606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102530 msgr2=0x7fdfc406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:43.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc1d9b640 1 --2- 172.21.15.119:0/3530904606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102530 0x7fdfc406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:43.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc1d9b640 1 -- 172.21.15.119:0/3530904606 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb4005040 con 0x7fdfc4102ed0 2024-09-13T21:56:43.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc1d9b640 1 --2- 172.21.15.119:0/3530904606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc4102ed0 0x7fdfc406ff50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8002840 tx=0x7fdfb8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:43.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfb2ffd640 1 -- 172.21.15.119:0/3530904606 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb8007c30 con 0x7fdfc4102ed0 2024-09-13T21:56:43.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfb2ffd640 1 -- 172.21.15.119:0/3530904606 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdfb800f040 con 0x7fdfc4102ed0 2024-09-13T21:56:43.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/3530904606 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc4070890 con 0x7fdfc4102ed0 2024-09-13T21:56:43.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.019+0000 7fdfb2ffd640 1 -- 172.21.15.119:0/3530904606 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb800d990 con 0x7fdfc4102ed0 2024-09-13T21:56:43.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.020+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/3530904606 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc4119970 con 0x7fdfc4102ed0 2024-09-13T21:56:43.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.020+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/3530904606 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc40fdcb0 con 0x7fdfc4102ed0 2024-09-13T21:56:43.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.021+0000 7fdfb2ffd640 1 -- 172.21.15.119:0/3530904606 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdfb8009600 con 0x7fdfc4102ed0 2024-09-13T21:56:43.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.021+0000 7fdfb2ffd640 1 --2- 172.21.15.119:0/3530904606 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfac06e530 0x7fdfac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:43.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.021+0000 7fdfb2ffd640 1 -- 172.21.15.119:0/3530904606 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fdfb808d930 con 0x7fdfc4102ed0 2024-09-13T21:56:43.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.021+0000 7fdfc259c640 1 --2- 172.21.15.119:0/3530904606 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfac06e530 0x7fdfac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:43.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.022+0000 7fdfc259c640 1 --2- 172.21.15.119:0/3530904606 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfac06e530 0x7fdfac0709e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009ac0 tx=0x7fdfb4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:43.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.026+0000 7fdfb2ffd640 1 -- 172.21.15.119:0/3530904606 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdfb8056a70 con 0x7fdfc4102ed0 2024-09-13T21:56:43.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.207+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/3530904606 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdfc4109600 con 0x7fdfc4102ed0 2024-09-13T21:56:43.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.208+0000 7fdfb2ffd640 1 -- 172.21.15.119:0/3530904606 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v81) v1 ==== 81+0+2459 (secure 0 0 0) 0x7fdfb805a130 con 0x7fdfc4102ed0 2024-09-13T21:56:43.210 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:6826/2908862913 2024-09-14T21:52:37.413663+0000 2024-09-13T21:56:43.210 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/3983229644 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:43.210 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/3089168281 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:43.210 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/411672165 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:43.210 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6801/4086293592 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:43.211 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6800/4086293592 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:43.211 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/916285265 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:43.211 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:6828/1626670445 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:43.211 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/821090242 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:43.211 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6829/66730685 2024-09-14T21:52:03.807713+0000 2024-09-13T21:56:43.211 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/4214610807 2024-09-14T21:36:31.341760+0000 2024-09-13T21:56:43.211 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/789874977 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:43.211 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1724446307 2024-09-14T21:36:02.290241+0000 2024-09-13T21:56:43.211 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1804460008 2024-09-14T21:36:02.290241+0000 2024-09-13T21:56:43.211 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/2537835370 2024-09-14T21:36:02.290241+0000 2024-09-13T21:56:43.211 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:0/2430602079 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:0/3940572027 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6800/254943630 2024-09-14T21:36:02.290241+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1541081107 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1116844341 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6801/1188851329 2024-09-14T21:37:29.647517+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6828/66730685 2024-09-14T21:52:03.807713+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:0/3293845016 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/2573788183 2024-09-14T21:37:29.647517+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6800/1188851329 2024-09-14T21:37:29.647517+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6801/254943630 2024-09-14T21:36:02.290241+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6800/245070511 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:43.212 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6827/1366726298 2024-09-14T21:42:26.453482+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/3960829539 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6826/1366726298 2024-09-14T21:42:26.453482+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6801/245070511 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/4064361328 2024-09-14T21:37:29.647517+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:0/4223424951 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/2630647001 2024-09-14T21:37:29.647517+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/4158458893 2024-09-14T21:36:31.341760+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6801/366226653 2024-09-14T21:36:31.341760+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1305587427 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:6827/2908862913 2024-09-14T21:52:37.413663+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6800/366226653 2024-09-14T21:36:31.341760+0000 2024-09-13T21:56:43.213 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:6829/1626670445 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:43.214 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1575352567 2024-09-14T21:36:31.341760+0000 2024-09-13T21:56:43.214 INFO:teuthology.orchestra.run.smithi119.stderr:listed 41 entries 2024-09-13T21:56:43.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.210+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/3530904606 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfac06e530 msgr2=0x7fdfac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:43.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.210+0000 7fdfc8ba3640 1 --2- 172.21.15.119:0/3530904606 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfac06e530 0x7fdfac0709e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009ac0 tx=0x7fdfb4035040 comp rx=0 tx=0).stop 2024-09-13T21:56:43.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.210+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/3530904606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc4102ed0 msgr2=0x7fdfc406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:43.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.210+0000 7fdfc8ba3640 1 --2- 172.21.15.119:0/3530904606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc4102ed0 0x7fdfc406ff50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8002840 tx=0x7fdfb8004570 comp rx=0 tx=0).stop 2024-09-13T21:56:43.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.210+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/3530904606 shutdown_connections 2024-09-13T21:56:43.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.210+0000 7fdfc8ba3640 1 --2- 172.21.15.119:0/3530904606 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7fdfac06e530 0x7fdfac0709e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:43.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.210+0000 7fdfc8ba3640 1 --2- 172.21.15.119:0/3530904606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc4102ed0 0x7fdfc406ff50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:43.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.210+0000 7fdfc8ba3640 1 --2- 172.21.15.119:0/3530904606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102530 0x7fdfc406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:43.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.210+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/3530904606 >> 172.21.15.119:0/3530904606 conn(0x7fdfc40f80f0 msgr2=0x7fdfc40f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:43.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.210+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/3530904606 shutdown_connections 2024-09-13T21:56:43.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:43.210+0000 7fdfc8ba3640 1 -- 172.21.15.119:0/3530904606 wait complete. 2024-09-13T21:56:43.772 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:43 smithi119 ceph-mon[90896]: pgmap v332: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:43.773 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:43 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/3530904606' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T21:56:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:43 smithi155 ceph-mon[79928]: pgmap v332: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:43 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/3530904606' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T21:56:44.063 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-13T21:56:44.063 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T21:56:44.082 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9722044-7217-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T21:56:44.383 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/mon.smithi119/config 2024-09-13T21:56:45.783 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:45 smithi119 ceph-mon[90896]: pgmap v333: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:45.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:45 smithi155 ceph-mon[79928]: pgmap v333: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:46.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.101+0000 7f0ffc363640 1 -- 172.21.15.119:0/2994638079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ff40fe450 msgr2=0x7f0ff40fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:46.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.101+0000 7f0ffc363640 1 --2- 172.21.15.119:0/2994638079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ff40fe450 0x7f0ff40fe820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00048d0 tx=0x7f0ff0009da0 comp rx=0 tx=0).stop 2024-09-13T21:56:46.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.101+0000 7f0ffc363640 1 -- 172.21.15.119:0/2994638079 shutdown_connections 2024-09-13T21:56:46.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.101+0000 7f0ffc363640 1 --2- 172.21.15.119:0/2994638079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff4064fe0 0x7f0ff4065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:46.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.101+0000 7f0ffc363640 1 --2- 172.21.15.119:0/2994638079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ff40fe450 0x7f0ff40fe820 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:46.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.101+0000 7f0ffc363640 1 -- 172.21.15.119:0/2994638079 >> 172.21.15.119:0/2994638079 conn(0x7f0ff40723b0 msgr2=0x7f0ff40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:46.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.101+0000 7f0ffc363640 1 -- 172.21.15.119:0/2994638079 shutdown_connections 2024-09-13T21:56:46.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.101+0000 7f0ffc363640 1 -- 172.21.15.119:0/2994638079 wait complete. 2024-09-13T21:56:46.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.101+0000 7f0ffc363640 1 Processor -- start 2024-09-13T21:56:46.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ffc363640 1 -- start start 2024-09-13T21:56:46.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ffc363640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff4064fe0 0x7f0ff4113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:46.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ffc363640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ff40fe450 0x7f0ff4113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:46.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ffc363640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4113e20 con 0x7f0ff40fe450 2024-09-13T21:56:46.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ffc363640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff410d1d0 con 0x7f0ff4064fe0 2024-09-13T21:56:46.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ff98fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ff40fe450 0x7f0ff4113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:46.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ff98fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ff40fe450 0x7f0ff4113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44304/0 (socket says 172.21.15.119:44304) 2024-09-13T21:56:46.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ff98fe640 1 -- 172.21.15.119:0/491026056 learned_addr learned my addr 172.21.15.119:0/491026056 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-13T21:56:46.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ffa0ff640 1 --2- 172.21.15.119:0/491026056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff4064fe0 0x7f0ff4113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:46.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ff98fe640 1 -- 172.21.15.119:0/491026056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff4064fe0 msgr2=0x7f0ff4113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:46.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ff98fe640 1 --2- 172.21.15.119:0/491026056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff4064fe0 0x7f0ff4113250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:46.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ff98fe640 1 -- 172.21.15.119:0/491026056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0005040 con 0x7f0ff40fe450 2024-09-13T21:56:46.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.102+0000 7f0ff98fe640 1 --2- 172.21.15.119:0/491026056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ff40fe450 0x7f0ff4113790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400b790 tx=0x7f0fe40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:46.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.103+0000 7f0feaffd640 1 -- 172.21.15.119:0/491026056 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fe400c700 con 0x7f0ff40fe450 2024-09-13T21:56:46.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.103+0000 7f0feaffd640 1 -- 172.21.15.119:0/491026056 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0fe400cd00 con 0x7f0ff40fe450 2024-09-13T21:56:46.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.103+0000 7f0ffc363640 1 -- 172.21.15.119:0/491026056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff410d4b0 con 0x7f0ff40fe450 2024-09-13T21:56:46.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.103+0000 7f0feaffd640 1 -- 172.21.15.119:0/491026056 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fe4015e80 con 0x7f0ff40fe450 2024-09-13T21:56:46.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.103+0000 7f0ffc363640 1 -- 172.21.15.119:0/491026056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff410d9d0 con 0x7f0ff40fe450 2024-09-13T21:56:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.104+0000 7f0ffc363640 1 -- 172.21.15.119:0/491026056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff40fdce0 con 0x7f0ff40fe450 2024-09-13T21:56:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.104+0000 7f0feaffd640 1 -- 172.21.15.119:0/491026056 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0fe4012070 con 0x7f0ff40fe450 2024-09-13T21:56:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.105+0000 7f0feaffd640 1 --2- 172.21.15.119:0/491026056 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0fe006e530 0x7f0fe00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T21:56:46.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.105+0000 7f0feaffd640 1 -- 172.21.15.119:0/491026056 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f0fe408dac0 con 0x7f0ff40fe450 2024-09-13T21:56:46.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.105+0000 7f0ffa0ff640 1 --2- 172.21.15.119:0/491026056 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0fe006e530 0x7f0fe00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T21:56:46.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.105+0000 7f0ffa0ff640 1 --2- 172.21.15.119:0/491026056 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0fe006e530 0x7f0fe00709e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009ac0 tx=0x7f0ff0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T21:56:46.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.109+0000 7f0feaffd640 1 -- 172.21.15.119:0/491026056 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0fe4056b50 con 0x7f0ff40fe450 2024-09-13T21:56:46.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.286+0000 7f0ffc363640 1 -- 172.21.15.119:0/491026056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0ff410e8c0 con 0x7f0ff40fe450 2024-09-13T21:56:46.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.286+0000 7f0feaffd640 1 -- 172.21.15.119:0/491026056 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v81) v1 ==== 81+0+2459 (secure 0 0 0) 0x7f0fe405a210 con 0x7f0ff40fe450 2024-09-13T21:56:46.288 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:6826/2908862913 2024-09-14T21:52:37.413663+0000 2024-09-13T21:56:46.288 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/3983229644 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:46.288 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/3089168281 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:46.288 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/411672165 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:46.288 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6801/4086293592 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:46.288 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6800/4086293592 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:46.289 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/916285265 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:46.289 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:6828/1626670445 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:46.289 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/821090242 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:46.289 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6829/66730685 2024-09-14T21:52:03.807713+0000 2024-09-13T21:56:46.289 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/4214610807 2024-09-14T21:36:31.341760+0000 2024-09-13T21:56:46.289 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/789874977 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:46.289 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1724446307 2024-09-14T21:36:02.290241+0000 2024-09-13T21:56:46.289 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1804460008 2024-09-14T21:36:02.290241+0000 2024-09-13T21:56:46.289 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/2537835370 2024-09-14T21:36:02.290241+0000 2024-09-13T21:56:46.289 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:0/2430602079 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:0/3940572027 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6800/254943630 2024-09-14T21:36:02.290241+0000 2024-09-13T21:56:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1541081107 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1116844341 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6801/1188851329 2024-09-14T21:37:29.647517+0000 2024-09-13T21:56:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6828/66730685 2024-09-14T21:52:03.807713+0000 2024-09-13T21:56:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:0/3293845016 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/2573788183 2024-09-14T21:37:29.647517+0000 2024-09-13T21:56:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6800/1188851329 2024-09-14T21:37:29.647517+0000 2024-09-13T21:56:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6801/254943630 2024-09-14T21:36:02.290241+0000 2024-09-13T21:56:46.290 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6800/245070511 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6827/1366726298 2024-09-14T21:42:26.453482+0000 2024-09-13T21:56:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/3960829539 2024-09-14T21:46:52.089325+0000 2024-09-13T21:56:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6826/1366726298 2024-09-14T21:42:26.453482+0000 2024-09-13T21:56:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6801/245070511 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/4064361328 2024-09-14T21:37:29.647517+0000 2024-09-13T21:56:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:0/4223424951 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/2630647001 2024-09-14T21:37:29.647517+0000 2024-09-13T21:56:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/4158458893 2024-09-14T21:36:31.341760+0000 2024-09-13T21:56:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6801/366226653 2024-09-14T21:36:31.341760+0000 2024-09-13T21:56:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1305587427 2024-09-14T21:44:36.488154+0000 2024-09-13T21:56:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:6827/2908862913 2024-09-14T21:52:37.413663+0000 2024-09-13T21:56:46.292 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:6800/366226653 2024-09-14T21:36:31.341760+0000 2024-09-13T21:56:46.292 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.155:6829/1626670445 2024-09-14T21:46:13.169548+0000 2024-09-13T21:56:46.292 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119:0/1575352567 2024-09-14T21:36:31.341760+0000 2024-09-13T21:56:46.293 INFO:teuthology.orchestra.run.smithi119.stderr:listed 41 entries 2024-09-13T21:56:46.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.288+0000 7f0ffc363640 1 -- 172.21.15.119:0/491026056 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0fe006e530 msgr2=0x7f0fe00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:46.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.288+0000 7f0ffc363640 1 --2- 172.21.15.119:0/491026056 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0fe006e530 0x7f0fe00709e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009ac0 tx=0x7f0ff0035040 comp rx=0 tx=0).stop 2024-09-13T21:56:46.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.288+0000 7f0ffc363640 1 -- 172.21.15.119:0/491026056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ff40fe450 msgr2=0x7f0ff4113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T21:56:46.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.288+0000 7f0ffc363640 1 --2- 172.21.15.119:0/491026056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ff40fe450 0x7f0ff4113790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400b790 tx=0x7f0fe40091d0 comp rx=0 tx=0).stop 2024-09-13T21:56:46.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.288+0000 7f0ffc363640 1 -- 172.21.15.119:0/491026056 shutdown_connections 2024-09-13T21:56:46.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.288+0000 7f0ffc363640 1 --2- 172.21.15.119:0/491026056 >> [v2:172.21.15.119:6800/42221219,v1:172.21.15.119:6801/42221219] conn(0x7f0fe006e530 0x7f0fe00709e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:46.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.288+0000 7f0ffc363640 1 --2- 172.21.15.119:0/491026056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ff40fe450 0x7f0ff4113790 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:46.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.288+0000 7f0ffc363640 1 --2- 172.21.15.119:0/491026056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff4064fe0 0x7f0ff4113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T21:56:46.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.288+0000 7f0ffc363640 1 -- 172.21.15.119:0/491026056 >> 172.21.15.119:0/491026056 conn(0x7f0ff40723b0 msgr2=0x7f0ff40fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T21:56:46.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.288+0000 7f0ffc363640 1 -- 172.21.15.119:0/491026056 shutdown_connections 2024-09-13T21:56:46.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-13T21:56:46.288+0000 7f0ffc363640 1 -- 172.21.15.119:0/491026056 wait complete. 2024-09-13T21:56:46.750 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:46 smithi119 ceph-mon[90896]: from='client.? 172.21.15.119:0/491026056' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T21:56:46.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:46 smithi155 ceph-mon[79928]: from='client.? 172.21.15.119:0/491026056' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T21:56:46.990 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2024-09-13T21:56:46.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T21:56:46.990 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T21:56:47.020 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T21:56:47.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:47 smithi155 ceph-mon[79928]: pgmap v334: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:47.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:47 smithi119 ceph-mon[90896]: pgmap v334: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:49.682 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:49 smithi119 ceph-mon[90896]: pgmap v335: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:49.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:49 smithi155 ceph-mon[79928]: pgmap v335: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:51.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:51 smithi155 ceph-mon[79928]: pgmap v336: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:51.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:51 smithi119 ceph-mon[90896]: pgmap v336: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:52.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:56:52.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:56:53.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:53 smithi155 ceph-mon[79928]: pgmap v337: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:53.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:53 smithi119 ceph-mon[90896]: pgmap v337: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:55.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:55 smithi155 ceph-mon[79928]: pgmap v338: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:55.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:55 smithi119 ceph-mon[90896]: pgmap v338: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:57 smithi155 ceph-mon[79928]: pgmap v339: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:57.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:57 smithi119 ceph-mon[90896]: pgmap v339: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:59.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:56:59 smithi155 ceph-mon[79928]: pgmap v340: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:56:59.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:56:59 smithi119 ceph-mon[90896]: pgmap v340: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:01.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:01 smithi155 ceph-mon[79928]: pgmap v341: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:01.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:01 smithi119 ceph-mon[90896]: pgmap v341: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:03.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:03 smithi155 ceph-mon[79928]: pgmap v342: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:03.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:03 smithi119 ceph-mon[90896]: pgmap v342: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:05 smithi155 ceph-mon[79928]: pgmap v343: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:05.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:05 smithi119 ceph-mon[90896]: pgmap v343: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:07 smithi155 ceph-mon[79928]: pgmap v344: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:57:07.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:07 smithi119 ceph-mon[90896]: pgmap v344: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:07.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:57:08.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:08 smithi155 ceph-mon[79928]: pgmap v345: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:08.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:08 smithi119 ceph-mon[90896]: pgmap v345: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:11.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:11 smithi155 ceph-mon[79928]: pgmap v346: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:11.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:11 smithi119 ceph-mon[90896]: pgmap v346: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:13.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:13 smithi155 ceph-mon[79928]: pgmap v347: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:13.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:13 smithi119 ceph-mon[90896]: pgmap v347: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:15.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:15 smithi155 ceph-mon[79928]: pgmap v348: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:15.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:15 smithi119 ceph-mon[90896]: pgmap v348: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:17.582 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:17 smithi155 ceph-mon[79928]: pgmap v349: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:17.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:17 smithi119 ceph-mon[90896]: pgmap v349: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:19.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:19 smithi155 ceph-mon[79928]: pgmap v350: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:19.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:19 smithi119 ceph-mon[90896]: pgmap v350: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:21.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:21 smithi155 ceph-mon[79928]: pgmap v351: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:21.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:21 smithi119 ceph-mon[90896]: pgmap v351: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:22.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:57:22.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:57:23.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:23 smithi119 ceph-mon[90896]: pgmap v352: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:23.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:23 smithi155 ceph-mon[79928]: pgmap v352: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:24.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:24 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:57:24.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:24 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:57:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:25 smithi155 ceph-mon[79928]: pgmap v353: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:57:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:57:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:57:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:57:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:57:25.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:25 smithi119 ceph-mon[90896]: pgmap v353: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:25.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:57:25.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:57:25.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:57:25.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:57:25.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:57:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:27 smithi155 ceph-mon[79928]: pgmap v354: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:27.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:27 smithi119 ceph-mon[90896]: pgmap v354: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:29.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:29 smithi155 ceph-mon[79928]: pgmap v355: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:29.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:29 smithi119 ceph-mon[90896]: pgmap v355: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:31.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:31 smithi155 ceph-mon[79928]: pgmap v356: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:31.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:31 smithi119 ceph-mon[90896]: pgmap v356: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:33.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:33 smithi155 ceph-mon[79928]: pgmap v357: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:33.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:33 smithi119 ceph-mon[90896]: pgmap v357: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:35.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:35 smithi155 ceph-mon[79928]: pgmap v358: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:35.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:35 smithi119 ceph-mon[90896]: pgmap v358: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:37 smithi155 ceph-mon[79928]: pgmap v359: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:57:37.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:37 smithi119 ceph-mon[90896]: pgmap v359: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:37.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:57:38.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:38 smithi155 ceph-mon[79928]: pgmap v360: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:38.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:38 smithi119 ceph-mon[90896]: pgmap v360: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:41.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:41 smithi155 ceph-mon[79928]: pgmap v361: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:41.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:41 smithi119 ceph-mon[90896]: pgmap v361: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:43.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:43 smithi155 ceph-mon[79928]: pgmap v362: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:43.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:43 smithi119 ceph-mon[90896]: pgmap v362: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:45.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:45 smithi155 ceph-mon[79928]: pgmap v363: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:45.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:45 smithi119 ceph-mon[90896]: pgmap v363: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:47.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:47 smithi155 ceph-mon[79928]: pgmap v364: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:47.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:47 smithi119 ceph-mon[90896]: pgmap v364: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:49.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:49 smithi155 ceph-mon[79928]: pgmap v365: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:49.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:49 smithi119 ceph-mon[90896]: pgmap v365: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:51.583 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:51 smithi155 ceph-mon[79928]: pgmap v366: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:51.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:51 smithi119 ceph-mon[90896]: pgmap v366: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:52.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:57:52.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:57:53.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:53 smithi119 ceph-mon[90896]: pgmap v367: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:53.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:53 smithi155 ceph-mon[79928]: pgmap v367: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:55.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:55 smithi119 ceph-mon[90896]: pgmap v368: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:55.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:55 smithi155 ceph-mon[79928]: pgmap v368: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:57.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:57 smithi119 ceph-mon[90896]: pgmap v369: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:57 smithi155 ceph-mon[79928]: pgmap v369: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:59.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:57:59 smithi119 ceph-mon[90896]: pgmap v370: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:57:59.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:57:59 smithi155 ceph-mon[79928]: pgmap v370: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:01.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:01 smithi119 ceph-mon[90896]: pgmap v371: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:01.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:01 smithi155 ceph-mon[79928]: pgmap v371: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:03.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:03 smithi119 ceph-mon[90896]: pgmap v372: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:03.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:03 smithi155 ceph-mon[79928]: pgmap v372: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:05.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:05 smithi119 ceph-mon[90896]: pgmap v373: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:05.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:05 smithi155 ceph-mon[79928]: pgmap v373: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:07.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:07 smithi119 ceph-mon[90896]: pgmap v374: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:07.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:58:07.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:07 smithi155 ceph-mon[79928]: pgmap v374: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:58:09.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:09 smithi119 ceph-mon[90896]: pgmap v375: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:09 smithi155 ceph-mon[79928]: pgmap v375: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:11.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:11 smithi119 ceph-mon[90896]: pgmap v376: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:11.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:11 smithi155 ceph-mon[79928]: pgmap v376: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:13.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:13 smithi119 ceph-mon[90896]: pgmap v377: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:13.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:13 smithi155 ceph-mon[79928]: pgmap v377: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:15.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:15 smithi119 ceph-mon[90896]: pgmap v378: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:15.635 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:15 smithi155 ceph-mon[79928]: pgmap v378: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:17.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:17 smithi119 ceph-mon[90896]: pgmap v379: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:17.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:17 smithi155 ceph-mon[79928]: pgmap v379: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:19.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:19 smithi119 ceph-mon[90896]: pgmap v380: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:19.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:19 smithi155 ceph-mon[79928]: pgmap v380: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:21.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:21 smithi119 ceph-mon[90896]: pgmap v381: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:21.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:21 smithi155 ceph-mon[79928]: pgmap v381: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:22.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:58:22.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:58:23.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:23 smithi155 ceph-mon[79928]: pgmap v382: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:23.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:23 smithi119 ceph-mon[90896]: pgmap v382: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:25 smithi155 ceph-mon[79928]: pgmap v383: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:58:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:58:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:25 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:58:25.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:25 smithi119 ceph-mon[90896]: pgmap v383: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:25.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:58:25.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:58:25.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:25 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:58:26.749 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:58:26.749 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:58:26.749 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:58:26.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:58:26.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:58:26.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:58:27.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:27 smithi155 ceph-mon[79928]: pgmap v384: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:27.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:27 smithi119 ceph-mon[90896]: pgmap v384: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:29.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:29 smithi155 ceph-mon[79928]: pgmap v385: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:29.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:29 smithi119 ceph-mon[90896]: pgmap v385: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:31.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:31 smithi155 ceph-mon[79928]: pgmap v386: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:31.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:31 smithi119 ceph-mon[90896]: pgmap v386: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:33.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:33 smithi155 ceph-mon[79928]: pgmap v387: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:33.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:33 smithi119 ceph-mon[90896]: pgmap v387: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:35.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:35 smithi155 ceph-mon[79928]: pgmap v388: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:35.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:35 smithi119 ceph-mon[90896]: pgmap v388: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:37 smithi155 ceph-mon[79928]: pgmap v389: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:58:37.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:37 smithi119 ceph-mon[90896]: pgmap v389: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:37.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:58:39.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:39 smithi155 ceph-mon[79928]: pgmap v390: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:39.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:39 smithi119 ceph-mon[90896]: pgmap v390: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:41 smithi155 ceph-mon[79928]: pgmap v391: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:41.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:41 smithi119 ceph-mon[90896]: pgmap v391: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:43 smithi155 ceph-mon[79928]: pgmap v392: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:43.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:43 smithi119 ceph-mon[90896]: pgmap v392: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:45.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:45 smithi155 ceph-mon[79928]: pgmap v393: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:45.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:45 smithi119 ceph-mon[90896]: pgmap v393: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:47.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:47 smithi155 ceph-mon[79928]: pgmap v394: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:47.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:47 smithi119 ceph-mon[90896]: pgmap v394: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:49.682 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:49 smithi119 ceph-mon[90896]: pgmap v395: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:49.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:49 smithi155 ceph-mon[79928]: pgmap v395: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:51.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:51 smithi155 ceph-mon[79928]: pgmap v396: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:51.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:51 smithi119 ceph-mon[90896]: pgmap v396: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:52.633 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:58:52.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:58:53.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:53 smithi155 ceph-mon[79928]: pgmap v397: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:53.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:53 smithi119 ceph-mon[90896]: pgmap v397: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:55.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:55 smithi155 ceph-mon[79928]: pgmap v398: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:55.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:55 smithi119 ceph-mon[90896]: pgmap v398: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:57 smithi155 ceph-mon[79928]: pgmap v399: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:57.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:57 smithi119 ceph-mon[90896]: pgmap v399: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:59.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:58:59 smithi155 ceph-mon[79928]: pgmap v400: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:58:59.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:58:59 smithi119 ceph-mon[90896]: pgmap v400: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:01.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:01 smithi155 ceph-mon[79928]: pgmap v401: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:01.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:01 smithi119 ceph-mon[90896]: pgmap v401: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:03.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:03 smithi155 ceph-mon[79928]: pgmap v402: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:03.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:03 smithi119 ceph-mon[90896]: pgmap v402: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:05 smithi155 ceph-mon[79928]: pgmap v403: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:05.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:05 smithi119 ceph-mon[90896]: pgmap v403: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:07 smithi155 ceph-mon[79928]: pgmap v404: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:59:07.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:07 smithi119 ceph-mon[90896]: pgmap v404: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:07.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:59:09.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:09 smithi155 ceph-mon[79928]: pgmap v405: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:09.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:09 smithi119 ceph-mon[90896]: pgmap v405: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:11.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:11 smithi155 ceph-mon[79928]: pgmap v406: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:11.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:11 smithi119 ceph-mon[90896]: pgmap v406: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:12.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:12 smithi119 ceph-mon[90896]: pgmap v407: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:12.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:12 smithi155 ceph-mon[79928]: pgmap v407: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:15.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:15 smithi119 ceph-mon[90896]: pgmap v408: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:15.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:15 smithi155 ceph-mon[79928]: pgmap v408: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:17.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:17 smithi119 ceph-mon[90896]: pgmap v409: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:17.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:17 smithi155 ceph-mon[79928]: pgmap v409: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:19.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:19 smithi119 ceph-mon[90896]: pgmap v410: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:19.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:19 smithi155 ceph-mon[79928]: pgmap v410: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:21 smithi119 ceph-mon[90896]: pgmap v411: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:21.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:21 smithi155 ceph-mon[79928]: pgmap v411: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:22.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:59:22.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:59:23.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:23 smithi119 ceph-mon[90896]: pgmap v412: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:23.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:23 smithi155 ceph-mon[79928]: pgmap v412: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:25.633 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:25 smithi119 ceph-mon[90896]: pgmap v413: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:25.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:25 smithi155 ceph-mon[79928]: pgmap v413: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:26.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:59:26.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:59:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:59:26.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:59:26.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T21:59:26.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T21:59:26.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T21:59:26.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T21:59:27.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:27 smithi119 ceph-mon[90896]: pgmap v414: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:27.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:27 smithi155 ceph-mon[79928]: pgmap v414: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:29.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:29 smithi119 ceph-mon[90896]: pgmap v415: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:29.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:29 smithi155 ceph-mon[79928]: pgmap v415: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:31.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:31 smithi119 ceph-mon[90896]: pgmap v416: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:31.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:31 smithi155 ceph-mon[79928]: pgmap v416: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:33.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:33 smithi119 ceph-mon[90896]: pgmap v417: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:33.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:33 smithi155 ceph-mon[79928]: pgmap v417: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:35.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:35 smithi119 ceph-mon[90896]: pgmap v418: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:35.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:35 smithi155 ceph-mon[79928]: pgmap v418: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:37 smithi119 ceph-mon[90896]: pgmap v419: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:37.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:59:37.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:37 smithi155 ceph-mon[79928]: pgmap v419: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:59:39.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:39 smithi119 ceph-mon[90896]: pgmap v420: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:39.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:39 smithi155 ceph-mon[79928]: pgmap v420: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:41 smithi155 ceph-mon[79928]: pgmap v421: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:41.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:41 smithi119 ceph-mon[90896]: pgmap v421: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:43 smithi155 ceph-mon[79928]: pgmap v422: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:43.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:43 smithi119 ceph-mon[90896]: pgmap v422: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:45.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:45 smithi155 ceph-mon[79928]: pgmap v423: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:45.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:45 smithi119 ceph-mon[90896]: pgmap v423: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:47.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:47 smithi155 ceph-mon[79928]: pgmap v424: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:47.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:47 smithi119 ceph-mon[90896]: pgmap v424: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:49.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:49 smithi119 ceph-mon[90896]: pgmap v425: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:49.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:49 smithi155 ceph-mon[79928]: pgmap v425: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:51.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:51 smithi119 ceph-mon[90896]: pgmap v426: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:51.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:51 smithi155 ceph-mon[79928]: pgmap v426: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:52.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:59:52.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T21:59:53.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:53 smithi119 ceph-mon[90896]: pgmap v427: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:53.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:53 smithi155 ceph-mon[79928]: pgmap v427: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:55.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:55 smithi119 ceph-mon[90896]: pgmap v428: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:55.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:55 smithi155 ceph-mon[79928]: pgmap v428: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:57.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:57 smithi119 ceph-mon[90896]: pgmap v429: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:57.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:57 smithi155 ceph-mon[79928]: pgmap v429: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:59.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 21:59:59 smithi119 ceph-mon[90896]: pgmap v430: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T21:59:59.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 21:59:59 smithi155 ceph-mon[79928]: pgmap v430: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:00.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:00 smithi119 ceph-mon[90896]: overall HEALTH_OK 2024-09-13T22:00:00.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:00 smithi155 ceph-mon[79928]: overall HEALTH_OK 2024-09-13T22:00:01.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:01 smithi119 ceph-mon[90896]: pgmap v431: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:01.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:01 smithi155 ceph-mon[79928]: pgmap v431: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:03.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:03 smithi119 ceph-mon[90896]: pgmap v432: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:03.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:03 smithi155 ceph-mon[79928]: pgmap v432: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:05.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:05 smithi119 ceph-mon[90896]: pgmap v433: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:05.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:05 smithi155 ceph-mon[79928]: pgmap v433: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:07.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:07 smithi155 ceph-mon[79928]: pgmap v434: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:07.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:07 smithi119 ceph-mon[90896]: pgmap v434: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:08.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:08 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:00:08.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:08 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:00:09.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:09 smithi155 ceph-mon[79928]: pgmap v435: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:09.379 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:09 smithi119 ceph-mon[90896]: pgmap v435: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:11.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:11 smithi119 ceph-mon[90896]: pgmap v436: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:11.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:11 smithi155 ceph-mon[79928]: pgmap v436: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:13.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:13 smithi119 ceph-mon[90896]: pgmap v437: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:13.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:13 smithi155 ceph-mon[79928]: pgmap v437: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:15.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:15 smithi119 ceph-mon[90896]: pgmap v438: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:15.635 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:15 smithi155 ceph-mon[79928]: pgmap v438: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:17.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:17 smithi119 ceph-mon[90896]: pgmap v439: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:17.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:17 smithi155 ceph-mon[79928]: pgmap v439: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:19.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:19 smithi119 ceph-mon[90896]: pgmap v440: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:19 smithi155 ceph-mon[79928]: pgmap v440: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:21.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:21 smithi119 ceph-mon[90896]: pgmap v441: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:21.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:21 smithi155 ceph-mon[79928]: pgmap v441: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:22.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:00:22.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:00:23.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:23 smithi119 ceph-mon[90896]: pgmap v442: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:23.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:23 smithi155 ceph-mon[79928]: pgmap v442: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:25.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:25 smithi119 ceph-mon[90896]: pgmap v443: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:25 smithi155 ceph-mon[79928]: pgmap v443: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:26.749 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:26 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:00:26.834 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:26 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:00:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:27 smithi155 ceph-mon[79928]: pgmap v444: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:00:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:00:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T22:00:27.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:27 smithi119 ceph-mon[90896]: pgmap v444: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:27.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:00:27.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:00:27.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T22:00:29.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:29 smithi155 ceph-mon[79928]: pgmap v445: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:29.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:29 smithi119 ceph-mon[90896]: pgmap v445: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:31.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:31 smithi155 ceph-mon[79928]: pgmap v446: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:31.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:31 smithi119 ceph-mon[90896]: pgmap v446: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:33.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:33 smithi155 ceph-mon[79928]: pgmap v447: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:33.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:33 smithi119 ceph-mon[90896]: pgmap v447: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:35.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:35 smithi155 ceph-mon[79928]: pgmap v448: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:35.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:35 smithi119 ceph-mon[90896]: pgmap v448: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:37 smithi155 ceph-mon[79928]: pgmap v449: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:00:37.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:37 smithi119 ceph-mon[90896]: pgmap v449: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:37.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:00:39.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:39 smithi155 ceph-mon[79928]: pgmap v450: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:39.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:39 smithi119 ceph-mon[90896]: pgmap v450: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:41 smithi155 ceph-mon[79928]: pgmap v451: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:41.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:41 smithi119 ceph-mon[90896]: pgmap v451: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:43 smithi155 ceph-mon[79928]: pgmap v452: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:43.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:43 smithi119 ceph-mon[90896]: pgmap v452: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:45.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:45 smithi155 ceph-mon[79928]: pgmap v453: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:45.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:45 smithi119 ceph-mon[90896]: pgmap v453: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:47.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:47 smithi155 ceph-mon[79928]: pgmap v454: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:47.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:47 smithi119 ceph-mon[90896]: pgmap v454: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:49.682 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:49 smithi119 ceph-mon[90896]: pgmap v455: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:49.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:49 smithi155 ceph-mon[79928]: pgmap v455: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:51.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:51 smithi155 ceph-mon[79928]: pgmap v456: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:51.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:51 smithi119 ceph-mon[90896]: pgmap v456: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:52.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:52 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:00:52.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:52 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:00:53.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:53 smithi155 ceph-mon[79928]: pgmap v457: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:53.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:53 smithi119 ceph-mon[90896]: pgmap v457: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:55.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:55 smithi155 ceph-mon[79928]: pgmap v458: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:55.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:55 smithi119 ceph-mon[90896]: pgmap v458: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:57.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:57 smithi155 ceph-mon[79928]: pgmap v459: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:57.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:57 smithi119 ceph-mon[90896]: pgmap v459: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:59.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:00:59 smithi155 ceph-mon[79928]: pgmap v460: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:00:59.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:00:59 smithi119 ceph-mon[90896]: pgmap v460: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:01.706 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:01 smithi119 ceph-mon[90896]: pgmap v461: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:01.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:01 smithi155 ceph-mon[79928]: pgmap v461: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:03.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:03 smithi155 ceph-mon[79928]: pgmap v462: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:03.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:03 smithi119 ceph-mon[90896]: pgmap v462: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:05.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:05 smithi155 ceph-mon[79928]: pgmap v463: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:05.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:05 smithi119 ceph-mon[90896]: pgmap v463: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:07 smithi155 ceph-mon[79928]: pgmap v464: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:07.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:07 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:07.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:07 smithi119 ceph-mon[90896]: pgmap v464: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:07.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:07 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:09.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:09 smithi155 ceph-mon[79928]: pgmap v465: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:09.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:09 smithi119 ceph-mon[90896]: pgmap v465: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:11.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:11 smithi155 ceph-mon[79928]: pgmap v466: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:11.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:11 smithi119 ceph-mon[90896]: pgmap v466: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:13.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:13 smithi155 ceph-mon[79928]: pgmap v467: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:13.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:13 smithi119 ceph-mon[90896]: pgmap v467: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:15.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:15 smithi155 ceph-mon[79928]: pgmap v468: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:15.881 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:15 smithi119 ceph-mon[90896]: pgmap v468: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:17.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:17 smithi155 ceph-mon[79928]: pgmap v469: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:17.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:17 smithi119 ceph-mon[90896]: pgmap v469: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:19.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:19 smithi155 ceph-mon[79928]: pgmap v470: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:19.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:19 smithi119 ceph-mon[90896]: pgmap v470: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:21.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:21 smithi155 ceph-mon[79928]: pgmap v471: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:21.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:21 smithi119 ceph-mon[90896]: pgmap v471: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:22.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:22 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:22.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:22 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:23.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:23 smithi155 ceph-mon[79928]: pgmap v472: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:23.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:23 smithi119 ceph-mon[90896]: pgmap v472: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:25.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:25 smithi155 ceph-mon[79928]: pgmap v473: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:25.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:25 smithi119 ceph-mon[90896]: pgmap v473: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:26.749 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:26 smithi119 ceph-mon[90896]: pgmap v474: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:26.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:26 smithi155 ceph-mon[79928]: pgmap v474: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:01:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:01:27.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:27 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T22:01:27.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:01:27.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:01:27.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:01:27.880 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:27 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' 2024-09-13T22:01:28.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:28 smithi155 ceph-mon[79928]: pgmap v475: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:28.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:28 smithi119 ceph-mon[90896]: pgmap v475: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:31.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:31 smithi119 ceph-mon[90896]: pgmap v476: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:31.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:31 smithi155 ceph-mon[79928]: pgmap v476: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:33.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:33 smithi119 ceph-mon[90896]: pgmap v477: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:33.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:33 smithi155 ceph-mon[79928]: pgmap v477: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:35.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:35 smithi119 ceph-mon[90896]: pgmap v478: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:35.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:35 smithi155 ceph-mon[79928]: pgmap v478: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:37.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:37 smithi119 ceph-mon[90896]: pgmap v479: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:37.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:37 smithi119 ceph-mon[90896]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:37.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:37 smithi155 ceph-mon[79928]: pgmap v479: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:37.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:37 smithi155 ceph-mon[79928]: from='mgr.34104 172.21.15.119:0/3694491640' entity='mgr.smithi119.gwjxmq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:01:39.832 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:39 smithi155 ceph-mon[79928]: pgmap v480: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:39.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:39 smithi119 ceph-mon[90896]: pgmap v480: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:41.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:41 smithi155 ceph-mon[79928]: pgmap v481: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:41.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:41 smithi119 ceph-mon[90896]: pgmap v481: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:43.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:43 smithi155 ceph-mon[79928]: pgmap v482: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:43.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:43 smithi119 ceph-mon[90896]: pgmap v482: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:45.833 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:45 smithi155 ceph-mon[79928]: pgmap v483: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:45.879 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:45 smithi119 ceph-mon[90896]: pgmap v483: 65 pgs: 65 active+clean; 140 MiB data, 659 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:01:46.092 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-13T22:01:46.093 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T22:01:46.095 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T22:01:46.109 INFO:tasks.cephadm:Teardown begin 2024-09-13T22:01:46.109 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T22:01:46.110 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:01:46.145 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:01:46.180 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T22:01:46.180 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T22:01:46.204 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T22:01:46.237 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T22:01:46.240 INFO:tasks.cephadm.mon.smithi119:Stopping mon.smithi119... 2024-09-13T22:01:46.240 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi119 2024-09-13T22:01:46.527 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:46 smithi119 systemd[1]: Stopping Ceph mon.smithi119 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T22:01:46.854 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:46 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119[90892]: 2024-09-13T22:01:46.526+0000 7f027bc46640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi119 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:01:46.854 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:46 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119[90892]: 2024-09-13T22:01:46.526+0000 7f027bc46640 -1 mon.smithi119@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T22:01:46.854 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:46 smithi119 podman[137047]: 2024-09-13 22:01:46.761272712 +0000 UTC m=+0.329316842 container died a7778435eff6df31ca6db10d7c2ccd2e380dcaa08fa6a5a2f0ffd0181d194531 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:01:47.512 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:47 smithi119 podman[137047]: 2024-09-13 22:01:47.243378023 +0000 UTC m=+0.811422198 container cleanup a7778435eff6df31ca6db10d7c2ccd2e380dcaa08fa6a5a2f0ffd0181d194531 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0) 2024-09-13T22:01:47.512 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Sep 13 22:01:47 smithi119 bash[137047]: ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi119 2024-09-13T22:01:47.672 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi119.service' 2024-09-13T22:01:47.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:01:47.722 INFO:tasks.cephadm.mon.smithi119:Stopped mon.smithi119 2024-09-13T22:01:47.723 INFO:tasks.cephadm.mon.smithi155:Stopping mon.smithi155... 2024-09-13T22:01:47.723 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi155 2024-09-13T22:01:48.037 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:47 smithi155 systemd[1]: Stopping Ceph mon.smithi155 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T22:01:48.332 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155[79924]: 2024-09-13T22:01:48.035+0000 7fbbf36b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi155 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:01:48.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:48 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155[79924]: 2024-09-13T22:01:48.035+0000 7fbbf36b6640 -1 mon.smithi155@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T22:01:48.333 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:48 smithi155 podman[111969]: 2024-09-13 22:01:48.056756308 +0000 UTC m=+0.140860825 container died 4616d5306e8c542bda81f3329a1ecb9d50a90709dabe073ef3be6cfaa6f3a260 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731) 2024-09-13T22:01:48.762 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:48 smithi155 podman[111969]: 2024-09-13 22:01:48.552965978 +0000 UTC m=+0.637070538 container cleanup 4616d5306e8c542bda81f3329a1ecb9d50a90709dabe073ef3be6cfaa6f3a260 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T22:01:48.762 INFO:journalctl@ceph.mon.smithi155.smithi155.stdout:Sep 13 22:01:48 smithi155 bash[111969]: ceph-f9722044-7217-11ef-bceb-c7b262605968-mon-smithi155 2024-09-13T22:01:48.970 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@mon.smithi155.service' 2024-09-13T22:01:49.019 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:01:49.020 INFO:tasks.cephadm.mon.smithi155:Stopped mon.smithi155 2024-09-13T22:01:49.020 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T22:01:49.020 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.0 2024-09-13T22:01:49.379 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:49 smithi119 systemd[1]: Stopping Ceph osd.0 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T22:01:49.879 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:49 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0[99182]: 2024-09-13T22:01:49.414+0000 7f4edadb3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:01:49.880 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:49 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0[99182]: 2024-09-13T22:01:49.414+0000 7f4edadb3640 -1 osd.0 81 *** Got signal Terminated *** 2024-09-13T22:01:49.880 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:49 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0[99182]: 2024-09-13T22:01:49.414+0000 7f4edadb3640 -1 osd.0 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:01:55.209 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:54 smithi119 podman[137181]: 2024-09-13 22:01:54.927080616 +0000 UTC m=+5.709544091 container died dd1b263d2276f9c552f6938aab624f1c58d2cedaef024d7c0824038eb73449a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T22:01:55.600 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:55 smithi119 podman[137181]: 2024-09-13 22:01:55.297992268 +0000 UTC m=+6.080455751 container cleanup dd1b263d2276f9c552f6938aab624f1c58d2cedaef024d7c0824038eb73449a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T22:01:55.600 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:55 smithi119 bash[137181]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0 2024-09-13T22:01:55.879 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:55 smithi119 podman[137209]: 2024-09-13 22:01:55.599444563 +0000 UTC m=+0.668913621 container remove dd1b263d2276f9c552f6938aab624f1c58d2cedaef024d7c0824038eb73449a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T22:01:56.212 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:55 smithi119 podman[137297]: 2024-09-13 22:01:55.823138223 +0000 UTC m=+0.015859390 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:01:56.212 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:55 smithi119 podman[137297]: 2024-09-13 22:01:55.950462914 +0000 UTC m=+0.143184066 container create 3ce112901b08c7e04a6ce717aa3082ab11ea97aa6ff292eacec3cdd9c30024f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T22:01:56.212 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:56 smithi119 podman[137297]: 2024-09-13 22:01:56.211278347 +0000 UTC m=+0.403999498 container init 3ce112901b08c7e04a6ce717aa3082ab11ea97aa6ff292eacec3cdd9c30024f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T22:01:56.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:56 smithi119 podman[137297]: 2024-09-13 22:01:56.21492326 +0000 UTC m=+0.407644419 container start 3ce112901b08c7e04a6ce717aa3082ab11ea97aa6ff292eacec3cdd9c30024f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-13T22:01:56.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:56 smithi119 podman[137297]: 2024-09-13 22:01:56.303091982 +0000 UTC m=+0.495813136 container attach 3ce112901b08c7e04a6ce717aa3082ab11ea97aa6ff292eacec3cdd9c30024f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T22:01:56.630 INFO:journalctl@ceph.osd.0.smithi119.stdout:Sep 13 22:01:56 smithi119 podman[137297]: 2024-09-13 22:01:56.40308238 +0000 UTC m=+0.595803548 container died 3ce112901b08c7e04a6ce717aa3082ab11ea97aa6ff292eacec3cdd9c30024f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T22:01:57.042 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T22:01:57.082 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:01:57.082 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T22:01:57.082 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T22:01:57.083 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.1 2024-09-13T22:01:57.379 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:01:57 smithi119 systemd[1]: Stopping Ceph osd.1 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T22:01:57.880 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:01:57 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[104948]: 2024-09-13T22:01:57.427+0000 7f5327f65640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:01:57.880 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:01:57 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[104948]: 2024-09-13T22:01:57.427+0000 7f5327f65640 -1 osd.1 81 *** Got signal Terminated *** 2024-09-13T22:01:57.880 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:01:57 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1[104948]: 2024-09-13T22:01:57.427+0000 7f5327f65640 -1 osd.1 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:02:03.129 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:02:02 smithi119 podman[137399]: 2024-09-13 22:02:02.833004319 +0000 UTC m=+5.537432320 container died 8f69bf25cd20fe1d37dd684e4c46d022f094cecd9e085c7ac3c783dc555fad2a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be) 2024-09-13T22:02:03.379 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:02:03 smithi119 podman[137399]: 2024-09-13 22:02:03.235369738 +0000 UTC m=+5.939797748 container cleanup 8f69bf25cd20fe1d37dd684e4c46d022f094cecd9e085c7ac3c783dc555fad2a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-ecab7be, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-13T22:02:03.379 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:02:03 smithi119 bash[137399]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1 2024-09-13T22:02:03.804 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:02:03 smithi119 podman[137416]: 2024-09-13 22:02:03.486930947 +0000 UTC m=+0.648066415 container remove 8f69bf25cd20fe1d37dd684e4c46d022f094cecd9e085c7ac3c783dc555fad2a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T22:02:04.124 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:02:03 smithi119 podman[137506]: 2024-09-13 22:02:03.804399806 +0000 UTC m=+0.111189537 container create ccecc329b3d021afd4c8d6126eb0331c0ba9614c8f91796f302925ae4e7e4313 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T22:02:04.124 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:02:03 smithi119 podman[137506]: 2024-09-13 22:02:03.709032206 +0000 UTC m=+0.015821953 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:02:04.124 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:02:04 smithi119 podman[137506]: 2024-09-13 22:02:04.040229624 +0000 UTC m=+0.347019356 container init ccecc329b3d021afd4c8d6126eb0331c0ba9614c8f91796f302925ae4e7e4313 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T22:02:04.124 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:02:04 smithi119 podman[137506]: 2024-09-13 22:02:04.043479171 +0000 UTC m=+0.350268913 container start ccecc329b3d021afd4c8d6126eb0331c0ba9614c8f91796f302925ae4e7e4313 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T22:02:04.124 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:02:04 smithi119 podman[137506]: 2024-09-13 22:02:04.123397241 +0000 UTC m=+0.430186977 container attach ccecc329b3d021afd4c8d6126eb0331c0ba9614c8f91796f302925ae4e7e4313 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:02:04.380 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 13 22:02:04 smithi119 podman[137506]: 2024-09-13 22:02:04.234867029 +0000 UTC m=+0.541656769 container died ccecc329b3d021afd4c8d6126eb0331c0ba9614c8f91796f302925ae4e7e4313 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:02:04.879 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T22:02:04.919 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:02:04.919 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T22:02:04.919 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T22:02:04.920 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.2 2024-09-13T22:02:05.129 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:05 smithi119 systemd[1]: Stopping Ceph osd.2 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T22:02:05.629 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:05 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2[110584]: 2024-09-13T22:02:05.246+0000 7fcc2eef9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:02:05.629 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:05 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2[110584]: 2024-09-13T22:02:05.246+0000 7fcc2eef9640 -1 osd.2 81 *** Got signal Terminated *** 2024-09-13T22:02:05.629 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:05 smithi119 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2[110584]: 2024-09-13T22:02:05.246+0000 7fcc2eef9640 -1 osd.2 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:02:10.840 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:10 smithi119 podman[137608]: 2024-09-13 22:02:10.58834509 +0000 UTC m=+5.449174146 container died 0f73e4fc2c43b92d0eded917e3be8634ffec9eea02dcd2f9ed9ec566319302af (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0) 2024-09-13T22:02:11.098 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:10 smithi119 podman[137608]: 2024-09-13 22:02:10.930255316 +0000 UTC m=+5.791084372 container cleanup 0f73e4fc2c43b92d0eded917e3be8634ffec9eea02dcd2f9ed9ec566319302af (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS) 2024-09-13T22:02:11.099 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:10 smithi119 bash[137608]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2 2024-09-13T22:02:11.379 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:11 smithi119 podman[137623]: 2024-09-13 22:02:11.098114631 +0000 UTC m=+0.507591620 container remove 0f73e4fc2c43b92d0eded917e3be8634ffec9eea02dcd2f9ed9ec566319302af (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T22:02:11.810 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:11 smithi119 podman[137714]: 2024-09-13 22:02:11.440753977 +0000 UTC m=+0.015697772 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:02:11.811 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:11 smithi119 podman[137714]: 2024-09-13 22:02:11.557382983 +0000 UTC m=+0.132326777 container create 4e9616f5cfae3944d57ebcaa3ac247440170664f5722305ef1ae6700905ce7d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be) 2024-09-13T22:02:11.811 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:11 smithi119 podman[137714]: 2024-09-13 22:02:11.810192917 +0000 UTC m=+0.385136702 container init 4e9616f5cfae3944d57ebcaa3ac247440170664f5722305ef1ae6700905ce7d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:02:12.130 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:11 smithi119 podman[137714]: 2024-09-13 22:02:11.813604901 +0000 UTC m=+0.388548694 container start 4e9616f5cfae3944d57ebcaa3ac247440170664f5722305ef1ae6700905ce7d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:02:12.130 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:11 smithi119 podman[137714]: 2024-09-13 22:02:11.893302067 +0000 UTC m=+0.468245864 container attach 4e9616f5cfae3944d57ebcaa3ac247440170664f5722305ef1ae6700905ce7d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, ceph=True) 2024-09-13T22:02:12.130 INFO:journalctl@ceph.osd.2.smithi119.stdout:Sep 13 22:02:12 smithi119 podman[137714]: 2024-09-13 22:02:12.003304423 +0000 UTC m=+0.578248213 container died 4e9616f5cfae3944d57ebcaa3ac247440170664f5722305ef1ae6700905ce7d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T22:02:12.642 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T22:02:12.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:02:12.680 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T22:02:12.680 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T22:02:12.680 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.3 2024-09-13T22:02:13.071 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:12 smithi155 systemd[1]: Stopping Ceph osd.3 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T22:02:13.332 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:13 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[89181]: 2024-09-13T22:02:13.070+0000 7faf34bd8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:02:13.333 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:13 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[89181]: 2024-09-13T22:02:13.070+0000 7faf34bd8640 -1 osd.3 81 *** Got signal Terminated *** 2024-09-13T22:02:13.333 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:13 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[89181]: 2024-09-13T22:02:13.070+0000 7faf34bd8640 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:02:17.583 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:17 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3[89181]: 2024-09-13T22:02:17.110+0000 7faf311dd640 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.336464+0000 front 2024-09-13T22:01:52.336548+0000 (oldest deadline 2024-09-13T22:02:17.036500+0000) 2024-09-13T22:02:17.850 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:17 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:17.743+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:18.332 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:17 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:17.906+0000 7ff68c8f3640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:51.608274+0000 front 2024-09-13T22:01:51.608350+0000 (oldest deadline 2024-09-13T22:02:17.508464+0000) 2024-09-13T22:02:18.709 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:18 smithi155 podman[112094]: 2024-09-13 22:02:18.450328785 +0000 UTC m=+5.575642313 container died 5a7f5a9c1c4de5818459a1c47958c9d76593c0dbeba95e3e78c348d71466e813 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-ecab7be, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-13T22:02:19.083 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:18 smithi155 podman[112094]: 2024-09-13 22:02:18.803306065 +0000 UTC m=+5.928619601 container cleanup 5a7f5a9c1c4de5818459a1c47958c9d76593c0dbeba95e3e78c348d71466e813 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T22:02:19.083 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:18 smithi155 bash[112094]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3 2024-09-13T22:02:19.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:18 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:18.947+0000 7ff68c8f3640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:51.608274+0000 front 2024-09-13T22:01:51.608350+0000 (oldest deadline 2024-09-13T22:02:17.508464+0000) 2024-09-13T22:02:19.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:18 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:18.707+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:19.460 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:19 smithi155 podman[112122]: 2024-09-13 22:02:19.105330436 +0000 UTC m=+0.657258149 container remove 5a7f5a9c1c4de5818459a1c47958c9d76593c0dbeba95e3e78c348d71466e813 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-ecab7be, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:02:19.713 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:19 smithi155 podman[112213]: 2024-09-13 22:02:19.361757603 +0000 UTC m=+0.016110893 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:02:19.714 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:19 smithi155 podman[112213]: 2024-09-13 22:02:19.46377293 +0000 UTC m=+0.118126218 container create c1cfb493d9f74b4257e753ae102e230a465c31f4922e8b8e482ed6b17da13821 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, ceph=True, io.buildah.version=1.37.2) 2024-09-13T22:02:19.714 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:19 smithi155 podman[112213]: 2024-09-13 22:02:19.69984471 +0000 UTC m=+0.354197991 container init c1cfb493d9f74b4257e753ae102e230a465c31f4922e8b8e482ed6b17da13821 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-13T22:02:19.714 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:19 smithi155 podman[112213]: 2024-09-13 22:02:19.703147417 +0000 UTC m=+0.357500701 container start c1cfb493d9f74b4257e753ae102e230a465c31f4922e8b8e482ed6b17da13821 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0) 2024-09-13T22:02:19.969 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:19 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:19.712+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:19.969 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:19 smithi155 podman[112213]: 2024-09-13 22:02:19.816547218 +0000 UTC m=+0.470900512 container attach c1cfb493d9f74b4257e753ae102e230a465c31f4922e8b8e482ed6b17da13821 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-ecab7be) 2024-09-13T22:02:19.969 INFO:journalctl@ceph.osd.3.smithi155.stdout:Sep 13 22:02:19 smithi155 podman[112213]: 2024-09-13 22:02:19.891182438 +0000 UTC m=+0.545535722 container died c1cfb493d9f74b4257e753ae102e230a465c31f4922e8b8e482ed6b17da13821 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:02:20.333 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:19 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:19.967+0000 7ff68c8f3640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:51.608274+0000 front 2024-09-13T22:01:51.608350+0000 (oldest deadline 2024-09-13T22:02:17.508464+0000) 2024-09-13T22:02:20.508 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T22:02:20.551 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:02:20.551 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T22:02:20.552 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T22:02:20.552 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.4 2024-09-13T22:02:20.833 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:20 smithi155 systemd[1]: Stopping Ceph osd.4 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T22:02:20.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:20 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:20.696+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:21.333 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:20 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:20.874+0000 7ff6942f6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:02:21.333 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:20 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:20.874+0000 7ff6942f6640 -1 osd.4 81 *** Got signal Terminated *** 2024-09-13T22:02:21.333 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:20 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:20.874+0000 7ff6942f6640 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:02:21.333 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:21 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:21.016+0000 7ff68c8f3640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:51.608274+0000 front 2024-09-13T22:01:51.608350+0000 (oldest deadline 2024-09-13T22:02:17.508464+0000) 2024-09-13T22:02:22.016 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:21 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:21.728+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:22.332 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:22 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:22.015+0000 7ff68c8f3640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:51.608274+0000 front 2024-09-13T22:01:51.608350+0000 (oldest deadline 2024-09-13T22:02:17.508464+0000) 2024-09-13T22:02:23.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:22 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:22.995+0000 7ff68c8f3640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:51.608274+0000 front 2024-09-13T22:01:51.608350+0000 (oldest deadline 2024-09-13T22:02:17.508464+0000) 2024-09-13T22:02:23.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:22 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:22.768+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:24.039 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:23 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:23.719+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:24.332 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:24 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:24.038+0000 7ff68c8f3640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:51.608274+0000 front 2024-09-13T22:01:51.608350+0000 (oldest deadline 2024-09-13T22:02:17.508464+0000) 2024-09-13T22:02:24.992 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:24 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:24.676+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:25.333 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:24 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:24.992+0000 7ff68c8f3640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:51.608274+0000 front 2024-09-13T22:01:51.608350+0000 (oldest deadline 2024-09-13T22:02:17.508464+0000) 2024-09-13T22:02:25.333 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:24 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4[94021]: 2024-09-13T22:02:24.992+0000 7ff68c8f3640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.119:6814 osd.1 since back 2024-09-13T22:02:01.009487+0000 front 2024-09-13T22:02:01.009396+0000 (oldest deadline 2024-09-13T22:02:24.509319+0000) 2024-09-13T22:02:26.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:25 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:25.702+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:26.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:25 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:25.702+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6814 osd.1 since back 2024-09-13T22:02:01.583876+0000 front 2024-09-13T22:02:01.583896+0000 (oldest deadline 2024-09-13T22:02:25.083752+0000) 2024-09-13T22:02:26.666 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:26 smithi155 podman[112318]: 2024-09-13 22:02:26.391541065 +0000 UTC m=+5.616011200 container died 03c992670291bbcd29226073528e2617332ba802f9ea8aa91a37b43a829af2ef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0) 2024-09-13T22:02:27.070 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:26 smithi155 podman[112318]: 2024-09-13 22:02:26.781583561 +0000 UTC m=+6.006053695 container cleanup 03c992670291bbcd29226073528e2617332ba802f9ea8aa91a37b43a829af2ef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T22:02:27.070 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:26 smithi155 bash[112318]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4 2024-09-13T22:02:27.071 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:26 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:26.667+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:27.071 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:26 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:26.667+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6814 osd.1 since back 2024-09-13T22:02:01.583876+0000 front 2024-09-13T22:02:01.583896+0000 (oldest deadline 2024-09-13T22:02:25.083752+0000) 2024-09-13T22:02:27.332 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:27 smithi155 podman[112333]: 2024-09-13 22:02:27.07001752 +0000 UTC m=+0.672146239 container remove 03c992670291bbcd29226073528e2617332ba802f9ea8aa91a37b43a829af2ef (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:02:27.667 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:27 smithi155 podman[112425]: 2024-09-13 22:02:27.309017108 +0000 UTC m=+0.015922045 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:02:27.668 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:27 smithi155 podman[112425]: 2024-09-13 22:02:27.44193485 +0000 UTC m=+0.148839819 container create a7c8b933910ce4099c0dd921df76fcea076f63765030503e09c4ab5627254c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T22:02:28.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:27 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:27.666+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:28.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:27 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:27.666+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6814 osd.1 since back 2024-09-13T22:02:01.583876+0000 front 2024-09-13T22:02:01.583896+0000 (oldest deadline 2024-09-13T22:02:25.083752+0000) 2024-09-13T22:02:28.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:27 smithi155 podman[112425]: 2024-09-13 22:02:27.689608583 +0000 UTC m=+0.396513519 container init a7c8b933910ce4099c0dd921df76fcea076f63765030503e09c4ab5627254c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T22:02:28.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:27 smithi155 podman[112425]: 2024-09-13 22:02:27.692977081 +0000 UTC m=+0.399882008 container start a7c8b933910ce4099c0dd921df76fcea076f63765030503e09c4ab5627254c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T22:02:28.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:27 smithi155 podman[112425]: 2024-09-13 22:02:27.769131337 +0000 UTC m=+0.476036270 container attach a7c8b933910ce4099c0dd921df76fcea076f63765030503e09c4ab5627254c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0) 2024-09-13T22:02:28.083 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 13 22:02:27 smithi155 podman[112425]: 2024-09-13 22:02:27.881925558 +0000 UTC m=+0.588830484 container died a7c8b933910ce4099c0dd921df76fcea076f63765030503e09c4ab5627254c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:02:28.555 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T22:02:28.596 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:02:28.596 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T22:02:28.596 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T22:02:28.597 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.5 2024-09-13T22:02:28.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:28 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:28.673+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:28.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:28 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:28.673+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6814 osd.1 since back 2024-09-13T22:02:01.583876+0000 front 2024-09-13T22:02:01.583896+0000 (oldest deadline 2024-09-13T22:02:25.083752+0000) 2024-09-13T22:02:28.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:28 smithi155 systemd[1]: Stopping Ceph osd.5 for f9722044-7217-11ef-bceb-c7b262605968... 2024-09-13T22:02:29.333 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:28 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:28.925+0000 7eff0bcd4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:02:29.333 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:28 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:28.925+0000 7eff0bcd4640 -1 osd.5 81 *** Got signal Terminated *** 2024-09-13T22:02:29.333 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:28 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:28.925+0000 7eff0bcd4640 -1 osd.5 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T22:02:30.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:29 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:29.702+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:30.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:29 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:29.702+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6814 osd.1 since back 2024-09-13T22:02:01.583876+0000 front 2024-09-13T22:02:01.583896+0000 (oldest deadline 2024-09-13T22:02:25.083752+0000) 2024-09-13T22:02:30.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:30 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:30.729+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:30.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:30 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:30.729+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6814 osd.1 since back 2024-09-13T22:02:01.583876+0000 front 2024-09-13T22:02:01.583896+0000 (oldest deadline 2024-09-13T22:02:25.083752+0000) 2024-09-13T22:02:32.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:31 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:31.716+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:32.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:31 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:31.716+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6814 osd.1 since back 2024-09-13T22:02:01.583876+0000 front 2024-09-13T22:02:01.583896+0000 (oldest deadline 2024-09-13T22:02:25.083752+0000) 2024-09-13T22:02:33.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:32 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:32.692+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:33.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:32 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:32.692+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6814 osd.1 since back 2024-09-13T22:02:01.583876+0000 front 2024-09-13T22:02:01.583896+0000 (oldest deadline 2024-09-13T22:02:25.083752+0000) 2024-09-13T22:02:33.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:32 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:32.692+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6822 osd.2 since back 2024-09-13T22:02:07.984651+0000 front 2024-09-13T22:02:07.984636+0000 (oldest deadline 2024-09-13T22:02:32.084490+0000) 2024-09-13T22:02:34.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:33 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:33.661+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6806 osd.0 since back 2024-09-13T22:01:52.382628+0000 front 2024-09-13T22:01:52.382641+0000 (oldest deadline 2024-09-13T22:02:17.082330+0000) 2024-09-13T22:02:34.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:33 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:33.661+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6814 osd.1 since back 2024-09-13T22:02:01.583876+0000 front 2024-09-13T22:02:01.583896+0000 (oldest deadline 2024-09-13T22:02:25.083752+0000) 2024-09-13T22:02:34.083 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:33 smithi155 ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5[99043]: 2024-09-13T22:02:33.661+0000 7eff082d9640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.119:6822 osd.2 since back 2024-09-13T22:02:07.984651+0000 front 2024-09-13T22:02:07.984636+0000 (oldest deadline 2024-09-13T22:02:32.084490+0000) 2024-09-13T22:02:34.552 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:34 smithi155 podman[112528]: 2024-09-13 22:02:34.284340591 +0000 UTC m=+5.466536029 container died bf54ed40f20f09eb7c5302894ac692ab91fb32f625cf362c5772da2ac65942c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:02:34.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:34 smithi155 podman[112528]: 2024-09-13 22:02:34.658370985 +0000 UTC m=+5.840566419 container cleanup bf54ed40f20f09eb7c5302894ac692ab91fb32f625cf362c5772da2ac65942c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T22:02:34.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:34 smithi155 bash[112528]: ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5 2024-09-13T22:02:35.260 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:34 smithi155 podman[112542]: 2024-09-13 22:02:34.951257194 +0000 UTC m=+0.660495964 container remove bf54ed40f20f09eb7c5302894ac692ab91fb32f625cf362c5772da2ac65942c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:02:35.563 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:35 smithi155 podman[112628]: 2024-09-13 22:02:35.260305185 +0000 UTC m=+0.103754676 container create df8ee88ad2ff4c61705617fee0051ebc7ed84a686d45b1530716d7560320a097 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T22:02:35.563 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:35 smithi155 podman[112628]: 2024-09-13 22:02:35.172734555 +0000 UTC m=+0.016184003 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:02:35.563 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:35 smithi155 podman[112628]: 2024-09-13 22:02:35.48749433 +0000 UTC m=+0.330943772 container init df8ee88ad2ff4c61705617fee0051ebc7ed84a686d45b1530716d7560320a097 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-09-13T22:02:35.563 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:35 smithi155 podman[112628]: 2024-09-13 22:02:35.490827257 +0000 UTC m=+0.334276703 container start df8ee88ad2ff4c61705617fee0051ebc7ed84a686d45b1530716d7560320a097 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T22:02:35.563 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:35 smithi155 podman[112628]: 2024-09-13 22:02:35.562424467 +0000 UTC m=+0.405873916 container attach df8ee88ad2ff4c61705617fee0051ebc7ed84a686d45b1530716d7560320a097 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T22:02:35.833 INFO:journalctl@ceph.osd.5.smithi155.stdout:Sep 13 22:02:35 smithi155 podman[112628]: 2024-09-13 22:02:35.679672897 +0000 UTC m=+0.523122330 container died df8ee88ad2ff4c61705617fee0051ebc7ed84a686d45b1530716d7560320a097 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-f9722044-7217-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-13T22:02:36.273 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9722044-7217-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T22:02:36.314 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T22:02:36.315 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T22:02:36.315 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9722044-7217-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T22:02:39.625 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[74127]: fuse finished with error 0 and tester_r 0 2024-09-13T22:02:58.080 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9722044-7217-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T22:03:13.510 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:03:13.544 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:03:13.572 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T22:03:13.574 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904198/remote/smithi119/crash 2024-09-13T22:03:13.574 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/crash -- . 2024-09-13T22:03:13.612 INFO:teuthology.orchestra.run.smithi119.stderr:tar: /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T22:03:13.612 INFO:teuthology.orchestra.run.smithi119.stderr:tar: Error is not recoverable: exiting now 2024-09-13T22:03:13.614 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904198/remote/smithi155/crash 2024-09-13T22:03:13.615 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/crash -- . 2024-09-13T22:03:13.638 INFO:teuthology.orchestra.run.smithi155.stderr:tar: /var/lib/ceph/f9722044-7217-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T22:03:13.639 INFO:teuthology.orchestra.run.smithi155.stderr:tar: Error is not recoverable: exiting now 2024-09-13T22:03:13.639 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T22:03:13.640 DEBUG:teuthology.orchestra.run.smithi119:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T22:03:13.689 INFO:teuthology.orchestra.run.smithi119.stdout:2024-09-13T21:50:00.000227+0000 mon.smithi119 (mon.0) 403 : cluster [WRN] pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-13T22:03:13.690 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-13T22:03:13.690 INFO:tasks.cephadm:Compressing logs... 2024-09-13T22:03:13.691 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T22:03:13.733 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T22:03:13.757 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-13T22:03:13.757 INFO:teuthology.orchestra.run.smithi119.stderr:: No such file or directory 2024-09-13T22:03:13.757 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi119.gwjxmq.log 2024-09-13T22:03:13.761 INFO:teuthology.orchestra.run.smithi155.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi155.yblkxo.log 2024-09-13T22:03:13.761 INFO:teuthology.orchestra.run.smithi155.stderr:: No such file or directory 2024-09-13T22:03:13.761 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T22:03:13.761 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-13T22:03:13.761 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi155.yblkxo.log: /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T22:03:13.761 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi155.wuuxfd.log 2024-09-13T22:03:13.761 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T22:03:13.761 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi155.wuuxfd.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-13T22:03:13.762 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi119.yydzwt.log 2024-09-13T22:03:13.762 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi119.gwjxmq.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-13T22:03:13.763 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi119.yydzwt.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T22:03:13.763 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T22:03:13.763 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.1.log: /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T22:03:13.763 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi119.rpmijj.log 2024-09-13T22:03:13.763 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.cephadm.log: /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi119.rpmijj.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-13T22:03:13.763 INFO:teuthology.orchestra.run.smithi119.stderr: 86.3% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T22:03:13.764 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.log 2024-09-13T22:03:13.764 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.5.log: /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.log: 85.2% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T22:03:13.764 INFO:teuthology.orchestra.run.smithi155.stderr: 91.4% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T22:03:13.764 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T22:03:13.764 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi155.afmavb.log 2024-09-13T22:03:13.764 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mon.smithi155.log 2024-09-13T22:03:13.764 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi155.afmavb.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-13T22:03:13.766 INFO:teuthology.orchestra.run.smithi119.stderr: 91.2% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T22:03:13.766 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.log 2024-09-13T22:03:13.766 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mon.smithi119.log 2024-09-13T22:03:13.767 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mon.smithi155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-13T22:03:13.769 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.log: 88.1% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T22:03:13.769 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-13T22:03:13.780 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T22:03:13.780 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.log: 91.1% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T22:03:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mon.smithi119.log: 91.0% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T22:03:13.781 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T22:03:13.782 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T22:03:13.826 INFO:teuthology.orchestra.run.smithi155.stderr: 89.8% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi155.wuuxfd.log.gz 2024-09-13T22:03:13.861 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T22:03:14.134 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mgr.smithi119.gwjxmq.log.gz 2024-09-13T22:03:14.213 INFO:teuthology.orchestra.run.smithi155.stderr: 92.5% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mon.smithi155.log.gz 2024-09-13T22:03:14.980 INFO:teuthology.orchestra.run.smithi119.stderr: 90.5% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mon.smithi119.log.gz 2024-09-13T22:03:17.420 INFO:teuthology.orchestra.run.smithi155.stderr: 95.3% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi155.afmavb.log.gz 2024-09-13T22:03:19.075 INFO:teuthology.orchestra.run.smithi119.stderr: 93.4% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-13T22:03:19.339 INFO:teuthology.orchestra.run.smithi119.stderr: 95.2% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi119.rpmijj.log.gz 2024-09-13T22:03:19.543 INFO:teuthology.orchestra.run.smithi119.stderr: 93.3% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-13T22:03:19.822 INFO:teuthology.orchestra.run.smithi155.stderr: 93.4% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-13T22:03:19.927 INFO:teuthology.orchestra.run.smithi155.stderr: 93.3% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-13T22:03:20.065 INFO:teuthology.orchestra.run.smithi119.stderr: 93.3% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-13T22:03:20.411 INFO:teuthology.orchestra.run.smithi155.stderr: 93.5% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-13T22:03:29.698 INFO:teuthology.orchestra.run.smithi119.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-13T22:03:29.988 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-13T22:03:29.988 INFO:teuthology.orchestra.run.smithi155.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-13T22:03:53.823 INFO:teuthology.orchestra.run.smithi155.stderr: 93.3% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi155.yblkxo.log.gz 2024-09-13T22:03:53.824 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-09-13T22:03:53.825 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m40.077s 2024-09-13T22:03:53.825 INFO:teuthology.orchestra.run.smithi155.stderr:user 1m16.778s 2024-09-13T22:03:53.825 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m2.454s 2024-09-13T22:03:58.109 INFO:teuthology.orchestra.run.smithi119.stderr: 93.1% -- replaced with /var/log/ceph/f9722044-7217-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi119.yydzwt.log.gz 2024-09-13T22:03:58.111 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-13T22:03:58.111 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m44.365s 2024-09-13T22:03:58.111 INFO:teuthology.orchestra.run.smithi119.stderr:user 1m22.072s 2024-09-13T22:03:58.111 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m2.656s 2024-09-13T22:03:58.112 INFO:tasks.cephadm:Archiving logs... 2024-09-13T22:03:58.112 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904198/remote/smithi119/log 2024-09-13T22:03:58.114 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T22:04:09.271 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904198/remote/smithi155/log 2024-09-13T22:04:09.273 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T22:04:20.040 INFO:tasks.cephadm:Removing cluster... 2024-09-13T22:04:20.041 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9722044-7217-11ef-bceb-c7b262605968 --force 2024-09-13T22:04:20.859 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9722044-7217-11ef-bceb-c7b262605968 --force 2024-09-13T22:04:21.520 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T22:04:21.520 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T22:04:21.537 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T22:04:21.553 INFO:tasks.cephadm:Teardown complete 2024-09-13T22:04:21.553 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T22:04:21.564 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T22:04:21.565 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T22:04:21.565 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T22:04:21.580 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T22:04:21.687 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T22:04:21.698 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T22:04:21.698 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T22:04:21.701 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T22:04:21.714 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-13T22:04:21.715 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-09-13T22:04:21.721 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T22:04:21.721 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-13T22:04:21.721 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 -236us[ -221us] +/- 52ms 2024-09-13T22:04:21.721 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 +548us[ +562us] +/- 67ms 2024-09-13T22:04:21.721 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -247us[ -233us] +/- 71ms 2024-09-13T22:04:21.721 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:04:21.722 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T22:04:21.722 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-09-13T22:04:21.723 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv01.front.sepia.ceph.com 3 6 377 34 -224us[ -221us] +/- 52ms 2024-09-13T22:04:21.723 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 +543us[ +546us] +/- 67ms 2024-09-13T22:04:21.723 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -247us[ -245us] +/- 71ms 2024-09-13T22:04:21.723 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:04:21.723 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T22:04:21.734 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T22:04:21.734 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T22:04:21.744 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T22:04:21.841 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T22:04:21.917 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T22:04:21.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:04:21.946 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T22:04:21.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:04:21.975 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T22:04:21.987 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T22:04:22.003 INFO:teuthology.task.internal:Duration was 2145.381161 seconds 2024-09-13T22:04:22.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T22:04:22.015 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T22:04:22.015 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T22:04:22.018 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T22:04:22.054 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T22:04:22.057 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T22:04:22.423 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T22:04:22.423 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-09-13T22:04:22.424 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T22:04:22.484 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-09-13T22:04:22.485 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T22:04:22.513 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T22:04:22.513 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T22:04:22.527 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T22:04:22.581 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T22:04:22.581 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T22:04:22.594 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T22:04:23.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T22:04:23.295 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T22:04:23.295 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T22:04:23.320 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T22:04:23.347 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T22:04:23.360 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T22:04:23.363 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T22:04:23.384 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-09-13T22:04:23.411 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-09-13T22:04:23.436 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T22:04:23.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:04:23.485 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T22:04:23.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:04:23.500 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T22:04:23.512 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T22:04:23.513 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904198/remote/smithi119 2024-09-13T22:04:23.513 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T22:04:23.593 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904198/remote/smithi155 2024-09-13T22:04:23.594 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T22:04:23.633 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T22:04:23.633 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T22:04:23.636 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T22:04:23.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T22:04:23.695 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T22:04:23.695 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T22:04:23.706 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T22:04:23.706 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T22:04:23.708 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T22:04:23.721 INFO:teuthology.orchestra.run.smithi119.stdout: 262169 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 13 22:04 /home/ubuntu/cephtest 2024-09-13T22:04:23.721 INFO:teuthology.orchestra.run.smithi119.stdout: 655697 4 d--------- 2 ubuntu ubuntu 4096 Sep 13 21:42 /home/ubuntu/cephtest/mnt.0 2024-09-13T22:04:23.722 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-13T22:04:23.722 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-13T22:04:23.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:04:23.724 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi119 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-13T22:04:23.725 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T22:04:23.737 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T22:04:23.749 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T22:04:23.752 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2145.3811609745026 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-13T22:04:23.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T22:04:23.849 INFO:teuthology.run:FAIL